2024-09-19T08:40:49.842 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:40:49.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:40:49.961 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911875' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyzfrUU2GcziNIVqVrIgV5gIonHf0poEJDWjauXyxPNtvImbYALlfbvL2fRzhVFBXRx0U2ROiZthJI1xYgFxZA= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEkca7F4w5bWHCD4QDr/D7i45kRdAMRh5ZOlTRl+9CM9fuasxLaBAQxVx36kJWzkrmtFUwAxBxJzMgHrdfqvE0U= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-19T08:40:49.962 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:40:49.963 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:40:49.963 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:40:49.964 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:40:49.987 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:40:49.987 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:40:49.987 INFO:teuthology.packaging:ref: None 2024-09-19T08:40:49.987 INFO:teuthology.packaging:tag: None 2024-09-19T08:40:49.987 INFO:teuthology.packaging:branch: squid 2024-09-19T08:40:49.987 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:40:49.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:40:50.192 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:40:50.193 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:40:50.199 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:40:50.199 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:40:50.254 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:40:50.282 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:40:50.288 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:40:50.309 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:34:24.624648', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyzfrUU2GcziNIVqVrIgV5gIonHf0poEJDWjauXyxPNtvImbYALlfbvL2fRzhVFBXRx0U2ROiZthJI1xYgFxZA='} 2024-09-19T08:40:50.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:34:24.622849', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEkca7F4w5bWHCD4QDr/D7i45kRdAMRh5ZOlTRl+9CM9fuasxLaBAQxVx36kJWzkrmtFUwAxBxJzMgHrdfqvE0U='} 2024-09-19T08:40:50.331 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:40:50.337 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-19T08:40:50.337 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-19T08:40:50.337 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:40:50.420 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed4badbbe0>, signals=[15]) 2024-09-19T08:40:50.420 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:40:50.426 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:40:50.427 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:40:50.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:40:50.510 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T08:40:50.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:40:50.586 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:40:50.592 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-09-19T08:40:50.611 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-09-19T08:40:50.612 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-09-19T08:40:50.671 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-09-19T08:40:50.671 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-09-19T08:40:50.671 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-09-19T08:40:50.671 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:40:50.672 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:40:50.673 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-09-19T08:40:50.694 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-19T08:40:50.713 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-19T08:40:50.713 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-19T08:40:50.770 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-19T08:40:50.770 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-19T08:40:50.770 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-19T08:40:50.770 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:40:50.770 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:40:50.771 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:40:50.771 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-19T08:40:50.795 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:40:50.802 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:40:50.838 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:40:50.838 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:40:50.842 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:40:50.858 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:40:50.871 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:40:50.871 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:40:50.899 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:40:50.928 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:40:50.981 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:40:50.995 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:40:50.995 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T08:40:50.995 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:40:50.996 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:40:51.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:40:51.012 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-19T08:40:51.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:40:51.014 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-19T08:40:51.069 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:40:51.069 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-503.el9.x86_64 2024-09-19T08:40:51.069 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-09-19T08:40:51.072 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:40:51.072 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.14.0-503.el9.x86_64 2024-09-19T08:40:51.073 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2024-09-19T08:40:53.206 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-19T08:40:53.316 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T08:40:55.300 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-19T08:40:59.568 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T08:41:01.052 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-19T08:41:01.639 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-19T08:41:02.231 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T08:41:06.090 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T08:41:07.542 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-19T08:41:07.579 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T08:41:08.403 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T08:41:09.485 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:41:09.486 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:41:09.571 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:41:09.578 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:41:09.578 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-19T08:41:09.578 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:41:09.578 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:41:09.578 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:41:09.578 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:41:09.578 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:41:09.579 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:41:09.579 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:41:09.579 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:41:09.579 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:41:09.579 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:41:09.579 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-19T08:41:09.579 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:41:09.580 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 79 M 2024-09-19T08:41:09.580 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 126 M 2024-09-19T08:41:09.580 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:41:10.405 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 62 kB/s | 36 kB 00:00 2024-09-19T08:41:11.231 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T08:41:11.872 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-19T08:41:12.856 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-19T08:41:12.857 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:41:12.857 INFO:teuthology.orchestra.run.smithi102.stdout:Total 24 MB/s | 79 MB 00:03 2024-09-19T08:41:13.540 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:41:13.894 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:41:13.894 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:41:14.051 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:41:14.839 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:41:14.839 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:41:15.982 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:41:15.983 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:41:16.079 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:41:16.088 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:41:16.089 INFO:teuthology.orchestra.run.smithi049.stdout:Install 4 Packages 2024-09-19T08:41:16.090 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:41:16.090 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 79 M 2024-09-19T08:41:16.090 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 126 M 2024-09-19T08:41:16.090 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:41:16.327 INFO:teuthology.orchestra.run.smithi049.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 335 kB/s | 36 kB 00:00 2024-09-19T08:41:16.719 INFO:teuthology.orchestra.run.smithi049.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-19T08:41:17.103 INFO:teuthology.orchestra.run.smithi049.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-19T08:41:17.274 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:41:17.420 INFO:teuthology.orchestra.run.smithi049.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-19T08:41:17.421 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:41:17.421 INFO:teuthology.orchestra.run.smithi049.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-19T08:41:17.907 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:41:17.999 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:41:18.133 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:41:18.543 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:41:18.544 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:41:19.552 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:41:19.552 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:41:20.740 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:41:20.870 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:41:22.136 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:41:22.808 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:41:22.896 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:41:25.672 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:41:25.712 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:41:25.780 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:41:25.924 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:41:30.551 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:41:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:41:31.183 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:41:36.570 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:08.949 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:08.988 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:42:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:42:09.369 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:42:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:10.218 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:42:10.219 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:42:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:42:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:42:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:42:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:42:10.219 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:42:10.219 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:42:10.578 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:42:10.659 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:42:10.660 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:42:10.660 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:42:10.660 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:42:10.660 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:42:10.660 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-19T08:42:10.661 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:42:10.661 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:42:10.719 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:42:10.720 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:42:10.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 82.el9 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8274670 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-09-19T08:42:10.753 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:42:10.754 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-09-19T08:42:10.755 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:42:10.755 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:42:10.755 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:42:10.756 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:42:10.756 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:42:11.443 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-19T08:42:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:42:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-19T08:42:12.765 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-19T08:42:12.781 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.TnhKFVBGxJ 2024-09-19T08:42:12.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TnhKFVBGxJ 2024-09-19T08:42:12.848 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.TnhKFVBGxJ 2024-09-19T08:42:13.001 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.TnhKFVBGxJ is 6KB 2024-09-19T08:42:13.050 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.TnhKFVBGxJ 2024-09-19T08:42:13.065 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:42:13.127 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:42:13.127 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:42:13.128 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:42:13.128 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:42:13.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:42:13.272 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-19T08:42:17.020 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:17.062 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:17.465 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:17.465 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:42:17.465 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:42:17.466 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:42:18.304 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:42:18.661 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:42:18.738 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:42:18.739 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:42:18.739 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:42:18.739 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:42:18.739 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:42:18.739 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-19T08:42:18.739 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:42:18.739 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:42:18.800 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:42:18.800 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:42:18.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2024-09-19T08:42:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2024-09-19T08:42:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2024-09-19T08:42:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.06 2024-09-19T08:42:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 82.el9 2024-09-19T08:42:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2024-09-19T08:42:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:42:18.838 INFO:teuthology.orchestra.run.smithi049.stdout:Group : Unspecified 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 8274670 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : builder@centos.org 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2024-09-19T08:42:18.839 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2024-09-19T08:42:18.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:42:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:42:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:42:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:42:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2024-09-19T08:42:18.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:42:18.840 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:42:18.841 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:42:18.841 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:42:18.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:42:19.609 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-09-19T08:42:21.106 INFO:teuthology.orchestra.run.smithi049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:42:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-09-19T08:42:21.141 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-09-19T08:42:21.157 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.YJdyzdKtHE 2024-09-19T08:42:21.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YJdyzdKtHE 2024-09-19T08:42:21.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.YJdyzdKtHE 2024-09-19T08:42:21.371 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.YJdyzdKtHE is 6KB 2024-09-19T08:42:21.391 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.YJdyzdKtHE 2024-09-19T08:42:21.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:42:21.469 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:42:21.470 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:42:21.470 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:42:21.470 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:42:21.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:42:21.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-09-19T08:42:43.296 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-19T08:42:43.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T08:42:43.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:42:51.642 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-19T08:42:51.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:42:51.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:01.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-19T08:43:10.013 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-19T08:43:10.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T08:43:10.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:13.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-19T08:43:19.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:43:19.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:22.081 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-19T08:43:25.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T08:43:25.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:34.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:43:34.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:37.149 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-19T08:43:52.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:43:52.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:55.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-19T08:43:57.737 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-19T08:43:58.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T08:43:58.297 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:43:58.297 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-19T08:43:58.313 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:43:58.313 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:43:58.313 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:43:58.314 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:43:59.314 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-19T08:43:59.315 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:43:59.457 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-19T08:43:59.484 DEBUG:teuthology.parallel:result is None 2024-09-19T08:44:13.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:44:13.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:13.235 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T08:45:34.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:45:34.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:34.509 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-19T08:45:34.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:45:34.864 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:45:34.865 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-19T08:45:34.881 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:45:34.882 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:45:34.882 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:45:34.882 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:45:35.883 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-19T08:45:35.883 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:45:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2024-09-19T08:45:35.990 DEBUG:teuthology.parallel:result is None 2024-09-19T08:45:35.990 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:45:35.997 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:45:35.997 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:45:36.000 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:45:36.019 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:45:36.025 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:45:36.058 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:45:36.058 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:45:36.061 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:45:36.092 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:45:36.098 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:45:36.099 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:45:36.129 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:45:36.161 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:45:36.166 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:45:36.173 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:45:36.178 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:45:36.180 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:45:36.186 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:45:36.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:45:36.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:45:36.246 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:45:36.255 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:45:36.255 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:45:36.287 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:45:36.303 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:45:36.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:45:36.435 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:45:36.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:45:36.561 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:45:36.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:45:36.627 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:45:36.669 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:45:36.720 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:45:36.806 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:45:36.846 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:45:36.846 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:45:36.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-09-19T08:45:36.914 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-19T08:45:36.955 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:45:36.995 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:45:37.335 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:45:37.343 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:45:37.343 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:45:37.379 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:45:37.411 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:45:37.411 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-09-19T08:45:37.451 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-09-19T08:45:37.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-19T08:45:37.505 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-19T08:45:37.507 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:45:37.508 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-09-19T08:45:37.535 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-09-19T08:45:37.535 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-19T08:45:37.572 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-19T08:45:37.572 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:45:37.572 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:45:37.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:45:37.604 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:45:37.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:45:37.637 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:45:37.637 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:45:37.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:45:37.713 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:45:37.722 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:45:37.733 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:45:37.734 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:49:26.091 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-19T08:49:26.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:49:26.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:49:26.176 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-19T08:49:26.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-19T08:49:26.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T08:49:26.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:49:26.341 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-19T08:49:26.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T08:49:26.420 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:49:26.431 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:49:26.431 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:49:26.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:49:26.434 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:49:26.434 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:49:26.464 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:49:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:49:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:49:26.504 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:49:26.506 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-09-19T08:49:26.518 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-09-19T08:49:26.528 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-19T08:49:26.533 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:49:26.539 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-19T08:49:26.548 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:49:26.553 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:49:26.566 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:49:26.606 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:49:26.610 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:49:26.610 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-19T08:49:26.610 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.610 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.610 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.610 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.621 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:49:26.624 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:49:26.624 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-19T08:49:26.624 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.625 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.625 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.625 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:49:26.626 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:49:26.634 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:49:26.634 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:49:26.634 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:49:26.634 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:49:26.640 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:49:26.640 INFO:teuthology.task.install:extra packages: [] 2024-09-19T08:49:26.641 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:49:26.641 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:49:26.641 INFO:teuthology.packaging:ref: None 2024-09-19T08:49:26.641 INFO:teuthology.packaging:tag: None 2024-09-19T08:49:26.641 INFO:teuthology.packaging:branch: reef 2024-09-19T08:49:26.641 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:49:26.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-19T08:49:26.644 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:49:26.644 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:49:26.644 INFO:teuthology.packaging:ref: None 2024-09-19T08:49:26.644 INFO:teuthology.packaging:tag: None 2024-09-19T08:49:26.644 INFO:teuthology.packaging:branch: reef 2024-09-19T08:49:26.645 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:49:26.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-19T08:49:26.874 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/ 2024-09-19T08:49:26.875 INFO:teuthology.task.install.rpm:Package version is 18.2.4-855.g19e2a2be 2024-09-19T08:49:26.916 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/ 2024-09-19T08:49:26.916 INFO:teuthology.task.install.rpm:Package version is 18.2.4-855.g19e2a2be 2024-09-19T08:49:26.983 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:49:26.983 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:49:26.983 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:49:27.011 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T08:49:27.012 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:49:27.012 INFO:teuthology.packaging:ref: None 2024-09-19T08:49:27.012 INFO:teuthology.packaging:tag: None 2024-09-19T08:49:27.012 INFO:teuthology.packaging:branch: reef 2024-09-19T08:49:27.012 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:49:27.012 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:49:27.023 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:49:27.023 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:49:27.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:49:27.051 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T08:49:27.051 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:49:27.051 INFO:teuthology.packaging:ref: None 2024-09-19T08:49:27.051 INFO:teuthology.packaging:tag: None 2024-09-19T08:49:27.051 INFO:teuthology.packaging:branch: reef 2024-09-19T08:49:27.051 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:49:27.052 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:49:27.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:49:27.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:49:27.155 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:49:27.197 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:49:27.221 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-19T08:49:27.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-19T08:49:27.262 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-09-19T08:49:27.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-09-19T08:49:27.456 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-19T08:49:27.483 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw 2024-09-19T08:49:27.501 INFO:teuthology.orchestra.run.smithi049.stdout:45 files removed 2024-09-19T08:49:27.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw 2024-09-19T08:49:28.043 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 282 kB/s | 77 kB 00:00 2024-09-19T08:49:28.103 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 281 kB/s | 77 kB 00:00 2024-09-19T08:49:28.343 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 47 kB/s | 11 kB 00:00 2024-09-19T08:49:28.387 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-19T08:49:28.628 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-19T08:49:28.663 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T08:49:29.396 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T08:49:30.528 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-19T08:49:34.370 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 20 MB 00:02 2024-09-19T08:49:37.380 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 20 MB 00:06 2024-09-19T08:49:38.679 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T08:49:40.247 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-19T08:49:41.260 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T08:49:44.480 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.5 MB 00:03 2024-09-19T08:49:46.666 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:49:46.856 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-19T08:49:47.743 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T08:49:48.950 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:49:48.960 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 7.7 M 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.3 M 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:49:48.961 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 5.1 M 2024-09-19T08:49:48.962 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 18 M 2024-09-19T08:49:48.962 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 25 k 2024-09-19T08:49:48.962 INFO:teuthology.orchestra.run.smithi102.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-19T08:49:48.962 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:49:48.962 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:49:48.962 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:49:48.962 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 712 k 2024-09-19T08:49:48.963 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:49:48.963 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:49:48.963 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:49:48.963 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 477 k 2024-09-19T08:49:48.963 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.5 M 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 45 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 129 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 162 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 321 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 300 k 2024-09-19T08:49:48.964 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 99 k 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout:Install 28 Packages 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 2 Packages 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:49:48.965 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 53 M 2024-09-19T08:49:48.966 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:49:49.684 INFO:teuthology.orchestra.run.smithi102.stdout:(1/30): ceph-base-18.2.4-855.g19e2a2be.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-19T08:49:49.917 INFO:teuthology.orchestra.run.smithi102.stdout:(2/30): ceph-radosgw-18.2.4-855.g19e2a2be.el9.x 12 MB/s | 7.7 MB 00:00 2024-09-19T08:49:49.967 INFO:teuthology.orchestra.run.smithi102.stdout:(3/30): ceph-selinux-18.2.4-855.g19e2a2be.el9.x 89 kB/s | 25 kB 00:00 2024-09-19T08:49:50.468 INFO:teuthology.orchestra.run.smithi102.stdout:(4/30): ceph-common-18.2.4-855.g19e2a2be.el9.x8 15 MB/s | 18 MB 00:01 2024-09-19T08:49:50.501 INFO:teuthology.orchestra.run.smithi102.stdout:(5/30): libradosstriper1-18.2.4-855.g19e2a2be.e 894 kB/s | 477 kB 00:00 2024-09-19T08:49:50.535 INFO:teuthology.orchestra.run.smithi102.stdout:(6/30): libcephfs2-18.2.4-855.g19e2a2be.el9.x86 1.1 MB/s | 712 kB 00:00 2024-09-19T08:49:50.552 INFO:teuthology.orchestra.run.smithi102.stdout:(7/30): python3-ceph-argparse-18.2.4-855.g19e2a 898 kB/s | 45 kB 00:00 2024-09-19T08:49:50.594 INFO:teuthology.orchestra.run.smithi102.stdout:(8/30): python3-ceph-common-18.2.4-855.g19e2a2b 2.2 MB/s | 129 kB 00:00 2024-09-19T08:49:50.619 INFO:teuthology.orchestra.run.smithi102.stdout:(9/30): python3-cephfs-18.2.4-855.g19e2a2be.el9 2.4 MB/s | 162 kB 00:00 2024-09-19T08:49:50.686 INFO:teuthology.orchestra.run.smithi102.stdout:(10/30): librgw2-18.2.4-855.g19e2a2be.el9.x86_6 21 MB/s | 4.5 MB 00:00 2024-09-19T08:49:50.711 INFO:teuthology.orchestra.run.smithi102.stdout:(11/30): python3-rbd-18.2.4-855.g19e2a2be.el9.x 3.2 MB/s | 300 kB 00:00 2024-09-19T08:49:50.736 INFO:teuthology.orchestra.run.smithi102.stdout:(12/30): python3-rados-18.2.4-855.g19e2a2be.el9 2.2 MB/s | 321 kB 00:00 2024-09-19T08:49:50.762 INFO:teuthology.orchestra.run.smithi102.stdout:(13/30): python3-rgw-18.2.4-855.g19e2a2be.el9.x 1.3 MB/s | 99 kB 00:00 2024-09-19T08:49:50.904 INFO:teuthology.orchestra.run.smithi102.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2024-09-19T08:49:50.929 INFO:teuthology.orchestra.run.smithi102.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 492 kB/s | 107 kB 00:00 2024-09-19T08:49:50.954 INFO:teuthology.orchestra.run.smithi102.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 737 kB/s | 160 kB 00:00 2024-09-19T08:49:51.013 INFO:teuthology.orchestra.run.smithi102.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 726 kB/s | 42 kB 00:00 2024-09-19T08:49:51.046 INFO:teuthology.orchestra.run.smithi102.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T08:49:51.088 INFO:teuthology.orchestra.run.smithi102.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-19T08:49:51.139 INFO:teuthology.orchestra.run.smithi102.stdout:(20/30): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-09-19T08:49:51.172 INFO:teuthology.orchestra.run.smithi102.stdout:(21/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.5 MB/s | 308 kB 00:00 2024-09-19T08:49:51.206 INFO:teuthology.orchestra.run.smithi102.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2024-09-19T08:49:51.232 INFO:teuthology.orchestra.run.smithi102.stdout:(23/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-09-19T08:49:51.256 INFO:teuthology.orchestra.run.smithi102.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-19T08:49:51.290 INFO:teuthology.orchestra.run.smithi102.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T08:49:51.349 INFO:teuthology.orchestra.run.smithi102.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-19T08:49:51.415 INFO:teuthology.orchestra.run.smithi102.stdout:(27/30): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T08:49:51.466 INFO:teuthology.orchestra.run.smithi102.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-19T08:49:51.616 INFO:teuthology.orchestra.run.smithi102.stdout:(29/30): librados2-18.2.4-855.g19e2a2be.el9.x86 12 MB/s | 3.3 MB 00:00 2024-09-19T08:49:51.683 INFO:teuthology.orchestra.run.smithi102.stdout:(30/30): librbd1-18.2.4-855.g19e2a2be.el9.x86_6 11 MB/s | 3.0 MB 00:00 2024-09-19T08:49:51.687 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:49:51.688 INFO:teuthology.orchestra.run.smithi102.stdout:Total 19 MB/s | 53 MB 00:02 2024-09-19T08:49:51.758 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:49:51.793 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:49:51.793 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:49:52.401 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:49:52.401 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:49:53.449 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T08:49:53.799 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:49:53.881 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-19T08:49:53.913 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-19T08:49:53.963 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-19T08:49:54.342 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-19T08:49:54.395 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-19T08:49:54.487 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-19T08:49:54.571 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-19T08:49:54.597 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-19T08:49:54.668 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-19T08:49:54.704 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-19T08:49:54.748 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 9/32 2024-09-19T08:49:54.814 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-19T08:49:54.841 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-19T08:49:54.899 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-19T08:49:55.003 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-19T08:49:55.040 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-19T08:49:55.094 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-19T08:49:55.129 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-19T08:49:55.156 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-19T08:49:55.192 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-19T08:49:55.225 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-19T08:49:55.524 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-19T08:49:55.563 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-19T08:49:55.653 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-19T08:49:55.685 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 21/32 2024-09-19T08:49:55.721 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-19T08:49:55.819 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:49:55.822 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 7.7 M 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.3 M 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 5.1 M 2024-09-19T08:49:55.823 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 18 M 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 25 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 712 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 477 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:49:55.824 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.5 M 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 45 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 129 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 162 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 321 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 300 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 99 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:49:55.825 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:49:55.826 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:49:55.826 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:49:55.826 INFO:teuthology.orchestra.run.smithi049.stdout:Install 28 Packages 2024-09-19T08:49:55.826 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 2 Packages 2024-09-19T08:49:55.826 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:49:55.826 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 53 M 2024-09-19T08:49:55.826 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:49:56.125 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-19T08:49:56.149 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-19T08:49:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-19T08:49:56.322 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 25/32 2024-09-19T08:49:56.360 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 26/32 2024-09-19T08:49:56.892 INFO:teuthology.orchestra.run.smithi049.stdout:(1/30): ceph-base-18.2.4-855.g19e2a2be.el9.x86_ 8.9 MB/s | 5.1 MB 00:00 2024-09-19T08:49:56.992 INFO:teuthology.orchestra.run.smithi049.stdout:(2/30): ceph-radosgw-18.2.4-855.g19e2a2be.el9.x 12 MB/s | 7.7 MB 00:00 2024-09-19T08:49:57.017 INFO:teuthology.orchestra.run.smithi049.stdout:(3/30): ceph-selinux-18.2.4-855.g19e2a2be.el9.x 201 kB/s | 25 kB 00:00 2024-09-19T08:49:57.059 INFO:teuthology.orchestra.run.smithi049.stdout:(4/30): libcephfs2-18.2.4-855.g19e2a2be.el9.x86 10 MB/s | 712 kB 00:00 2024-09-19T08:49:57.085 INFO:teuthology.orchestra.run.smithi049.stdout:(5/30): libradosstriper1-18.2.4-855.g19e2a2be.e 7.0 MB/s | 477 kB 00:00 2024-09-19T08:49:57.143 INFO:teuthology.orchestra.run.smithi049.stdout:(6/30): python3-ceph-argparse-18.2.4-855.g19e2a 772 kB/s | 45 kB 00:00 2024-09-19T08:49:57.227 INFO:teuthology.orchestra.run.smithi049.stdout:(7/30): python3-ceph-common-18.2.4-855.g19e2a2b 1.5 MB/s | 129 kB 00:00 2024-09-19T08:49:57.294 INFO:teuthology.orchestra.run.smithi049.stdout:(8/30): librgw2-18.2.4-855.g19e2a2be.el9.x86_64 19 MB/s | 4.5 MB 00:00 2024-09-19T08:49:57.319 INFO:teuthology.orchestra.run.smithi049.stdout:(9/30): python3-cephfs-18.2.4-855.g19e2a2be.el9 1.7 MB/s | 162 kB 00:00 2024-09-19T08:49:57.344 INFO:teuthology.orchestra.run.smithi049.stdout:(10/30): python3-rados-18.2.4-855.g19e2a2be.el9 6.2 MB/s | 321 kB 00:00 2024-09-19T08:49:57.378 INFO:teuthology.orchestra.run.smithi049.stdout:(11/30): python3-rbd-18.2.4-855.g19e2a2be.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-19T08:49:57.403 INFO:teuthology.orchestra.run.smithi049.stdout:(12/30): python3-rgw-18.2.4-855.g19e2a2be.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-19T08:49:57.587 INFO:teuthology.orchestra.run.smithi049.stdout:(13/30): ceph-common-18.2.4-855.g19e2a2be.el9.x 15 MB/s | 18 MB 00:01 2024-09-19T08:49:57.645 INFO:teuthology.orchestra.run.smithi049.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 400 kB/s | 107 kB 00:00 2024-09-19T08:49:57.689 INFO:teuthology.orchestra.run.smithi049.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 442 kB/s | 45 kB 00:00 2024-09-19T08:49:57.732 INFO:teuthology.orchestra.run.smithi049.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 488 kB/s | 160 kB 00:00 2024-09-19T08:49:57.765 INFO:teuthology.orchestra.run.smithi049.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 5.4 MB/s | 662 kB 00:00 2024-09-19T08:49:57.790 INFO:teuthology.orchestra.run.smithi049.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 723 kB/s | 42 kB 00:00 2024-09-19T08:49:57.816 INFO:teuthology.orchestra.run.smithi049.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-19T08:49:57.874 INFO:teuthology.orchestra.run.smithi049.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-09-19T08:49:57.900 INFO:teuthology.orchestra.run.smithi049.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-19T08:49:57.925 INFO:teuthology.orchestra.run.smithi049.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T08:49:57.958 INFO:teuthology.orchestra.run.smithi049.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.8 MB/s | 308 kB 00:00 2024-09-19T08:49:57.984 INFO:teuthology.orchestra.run.smithi049.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-19T08:49:58.017 INFO:teuthology.orchestra.run.smithi049.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T08:49:58.051 INFO:teuthology.orchestra.run.smithi049.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-19T08:49:58.110 INFO:teuthology.orchestra.run.smithi049.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T08:49:58.277 INFO:teuthology.orchestra.run.smithi049.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-19T08:49:58.360 INFO:teuthology.orchestra.run.smithi049.stdout:(29/30): librados2-18.2.4-855.g19e2a2be.el9.x86 11 MB/s | 3.3 MB 00:00 2024-09-19T08:49:58.419 INFO:teuthology.orchestra.run.smithi049.stdout:(30/30): librbd1-18.2.4-855.g19e2a2be.el9.x86_6 9.8 MB/s | 3.0 MB 00:00 2024-09-19T08:49:58.424 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:49:58.424 INFO:teuthology.orchestra.run.smithi049.stdout:Total 20 MB/s | 53 MB 00:02 2024-09-19T08:49:58.466 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-19T08:49:58.500 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:49:58.506 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-19T08:49:58.540 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:49:58.541 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:49:59.037 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-19T08:49:59.077 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-19T08:49:59.161 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:49:59.161 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:49:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-19T08:49:59.174 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:49:59.174 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:49:59.175 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:49:59.203 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-19T08:50:00.571 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:50:00.679 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-19T08:50:00.707 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-19T08:50:00.767 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-19T08:50:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-19T08:50:01.231 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-19T08:50:01.324 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-19T08:50:01.410 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-19T08:50:01.441 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-19T08:50:01.503 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-19T08:50:01.532 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-19T08:50:01.576 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 9/32 2024-09-19T08:50:01.652 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-19T08:50:01.676 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-19T08:50:01.742 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-19T08:50:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-19T08:50:01.884 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-19T08:50:01.933 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-19T08:50:01.973 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-19T08:50:02.009 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-19T08:50:02.045 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-19T08:50:02.100 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-19T08:50:02.419 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-19T08:50:02.457 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-19T08:50:02.562 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 20/32 2024-09-19T08:50:02.601 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 21/32 2024-09-19T08:50:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-19T08:50:03.074 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-19T08:50:03.101 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-19T08:50:03.157 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 24/32 2024-09-19T08:50:03.235 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 25/32 2024-09-19T08:50:03.270 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 26/32 2024-09-19T08:50:05.705 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-19T08:50:05.734 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-19T08:50:06.309 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 27/32 2024-09-19T08:50:06.354 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-19T08:50:06.443 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 28/32 2024-09-19T08:50:06.443 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:50:06.443 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:50:06.443 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:06.488 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-19T08:50:09.198 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-19T08:50:09.199 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:09.937 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-19T08:50:09.962 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-19T08:50:09.963 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:09.963 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:50:09.963 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:50:09.963 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:50:09.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:09.964 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-19T08:50:10.047 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-19T08:50:10.047 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-19T08:50:11.173 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 1/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 3/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 4/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 8/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 9/32 2024-09-19T08:50:11.174 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 12/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 13/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-19T08:50:11.175 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-19T08:50:11.176 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 31/32 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.123 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:50:12.124 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:12.125 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:12.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-test 2024-09-19T08:50:13.043 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:27 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:13.178 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:13.178 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:13.178 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 40 M 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 166 k 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-19T08:50:13.179 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:13.180 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 40 M 2024-09-19T08:50:13.180 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 164 M 2024-09-19T08:50:13.180 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:50:13.389 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-19T08:50:13.455 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 957 kB/s | 64 kB 00:00 2024-09-19T08:50:13.480 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): libcephsqlite-18.2.4-855.g19e2a2be.el9.x 656 kB/s | 166 kB 00:00 2024-09-19T08:50:14.714 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): ceph-test-18.2.4-855.g19e2a2be.el9.x86_6 27 MB/s | 40 MB 00:01 2024-09-19T08:50:14.716 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:14.716 INFO:teuthology.orchestra.run.smithi102.stdout:Total 26 MB/s | 40 MB 00:01 2024-09-19T08:50:14.743 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:50:14.763 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:50:14.764 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:50:15.086 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:50:15.086 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:50:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:50:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T08:50:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T08:50:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-19T08:50:17.114 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-09-19T08:50:17.115 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:17.897 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-19T08:50:17.924 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 30/32 2024-09-19T08:50:17.924 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:17.924 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:50:17.924 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:50:17.924 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:50:17.924 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:17.927 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-19T08:50:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-19T08:50:18.017 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-19T08:50:19.318 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-19T08:50:19.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 1/32 2024-09-19T08:50:19.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2/32 2024-09-19T08:50:19.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 3/32 2024-09-19T08:50:19.318 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 4/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 5/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 6/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 7/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x 8/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86 9/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 10/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 11/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 12/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 13/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-19T08:50:19.319 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-19T08:50:19.320 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-19T08:50:19.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-19T08:50:19.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-19T08:50:19.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 29/32 2024-09-19T08:50:19.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-19T08:50:19.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 31/32 2024-09-19T08:50:19.379 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-19T08:50:19.455 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-19T08:50:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-19T08:50:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:20.215 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-09-19T08:50:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.215 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.215 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:50:20.216 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.217 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:50:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:50:20.218 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:20.218 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:20.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-test 2024-09-19T08:50:21.174 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:28 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:21.311 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 40 M 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 166 k 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:50:21.312 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:21.313 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:50:21.313 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:21.313 INFO:teuthology.orchestra.run.smithi049.stdout:Install 4 Packages 2024-09-19T08:50:21.313 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:21.313 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 40 M 2024-09-19T08:50:21.313 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 164 M 2024-09-19T08:50:21.313 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:50:21.422 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-19T08:50:21.422 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 1/4 2024-09-19T08:50:21.423 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2/4 2024-09-19T08:50:21.423 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T08:50:21.572 INFO:teuthology.orchestra.run.smithi049.stdout:(1/4): libcephsqlite-18.2.4-855.g19e2a2be.el9.x 785 kB/s | 166 kB 00:00 2024-09-19T08:50:21.708 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:21.709 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:22.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph 2024-09-19T08:50:22.147 INFO:teuthology.orchestra.run.smithi049.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 387 kB/s | 304 kB 00:00 2024-09-19T08:50:22.189 INFO:teuthology.orchestra.run.smithi049.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-19T08:50:22.625 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:36 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:22.656 INFO:teuthology.orchestra.run.smithi049.stdout:(4/4): ceph-test-18.2.4-855.g19e2a2be.el9.x86_6 31 MB/s | 40 MB 00:01 2024-09-19T08:50:22.658 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:22.658 INFO:teuthology.orchestra.run.smithi049.stdout:Total 30 MB/s | 40 MB 00:01 2024-09-19T08:50:22.686 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:50:22.709 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:50:22.709 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:50:22.763 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:22.765 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:22.765 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 6.5 k 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 2.1 M 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 1.5 M 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 246 k 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.7 M 2024-09-19T08:50:22.766 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 17 M 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:50:22.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:50:22.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout:Install 33 Packages 2024-09-19T08:50:22.769 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:22.770 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 29 M 2024-09-19T08:50:22.770 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 104 M 2024-09-19T08:50:22.770 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:50:23.059 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:50:23.059 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:50:23.149 INFO:teuthology.orchestra.run.smithi102.stdout:(1/33): ceph-18.2.4-855.g19e2a2be.el9.x86_64.rp 55 kB/s | 6.5 kB 00:00 2024-09-19T08:50:23.341 INFO:teuthology.orchestra.run.smithi102.stdout:(2/33): ceph-mgr-18.2.4-855.g19e2a2be.el9.x86_6 4.7 MB/s | 1.5 MB 00:00 2024-09-19T08:50:23.391 INFO:teuthology.orchestra.run.smithi102.stdout:(3/33): ceph-mds-18.2.4-855.g19e2a2be.el9.x86_6 5.8 MB/s | 2.1 MB 00:00 2024-09-19T08:50:23.483 INFO:teuthology.orchestra.run.smithi102.stdout:(4/33): ceph-mgr-modules-core-18.2.4-855.g19e2a 2.6 MB/s | 246 kB 00:00 2024-09-19T08:50:23.542 INFO:teuthology.orchestra.run.smithi102.stdout:(5/33): ceph-mon-18.2.4-855.g19e2a2be.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-19T08:50:23.593 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:50:23.658 INFO:teuthology.orchestra.run.smithi102.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-19T08:50:23.666 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T08:50:23.710 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T08:50:23.725 INFO:teuthology.orchestra.run.smithi102.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 6.7 MB/s | 1.2 MB 00:00 2024-09-19T08:50:23.732 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-19T08:50:23.751 INFO:teuthology.orchestra.run.smithi102.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-19T08:50:23.926 INFO:teuthology.orchestra.run.smithi102.stdout:(9/33): ceph-osd-18.2.4-855.g19e2a2be.el9.x86_6 28 MB/s | 17 MB 00:00 2024-09-19T08:50:23.952 INFO:teuthology.orchestra.run.smithi102.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 623 kB/s | 125 kB 00:00 2024-09-19T08:50:23.988 INFO:teuthology.orchestra.run.smithi102.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 515 kB/s | 135 kB 00:00 2024-09-19T08:50:24.064 INFO:teuthology.orchestra.run.smithi102.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 462 kB/s | 35 kB 00:00 2024-09-19T08:50:24.089 INFO:teuthology.orchestra.run.smithi102.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-19T08:50:24.114 INFO:teuthology.orchestra.run.smithi102.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T08:50:24.139 INFO:teuthology.orchestra.run.smithi102.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-19T08:50:24.165 INFO:teuthology.orchestra.run.smithi102.stdout:(16/33): python3-urllib3-1.26.5-6.el9.noarch.rp 901 kB/s | 215 kB 00:00 2024-09-19T08:50:24.215 INFO:teuthology.orchestra.run.smithi102.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-19T08:50:24.240 INFO:teuthology.orchestra.run.smithi102.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 459 kB/s | 11 kB 00:00 2024-09-19T08:50:24.266 INFO:teuthology.orchestra.run.smithi102.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T08:50:24.291 INFO:teuthology.orchestra.run.smithi102.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 350 kB/s | 18 kB 00:00 2024-09-19T08:50:24.316 INFO:teuthology.orchestra.run.smithi102.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-19T08:50:24.342 INFO:teuthology.orchestra.run.smithi102.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-19T08:50:24.367 INFO:teuthology.orchestra.run.smithi102.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-19T08:50:24.392 INFO:teuthology.orchestra.run.smithi102.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-19T08:50:24.417 INFO:teuthology.orchestra.run.smithi102.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-19T08:50:24.443 INFO:teuthology.orchestra.run.smithi102.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-19T08:50:24.468 INFO:teuthology.orchestra.run.smithi102.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-19T08:50:24.493 INFO:teuthology.orchestra.run.smithi102.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-19T08:50:24.518 INFO:teuthology.orchestra.run.smithi102.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-19T08:50:24.552 INFO:teuthology.orchestra.run.smithi102.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-19T08:50:24.577 INFO:teuthology.orchestra.run.smithi102.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-19T08:50:24.602 INFO:teuthology.orchestra.run.smithi102.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-19T08:50:24.628 INFO:teuthology.orchestra.run.smithi102.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-19T08:50:24.634 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:24.634 INFO:teuthology.orchestra.run.smithi102.stdout:Total 16 MB/s | 29 MB 00:01 2024-09-19T08:50:24.750 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:50:24.786 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:50:24.786 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:50:25.197 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:50:25.197 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:50:26.457 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:50:26.523 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-19T08:50:26.555 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-19T08:50:26.588 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-19T08:50:26.680 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-19T08:50:26.758 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-19T08:50:26.807 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-19T08:50:26.851 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-19T08:50:26.881 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-19T08:50:26.915 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-19T08:50:26.948 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-19T08:50:26.981 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-19T08:50:27.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-19T08:50:27.050 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-19T08:50:27.089 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-19T08:50:27.162 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-19T08:50:27.301 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-19T08:50:27.382 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-19T08:50:27.436 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-19T08:50:27.474 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-19T08:50:27.531 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-19T08:50:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-19T08:50:27.640 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 3/4 2024-09-19T08:50:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-19T08:50:27.784 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-19T08:50:27.836 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-19T08:50:27.923 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-19T08:50:28.012 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-19T08:50:28.060 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-19T08:50:28.178 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-19T08:50:28.328 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 28/33 2024-09-19T08:50:28.353 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-19T08:50:28.380 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-19T08:50:28.380 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:28.380 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:50:28.380 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:50:28.380 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:50:28.380 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:29.719 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 4/4 2024-09-19T08:50:29.719 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 1/4 2024-09-19T08:50:29.719 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2/4 2024-09-19T08:50:29.719 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T08:50:29.788 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-19T08:50:29.815 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-19T08:50:29.815 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:29.815 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:50:29.815 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:50:29.815 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:50:29.816 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:30.048 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T08:50:30.048 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:30.049 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:50:30.049 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:30.049 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:30.049 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:50:30.049 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:50:30.049 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:30.049 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:50:30.301 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:30.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph 2024-09-19T08:50:30.497 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-19T08:50:30.521 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-19T08:50:30.521 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:30.521 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:50:30.521 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:50:30.521 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:50:30.521 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:30.578 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-19T08:50:31.011 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:38 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:31.154 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:31.157 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:50:31.157 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:31.157 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:50:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 6.5 k 2024-09-19T08:50:31.157 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 2.1 M 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 1.5 M 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 246 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 4.7 M 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 17 M 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:50:31.158 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:50:31.159 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout:Install 33 Packages 2024-09-19T08:50:31.160 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:31.161 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 29 M 2024-09-19T08:50:31.161 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 104 M 2024-09-19T08:50:31.161 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:50:31.374 INFO:teuthology.orchestra.run.smithi049.stdout:(1/33): ceph-18.2.4-855.g19e2a2be.el9.x86_64.rp 48 kB/s | 6.5 kB 00:00 2024-09-19T08:50:31.515 INFO:teuthology.orchestra.run.smithi049.stdout:(2/33): ceph-mgr-18.2.4-855.g19e2a2be.el9.x86_6 5.2 MB/s | 1.5 MB 00:00 2024-09-19T08:50:31.591 INFO:teuthology.orchestra.run.smithi049.stdout:(3/33): ceph-mds-18.2.4-855.g19e2a2be.el9.x86_6 5.9 MB/s | 2.1 MB 00:00 2024-09-19T08:50:31.716 INFO:teuthology.orchestra.run.smithi049.stdout:(4/33): ceph-mon-18.2.4-855.g19e2a2be.el9.x86_6 14 MB/s | 4.7 MB 00:00 2024-09-19T08:50:31.758 INFO:teuthology.orchestra.run.smithi049.stdout:(5/33): ceph-mgr-modules-core-18.2.4-855.g19e2a 1.4 MB/s | 246 kB 00:00 2024-09-19T08:50:31.908 INFO:teuthology.orchestra.run.smithi049.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-19T08:50:32.092 INFO:teuthology.orchestra.run.smithi049.stdout:(7/33): ceph-osd-18.2.4-855.g19e2a2be.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-19T08:50:32.117 INFO:teuthology.orchestra.run.smithi049.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 511 kB/s | 106 kB 00:00 2024-09-19T08:50:32.151 INFO:teuthology.orchestra.run.smithi049.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 3.1 MB/s | 1.2 MB 00:00 2024-09-19T08:50:32.213 INFO:teuthology.orchestra.run.smithi049.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-09-19T08:50:32.213 INFO:teuthology.orchestra.run.smithi049.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-19T08:50:32.235 INFO:teuthology.orchestra.run.smithi049.stdout:(12/33): python3-pycparser-2.20-6.el9.noarch.rp 947 kB/s | 135 kB 00:00 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 1/33 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2/33 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 3/33 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 4/33 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 5/33 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 6/33 2024-09-19T08:50:32.353 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-19T08:50:32.354 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-19T08:50:32.355 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-19T08:50:32.356 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-19T08:50:32.356 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-19T08:50:32.356 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-19T08:50:32.356 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-19T08:50:32.356 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-19T08:50:32.356 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-19T08:50:32.357 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-19T08:50:32.493 INFO:teuthology.orchestra.run.smithi049.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-19T08:50:32.610 INFO:teuthology.orchestra.run.smithi049.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 136 kB/s | 51 kB 00:00 2024-09-19T08:50:32.652 INFO:teuthology.orchestra.run.smithi049.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-19T08:50:32.678 INFO:teuthology.orchestra.run.smithi049.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-19T08:50:32.702 INFO:teuthology.orchestra.run.smithi049.stdout:(17/33): python3-toml-0.10.2-6.el9.noarch.rpm 199 kB/s | 42 kB 00:00 2024-09-19T08:50:32.728 INFO:teuthology.orchestra.run.smithi049.stdout:(18/33): python3-mako-1.1.4-6.el9.noarch.rpm 312 kB/s | 172 kB 00:00 2024-09-19T08:50:32.770 INFO:teuthology.orchestra.run.smithi049.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-09-19T08:50:32.795 INFO:teuthology.orchestra.run.smithi049.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 301 kB/s | 18 kB 00:00 2024-09-19T08:50:32.820 INFO:teuthology.orchestra.run.smithi049.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 482 kB/s | 23 kB 00:00 2024-09-19T08:50:32.845 INFO:teuthology.orchestra.run.smithi049.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 783 kB/s | 19 kB 00:00 2024-09-19T08:50:32.866 INFO:teuthology.orchestra.run.smithi049.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 435 kB/s | 20 kB 00:00 2024-09-19T08:50:32.892 INFO:teuthology.orchestra.run.smithi049.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-19T08:50:32.916 INFO:teuthology.orchestra.run.smithi049.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 655 kB/s | 46 kB 00:00 2024-09-19T08:50:32.942 INFO:teuthology.orchestra.run.smithi049.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-19T08:50:32.967 INFO:teuthology.orchestra.run.smithi049.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-19T08:50:32.992 INFO:teuthology.orchestra.run.smithi049.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-19T08:50:33.018 INFO:teuthology.orchestra.run.smithi049.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-19T08:50:33.051 INFO:teuthology.orchestra.run.smithi049.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-19T08:50:33.077 INFO:teuthology.orchestra.run.smithi049.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 809 kB/s | 20 kB 00:00 2024-09-19T08:50:33.102 INFO:teuthology.orchestra.run.smithi049.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-19T08:50:33.127 INFO:teuthology.orchestra.run.smithi049.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-19T08:50:33.131 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:33.132 INFO:teuthology.orchestra.run.smithi049.stdout:Total 15 MB/s | 29 MB 00:01 2024-09-19T08:50:33.260 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:50:33.303 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:50:33.303 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:50:33.324 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-19T08:50:33.325 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:33.325 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:50:33.325 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:33.325 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:33.325 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:33.326 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:33.326 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:33.326 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:33.326 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:50:33.326 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:50:33.326 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:50:33.327 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:50:33.327 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:50:33.327 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:50:33.327 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:50:33.327 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:50:33.327 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:50:33.328 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:50:33.328 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:50:33.328 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:50:33.328 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:50:33.328 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:50:33.329 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:50:33.329 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:50:33.329 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:50:33.329 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:50:33.329 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:50:33.329 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:50:33.330 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:50:33.330 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:50:33.330 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:50:33.330 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:50:33.330 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:50:33.331 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:50:33.331 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:50:33.331 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:33.331 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:33.678 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-base 2024-09-19T08:50:33.748 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:50:33.749 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:50:34.268 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:48 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:34.356 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:50:34.398 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:34.398 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:50:34.399 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:34.464 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install cephadm 2024-09-19T08:50:35.012 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:50:35.033 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:49 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:35.122 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-19T08:50:35.154 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-19T08:50:35.163 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 226 k 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:35.164 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T08:50:35.165 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:35.165 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 226 k 2024-09-19T08:50:35.165 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 217 k 2024-09-19T08:50:35.165 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:50:35.218 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-19T08:50:35.326 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-19T08:50:35.397 INFO:teuthology.orchestra.run.smithi102.stdout:cephadm-18.2.4-855.g19e2a2be.el9.noarch.rpm 975 kB/s | 226 kB 00:00 2024-09-19T08:50:35.397 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:35.398 INFO:teuthology.orchestra.run.smithi102.stdout:Total 968 kB/s | 226 kB 00:00 2024-09-19T08:50:35.398 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:50:35.403 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:50:35.403 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:50:35.403 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-19T08:50:35.406 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:50:35.406 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:50:35.449 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-19T08:50:35.473 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:50:35.492 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-19T08:50:35.521 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-19T08:50:35.573 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-19T08:50:35.623 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-19T08:50:35.664 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-19T08:50:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-19T08:50:35.749 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-19T08:50:35.788 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-19T08:50:35.873 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-19T08:50:35.910 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:36.000 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:36.034 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-19T08:50:36.115 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-19T08:50:36.166 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-19T08:50:36.212 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-19T08:50:36.279 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-19T08:50:36.342 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:36.344 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-19T08:50:36.549 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-19T08:50:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:36.582 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:50:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:36.582 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:36.582 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-19T08:50:36.681 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-19T08:50:36.789 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-19T08:50:36.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T08:50:36.833 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-19T08:50:36.958 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-19T08:50:37.124 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 28/33 2024-09-19T08:50:37.151 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-19T08:50:37.178 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 29/33 2024-09-19T08:50:37.178 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:37.178 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:50:37.178 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:50:37.178 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:50:37.178 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:37.388 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:51 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:37.524 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:37.524 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:37.524 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 143 k 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 143 k 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 395 k 2024-09-19T08:50:37.525 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:50:37.730 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-immutable-object-cache-18.2.4-855.g19e2a2b 697 kB/s | 143 kB 00:00 2024-09-19T08:50:37.731 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:37.731 INFO:teuthology.orchestra.run.smithi102.stdout:Total 691 kB/s | 143 kB 00:00 2024-09-19T08:50:37.732 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:50:37.739 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:50:37.739 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:50:37.796 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:50:37.797 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:50:37.949 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:50:38.006 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-19T08:50:38.031 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-19T08:50:38.031 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:38.031 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:50:38.031 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:38.686 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-19T08:50:38.716 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 30/33 2024-09-19T08:50:38.717 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:38.717 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:50:38.717 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:50:38.717 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:50:38.717 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-19T08:50:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:39.040 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:50:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:39.040 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:39.040 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:39.186 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-19T08:50:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 31/33 2024-09-19T08:50:39.213 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:39.213 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:50:39.213 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:50:39.213 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:50:39.213 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:39.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr 2024-09-19T08:50:39.429 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-19T08:50:39.454 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 32/33 2024-09-19T08:50:39.455 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:39.455 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:50:39.455 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:50:39.455 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:50:39.455 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:39.520 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-19T08:50:39.840 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:53 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:39.932 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:50:39.975 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:39.976 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:50:39.976 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:40.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T08:50:40.624 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:54 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:40.755 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:40.755 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:40.755 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 3.5 M 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 24 k 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 16 k 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout:Install 5 Packages 2024-09-19T08:50:40.756 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:40.757 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 3.8 M 2024-09-19T08:50:40.757 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 87 M 2024-09-19T08:50:40.757 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:50:41.277 INFO:teuthology.orchestra.run.smithi102.stdout:(1/5): ceph-grafana-dashboards-18.2.4-855.g19e2 161 kB/s | 24 kB 00:00 2024-09-19T08:50:41.302 INFO:teuthology.orchestra.run.smithi102.stdout:(2/5): ceph-prometheus-alerts-18.2.4-855.g19e2a 93 kB/s | 16 kB 00:00 2024-09-19T08:50:41.344 INFO:teuthology.orchestra.run.smithi102.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 459 kB/s | 31 kB 00:00 2024-09-19T08:50:41.369 INFO:teuthology.orchestra.run.smithi102.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-19T08:50:41.398 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 33/33 2024-09-19T08:50:41.398 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 1/33 2024-09-19T08:50:41.398 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2/33 2024-09-19T08:50:41.398 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 3/33 2024-09-19T08:50:41.398 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 4/33 2024-09-19T08:50:41.398 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 5/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.n 6/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-19T08:50:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-19T08:50:41.400 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-19T08:50:41.401 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-19T08:50:41.401 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-19T08:50:41.401 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-19T08:50:41.401 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-19T08:50:41.401 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-19T08:50:41.528 INFO:teuthology.orchestra.run.smithi102.stdout:(5/5): ceph-mgr-dashboard-18.2.4-855.g19e2a2be. 8.8 MB/s | 3.5 MB 00:00 2024-09-19T08:50:41.531 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:41.532 INFO:teuthology.orchestra.run.smithi102.stdout:Total 4.9 MB/s | 3.8 MB 00:00 2024-09-19T08:50:41.532 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:50:41.539 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:50:41.540 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:50:41.627 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:50:41.628 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:50:41.869 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:50:41.942 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-19T08:50:41.974 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-19T08:50:42.003 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:42.436 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:50:42.437 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:50:42.438 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:50:42.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:50:42.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:50:42.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:50:42.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:42.439 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:42.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-base 2024-09-19T08:50:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 4/5 2024-09-19T08:50:43.090 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-19T08:50:43.398 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:50 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:43.490 INFO:teuthology.orchestra.run.smithi049.stdout:Package ceph-base-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:50:43.534 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:43.535 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:50:43.535 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:43.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install cephadm 2024-09-19T08:50:44.203 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:51 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:44.273 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-19T08:50:44.273 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 1/5 2024-09-19T08:50:44.274 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2/5 2024-09-19T08:50:44.274 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-19T08:50:44.274 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-19T08:50:44.342 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:44.342 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:44.342 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 226 k 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 226 k 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 217 k 2024-09-19T08:50:44.343 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:50:44.547 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-19T08:50:44.547 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:44.548 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:44.560 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm-18.2.4-855.g19e2a2be.el9.noarch.rpm 1.0 MB/s | 226 kB 00:00 2024-09-19T08:50:44.561 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:44.561 INFO:teuthology.orchestra.run.smithi049.stdout:Total 1.0 MB/s | 226 kB 00:00 2024-09-19T08:50:44.561 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:50:44.567 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:50:44.567 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:50:44.570 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:50:44.570 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:50:44.641 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:50:44.764 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T08:50:45.118 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:45.225 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:45.339 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:59 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:45.470 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:45.471 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-19T08:50:45.471 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 7.4 M 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:50:45.472 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-09-19T08:50:45.473 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:45.474 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 38 M 2024-09-19T08:50:45.474 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 212 M 2024-09-19T08:50:45.474 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:50:45.567 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:45.785 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 881 kB/s | 191 kB 00:00 2024-09-19T08:50:45.847 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/1 2024-09-19T08:50:45.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:45.848 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:50:45.848 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:45.848 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:45.848 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:45.878 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-09-19T08:50:45.911 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-19T08:50:46.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T08:50:46.053 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): ceph-mgr-diskprediction-local-18.2.4-85 15 MB/s | 7.4 MB 00:00 2024-09-19T08:50:46.078 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 109 kB/s | 18 kB 00:00 2024-09-19T08:50:46.112 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-19T08:50:46.187 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.7 MB/s | 3.0 MB 00:00 2024-09-19T08:50:46.246 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-19T08:50:46.321 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-19T08:50:46.346 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-19T08:50:46.446 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 13 MB/s | 4.9 MB 00:00 2024-09-19T08:50:46.655 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-09-19T08:50:46.656 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:53 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:46.656 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:46.656 INFO:teuthology.orchestra.run.smithi102.stdout:Total 32 MB/s | 38 MB 00:01 2024-09-19T08:50:46.792 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:46.793 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:46.793 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-09-19T08:50:46.793 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:46.793 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:50:46.793 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 143 k 2024-09-19T08:50:46.793 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:46.793 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:50:46.794 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:46.794 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-09-19T08:50:46.794 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:46.794 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 143 k 2024-09-19T08:50:46.794 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 395 k 2024-09-19T08:50:46.794 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:50:47.008 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-immutable-object-cache-18.2.4-855.g19e2a2b 668 kB/s | 143 kB 00:00 2024-09-19T08:50:47.009 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:47.009 INFO:teuthology.orchestra.run.smithi049.stdout:Total 663 kB/s | 143 kB 00:00 2024-09-19T08:50:47.009 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:50:47.010 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:50:47.017 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:50:47.017 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:50:47.036 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:50:47.036 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:50:47.078 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:50:47.078 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:50:47.231 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:50:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-19T08:50:47.327 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-19T08:50:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:50:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:50:47.328 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:47.548 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:50:47.548 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:50:48.261 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.e 1/1 2024-09-19T08:50:48.261 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:48.261 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:50:48.261 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:50:48.261 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:48.261 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:48.331 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:50:48.409 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T08:50:48.462 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T08:50:48.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr 2024-09-19T08:50:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T08:50:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T08:50:48.788 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T08:50:48.820 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T08:50:48.898 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T08:50:49.102 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:49.193 INFO:teuthology.orchestra.run.smithi049.stdout:Package ceph-mgr-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:50:49.237 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:49.238 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:50:49.238 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:49.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T08:50:49.540 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T08:50:49.650 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T08:50:49.917 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:50.054 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:50.054 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:50.054 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 3.5 M 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 24 k 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 16 k 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:50.055 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:50:50.056 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:50:50.056 INFO:teuthology.orchestra.run.smithi049.stdout:Install 5 Packages 2024-09-19T08:50:50.056 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:50.056 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 3.8 M 2024-09-19T08:50:50.056 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 87 M 2024-09-19T08:50:50.056 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:50:50.237 INFO:teuthology.orchestra.run.smithi049.stdout:(1/5): ceph-grafana-dashboards-18.2.4-855.g19e2 166 kB/s | 24 kB 00:00 2024-09-19T08:50:50.262 INFO:teuthology.orchestra.run.smithi049.stdout:(2/5): ceph-prometheus-alerts-18.2.4-855.g19e2a 96 kB/s | 16 kB 00:00 2024-09-19T08:50:50.303 INFO:teuthology.orchestra.run.smithi049.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 462 kB/s | 31 kB 00:00 2024-09-19T08:50:50.338 INFO:teuthology.orchestra.run.smithi049.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-19T08:50:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:(5/5): ceph-mgr-dashboard-18.2.4-855.g19e2a2be. 9.1 MB/s | 3.5 MB 00:00 2024-09-19T08:50:50.483 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:50.483 INFO:teuthology.orchestra.run.smithi049.stdout:Total 8.9 MB/s | 3.8 MB 00:00 2024-09-19T08:50:50.483 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:50:50.491 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:50:50.491 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:50:50.584 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:50:50.585 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:50:50.841 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:50:50.886 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T08:50:50.932 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-19T08:50:50.961 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-19T08:50:50.990 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-19T08:50:51.912 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T08:50:51.936 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-19T08:50:52.107 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 4/5 2024-09-19T08:50:52.135 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-19T08:50:53.242 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 5/5 2024-09-19T08:50:53.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.n 1/5 2024-09-19T08:50:53.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2/5 2024-09-19T08:50:53.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.no 3/5 2024-09-19T08:50:53.242 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:50:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:53.508 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:50:53.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T08:50:54.326 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:01 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:50:54.462 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================== 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================== 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 7.4 M 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:50:54.463 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout:====================================================================================== 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout:Install 12 Packages 2024-09-19T08:50:54.464 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:50:54.465 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 38 M 2024-09-19T08:50:54.465 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 212 M 2024-09-19T08:50:54.465 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 1/12 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T08:50:54.494 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T08:50:54.495 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T08:50:54.495 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T08:50:54.495 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T08:50:54.495 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T08:50:54.495 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T08:50:54.925 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T08:50:54.925 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:54.925 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:50:54.926 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:50:54.927 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:54.927 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:50:54.980 INFO:teuthology.orchestra.run.smithi049.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.4-85 17 MB/s | 7.4 MB 00:00 2024-09-19T08:50:55.272 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-rook 2024-09-19T08:50:55.455 INFO:teuthology.orchestra.run.smithi049.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 207 kB/s | 191 kB 00:00 2024-09-19T08:50:55.547 INFO:teuthology.orchestra.run.smithi049.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-19T08:50:55.862 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:09 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:50:55.994 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:50:55.995 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:55.995 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:50:55.995 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:55.995 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:50:55.995 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 49 k 2024-09-19T08:50:55.995 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:50:55.995 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:50:55.996 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:50:55.997 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:55.997 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:50:55.997 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:50:55.997 INFO:teuthology.orchestra.run.smithi102.stdout:Install 13 Packages 2024-09-19T08:50:55.997 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:50:55.998 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 2.2 M 2024-09-19T08:50:55.998 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 26 M 2024-09-19T08:50:55.998 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:50:56.056 INFO:teuthology.orchestra.run.smithi049.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 36 kB/s | 18 kB 00:00 2024-09-19T08:50:56.139 INFO:teuthology.orchestra.run.smithi049.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 499 kB/s | 801 kB 00:01 2024-09-19T08:50:56.631 INFO:teuthology.orchestra.run.smithi049.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-09-19T08:50:56.695 INFO:teuthology.orchestra.run.smithi102.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 184 kB/s | 19 kB 00:00 2024-09-19T08:50:56.715 INFO:teuthology.orchestra.run.smithi049.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-09-19T08:50:56.720 INFO:teuthology.orchestra.run.smithi102.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 198 kB/s | 26 kB 00:00 2024-09-19T08:50:56.779 INFO:teuthology.orchestra.run.smithi102.stdout:(3/13): ceph-mgr-rook-18.2.4-855.g19e2a2be.el9. 262 kB/s | 49 kB 00:00 2024-09-19T08:50:56.804 INFO:teuthology.orchestra.run.smithi102.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-19T08:50:56.829 INFO:teuthology.orchestra.run.smithi102.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-19T08:50:56.871 INFO:teuthology.orchestra.run.smithi102.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 772 kB/s | 32 kB 00:00 2024-09-19T08:50:56.897 INFO:teuthology.orchestra.run.smithi102.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 581 kB/s | 54 kB 00:00 2024-09-19T08:50:56.922 INFO:teuthology.orchestra.run.smithi102.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 280 kB/s | 14 kB 00:00 2024-09-19T08:50:56.956 INFO:teuthology.orchestra.run.smithi102.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-19T08:50:57.022 INFO:teuthology.orchestra.run.smithi102.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 11 MB/s | 1.0 MB 00:00 2024-09-19T08:50:57.048 INFO:teuthology.orchestra.run.smithi102.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.4 MB/s | 220 kB 00:00 2024-09-19T08:50:57.073 INFO:teuthology.orchestra.run.smithi102.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 512 kB/s | 59 kB 00:00 2024-09-19T08:50:57.098 INFO:teuthology.orchestra.run.smithi102.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-19T08:50:57.100 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:57.101 INFO:teuthology.orchestra.run.smithi102.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-19T08:50:57.166 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:50:57.181 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:50:57.181 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:50:57.270 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:50:57.271 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:50:57.640 INFO:teuthology.orchestra.run.smithi049.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 243 kB/s | 245 kB 00:01 2024-09-19T08:50:57.785 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:50:57.965 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T08:50:58.025 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T08:50:58.089 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T08:50:58.107 INFO:teuthology.orchestra.run.smithi049.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 2.5 MB/s | 4.9 MB 00:01 2024-09-19T08:50:58.125 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T08:50:58.167 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T08:50:58.269 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T08:50:58.432 INFO:teuthology.orchestra.run.smithi049.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 317 kB/s | 250 kB 00:00 2024-09-19T08:50:58.437 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T08:50:58.486 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T08:50:58.516 INFO:teuthology.orchestra.run.smithi049.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.8 MB/s | 5.1 MB 00:01 2024-09-19T08:50:59.205 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T08:50:59.258 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T08:50:59.291 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T08:50:59.339 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T08:50:59.361 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-19T08:50:59.733 INFO:teuthology.orchestra.run.smithi049.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-19T08:50:59.735 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:50:59.735 INFO:teuthology.orchestra.run.smithi049.stdout:Total 7.3 MB/s | 38 MB 00:05 2024-09-19T08:51:00.103 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:00.131 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:00.132 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:00.158 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 1/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T08:51:00.159 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T08:51:00.160 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T08:51:00.497 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T08:51:00.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:00.497 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:00.497 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:51:00.497 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:51:00.497 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:00.498 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:00.657 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:00.657 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:00.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T08:51:01.347 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:15 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:01.441 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:01.479 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:01.479 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 139 k 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:51:01.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:51:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:01.481 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:51:01.481 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:01.481 INFO:teuthology.orchestra.run.smithi102.stdout:Install 6 Packages 2024-09-19T08:51:01.481 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:01.481 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 7.0 M 2024-09-19T08:51:01.482 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 33 M 2024-09-19T08:51:01.482 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:51:01.518 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T08:51:01.561 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T08:51:01.662 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T08:51:01.707 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T08:51:01.908 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T08:51:01.939 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T08:51:01.959 INFO:teuthology.orchestra.run.smithi102.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-19T08:51:02.010 INFO:teuthology.orchestra.run.smithi102.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-19T08:51:02.020 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T08:51:02.043 INFO:teuthology.orchestra.run.smithi102.stdout:(3/6): ceph-mgr-cephadm-18.2.4-855.g19e2a2be.el 563 kB/s | 139 kB 00:00 2024-09-19T08:51:02.069 INFO:teuthology.orchestra.run.smithi102.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 985 kB/s | 58 kB 00:00 2024-09-19T08:51:02.160 INFO:teuthology.orchestra.run.smithi102.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-19T08:51:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:(6/6): python3-typing-extensions-4.12.2-2.el9.n 524 kB/s | 74 kB 00:00 2024-09-19T08:51:02.188 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:02.188 INFO:teuthology.orchestra.run.smithi102.stdout:Total 9.9 MB/s | 7.0 MB 00:00 2024-09-19T08:51:02.260 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:51:02.271 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:51:02.271 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:51:02.370 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:51:02.372 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:51:02.672 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:51:02.712 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T08:51:02.831 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T08:51:02.841 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T08:51:02.887 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T08:51:03.413 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T08:51:03.498 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T08:51:03.569 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T08:51:03.599 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-19T08:51:04.165 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T08:51:04.375 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-19T08:51:04.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/6 2024-09-19T08:51:04.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T08:51:04.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T08:51:04.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T08:51:04.375 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:04.671 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:04.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-fuse 2024-09-19T08:51:05.258 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T08:51:05.288 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-19T08:51:05.483 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:19 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:05.616 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:05.616 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:05.616 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 852 k 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout:Install 2 Packages 2024-09-19T08:51:05.617 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:05.618 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 932 k 2024-09-19T08:51:05.618 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 2.7 M 2024-09-19T08:51:05.618 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:51:05.837 INFO:teuthology.orchestra.run.smithi102.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 654 kB/s | 80 kB 00:00 2024-09-19T08:51:06.012 INFO:teuthology.orchestra.run.smithi102.stdout:(2/2): ceph-fuse-18.2.4-855.g19e2a2be.el9.x86_6 2.8 MB/s | 852 kB 00:00 2024-09-19T08:51:06.013 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:06.013 INFO:teuthology.orchestra.run.smithi102.stdout:Total 2.3 MB/s | 932 kB 00:00 2024-09-19T08:51:06.025 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:51:06.046 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:51:06.046 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:51:06.125 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:51:06.125 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:51:06.315 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:51:06.460 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T08:51:06.536 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-19T08:51:07.279 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-19T08:51:07.279 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/2 2024-09-19T08:51:07.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T08:51:07.563 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:07.563 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:07.563 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T08:51:07.563 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:07.563 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:07.796 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 12/12 2024-09-19T08:51:07.796 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2 1/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T08:51:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T08:51:07.877 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados-devel 2024-09-19T08:51:08.199 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:51:08.200 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:51:08.201 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:51:08.201 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:08.201 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:51:08.201 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:51:08.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:08.201 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:08.475 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:22 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:08.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-rook 2024-09-19T08:51:08.611 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:08.611 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:08.611 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 126 k 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 126 k 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 456 k 2024-09-19T08:51:08.612 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:51:08.818 INFO:teuthology.orchestra.run.smithi102.stdout:librados-devel-18.2.4-855.g19e2a2be.el9.x86_64. 616 kB/s | 126 kB 00:00 2024-09-19T08:51:08.819 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:08.819 INFO:teuthology.orchestra.run.smithi102.stdout:Total 612 kB/s | 126 kB 00:00 2024-09-19T08:51:08.819 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:51:08.824 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:51:08.824 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:51:08.887 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:51:08.887 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:51:09.041 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:51:09.140 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:09.173 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:16 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:09.315 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:09.316 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:51:09.316 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 49 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:51:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout:Install 13 Packages 2024-09-19T08:51:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:09.319 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 2.2 M 2024-09-19T08:51:09.319 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 26 M 2024-09-19T08:51:09.319 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:09.547 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:09.595 INFO:teuthology.orchestra.run.smithi049.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 219 kB/s | 19 kB 00:00 2024-09-19T08:51:09.612 INFO:teuthology.orchestra.run.smithi049.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 245 kB/s | 26 kB 00:00 2024-09-19T08:51:09.671 INFO:teuthology.orchestra.run.smithi049.stdout:(3/13): ceph-mgr-rook-18.2.4-855.g19e2a2be.el9. 302 kB/s | 49 kB 00:00 2024-09-19T08:51:09.696 INFO:teuthology.orchestra.run.smithi049.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-19T08:51:09.721 INFO:teuthology.orchestra.run.smithi049.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-19T08:51:09.747 INFO:teuthology.orchestra.run.smithi049.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-19T08:51:09.780 INFO:teuthology.orchestra.run.smithi049.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 548 kB/s | 32 kB 00:00 2024-09-19T08:51:09.806 INFO:teuthology.orchestra.run.smithi049.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 241 kB/s | 14 kB 00:00 2024-09-19T08:51:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:09.813 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:09.813 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:09.831 INFO:teuthology.orchestra.run.smithi049.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2024-09-19T08:51:09.865 INFO:teuthology.orchestra.run.smithi049.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-19T08:51:09.892 INFO:teuthology.orchestra.run.smithi049.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-19T08:51:09.915 INFO:teuthology.orchestra.run.smithi049.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-09-19T08:51:09.949 INFO:teuthology.orchestra.run.smithi049.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-19T08:51:09.951 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:09.952 INFO:teuthology.orchestra.run.smithi049.stdout:Total 3.5 MB/s | 2.2 MB 00:00 2024-09-19T08:51:10.019 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:10.035 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:10.035 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:10.060 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs2 2024-09-19T08:51:10.133 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:10.133 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:10.648 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:24 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:10.738 INFO:teuthology.orchestra.run.smithi102.stdout:Package libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:10.774 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:10.782 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:10.783 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:51:10.783 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:10.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs-devel 2024-09-19T08:51:10.967 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T08:51:11.027 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T08:51:11.083 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T08:51:11.118 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T08:51:11.169 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T08:51:11.284 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T08:51:11.394 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T08:51:11.435 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:25 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:11.446 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T08:51:11.569 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:11.569 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:11.569 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 31 k 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 31 k 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 139 k 2024-09-19T08:51:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:51:11.722 INFO:teuthology.orchestra.run.smithi102.stdout:libcephfs-devel-18.2.4-855.g19e2a2be.el9.x86_64 205 kB/s | 31 kB 00:00 2024-09-19T08:51:11.722 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:11.723 INFO:teuthology.orchestra.run.smithi102.stdout:Total 203 kB/s | 31 kB 00:00 2024-09-19T08:51:11.723 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:51:11.726 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:51:11.726 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:51:11.752 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:51:11.752 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:51:11.839 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:51:11.952 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:12.213 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T08:51:12.267 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T08:51:12.301 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T08:51:12.316 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:12.350 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T08:51:12.378 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-19T08:51:12.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:12.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:12.561 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:12.561 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:12.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:12.562 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:12.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados2 2024-09-19T08:51:13.200 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 13/13 2024-09-19T08:51:13.231 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 1/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T08:51:13.232 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T08:51:13.330 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:27 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:13.419 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:13.461 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:13.462 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:51:13.462 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:51:13.531 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:13.532 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:13.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librbd1 2024-09-19T08:51:13.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T08:51:14.110 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:28 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:14.199 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:14.242 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:51:14.242 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:14.310 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rados 2024-09-19T08:51:14.400 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:21 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:14.538 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:14.539 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:51:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:14.539 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:18.2.4-855.g19e2a2be.el9 ceph-noarch 139 k 2024-09-19T08:51:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:51:14.539 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:Install 6 Packages 2024-09-19T08:51:14.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:14.541 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 7.0 M 2024-09-19T08:51:14.541 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 33 M 2024-09-19T08:51:14.541 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:14.883 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:28 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:14.971 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:15.014 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:15.016 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:51:15.016 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:15.076 INFO:teuthology.orchestra.run.smithi049.stdout:(1/6): ceph-mgr-cephadm-18.2.4-855.g19e2a2be.el 625 kB/s | 139 kB 00:00 2024-09-19T08:51:15.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rgw 2024-09-19T08:51:15.151 INFO:teuthology.orchestra.run.smithi049.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.9 MB/s | 548 kB 00:00 2024-09-19T08:51:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-19T08:51:15.202 INFO:teuthology.orchestra.run.smithi049.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-19T08:51:15.652 INFO:teuthology.orchestra.run.smithi049.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 311 kB/s | 248 kB 00:00 2024-09-19T08:51:15.661 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:29 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:15.749 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:15.792 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:15.793 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:51:15.793 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:15.876 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-cephfs 2024-09-19T08:51:16.044 INFO:teuthology.orchestra.run.smithi049.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-19T08:51:16.046 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:16.047 INFO:teuthology.orchestra.run.smithi049.stdout:Total 4.7 MB/s | 7.0 MB 00:01 2024-09-19T08:51:16.123 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:16.136 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:16.138 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:16.242 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:16.242 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:16.453 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:30 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:16.542 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:16.564 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:16.584 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:16.585 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:51:16.586 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:16.660 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rbd 2024-09-19T08:51:16.733 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T08:51:16.788 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T08:51:17.233 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:31 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:17.321 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:17.350 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T08:51:17.362 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:17.364 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T08:51:17.364 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:17.441 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-fuse 2024-09-19T08:51:17.443 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T08:51:17.513 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T08:51:17.541 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-19T08:51:18.025 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:32 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:18.156 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 87 k 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T08:51:18.157 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:18.158 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 87 k 2024-09-19T08:51:18.158 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 227 k 2024-09-19T08:51:18.158 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:51:18.320 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 6/6 2024-09-19T08:51:18.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 1/6 2024-09-19T08:51:18.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T08:51:18.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T08:51:18.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T08:51:18.321 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T08:51:18.342 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-fuse-18.2.4-855.g19e2a2be.el9.x86_64.rpm 470 kB/s | 87 kB 00:00 2024-09-19T08:51:18.343 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:18.343 INFO:teuthology.orchestra.run.smithi102.stdout:Total 467 kB/s | 87 kB 00:00 2024-09-19T08:51:18.343 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:51:18.350 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:51:18.350 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:51:18.412 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:51:18.413 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:51:18.571 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:51:18.672 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:18.717 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T08:51:18.717 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:18.717 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:18.717 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:18.2.4-855.g19e2a2be.el9.noarch 2024-09-19T08:51:18.717 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:51:18.717 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:51:18.717 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:51:18.718 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:51:18.718 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:51:18.718 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:18.718 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:18.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-fuse 2024-09-19T08:51:19.079 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:19.370 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:19.370 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:19.370 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:19.370 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:19.371 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:19.371 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:19.585 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:26 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:19.641 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-mirror 2024-09-19T08:51:19.725 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:19.725 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 852 k 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout:Install 2 Packages 2024-09-19T08:51:19.726 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:19.727 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 932 k 2024-09-19T08:51:19.727 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 2.7 M 2024-09-19T08:51:19.727 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:20.079 INFO:teuthology.orchestra.run.smithi049.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 834 kB/s | 80 kB 00:00 2024-09-19T08:51:20.220 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:34 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:20.270 INFO:teuthology.orchestra.run.smithi049.stdout:(2/2): ceph-fuse-18.2.4-855.g19e2a2be.el9.x86_6 2.9 MB/s | 852 kB 00:00 2024-09-19T08:51:20.271 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:20.272 INFO:teuthology.orchestra.run.smithi049.stdout:Total 1.7 MB/s | 932 kB 00:00 2024-09-19T08:51:20.286 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:20.311 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:20.312 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:20.353 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 3.0 M 2024-09-19T08:51:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 12 M 2024-09-19T08:51:20.355 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:51:20.397 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:20.397 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:20.611 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:20.671 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-mirror-18.2.4-855.g19e2a2be.el9.x86_64.rpm 9.5 MB/s | 3.0 MB 00:00 2024-09-19T08:51:20.671 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:20.672 INFO:teuthology.orchestra.run.smithi102.stdout:Total 9.4 MB/s | 3.0 MB 00:00 2024-09-19T08:51:20.672 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:51:20.681 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:51:20.681 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:51:20.749 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T08:51:20.760 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:51:20.760 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:51:20.822 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-19T08:51:21.182 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:51:21.247 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:21.271 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:21.271 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:21.271 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:51:21.271 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:21.271 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:21.272 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:21.536 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2/2 2024-09-19T08:51:21.536 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/2 2024-09-19T08:51:21.799 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T08:51:21.799 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:21.799 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:21.799 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T08:51:21.799 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:21.800 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:22.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librados-devel 2024-09-19T08:51:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:22.412 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:22.412 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:22.412 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:22.678 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:29 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:22.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-nbd 2024-09-19T08:51:22.817 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:22.818 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:22.818 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 126 k 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 126 k 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 456 k 2024-09-19T08:51:22.819 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:23.034 INFO:teuthology.orchestra.run.smithi049.stdout:librados-devel-18.2.4-855.g19e2a2be.el9.x86_64. 590 kB/s | 126 kB 00:00 2024-09-19T08:51:23.035 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:23.035 INFO:teuthology.orchestra.run.smithi049.stdout:Total 585 kB/s | 126 kB 00:00 2024-09-19T08:51:23.035 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:23.041 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:23.041 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:23.108 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:23.108 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:23.259 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:23.278 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:37 ago on Thu 19 Sep 2024 08:49:46 AM UTC. 2024-09-19T08:51:23.358 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:23.413 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 172 k 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 172 k 2024-09-19T08:51:23.414 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 494 k 2024-09-19T08:51:23.415 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T08:51:23.625 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-nbd-18.2.4-855.g19e2a2be.el9.x86_64.rpm 818 kB/s | 172 kB 00:00 2024-09-19T08:51:23.626 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:23.626 INFO:teuthology.orchestra.run.smithi102.stdout:Total 812 kB/s | 172 kB 00:00 2024-09-19T08:51:23.626 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T08:51:23.633 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T08:51:23.633 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T08:51:23.696 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T08:51:23.696 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T08:51:23.802 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:23.849 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T08:51:23.963 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:24.024 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:24.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:24.025 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:24.025 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:24.025 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:24.025 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:24.253 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install libcephfs2 2024-09-19T08:51:24.365 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:24.627 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T08:51:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:24.627 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:51:24.627 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T08:51:24.864 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:31 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:24.913 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:24.958 INFO:teuthology.orchestra.run.smithi049.stdout:Package libcephfs2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:25.004 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:25.005 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:51:25.005 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:25.080 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install libcephfs-devel 2024-09-19T08:51:25.687 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:32 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:25.825 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 31 k 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:25.826 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-09-19T08:51:25.827 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:25.827 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 31 k 2024-09-19T08:51:25.827 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 139 k 2024-09-19T08:51:25.827 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:25.970 INFO:teuthology.orchestra.run.smithi049.stdout:libcephfs-devel-18.2.4-855.g19e2a2be.el9.x86_64 216 kB/s | 31 kB 00:00 2024-09-19T08:51:25.971 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:25.971 INFO:teuthology.orchestra.run.smithi049.stdout:Total 214 kB/s | 31 kB 00:00 2024-09-19T08:51:25.971 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:25.975 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:25.975 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:25.994 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:25.994 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:26.088 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:26.205 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:26.676 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:26.907 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:26.907 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:27.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librados2 2024-09-19T08:51:27.699 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:34 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:27.790 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:27.835 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:27.837 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:51:27.837 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:27.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librbd1 2024-09-19T08:51:28.517 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:35 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:28.609 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:28.655 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:28.656 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:51:28.656 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:28.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rados 2024-09-19T08:51:29.329 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:36 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:29.420 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rados-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:29.465 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:29.466 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:51:29.466 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:29.537 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rgw 2024-09-19T08:51:30.142 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:37 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:30.235 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rgw-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:30.280 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:30.281 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:51:30.281 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:30.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-cephfs 2024-09-19T08:51:30.965 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:37 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:31.058 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-cephfs-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:31.102 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:31.104 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:51:31.104 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:31.294 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rbd 2024-09-19T08:51:31.896 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:38 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:31.989 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rbd-2:18.2.4-855.g19e2a2be.el9.x86_64 is already installed. 2024-09-19T08:51:32.036 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:32.037 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-09-19T08:51:32.037 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:32.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-fuse 2024-09-19T08:51:32.718 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:39 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:32.857 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:32.857 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 87 k 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 87 k 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 227 k 2024-09-19T08:51:32.858 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-fuse-18.2.4-855.g19e2a2be.el9.x86_64.rpm 420 kB/s | 87 kB 00:00 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi049.stdout:Total 417 kB/s | 87 kB 00:00 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:33.073 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:33.073 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:33.139 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:33.140 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:33.305 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:33.416 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:33.788 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:34.053 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:34.053 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:34.053 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:34.053 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:34.053 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:34.053 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:34.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-mirror 2024-09-19T08:51:34.916 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:41 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:35.057 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 3.0 M 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:35.058 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 3.0 M 2024-09-19T08:51:35.059 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 12 M 2024-09-19T08:51:35.059 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:35.376 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-mirror-18.2.4-855.g19e2a2be.el9.x86_64.rpm 9.4 MB/s | 3.0 MB 00:00 2024-09-19T08:51:35.377 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:35.377 INFO:teuthology.orchestra.run.smithi049.stdout:Total 9.4 MB/s | 3.0 MB 00:00 2024-09-19T08:51:35.378 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:35.387 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:35.387 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:35.471 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:35.472 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:35.916 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:35.977 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:36.004 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:36.004 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:51:36.004 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:51:36.004 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:36.004 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:51:36.004 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:37.147 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:37.147 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:37.147 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:37.147 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:37.147 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:37.147 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:37.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-nbd 2024-09-19T08:51:38.035 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:45 ago on Thu 19 Sep 2024 08:49:53 AM UTC. 2024-09-19T08:51:38.175 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:18.2.4-855.g19e2a2be.el9 ceph 172 k 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-19T08:51:38.176 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-19T08:51:38.177 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-09-19T08:51:38.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:38.177 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 172 k 2024-09-19T08:51:38.177 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 494 k 2024-09-19T08:51:38.177 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-19T08:51:38.389 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-nbd-18.2.4-855.g19e2a2be.el9.x86_64.rpm 814 kB/s | 172 kB 00:00 2024-09-19T08:51:38.389 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:38.389 INFO:teuthology.orchestra.run.smithi049.stdout:Total 807 kB/s | 172 kB 00:00 2024-09-19T08:51:38.389 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-19T08:51:38.398 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-19T08:51:38.398 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-19T08:51:38.465 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-19T08:51:38.466 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-19T08:51:38.619 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-19T08:51:38.713 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:39.231 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:39.488 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 1/1 2024-09-19T08:51:39.488 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:39.488 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-19T08:51:39.488 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:18.2.4-855.g19e2a2be.el9.x86_64 2024-09-19T08:51:39.489 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:51:39.489 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-19T08:51:39.755 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:39.756 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:51:39.756 INFO:teuthology.packaging:ref: None 2024-09-19T08:51:39.756 INFO:teuthology.packaging:tag: None 2024-09-19T08:51:39.756 INFO:teuthology.packaging:branch: reef 2024-09-19T08:51:39.756 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:39.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-19T08:51:39.987 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:51:40.010 INFO:teuthology.orchestra.run.smithi049.stdout:18.2.4-855.g19e2a2be.el9 2024-09-19T08:51:40.011 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855.g19e2a2be.el9 2024-09-19T08:51:40.011 INFO:teuthology.task.install:The correct ceph version 18.2.4-855.g19e2a2be is installed. 2024-09-19T08:51:40.013 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:51:40.013 INFO:teuthology.packaging:ref: None 2024-09-19T08:51:40.013 INFO:teuthology.packaging:tag: None 2024-09-19T08:51:40.013 INFO:teuthology.packaging:branch: reef 2024-09-19T08:51:40.013 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:40.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-19T08:51:40.227 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:51:40.252 INFO:teuthology.orchestra.run.smithi102.stdout:18.2.4-855.g19e2a2be.el9 2024-09-19T08:51:40.252 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855.g19e2a2be.el9 2024-09-19T08:51:40.252 INFO:teuthology.task.install:The correct ceph version 18.2.4-855.g19e2a2be is installed. 2024-09-19T08:51:40.254 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:51:40.254 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:51:40.255 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:51:40.283 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:51:40.283 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:51:40.322 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:51:40.322 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:51:40.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:51:40.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:51:40.416 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:51:40.416 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:51:40.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:51:40.510 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:51:40.511 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:51:40.511 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:51:40.537 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:51:40.602 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:51:40.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:51:40.629 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:51:40.694 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:51:40.694 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:51:40.694 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:51:40.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:51:40.785 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:51:40.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:51:40.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:51:40.877 INFO:teuthology.run_tasks:Running task print... 2024-09-19T08:51:40.885 INFO:teuthology.task.print:**** done install task... 2024-09-19T08:51:40.885 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:51:41.019 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:51:41.019 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-09-19T08:51:41.019 INFO:tasks.cephadm:Cluster fsid is 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:51:41.020 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:51:41.020 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-19T08:51:41.020 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi049': '172.21.15.49', 'mon.smithi102': '172.21.15.102'} 2024-09-19T08:51:41.020 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:51:41.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2024-09-19T08:51:41.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname $(hostname -s) 2024-09-19T08:51:41.071 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-19T08:51:41.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:41.208 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:51:41.425 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-19T08:51:41.426 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:51:41.426 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:51:41.427 DEBUG:teuthology.orchestra.run.smithi049:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:41.918 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 19 08:51 /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:41.918 DEBUG:teuthology.orchestra.run.smithi102:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:42.413 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 19 08:51 /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:42.413 DEBUG:teuthology.orchestra.run.smithi049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:42.433 DEBUG:teuthology.orchestra.run.smithi102:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:51:42.464 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-09-19T08:51:42.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-19T08:51:42.477 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-19T08:51:44.052 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-19T08:51:44.114 INFO:teuthology.orchestra.run.smithi102.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-19T08:52:47.604 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-19T08:52:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-19T08:52:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-19T08:52:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: "repo_digests": [ 2024-09-19T08:52:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-19T08:52:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-19T08:52:47.605 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-19T08:52:51.783 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T08:52:51.784 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-19T08:52:51.784 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-19T08:52:51.784 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2024-09-19T08:52:51.784 INFO:teuthology.orchestra.run.smithi049.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-19T08:52:51.784 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-19T08:52:51.784 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T08:52:51.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2024-09-19T08:52:51.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph 2024-09-19T08:52:51.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2024-09-19T08:52:51.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /etc/ceph 2024-09-19T08:52:51.942 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:52:51.944 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-19T08:52:51.944 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-19T08:52:51.945 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T08:52:51.945 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T08:52:51.945 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T08:52:51.945 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:52:51.945 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:52:51.945 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T08:52:51.946 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T08:52:51.946 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:52:51.946 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:52:51.946 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T08:52:51.946 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:52:51.946 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:52:51.946 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:52:51.947 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:52:51.947 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:52:51.947 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:52:51.947 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:52:51.947 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:52:51.947 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:52:51.948 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:52:51.948 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:52:51.948 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-19T08:52:51.948 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:52:51.948 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:52:51.948 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:52:51.948 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:52:51.949 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:52:51.949 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:52:51.949 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:52:51.949 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:52:51.949 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:52:51.949 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:52:51.950 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:52:51.950 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:52:51.950 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:52:51.950 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:52:51.950 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:52:51.950 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:52:51.950 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:52:51.951 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:52:51.951 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:52:51.952 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:52:51.952 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:52:51.971 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 63845326-7664-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:52:51.972 DEBUG:teuthology.orchestra.run.smithi049:mon.smithi049> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service 2024-09-19T08:52:52.014 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:52:52.014 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid 63845326-7664-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.49 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:52:52.174 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:52:52.175 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', '63845326-7664-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.49', '--skip-admin-label'] 2024-09-19T08:52:52.198 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:52:52.199 INFO:teuthology.orchestra.run.smithi049.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:52:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying podman|docker is present... 2024-09-19T08:52:52.221 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:52:52.221 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying lvm2 is present... 2024-09-19T08:52:52.221 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying time synchronization is in place... 2024-09-19T08:52:52.229 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:52:52.229 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:52:52.236 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:52:52.236 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-19T08:52:52.243 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-09-19T08:52:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-09-19T08:52:52.249 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:52:52.250 INFO:teuthology.orchestra.run.smithi049.stdout:Repeating the final host check... 2024-09-19T08:52:52.272 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:52:52.272 INFO:teuthology.orchestra.run.smithi049.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:52:52.272 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl is present 2024-09-19T08:52:52.272 INFO:teuthology.orchestra.run.smithi049.stdout:lvcreate is present 2024-09-19T08:52:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:52:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:52:52.285 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:52:52.285 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-19T08:52:52.292 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-09-19T08:52:52.299 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-09-19T08:52:52.299 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:52:52.299 INFO:teuthology.orchestra.run.smithi049.stdout:Host looks OK 2024-09-19T08:52:52.299 INFO:teuthology.orchestra.run.smithi049.stdout:Cluster fsid: 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:52.299 INFO:teuthology.orchestra.run.smithi049.stdout:Acquiring lock 139732920378704 on /run/cephadm/63845326-7664-11ef-bceb-c7b262605968.lock 2024-09-19T08:52:52.299 INFO:teuthology.orchestra.run.smithi049.stdout:Lock 139732920378704 acquired on /run/cephadm/63845326-7664-11ef-bceb-c7b262605968.lock 2024-09-19T08:52:52.300 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 3300 ... 2024-09-19T08:52:52.300 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 6789 ... 2024-09-19T08:52:52.300 INFO:teuthology.orchestra.run.smithi049.stdout:Base mon IP(s) is [172.21.15.49:3300, 172.21.15.49:6789], mon addrv is [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-09-19T08:52:52.303 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.49 metric 100 2024-09-19T08:52:52.304 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.49 metric 100 2024-09-19T08:52:52.306 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:52:52.306 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T08:52:52.306 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-09-19T08:52:52.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:52:52.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:52:52.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:52:52.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T08:52:52.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-09-19T08:52:52.309 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:52:52.310 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-09-19T08:52:52.310 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-09-19T08:52:52.310 INFO:teuthology.orchestra.run.smithi049.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:52:52.310 INFO:teuthology.orchestra.run.smithi049.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:52:52.311 INFO:teuthology.orchestra.run.smithi049.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-19T08:52:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 2024-09-19T08:52:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-09-19T08:52:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:52:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:d8a707c21dc06a64315160cb2d8e524fa91943a344731b2a930ee3a716bebbdd 2024-09-19T08:52:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:52:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying config sha256:980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 2024-09-19T08:52:52.786 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:52:53.740 INFO:teuthology.orchestra.run.smithi049.stdout:ceph: stdout ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-19T08:52:53.741 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph version: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-19T08:52:53.741 INFO:teuthology.orchestra.run.smithi049.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:52:54.779 INFO:teuthology.orchestra.run.smithi049.stdout:stat: stdout 167 167 2024-09-19T08:52:54.780 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial keys... 2024-09-19T08:52:55.743 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQBn5utm6sw6CBAAIIGRGyGNdp0GYhS83NFCmg== 2024-09-19T08:52:56.640 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQBo5utmMBgmAxAANsAaIMnH0BaQauMBTPlqTg== 2024-09-19T08:52:57.570 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQBo5utmFm4dOhAA4bHFww6FriqxcVHDpxs+FQ== 2024-09-19T08:52:57.571 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial monmap... 2024-09-19T08:52:58.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:52:58.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-19T08:52:58.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:58.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:52:58.486 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool for smithi049 [v2:172.21.15.49:3300,v1:172.21.15.49:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:52:58.486 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = pacific 2024-09-19T08:52:58.486 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: set fsid to 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:52:58.486 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:52:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:52:58.486 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mon... 2024-09-19T08:52:59.373 INFO:teuthology.orchestra.run.smithi049.stdout:create mon.smithi049 on 2024-09-19T08:52:59.597 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:52:59.758 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:52:59.979 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-63845326-7664-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-63845326-7664-11ef-bceb-c7b262605968.target. 2024-09-19T08:52:59.979 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-63845326-7664-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-63845326-7664-11ef-bceb-c7b262605968.target. 2024-09-19T08:53:00.222 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049 2024-09-19T08:53:00.222 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service: Unit ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service not loaded. 2024-09-19T08:53:00.413 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-63845326-7664-11ef-bceb-c7b262605968.target.wants/ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service → /etc/systemd/system/ceph-63845326-7664-11ef-bceb-c7b262605968@.service. 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:53:00.966 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-19T08:53:00.973 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:53:00.973 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-19T08:53:00.973 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-19T08:53:00.973 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:53:00.973 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon to start... 2024-09-19T08:53:00.973 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon... 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout id: 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi049 (age 0.553138s) 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:53:02.058 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.390+0000 7f6a83301640 1 Processor -- start 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.391+0000 7f6a83301640 1 -- start start 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.391+0000 7f6a83301640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c108460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.391+0000 7f6a83301640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c079e60 con 0x7f6a7c106070 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.391+0000 7f6a8109d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.059 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.391+0000 7f6a8109d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33638/0 (socket says 172.21.15.49:33638) 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.391+0000 7f6a8109d640 1 -- 172.21.15.49:0/1418431517 learned_addr learned my addr 172.21.15.49:0/1418431517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.391+0000 7f6a8109d640 1 -- 172.21.15.49:0/1418431517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c1089a0 con 0x7f6a7c106070 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.393+0000 7f6a8109d640 1 --2- 172.21.15.49:0/1418431517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c108460 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009820 tx=0x7f6a7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d12652491259f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.393+0000 7f6a6ffff640 1 -- 172.21.15.49:0/1418431517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a7802ad40 con 0x7f6a7c106070 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.393+0000 7f6a6ffff640 1 -- 172.21.15.49:0/1418431517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78032440 con 0x7f6a7c106070 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a6ffff640 1 -- 172.21.15.49:0/1418431517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a7802aea0 con 0x7f6a7c106070 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a83301640 1 -- 172.21.15.49:0/1418431517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 msgr2=0x7f6a7c108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a83301640 1 --2- 172.21.15.49:0/1418431517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c108460 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009820 tx=0x7f6a7802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a83301640 1 -- 172.21.15.49:0/1418431517 shutdown_connections 2024-09-19T08:53:02.060 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a83301640 1 --2- 172.21.15.49:0/1418431517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c108460 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a83301640 1 -- 172.21.15.49:0/1418431517 >> 172.21.15.49:0/1418431517 conn(0x7f6a7c0ffc30 msgr2=0x7f6a7c102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a83301640 1 -- 172.21.15.49:0/1418431517 shutdown_connections 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.394+0000 7f6a83301640 1 -- 172.21.15.49:0/1418431517 wait complete. 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.395+0000 7f6a83301640 1 Processor -- start 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.395+0000 7f6a83301640 1 -- start start 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.395+0000 7f6a83301640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c1058a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.395+0000 7f6a83301640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c105de0 con 0x7f6a7c106070 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.395+0000 7f6a8109d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c1058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.395+0000 7f6a8109d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c1058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33640/0 (socket says 172.21.15.49:33640) 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.395+0000 7f6a8109d640 1 -- 172.21.15.49:0/3990715101 learned_addr learned my addr 172.21.15.49:0/3990715101 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a8109d640 1 -- 172.21.15.49:0/3990715101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780094d0 con 0x7f6a7c106070 2024-09-19T08:53:02.061 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a8109d640 1 --2- 172.21.15.49:0/3990715101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c1058a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6a780090b0 tx=0x7f6a780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a6e7fc640 1 -- 172.21.15.49:0/3990715101 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a780308d0 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a6e7fc640 1 -- 172.21.15.49:0/3990715101 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78030a30 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c104020 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a6e7fc640 1 -- 172.21.15.49:0/3990715101 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a78030d30 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c1044c0 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a6e7fc640 1 -- 172.21.15.49:0/3990715101 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6a78039040 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.396+0000 7f6a6e7fc640 1 -- 172.21.15.49:0/3990715101 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6a7803b880 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.397+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c1064d0 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.399+0000 7f6a6e7fc640 1 -- 172.21.15.49:0/3990715101 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6a78037070 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.460+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6a7c108e30 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.460+0000 7f6a6e7fc640 1 -- 172.21.15.49:0/3990715101 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f6a7803bb40 con 0x7f6a7c106070 2024-09-19T08:53:02.062 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.461+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 msgr2=0x7f6a7c1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.461+0000 7f6a83301640 1 --2- 172.21.15.49:0/3990715101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c1058a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6a780090b0 tx=0x7f6a780046c0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.461+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 shutdown_connections 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.461+0000 7f6a83301640 1 --2- 172.21.15.49:0/3990715101 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c106070 0x7f6a7c1058a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.461+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 >> 172.21.15.49:0/3990715101 conn(0x7f6a7c0ffc30 msgr2=0x7f6a7c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.461+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 shutdown_connections 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:01.461+0000 7f6a83301640 1 -- 172.21.15.49:0/3990715101 wait complete. 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:mon is available 2024-09-19T08:53:02.063 INFO:teuthology.orchestra.run.smithi049.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:53:03.130 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:02 smithi049 ceph-mon[27791]: from='client.? 172.21.15.49:0/4078933868' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T08:53:03.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:03.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:53:03.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:03.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:53:03.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.481+0000 7fd722751640 1 Processor -- start 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.481+0000 7fd722751640 1 -- start start 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.482+0000 7fd722751640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.482+0000 7fd722751640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c079ea0 con 0x7fd71c106050 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.482+0000 7fd71bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.482+0000 7fd71bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33642/0 (socket says 172.21.15.49:33642) 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.482+0000 7fd71bfff640 1 -- 172.21.15.49:0/2145585779 learned_addr learned my addr 172.21.15.49:0/2145585779 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.482+0000 7fd71bfff640 1 -- 172.21.15.49:0/2145585779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c108980 con 0x7fd71c106050 2024-09-19T08:53:03.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.483+0000 7fd71bfff640 1 --2- 172.21.15.49:0/2145585779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c108440 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009820 tx=0x7fd70c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b937fe9931825fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.483+0000 7fd71affd640 1 -- 172.21.15.49:0/2145585779 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd70c02ad40 con 0x7fd71c106050 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.483+0000 7fd71affd640 1 -- 172.21.15.49:0/2145585779 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c032440 con 0x7fd71c106050 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.483+0000 7fd71affd640 1 -- 172.21.15.49:0/2145585779 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd70c02aea0 con 0x7fd71c106050 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 -- 172.21.15.49:0/2145585779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 msgr2=0x7fd71c108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 --2- 172.21.15.49:0/2145585779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c108440 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009820 tx=0x7fd70c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 -- 172.21.15.49:0/2145585779 shutdown_connections 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 --2- 172.21.15.49:0/2145585779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c108440 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 -- 172.21.15.49:0/2145585779 >> 172.21.15.49:0/2145585779 conn(0x7fd71c0ffc50 msgr2=0x7fd71c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 -- 172.21.15.49:0/2145585779 shutdown_connections 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 -- 172.21.15.49:0/2145585779 wait complete. 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 Processor -- start 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.484+0000 7fd722751640 1 -- start start 2024-09-19T08:53:03.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd722751640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd722751640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c199040 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd71bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd71bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33658/0 (socket says 172.21.15.49:33658) 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd71bfff640 1 -- 172.21.15.49:0/4078933868 learned_addr learned my addr 172.21.15.49:0/4078933868 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd71bfff640 1 -- 172.21.15.49:0/4078933868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0094d0 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd71bfff640 1 --2- 172.21.15.49:0/4078933868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c198b00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0090b0 tx=0x7fd70c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd70c0308d0 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.485+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c030a30 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.486+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c199240 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.486+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd70c030d30 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.486+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c1996e0 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.486+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd70c039040 con 0x7fd71c106050 2024-09-19T08:53:03.142 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.486+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd70c03b880 con 0x7fd71c106050 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.487+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c1928c0 con 0x7fd71c106050 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.489+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd70c037070 con 0x7fd71c106050 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.547+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd71c108c30 con 0x7fd71c106050 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.551+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 7 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd70c046cb0 con 0x7fd71c106050 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.551+0000 7fd7197fa640 1 -- 172.21.15.49:0/4078933868 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fd70c054d80 con 0x7fd71c106050 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.552+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 msgr2=0x7fd71c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.552+0000 7fd722751640 1 --2- 172.21.15.49:0/4078933868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c198b00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0090b0 tx=0x7fd70c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.552+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 shutdown_connections 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.552+0000 7fd722751640 1 --2- 172.21.15.49:0/4078933868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd71c106050 0x7fd71c198b00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.552+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 >> 172.21.15.49:0/4078933868 conn(0x7fd71c0ffc50 msgr2=0x7fd71c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.552+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 shutdown_connections 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:02.552+0000 7fd722751640 1 -- 172.21.15.49:0/4078933868 wait complete. 2024-09-19T08:53:03.143 INFO:teuthology.orchestra.run.smithi049.stdout:Generating new minimal ceph.conf... 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.495+0000 7f6bf832c640 1 Processor -- start 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.495+0000 7f6bf832c640 1 -- start start 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.495+0000 7f6bf832c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf0105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.495+0000 7f6bf832c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0106550 con 0x7f6bf0105b80 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.496+0000 7f6bf60c8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf0105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.496+0000 7f6bf60c8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf0105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33668/0 (socket says 172.21.15.49:33668) 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.496+0000 7f6bf60c8640 1 -- 172.21.15.49:0/652757641 learned_addr learned my addr 172.21.15.49:0/652757641 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.496+0000 7f6bf60c8640 1 -- 172.21.15.49:0/652757641 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0104750 con 0x7f6bf0105b80 2024-09-19T08:53:04.153 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf60c8640 1 --2- 172.21.15.49:0/652757641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf0105f80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009e80 tx=0x7f6be002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156248e4f9b698c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf50c6640 1 -- 172.21.15.49:0/652757641 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6be0031400 con 0x7f6bf0105b80 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf50c6640 1 -- 172.21.15.49:0/652757641 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6be002d050 con 0x7f6bf0105b80 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf50c6640 1 -- 172.21.15.49:0/652757641 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6be0007910 con 0x7f6bf0105b80 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf832c640 1 -- 172.21.15.49:0/652757641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 msgr2=0x7f6bf0105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf832c640 1 --2- 172.21.15.49:0/652757641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf0105f80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009e80 tx=0x7f6be002a7a0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf832c640 1 -- 172.21.15.49:0/652757641 shutdown_connections 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf832c640 1 --2- 172.21.15.49:0/652757641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf0105f80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf832c640 1 -- 172.21.15.49:0/652757641 >> 172.21.15.49:0/652757641 conn(0x7f6bf00ff3f0 msgr2=0x7f6bf0101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.497+0000 7f6bf832c640 1 -- 172.21.15.49:0/652757641 shutdown_connections 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf832c640 1 -- 172.21.15.49:0/652757641 wait complete. 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf832c640 1 Processor -- start 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf832c640 1 -- start start 2024-09-19T08:53:04.154 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf832c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf01040c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf832c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0104600 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf60c8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf01040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf60c8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf01040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33682/0 (socket says 172.21.15.49:33682) 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.498+0000 7f6bf60c8640 1 -- 172.21.15.49:0/3908861859 learned_addr learned my addr 172.21.15.49:0/3908861859 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bf60c8640 1 -- 172.21.15.49:0/3908861859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009b30 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bf60c8640 1 --2- 172.21.15.49:0/3908861859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf01040c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099e0 tx=0x7f6be00075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bef7fe640 1 -- 172.21.15.49:0/3908861859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6be00319d0 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bef7fe640 1 -- 172.21.15.49:0/3908861859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f6be003c420 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf019c0f0 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bef7fe640 1 -- 172.21.15.49:0/3908861859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6be003a560 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf019c5f0 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bef7fe640 1 -- 172.21.15.49:0/3908861859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6be0038040 con 0x7f6bf0105b80 2024-09-19T08:53:04.155 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.499+0000 7f6bef7fe640 1 -- 172.21.15.49:0/3908861859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6be00449d0 con 0x7f6bf0105b80 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.500+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf0108990 con 0x7f6bf0105b80 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.502+0000 7f6bef7fe640 1 -- 172.21.15.49:0/3908861859 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6be0040070 con 0x7f6bf0105b80 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.560+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6bf019c780 con 0x7f6bf0105b80 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.560+0000 7f6bef7fe640 1 -- 172.21.15.49:0/3908861859 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f6be0036070 con 0x7f6bf0105b80 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.561+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 msgr2=0x7f6bf01040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.561+0000 7f6bf832c640 1 --2- 172.21.15.49:0/3908861859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf01040c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099e0 tx=0x7f6be00075c0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.561+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 shutdown_connections 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.561+0000 7f6bf832c640 1 --2- 172.21.15.49:0/3908861859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6bf0105b80 0x7f6bf01040c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.561+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 >> 172.21.15.49:0/3908861859 conn(0x7f6bf00ff3f0 msgr2=0x7f6bf0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.561+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 shutdown_connections 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:03.561+0000 7f6bf832c640 1 -- 172.21.15.49:0/3908861859 wait complete. 2024-09-19T08:53:04.156 INFO:teuthology.orchestra.run.smithi049.stdout:Restarting the monitor... 2024-09-19T08:53:04.169 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:03 smithi049 ceph-mon[27791]: from='client.? 172.21.15.49:0/3908861859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:04.441 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:04 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T08:53:04.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:04 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[27787]: 2024-09-19T08:53:04.440+0000 7fddf1dc5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:53:04.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:04 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[27787]: 2024-09-19T08:53:04.440+0000 7fddf1dc5640 -1 mon.smithi049@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:53:04.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:04 smithi049 podman[28033]: 2024-09-19 08:53:04.604877328 +0000 UTC m=+0.278784874 container died 9d04d17001d4f7b7025c9377948755c7e084d54c3ff3ea12939e5564ffd262ae (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:53:05.123 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:04 smithi049 podman[28033]: 2024-09-19 08:53:04.932064742 +0000 UTC m=+0.605972292 container cleanup 9d04d17001d4f7b7025c9377948755c7e084d54c3ff3ea12939e5564ffd262ae (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T08:53:05.124 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:04 smithi049 bash[28033]: ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049 2024-09-19T08:53:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 podman[28045]: 2024-09-19 08:53:05.124782971 +0000 UTC m=+0.521323808 container remove 9d04d17001d4f7b7025c9377948755c7e084d54c3ff3ea12939e5564ffd262ae (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T08:53:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service: Deactivated successfully. 2024-09-19T08:53:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 systemd[1]: Stopped Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T08:53:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T08:53:05.835 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 podman[28139]: 2024-09-19 08:53:05.55885975 +0000 UTC m=+0.111756031 container create 619b66ac80ddd7c35c8fdd9b4b8a342166a4f0b95443cb468b4aed3970c753f0 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 podman[28139]: 2024-09-19 08:53:05.463312558 +0000 UTC m=+0.016208839 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph:reef 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 podman[28139]: 2024-09-19 08:53:05.761141629 +0000 UTC m=+0.314037919 container init 619b66ac80ddd7c35c8fdd9b4b8a342166a4f0b95443cb468b4aed3970c753f0 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 podman[28139]: 2024-09-19 08:53:05.764378572 +0000 UTC m=+0.317274855 container start 619b66ac80ddd7c35c8fdd9b4b8a342166a4f0b95443cb468b4aed3970c753f0 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 2 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: pidfile_write: ignore empty --pid-file 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: load: jerasure load: lrc 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Git sha 0 2024-09-19T08:53:05.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: DB SUMMARY 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: DB Session ID: QFKH6ZKODA01SRPRTRNA 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi049/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi049/store.db: 000009.log size: 98987 ; 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:53:05.837 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.env: 0x560b4a864bc0 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.info_log: 0x560b4cf54dc0 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.statistics: (nil) 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.use_fsync: 0 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:53:05.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.db_log_dir: 2024-09-19T08:53:05.842 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.wal_dir: 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.write_buffer_manager: 0x560b4cf62320 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:53:05.843 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.unordered_write: 0 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.row_cache: None 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.wal_filter: None 2024-09-19T08:53:05.844 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.wal_compression: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:53:05.845 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:53:05.846 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_open_files: -1 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Compression algorithms supported: 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kZSTD supported: 0 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:53:05.847 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000010 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.merge_operator: 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_filter: None 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:53:05.848 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560b4cf54a20) 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_type: 0 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_index_type: 0 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_shortening: 1 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:53:05.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: checksum: 4 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: no_block_cache: 0 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache: 0x560b4cf49350 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_options: 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: capacity : 536870912 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_shard_bits : 4 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: strict_capacity_limit : 0 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_compressed: (nil) 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: persistent_cache: (nil) 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size: 4096 2024-09-19T08:53:05.850 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size_deviation: 10 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_restart_interval: 16 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_block_restart_interval: 1 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_block_size: 4096 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: partition_filters: 0 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: use_delta_encoding: 1 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: filter_policy: bloomfilter 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: whole_key_filtering: 1 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: verify_compression: 0 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: format_version: 5 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_index_compression: 1 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_align: 0 2024-09-19T08:53:05.851 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_auto_readahead_size: 262144 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: prepopulate_block_cache: 0 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression: NoCompression 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.num_levels: 7 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:53:05.852 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:53:05.853 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:53:05.854 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:53:05.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:53:05.856 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:53:05.857 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:53:05.857 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:53:05.857 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:53:05.857 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:53:05.857 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:53:05.857 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:53:05.857 INFO:teuthology.orchestra.run.smithi049.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.ttl: 2592000 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:53:05.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:53:05.859 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 200ef800-085d-40d1-8a59-0d08a58f341b 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735985792148, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735985793639, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94259, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92239, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84747, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735985, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "200ef800-085d-40d1-8a59-0d08a58f341b", "db_session_id": "QFKH6ZKODA01SRPRTRNA", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735985793775, "job": 1, "event": "recovery_finished"} 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi049/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560b4cf74e00 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: DB pointer 0x560b4d068000 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:53:05.860 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** DB Stats ** 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L0 2/0 93.95 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:53:05.861 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Sum 2/0 93.95 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:53:05.862 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative compaction: 0.00 GB write, 19.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval compaction: 0.00 GB write, 19.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache BinnedLRUCache@0x560b4cf49350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: starting mon.smithi049 rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi049 fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???) e1 preinit fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:05.863 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???).mds e1 new map 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???).mds e1 print_map 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: e1 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: legacy client fscid: -1 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: No filesystems configured 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:53:05.864 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 bash[28139]: 619b66ac80ddd7c35c8fdd9b4b8a342166a4f0b95443cb468b4aed3970c753f0 2024-09-19T08:53:05.865 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 systemd[1]: Started Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T08:53:06.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mon.smithi049 is new leader, mons smithi049 in quorum (ranks 0) 2024-09-19T08:53:06.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: monmap e1: 1 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T08:53:06.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: fsmap 2024-09-19T08:53:06.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:53:06.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:05 smithi049 ceph-mon[28158]: mgrmap e1: no daemons active 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.271+0000 7f5ce91c4640 1 Processor -- start 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.271+0000 7f5ce91c4640 1 -- start start 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.271+0000 7f5ce91c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce41059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.271+0000 7f5ce91c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4105f90 con 0x7f5ce41055c0 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.271+0000 7f5ce2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce41059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.271+0000 7f5ce2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce41059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33688/0 (socket says 172.21.15.49:33688) 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.271+0000 7f5ce2d9d640 1 -- 172.21.15.49:0/1277850172 learned_addr learned my addr 172.21.15.49:0/1277850172 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.272+0000 7f5ce2d9d640 1 -- 172.21.15.49:0/1277850172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce41067c0 con 0x7f5ce41055c0 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.274+0000 7f5ce2d9d640 1 --2- 172.21.15.49:0/1277850172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce41059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009820 tx=0x7f5cd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a20d47c5a56b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.823 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.274+0000 7f5ce1d9b640 1 -- 172.21.15.49:0/1277850172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd402ad40 con 0x7f5ce41055c0 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.274+0000 7f5ce1d9b640 1 -- 172.21.15.49:0/1277850172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5cd40328c0 con 0x7f5ce41055c0 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.274+0000 7f5ce1d9b640 1 -- 172.21.15.49:0/1277850172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd40307f0 con 0x7f5ce41055c0 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.275+0000 7f5ce91c4640 1 -- 172.21.15.49:0/1277850172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 msgr2=0x7f5ce41059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.275+0000 7f5ce91c4640 1 --2- 172.21.15.49:0/1277850172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce41059c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009820 tx=0x7f5cd402a270 comp rx=0 tx=0).stop 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.275+0000 7f5ce91c4640 1 -- 172.21.15.49:0/1277850172 shutdown_connections 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.275+0000 7f5ce91c4640 1 --2- 172.21.15.49:0/1277850172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce41059c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.275+0000 7f5ce91c4640 1 -- 172.21.15.49:0/1277850172 >> 172.21.15.49:0/1277850172 conn(0x7f5ce4100d30 msgr2=0x7f5ce4103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.275+0000 7f5ce91c4640 1 -- 172.21.15.49:0/1277850172 shutdown_connections 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.275+0000 7f5ce91c4640 1 -- 172.21.15.49:0/1277850172 wait complete. 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce91c4640 1 Processor -- start 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce91c4640 1 -- start start 2024-09-19T08:53:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce91c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce407bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce91c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce407c0a0 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce407bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce407bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33696/0 (socket says 172.21.15.49:33696) 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce2d9d640 1 -- 172.21.15.49:0/2904609324 learned_addr learned my addr 172.21.15.49:0/2904609324 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.276+0000 7f5ce2d9d640 1 -- 172.21.15.49:0/2904609324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd40094d0 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ce2d9d640 1 --2- 172.21.15.49:0/2904609324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce407bb60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4030d30 tx=0x7f5cd4030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ccbfff640 1 -- 172.21.15.49:0/2904609324 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd4032c40 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ccbfff640 1 -- 172.21.15.49:0/2904609324 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f5cd4032da0 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce407a290 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ccbfff640 1 -- 172.21.15.49:0/2904609324 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5cd403c570 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce407a6b0 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ccbfff640 1 -- 172.21.15.49:0/2904609324 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5cd403cb30 con 0x7f5ce41055c0 2024-09-19T08:53:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.277+0000 7f5ccbfff640 1 -- 172.21.15.49:0/2904609324 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5cd40463c0 con 0x7f5ce41055c0 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.278+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce41059c0 con 0x7f5ce41055c0 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.280+0000 7f5ccbfff640 1 -- 172.21.15.49:0/2904609324 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5cd4037070 con 0x7f5ce41055c0 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.338+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f5ce407a8f0 con 0x7f5ce41055c0 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.340+0000 7f5ccbfff640 1 -- 172.21.15.49:0/2904609324 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5cd4047e10 con 0x7f5ce41055c0 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.341+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 msgr2=0x7f5ce407bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.341+0000 7f5ce91c4640 1 --2- 172.21.15.49:0/2904609324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce407bb60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4030d30 tx=0x7f5cd4030d60 comp rx=0 tx=0).stop 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.341+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 shutdown_connections 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.341+0000 7f5ce91c4640 1 --2- 172.21.15.49:0/2904609324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ce41055c0 0x7f5ce407bb60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.341+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 >> 172.21.15.49:0/2904609324 conn(0x7f5ce4100d30 msgr2=0x7f5ce41018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.341+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 shutdown_connections 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:06.341+0000 7f5ce91c4640 1 -- 172.21.15.49:0/2904609324 wait complete. 2024-09-19T08:53:06.826 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:53:06.840 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:53:06.841 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mgr... 2024-09-19T08:53:06.841 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:53:06.842 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:53:06.842 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-19T08:53:07.107 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-63845326-7664-11ef-bceb-c7b262605968@mgr.smithi049.qdvksw 2024-09-19T08:53:07.107 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-63845326-7664-11ef-bceb-c7b262605968@mgr.smithi049.qdvksw.service: Unit ceph-63845326-7664-11ef-bceb-c7b262605968@mgr.smithi049.qdvksw.service not loaded. 2024-09-19T08:53:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-63845326-7664-11ef-bceb-c7b262605968.target.wants/ceph-63845326-7664-11ef-bceb-c7b262605968@mgr.smithi049.qdvksw.service → /etc/systemd/system/ceph-63845326-7664-11ef-bceb-c7b262605968@.service. 2024-09-19T08:53:07.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:07 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2904609324' entity='client.admin' 2024-09-19T08:53:07.836 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:53:07.837 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-19T08:53:07.845 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:53:07.846 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-19T08:53:07.846 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-19T08:53:07.846 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:53:07.856 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:53:07.856 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-19T08:53:07.865 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:53:07.865 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-19T08:53:07.865 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-19T08:53:07.865 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-19T08:53:07.865 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr to start... 2024-09-19T08:53:07.866 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr... 2024-09-19T08:53:08.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:08 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3787244397' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:53:08.856 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "63845326-7664-11ef-bceb-c7b262605968", 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:08.857 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "smithi049" 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:53:08.858 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:53:08.866 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:53:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:53:00.909784+0000", 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.303+0000 7ff948313640 1 Processor -- start 2024-09-19T08:53:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.304+0000 7ff948313640 1 -- start start 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.304+0000 7ff948313640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff9401042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.304+0000 7ff948313640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940079e20 con 0x7ff940103ec0 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.304+0000 7ff9460af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff9401042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.304+0000 7ff9460af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff9401042c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33728/0 (socket says 172.21.15.49:33728) 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.304+0000 7ff9460af640 1 -- 172.21.15.49:0/4195202766 learned_addr learned my addr 172.21.15.49:0/4195202766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.305+0000 7ff9460af640 1 -- 172.21.15.49:0/4195202766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940104800 con 0x7ff940103ec0 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.306+0000 7ff9460af640 1 --2- 172.21.15.49:0/4195202766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff9401042c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009820 tx=0x7ff93c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7798be59bbb99d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.306+0000 7ff9450ad640 1 -- 172.21.15.49:0/4195202766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff93c02ad40 con 0x7ff940103ec0 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.306+0000 7ff9450ad640 1 -- 172.21.15.49:0/4195202766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff93c0328c0 con 0x7ff940103ec0 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.306+0000 7ff9450ad640 1 -- 172.21.15.49:0/4195202766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff93c0307f0 con 0x7ff940103ec0 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.307+0000 7ff948313640 1 -- 172.21.15.49:0/4195202766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 msgr2=0x7ff9401042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.307+0000 7ff948313640 1 --2- 172.21.15.49:0/4195202766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff9401042c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009820 tx=0x7ff93c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.307+0000 7ff948313640 1 -- 172.21.15.49:0/4195202766 shutdown_connections 2024-09-19T08:53:08.869 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.307+0000 7ff948313640 1 --2- 172.21.15.49:0/4195202766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff9401042c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.307+0000 7ff948313640 1 -- 172.21.15.49:0/4195202766 >> 172.21.15.49:0/4195202766 conn(0x7ff9400ffc50 msgr2=0x7ff9401020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.307+0000 7ff948313640 1 -- 172.21.15.49:0/4195202766 shutdown_connections 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.307+0000 7ff948313640 1 -- 172.21.15.49:0/4195202766 wait complete. 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff948313640 1 Processor -- start 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff948313640 1 -- start start 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff948313640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff94019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff948313640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94019b9e0 con 0x7ff940103ec0 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff9460af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff94019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff9460af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff94019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33736/0 (socket says 172.21.15.49:33736) 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff9460af640 1 -- 172.21.15.49:0/3787244397 learned_addr learned my addr 172.21.15.49:0/3787244397 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff9460af640 1 -- 172.21.15.49:0/3787244397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0094d0 con 0x7ff940103ec0 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.308+0000 7ff9460af640 1 --2- 172.21.15.49:0/3787244397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff94019b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff93c030d30 tx=0x7ff93c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:08.870 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.309+0000 7ff9377fe640 1 -- 172.21.15.49:0/3787244397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff93c032c40 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.309+0000 7ff9377fe640 1 -- 172.21.15.49:0/3787244397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff93c032da0 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.309+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94019bbe0 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.309+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94019c000 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.309+0000 7ff9377fe640 1 -- 172.21.15.49:0/3787244397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff93c03c660 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.309+0000 7ff9377fe640 1 -- 172.21.15.49:0/3787244397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff93c03cc10 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.309+0000 7ff9377fe640 1 -- 172.21.15.49:0/3787244397 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff93c0463c0 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.310+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff924005280 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.312+0000 7ff9377fe640 1 -- 172.21.15.49:0/3787244397 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff93c037070 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.373+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff924005800 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.373+0000 7ff9377fe640 1 -- 172.21.15.49:0/3787244397 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7ff93c03db00 con 0x7ff940103ec0 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.375+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 msgr2=0x7ff94019b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:08.871 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.375+0000 7ff948313640 1 --2- 172.21.15.49:0/3787244397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff94019b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff93c030d30 tx=0x7ff93c030d60 comp rx=0 tx=0).stop 2024-09-19T08:53:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.375+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 shutdown_connections 2024-09-19T08:53:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.375+0000 7ff948313640 1 --2- 172.21.15.49:0/3787244397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff940103ec0 0x7ff94019b4a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.375+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 >> 172.21.15.49:0/3787244397 conn(0x7ff9400ffc50 msgr2=0x7ff94018fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.375+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 shutdown_connections 2024-09-19T08:53:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:08.375+0000 7ff948313640 1 -- 172.21.15.49:0/3787244397 wait complete. 2024-09-19T08:53:08.872 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:53:11.618 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:11 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3249837885' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "63845326-7664-11ef-bceb-c7b262605968", 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:53:12.029 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "smithi049" 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:53:12.030 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:53:12.031 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:53:12.032 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:53:00.909784+0000", 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:12.033 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.325+0000 7febdd176640 1 Processor -- start 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.326+0000 7febdd176640 1 -- start start 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.326+0000 7febdd176640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd8108500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.326+0000 7febdd176640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8079de0 con 0x7febd8106110 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.326+0000 7febd6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd8108500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.326+0000 7febd6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd8108500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42438/0 (socket says 172.21.15.49:42438) 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.326+0000 7febd6d9d640 1 -- 172.21.15.49:0/2651306706 learned_addr learned my addr 172.21.15.49:0/2651306706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.326+0000 7febd6d9d640 1 -- 172.21.15.49:0/2651306706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8079f20 con 0x7febd8106110 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.327+0000 7febd6d9d640 1 --2- 172.21.15.49:0/2651306706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd8108500 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febc8009820 tx=0x7febc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46039e80175cefc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.327+0000 7febd5d9b640 1 -- 172.21.15.49:0/2651306706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febc802ad40 con 0x7febd8106110 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.327+0000 7febd5d9b640 1 -- 172.21.15.49:0/2651306706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7febc80328c0 con 0x7febd8106110 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.327+0000 7febd5d9b640 1 -- 172.21.15.49:0/2651306706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febc80307f0 con 0x7febd8106110 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 -- 172.21.15.49:0/2651306706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 msgr2=0x7febd8108500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 --2- 172.21.15.49:0/2651306706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd8108500 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febc8009820 tx=0x7febc802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:12.034 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 -- 172.21.15.49:0/2651306706 shutdown_connections 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 --2- 172.21.15.49:0/2651306706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd8108500 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 -- 172.21.15.49:0/2651306706 >> 172.21.15.49:0/2651306706 conn(0x7febd80ffc50 msgr2=0x7febd81020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 -- 172.21.15.49:0/2651306706 shutdown_connections 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 -- 172.21.15.49:0/2651306706 wait complete. 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.328+0000 7febdd176640 1 Processor -- start 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febdd176640 1 -- start start 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febdd176640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febdd176640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd81997f0 con 0x7febd8106110 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febd6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febd6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd81992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42450/0 (socket says 172.21.15.49:42450) 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febd6d9d640 1 -- 172.21.15.49:0/3249837885 learned_addr learned my addr 172.21.15.49:0/3249837885 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:12.035 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febd6d9d640 1 -- 172.21.15.49:0/3249837885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80094d0 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febd6d9d640 1 --2- 172.21.15.49:0/3249837885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd81992b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febc8009940 tx=0x7febc8032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febbffff640 1 -- 172.21.15.49:0/3249837885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febc8041070 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd81999f0 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.329+0000 7febbffff640 1 -- 172.21.15.49:0/3249837885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7febc8030cc0 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.330+0000 7febbffff640 1 -- 172.21.15.49:0/3249837885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febc803c620 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.330+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd8199e10 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.330+0000 7febbffff640 1 -- 172.21.15.49:0/3249837885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7febc803cb50 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.330+0000 7febbffff640 1 -- 172.21.15.49:0/3249837885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7febc8046e00 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.331+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd8109720 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.333+0000 7febbffff640 1 -- 172.21.15.49:0/3249837885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7febc8037070 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.394+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7febd819ca20 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.395+0000 7febbffff640 1 -- 172.21.15.49:0/3249837885 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7febc8030e30 con 0x7febd8106110 2024-09-19T08:53:12.036 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.396+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 msgr2=0x7febd81992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.396+0000 7febdd176640 1 --2- 172.21.15.49:0/3249837885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd81992b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febc8009940 tx=0x7febc8032c60 comp rx=0 tx=0).stop 2024-09-19T08:53:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.396+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 shutdown_connections 2024-09-19T08:53:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.396+0000 7febdd176640 1 --2- 172.21.15.49:0/3249837885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febd8106110 0x7febd81992b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.396+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 >> 172.21.15.49:0/3249837885 conn(0x7febd80ffc50 msgr2=0x7febd8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.396+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 shutdown_connections 2024-09-19T08:53:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:11.396+0000 7febdd176640 1 -- 172.21.15.49:0/3249837885 wait complete. 2024-09-19T08:53:12.037 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:53:13.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: Activating manager daemon smithi049.qdvksw 2024-09-19T08:53:13.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: mgrmap e2: smithi049.qdvksw(active, starting, since 0.0028881s) 2024-09-19T08:53:13.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:53:13.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:53:13.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:53:13.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:53:13.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T08:53:13.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: Manager daemon smithi049.qdvksw is now available 2024-09-19T08:53:13.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:53:13.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:13.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T08:53:13.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:13.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:12 smithi049 ceph-mon[28158]: from='mgr.14100 172.21.15.49:0/3349238242' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:15.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:14 smithi049 ceph-mon[28158]: mgrmap e3: smithi049.qdvksw(active, since 1.00771s) 2024-09-19T08:53:15.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:14 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1994307325' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:53:15.253 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:15.253 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:15.253 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "63845326-7664-11ef-bceb-c7b262605968", 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "smithi049" 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T08:53:15.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:53:15.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:53:15.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:53:15.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:53:15.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:15.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:53:15.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:15.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:53:00.909784+0000", 2024-09-19T08:53:15.267 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.441+0000 7f4dec662640 1 Processor -- start 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.441+0000 7f4dec662640 1 -- start start 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.441+0000 7f4dec662640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41103c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.441+0000 7f4dec662640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4110990 con 0x7f4de410ffc0 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.441+0000 7f4dea3fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.441+0000 7f4dea3fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42508/0 (socket says 172.21.15.49:42508) 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.441+0000 7f4dea3fe640 1 -- 172.21.15.49:0/2511378824 learned_addr learned my addr 172.21.15.49:0/2511378824 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.442+0000 7f4dea3fe640 1 -- 172.21.15.49:0/2511378824 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de41111c0 con 0x7f4de410ffc0 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.442+0000 7f4dea3fe640 1 --2- 172.21.15.49:0/2511378824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41103c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009820 tx=0x7f4de002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defd3146856b08bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:15.268 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.443+0000 7f4de93fc640 1 -- 172.21.15.49:0/2511378824 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de002ad40 con 0x7f4de410ffc0 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.443+0000 7f4de93fc640 1 -- 172.21.15.49:0/2511378824 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f4de00328c0 con 0x7f4de410ffc0 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.443+0000 7f4de93fc640 1 -- 172.21.15.49:0/2511378824 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de00307f0 con 0x7f4de410ffc0 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.443+0000 7f4dec662640 1 -- 172.21.15.49:0/2511378824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 msgr2=0x7f4de41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.443+0000 7f4dec662640 1 --2- 172.21.15.49:0/2511378824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41103c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009820 tx=0x7f4de002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 -- 172.21.15.49:0/2511378824 shutdown_connections 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 --2- 172.21.15.49:0/2511378824 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41103c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 -- 172.21.15.49:0/2511378824 >> 172.21.15.49:0/2511378824 conn(0x7f4de406abb0 msgr2=0x7f4de410dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 -- 172.21.15.49:0/2511378824 shutdown_connections 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 -- 172.21.15.49:0/2511378824 wait complete. 2024-09-19T08:53:15.269 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 Processor -- start 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 -- start start 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.444+0000 7f4dec662640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de41a41e0 con 0x7f4de410ffc0 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4dea3fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4dea3fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42514/0 (socket says 172.21.15.49:42514) 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4dea3fe640 1 -- 172.21.15.49:0/1994307325 learned_addr learned my addr 172.21.15.49:0/1994307325 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4dea3fe640 1 -- 172.21.15.49:0/1994307325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de00094d0 con 0x7f4de410ffc0 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4dea3fe640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41a3ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4de00303a0 tx=0x7f4de0032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4ddb7fe640 1 -- 172.21.15.49:0/1994307325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de0030cc0 con 0x7f4de410ffc0 2024-09-19T08:53:15.270 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4ddb7fe640 1 -- 172.21.15.49:0/1994307325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f4de0030e20 con 0x7f4de410ffc0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de41a43e0 con 0x7f4de410ffc0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4ddb7fe640 1 -- 172.21.15.49:0/1994307325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4de003c620 con 0x7f4de410ffc0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.445+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de41a4800 con 0x7f4de410ffc0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.446+0000 7f4ddb7fe640 1 -- 172.21.15.49:0/1994307325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 3) v1 ==== 45439+0+0 (secure 0 0 0) 0x7f4de003c860 con 0x7f4de410ffc0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.447+0000 7f4ddb7fe640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f4dd00384e0 0x7f4dd003a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.447+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de41103c0 con 0x7f4de410ffc0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.447+0000 7f4ddb7fe640 1 -- 172.21.15.49:0/1994307325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4de006ba00 con 0x7f4de410ffc0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.447+0000 7f4de9bfd640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f4dd00384e0 0x7f4dd003a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.447+0000 7f4de9bfd640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f4dd00384e0 0x7f4dd003a9a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40098c0 tx=0x7f4dd4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:15.271 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.452+0000 7f4ddb7fe640 1 -- 172.21.15.49:0/1994307325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4de00313a0 con 0x7f4de410ffc0 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.688+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4de41a7160 con 0x7f4de410ffc0 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.689+0000 7f4ddb7fe640 1 -- 172.21.15.49:0/1994307325 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1245 (secure 0 0 0) 0x7f4de003bb30 con 0x7f4de410ffc0 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f4dd00384e0 msgr2=0x7f4dd003a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f4dd00384e0 0x7f4dd003a9a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40098c0 tx=0x7f4dd4006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 msgr2=0x7f4de41a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41a3ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4de00303a0 tx=0x7f4de0032c60 comp rx=0 tx=0).stop 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 shutdown_connections 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f4dd00384e0 0x7f4dd003a9a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 --2- 172.21.15.49:0/1994307325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4de410ffc0 0x7f4de41a3ca0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 >> 172.21.15.49:0/1994307325 conn(0x7f4de406abb0 msgr2=0x7f4de41123e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 shutdown_connections 2024-09-19T08:53:15.273 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:14.691+0000 7f4dec662640 1 -- 172.21.15.49:0/1994307325 wait complete. 2024-09-19T08:53:15.273 INFO:teuthology.orchestra.run.smithi049.stdout:mgr is available 2024-09-19T08:53:15.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:15 smithi049 ceph-mon[28158]: mgrmap e4: smithi049.qdvksw(active, since 2s) 2024-09-19T08:53:17.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:16 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1938887058' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.646+0000 7fde93abb640 1 Processor -- start 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.647+0000 7fde93abb640 1 -- start start 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.647+0000 7fde93abb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.255 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.647+0000 7fde93abb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c07a8c0 con 0x7fde8c07be90 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.647+0000 7fde91857640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.647+0000 7fde91857640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42520/0 (socket says 172.21.15.49:42520) 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.647+0000 7fde91857640 1 -- 172.21.15.49:0/1110349632 learned_addr learned my addr 172.21.15.49:0/1110349632 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.647+0000 7fde91857640 1 -- 172.21.15.49:0/1110349632 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c07aa00 con 0x7fde8c07be90 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.648+0000 7fde91857640 1 --2- 172.21.15.49:0/1110349632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c07a2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fde80009820 tx=0x7fde8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c0e1dc11563e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.648+0000 7fde90855640 1 -- 172.21.15.49:0/1110349632 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde8002ad40 con 0x7fde8c07be90 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.648+0000 7fde90855640 1 -- 172.21.15.49:0/1110349632 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fde800328c0 con 0x7fde8c07be90 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.648+0000 7fde90855640 1 -- 172.21.15.49:0/1110349632 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde800307f0 con 0x7fde8c07be90 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 -- 172.21.15.49:0/1110349632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 msgr2=0x7fde8c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 --2- 172.21.15.49:0/1110349632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c07a2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fde80009820 tx=0x7fde8002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 -- 172.21.15.49:0/1110349632 shutdown_connections 2024-09-19T08:53:17.256 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 --2- 172.21.15.49:0/1110349632 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c07a2f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 -- 172.21.15.49:0/1110349632 >> 172.21.15.49:0/1110349632 conn(0x7fde8c100d80 msgr2=0x7fde8c1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 -- 172.21.15.49:0/1110349632 shutdown_connections 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 -- 172.21.15.49:0/1110349632 wait complete. 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.649+0000 7fde93abb640 1 Processor -- start 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde93abb640 1 -- start start 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde93abb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde93abb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c19ba10 con 0x7fde8c07be90 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde91857640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde91857640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42534/0 (socket says 172.21.15.49:42534) 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde91857640 1 -- 172.21.15.49:0/1938887058 learned_addr learned my addr 172.21.15.49:0/1938887058 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde91857640 1 -- 172.21.15.49:0/1938887058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800094d0 con 0x7fde8c07be90 2024-09-19T08:53:17.257 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde91857640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c19b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde80030d30 tx=0x7fde80030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde7effd640 1 -- 172.21.15.49:0/1938887058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde80032c40 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde7effd640 1 -- 172.21.15.49:0/1938887058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fde80032da0 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c19bc10 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.650+0000 7fde7effd640 1 -- 172.21.15.49:0/1938887058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde8003c660 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.651+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c19c030 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.652+0000 7fde7effd640 1 -- 172.21.15.49:0/1938887058 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fde8003c7e0 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.652+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c10b930 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.652+0000 7fde7effd640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7fde78038650 0x7fde7803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.652+0000 7fde7effd640 1 -- 172.21.15.49:0/1938887058 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fde8006b6d0 con 0x7fde8c07be90 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.652+0000 7fde91056640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7fde78038650 0x7fde7803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.652+0000 7fde91056640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7fde78038650 0x7fde7803ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fde8800ad30 tx=0x7fde880093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.657+0000 7fde7effd640 1 -- 172.21.15.49:0/1938887058 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fde80045d30 con 0x7fde8c07be90 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.831+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fde8c10bb40 con 0x7fde8c07be90 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.832+0000 7fde7effd640 1 -- 172.21.15.49:0/1938887058 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fde80045b50 con 0x7fde8c07be90 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7fde78038650 msgr2=0x7fde7803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7fde78038650 0x7fde7803ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fde8800ad30 tx=0x7fde880093f0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 msgr2=0x7fde8c19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c19b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde80030d30 tx=0x7fde80030d60 comp rx=0 tx=0).stop 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 shutdown_connections 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7fde78038650 0x7fde7803ab10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 --2- 172.21.15.49:0/1938887058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde8c07be90 0x7fde8c19b4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 >> 172.21.15.49:0/1938887058 conn(0x7fde8c100d80 msgr2=0x7fde8c101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:17.259 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 shutdown_connections 2024-09-19T08:53:17.260 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:15.834+0000 7fde93abb640 1 -- 172.21.15.49:0/1938887058 wait complete. 2024-09-19T08:53:17.260 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling cephadm module... 2024-09-19T08:53:20.499 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:20 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2397528231' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:53:21.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:21 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2397528231' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:53:21.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:21 smithi049 ceph-mon[28158]: mgrmap e5: smithi049.qdvksw(active, since 7s) 2024-09-19T08:53:25.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: Active manager daemon smithi049.qdvksw restarted 2024-09-19T08:53:25.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: Activating manager daemon smithi049.qdvksw 2024-09-19T08:53:25.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:53:25.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: mgrmap e6: smithi049.qdvksw(active, starting, since 0.00296994s) 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: Manager daemon smithi049.qdvksw is now available 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:53:25.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:25 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T08:53:26.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:26 smithi049 ceph-mon[28158]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:53:26.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:26 smithi049 ceph-mon[28158]: mgrmap e7: smithi049.qdvksw(active, since 1.00543s) 2024-09-19T08:53:26.897 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.015+0000 7f0dd2d62640 1 Processor -- start 2024-09-19T08:53:26.897 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.015+0000 7f0dd2d62640 1 -- start start 2024-09-19T08:53:26.897 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.015+0000 7f0dd2d62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc07a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.897 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.015+0000 7f0dd2d62640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc07a8a0 con 0x7f0dcc07be70 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.016+0000 7f0dd0afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc07a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.016+0000 7f0dd0afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc07a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42540/0 (socket says 172.21.15.49:42540) 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.016+0000 7f0dd0afe640 1 -- 172.21.15.49:0/836065065 learned_addr learned my addr 172.21.15.49:0/836065065 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.016+0000 7f0dd0afe640 1 -- 172.21.15.49:0/836065065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc07a9e0 con 0x7f0dcc07be70 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.017+0000 7f0dd0afe640 1 --2- 172.21.15.49:0/836065065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc07a2d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009820 tx=0x7f0dc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff59973aa868308 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.017+0000 7f0dcb7fe640 1 -- 172.21.15.49:0/836065065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0dc002ad40 con 0x7f0dcc07be70 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.017+0000 7f0dcb7fe640 1 -- 172.21.15.49:0/836065065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f0dc00328c0 con 0x7f0dcc07be70 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.017+0000 7f0dcb7fe640 1 -- 172.21.15.49:0/836065065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0dc00307f0 con 0x7f0dcc07be70 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 -- 172.21.15.49:0/836065065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 msgr2=0x7f0dcc07a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 --2- 172.21.15.49:0/836065065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc07a2d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009820 tx=0x7f0dc002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 -- 172.21.15.49:0/836065065 shutdown_connections 2024-09-19T08:53:26.898 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 --2- 172.21.15.49:0/836065065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc07a2d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 -- 172.21.15.49:0/836065065 >> 172.21.15.49:0/836065065 conn(0x7f0dcc100d70 msgr2=0x7f0dcc103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 -- 172.21.15.49:0/836065065 shutdown_connections 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 -- 172.21.15.49:0/836065065 wait complete. 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 Processor -- start 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.018+0000 7f0dd2d62640 1 -- start start 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd2d62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd2d62640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc19ba10 con 0x7f0dcc07be70 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd0afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd0afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42548/0 (socket says 172.21.15.49:42548) 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd0afe640 1 -- 172.21.15.49:0/2397528231 learned_addr learned my addr 172.21.15.49:0/2397528231 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd0afe640 1 -- 172.21.15.49:0/2397528231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00094d0 con 0x7f0dcc07be70 2024-09-19T08:53:26.899 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd0afe640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc19b4d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009940 tx=0x7f0dc0032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0dc0041070 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f0dc0030cc0 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc19bc10 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.019+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0dc003c620 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.020+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc19c030 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.020+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f0dc003c780 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.021+0000 7f0dc9ffb640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f0dbc038650 0x7f0dbc03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.021+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0dc006b5d0 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.021+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc10b930 con 0x7f0dcc07be70 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.021+0000 7f0dcbfff640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f0dbc038650 0x7f0dbc03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.021+0000 7f0dcbfff640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f0dbc038650 0x7f0dbc03ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0db80098c0 tx=0x7f0db8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:26.900 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.026+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0dc0046410 con 0x7f0dcc07be70 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.245+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f0dcc19ebb0 con 0x7f0dcc07be70 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.297+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f0dc003db00 con 0x7f0dcc07be70 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.298+0000 7f0dc9ffb640 1 -- 172.21.15.49:0/2397528231 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f0dc003bc40 con 0x7f0dcc07be70 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f0dbc038650 msgr2=0x7f0dbc03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f0dbc038650 0x7f0dbc03ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0db80098c0 tx=0x7f0db8006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 msgr2=0x7f0dcc19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc19b4d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009940 tx=0x7f0dc0032c60 comp rx=0 tx=0).stop 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 shutdown_connections 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:6800/1436634671,v1:172.21.15.49:6801/1436634671] conn(0x7f0dbc038650 0x7f0dbc03ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 --2- 172.21.15.49:0/2397528231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0dcc07be70 0x7f0dcc19b4d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 >> 172.21.15.49:0/2397528231 conn(0x7f0dcc100d70 msgr2=0x7f0dcc101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 shutdown_connections 2024-09-19T08:53:26.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:20.301+0000 7f0dd2d62640 1 -- 172.21.15.49:0/2397528231 wait complete. 2024-09-19T08:53:28.252 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:28 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:28.252 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:28 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:29.225 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 8, 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "smithi049.qdvksw", 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.425+0000 7fd370160640 1 Processor -- start 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.426+0000 7fd370160640 1 -- start start 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.426+0000 7fd370160640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd368108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.426+0000 7fd370160640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368079ea0 con 0x7fd368106050 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.426+0000 7fd36defc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd368108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:29.226 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.426+0000 7fd36defc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd368108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52804/0 (socket says 172.21.15.49:52804) 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.426+0000 7fd36defc640 1 -- 172.21.15.49:0/2935056826 learned_addr learned my addr 172.21.15.49:0/2935056826 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.426+0000 7fd36defc640 1 -- 172.21.15.49:0/2935056826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368108980 con 0x7fd368106050 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.427+0000 7fd36defc640 1 --2- 172.21.15.49:0/2935056826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd368108440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd364009820 tx=0x7fd36402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04ac6ad394bbd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.427+0000 7fd36cefa640 1 -- 172.21.15.49:0/2935056826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd36402ad40 con 0x7fd368106050 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.427+0000 7fd36cefa640 1 -- 172.21.15.49:0/2935056826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd3640328c0 con 0x7fd368106050 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.427+0000 7fd36cefa640 1 -- 172.21.15.49:0/2935056826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3640307f0 con 0x7fd368106050 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.428+0000 7fd370160640 1 -- 172.21.15.49:0/2935056826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 msgr2=0x7fd368108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.428+0000 7fd370160640 1 --2- 172.21.15.49:0/2935056826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd368108440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd364009820 tx=0x7fd36402a270 comp rx=0 tx=0).stop 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.428+0000 7fd370160640 1 -- 172.21.15.49:0/2935056826 shutdown_connections 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.428+0000 7fd370160640 1 --2- 172.21.15.49:0/2935056826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd368108440 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.428+0000 7fd370160640 1 -- 172.21.15.49:0/2935056826 >> 172.21.15.49:0/2935056826 conn(0x7fd3680ffc50 msgr2=0x7fd3681020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.428+0000 7fd370160640 1 -- 172.21.15.49:0/2935056826 shutdown_connections 2024-09-19T08:53:29.227 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.428+0000 7fd370160640 1 -- 172.21.15.49:0/2935056826 wait complete. 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd370160640 1 Processor -- start 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd370160640 1 -- start start 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd370160640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd3681992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd370160640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3681997f0 con 0x7fd368106050 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd36defc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd3681992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd36defc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd3681992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52810/0 (socket says 172.21.15.49:52810) 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd36defc640 1 -- 172.21.15.49:0/722374300 learned_addr learned my addr 172.21.15.49:0/722374300 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd36defc640 1 -- 172.21.15.49:0/722374300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3640094d0 con 0x7fd368106050 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.429+0000 7fd36defc640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd3681992b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd364030d30 tx=0x7fd364030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.430+0000 7fd35affd640 1 -- 172.21.15.49:0/722374300 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd364032c40 con 0x7fd368106050 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.430+0000 7fd35affd640 1 -- 172.21.15.49:0/722374300 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd364032da0 con 0x7fd368106050 2024-09-19T08:53:29.228 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.430+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3681999f0 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.430+0000 7fd35affd640 1 -- 172.21.15.49:0/722374300 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd36403c660 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.430+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd368199e10 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.430+0000 7fd35affd640 1 -- 172.21.15.49:0/722374300 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fd36403c7e0 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.431+0000 7fd35affd640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd3540386a0 0x7fd35403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.431+0000 7fd35affd640 1 -- 172.21.15.49:0/722374300 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd36406b7c0 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.431+0000 7fd36d6fb640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd3540386a0 0x7fd35403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.431+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd368106430 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.431+0000 7fd36d6fb640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd3540386a0 0x7fd35403ab60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0098c0 tx=0x7fd35c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.436+0000 7fd35affd640 1 -- 172.21.15.49:0/722374300 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd364047460 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.651+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd368109930 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.652+0000 7fd35affd640 1 -- 172.21.15.49:0/722374300 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v8) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd36403b340 con 0x7fd368106050 2024-09-19T08:53:29.229 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.653+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd3540386a0 msgr2=0x7fd35403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.653+0000 7fd370160640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd3540386a0 0x7fd35403ab60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0098c0 tx=0x7fd35c006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.653+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 msgr2=0x7fd3681992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.653+0000 7fd370160640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd3681992b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd364030d30 tx=0x7fd364030d60 comp rx=0 tx=0).stop 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.654+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 shutdown_connections 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.654+0000 7fd370160640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd3540386a0 0x7fd35403ab60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.654+0000 7fd370160640 1 --2- 172.21.15.49:0/722374300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd368106050 0x7fd3681992b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.654+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 >> 172.21.15.49:0/722374300 conn(0x7fd3680ffc50 msgr2=0x7fd368100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.654+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 shutdown_connections 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:28.654+0000 7fd370160640 1 -- 172.21.15.49:0/722374300 wait complete. 2024-09-19T08:53:29.230 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-09-19T08:53:29.231 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 8... 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:29 smithi049 ceph-mon[28158]: mgrmap e8: smithi049.qdvksw(active, since 2s) 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:29 smithi049 ceph-mon[28158]: [19/Sep/2024:08:53:28] ENGINE Bus STARTING 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:29 smithi049 ceph-mon[28158]: [19/Sep/2024:08:53:28] ENGINE Serving on https://172.21.15.49:7150 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:29 smithi049 ceph-mon[28158]: [19/Sep/2024:08:53:28] ENGINE Error in HTTPServer.serve 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Traceback (most recent call last): 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:53:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._run(expiration_interval) 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s = self.context.wrap_socket( 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: return self.sslsocket_class._create( 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self.do_handshake() 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:53:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._sslobj.do_handshake() 2024-09-19T08:53:29.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:53:29.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:29 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:29.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:29 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/722374300' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:53:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-19T08:53:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:53:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f186214f640 1 Processor -- start 2024-09-19T08:53:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f186214f640 1 -- start start 2024-09-19T08:53:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f186214f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f186214f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c079e60 con 0x7f185c106090 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52816/0 (socket says 172.21.15.49:52816) 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f185b7fe640 1 -- 172.21.15.49:0/887975580 learned_addr learned my addr 172.21.15.49:0/887975580 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.662+0000 7f185b7fe640 1 -- 172.21.15.49:0/887975580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c1089c0 con 0x7f185c106090 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.663+0000 7f185b7fe640 1 --2- 172.21.15.49:0/887975580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c108480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f184c009820 tx=0x7f184c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96f2d295e42057c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.663+0000 7f185a7fc640 1 -- 172.21.15.49:0/887975580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f184c02ad40 con 0x7f185c106090 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.663+0000 7f185a7fc640 1 -- 172.21.15.49:0/887975580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f184c0328c0 con 0x7f185c106090 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.663+0000 7f185a7fc640 1 -- 172.21.15.49:0/887975580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f184c0307f0 con 0x7f185c106090 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.664+0000 7f186214f640 1 -- 172.21.15.49:0/887975580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 msgr2=0x7f185c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.664+0000 7f186214f640 1 --2- 172.21.15.49:0/887975580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c108480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f184c009820 tx=0x7f184c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.664+0000 7f186214f640 1 -- 172.21.15.49:0/887975580 shutdown_connections 2024-09-19T08:53:30.124 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.664+0000 7f186214f640 1 --2- 172.21.15.49:0/887975580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c108480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.664+0000 7f186214f640 1 -- 172.21.15.49:0/887975580 >> 172.21.15.49:0/887975580 conn(0x7f185c0ffc50 msgr2=0x7f185c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.664+0000 7f186214f640 1 -- 172.21.15.49:0/887975580 shutdown_connections 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.664+0000 7f186214f640 1 -- 172.21.15.49:0/887975580 wait complete. 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f186214f640 1 Processor -- start 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f186214f640 1 -- start start 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f186214f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f186214f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c199800 con 0x7f185c106090 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52818/0 (socket says 172.21.15.49:52818) 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f185b7fe640 1 -- 172.21.15.49:0/683750838 learned_addr learned my addr 172.21.15.49:0/683750838 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.665+0000 7f185b7fe640 1 -- 172.21.15.49:0/683750838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0094d0 con 0x7f185c106090 2024-09-19T08:53:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.666+0000 7f185b7fe640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c1992c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f184c009940 tx=0x7f184c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.666+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f184c041070 con 0x7f185c106090 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.666+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f184c030cc0 con 0x7f185c106090 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.666+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c199a00 con 0x7f185c106090 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.666+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f184c03c620 con 0x7f185c106090 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.666+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c199e20 con 0x7f185c106090 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.667+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f184c03c780 con 0x7f185c106090 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.667+0000 7f1858ff9640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f18440386a0 0x7f184403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.667+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f184403b270 con 0x7f18440386a0 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.667+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f184c06b650 con 0x7f185c106090 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.667+0000 7f185affd640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f18440386a0 0x7f184403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.668+0000 7f185affd640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f18440386a0 0x7f184403ab60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18500098c0 tx=0x7f1850006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.668+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f184403b270 con 0x7f18440386a0 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.673+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f185c106470 con 0x7f18440386a0 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f1858ff9640 1 -- 172.21.15.49:0/683750838 <== mgr.14118 v2:172.21.15.49:6800/1902543814 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f185c106470 con 0x7f18440386a0 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f18440386a0 msgr2=0x7f184403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f18440386a0 0x7f184403ab60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18500098c0 tx=0x7f1850006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 msgr2=0x7f185c1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c1992c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f184c009940 tx=0x7f184c032c60 comp rx=0 tx=0).stop 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 shutdown_connections 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f18440386a0 0x7f184403ab60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 --2- 172.21.15.49:0/683750838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f185c106090 0x7f185c1992c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 >> 172.21.15.49:0/683750838 conn(0x7f185c0ffc50 msgr2=0x7f185c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 shutdown_connections 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:29.674+0000 7f186214f640 1 -- 172.21.15.49:0/683750838 wait complete. 2024-09-19T08:53:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 8 is available 2024-09-19T08:53:30.128 INFO:teuthology.orchestra.run.smithi049.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:53:30.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:30 smithi049 ceph-mon[28158]: [19/Sep/2024:08:53:28] ENGINE Serving on http://172.21.15.49:8765 2024-09-19T08:53:30.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:30 smithi049 ceph-mon[28158]: [19/Sep/2024:08:53:28] ENGINE Bus STARTED 2024-09-19T08:53:31.244 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.505+0000 7f14252c4640 1 Processor -- start 2024-09-19T08:53:31.244 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.505+0000 7f14252c4640 1 -- start start 2024-09-19T08:53:31.244 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.505+0000 7f14252c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f14201059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.505+0000 7f14252c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420105f90 con 0x7f14201055c0 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.505+0000 7f141effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f14201059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.505+0000 7f141effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f14201059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41444/0 (socket says 172.21.15.49:41444) 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.505+0000 7f141effd640 1 -- 172.21.15.49:0/609689896 learned_addr learned my addr 172.21.15.49:0/609689896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.506+0000 7f141effd640 1 -- 172.21.15.49:0/609689896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14201067c0 con 0x7f14201055c0 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.506+0000 7f141effd640 1 --2- 172.21.15.49:0/609689896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f14201059c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1410009820 tx=0x7f141002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895c5a5bf6f18b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.506+0000 7f141dffb640 1 -- 172.21.15.49:0/609689896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f141002ad40 con 0x7f14201055c0 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.506+0000 7f141dffb640 1 -- 172.21.15.49:0/609689896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f14100328c0 con 0x7f14201055c0 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.506+0000 7f141dffb640 1 -- 172.21.15.49:0/609689896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14100307f0 con 0x7f14201055c0 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.507+0000 7f14252c4640 1 -- 172.21.15.49:0/609689896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 msgr2=0x7f14201059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.507+0000 7f14252c4640 1 --2- 172.21.15.49:0/609689896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f14201059c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1410009820 tx=0x7f141002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:31.245 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.507+0000 7f14252c4640 1 -- 172.21.15.49:0/609689896 shutdown_connections 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.507+0000 7f14252c4640 1 --2- 172.21.15.49:0/609689896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f14201059c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.507+0000 7f14252c4640 1 -- 172.21.15.49:0/609689896 >> 172.21.15.49:0/609689896 conn(0x7f1420100d30 msgr2=0x7f1420103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.507+0000 7f14252c4640 1 -- 172.21.15.49:0/609689896 shutdown_connections 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.507+0000 7f14252c4640 1 -- 172.21.15.49:0/609689896 wait complete. 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f14252c4640 1 Processor -- start 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f14252c4640 1 -- start start 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f14252c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f142007bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f14252c4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142007c0a0 con 0x7f14201055c0 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f141effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f142007bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f141effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f142007bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41456/0 (socket says 172.21.15.49:41456) 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f141effd640 1 -- 172.21.15.49:0/3281590575 learned_addr learned my addr 172.21.15.49:0/3281590575 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.508+0000 7f141effd640 1 -- 172.21.15.49:0/3281590575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100094d0 con 0x7f14201055c0 2024-09-19T08:53:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.509+0000 7f141effd640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f142007bb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f14100303a0 tx=0x7f1410032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.509+0000 7f1407fff640 1 -- 172.21.15.49:0/3281590575 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1410030cc0 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.509+0000 7f1407fff640 1 -- 172.21.15.49:0/3281590575 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f1410030e20 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.509+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142007a290 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.509+0000 7f1407fff640 1 -- 172.21.15.49:0/3281590575 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f141003c620 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.509+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142007a6b0 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.510+0000 7f1407fff640 1 -- 172.21.15.49:0/3281590575 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f141003c860 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.510+0000 7f1407fff640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f1408038650 0x7f140803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.510+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14201059c0 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.510+0000 7f1407fff640 1 -- 172.21.15.49:0/3281590575 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f141006bb70 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.510+0000 7f141e7fc640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f1408038650 0x7f140803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.510+0000 7f141e7fc640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f1408038650 0x7f140803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14140098c0 tx=0x7f1414006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.515+0000 7f1407fff640 1 -- 172.21.15.49:0/3281590575 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f14100313a0 con 0x7f14201055c0 2024-09-19T08:53:31.247 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.698+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f142007aed0 con 0x7f1408038650 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.707+0000 7f1407fff640 1 -- 172.21.15.49:0/3281590575 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f142007aed0 con 0x7f1408038650 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f1408038650 msgr2=0x7f140803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f1408038650 0x7f140803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14140098c0 tx=0x7f1414006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 msgr2=0x7f142007bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f142007bb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f14100303a0 tx=0x7f1410032c60 comp rx=0 tx=0).stop 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 shutdown_connections 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f1408038650 0x7f140803ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 --2- 172.21.15.49:0/3281590575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14201055c0 0x7f142007bb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 >> 172.21.15.49:0/3281590575 conn(0x7f1420100d30 msgr2=0x7f14201018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 shutdown_connections 2024-09-19T08:53:31.248 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:30.709+0000 7f14252c4640 1 -- 172.21.15.49:0/3281590575 wait complete. 2024-09-19T08:53:31.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:31 smithi049 ceph-mon[28158]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:53:31.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:31 smithi049 ceph-mon[28158]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:53:31.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:31 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:31.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:31 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:32.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:32 smithi049 ceph-mon[28158]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:32.393 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:53:32.393 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.641+0000 7fa4d6d62640 1 Processor -- start 2024-09-19T08:53:32.393 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.641+0000 7fa4d6d62640 1 -- start start 2024-09-19T08:53:32.393 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.641+0000 7fa4d6d62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:32.393 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.641+0000 7fa4d6d62640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d007a8c0 con 0x7fa4d007be90 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.642+0000 7fa4d4afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.642+0000 7fa4d4afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41462/0 (socket says 172.21.15.49:41462) 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.642+0000 7fa4d4afe640 1 -- 172.21.15.49:0/894511411 learned_addr learned my addr 172.21.15.49:0/894511411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.642+0000 7fa4d4afe640 1 -- 172.21.15.49:0/894511411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d007aa00 con 0x7fa4d007be90 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.643+0000 7fa4d4afe640 1 --2- 172.21.15.49:0/894511411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d007a2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009e80 tx=0x7fa4c002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9f5150aaad6a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.643+0000 7fa4cf7fe640 1 -- 172.21.15.49:0/894511411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c0031400 con 0x7fa4d007be90 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.643+0000 7fa4cf7fe640 1 -- 172.21.15.49:0/894511411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa4c002d050 con 0x7fa4d007be90 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.643+0000 7fa4cf7fe640 1 -- 172.21.15.49:0/894511411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c0007910 con 0x7fa4d007be90 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.643+0000 7fa4d6d62640 1 -- 172.21.15.49:0/894511411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 msgr2=0x7fa4d007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.643+0000 7fa4d6d62640 1 --2- 172.21.15.49:0/894511411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d007a2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009e80 tx=0x7fa4c002a7a0 comp rx=0 tx=0).stop 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 -- 172.21.15.49:0/894511411 shutdown_connections 2024-09-19T08:53:32.394 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 --2- 172.21.15.49:0/894511411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d007a2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 -- 172.21.15.49:0/894511411 >> 172.21.15.49:0/894511411 conn(0x7fa4d0100d80 msgr2=0x7fa4d01031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 -- 172.21.15.49:0/894511411 shutdown_connections 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 -- 172.21.15.49:0/894511411 wait complete. 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 Processor -- start 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 -- start start 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.644+0000 7fa4d6d62640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d019baa0 con 0x7fa4d007be90 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4d4afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4d4afe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d019b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41474/0 (socket says 172.21.15.49:41474) 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4d4afe640 1 -- 172.21.15.49:0/3444843476 learned_addr learned my addr 172.21.15.49:0/3444843476 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4d4afe640 1 -- 172.21.15.49:0/3444843476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0009b30 con 0x7fa4d007be90 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4d4afe640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d019b560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0031630 tx=0x7fa4c00075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:32.395 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4cdffb640 1 -- 172.21.15.49:0/3444843476 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c0031b50 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4cdffb640 1 -- 172.21.15.49:0/3444843476 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa4c0031cb0 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d019bca0 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4cdffb640 1 -- 172.21.15.49:0/3444843476 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c003a6b0 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.645+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d019c1a0 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.646+0000 7fa4cdffb640 1 -- 172.21.15.49:0/3444843476 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fa4c0038040 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.647+0000 7fa4cdffb640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa4bc038650 0x7fa4bc03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.647+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d010b930 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.647+0000 7fa4cdffb640 1 -- 172.21.15.49:0/3444843476 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa4c006c850 con 0x7fa4d007be90 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.647+0000 7fa4cffff640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa4bc038650 0x7fa4bc03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.647+0000 7fa4cffff640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa4bc038650 0x7fa4bc03ab10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80098c0 tx=0x7fa4b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:32.396 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.652+0000 7fa4cdffb640 1 -- 172.21.15.49:0/3444843476 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4c0040020 con 0x7fa4d007be90 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.825+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4d01020f0 con 0x7fa4bc038650 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.826+0000 7fa4cdffb640 1 -- 172.21.15.49:0/3444843476 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fa4d01020f0 con 0x7fa4bc038650 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa4bc038650 msgr2=0x7fa4bc03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa4bc038650 0x7fa4bc03ab10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80098c0 tx=0x7fa4b8006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 msgr2=0x7fa4d019b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d019b560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0031630 tx=0x7fa4c00075c0 comp rx=0 tx=0).stop 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 shutdown_connections 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa4bc038650 0x7fa4bc03ab10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 --2- 172.21.15.49:0/3444843476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4d007be90 0x7fa4d019b560 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 >> 172.21.15.49:0/3444843476 conn(0x7fa4d0100d80 msgr2=0x7fa4d01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 shutdown_connections 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:31.828+0000 7fa4d6d62640 1 -- 172.21.15.49:0/3444843476 wait complete. 2024-09-19T08:53:32.397 INFO:teuthology.orchestra.run.smithi049.stdout:Generating ssh key... 2024-09-19T08:53:33.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:33 smithi049 ceph-mon[28158]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:33.657 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.759+0000 7f2b2f7fe640 1 Processor -- start 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.759+0000 7f2b2f7fe640 1 -- start start 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.760+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b281042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.760+0000 7f2b2f7fe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28079e40 con 0x7f2b28103ea0 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.760+0000 7f2b2d59a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b281042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.760+0000 7f2b2d59a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b281042a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41490/0 (socket says 172.21.15.49:41490) 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.760+0000 7f2b2d59a640 1 -- 172.21.15.49:0/2151582755 learned_addr learned my addr 172.21.15.49:0/2151582755 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.760+0000 7f2b2d59a640 1 -- 172.21.15.49:0/2151582755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b281047e0 con 0x7f2b28103ea0 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.761+0000 7f2b2d59a640 1 --2- 172.21.15.49:0/2151582755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b281042a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009e80 tx=0x7f2b1c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b45e92d088986d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.761+0000 7f2b1bfff640 1 -- 172.21.15.49:0/2151582755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b1c031400 con 0x7f2b28103ea0 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.761+0000 7f2b1bfff640 1 -- 172.21.15.49:0/2151582755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2b1c02d050 con 0x7f2b28103ea0 2024-09-19T08:53:33.658 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.761+0000 7f2b1bfff640 1 -- 172.21.15.49:0/2151582755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b1c007910 con 0x7f2b28103ea0 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.761+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/2151582755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 msgr2=0x7f2b281042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.761+0000 7f2b2f7fe640 1 --2- 172.21.15.49:0/2151582755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b281042a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009e80 tx=0x7f2b1c02a7a0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/2151582755 shutdown_connections 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 --2- 172.21.15.49:0/2151582755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b281042a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/2151582755 >> 172.21.15.49:0/2151582755 conn(0x7f2b280ffc50 msgr2=0x7f2b281020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/2151582755 shutdown_connections 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/2151582755 wait complete. 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 Processor -- start 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 -- start start 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b2819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.762+0000 7f2b2f7fe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2819ba80 con 0x7f2b28103ea0 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b2d59a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b2819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b2d59a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b2819b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41498/0 (socket says 172.21.15.49:41498) 2024-09-19T08:53:33.659 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b2d59a640 1 -- 172.21.15.49:0/520931716 learned_addr learned my addr 172.21.15.49:0/520931716 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b2d59a640 1 -- 172.21.15.49:0/520931716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c009b30 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b2d59a640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b2819b540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c031630 tx=0x7f2b1c0075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b1a7fc640 1 -- 172.21.15.49:0/520931716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b1c031b50 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b1a7fc640 1 -- 172.21.15.49:0/520931716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f2b1c031cb0 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2819bc80 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b1a7fc640 1 -- 172.21.15.49:0/520931716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b1c03a6b0 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.763+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2819c180 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.764+0000 7f2b1a7fc640 1 -- 172.21.15.49:0/520931716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2b1c038040 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.764+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b28195270 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.764+0000 7f2b1a7fc640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2b140386a0 0x7f2b1403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.764+0000 7f2b1a7fc640 1 -- 172.21.15.49:0/520931716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2b1c06b840 con 0x7f2b28103ea0 2024-09-19T08:53:33.660 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.764+0000 7f2b2cd99640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2b140386a0 0x7f2b1403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.765+0000 7f2b2cd99640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2b140386a0 0x7f2b1403ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b240098c0 tx=0x7f2b24006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.769+0000 7f2b1a7fc640 1 -- 172.21.15.49:0/520931716 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2b1c0439b0 con 0x7f2b28103ea0 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:32.945+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b2802c660 con 0x7f2b140386a0 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.037+0000 7f2b1a7fc640 1 -- 172.21.15.49:0/520931716 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2b2802c660 con 0x7f2b140386a0 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.039+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2b140386a0 msgr2=0x7f2b1403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.039+0000 7f2b2f7fe640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2b140386a0 0x7f2b1403ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b240098c0 tx=0x7f2b24006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.039+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 msgr2=0x7f2b2819b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.039+0000 7f2b2f7fe640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b2819b540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c031630 tx=0x7f2b1c0075c0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.040+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 shutdown_connections 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.040+0000 7f2b2f7fe640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2b140386a0 0x7f2b1403ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.040+0000 7f2b2f7fe640 1 --2- 172.21.15.49:0/520931716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b28103ea0 0x7f2b2819b540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.040+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 >> 172.21.15.49:0/520931716 conn(0x7f2b280ffc50 msgr2=0x7f2b28192440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:33.661 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.040+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 shutdown_connections 2024-09-19T08:53:33.662 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:33.040+0000 7f2b2f7fe640 1 -- 172.21.15.49:0/520931716 wait complete. 2024-09-19T08:53:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:34 smithi049 ceph-mon[28158]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:34 smithi049 ceph-mon[28158]: Generating ssh key... 2024-09-19T08:53:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:34 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:34 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:34.780 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs4S2+a6FEcgo9u9becmnrInlbDJsRkxV330PLYUonD6Tg1/voAteGxM2oTkCKWLDjivxReDiqpqoiiZBhIibNsoS391tzG8uZXEd2n/DP89NiGpvJ0MEqjBdLqxeVf9jBceJrMKQbzft+Fr6noLLyWqNDiWlw6pyF9jLZEWkvnVutAQ8T/CN5I0M5tYz4OquEoYteWCjc2kCzNMaoG5qdkj9vQxzPhkJtDrJUyAmWOfQspox8Oe2osnJe/N9ZgXpNDfqfrNwrHtiX484BgAVHn/nAs7Wd3Y0n7zFjehgMVeb3VYU7jKaTvlt60oiCz20RE7mzCs4RynJZ/MkIiAeuWJ47nXBPWusBN3Wi3plv1JsXUbob3oe0lLf3BPIQyLjsoCCnIRtu5zLOJE7X8FEevRT+c/QC08GUW/jXrMGIP0W4Q8TEsxoCJxJl1/X4kvIhPr+tpsLdoj9i5pzBHvXZd7aVY/CUidaecS6cfftJUGMp1geM7TnDAfFdOcBUnO0= ceph-63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.070+0000 7fe692641640 1 Processor -- start 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.070+0000 7fe692641640 1 -- start start 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.070+0000 7fe692641640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.071+0000 7fe692641640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c105f90 con 0x7fe68c1055c0 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.071+0000 7fe68bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.071+0000 7fe68bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41504/0 (socket says 172.21.15.49:41504) 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.071+0000 7fe68bfff640 1 -- 172.21.15.49:0/2473447605 learned_addr learned my addr 172.21.15.49:0/2473447605 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.071+0000 7fe68bfff640 1 -- 172.21.15.49:0/2473447605 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c1067c0 con 0x7fe68c1055c0 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.072+0000 7fe68bfff640 1 --2- 172.21.15.49:0/2473447605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1059c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009820 tx=0x7fe67c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482c55300c698081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.072+0000 7fe68affd640 1 -- 172.21.15.49:0/2473447605 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe67c02ad40 con 0x7fe68c1055c0 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.072+0000 7fe68affd640 1 -- 172.21.15.49:0/2473447605 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe67c0328c0 con 0x7fe68c1055c0 2024-09-19T08:53:34.781 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.072+0000 7fe68affd640 1 -- 172.21.15.49:0/2473447605 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe67c0307f0 con 0x7fe68c1055c0 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.072+0000 7fe692641640 1 -- 172.21.15.49:0/2473447605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 msgr2=0x7fe68c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.072+0000 7fe692641640 1 --2- 172.21.15.49:0/2473447605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1059c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009820 tx=0x7fe67c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.073+0000 7fe692641640 1 -- 172.21.15.49:0/2473447605 shutdown_connections 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.073+0000 7fe692641640 1 --2- 172.21.15.49:0/2473447605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1059c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.073+0000 7fe692641640 1 -- 172.21.15.49:0/2473447605 >> 172.21.15.49:0/2473447605 conn(0x7fe68c100d30 msgr2=0x7fe68c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.073+0000 7fe692641640 1 -- 172.21.15.49:0/2473447605 shutdown_connections 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.073+0000 7fe692641640 1 -- 172.21.15.49:0/2473447605 wait complete. 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.073+0000 7fe692641640 1 Processor -- start 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.073+0000 7fe692641640 1 -- start start 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe692641640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe692641640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c199810 con 0x7fe68c1055c0 2024-09-19T08:53:34.782 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe68bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe68bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41512/0 (socket says 172.21.15.49:41512) 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe68bfff640 1 -- 172.21.15.49:0/519137664 learned_addr learned my addr 172.21.15.49:0/519137664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe68bfff640 1 -- 172.21.15.49:0/519137664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c0094d0 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe68bfff640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1992d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe67c030d30 tx=0x7fe67c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe6897fa640 1 -- 172.21.15.49:0/519137664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe67c032c40 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe6897fa640 1 -- 172.21.15.49:0/519137664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe67c032da0 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c199a10 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.074+0000 7fe6897fa640 1 -- 172.21.15.49:0/519137664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe67c03c570 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.075+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c199e30 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.075+0000 7fe6897fa640 1 -- 172.21.15.49:0/519137664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fe67c03c7e0 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.076+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c1099f0 con 0x7fe68c1055c0 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.076+0000 7fe6897fa640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe6740386a0 0x7fe67403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:34.783 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.076+0000 7fe6897fa640 1 -- 172.21.15.49:0/519137664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe67c06bc30 con 0x7fe68c1055c0 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.076+0000 7fe68b7fe640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe6740386a0 0x7fe67403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.076+0000 7fe68b7fe640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe6740386a0 0x7fe67403ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6800098c0 tx=0x7fe680006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.080+0000 7fe6897fa640 1 -- 172.21.15.49:0/519137664 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe67c0313a0 con 0x7fe68c1055c0 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.254+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe68c101fc0 con 0x7fe6740386a0 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.255+0000 7fe6897fa640 1 -- 172.21.15.49:0/519137664 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe68c101fc0 con 0x7fe6740386a0 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe6740386a0 msgr2=0x7fe67403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe6740386a0 0x7fe67403ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6800098c0 tx=0x7fe680006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 msgr2=0x7fe68c1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1992d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe67c030d30 tx=0x7fe67c030d60 comp rx=0 tx=0).stop 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 shutdown_connections 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe6740386a0 0x7fe67403ab60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 --2- 172.21.15.49:0/519137664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe68c1055c0 0x7fe68c1992d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:34.784 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 >> 172.21.15.49:0/519137664 conn(0x7fe68c100d30 msgr2=0x7fe68c1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:34.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 shutdown_connections 2024-09-19T08:53:34.785 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:34.257+0000 7fe692641640 1 -- 172.21.15.49:0/519137664 wait complete. 2024-09-19T08:53:34.785 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:53:34.785 INFO:teuthology.orchestra.run.smithi049.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:53:34.785 INFO:teuthology.orchestra.run.smithi049.stdout:Adding host smithi049... 2024-09-19T08:53:35.217 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:35 smithi049 ceph-mon[28158]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:36.742 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:36 smithi049 ceph-mon[28158]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:37.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:37 smithi049 ceph-mon[28158]: Deploying cephadm binary to smithi049 2024-09-19T08:53:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Added host 'smithi049' with addr '172.21.15.49' 2024-09-19T08:53:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.226+0000 7fca5df42640 1 Processor -- start 2024-09-19T08:53:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.226+0000 7fca5df42640 1 -- start start 2024-09-19T08:53:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.226+0000 7fca5df42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca581059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.226+0000 7fca5df42640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58105f90 con 0x7fca581055c0 2024-09-19T08:53:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.227+0000 7fca577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca581059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.280 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.227+0000 7fca577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca581059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41528/0 (socket says 172.21.15.49:41528) 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.227+0000 7fca577fe640 1 -- 172.21.15.49:0/4086344050 learned_addr learned my addr 172.21.15.49:0/4086344050 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.227+0000 7fca577fe640 1 -- 172.21.15.49:0/4086344050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca581067c0 con 0x7fca581055c0 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.227+0000 7fca577fe640 1 --2- 172.21.15.49:0/4086344050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca581059c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca48009e80 tx=0x7fca4802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2206f26966885f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca567fc640 1 -- 172.21.15.49:0/4086344050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca48031400 con 0x7fca581055c0 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca567fc640 1 -- 172.21.15.49:0/4086344050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fca4802d050 con 0x7fca581055c0 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca567fc640 1 -- 172.21.15.49:0/4086344050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca48007910 con 0x7fca581055c0 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca5df42640 1 -- 172.21.15.49:0/4086344050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 msgr2=0x7fca581059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca5df42640 1 --2- 172.21.15.49:0/4086344050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca581059c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca48009e80 tx=0x7fca4802a7a0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca5df42640 1 -- 172.21.15.49:0/4086344050 shutdown_connections 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca5df42640 1 --2- 172.21.15.49:0/4086344050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca581059c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca5df42640 1 -- 172.21.15.49:0/4086344050 >> 172.21.15.49:0/4086344050 conn(0x7fca58100d70 msgr2=0x7fca58103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:39.281 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca5df42640 1 -- 172.21.15.49:0/4086344050 shutdown_connections 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.228+0000 7fca5df42640 1 -- 172.21.15.49:0/4086344050 wait complete. 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.229+0000 7fca5df42640 1 Processor -- start 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.229+0000 7fca5df42640 1 -- start start 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.229+0000 7fca5df42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca58199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.229+0000 7fca5df42640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58199870 con 0x7fca581055c0 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.229+0000 7fca577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca58199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca58199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41544/0 (socket says 172.21.15.49:41544) 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca577fe640 1 -- 172.21.15.49:0/1025607442 learned_addr learned my addr 172.21.15.49:0/1025607442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca577fe640 1 -- 172.21.15.49:0/1025607442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48009b30 con 0x7fca581055c0 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca577fe640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca58199330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca48031660 tx=0x7fca48031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca54ff9640 1 -- 172.21.15.49:0/1025607442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca48031bb0 con 0x7fca581055c0 2024-09-19T08:53:39.282 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca54ff9640 1 -- 172.21.15.49:0/1025607442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fca48031d10 con 0x7fca581055c0 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58199a70 con 0x7fca581055c0 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca54ff9640 1 -- 172.21.15.49:0/1025607442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca4803a740 con 0x7fca581055c0 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.230+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca58199f70 con 0x7fca581055c0 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.231+0000 7fca54ff9640 1 -- 172.21.15.49:0/1025607442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fca48038040 con 0x7fca581055c0 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.231+0000 7fca54ff9640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fca400386a0 0x7fca4003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.231+0000 7fca54ff9640 1 -- 172.21.15.49:0/1025607442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fca4806b900 con 0x7fca581055c0 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.231+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca58105a40 con 0x7fca581055c0 2024-09-19T08:53:39.283 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.231+0000 7fca56ffd640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fca400386a0 0x7fca4003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.232+0000 7fca56ffd640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fca400386a0 0x7fca4003ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0098c0 tx=0x7fca4c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.236+0000 7fca54ff9640 1 -- 172.21.15.49:0/1025607442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca48040070 con 0x7fca581055c0 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:35.416+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}) v1 -- 0x7fca58102030 con 0x7fca400386a0 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.740+0000 7fca54ff9640 1 -- 172.21.15.49:0/1025607442 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fca58102030 con 0x7fca400386a0 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fca400386a0 msgr2=0x7fca4003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fca400386a0 0x7fca4003ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0098c0 tx=0x7fca4c006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 msgr2=0x7fca58199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca58199330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca48031660 tx=0x7fca48031690 comp rx=0 tx=0).stop 2024-09-19T08:53:39.284 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 shutdown_connections 2024-09-19T08:53:39.285 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fca400386a0 0x7fca4003ab60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.285 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 --2- 172.21.15.49:0/1025607442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca581055c0 0x7fca58199330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:39.285 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.743+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 >> 172.21.15.49:0/1025607442 conn(0x7fca58100d70 msgr2=0x7fca58101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:39.285 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.744+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 shutdown_connections 2024-09-19T08:53:39.285 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:38.744+0000 7fca5df42640 1 -- 172.21.15.49:0/1025607442 wait complete. 2024-09-19T08:53:39.285 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying mon service with default placement... 2024-09-19T08:53:39.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:39 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:39.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:39 smithi049 ceph-mon[28158]: Added host smithi049 2024-09-19T08:53:39.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:39 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:40.509 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:53:40.509 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.700+0000 7fe24af59640 1 Processor -- start 2024-09-19T08:53:40.509 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.701+0000 7fe24af59640 1 -- start start 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.701+0000 7fe24af59640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe244104950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.701+0000 7fe24af59640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe244104f20 con 0x7fe244104550 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.701+0000 7fe248cf5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe244104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.701+0000 7fe248cf5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe244104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41556/0 (socket says 172.21.15.49:41556) 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.701+0000 7fe248cf5640 1 -- 172.21.15.49:0/510796900 learned_addr learned my addr 172.21.15.49:0/510796900 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.701+0000 7fe248cf5640 1 -- 172.21.15.49:0/510796900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244105700 con 0x7fe244104550 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.702+0000 7fe248cf5640 1 --2- 172.21.15.49:0/510796900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe244104950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe238009820 tx=0x7fe23802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04b6f358fb947fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.702+0000 7fe2437fe640 1 -- 172.21.15.49:0/510796900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe23802ad40 con 0x7fe244104550 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.702+0000 7fe2437fe640 1 -- 172.21.15.49:0/510796900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe2380328c0 con 0x7fe244104550 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.702+0000 7fe2437fe640 1 -- 172.21.15.49:0/510796900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2380307f0 con 0x7fe244104550 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 -- 172.21.15.49:0/510796900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 msgr2=0x7fe244104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.510 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 --2- 172.21.15.49:0/510796900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe244104950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe238009820 tx=0x7fe23802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 -- 172.21.15.49:0/510796900 shutdown_connections 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 --2- 172.21.15.49:0/510796900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe244104950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 -- 172.21.15.49:0/510796900 >> 172.21.15.49:0/510796900 conn(0x7fe2440ffd00 msgr2=0x7fe244102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 -- 172.21.15.49:0/510796900 shutdown_connections 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 -- 172.21.15.49:0/510796900 wait complete. 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 Processor -- start 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.703+0000 7fe24af59640 1 -- start start 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe24af59640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe24418f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.511 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe24af59640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24418fa80 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe248cf5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe24418f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe248cf5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe24418f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41562/0 (socket says 172.21.15.49:41562) 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe248cf5640 1 -- 172.21.15.49:0/955885449 learned_addr learned my addr 172.21.15.49:0/955885449 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe248cf5640 1 -- 172.21.15.49:0/955885449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380094d0 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe248cf5640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe24418f540 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe238009940 tx=0x7fe238032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe241ffb640 1 -- 172.21.15.49:0/955885449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe238041070 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe241ffb640 1 -- 172.21.15.49:0/955885449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe238030cc0 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24418dc70 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.704+0000 7fe241ffb640 1 -- 172.21.15.49:0/955885449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe23803c690 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.705+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24418e090 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.705+0000 7fe241ffb640 1 -- 172.21.15.49:0/955885449 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fe23803c7f0 con 0x7fe244104550 2024-09-19T08:53:40.512 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.705+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe244104950 con 0x7fe244104550 2024-09-19T08:53:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.706+0000 7fe241ffb640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe2340386a0 0x7fe23403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.706+0000 7fe241ffb640 1 -- 172.21.15.49:0/955885449 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe23806b660 con 0x7fe244104550 2024-09-19T08:53:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.706+0000 7fe243fff640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe2340386a0 0x7fe23403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.706+0000 7fe243fff640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe2340386a0 0x7fe23403ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2300098c0 tx=0x7fe230006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.710+0000 7fe241ffb640 1 -- 172.21.15.49:0/955885449 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe238031dd0 con 0x7fe244104550 2024-09-19T08:53:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.898+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2441930a0 con 0x7fe2340386a0 2024-09-19T08:53:40.513 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.902+0000 7fe241ffb640 1 -- 172.21.15.49:0/955885449 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe2441930a0 con 0x7fe2340386a0 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.904+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe2340386a0 msgr2=0x7fe23403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.904+0000 7fe24af59640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe2340386a0 0x7fe23403ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2300098c0 tx=0x7fe230006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.904+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 msgr2=0x7fe24418f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.904+0000 7fe24af59640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe24418f540 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe238009940 tx=0x7fe238032c60 comp rx=0 tx=0).stop 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.905+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 shutdown_connections 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.905+0000 7fe24af59640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fe2340386a0 0x7fe23403ab60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.905+0000 7fe24af59640 1 --2- 172.21.15.49:0/955885449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe244104550 0x7fe24418f540 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.905+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 >> 172.21.15.49:0/955885449 conn(0x7fe2440ffd00 msgr2=0x7fe244100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.905+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 shutdown_connections 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:39.905+0000 7fe24af59640 1 -- 172.21.15.49:0/955885449 wait complete. 2024-09-19T08:53:40.514 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying mgr service with default placement... 2024-09-19T08:53:41.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:40 smithi049 ceph-mon[28158]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:41.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:40 smithi049 ceph-mon[28158]: Saving service mon spec with placement count:5 2024-09-19T08:53:41.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:40 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:42 smithi049 ceph-mon[28158]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:42 smithi049 ceph-mon[28158]: Saving service mgr spec with placement count:2 2024-09-19T08:53:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:42 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:42 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.918+0000 7fd0c9144640 1 Processor -- start 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.918+0000 7fd0c9144640 1 -- start start 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.919+0000 7fd0c9144640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c41048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.919+0000 7fd0c9144640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c4104eb0 con 0x7fd0c41044e0 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.919+0000 7fd0c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c41048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.919+0000 7fd0c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c41048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46840/0 (socket says 172.21.15.49:46840) 2024-09-19T08:53:42.309 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.919+0000 7fd0c2d9d640 1 -- 172.21.15.49:0/3587350079 learned_addr learned my addr 172.21.15.49:0/3587350079 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.919+0000 7fd0c2d9d640 1 -- 172.21.15.49:0/3587350079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c41056e0 con 0x7fd0c41044e0 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.920+0000 7fd0c2d9d640 1 --2- 172.21.15.49:0/3587350079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c41048e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009820 tx=0x7fd0b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e85f6f100186e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.920+0000 7fd0c259c640 1 -- 172.21.15.49:0/3587350079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0b402ad40 con 0x7fd0c41044e0 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.920+0000 7fd0c259c640 1 -- 172.21.15.49:0/3587350079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd0b40328c0 con 0x7fd0c41044e0 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.920+0000 7fd0c259c640 1 -- 172.21.15.49:0/3587350079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0b40307f0 con 0x7fd0c41044e0 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.921+0000 7fd0c9144640 1 -- 172.21.15.49:0/3587350079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 msgr2=0x7fd0c41048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.921+0000 7fd0c9144640 1 --2- 172.21.15.49:0/3587350079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c41048e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009820 tx=0x7fd0b402a270 comp rx=0 tx=0).stop 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.921+0000 7fd0c9144640 1 -- 172.21.15.49:0/3587350079 shutdown_connections 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.921+0000 7fd0c9144640 1 --2- 172.21.15.49:0/3587350079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c41048e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.921+0000 7fd0c9144640 1 -- 172.21.15.49:0/3587350079 >> 172.21.15.49:0/3587350079 conn(0x7fd0c40ffc50 msgr2=0x7fd0c41020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.921+0000 7fd0c9144640 1 -- 172.21.15.49:0/3587350079 shutdown_connections 2024-09-19T08:53:42.310 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.921+0000 7fd0c9144640 1 -- 172.21.15.49:0/3587350079 wait complete. 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.922+0000 7fd0c9144640 1 Processor -- start 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.922+0000 7fd0c9144640 1 -- start start 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.922+0000 7fd0c9144640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.922+0000 7fd0c9144640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c4199890 con 0x7fd0c41044e0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.922+0000 7fd0c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.922+0000 7fd0c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46846/0 (socket says 172.21.15.49:46846) 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.922+0000 7fd0c2d9d640 1 -- 172.21.15.49:0/3727045857 learned_addr learned my addr 172.21.15.49:0/3727045857 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.923+0000 7fd0c2d9d640 1 -- 172.21.15.49:0/3727045857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40094d0 con 0x7fd0c41044e0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.923+0000 7fd0c2d9d640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c4199350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40303a0 tx=0x7fd0b4032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.923+0000 7fd0c0d99640 1 -- 172.21.15.49:0/3727045857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0b4030cc0 con 0x7fd0c41044e0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.923+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c4199a90 con 0x7fd0c41044e0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.923+0000 7fd0c0d99640 1 -- 172.21.15.49:0/3727045857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd0b4030e20 con 0x7fd0c41044e0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.923+0000 7fd0c0d99640 1 -- 172.21.15.49:0/3727045857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0b403c620 con 0x7fd0c41044e0 2024-09-19T08:53:42.311 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.924+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c4199eb0 con 0x7fd0c41044e0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.924+0000 7fd0c0d99640 1 -- 172.21.15.49:0/3727045857 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fd0b403c810 con 0x7fd0c41044e0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.924+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c41048e0 con 0x7fd0c41044e0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.925+0000 7fd0c0d99640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd0b00386a0 0x7fd0b003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.925+0000 7fd0c0d99640 1 -- 172.21.15.49:0/3727045857 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd0b406ba20 con 0x7fd0c41044e0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.925+0000 7fd0ba59c640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd0b00386a0 0x7fd0b003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.925+0000 7fd0ba59c640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd0b00386a0 0x7fd0b003ab60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0098c0 tx=0x7fd0ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:40.929+0000 7fd0c0d99640 1 -- 172.21.15.49:0/3727045857 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0b40313a0 con 0x7fd0c41044e0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.114+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0c402c5a0 con 0x7fd0b00386a0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.119+0000 7fd0c0d99640 1 -- 172.21.15.49:0/3727045857 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd0c402c5a0 con 0x7fd0b00386a0 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd0b00386a0 msgr2=0x7fd0b003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd0b00386a0 0x7fd0b003ab60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0098c0 tx=0x7fd0ac006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 msgr2=0x7fd0c4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c4199350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40303a0 tx=0x7fd0b4032c60 comp rx=0 tx=0).stop 2024-09-19T08:53:42.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 shutdown_connections 2024-09-19T08:53:42.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd0b00386a0 0x7fd0b003ab60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 --2- 172.21.15.49:0/3727045857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0c41044e0 0x7fd0c4199350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:42.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 >> 172.21.15.49:0/3727045857 conn(0x7fd0c40ffc50 msgr2=0x7fd0c4100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:42.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 shutdown_connections 2024-09-19T08:53:42.313 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:41.121+0000 7fd0c9144640 1 -- 172.21.15.49:0/3727045857 wait complete. 2024-09-19T08:53:42.313 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying crash service with default placement... 2024-09-19T08:53:43.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:43 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:43.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:43 smithi049 ceph-mon[28158]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:43.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:43 smithi049 ceph-mon[28158]: Saving service crash spec with placement * 2024-09-19T08:53:43.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:43 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:44.136 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb0d5a3640 1 Processor -- start 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb0d5a3640 1 -- start start 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb0d5a3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb08108460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb0d5a3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08079e60 con 0x7fbb08106070 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb08108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb08108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46852/0 (socket says 172.21.15.49:46852) 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb06ffd640 1 -- 172.21.15.49:0/2208061781 learned_addr learned my addr 172.21.15.49:0/2208061781 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.755+0000 7fbb06ffd640 1 -- 172.21.15.49:0/2208061781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb081089a0 con 0x7fbb08106070 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.756+0000 7fbb06ffd640 1 --2- 172.21.15.49:0/2208061781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb08108460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009820 tx=0x7fbaf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b704cb905bda2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.756+0000 7fbb05ffb640 1 -- 172.21.15.49:0/2208061781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf802ad40 con 0x7fbb08106070 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.756+0000 7fbb05ffb640 1 -- 172.21.15.49:0/2208061781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbaf8032900 con 0x7fbb08106070 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.756+0000 7fbb05ffb640 1 -- 172.21.15.49:0/2208061781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf8030860 con 0x7fbb08106070 2024-09-19T08:53:44.137 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.757+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/2208061781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 msgr2=0x7fbb08108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.757+0000 7fbb0d5a3640 1 --2- 172.21.15.49:0/2208061781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb08108460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009820 tx=0x7fbaf802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.757+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/2208061781 shutdown_connections 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.757+0000 7fbb0d5a3640 1 --2- 172.21.15.49:0/2208061781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb08108460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.757+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/2208061781 >> 172.21.15.49:0/2208061781 conn(0x7fbb080ffc30 msgr2=0x7fbb08102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.757+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/2208061781 shutdown_connections 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.757+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/2208061781 wait complete. 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb0d5a3640 1 Processor -- start 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb0d5a3640 1 -- start start 2024-09-19T08:53:44.138 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb0d5a3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb081058f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb0d5a3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08105e30 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb081058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb081058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46868/0 (socket says 172.21.15.49:46868) 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb06ffd640 1 -- 172.21.15.49:0/3521922315 learned_addr learned my addr 172.21.15.49:0/3521922315 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.758+0000 7fbb06ffd640 1 -- 172.21.15.49:0/3521922315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80094d0 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.759+0000 7fbb06ffd640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb081058f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8032670 tx=0x7fbaf80326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.759+0000 7fbaeffff640 1 -- 172.21.15.49:0/3521922315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf8032c80 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.759+0000 7fbaeffff640 1 -- 172.21.15.49:0/3521922315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbaf8032de0 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.759+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb08104020 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.759+0000 7fbaeffff640 1 -- 172.21.15.49:0/3521922315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf803a720 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.759+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb081044c0 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.760+0000 7fbaeffff640 1 -- 172.21.15.49:0/3521922315 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fbaf803a950 con 0x7fbb08106070 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.760+0000 7fbaeffff640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fbaf00386a0 0x7fbaf003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:44.139 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.760+0000 7fbaeffff640 1 -- 172.21.15.49:0/3521922315 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbaf806b910 con 0x7fbb08106070 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.760+0000 7fbb067fc640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fbaf00386a0 0x7fbaf003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.760+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb08106450 con 0x7fbb08106070 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.760+0000 7fbb067fc640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fbaf00386a0 0x7fbaf003ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0098c0 tx=0x7fbafc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.765+0000 7fbaeffff640 1 -- 172.21.15.49:0/3521922315 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbaf8039b20 con 0x7fbb08106070 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.959+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb08104a10 con 0x7fbaf00386a0 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.964+0000 7fbaeffff640 1 -- 172.21.15.49:0/3521922315 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fbb08104a10 con 0x7fbaf00386a0 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.965+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fbaf00386a0 msgr2=0x7fbaf003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.965+0000 7fbb0d5a3640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fbaf00386a0 0x7fbaf003ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0098c0 tx=0x7fbafc006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.965+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 msgr2=0x7fbb081058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.965+0000 7fbb0d5a3640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb081058f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8032670 tx=0x7fbaf80326a0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.966+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 shutdown_connections 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.966+0000 7fbb0d5a3640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fbaf00386a0 0x7fbaf003ab60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.140 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.966+0000 7fbb0d5a3640 1 --2- 172.21.15.49:0/3521922315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb08106070 0x7fbb081058f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:44.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.966+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 >> 172.21.15.49:0/3521922315 conn(0x7fbb080ffc30 msgr2=0x7fbb08100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:44.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.966+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 shutdown_connections 2024-09-19T08:53:44.141 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:42.966+0000 7fbb0d5a3640 1 -- 172.21.15.49:0/3521922315 wait complete. 2024-09-19T08:53:44.141 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying ceph-exporter service with default placement... 2024-09-19T08:53:45.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:44 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:45.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:44 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:45.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:44 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:45.343 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-19T08:53:45.343 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.558+0000 7fdd6efb4640 1 Processor -- start 2024-09-19T08:53:45.343 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.558+0000 7fdd6efb4640 1 -- start start 2024-09-19T08:53:45.343 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.558+0000 7fdd6efb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.343 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.558+0000 7fdd6efb4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68104290 con 0x7fdd681038c0 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.558+0000 7fdd6cd50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.558+0000 7fdd6cd50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68103cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46872/0 (socket says 172.21.15.49:46872) 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.558+0000 7fdd6cd50640 1 -- 172.21.15.49:0/1602017178 learned_addr learned my addr 172.21.15.49:0/1602017178 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.559+0000 7fdd6cd50640 1 -- 172.21.15.49:0/1602017178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd681043d0 con 0x7fdd681038c0 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.559+0000 7fdd6cd50640 1 --2- 172.21.15.49:0/1602017178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68103cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009820 tx=0x7fdd5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3847cd8f0328b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.559+0000 7fdd677fe640 1 -- 172.21.15.49:0/1602017178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd5c02ad40 con 0x7fdd681038c0 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd677fe640 1 -- 172.21.15.49:0/1602017178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd5c032900 con 0x7fdd681038c0 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd677fe640 1 -- 172.21.15.49:0/1602017178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd5c030860 con 0x7fdd681038c0 2024-09-19T08:53:45.344 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd6efb4640 1 -- 172.21.15.49:0/1602017178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 msgr2=0x7fdd68103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd6efb4640 1 --2- 172.21.15.49:0/1602017178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68103cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009820 tx=0x7fdd5c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd6efb4640 1 -- 172.21.15.49:0/1602017178 shutdown_connections 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd6efb4640 1 --2- 172.21.15.49:0/1602017178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68103cc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd6efb4640 1 -- 172.21.15.49:0/1602017178 >> 172.21.15.49:0/1602017178 conn(0x7fdd680ff410 msgr2=0x7fdd68101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd6efb4640 1 -- 172.21.15.49:0/1602017178 shutdown_connections 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.560+0000 7fdd6efb4640 1 -- 172.21.15.49:0/1602017178 wait complete. 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6efb4640 1 Processor -- start 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6efb4640 1 -- start start 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6efb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68106120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6efb4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68106660 con 0x7fdd681038c0 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6cd50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68106120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6cd50640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68106120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46876/0 (socket says 172.21.15.49:46876) 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6cd50640 1 -- 172.21.15.49:0/786394312 learned_addr learned my addr 172.21.15.49:0/786394312 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:45.345 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.561+0000 7fdd6cd50640 1 -- 172.21.15.49:0/786394312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0094d0 con 0x7fdd681038c0 2024-09-19T08:53:45.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.562+0000 7fdd6cd50640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68106120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097f0 tx=0x7fdd5c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.562+0000 7fdd65ffb640 1 -- 172.21.15.49:0/786394312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd5c040070 con 0x7fdd681038c0 2024-09-19T08:53:45.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.562+0000 7fdd65ffb640 1 -- 172.21.15.49:0/786394312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd5c032dd0 con 0x7fdd681038c0 2024-09-19T08:53:45.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.562+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd68104850 con 0x7fdd681038c0 2024-09-19T08:53:45.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.562+0000 7fdd65ffb640 1 -- 172.21.15.49:0/786394312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd5c03a730 con 0x7fdd681038c0 2024-09-19T08:53:45.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.562+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd68104cf0 con 0x7fdd681038c0 2024-09-19T08:53:45.346 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.563+0000 7fdd65ffb640 1 -- 172.21.15.49:0/786394312 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fdd5c03a890 con 0x7fdd681038c0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.563+0000 7fdd65ffb640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdd580386a0 0x7fdd5803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.563+0000 7fdd65ffb640 1 -- 172.21.15.49:0/786394312 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdd5c06b680 con 0x7fdd681038c0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.563+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd68103cc0 con 0x7fdd681038c0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.563+0000 7fdd67fff640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdd580386a0 0x7fdd5803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.564+0000 7fdd67fff640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdd580386a0 0x7fdd5803ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdd540098c0 tx=0x7fdd54006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.568+0000 7fdd65ffb640 1 -- 172.21.15.49:0/786394312 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdd5c039b90 con 0x7fdd681038c0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.754+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd68105350 con 0x7fdd580386a0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.758+0000 7fdd65ffb640 1 -- 172.21.15.49:0/786394312 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fdd68105350 con 0x7fdd580386a0 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.760+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdd580386a0 msgr2=0x7fdd5803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.760+0000 7fdd6efb4640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdd580386a0 0x7fdd5803ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdd540098c0 tx=0x7fdd54006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.760+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 msgr2=0x7fdd68106120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:45.347 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.760+0000 7fdd6efb4640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68106120 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097f0 tx=0x7fdd5c030d50 comp rx=0 tx=0).stop 2024-09-19T08:53:45.348 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.761+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 shutdown_connections 2024-09-19T08:53:45.348 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.761+0000 7fdd6efb4640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdd580386a0 0x7fdd5803ab60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.348 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.761+0000 7fdd6efb4640 1 --2- 172.21.15.49:0/786394312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd681038c0 0x7fdd68106120 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:45.348 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.761+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 >> 172.21.15.49:0/786394312 conn(0x7fdd680ff410 msgr2=0x7fdd680fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:45.348 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.761+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 shutdown_connections 2024-09-19T08:53:45.348 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:44.761+0000 7fdd6efb4640 1 -- 172.21.15.49:0/786394312 wait complete. 2024-09-19T08:53:45.348 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying prometheus service with default placement... 2024-09-19T08:53:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:46 smithi049 ceph-mon[28158]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:46 smithi049 ceph-mon[28158]: Saving service ceph-exporter spec with placement * 2024-09-19T08:53:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:46 smithi049 ceph-mon[28158]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:53:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:46 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:47.398 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:47 smithi049 ceph-mon[28158]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:47.398 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:47 smithi049 ceph-mon[28158]: Saving service prometheus spec with placement count:1 2024-09-19T08:53:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-19T08:53:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.712+0000 7fd77d382640 1 Processor -- start 2024-09-19T08:53:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.712+0000 7fd77d382640 1 -- start start 2024-09-19T08:53:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.712+0000 7fd77d382640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd7781059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.712+0000 7fd77d382640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd778105fa0 con 0x7fd7781055d0 2024-09-19T08:53:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.713+0000 7fd776ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd7781059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.713+0000 7fd776ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd7781059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46878/0 (socket says 172.21.15.49:46878) 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.713+0000 7fd776ffd640 1 -- 172.21.15.49:0/1131968392 learned_addr learned my addr 172.21.15.49:0/1131968392 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.713+0000 7fd776ffd640 1 -- 172.21.15.49:0/1131968392 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7781067d0 con 0x7fd7781055d0 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd776ffd640 1 --2- 172.21.15.49:0/1131968392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd7781059d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd768009820 tx=0x7fd76802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da339f777d89af5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd775ffb640 1 -- 172.21.15.49:0/1131968392 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd76802ad40 con 0x7fd7781055d0 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd775ffb640 1 -- 172.21.15.49:0/1131968392 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd768032900 con 0x7fd7781055d0 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd775ffb640 1 -- 172.21.15.49:0/1131968392 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd768030860 con 0x7fd7781055d0 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd77d382640 1 -- 172.21.15.49:0/1131968392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 msgr2=0x7fd7781059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd77d382640 1 --2- 172.21.15.49:0/1131968392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd7781059d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd768009820 tx=0x7fd76802a270 comp rx=0 tx=0).stop 2024-09-19T08:53:47.407 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd77d382640 1 -- 172.21.15.49:0/1131968392 shutdown_connections 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd77d382640 1 --2- 172.21.15.49:0/1131968392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd7781059d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd77d382640 1 -- 172.21.15.49:0/1131968392 >> 172.21.15.49:0/1131968392 conn(0x7fd778100d80 msgr2=0x7fd7781031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd77d382640 1 -- 172.21.15.49:0/1131968392 shutdown_connections 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.714+0000 7fd77d382640 1 -- 172.21.15.49:0/1131968392 wait complete. 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.715+0000 7fd77d382640 1 Processor -- start 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.715+0000 7fd77d382640 1 -- start start 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.715+0000 7fd77d382640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd778199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.715+0000 7fd77d382640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd778199850 con 0x7fd7781055d0 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd776ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd778199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd776ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd778199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46886/0 (socket says 172.21.15.49:46886) 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd776ffd640 1 -- 172.21.15.49:0/87065499 learned_addr learned my addr 172.21.15.49:0/87065499 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd776ffd640 1 -- 172.21.15.49:0/87065499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7680094d0 con 0x7fd7781055d0 2024-09-19T08:53:47.408 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd776ffd640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd778199310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7680097f0 tx=0x7fd768030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd75ffff640 1 -- 172.21.15.49:0/87065499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd768040070 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd75ffff640 1 -- 172.21.15.49:0/87065499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd768032dd0 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd778199a50 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd75ffff640 1 -- 172.21.15.49:0/87065499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd76803a730 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.716+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd778199ef0 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.717+0000 7fd75ffff640 1 -- 172.21.15.49:0/87065499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fd76803a890 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.717+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd778109a00 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.718+0000 7fd75ffff640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd760038650 0x7fd76003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.718+0000 7fd75ffff640 1 -- 172.21.15.49:0/87065499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd76806b7c0 con 0x7fd7781055d0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.718+0000 7fd7767fc640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd760038650 0x7fd76003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.718+0000 7fd7767fc640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd760038650 0x7fd76003ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0098c0 tx=0x7fd76c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:47.409 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.722+0000 7fd75ffff640 1 -- 172.21.15.49:0/87065499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd7680394f0 con 0x7fd7781055d0 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.927+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fd778101fa0 con 0x7fd760038650 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.932+0000 7fd75ffff640 1 -- 172.21.15.49:0/87065499 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fd778101fa0 con 0x7fd760038650 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.933+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd760038650 msgr2=0x7fd76003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.933+0000 7fd77d382640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd760038650 0x7fd76003ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0098c0 tx=0x7fd76c006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.933+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 msgr2=0x7fd778199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.934+0000 7fd77d382640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd778199310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7680097f0 tx=0x7fd768030d50 comp rx=0 tx=0).stop 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.934+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 shutdown_connections 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.934+0000 7fd77d382640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fd760038650 0x7fd76003ab10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.934+0000 7fd77d382640 1 --2- 172.21.15.49:0/87065499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7781055d0 0x7fd778199310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.934+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 >> 172.21.15.49:0/87065499 conn(0x7fd778100d80 msgr2=0x7fd778101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.934+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 shutdown_connections 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:45.934+0000 7fd77d382640 1 -- 172.21.15.49:0/87065499 wait complete. 2024-09-19T08:53:47.410 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying grafana service with default placement... 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.823+0000 7f4e3b694640 1 Processor -- start 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.823+0000 7f4e3b694640 1 -- start start 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.823+0000 7f4e3b694640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e341059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.823+0000 7f4e3b694640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34105fa0 con 0x7f4e341055d0 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.823+0000 7f4e39430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e341059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.824+0000 7f4e39430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e341059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46898/0 (socket says 172.21.15.49:46898) 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.824+0000 7f4e39430640 1 -- 172.21.15.49:0/1209006741 learned_addr learned my addr 172.21.15.49:0/1209006741 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.824+0000 7f4e39430640 1 -- 172.21.15.49:0/1209006741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e341067d0 con 0x7f4e341055d0 2024-09-19T08:53:48.529 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e39430640 1 --2- 172.21.15.49:0/1209006741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e341059d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009820 tx=0x7f4e3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf220662c91de693 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e2bfff640 1 -- 172.21.15.49:0/1209006741 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e3002ad40 con 0x7f4e341055d0 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e2bfff640 1 -- 172.21.15.49:0/1209006741 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e30032900 con 0x7f4e341055d0 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e2bfff640 1 -- 172.21.15.49:0/1209006741 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e30030860 con 0x7f4e341055d0 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e3b694640 1 -- 172.21.15.49:0/1209006741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 msgr2=0x7f4e341059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e3b694640 1 --2- 172.21.15.49:0/1209006741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e341059d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009820 tx=0x7f4e3002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e3b694640 1 -- 172.21.15.49:0/1209006741 shutdown_connections 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.825+0000 7f4e3b694640 1 --2- 172.21.15.49:0/1209006741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e341059d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.826+0000 7f4e3b694640 1 -- 172.21.15.49:0/1209006741 >> 172.21.15.49:0/1209006741 conn(0x7f4e34100d80 msgr2=0x7f4e341031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.826+0000 7f4e3b694640 1 -- 172.21.15.49:0/1209006741 shutdown_connections 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.826+0000 7f4e3b694640 1 -- 172.21.15.49:0/1209006741 wait complete. 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.826+0000 7f4e3b694640 1 Processor -- start 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.826+0000 7f4e3b694640 1 -- start start 2024-09-19T08:53:48.530 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.826+0000 7f4e3b694640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e34199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e3b694640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34199850 con 0x7f4e341055d0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e39430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e34199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e39430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e34199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46904/0 (socket says 172.21.15.49:46904) 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e39430640 1 -- 172.21.15.49:0/2335576616 learned_addr learned my addr 172.21.15.49:0/2335576616 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e39430640 1 -- 172.21.15.49:0/2335576616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300094d0 con 0x7f4e341055d0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e39430640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e34199310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e300097f0 tx=0x7f4e30030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e2a7fc640 1 -- 172.21.15.49:0/2335576616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e30040070 con 0x7f4e341055d0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e2a7fc640 1 -- 172.21.15.49:0/2335576616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e30032dd0 con 0x7f4e341055d0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e34199a50 con 0x7f4e341055d0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.827+0000 7f4e2a7fc640 1 -- 172.21.15.49:0/2335576616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e3003a730 con 0x7f4e341055d0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.828+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e34199ef0 con 0x7f4e341055d0 2024-09-19T08:53:48.531 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.828+0000 7f4e2a7fc640 1 -- 172.21.15.49:0/2335576616 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f4e3003cc30 con 0x7f4e341055d0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.828+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e34109a00 con 0x7f4e341055d0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.829+0000 7f4e2a7fc640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4e200386a0 0x7f4e2003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.829+0000 7f4e2a7fc640 1 -- 172.21.15.49:0/2335576616 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4e3006b640 con 0x7f4e341055d0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.829+0000 7f4e38c2f640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4e200386a0 0x7f4e2003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.829+0000 7f4e38c2f640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4e200386a0 0x7f4e2003ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e240098c0 tx=0x7f4e24006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:47.833+0000 7f4e2a7fc640 1 -- 172.21.15.49:0/2335576616 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4e30043920 con 0x7f4e341055d0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.020+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e34101fa0 con 0x7f4e200386a0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.025+0000 7f4e2a7fc640 1 -- 172.21.15.49:0/2335576616 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f4e34101fa0 con 0x7f4e200386a0 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4e200386a0 msgr2=0x7f4e2003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4e200386a0 0x7f4e2003ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e240098c0 tx=0x7f4e24006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 msgr2=0x7f4e34199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.532 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e34199310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e300097f0 tx=0x7f4e30030d50 comp rx=0 tx=0).stop 2024-09-19T08:53:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 shutdown_connections 2024-09-19T08:53:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4e200386a0 0x7f4e2003ab60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 --2- 172.21.15.49:0/2335576616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e341055d0 0x7f4e34199310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 >> 172.21.15.49:0/2335576616 conn(0x7f4e34100d80 msgr2=0x7f4e34101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 shutdown_connections 2024-09-19T08:53:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.027+0000 7f4e3b694640 1 -- 172.21.15.49:0/2335576616 wait complete. 2024-09-19T08:53:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying node-exporter service with default placement... 2024-09-19T08:53:48.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:48 smithi049 ceph-mon[28158]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:53:48.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:48 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:49.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:49 smithi049 ceph-mon[28158]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:49.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:49 smithi049 ceph-mon[28158]: Saving service grafana spec with placement count:1 2024-09-19T08:53:49.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:49 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:49.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-19T08:53:49.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.923+0000 7f10334aa640 1 Processor -- start 2024-09-19T08:53:49.735 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.923+0000 7f10334aa640 1 -- start start 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.924+0000 7f10334aa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c1084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.924+0000 7f10334aa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c079e20 con 0x7f102c1060d0 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.924+0000 7f1031246640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c1084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.924+0000 7f1031246640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c1084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46918/0 (socket says 172.21.15.49:46918) 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.924+0000 7f1031246640 1 -- 172.21.15.49:0/215380343 learned_addr learned my addr 172.21.15.49:0/215380343 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.924+0000 7f1031246640 1 -- 172.21.15.49:0/215380343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c108a00 con 0x7f102c1060d0 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.925+0000 7f1031246640 1 --2- 172.21.15.49:0/215380343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c1084c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f101c009e80 tx=0x7f101c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24690cda4851d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.925+0000 7f102bfff640 1 -- 172.21.15.49:0/215380343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f101c031400 con 0x7f102c1060d0 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.925+0000 7f102bfff640 1 -- 172.21.15.49:0/215380343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f101c02d050 con 0x7f102c1060d0 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.925+0000 7f102bfff640 1 -- 172.21.15.49:0/215380343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f101c007930 con 0x7f102c1060d0 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.926+0000 7f10334aa640 1 -- 172.21.15.49:0/215380343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 msgr2=0x7f102c1084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.736 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.926+0000 7f10334aa640 1 --2- 172.21.15.49:0/215380343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c1084c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f101c009e80 tx=0x7f101c02a7a0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.926+0000 7f10334aa640 1 -- 172.21.15.49:0/215380343 shutdown_connections 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.926+0000 7f10334aa640 1 --2- 172.21.15.49:0/215380343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c1084c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.926+0000 7f10334aa640 1 -- 172.21.15.49:0/215380343 >> 172.21.15.49:0/215380343 conn(0x7f102c0ffc50 msgr2=0x7f102c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.926+0000 7f10334aa640 1 -- 172.21.15.49:0/215380343 shutdown_connections 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.926+0000 7f10334aa640 1 -- 172.21.15.49:0/215380343 wait complete. 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f10334aa640 1 Processor -- start 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f10334aa640 1 -- start start 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f10334aa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c105950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f10334aa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c105e90 con 0x7f102c1060d0 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f1031246640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c105950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f1031246640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c105950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46934/0 (socket says 172.21.15.49:46934) 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f1031246640 1 -- 172.21.15.49:0/3530726367 learned_addr learned my addr 172.21.15.49:0/3530726367 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:49.737 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f1031246640 1 -- 172.21.15.49:0/3530726367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c009b30 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.927+0000 7f1031246640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c105950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f101c0319a0 tx=0x7f101c0319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.928+0000 7f102a7fc640 1 -- 172.21.15.49:0/3530726367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f101c03a550 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.928+0000 7f102a7fc640 1 -- 172.21.15.49:0/3530726367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f101c03ab70 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.928+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c104080 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.928+0000 7f102a7fc640 1 -- 172.21.15.49:0/3530726367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f101c039c00 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.928+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c104520 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.928+0000 7f102a7fc640 1 -- 172.21.15.49:0/3530726367 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f101c038040 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.929+0000 7f102a7fc640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f10140386a0 0x7f101403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.929+0000 7f102a7fc640 1 -- 172.21.15.49:0/3530726367 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f101c06b5d0 con 0x7f102c1060d0 2024-09-19T08:53:49.738 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.929+0000 7f1030a45640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f10140386a0 0x7f101403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.929+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102c106530 con 0x7f102c1060d0 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.929+0000 7f1030a45640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f10140386a0 0x7f101403ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10200098c0 tx=0x7f1020006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:48.934+0000 7f102a7fc640 1 -- 172.21.15.49:0/3530726367 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f101c04a080 con 0x7f102c1060d0 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.115+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f102c104b10 con 0x7f10140386a0 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.119+0000 7f102a7fc640 1 -- 172.21.15.49:0/3530726367 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f102c104b10 con 0x7f10140386a0 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f10140386a0 msgr2=0x7f101403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f10140386a0 0x7f101403ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f10200098c0 tx=0x7f1020006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 msgr2=0x7f102c105950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c105950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f101c0319a0 tx=0x7f101c0319d0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 shutdown_connections 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f10140386a0 0x7f101403ab60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 --2- 172.21.15.49:0/3530726367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f102c1060d0 0x7f102c105950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:49.739 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 >> 172.21.15.49:0/3530726367 conn(0x7f102c0ffc50 msgr2=0x7f102c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:49.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 shutdown_connections 2024-09-19T08:53:49.740 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:49.122+0000 7f10334aa640 1 -- 172.21.15.49:0/3530726367 wait complete. 2024-09-19T08:53:49.740 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying alertmanager service with default placement... 2024-09-19T08:53:50.392 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:50 smithi049 ceph-mon[28158]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:50.392 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:50 smithi049 ceph-mon[28158]: Saving service node-exporter spec with placement * 2024-09-19T08:53:50.392 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:50 smithi049 ceph-mon[28158]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:53:50.983 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-19T08:53:50.984 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.198+0000 7f4ef2c3a640 1 Processor -- start 2024-09-19T08:53:50.984 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.199+0000 7f4ef2c3a640 1 -- start start 2024-09-19T08:53:50.984 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.199+0000 7f4ef2c3a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec104280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:50.984 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.199+0000 7f4ef2c3a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec079e60 con 0x7f4eec103e80 2024-09-19T08:53:50.984 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.199+0000 7f4ef09d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:50.984 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.199+0000 7f4ef09d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40266/0 (socket says 172.21.15.49:40266) 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.199+0000 7f4ef09d6640 1 -- 172.21.15.49:0/1687153903 learned_addr learned my addr 172.21.15.49:0/1687153903 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.199+0000 7f4ef09d6640 1 -- 172.21.15.49:0/1687153903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec1047c0 con 0x7f4eec103e80 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.200+0000 7f4ef09d6640 1 --2- 172.21.15.49:0/1687153903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec104280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009820 tx=0x7f4ee002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffed4d88697b5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.200+0000 7f4eeb7fe640 1 -- 172.21.15.49:0/1687153903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee002ad40 con 0x7f4eec103e80 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.200+0000 7f4eeb7fe640 1 -- 172.21.15.49:0/1687153903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ee0032900 con 0x7f4eec103e80 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.200+0000 7f4eeb7fe640 1 -- 172.21.15.49:0/1687153903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0030860 con 0x7f4eec103e80 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/1687153903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 msgr2=0x7f4eec104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 --2- 172.21.15.49:0/1687153903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec104280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009820 tx=0x7f4ee002a270 comp rx=0 tx=0).stop 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/1687153903 shutdown_connections 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 --2- 172.21.15.49:0/1687153903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec104280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.985 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/1687153903 >> 172.21.15.49:0/1687153903 conn(0x7f4eec0ffc50 msgr2=0x7f4eec1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/1687153903 shutdown_connections 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/1687153903 wait complete. 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.201+0000 7f4ef2c3a640 1 Processor -- start 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef2c3a640 1 -- start start 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef2c3a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef2c3a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec19ba50 con 0x7f4eec103e80 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef09d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef09d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec19b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40276/0 (socket says 172.21.15.49:40276) 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef09d6640 1 -- 172.21.15.49:0/4059706877 learned_addr learned my addr 172.21.15.49:0/4059706877 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef09d6640 1 -- 172.21.15.49:0/4059706877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00094d0 con 0x7f4eec103e80 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef09d6640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec19b510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0032670 tx=0x7f4ee00326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ee9ffb640 1 -- 172.21.15.49:0/4059706877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0032c80 con 0x7f4eec103e80 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ee9ffb640 1 -- 172.21.15.49:0/4059706877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ee0032de0 con 0x7f4eec103e80 2024-09-19T08:53:50.986 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec19bc50 con 0x7f4eec103e80 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.202+0000 7f4ee9ffb640 1 -- 172.21.15.49:0/4059706877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee003a720 con 0x7f4eec103e80 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.203+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec19c0f0 con 0x7f4eec103e80 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.203+0000 7f4ee9ffb640 1 -- 172.21.15.49:0/4059706877 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f4ee003a9a0 con 0x7f4eec103e80 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.204+0000 7f4ee9ffb640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4edc038650 0x7f4edc03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.204+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec195200 con 0x7f4eec103e80 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.204+0000 7f4ee9ffb640 1 -- 172.21.15.49:0/4059706877 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4ee006baa0 con 0x7f4eec103e80 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.204+0000 7f4eebfff640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4edc038650 0x7f4edc03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.204+0000 7f4eebfff640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4edc038650 0x7f4edc03ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80098c0 tx=0x7f4ed8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.208+0000 7f4ee9ffb640 1 -- 172.21.15.49:0/4059706877 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ee0039b00 con 0x7f4eec103e80 2024-09-19T08:53:50.987 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.392+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f4eec02c610 con 0x7f4edc038650 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.396+0000 7f4ee9ffb640 1 -- 172.21.15.49:0/4059706877 <== mgr.14118 v2:172.21.15.49:6800/1902543814 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f4eec02c610 con 0x7f4edc038650 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4edc038650 msgr2=0x7f4edc03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4edc038650 0x7f4edc03ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80098c0 tx=0x7f4ed8006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 msgr2=0x7f4eec19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec19b510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0032670 tx=0x7f4ee00326a0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 shutdown_connections 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f4edc038650 0x7f4edc03ab10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 --2- 172.21.15.49:0/4059706877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4eec103e80 0x7f4eec19b510 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 >> 172.21.15.49:0/4059706877 conn(0x7f4eec0ffc50 msgr2=0x7f4eec1923d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 shutdown_connections 2024-09-19T08:53:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:50.399+0000 7f4ef2c3a640 1 -- 172.21.15.49:0/4059706877 wait complete. 2024-09-19T08:53:51.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:51 smithi049 ceph-mon[28158]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:53:51.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:51 smithi049 ceph-mon[28158]: Saving service alertmanager spec with placement count:1 2024-09-19T08:53:51.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:51 smithi049 ceph-mon[28158]: from='mgr.14118 172.21.15.49:0/1521551357' entity='mgr.smithi049.qdvksw' 2024-09-19T08:53:51.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:51 smithi049 ceph-mon[28158]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:53:52.193 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.372+0000 7fa431a7d640 1 Processor -- start 2024-09-19T08:53:52.198 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.372+0000 7fa431a7d640 1 -- start start 2024-09-19T08:53:52.198 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.372+0000 7fa431a7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:52.198 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.372+0000 7fa431a7d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c079e60 con 0x7fa42c106090 2024-09-19T08:53:52.198 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.372+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.372+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40290/0 (socket says 172.21.15.49:40290) 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.372+0000 7fa42b7fe640 1 -- 172.21.15.49:0/2642795450 learned_addr learned my addr 172.21.15.49:0/2642795450 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.373+0000 7fa42b7fe640 1 -- 172.21.15.49:0/2642795450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c1089c0 con 0x7fa42c106090 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.373+0000 7fa42b7fe640 1 --2- 172.21.15.49:0/2642795450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c108480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009820 tx=0x7fa41c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e40b20f39d382cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa42a7fc640 1 -- 172.21.15.49:0/2642795450 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa41c02ad40 con 0x7fa42c106090 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa42a7fc640 1 -- 172.21.15.49:0/2642795450 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa41c032900 con 0x7fa42c106090 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa42a7fc640 1 -- 172.21.15.49:0/2642795450 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa41c030860 con 0x7fa42c106090 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa431a7d640 1 -- 172.21.15.49:0/2642795450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 msgr2=0x7fa42c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa431a7d640 1 --2- 172.21.15.49:0/2642795450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c108480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009820 tx=0x7fa41c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:52.199 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa431a7d640 1 -- 172.21.15.49:0/2642795450 shutdown_connections 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa431a7d640 1 --2- 172.21.15.49:0/2642795450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c108480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa431a7d640 1 -- 172.21.15.49:0/2642795450 >> 172.21.15.49:0/2642795450 conn(0x7fa42c0ffc50 msgr2=0x7fa42c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa431a7d640 1 -- 172.21.15.49:0/2642795450 shutdown_connections 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.374+0000 7fa431a7d640 1 -- 172.21.15.49:0/2642795450 wait complete. 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.375+0000 7fa431a7d640 1 Processor -- start 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.375+0000 7fa431a7d640 1 -- start start 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.375+0000 7fa431a7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.375+0000 7fa431a7d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c105e50 con 0x7fa42c106090 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa42b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c105910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40300/0 (socket says 172.21.15.49:40300) 2024-09-19T08:53:52.200 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa42b7fe640 1 -- 172.21.15.49:0/456511923 learned_addr learned my addr 172.21.15.49:0/456511923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa42b7fe640 1 -- 172.21.15.49:0/456511923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0094d0 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa42b7fe640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c105910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa41c032670 tx=0x7fa41c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa428ff9640 1 -- 172.21.15.49:0/456511923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa41c032c80 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c104040 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa428ff9640 1 -- 172.21.15.49:0/456511923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa41c032de0 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa428ff9640 1 -- 172.21.15.49:0/456511923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa41c03a720 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.376+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c1044e0 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.377+0000 7fa428ff9640 1 -- 172.21.15.49:0/456511923 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fa41c03a9a0 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.378+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c106470 con 0x7fa42c106090 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.378+0000 7fa428ff9640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa414038650 0x7fa41403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:52.201 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.378+0000 7fa428ff9640 1 -- 172.21.15.49:0/456511923 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa41c06b970 con 0x7fa42c106090 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.378+0000 7fa42affd640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa414038650 0x7fa41403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.378+0000 7fa42affd640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa414038650 0x7fa41403ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa42000ad30 tx=0x7fa4200093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.382+0000 7fa428ff9640 1 -- 172.21.15.49:0/456511923 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa41c039d10 con 0x7fa42c106090 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.557+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fa42c109770 con 0x7fa42c106090 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.561+0000 7fa428ff9640 1 -- 172.21.15.49:0/456511923 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa41c044e90 con 0x7fa42c106090 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa414038650 msgr2=0x7fa41403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa414038650 0x7fa41403ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa42000ad30 tx=0x7fa4200093f0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 msgr2=0x7fa42c105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c105910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa41c032670 tx=0x7fa41c0326a0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.202 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 shutdown_connections 2024-09-19T08:53:52.203 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fa414038650 0x7fa41403ab10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.203 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 --2- 172.21.15.49:0/456511923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa42c106090 0x7fa42c105910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:52.203 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 >> 172.21.15.49:0/456511923 conn(0x7fa42c0ffc50 msgr2=0x7fa42c100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:52.203 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 shutdown_connections 2024-09-19T08:53:52.203 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:51.563+0000 7fa431a7d640 1 -- 172.21.15.49:0/456511923 wait complete. 2024-09-19T08:53:52.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:52 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/456511923' entity='client.admin' 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.643+0000 7f9ea87ac640 1 Processor -- start 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.644+0000 7f9ea87ac640 1 -- start start 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.644+0000 7f9ea87ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.644+0000 7f9ea87ac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea007a8c0 con 0x7f9ea007be90 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.644+0000 7f9ea6548640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.644+0000 7f9ea6548640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40312/0 (socket says 172.21.15.49:40312) 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.644+0000 7f9ea6548640 1 -- 172.21.15.49:0/264813664 learned_addr learned my addr 172.21.15.49:0/264813664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.644+0000 7f9ea6548640 1 -- 172.21.15.49:0/264813664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea007aa00 con 0x7f9ea007be90 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.645+0000 7f9ea6548640 1 --2- 172.21.15.49:0/264813664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea007a2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009820 tx=0x7f9e9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5ca546d95c7387 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:53.572 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.645+0000 7f9ea5546640 1 -- 172.21.15.49:0/264813664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e9402ad40 con 0x7f9ea007be90 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.645+0000 7f9ea5546640 1 -- 172.21.15.49:0/264813664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e94032900 con 0x7f9ea007be90 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.645+0000 7f9ea5546640 1 -- 172.21.15.49:0/264813664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e94030860 con 0x7f9ea007be90 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.646+0000 7f9ea87ac640 1 -- 172.21.15.49:0/264813664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 msgr2=0x7f9ea007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.646+0000 7f9ea87ac640 1 --2- 172.21.15.49:0/264813664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea007a2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009820 tx=0x7f9e9402a270 comp rx=0 tx=0).stop 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.646+0000 7f9ea87ac640 1 -- 172.21.15.49:0/264813664 shutdown_connections 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.646+0000 7f9ea87ac640 1 --2- 172.21.15.49:0/264813664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea007a2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.646+0000 7f9ea87ac640 1 -- 172.21.15.49:0/264813664 >> 172.21.15.49:0/264813664 conn(0x7f9ea0100d70 msgr2=0x7f9ea0103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.646+0000 7f9ea87ac640 1 -- 172.21.15.49:0/264813664 shutdown_connections 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.646+0000 7f9ea87ac640 1 -- 172.21.15.49:0/264813664 wait complete. 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea87ac640 1 Processor -- start 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea87ac640 1 -- start start 2024-09-19T08:53:53.573 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea87ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea87ac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea019ba40 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea6548640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea6548640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea019b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40326/0 (socket says 172.21.15.49:40326) 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea6548640 1 -- 172.21.15.49:0/1329571598 learned_addr learned my addr 172.21.15.49:0/1329571598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea6548640 1 -- 172.21.15.49:0/1329571598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e940094d0 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.647+0000 7f9ea6548640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea019b500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e94032670 tx=0x7f9e940326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.648+0000 7f9e937fe640 1 -- 172.21.15.49:0/1329571598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e94032c80 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.648+0000 7f9e937fe640 1 -- 172.21.15.49:0/1329571598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e94032de0 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.648+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea019bc40 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.648+0000 7f9e937fe640 1 -- 172.21.15.49:0/1329571598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e9403a720 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.648+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea019c0e0 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.648+0000 7f9e937fe640 1 -- 172.21.15.49:0/1329571598 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f9e9403cc30 con 0x7f9ea007be90 2024-09-19T08:53:53.574 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.649+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea010b9e0 con 0x7f9ea007be90 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.649+0000 7f9e937fe640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f9e8c038650 0x7f9e8c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.649+0000 7f9e937fe640 1 -- 172.21.15.49:0/1329571598 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9e9406b960 con 0x7f9ea007be90 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.649+0000 7f9ea5d47640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f9e8c038650 0x7f9e8c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.649+0000 7f9ea5d47640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f9e8c038650 0x7f9e8c03ab10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0098c0 tx=0x7f9e9c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.653+0000 7f9e937fe640 1 -- 172.21.15.49:0/1329571598 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9e94043310 con 0x7f9ea007be90 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.827+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f9ea019ea20 con 0x7f9ea007be90 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.830+0000 7f9e937fe640 1 -- 172.21.15.49:0/1329571598 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f9e94031b90 con 0x7f9ea007be90 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f9e8c038650 msgr2=0x7f9e8c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f9e8c038650 0x7f9e8c03ab10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0098c0 tx=0x7f9e9c006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 msgr2=0x7f9ea019b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea019b500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e94032670 tx=0x7f9e940326a0 comp rx=0 tx=0).stop 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 shutdown_connections 2024-09-19T08:53:53.575 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f9e8c038650 0x7f9e8c03ab10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:53.576 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 --2- 172.21.15.49:0/1329571598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea007be90 0x7f9ea019b500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:53.576 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 >> 172.21.15.49:0/1329571598 conn(0x7f9ea0100d70 msgr2=0x7f9ea0101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:53.576 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 shutdown_connections 2024-09-19T08:53:53.576 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:52.833+0000 7f9ea87ac640 1 -- 172.21.15.49:0/1329571598 wait complete. 2024-09-19T08:53:53.576 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling the dashboard module... 2024-09-19T08:53:53.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:53 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1329571598' entity='client.admin' 2024-09-19T08:53:53.958 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:53 smithi049 ceph-mon[28158]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:53:55.144 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:54 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/205078038' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:53:55.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.959+0000 7fcd30b33640 1 Processor -- start 2024-09-19T08:53:55.475 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.959+0000 7fcd30b33640 1 -- start start 2024-09-19T08:53:55.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.959+0000 7fcd30b33640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.959+0000 7fcd30b33640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c105f90 con 0x7fcd2c1055c0 2024-09-19T08:53:55.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.959+0000 7fcd2a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.959+0000 7fcd2a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40330/0 (socket says 172.21.15.49:40330) 2024-09-19T08:53:55.476 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.959+0000 7fcd2a59c640 1 -- 172.21.15.49:0/1958495065 learned_addr learned my addr 172.21.15.49:0/1958495065 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:55.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.960+0000 7fcd2a59c640 1 -- 172.21.15.49:0/1958495065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c1067c0 con 0x7fcd2c1055c0 2024-09-19T08:53:55.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.960+0000 7fcd2a59c640 1 --2- 172.21.15.49:0/1958495065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c1059c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009820 tx=0x7fcd1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318afac1707e368d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:55.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd2959a640 1 -- 172.21.15.49:0/1958495065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd1c02ad40 con 0x7fcd2c1055c0 2024-09-19T08:53:55.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd2959a640 1 -- 172.21.15.49:0/1958495065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd1c032900 con 0x7fcd2c1055c0 2024-09-19T08:53:55.477 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd2959a640 1 -- 172.21.15.49:0/1958495065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd1c030860 con 0x7fcd2c1055c0 2024-09-19T08:53:55.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd30b33640 1 -- 172.21.15.49:0/1958495065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 msgr2=0x7fcd2c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd30b33640 1 --2- 172.21.15.49:0/1958495065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c1059c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009820 tx=0x7fcd1c02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:55.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd30b33640 1 -- 172.21.15.49:0/1958495065 shutdown_connections 2024-09-19T08:53:55.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd30b33640 1 --2- 172.21.15.49:0/1958495065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c1059c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.478 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd30b33640 1 -- 172.21.15.49:0/1958495065 >> 172.21.15.49:0/1958495065 conn(0x7fcd2c100d70 msgr2=0x7fcd2c103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:55.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd30b33640 1 -- 172.21.15.49:0/1958495065 shutdown_connections 2024-09-19T08:53:55.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.961+0000 7fcd30b33640 1 -- 172.21.15.49:0/1958495065 wait complete. 2024-09-19T08:53:55.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.962+0000 7fcd30b33640 1 Processor -- start 2024-09-19T08:53:55.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.962+0000 7fcd30b33640 1 -- start start 2024-09-19T08:53:55.479 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.962+0000 7fcd30b33640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c07bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.962+0000 7fcd30b33640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c07c0a0 con 0x7fcd2c1055c0 2024-09-19T08:53:55.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd2a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c07bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.480 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd2a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c07bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40344/0 (socket says 172.21.15.49:40344) 2024-09-19T08:53:55.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd2a59c640 1 -- 172.21.15.49:0/205078038 learned_addr learned my addr 172.21.15.49:0/205078038 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:55.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd2a59c640 1 -- 172.21.15.49:0/205078038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0094d0 con 0x7fcd2c1055c0 2024-09-19T08:53:55.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd2a59c640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c07bb60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0097f0 tx=0x7fcd1c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:55.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd1c040070 con 0x7fcd2c1055c0 2024-09-19T08:53:55.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c07a290 con 0x7fcd2c1055c0 2024-09-19T08:53:55.481 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd1c032dd0 con 0x7fcd2c1055c0 2024-09-19T08:53:55.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd1c03a730 con 0x7fcd2c1055c0 2024-09-19T08:53:55.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.963+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c07a730 con 0x7fcd2c1055c0 2024-09-19T08:53:55.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.964+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fcd1c03a890 con 0x7fcd2c1055c0 2024-09-19T08:53:55.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.964+0000 7fcd1b7fe640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fcd14038650 0x7fcd1403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:55.482 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.964+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcd1c03cc30 con 0x7fcd2c1055c0 2024-09-19T08:53:55.483 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.964+0000 7fcd29d9b640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fcd14038650 0x7fcd1403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:55.483 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.965+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c1059c0 con 0x7fcd2c1055c0 2024-09-19T08:53:55.483 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.965+0000 7fcd29d9b640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fcd14038650 0x7fcd1403ab10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098c0 tx=0x7fcd20006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:55.483 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:53.969+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd1c039b90 con 0x7fcd2c1055c0 2024-09-19T08:53:55.483 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.190+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fcd2c109a80 con 0x7fcd2c1055c0 2024-09-19T08:53:55.484 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.835+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fcd1c039dc0 con 0x7fcd2c1055c0 2024-09-19T08:53:55.484 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.837+0000 7fcd1b7fe640 1 -- 172.21.15.49:0/205078038 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fcd1c05b7b0 con 0x7fcd2c1055c0 2024-09-19T08:53:55.484 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fcd14038650 msgr2=0x7fcd1403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.484 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fcd14038650 0x7fcd1403ab10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098c0 tx=0x7fcd20006db0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.484 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 msgr2=0x7fcd2c07bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c07bb60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0097f0 tx=0x7fcd1c030d50 comp rx=0 tx=0).stop 2024-09-19T08:53:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 shutdown_connections 2024-09-19T08:53:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fcd14038650 0x7fcd1403ab10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 --2- 172.21.15.49:0/205078038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd2c1055c0 0x7fcd2c07bb60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:55.485 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.840+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 >> 172.21.15.49:0/205078038 conn(0x7fcd2c100d70 msgr2=0x7fcd2c1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:55.486 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.841+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 shutdown_connections 2024-09-19T08:53:55.486 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:54.841+0000 7fcd30b33640 1 -- 172.21.15.49:0/205078038 wait complete. 2024-09-19T08:53:55.978 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:55 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/205078038' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:53:55.979 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:55 smithi049 ceph-mon[28158]: mgrmap e9: smithi049.qdvksw(active, since 29s) 2024-09-19T08:53:56.722 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "smithi049.qdvksw", 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.894+0000 7fdcc29f1640 1 Processor -- start 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.895+0000 7fdcc29f1640 1 -- start start 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.895+0000 7fdcc29f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.729 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.895+0000 7fdcc29f1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc079e10 con 0x7fdcbc106100 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.895+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.895+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1084f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40370/0 (socket says 172.21.15.49:40370) 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.895+0000 7fdcbbfff640 1 -- 172.21.15.49:0/1015453137 learned_addr learned my addr 172.21.15.49:0/1015453137 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.895+0000 7fdcbbfff640 1 -- 172.21.15.49:0/1015453137 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc108a30 con 0x7fdcbc106100 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.896+0000 7fdcbbfff640 1 --2- 172.21.15.49:0/1015453137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1084f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009820 tx=0x7fdcac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dfdd4a74f684f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.896+0000 7fdcbaffd640 1 -- 172.21.15.49:0/1015453137 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcac02ad40 con 0x7fdcbc106100 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.896+0000 7fdcbaffd640 1 -- 172.21.15.49:0/1015453137 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcac032900 con 0x7fdcbc106100 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.896+0000 7fdcbaffd640 1 -- 172.21.15.49:0/1015453137 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcac030860 con 0x7fdcbc106100 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.897+0000 7fdcc29f1640 1 -- 172.21.15.49:0/1015453137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 msgr2=0x7fdcbc1084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.897+0000 7fdcc29f1640 1 --2- 172.21.15.49:0/1015453137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1084f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009820 tx=0x7fdcac02a270 comp rx=0 tx=0).stop 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.897+0000 7fdcc29f1640 1 -- 172.21.15.49:0/1015453137 shutdown_connections 2024-09-19T08:53:56.730 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.897+0000 7fdcc29f1640 1 --2- 172.21.15.49:0/1015453137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1084f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.897+0000 7fdcc29f1640 1 -- 172.21.15.49:0/1015453137 >> 172.21.15.49:0/1015453137 conn(0x7fdcbc0ffd00 msgr2=0x7fdcbc102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.897+0000 7fdcc29f1640 1 -- 172.21.15.49:0/1015453137 shutdown_connections 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.897+0000 7fdcc29f1640 1 -- 172.21.15.49:0/1015453137 wait complete. 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.898+0000 7fdcc29f1640 1 Processor -- start 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.898+0000 7fdcc29f1640 1 -- start start 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.898+0000 7fdcc29f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.898+0000 7fdcc29f1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc199730 con 0x7fdcbc106100 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.898+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.898+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40382/0 (socket says 172.21.15.49:40382) 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.898+0000 7fdcbbfff640 1 -- 172.21.15.49:0/4153175463 learned_addr learned my addr 172.21.15.49:0/4153175463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.899+0000 7fdcbbfff640 1 -- 172.21.15.49:0/4153175463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0094d0 con 0x7fdcbc106100 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.899+0000 7fdcbbfff640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1991f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097f0 tx=0x7fdcac030e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.731 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.899+0000 7fdcb97fa640 1 -- 172.21.15.49:0/4153175463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcac032c80 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.899+0000 7fdcb97fa640 1 -- 172.21.15.49:0/4153175463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcac032de0 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.899+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc199930 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.899+0000 7fdcb97fa640 1 -- 172.21.15.49:0/4153175463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcac03a7c0 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.899+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc199dd0 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.900+0000 7fdcb97fa640 1 -- 172.21.15.49:0/4153175463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fdcac03a970 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.900+0000 7fdcb97fa640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 0x7fdca403abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.900+0000 7fdcb97fa640 1 -- 172.21.15.49:0/4153175463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdcac06ba60 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.900+0000 7fdcbb7fe640 1 -- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 msgr2=0x7fdca403abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1902543814 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.900+0000 7fdcbb7fe640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 0x7fdca403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.900+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc1064e0 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:55.905+0000 7fdcb97fa640 1 -- 172.21.15.49:0/4153175463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdcac043310 con 0x7fdcbc106100 2024-09-19T08:53:56.732 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.101+0000 7fdcbb7fe640 1 -- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 msgr2=0x7fdca403abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1902543814 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.101+0000 7fdcbb7fe640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 0x7fdca403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.138+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fdcbc1096a0 con 0x7fdcbc106100 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.138+0000 7fdcb97fa640 1 -- 172.21.15.49:0/4153175463 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fdcac037ed0 con 0x7fdcbc106100 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 msgr2=0x7fdca403abb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 0x7fdca403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 msgr2=0x7fdcbc1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1991f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097f0 tx=0x7fdcac030e20 comp rx=0 tx=0).stop 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 shutdown_connections 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7fdca40386f0 0x7fdca403abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 --2- 172.21.15.49:0/4153175463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdcbc106100 0x7fdcbc1991f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.141+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 >> 172.21.15.49:0/4153175463 conn(0x7fdcbc0ffd00 msgr2=0x7fdcbc1008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.142+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 shutdown_connections 2024-09-19T08:53:56.733 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:56.142+0000 7fdcc29f1640 1 -- 172.21.15.49:0/4153175463 wait complete. 2024-09-19T08:53:56.734 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-09-19T08:53:56.734 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 9... 2024-09-19T08:53:57.096 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:56 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/4153175463' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: Active manager daemon smithi049.qdvksw restarted 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: Activating manager daemon smithi049.qdvksw 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: mgrmap e10: smithi049.qdvksw(active, starting, since 0.0033276s) 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:54:00.087 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:54:00.088 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: Manager daemon smithi049.qdvksw is now available 2024-09-19T08:54:00.088 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:00.088 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:54:00.088 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:53:59 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.160+0000 7f2a21c22640 1 Processor -- start 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.160+0000 7f2a21c22640 1 -- start start 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.160+0000 7f2a21c22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.160+0000 7f2a21c22640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c079e60 con 0x7f2a1c106090 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.161+0000 7f2a1b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:01.521 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.161+0000 7f2a1b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40398/0 (socket says 172.21.15.49:40398) 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.161+0000 7f2a1b7fe640 1 -- 172.21.15.49:0/218793812 learned_addr learned my addr 172.21.15.49:0/218793812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.161+0000 7f2a1b7fe640 1 -- 172.21.15.49:0/218793812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c1089c0 con 0x7f2a1c106090 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.162+0000 7f2a1b7fe640 1 --2- 172.21.15.49:0/218793812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c108480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009820 tx=0x7f2a0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e84ab5e360c4c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.162+0000 7f2a1a7fc640 1 -- 172.21.15.49:0/218793812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a0c02ad40 con 0x7f2a1c106090 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.162+0000 7f2a1a7fc640 1 -- 172.21.15.49:0/218793812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a0c032900 con 0x7f2a1c106090 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.162+0000 7f2a1a7fc640 1 -- 172.21.15.49:0/218793812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a0c030860 con 0x7f2a1c106090 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 -- 172.21.15.49:0/218793812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 msgr2=0x7f2a1c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 --2- 172.21.15.49:0/218793812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c108480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c009820 tx=0x7f2a0c02a270 comp rx=0 tx=0).stop 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 -- 172.21.15.49:0/218793812 shutdown_connections 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 --2- 172.21.15.49:0/218793812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c108480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 -- 172.21.15.49:0/218793812 >> 172.21.15.49:0/218793812 conn(0x7f2a1c0ffc50 msgr2=0x7f2a1c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 -- 172.21.15.49:0/218793812 shutdown_connections 2024-09-19T08:54:01.522 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 -- 172.21.15.49:0/218793812 wait complete. 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 Processor -- start 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.163+0000 7f2a21c22640 1 -- start start 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a21c22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a21c22640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c199840 con 0x7f2a1c106090 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a1b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a1b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40406/0 (socket says 172.21.15.49:40406) 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a1b7fe640 1 -- 172.21.15.49:0/117970308 learned_addr learned my addr 172.21.15.49:0/117970308 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a1b7fe640 1 -- 172.21.15.49:0/117970308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c0094d0 con 0x7f2a1c106090 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a1b7fe640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c199300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097f0 tx=0x7f2a0c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a0c040070 con 0x7f2a1c106090 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c199a40 con 0x7f2a1c106090 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a0c032dd0 con 0x7f2a1c106090 2024-09-19T08:54:01.523 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.164+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a0c03a790 con 0x7f2a1c106090 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.165+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c199ee0 con 0x7f2a1c106090 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.165+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f2a0c03a8f0 con 0x7f2a1c106090 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.166+0000 7f2a18ff9640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 0x7f2a0403abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.166+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 --> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a0403b2c0 con 0x7f2a040386f0 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.166+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2a0c06b700 con 0x7f2a1c106090 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.166+0000 7f2a1affd640 1 -- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 msgr2=0x7f2a0403abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1902543814 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.166+0000 7f2a1affd640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 0x7f2a0403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.367+0000 7f2a1affd640 1 -- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 msgr2=0x7f2a0403abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1902543814 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.367+0000 7f2a1affd640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 0x7f2a0403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.768+0000 7f2a1affd640 1 -- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 msgr2=0x7f2a0403abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1902543814 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:57.768+0000 7f2a1affd640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 0x7f2a0403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:58.569+0000 7f2a1affd640 1 -- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 msgr2=0x7f2a0403abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/1902543814 2024-09-19T08:54:01.524 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:58.569+0000 7f2a1affd640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 0x7f2a0403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:59.837+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f2a0c06a530 con 0x7f2a1c106090 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:59.838+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 msgr2=0x7f2a0403abb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:53:59.838+0000 7f2a18ff9640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 0x7f2a0403abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.839+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f2a0c045410 con 0x7f2a1c106090 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.839+0000 7f2a18ff9640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2a0403bfe0 0x7f2a0403e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.839+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a0403b2c0 con 0x7f2a0403bfe0 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.840+0000 7f2a1affd640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2a0403bfe0 0x7f2a0403e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.840+0000 7f2a1affd640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2a0403bfe0 0x7f2a0403e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2a10003980 tx=0x7f2a100092b0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.841+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mgr.14162 v2:172.21.15.49:6800/4115442638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f2a0403b2c0 con 0x7f2a0403bfe0 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.846+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2a1c109770 con 0x7f2a0403bfe0 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a18ff9640 1 -- 172.21.15.49:0/117970308 <== mgr.14162 v2:172.21.15.49:6800/4115442638 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f2a1c109770 con 0x7f2a0403bfe0 2024-09-19T08:54:01.525 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2a0403bfe0 msgr2=0x7f2a0403e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2a0403bfe0 0x7f2a0403e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2a10003980 tx=0x7f2a100092b0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 msgr2=0x7f2a1c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c199300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097f0 tx=0x7f2a0c030d50 comp rx=0 tx=0).stop 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 shutdown_connections 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2a0403bfe0 0x7f2a0403e3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:6800/1902543814,v1:172.21.15.49:6801/1902543814] conn(0x7f2a040386f0 0x7f2a0403abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 --2- 172.21.15.49:0/117970308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a1c106090 0x7f2a1c199300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 >> 172.21.15.49:0/117970308 conn(0x7f2a1c0ffc50 msgr2=0x7f2a1c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 shutdown_connections 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:00.847+0000 7f2a21c22640 1 -- 172.21.15.49:0/117970308 wait complete. 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 9 is available 2024-09-19T08:54:01.526 INFO:teuthology.orchestra.run.smithi049.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:54:01.953 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:01 smithi049 ceph-mon[28158]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:54:01.953 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:01 smithi049 ceph-mon[28158]: mgrmap e11: smithi049.qdvksw(active, since 1.00615s) 2024-09-19T08:54:01.954 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:01 smithi049 ceph-mon[28158]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:54:01.954 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:01 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.952+0000 7f0990c86640 1 Processor -- start 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.952+0000 7f0990c86640 1 -- start start 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.953+0000 7f0990c86640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.953+0000 7f0990c86640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1064a0 con 0x7f098c105ad0 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.953+0000 7f098a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.953+0000 7f098a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46926/0 (socket says 172.21.15.49:46926) 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.953+0000 7f098a59c640 1 -- 172.21.15.49:0/4258411539 learned_addr learned my addr 172.21.15.49:0/4258411539 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:02.793 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.954+0000 7f098a59c640 1 -- 172.21.15.49:0/4258411539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c104730 con 0x7f098c105ad0 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.955+0000 7f098a59c640 1 --2- 172.21.15.49:0/4258411539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c105ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f097c00bac0 tx=0x7f097c02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd194e87bc836c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.955+0000 7f098959a640 1 -- 172.21.15.49:0/4258411539 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f097c02f070 con 0x7f098c105ad0 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.955+0000 7f098959a640 1 -- 172.21.15.49:0/4258411539 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f097c032a60 con 0x7f098c105ad0 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.955+0000 7f098959a640 1 -- 172.21.15.49:0/4258411539 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f097c033c50 con 0x7f098c105ad0 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.956+0000 7f0990c86640 1 -- 172.21.15.49:0/4258411539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 msgr2=0x7f098c105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.956+0000 7f0990c86640 1 --2- 172.21.15.49:0/4258411539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c105ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f097c00bac0 tx=0x7f097c02c920 comp rx=0 tx=0).stop 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.956+0000 7f0990c86640 1 -- 172.21.15.49:0/4258411539 shutdown_connections 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.956+0000 7f0990c86640 1 --2- 172.21.15.49:0/4258411539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c105ed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.956+0000 7f0990c86640 1 -- 172.21.15.49:0/4258411539 >> 172.21.15.49:0/4258411539 conn(0x7f098c0ff3f0 msgr2=0x7f098c101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.956+0000 7f0990c86640 1 -- 172.21.15.49:0/4258411539 shutdown_connections 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.956+0000 7f0990c86640 1 -- 172.21.15.49:0/4258411539 wait complete. 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.957+0000 7f0990c86640 1 Processor -- start 2024-09-19T08:54:02.794 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.957+0000 7f0990c86640 1 -- start start 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.957+0000 7f0990c86640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.957+0000 7f0990c86640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c19bb60 con 0x7f098c105ad0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f098a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f098a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c19b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46932/0 (socket says 172.21.15.49:46932) 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f098a59c640 1 -- 172.21.15.49:0/3502679985 learned_addr learned my addr 172.21.15.49:0/3502679985 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f098a59c640 1 -- 172.21.15.49:0/3502679985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c00b770 con 0x7f098c105ad0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f098a59c640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c19b620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f097c038040 tx=0x7f097c0327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f097b7fe640 1 -- 172.21.15.49:0/3502679985 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f097c03e650 con 0x7f098c105ad0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c19bd60 con 0x7f098c105ad0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f097b7fe640 1 -- 172.21.15.49:0/3502679985 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f097c03ec70 con 0x7f098c105ad0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.958+0000 7f097b7fe640 1 -- 172.21.15.49:0/3502679985 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f097c03cdb0 con 0x7f098c105ad0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.959+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c19c260 con 0x7f098c105ad0 2024-09-19T08:54:02.795 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.960+0000 7f097b7fe640 1 -- 172.21.15.49:0/3502679985 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f097c047400 con 0x7f098c105ad0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.960+0000 7f097b7fe640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f09740385d0 0x7f097403aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.960+0000 7f097b7fe640 1 -- 172.21.15.49:0/3502679985 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f097c06cc40 con 0x7f098c105ad0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.960+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c103620 con 0x7f098c105ad0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.960+0000 7f0989d9b640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f09740385d0 0x7f097403aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.960+0000 7f0989d9b640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f09740385d0 0x7f097403aa90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09800098c0 tx=0x7f0980006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:01.969+0000 7f097b7fe640 1 -- 172.21.15.49:0/3502679985 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f097c042070 con 0x7f098c105ad0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.152+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f098c19eae0 con 0x7f09740385d0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.228+0000 7f097b7fe640 1 -- 172.21.15.49:0/3502679985 <== mgr.14162 v2:172.21.15.49:6800/4115442638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f098c19eae0 con 0x7f09740385d0 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f09740385d0 msgr2=0x7f097403aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f09740385d0 0x7f097403aa90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09800098c0 tx=0x7f0980006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 msgr2=0x7f098c19b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c19b620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f097c038040 tx=0x7f097c0327d0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.796 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 shutdown_connections 2024-09-19T08:54:02.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f09740385d0 0x7f097403aa90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 --2- 172.21.15.49:0/3502679985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f098c105ad0 0x7f098c19b620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:02.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 >> 172.21.15.49:0/3502679985 conn(0x7f098c0ff3f0 msgr2=0x7f098c18da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:02.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 shutdown_connections 2024-09-19T08:54:02.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:02.230+0000 7f0990c86640 1 -- 172.21.15.49:0/3502679985 wait complete. 2024-09-19T08:54:02.797 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial admin user... 2024-09-19T08:54:03.223 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:03 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:03.223 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:03 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:03.223 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:03 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:03.223 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:03 smithi049 ceph-mon[28158]: mgrmap e12: smithi049.qdvksw(active, since 2s) 2024-09-19T08:54:03.223 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:03 smithi049 ceph-mon[28158]: [19/Sep/2024:08:54:02] ENGINE Bus STARTING 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:04 smithi049 ceph-mon[28158]: [19/Sep/2024:08:54:02] ENGINE Serving on https://172.21.15.49:7150 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:04 smithi049 ceph-mon[28158]: [19/Sep/2024:08:54:02] ENGINE Error in HTTPServer.serve 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Traceback (most recent call last): 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._run(expiration_interval) 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:54:04.950 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s = self.context.wrap_socket( 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: return self.sslsocket_class._create( 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self.do_handshake() 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._sslobj.do_handshake() 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:04 smithi049 ceph-mon[28158]: [19/Sep/2024:08:54:03] ENGINE Serving on http://172.21.15.49:8765 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:04 smithi049 ceph-mon[28158]: [19/Sep/2024:08:54:03] ENGINE Bus STARTED 2024-09-19T08:54:04.951 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:04 smithi049 ceph-mon[28158]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:04.952 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:04 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:04.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$sBfJFatPz7awSSx7yMJlqeNJJxUZKv/PMx.Wg.kY7wjXpJQ2Rbj1i", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726736043, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:54:04.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.305+0000 7f4d8aa6e640 1 Processor -- start 2024-09-19T08:54:04.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.305+0000 7f4d8aa6e640 1 -- start start 2024-09-19T08:54:04.957 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.305+0000 7f4d8aa6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d841048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.306+0000 7f4d8aa6e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84104eb0 con 0x7f4d841044e0 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.306+0000 7f4d8880a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d841048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.306+0000 7f4d8880a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d841048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46936/0 (socket says 172.21.15.49:46936) 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.306+0000 7f4d8880a640 1 -- 172.21.15.49:0/1545489874 learned_addr learned my addr 172.21.15.49:0/1545489874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.306+0000 7f4d8880a640 1 -- 172.21.15.49:0/1545489874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d841056e0 con 0x7f4d841044e0 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8880a640 1 --2- 172.21.15.49:0/1545489874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d841048e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009820 tx=0x7f4d6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed42f8875a8cf32d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d837fe640 1 -- 172.21.15.49:0/1545489874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d6c02ad40 con 0x7f4d841044e0 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d837fe640 1 -- 172.21.15.49:0/1545489874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d6c032900 con 0x7f4d841044e0 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d837fe640 1 -- 172.21.15.49:0/1545489874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d6c030860 con 0x7f4d841044e0 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1545489874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 msgr2=0x7f4d841048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8aa6e640 1 --2- 172.21.15.49:0/1545489874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d841048e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009820 tx=0x7f4d6c02a270 comp rx=0 tx=0).stop 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1545489874 shutdown_connections 2024-09-19T08:54:04.958 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8aa6e640 1 --2- 172.21.15.49:0/1545489874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d841048e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1545489874 >> 172.21.15.49:0/1545489874 conn(0x7f4d840ffc50 msgr2=0x7f4d841020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1545489874 shutdown_connections 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.307+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1545489874 wait complete. 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.308+0000 7f4d8aa6e640 1 Processor -- start 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.308+0000 7f4d8aa6e640 1 -- start start 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.308+0000 7f4d8aa6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d84199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.308+0000 7f4d8aa6e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84199890 con 0x7f4d841044e0 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.308+0000 7f4d8880a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d84199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.308+0000 7f4d8880a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d84199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46940/0 (socket says 172.21.15.49:46940) 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.308+0000 7f4d8880a640 1 -- 172.21.15.49:0/1940668208 learned_addr learned my addr 172.21.15.49:0/1940668208 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.309+0000 7f4d8880a640 1 -- 172.21.15.49:0/1940668208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0094d0 con 0x7f4d841044e0 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.309+0000 7f4d8880a640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d84199350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0097f0 tx=0x7f4d6c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.959 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.309+0000 7f4d81ffb640 1 -- 172.21.15.49:0/1940668208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d6c040070 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.309+0000 7f4d81ffb640 1 -- 172.21.15.49:0/1940668208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d6c032dd0 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.309+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d84199a90 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.309+0000 7f4d81ffb640 1 -- 172.21.15.49:0/1940668208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d6c03a730 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.309+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d84199f30 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.310+0000 7f4d81ffb640 1 -- 172.21.15.49:0/1940668208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f4d6c03a890 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.310+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d841935b0 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.310+0000 7f4d81ffb640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f4d700386f0 0x7f4d7003abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.310+0000 7f4d81ffb640 1 -- 172.21.15.49:0/1940668208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4d6c06b770 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.310+0000 7f4d83fff640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f4d700386f0 0x7f4d7003abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.311+0000 7f4d83fff640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f4d700386f0 0x7f4d7003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400ad30 tx=0x7f4d740093f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.315+0000 7f4d81ffb640 1 -- 172.21.15.49:0/1940668208 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4d6c043920 con 0x7f4d841044e0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.512+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4d84061900 con 0x7f4d700386f0 2024-09-19T08:54:04.960 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.761+0000 7f4d81ffb640 1 -- 172.21.15.49:0/1940668208 <== mgr.14162 v2:172.21.15.49:6800/4115442638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4d84061900 con 0x7f4d700386f0 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.763+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f4d700386f0 msgr2=0x7f4d7003abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.763+0000 7f4d8aa6e640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f4d700386f0 0x7f4d7003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400ad30 tx=0x7f4d740093f0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.763+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 msgr2=0x7f4d84199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.763+0000 7f4d8aa6e640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d84199350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0097f0 tx=0x7f4d6c030d50 comp rx=0 tx=0).stop 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.764+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 shutdown_connections 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.764+0000 7f4d8aa6e640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f4d700386f0 0x7f4d7003abb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.764+0000 7f4d8aa6e640 1 --2- 172.21.15.49:0/1940668208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d841044e0 0x7f4d84199350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.764+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 >> 172.21.15.49:0/1940668208 conn(0x7f4d840ffc50 msgr2=0x7f4d84100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.764+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 shutdown_connections 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:03.764+0000 7f4d8aa6e640 1 -- 172.21.15.49:0/1940668208 wait complete. 2024-09-19T08:54:04.961 INFO:teuthology.orchestra.run.smithi049.stdout:Fetching dashboard port number... 2024-09-19T08:54:05.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:05 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/575814136' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:54:06.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:54:06.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb30ed640 1 Processor -- start 2024-09-19T08:54:06.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb30ed640 1 -- start start 2024-09-19T08:54:06.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb30ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:06.107 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb30ed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac07a8c0 con 0x7f8fac07be90 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb0e89640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb0e89640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46948/0 (socket says 172.21.15.49:46948) 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb0e89640 1 -- 172.21.15.49:0/2238484406 learned_addr learned my addr 172.21.15.49:0/2238484406 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.366+0000 7f8fb0e89640 1 -- 172.21.15.49:0/2238484406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac07aa00 con 0x7f8fac07be90 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.367+0000 7f8fb0e89640 1 --2- 172.21.15.49:0/2238484406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac07a2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009820 tx=0x7f8f9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50116bf60f85f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.367+0000 7f8fab7fe640 1 -- 172.21.15.49:0/2238484406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f9402ad40 con 0x7f8fac07be90 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.367+0000 7f8fab7fe640 1 -- 172.21.15.49:0/2238484406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f94032900 con 0x7f8fac07be90 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.367+0000 7f8fab7fe640 1 -- 172.21.15.49:0/2238484406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f94030860 con 0x7f8fac07be90 2024-09-19T08:54:06.108 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 -- 172.21.15.49:0/2238484406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 msgr2=0x7f8fac07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 --2- 172.21.15.49:0/2238484406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac07a2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009820 tx=0x7f8f9402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 -- 172.21.15.49:0/2238484406 shutdown_connections 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 --2- 172.21.15.49:0/2238484406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac07a2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 -- 172.21.15.49:0/2238484406 >> 172.21.15.49:0/2238484406 conn(0x7f8fac100d70 msgr2=0x7f8fac103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 -- 172.21.15.49:0/2238484406 shutdown_connections 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 -- 172.21.15.49:0/2238484406 wait complete. 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 Processor -- start 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.368+0000 7f8fb30ed640 1 -- start start 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb30ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac108850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb30ed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac108d90 con 0x7f8fac07be90 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb0e89640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac108850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:06.109 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb0e89640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac108850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46956/0 (socket says 172.21.15.49:46956) 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb0e89640 1 -- 172.21.15.49:0/575814136 learned_addr learned my addr 172.21.15.49:0/575814136 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb0e89640 1 -- 172.21.15.49:0/575814136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f940094d0 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb0e89640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac108850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8f94032670 tx=0x7f8f940326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fa9ffb640 1 -- 172.21.15.49:0/575814136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f94032c80 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fa9ffb640 1 -- 172.21.15.49:0/575814136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f94032de0 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac108f90 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.369+0000 7f8fa9ffb640 1 -- 172.21.15.49:0/575814136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f9403a720 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.370+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac105390 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.370+0000 7f8fa9ffb640 1 -- 172.21.15.49:0/575814136 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f8f9403a9a0 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.370+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fac10b9e0 con 0x7f8fac07be90 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.371+0000 7f8fa9ffb640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8f980386a0 0x7f8f9803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:06.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.371+0000 7f8fa9ffb640 1 -- 172.21.15.49:0/575814136 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8f9406baa0 con 0x7f8fac07be90 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.371+0000 7f8fabfff640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8f980386a0 0x7f8f9803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.371+0000 7f8fabfff640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8f980386a0 0x7f8f9803ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00ad30 tx=0x7f8f9c0093f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.375+0000 7f8fa9ffb640 1 -- 172.21.15.49:0/575814136 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8f940319f0 con 0x7f8fac07be90 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.549+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f8fac10bc20 con 0x7f8fac07be90 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.549+0000 7f8fa9ffb640 1 -- 172.21.15.49:0/575814136 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f8f94046cb0 con 0x7f8fac07be90 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8f980386a0 msgr2=0x7f8f9803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8f980386a0 0x7f8f9803ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00ad30 tx=0x7f8f9c0093f0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 msgr2=0x7f8fac108850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac108850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8f94032670 tx=0x7f8f940326a0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 shutdown_connections 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8f980386a0 0x7f8f9803ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 --2- 172.21.15.49:0/575814136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fac07be90 0x7f8fac108850 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 >> 172.21.15.49:0/575814136 conn(0x7f8fac100d70 msgr2=0x7f8fac101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:06.111 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 shutdown_connections 2024-09-19T08:54:06.112 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:05.551+0000 7f8fb30ed640 1 -- 172.21.15.49:0/575814136 wait complete. 2024-09-19T08:54:06.114 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:54:06.114 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-19T08:54:06.122 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:54:06.122 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-19T08:54:06.122 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-19T08:54:06.122 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:54:06.124 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph Dashboard is now available at: 2024-09-19T08:54:06.124 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:06.124 INFO:teuthology.orchestra.run.smithi049.stdout: URL: https://smithi049.front.sepia.ceph.com:8443/ 2024-09-19T08:54:06.124 INFO:teuthology.orchestra.run.smithi049.stdout: User: admin 2024-09-19T08:54:06.124 INFO:teuthology.orchestra.run.smithi049.stdout: Password: zidzo3ymbz 2024-09-19T08:54:06.124 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:06.125 INFO:teuthology.orchestra.run.smithi049.stdout:Saving cluster configuration to /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config directory 2024-09-19T08:54:06.125 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling autotune for osd_memory_target 2024-09-19T08:54:07.262 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.511+0000 7fca51648640 1 Processor -- start 2024-09-19T08:54:07.262 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.511+0000 7fca51648640 1 -- start start 2024-09-19T08:54:07.262 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.511+0000 7fca51648640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c1059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.511+0000 7fca51648640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c105fa0 con 0x7fca4c1055d0 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.512+0000 7fca4affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c1059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.512+0000 7fca4affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c1059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46960/0 (socket says 172.21.15.49:46960) 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.512+0000 7fca4affd640 1 -- 172.21.15.49:0/1137601381 learned_addr learned my addr 172.21.15.49:0/1137601381 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.512+0000 7fca4affd640 1 -- 172.21.15.49:0/1137601381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c1067d0 con 0x7fca4c1055d0 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.513+0000 7fca4affd640 1 --2- 172.21.15.49:0/1137601381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c1059d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca44009820 tx=0x7fca4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a459755b4b6181 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.513+0000 7fca49ffb640 1 -- 172.21.15.49:0/1137601381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca4402ad40 con 0x7fca4c1055d0 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.513+0000 7fca49ffb640 1 -- 172.21.15.49:0/1137601381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca44032900 con 0x7fca4c1055d0 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.513+0000 7fca49ffb640 1 -- 172.21.15.49:0/1137601381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca44030860 con 0x7fca4c1055d0 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 -- 172.21.15.49:0/1137601381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 msgr2=0x7fca4c1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 --2- 172.21.15.49:0/1137601381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c1059d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca44009820 tx=0x7fca4402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 -- 172.21.15.49:0/1137601381 shutdown_connections 2024-09-19T08:54:07.263 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 --2- 172.21.15.49:0/1137601381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c1059d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 -- 172.21.15.49:0/1137601381 >> 172.21.15.49:0/1137601381 conn(0x7fca4c100d80 msgr2=0x7fca4c1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 -- 172.21.15.49:0/1137601381 shutdown_connections 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 -- 172.21.15.49:0/1137601381 wait complete. 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 Processor -- start 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.514+0000 7fca51648640 1 -- start start 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca51648640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca51648640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c19ba50 con 0x7fca4c1055d0 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca4affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca4affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c19b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46962/0 (socket says 172.21.15.49:46962) 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca4affd640 1 -- 172.21.15.49:0/3940707974 learned_addr learned my addr 172.21.15.49:0/3940707974 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca4affd640 1 -- 172.21.15.49:0/3940707974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440094d0 con 0x7fca4c1055d0 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca4affd640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c19b510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca440097f0 tx=0x7fca44030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.264 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca43fff640 1 -- 172.21.15.49:0/3940707974 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca44040070 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca43fff640 1 -- 172.21.15.49:0/3940707974 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca44032dd0 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c19bc50 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca43fff640 1 -- 172.21.15.49:0/3940707974 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca4403a730 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.515+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c19c0f0 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.516+0000 7fca43fff640 1 -- 172.21.15.49:0/3940707974 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fca4403a890 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.516+0000 7fca43fff640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fca380386a0 0x7fca3803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.516+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c195240 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.516+0000 7fca43fff640 1 -- 172.21.15.49:0/3940707974 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fca4406b7c0 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.517+0000 7fca4a7fc640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fca380386a0 0x7fca3803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.517+0000 7fca4a7fc640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fca380386a0 0x7fca3803ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca340098c0 tx=0x7fca34006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.521+0000 7fca43fff640 1 -- 172.21.15.49:0/3940707974 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca44039b90 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.693+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fca4c07a0d0 con 0x7fca4c1055d0 2024-09-19T08:54:07.265 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.694+0000 7fca43fff640 1 -- 172.21.15.49:0/3940707974 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fca44039780 con 0x7fca4c1055d0 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fca380386a0 msgr2=0x7fca3803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fca380386a0 0x7fca3803ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca340098c0 tx=0x7fca34006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 msgr2=0x7fca4c19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c19b510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca440097f0 tx=0x7fca44030d50 comp rx=0 tx=0).stop 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 shutdown_connections 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fca380386a0 0x7fca3803ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 --2- 172.21.15.49:0/3940707974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c1055d0 0x7fca4c19b510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 >> 172.21.15.49:0/3940707974 conn(0x7fca4c100d80 msgr2=0x7fca4c108e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 shutdown_connections 2024-09-19T08:54:07.266 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:06.696+0000 7fca51648640 1 -- 172.21.15.49:0/3940707974 wait complete. 2024-09-19T08:54:07.927 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:07 smithi049 ceph-mon[28158]: mgrmap e13: smithi049.qdvksw(active, since 6s) 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f8974886640 1 Processor -- start 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f8974886640 1 -- start start 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f8974886640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f8970104280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f8974886640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8970079e40 con 0x7f8970103e80 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f896e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f8970104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f896e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f8970104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46970/0 (socket says 172.21.15.49:46970) 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f896e59c640 1 -- 172.21.15.49:0/2443641397 learned_addr learned my addr 172.21.15.49:0/2443641397 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.656+0000 7f896e59c640 1 -- 172.21.15.49:0/2443641397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89701047c0 con 0x7f8970103e80 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.657+0000 7f896e59c640 1 --2- 172.21.15.49:0/2443641397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f8970104280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8960009820 tx=0x7f896002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a527c93b199d690 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.657+0000 7f896d59a640 1 -- 172.21.15.49:0/2443641397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f896002ad40 con 0x7f8970103e80 2024-09-19T08:54:08.495 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.657+0000 7f896d59a640 1 -- 172.21.15.49:0/2443641397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8960032900 con 0x7f8970103e80 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.657+0000 7f896d59a640 1 -- 172.21.15.49:0/2443641397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8960030860 con 0x7f8970103e80 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.658+0000 7f8974886640 1 -- 172.21.15.49:0/2443641397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 msgr2=0x7f8970104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.658+0000 7f8974886640 1 --2- 172.21.15.49:0/2443641397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f8970104280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8960009820 tx=0x7f896002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.658+0000 7f8974886640 1 -- 172.21.15.49:0/2443641397 shutdown_connections 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.658+0000 7f8974886640 1 --2- 172.21.15.49:0/2443641397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f8970104280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.658+0000 7f8974886640 1 -- 172.21.15.49:0/2443641397 >> 172.21.15.49:0/2443641397 conn(0x7f89700ffcd0 msgr2=0x7f89701020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.658+0000 7f8974886640 1 -- 172.21.15.49:0/2443641397 shutdown_connections 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.658+0000 7f8974886640 1 -- 172.21.15.49:0/2443641397 wait complete. 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f8974886640 1 Processor -- start 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f8974886640 1 -- start start 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f8974886640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f897019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f8974886640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897019ba10 con 0x7f8970103e80 2024-09-19T08:54:08.496 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f896e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f897019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f896e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f897019b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46982/0 (socket says 172.21.15.49:46982) 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f896e59c640 1 -- 172.21.15.49:0/1188101521 learned_addr learned my addr 172.21.15.49:0/1188101521 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f896e59c640 1 -- 172.21.15.49:0/1188101521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600094d0 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.659+0000 7f896e59c640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f897019b4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f89600097f0 tx=0x7f8960030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.660+0000 7f895f7fe640 1 -- 172.21.15.49:0/1188101521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8960040070 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.660+0000 7f895f7fe640 1 -- 172.21.15.49:0/1188101521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8960032dd0 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.660+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897019bc10 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.660+0000 7f895f7fe640 1 -- 172.21.15.49:0/1188101521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f896003a790 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.660+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897019c0b0 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.661+0000 7f895f7fe640 1 -- 172.21.15.49:0/1188101521 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f896003a8f0 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.661+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8970105690 con 0x7f8970103e80 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.661+0000 7f895f7fe640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8958038790 0x7f895803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:08.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.661+0000 7f895f7fe640 1 -- 172.21.15.49:0/1188101521 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f896006b990 con 0x7f8970103e80 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.661+0000 7f896dd9b640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8958038790 0x7f895803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.662+0000 7f896dd9b640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8958038790 0x7f895803ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89640098c0 tx=0x7f8964006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.666+0000 7f895f7fe640 1 -- 172.21.15.49:0/1188101521 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f89600396d0 con 0x7f8970103e80 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.926+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f89701058d0 con 0x7f8970103e80 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.929+0000 7f895f7fe640 1 -- 172.21.15.49:0/1188101521 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8960039310 con 0x7f8970103e80 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8958038790 msgr2=0x7f895803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8958038790 0x7f895803ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89640098c0 tx=0x7f8964006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 msgr2=0x7f897019b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f897019b4d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f89600097f0 tx=0x7f8960030d50 comp rx=0 tx=0).stop 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 shutdown_connections 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8958038790 0x7f895803ac50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.498 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 --2- 172.21.15.49:0/1188101521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8970103e80 0x7f897019b4d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 >> 172.21.15.49:0/1188101521 conn(0x7f89700ffcd0 msgr2=0x7f897018fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 shutdown_connections 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:07.931+0000 7f8974886640 1 -- 172.21.15.49:0/1188101521 wait complete. 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.499 INFO:teuthology.orchestra.run.smithi049.stdout: ceph telemetry on 2024-09-19T08:54:08.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.500 INFO:teuthology.orchestra.run.smithi049.stdout:For more information see: 2024-09-19T08:54:08.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.500 INFO:teuthology.orchestra.run.smithi049.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:54:08.500 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:08.500 INFO:teuthology.orchestra.run.smithi049.stdout:Bootstrap complete. 2024-09-19T08:54:08.528 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:54:08.528 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:54:08.529 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:54:08.546 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:54:08.546 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:54:08.546 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:54:08.602 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:54:08.602 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:54:08.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/keyring of=/dev/stdout 2024-09-19T08:54:08.669 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:54:08.669 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:54:08.669 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:54:08.726 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:54:08.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs4S2+a6FEcgo9u9becmnrInlbDJsRkxV330PLYUonD6Tg1/voAteGxM2oTkCKWLDjivxReDiqpqoiiZBhIibNsoS391tzG8uZXEd2n/DP89NiGpvJ0MEqjBdLqxeVf9jBceJrMKQbzft+Fr6noLLyWqNDiWlw6pyF9jLZEWkvnVutAQ8T/CN5I0M5tYz4OquEoYteWCjc2kCzNMaoG5qdkj9vQxzPhkJtDrJUyAmWOfQspox8Oe2osnJe/N9ZgXpNDfqfrNwrHtiX484BgAVHn/nAs7Wd3Y0n7zFjehgMVeb3VYU7jKaTvlt60oiCz20RE7mzCs4RynJZ/MkIiAeuWJ47nXBPWusBN3Wi3plv1JsXUbob3oe0lLf3BPIQyLjsoCCnIRtu5zLOJE7X8FEevRT+c/QC08GUW/jXrMGIP0W4Q8TEsxoCJxJl1/X4kvIhPr+tpsLdoj9i5pzBHvXZd7aVY/CUidaecS6cfftJUGMp1geM7TnDAfFdOcBUnO0= ceph-63845326-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:54:08.801 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs4S2+a6FEcgo9u9becmnrInlbDJsRkxV330PLYUonD6Tg1/voAteGxM2oTkCKWLDjivxReDiqpqoiiZBhIibNsoS391tzG8uZXEd2n/DP89NiGpvJ0MEqjBdLqxeVf9jBceJrMKQbzft+Fr6noLLyWqNDiWlw6pyF9jLZEWkvnVutAQ8T/CN5I0M5tYz4OquEoYteWCjc2kCzNMaoG5qdkj9vQxzPhkJtDrJUyAmWOfQspox8Oe2osnJe/N9ZgXpNDfqfrNwrHtiX484BgAVHn/nAs7Wd3Y0n7zFjehgMVeb3VYU7jKaTvlt60oiCz20RE7mzCs4RynJZ/MkIiAeuWJ47nXBPWusBN3Wi3plv1JsXUbob3oe0lLf3BPIQyLjsoCCnIRtu5zLOJE7X8FEevRT+c/QC08GUW/jXrMGIP0W4Q8TEsxoCJxJl1/X4kvIhPr+tpsLdoj9i5pzBHvXZd7aVY/CUidaecS6cfftJUGMp1geM7TnDAfFdOcBUnO0= ceph-63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:08.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs4S2+a6FEcgo9u9becmnrInlbDJsRkxV330PLYUonD6Tg1/voAteGxM2oTkCKWLDjivxReDiqpqoiiZBhIibNsoS391tzG8uZXEd2n/DP89NiGpvJ0MEqjBdLqxeVf9jBceJrMKQbzft+Fr6noLLyWqNDiWlw6pyF9jLZEWkvnVutAQ8T/CN5I0M5tYz4OquEoYteWCjc2kCzNMaoG5qdkj9vQxzPhkJtDrJUyAmWOfQspox8Oe2osnJe/N9ZgXpNDfqfrNwrHtiX484BgAVHn/nAs7Wd3Y0n7zFjehgMVeb3VYU7jKaTvlt60oiCz20RE7mzCs4RynJZ/MkIiAeuWJ47nXBPWusBN3Wi3plv1JsXUbob3oe0lLf3BPIQyLjsoCCnIRtu5zLOJE7X8FEevRT+c/QC08GUW/jXrMGIP0W4Q8TEsxoCJxJl1/X4kvIhPr+tpsLdoj9i5pzBHvXZd7aVY/CUidaecS6cfftJUGMp1geM7TnDAfFdOcBUnO0= ceph-63845326-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:54:08.939 INFO:teuthology.orchestra.run.smithi102.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs4S2+a6FEcgo9u9becmnrInlbDJsRkxV330PLYUonD6Tg1/voAteGxM2oTkCKWLDjivxReDiqpqoiiZBhIibNsoS391tzG8uZXEd2n/DP89NiGpvJ0MEqjBdLqxeVf9jBceJrMKQbzft+Fr6noLLyWqNDiWlw6pyF9jLZEWkvnVutAQ8T/CN5I0M5tYz4OquEoYteWCjc2kCzNMaoG5qdkj9vQxzPhkJtDrJUyAmWOfQspox8Oe2osnJe/N9ZgXpNDfqfrNwrHtiX484BgAVHn/nAs7Wd3Y0n7zFjehgMVeb3VYU7jKaTvlt60oiCz20RE7mzCs4RynJZ/MkIiAeuWJ47nXBPWusBN3Wi3plv1JsXUbob3oe0lLf3BPIQyLjsoCCnIRtu5zLOJE7X8FEevRT+c/QC08GUW/jXrMGIP0W4Q8TEsxoCJxJl1/X4kvIhPr+tpsLdoj9i5pzBHvXZd7aVY/CUidaecS6cfftJUGMp1geM7TnDAfFdOcBUnO0= ceph-63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:08.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:54:09.040 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:08 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1188101521' entity='client.admin' 2024-09-19T08:54:09.157 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:54:10.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.894+0000 7f04c454d640 1 -- 172.21.15.49:0/1686913619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 msgr2=0x7f04bc0feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:10.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.894+0000 7f04c454d640 1 --2- 172.21.15.49:0/1686913619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc0feaf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009880 tx=0x7f04b802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.894+0000 7f04c454d640 1 -- 172.21.15.49:0/1686913619 shutdown_connections 2024-09-19T08:54:10.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.894+0000 7f04c454d640 1 --2- 172.21.15.49:0/1686913619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc0feaf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:10.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.894+0000 7f04c454d640 1 -- 172.21.15.49:0/1686913619 >> 172.21.15.49:0/1686913619 conn(0x7f04bc0f9e80 msgr2=0x7f04bc0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:10.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c454d640 1 -- 172.21.15.49:0/1686913619 shutdown_connections 2024-09-19T08:54:10.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c454d640 1 -- 172.21.15.49:0/1686913619 wait complete. 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c454d640 1 Processor -- start 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c454d640 1 -- start start 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c454d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc18b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c454d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc18bdd0 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c22e9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc18b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c22e9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc18b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45720/0 (socket says 172.21.15.49:45720) 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.895+0000 7f04c22e9640 1 -- 172.21.15.49:0/1035216195 learned_addr learned my addr 172.21.15.49:0/1035216195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.896+0000 7f04c22e9640 1 -- 172.21.15.49:0/1035216195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8009560 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.896+0000 7f04c22e9640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc18b890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04b8005610 tx=0x7f04b8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.896+0000 7f04b37fe640 1 -- 172.21.15.49:0/1035216195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04b8004b20 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.896+0000 7f04b37fe640 1 -- 172.21.15.49:0/1035216195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04b8004c80 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.896+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc189fc0 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.896+0000 7f04b37fe640 1 -- 172.21.15.49:0/1035216195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04b8031a90 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.896+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc18a460 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.897+0000 7f04b37fe640 1 -- 172.21.15.49:0/1035216195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f04b8031cc0 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.897+0000 7f04b37fe640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f04a8038790 0x7f04a803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.897+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc0feaf0 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.897+0000 7f04b37fe640 1 -- 172.21.15.49:0/1035216195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f04b806c490 con 0x7f04bc0fe6f0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.897+0000 7f04c1ae8640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f04a8038790 0x7f04a803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:10.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.898+0000 7f04c1ae8640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f04a8038790 0x7f04a803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0098c0 tx=0x7f04ac006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:10.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:10.902+0000 7f04b37fe640 1 -- 172.21.15.49:0/1035216195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f04b8035070 con 0x7f04bc0fe6f0 2024-09-19T08:54:11.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.076+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f04bc1045c0 con 0x7f04bc0fe6f0 2024-09-19T08:54:11.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.079+0000 7f04b37fe640 1 -- 172.21.15.49:0/1035216195 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f04b8003db0 con 0x7f04bc0fe6f0 2024-09-19T08:54:11.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f04a8038790 msgr2=0x7f04a803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f04a8038790 0x7f04a803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0098c0 tx=0x7f04ac006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 msgr2=0x7f04bc18b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:11.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc18b890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04b8005610 tx=0x7f04b8005640 comp rx=0 tx=0).stop 2024-09-19T08:54:11.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 shutdown_connections 2024-09-19T08:54:11.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f04a8038790 0x7f04a803ac50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 --2- 172.21.15.49:0/1035216195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04bc0fe6f0 0x7f04bc18b890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:11.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 >> 172.21.15.49:0/1035216195 conn(0x7f04bc0f9e80 msgr2=0x7f04bc0faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:11.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 shutdown_connections 2024-09-19T08:54:11.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:11.081+0000 7f04c454d640 1 -- 172.21.15.49:0/1035216195 wait complete. 2024-09-19T08:54:12.040 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:54:12.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:54:12.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1035216195' entity='client.admin' 2024-09-19T08:54:12.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:12.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:12.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:54:12.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:12.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T08:54:12.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-19T08:54:12.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:12.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:12 smithi049 ceph-mon[28158]: Deploying daemon ceph-exporter.smithi049 on smithi049 2024-09-19T08:54:12.506 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:54:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.349+0000 7ff355b29640 1 -- 172.21.15.49:0/810093579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 msgr2=0x7ff3500ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.349+0000 7ff355b29640 1 --2- 172.21.15.49:0/810093579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff3500ffbe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff340009880 tx=0x7ff34002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.349+0000 7ff355b29640 1 -- 172.21.15.49:0/810093579 shutdown_connections 2024-09-19T08:54:15.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.349+0000 7ff355b29640 1 --2- 172.21.15.49:0/810093579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff3500ffbe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.349+0000 7ff355b29640 1 -- 172.21.15.49:0/810093579 >> 172.21.15.49:0/810093579 conn(0x7ff3500faf90 msgr2=0x7ff3500fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:15.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.349+0000 7ff355b29640 1 -- 172.21.15.49:0/810093579 shutdown_connections 2024-09-19T08:54:15.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.349+0000 7ff355b29640 1 -- 172.21.15.49:0/810093579 wait complete. 2024-09-19T08:54:15.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.350+0000 7ff355b29640 1 Processor -- start 2024-09-19T08:54:15.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.350+0000 7ff355b29640 1 -- start start 2024-09-19T08:54:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.350+0000 7ff355b29640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff350196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.350+0000 7ff355b29640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350197400 con 0x7ff3500ff7e0 2024-09-19T08:54:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.350+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff350196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.350+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff350196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45742/0 (socket says 172.21.15.49:45742) 2024-09-19T08:54:15.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.350+0000 7ff34f7fe640 1 -- 172.21.15.49:0/2699842130 learned_addr learned my addr 172.21.15.49:0/2699842130 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.351+0000 7ff34f7fe640 1 -- 172.21.15.49:0/2699842130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009560 con 0x7ff3500ff7e0 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.351+0000 7ff34f7fe640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff350196ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff340005610 tx=0x7ff340005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.351+0000 7ff34cff9640 1 -- 172.21.15.49:0/2699842130 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff340004b20 con 0x7ff3500ff7e0 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.351+0000 7ff34cff9640 1 -- 172.21.15.49:0/2699842130 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff340004c80 con 0x7ff3500ff7e0 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.351+0000 7ff34cff9640 1 -- 172.21.15.49:0/2699842130 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff340031a90 con 0x7ff3500ff7e0 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.351+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff350197600 con 0x7ff3500ff7e0 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.351+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff350197aa0 con 0x7ff3500ff7e0 2024-09-19T08:54:15.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.352+0000 7ff34cff9640 1 -- 172.21.15.49:0/2699842130 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7ff340031d00 con 0x7ff3500ff7e0 2024-09-19T08:54:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.352+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3500ffbe0 con 0x7ff3500ff7e0 2024-09-19T08:54:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.352+0000 7ff34cff9640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff338038790 0x7ff33803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.353+0000 7ff34cff9640 1 -- 172.21.15.49:0/2699842130 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff34006c470 con 0x7ff3500ff7e0 2024-09-19T08:54:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.353+0000 7ff34effd640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff338038790 0x7ff33803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:15.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.353+0000 7ff34effd640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff338038790 0x7ff33803ac50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff3440098c0 tx=0x7ff344006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:15.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.357+0000 7ff34cff9640 1 -- 172.21.15.49:0/2699842130 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff34004dce0 con 0x7ff3500ff7e0 2024-09-19T08:54:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.538+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff35002c450 con 0x7ff338038790 2024-09-19T08:54:15.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.541+0000 7ff34cff9640 1 -- 172.21.15.49:0/2699842130 <== mgr.14162 v2:172.21.15.49:6800/4115442638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff35002c450 con 0x7ff338038790 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff338038790 msgr2=0x7ff33803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff338038790 0x7ff33803ac50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff3440098c0 tx=0x7ff344006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 msgr2=0x7ff350196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff350196ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff340005610 tx=0x7ff340005640 comp rx=0 tx=0).stop 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 shutdown_connections 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff338038790 0x7ff33803ac50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 --2- 172.21.15.49:0/2699842130 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3500ff7e0 0x7ff350196ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 >> 172.21.15.49:0/2699842130 conn(0x7ff3500faf90 msgr2=0x7ff3500fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:15.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.543+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 shutdown_connections 2024-09-19T08:54:15.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:15.544+0000 7ff355b29640 1 -- 172.21.15.49:0/2699842130 wait complete. 2024-09-19T08:54:16.460 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi102 2024-09-19T08:54:16.460 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:54:16.461 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:54:16.480 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:54:16.480 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:16.539 INFO:tasks.cephadm:Adding host smithi102 to orchestrator... 2024-09-19T08:54:16.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch host add smithi102 2024-09-19T08:54:16.798 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:16 smithi049 ceph-mon[28158]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:16.798 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:16 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:17.022 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:54:18.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:18.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:18.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:18.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:18.130 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T08:54:18.130 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-19T08:54:18.130 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:18.130 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:18 smithi049 ceph-mon[28158]: Deploying daemon crash.smithi049 on smithi049 2024-09-19T08:54:19.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 -- 172.21.15.49:0/3561147998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 msgr2=0x7fc0940fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 --2- 172.21.15.49:0/3561147998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc0940fead0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc084009c20 tx=0x7fc08402aa90 comp rx=0 tx=0).stop 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 -- 172.21.15.49:0/3561147998 shutdown_connections 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 --2- 172.21.15.49:0/3561147998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc0940fead0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 -- 172.21.15.49:0/3561147998 >> 172.21.15.49:0/3561147998 conn(0x7fc0940f9e80 msgr2=0x7fc0940fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 -- 172.21.15.49:0/3561147998 shutdown_connections 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 -- 172.21.15.49:0/3561147998 wait complete. 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.190+0000 7fc099a9f640 1 Processor -- start 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc099a9f640 1 -- start start 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc099a9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc094197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc099a9f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094197560 con 0x7fc0940fe6d0 2024-09-19T08:54:19.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc0937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc094197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc0937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc094197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45764/0 (socket says 172.21.15.49:45764) 2024-09-19T08:54:19.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc0937fe640 1 -- 172.21.15.49:0/313901083 learned_addr learned my addr 172.21.15.49:0/313901083 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:19.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc0937fe640 1 -- 172.21.15.49:0/313901083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009900 con 0x7fc0940fe6d0 2024-09-19T08:54:19.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.191+0000 7fc0937fe640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc094197020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc084009d40 tx=0x7fc08402f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.192+0000 7fc090ff9640 1 -- 172.21.15.49:0/313901083 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc08403e070 con 0x7fc0940fe6d0 2024-09-19T08:54:19.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.192+0000 7fc090ff9640 1 -- 172.21.15.49:0/313901083 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc08402fbc0 con 0x7fc0940fe6d0 2024-09-19T08:54:19.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.192+0000 7fc090ff9640 1 -- 172.21.15.49:0/313901083 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc084004710 con 0x7fc0940fe6d0 2024-09-19T08:54:19.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.192+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094197760 con 0x7fc0940fe6d0 2024-09-19T08:54:19.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.192+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc094197c00 con 0x7fc0940fe6d0 2024-09-19T08:54:19.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.193+0000 7fc090ff9640 1 -- 172.21.15.49:0/313901083 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fc08400a040 con 0x7fc0940fe6d0 2024-09-19T08:54:19.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.193+0000 7fc090ff9640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc080038740 0x7fc08003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:19.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.193+0000 7fc090ff9640 1 -- 172.21.15.49:0/313901083 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc08406c660 con 0x7fc0940fe6d0 2024-09-19T08:54:19.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.193+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940feb50 con 0x7fc0940fe6d0 2024-09-19T08:54:19.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.193+0000 7fc092ffd640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc080038740 0x7fc08003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:19.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.193+0000 7fc092ffd640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc080038740 0x7fc08003ac00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0098c0 tx=0x7fc07c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:19.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.198+0000 7fc090ff9640 1 -- 172.21.15.49:0/313901083 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc084033080 con 0x7fc0940fe6d0 2024-09-19T08:54:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:19.376+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0940608f0 con 0x7fc080038740 2024-09-19T08:54:21.033 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:20 smithi049 ceph-mon[28158]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:21.033 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:20 smithi049 ceph-mon[28158]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:21.033 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:20 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:21.033 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:20 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:21.034 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:20 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:21.034 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:20 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:21.034 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:20 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:22.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:21 smithi049 ceph-mon[28158]: Deploying cephadm binary to smithi102 2024-09-19T08:54:22.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:21 smithi049 ceph-mon[28158]: Deploying daemon node-exporter.smithi049 on smithi049 2024-09-19T08:54:22.748 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi102' with addr '172.21.15.102' 2024-09-19T08:54:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.747+0000 7fc090ff9640 1 -- 172.21.15.49:0/313901083 <== mgr.14162 v2:172.21.15.49:6800/4115442638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc0940608f0 con 0x7fc080038740 2024-09-19T08:54:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc080038740 msgr2=0x7fc08003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc080038740 0x7fc08003ac00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0098c0 tx=0x7fc07c006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 msgr2=0x7fc094197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc094197020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc084009d40 tx=0x7fc08402f8a0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 shutdown_connections 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc080038740 0x7fc08003ac00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 --2- 172.21.15.49:0/313901083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0940fe6d0 0x7fc094197020 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 >> 172.21.15.49:0/313901083 conn(0x7fc0940f9e80 msgr2=0x7fc09418e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 shutdown_connections 2024-09-19T08:54:22.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:22.751+0000 7fc099a9f640 1 -- 172.21.15.49:0/313901083 wait complete. 2024-09-19T08:54:23.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:22 smithi049 ceph-mon[28158]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:23.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:22 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:23 smithi049 ceph-mon[28158]: Added host smithi102 2024-09-19T08:54:24.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:54:24.652 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:54:25.041 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:24 smithi049 ceph-mon[28158]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:25.041 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:24 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:25.041 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:24 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:25.041 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:24 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:25.041 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:24 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:25.041 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:24 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:26.039 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:25 smithi049 ceph-mon[28158]: Deploying daemon alertmanager.smithi049 on smithi049 2024-09-19T08:54:26.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.124+0000 7f755fa7b640 1 -- 172.21.15.49:0/3819113929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 msgr2=0x7f75580feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.124+0000 7f755fa7b640 1 --2- 172.21.15.49:0/3819113929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f75580feae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7554009880 tx=0x7f755402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.124+0000 7f755fa7b640 1 -- 172.21.15.49:0/3819113929 shutdown_connections 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.124+0000 7f755fa7b640 1 --2- 172.21.15.49:0/3819113929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f75580feae0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.124+0000 7f755fa7b640 1 -- 172.21.15.49:0/3819113929 >> 172.21.15.49:0/3819113929 conn(0x7f75580f9e90 msgr2=0x7f75580fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.124+0000 7f755fa7b640 1 -- 172.21.15.49:0/3819113929 shutdown_connections 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.124+0000 7f755fa7b640 1 -- 172.21.15.49:0/3819113929 wait complete. 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.125+0000 7f755fa7b640 1 Processor -- start 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.125+0000 7f755fa7b640 1 -- start start 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.125+0000 7f755fa7b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f7558194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.125+0000 7f755fa7b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7558195200 con 0x7f75580fe6e0 2024-09-19T08:54:26.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.125+0000 7f755d817640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f7558194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.125+0000 7f755d817640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f7558194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45838/0 (socket says 172.21.15.49:45838) 2024-09-19T08:54:26.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.125+0000 7f755d817640 1 -- 172.21.15.49:0/3290690133 learned_addr learned my addr 172.21.15.49:0/3290690133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.126+0000 7f755d817640 1 -- 172.21.15.49:0/3290690133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554009560 con 0x7f75580fe6e0 2024-09-19T08:54:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.126+0000 7f755d817640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f7558194cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7554005610 tx=0x7f7554005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.126+0000 7f754effd640 1 -- 172.21.15.49:0/3290690133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7554004b20 con 0x7f75580fe6e0 2024-09-19T08:54:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.126+0000 7f754effd640 1 -- 172.21.15.49:0/3290690133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7554004c80 con 0x7f75580fe6e0 2024-09-19T08:54:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.126+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7558195400 con 0x7f75580fe6e0 2024-09-19T08:54:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.126+0000 7f754effd640 1 -- 172.21.15.49:0/3290690133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7554031a90 con 0x7f75580fe6e0 2024-09-19T08:54:26.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.126+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75581958a0 con 0x7f75580fe6e0 2024-09-19T08:54:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.127+0000 7f754effd640 1 -- 172.21.15.49:0/3290690133 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f7554031ce0 con 0x7f75580fe6e0 2024-09-19T08:54:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.127+0000 7f754effd640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f7544038790 0x7f754403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.127+0000 7f754effd640 1 -- 172.21.15.49:0/3290690133 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f755406c470 con 0x7f75580fe6e0 2024-09-19T08:54:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.127+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75580feae0 con 0x7f75580fe6e0 2024-09-19T08:54:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.127+0000 7f755d016640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f7544038790 0x7f754403ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:26.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.128+0000 7f755d016640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f7544038790 0x7f754403ac50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75480098c0 tx=0x7f7548006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:26.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.132+0000 7f754effd640 1 -- 172.21.15.49:0/3290690133 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7554035020 con 0x7f75580fe6e0 2024-09-19T08:54:26.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.316+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75580608f0 con 0x7f7544038790 2024-09-19T08:54:26.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.317+0000 7f754effd640 1 -- 172.21.15.49:0/3290690133 <== mgr.14162 v2:172.21.15.49:6800/4115442638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f75580608f0 con 0x7f7544038790 2024-09-19T08:54:26.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:54:26.317 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}] 2024-09-19T08:54:26.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f7544038790 msgr2=0x7f754403ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f7544038790 0x7f754403ac50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75480098c0 tx=0x7f7548006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 msgr2=0x7f7558194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f7558194cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7554005610 tx=0x7f7554005640 comp rx=0 tx=0).stop 2024-09-19T08:54:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 shutdown_connections 2024-09-19T08:54:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f7544038790 0x7f754403ac50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 --2- 172.21.15.49:0/3290690133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75580fe6e0 0x7f7558194cc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 >> 172.21.15.49:0/3290690133 conn(0x7f75580f9e90 msgr2=0x7f7558068340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 shutdown_connections 2024-09-19T08:54:26.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:26.320+0000 7f755fa7b640 1 -- 172.21.15.49:0/3290690133 wait complete. 2024-09-19T08:54:26.945 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:26 smithi049 ceph-mon[28158]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:27.093 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:54:27.094 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:54:27.297 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:54:28.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:27 smithi049 ceph-mon[28158]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:54:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:28 smithi049 ceph-mon[28158]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:30.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.358+0000 7fb9e760a640 1 -- 172.21.15.49:0/1430963775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 msgr2=0x7fb9e00ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.358+0000 7fb9e760a640 1 --2- 172.21.15.49:0/1430963775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e00ffbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009880 tx=0x7fb9dc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.358+0000 7fb9e760a640 1 -- 172.21.15.49:0/1430963775 shutdown_connections 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.358+0000 7fb9e760a640 1 --2- 172.21.15.49:0/1430963775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e00ffbe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.358+0000 7fb9e760a640 1 -- 172.21.15.49:0/1430963775 >> 172.21.15.49:0/1430963775 conn(0x7fb9e00faf90 msgr2=0x7fb9e00fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.358+0000 7fb9e760a640 1 -- 172.21.15.49:0/1430963775 shutdown_connections 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.358+0000 7fb9e760a640 1 -- 172.21.15.49:0/1430963775 wait complete. 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.359+0000 7fb9e760a640 1 Processor -- start 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.359+0000 7fb9e760a640 1 -- start start 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.359+0000 7fb9e760a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e0194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.359+0000 7fb9e760a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e01951d0 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.359+0000 7fb9e53a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e0194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.359+0000 7fb9e53a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e0194c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60836/0 (socket says 172.21.15.49:60836) 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.359+0000 7fb9e53a6640 1 -- 172.21.15.49:0/2129187235 learned_addr learned my addr 172.21.15.49:0/2129187235 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.360+0000 7fb9e53a6640 1 -- 172.21.15.49:0/2129187235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009560 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.360+0000 7fb9e53a6640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e0194c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc005610 tx=0x7fb9dc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.360+0000 7fb9d67fc640 1 -- 172.21.15.49:0/2129187235 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9dc004b20 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.360+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e01953d0 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.360+0000 7fb9d67fc640 1 -- 172.21.15.49:0/2129187235 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9dc004c80 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.360+0000 7fb9d67fc640 1 -- 172.21.15.49:0/2129187235 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9dc031a90 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.360+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e0195870 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.361+0000 7fb9d67fc640 1 -- 172.21.15.49:0/2129187235 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fb9dc031d50 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.361+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e00ffbe0 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.361+0000 7fb9d67fc640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb9cc038740 0x7fb9cc03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.361+0000 7fb9d67fc640 1 -- 172.21.15.49:0/2129187235 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb9dc06c4e0 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.361+0000 7fb9e4ba5640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb9cc038740 0x7fb9cc03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.362+0000 7fb9e4ba5640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb9cc038740 0x7fb9cc03ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00098c0 tx=0x7fb9d0006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:30.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.366+0000 7fb9d67fc640 1 -- 172.21.15.49:0/2129187235 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb9dc0443b0 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.541+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb9e018e610 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.889+0000 7fb9d67fc640 1 -- 172.21.15.49:0/2129187235 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb9dc035020 con 0x7fb9e00ff7e0 2024-09-19T08:54:30.889 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb9cc038740 msgr2=0x7fb9cc03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb9cc038740 0x7fb9cc03ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00098c0 tx=0x7fb9d0006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 msgr2=0x7fb9e0194c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e0194c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc005610 tx=0x7fb9dc005640 comp rx=0 tx=0).stop 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 shutdown_connections 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb9cc038740 0x7fb9cc03ac00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 --2- 172.21.15.49:0/2129187235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9e00ff7e0 0x7fb9e0194c90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 >> 172.21.15.49:0/2129187235 conn(0x7fb9e00faf90 msgr2=0x7fb9e00fb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:30.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 shutdown_connections 2024-09-19T08:54:30.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:54:30.891+0000 7fb9e760a640 1 -- 172.21.15.49:0/2129187235 wait complete. 2024-09-19T08:54:30.953 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:30 smithi049 ceph-mon[28158]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:30.953 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:30 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2129187235' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:54:31.512 INFO:tasks.cephadm:Adding mon.smithi049 on smithi049 2024-09-19T08:54:31.512 INFO:tasks.cephadm:Adding mon.smithi102 on smithi102 2024-09-19T08:54:31.512 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi049:172.21.15.49=smithi049;smithi102:172.21.15.102=smithi102' 2024-09-19T08:54:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:31.747 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:32.292 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:31 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2129187235' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:54:32.293 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:31 smithi049 ceph-mon[28158]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:54:33.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:32 smithi049 ceph-mon[28158]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 -- 172.21.15.102:0/2074248077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 msgr2=0x7fa9f00feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 --2- 172.21.15.102:0/2074248077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f00feaf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009880 tx=0x7fa9e002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 -- 172.21.15.102:0/2074248077 shutdown_connections 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 --2- 172.21.15.102:0/2074248077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f00feaf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 -- 172.21.15.102:0/2074248077 >> 172.21.15.102:0/2074248077 conn(0x7fa9f00f9e80 msgr2=0x7fa9f00fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 -- 172.21.15.102:0/2074248077 shutdown_connections 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 -- 172.21.15.102:0/2074248077 wait complete. 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.246+0000 7fa9f5314640 1 Processor -- start 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.247+0000 7fa9f5314640 1 -- start start 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.247+0000 7fa9f5314640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f0194d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.247+0000 7fa9f5314640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0195240 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.247+0000 7fa9eeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f0194d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.247+0000 7fa9eeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f0194d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:47980/0 (socket says 172.21.15.102:47980) 2024-09-19T08:54:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.247+0000 7fa9eeffd640 1 -- 172.21.15.102:0/4247636484 learned_addr learned my addr 172.21.15.102:0/4247636484 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:33.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.247+0000 7fa9eeffd640 1 -- 172.21.15.102:0/4247636484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009560 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.248+0000 7fa9eeffd640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f0194d00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0005610 tx=0x7fa9e0005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.248+0000 7fa9d7fff640 1 -- 172.21.15.102:0/4247636484 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9e0004b20 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.248+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f0195440 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.248+0000 7fa9d7fff640 1 -- 172.21.15.102:0/4247636484 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9e0004c80 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.248+0000 7fa9d7fff640 1 -- 172.21.15.102:0/4247636484 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9e0031a90 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.248+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01958e0 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.249+0000 7fa9d7fff640 1 -- 172.21.15.102:0/4247636484 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fa9e0031d50 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.249+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f00feaf0 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.249+0000 7fa9d7fff640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fa9d8038740 0x7fa9d803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.249+0000 7fa9d7fff640 1 -- 172.21.15.102:0/4247636484 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa9e006c4c0 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.249+0000 7fa9ee7fc640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fa9d8038740 0x7fa9d803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:33.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.250+0000 7fa9ee7fc640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fa9d8038740 0x7fa9d803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40098c0 tx=0x7fa9e4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.254+0000 7fa9d7fff640 1 -- 172.21.15.102:0/4247636484 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa9e00443b0 con 0x7fa9f00fe6f0 2024-09-19T08:54:33.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.424+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 --> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi049:172.21.15.49=smithi049;smithi102:172.21.15.102=smithi102", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9f0060a60 con 0x7fa9d8038740 2024-09-19T08:54:33.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.431+0000 7fa9d7fff640 1 -- 172.21.15.102:0/4247636484 <== mgr.14162 v2:172.21.15.49:6800/4115442638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa9f0060a60 con 0x7fa9d8038740 2024-09-19T08:54:33.431 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mon update... 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.432+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fa9d8038740 msgr2=0x7fa9d803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.432+0000 7fa9f5314640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fa9d8038740 0x7fa9d803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40098c0 tx=0x7fa9e4006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.432+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 msgr2=0x7fa9f0194d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.432+0000 7fa9f5314640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f0194d00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0005610 tx=0x7fa9e0005640 comp rx=0 tx=0).stop 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.433+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 shutdown_connections 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.433+0000 7fa9f5314640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fa9d8038740 0x7fa9d803ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.433+0000 7fa9f5314640 1 --2- 172.21.15.102:0/4247636484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9f00fe6f0 0x7fa9f0194d00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.433+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 >> 172.21.15.102:0/4247636484 conn(0x7fa9f00f9e80 msgr2=0x7fa9f0068360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.433+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 shutdown_connections 2024-09-19T08:54:33.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:33.433+0000 7fa9f5314640 1 -- 172.21.15.102:0/4247636484 wait complete. 2024-09-19T08:54:33.975 DEBUG:teuthology.orchestra.run.smithi102:mon.smithi102> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi102.service 2024-09-19T08:54:33.978 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:33.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:34.198 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:34.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:34 smithi049 ceph-mon[28158]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi049:172.21.15.49=smithi049;smithi102:172.21.15.102=smithi102", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:34.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:34 smithi049 ceph-mon[28158]: Saving service mon spec with placement smithi049:172.21.15.49=smithi049;smithi102:172.21.15.102=smithi102;count:2 2024-09-19T08:54:34.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:34 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:34.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:34 smithi049 ceph-mon[28158]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:35.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.678+0000 7fc749b2f640 1 -- 172.21.15.102:0/4093412290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 msgr2=0x7fc7440ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.678+0000 7fc749b2f640 1 --2- 172.21.15.102:0/4093412290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc7440ffbe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc734009880 tx=0x7fc73402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.679+0000 7fc749b2f640 1 -- 172.21.15.102:0/4093412290 shutdown_connections 2024-09-19T08:54:35.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.679+0000 7fc749b2f640 1 --2- 172.21.15.102:0/4093412290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc7440ffbe0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.679+0000 7fc749b2f640 1 -- 172.21.15.102:0/4093412290 >> 172.21.15.102:0/4093412290 conn(0x7fc7440faf90 msgr2=0x7fc7440fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:35.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.679+0000 7fc749b2f640 1 -- 172.21.15.102:0/4093412290 shutdown_connections 2024-09-19T08:54:35.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.679+0000 7fc749b2f640 1 -- 172.21.15.102:0/4093412290 wait complete. 2024-09-19T08:54:35.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.679+0000 7fc749b2f640 1 Processor -- start 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.679+0000 7fc749b2f640 1 -- start start 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.680+0000 7fc749b2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc744074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.680+0000 7fc749b2f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440746b0 con 0x7fc7440ff7e0 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.680+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc744074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.680+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc744074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:37134/0 (socket says 172.21.15.102:37134) 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.680+0000 7fc7437fe640 1 -- 172.21.15.102:0/2138341438 learned_addr learned my addr 172.21.15.102:0/2138341438 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.680+0000 7fc7437fe640 1 -- 172.21.15.102:0/2138341438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc734009560 con 0x7fc7440ff7e0 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.680+0000 7fc7437fe640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc744074170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7340055d0 tx=0x7fc734005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.681+0000 7fc740ff9640 1 -- 172.21.15.102:0/2138341438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc734004b60 con 0x7fc7440ff7e0 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.681+0000 7fc740ff9640 1 -- 172.21.15.102:0/2138341438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc734004cc0 con 0x7fc7440ff7e0 2024-09-19T08:54:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.681+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7440728a0 con 0x7fc7440ff7e0 2024-09-19T08:54:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.681+0000 7fc740ff9640 1 -- 172.21.15.102:0/2138341438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc734031a50 con 0x7fc7440ff7e0 2024-09-19T08:54:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.681+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc744072d40 con 0x7fc7440ff7e0 2024-09-19T08:54:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.681+0000 7fc740ff9640 1 -- 172.21.15.102:0/2138341438 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fc734031cc0 con 0x7fc7440ff7e0 2024-09-19T08:54:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.682+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc744105fd0 con 0x7fc7440ff7e0 2024-09-19T08:54:35.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.682+0000 7fc740ff9640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc72c038740 0x7fc72c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:35.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.682+0000 7fc740ff9640 1 -- 172.21.15.102:0/2138341438 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc73406c640 con 0x7fc7440ff7e0 2024-09-19T08:54:35.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.682+0000 7fc742ffd640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc72c038740 0x7fc72c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:35.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.682+0000 7fc742ffd640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc72c038740 0x7fc72c03ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098c0 tx=0x7fc738006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:35.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.687+0000 7fc740ff9640 1 -- 172.21.15.102:0/2138341438 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc73404d9a0 con 0x7fc7440ff7e0 2024-09-19T08:54:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.909+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc7440ffbe0 con 0x7fc7440ff7e0 2024-09-19T08:54:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.909+0000 7fc740ff9640 1 -- 172.21.15.102:0/2138341438 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc734035070 con 0x7fc7440ff7e0 2024-09-19T08:54:35.910 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:54:35.910 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:54:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc72c038740 msgr2=0x7fc72c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc72c038740 0x7fc72c03ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098c0 tx=0x7fc738006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 msgr2=0x7fc744074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc744074170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7340055d0 tx=0x7fc734005600 comp rx=0 tx=0).stop 2024-09-19T08:54:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 shutdown_connections 2024-09-19T08:54:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fc72c038740 0x7fc72c03ac00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 --2- 172.21.15.102:0/2138341438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7440ff7e0 0x7fc744074170 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 >> 172.21.15.102:0/2138341438 conn(0x7fc7440faf90 msgr2=0x7fc7440fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 shutdown_connections 2024-09-19T08:54:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:35.911+0000 7fc749b2f640 1 -- 172.21.15.102:0/2138341438 wait complete. 2024-09-19T08:54:36.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: Deploying daemon grafana.smithi049 on smithi049 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:35 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/2138341438' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:37.464 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:37.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:39.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.108+0000 7ff2c8353640 1 -- 172.21.15.102:0/3808005077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 msgr2=0x7ff2c00feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.108+0000 7ff2c8353640 1 --2- 172.21.15.102:0/3808005077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c00feae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009880 tx=0x7ff2bc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 -- 172.21.15.102:0/3808005077 shutdown_connections 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 --2- 172.21.15.102:0/3808005077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c00feae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 -- 172.21.15.102:0/3808005077 >> 172.21.15.102:0/3808005077 conn(0x7ff2c00f9e90 msgr2=0x7ff2c00fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 -- 172.21.15.102:0/3808005077 shutdown_connections 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 -- 172.21.15.102:0/3808005077 wait complete. 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 Processor -- start 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 -- start start 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c0192ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.109+0000 7ff2c8353640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0192ff0 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2c60ef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c0192ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2c60ef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c0192ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:37158/0 (socket says 172.21.15.102:37158) 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2c60ef640 1 -- 172.21.15.102:0/2323716332 learned_addr learned my addr 172.21.15.102:0/2323716332 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2c60ef640 1 -- 172.21.15.102:0/2323716332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc009560 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2c60ef640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c0192ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc005610 tx=0x7ff2bc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2b77fe640 1 -- 172.21.15.102:0/2323716332 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2bc004b20 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c01931f0 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2b77fe640 1 -- 172.21.15.102:0/2323716332 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2bc004c80 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c0193690 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.110+0000 7ff2b77fe640 1 -- 172.21.15.102:0/2323716332 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2bc031930 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.111+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c00feae0 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.111+0000 7ff2b77fe640 1 -- 172.21.15.102:0/2323716332 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7ff2bc031a90 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.112+0000 7ff2b77fe640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff2ac03a990 0x7ff2ac03ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.112+0000 7ff2b77fe640 1 -- 172.21.15.102:0/2323716332 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff2bc06c6b0 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.112+0000 7ff2c58ee640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff2ac03a990 0x7ff2ac03ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.112+0000 7ff2c58ee640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff2ac03a990 0x7ff2ac03ce50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00098c0 tx=0x7ff2b0006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.119+0000 7ff2b77fe640 1 -- 172.21.15.102:0/2323716332 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2bc0437d0 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:38 smithi049 ceph-mon[28158]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:39.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.342+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff2c002c3e0 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.343+0000 7ff2b77fe640 1 -- 172.21.15.102:0/2323716332 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff2bc035030 con 0x7ff2c00fe6e0 2024-09-19T08:54:39.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:54:39.343 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:39.343 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff2ac03a990 msgr2=0x7ff2ac03ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff2ac03a990 0x7ff2ac03ce50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00098c0 tx=0x7ff2b0006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 msgr2=0x7ff2c0192ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c0192ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc005610 tx=0x7ff2bc005640 comp rx=0 tx=0).stop 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 shutdown_connections 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7ff2ac03a990 0x7ff2ac03ce50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 --2- 172.21.15.102:0/2323716332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2c00fe6e0 0x7ff2c0192ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 >> 172.21.15.102:0/2323716332 conn(0x7ff2c00f9e90 msgr2=0x7ff2c00fa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 shutdown_connections 2024-09-19T08:54:39.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:39.345+0000 7ff2c8353640 1 -- 172.21.15.102:0/2323716332 wait complete. 2024-09-19T08:54:40.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:39 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/2323716332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:40.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:39 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:40.883 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:40.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:41.086 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:41.130 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:41.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:40 smithi049 ceph-mon[28158]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:42.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 -- 172.21.15.102:0/783221641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 msgr2=0x7fe6f8100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 --2- 172.21.15.102:0/783221641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f8100480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009880 tx=0x7fe6f402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 -- 172.21.15.102:0/783221641 shutdown_connections 2024-09-19T08:54:42.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 --2- 172.21.15.102:0/783221641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f8100480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 -- 172.21.15.102:0/783221641 >> 172.21.15.102:0/783221641 conn(0x7fe6f80f9e80 msgr2=0x7fe6f80fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 -- 172.21.15.102:0/783221641 shutdown_connections 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 -- 172.21.15.102:0/783221641 wait complete. 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 Processor -- start 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.599+0000 7fe700261640 1 -- start start 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe700261640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f819b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe700261640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f819b800 con 0x7fe6f80fe070 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe6fdffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f819b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe6fdffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f819b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:37174/0 (socket says 172.21.15.102:37174) 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe6fdffd640 1 -- 172.21.15.102:0/4051693924 learned_addr learned my addr 172.21.15.102:0/4051693924 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe6fdffd640 1 -- 172.21.15.102:0/4051693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009560 con 0x7fe6f80fe070 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe6fdffd640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f819b2c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4006010 tx=0x7fe6f4005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe6eeffd640 1 -- 172.21.15.102:0/4051693924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f4004aa0 con 0x7fe6f80fe070 2024-09-19T08:54:42.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f819ba00 con 0x7fe6f80fe070 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.600+0000 7fe6eeffd640 1 -- 172.21.15.102:0/4051693924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6f4004c00 con 0x7fe6f80fe070 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.601+0000 7fe6eeffd640 1 -- 172.21.15.102:0/4051693924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f4031a80 con 0x7fe6f80fe070 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.601+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f819bea0 con 0x7fe6f80fe070 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.601+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f80fe470 con 0x7fe6f80fe070 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.601+0000 7fe6eeffd640 1 -- 172.21.15.102:0/4051693924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fe6f4031d40 con 0x7fe6f80fe070 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.602+0000 7fe6eeffd640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fe6e4038740 0x7fe6e403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.602+0000 7fe6eeffd640 1 -- 172.21.15.102:0/4051693924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe6f406c5c0 con 0x7fe6f80fe070 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.602+0000 7fe6fd7fc640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fe6e4038740 0x7fe6e403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.602+0000 7fe6fd7fc640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fe6e4038740 0x7fe6e403ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098c0 tx=0x7fe6e8006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:42.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.606+0000 7fe6eeffd640 1 -- 172.21.15.102:0/4051693924 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe6f404d9a0 con 0x7fe6f80fe070 2024-09-19T08:54:42.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.834+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe6f81952d0 con 0x7fe6f80fe070 2024-09-19T08:54:42.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.835+0000 7fe6eeffd640 1 -- 172.21.15.102:0/4051693924 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe6f4035070 con 0x7fe6f80fe070 2024-09-19T08:54:42.835 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:54:42.835 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:42.835 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:54:42.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fe6e4038740 msgr2=0x7fe6e403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fe6e4038740 0x7fe6e403ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098c0 tx=0x7fe6e8006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 msgr2=0x7fe6f819b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f819b2c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4006010 tx=0x7fe6f4005630 comp rx=0 tx=0).stop 2024-09-19T08:54:42.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 shutdown_connections 2024-09-19T08:54:42.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fe6e4038740 0x7fe6e403ac00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 --2- 172.21.15.102:0/4051693924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80fe070 0x7fe6f819b2c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 >> 172.21.15.102:0/4051693924 conn(0x7fe6f80f9e80 msgr2=0x7fe6f80fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:42.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 shutdown_connections 2024-09-19T08:54:42.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:42.837+0000 7fe700261640 1 -- 172.21.15.102:0/4051693924 wait complete. 2024-09-19T08:54:42.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:42 smithi049 ceph-mon[28158]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:42.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:42 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/4051693924' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:44.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:43 smithi049 ceph-mon[28158]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:44.413 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:44.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.078+0000 7f2e56276640 1 -- 172.21.15.102:0/2483930456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 msgr2=0x7f2e500feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.078+0000 7f2e56276640 1 --2- 172.21.15.102:0/2483930456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e500feae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009880 tx=0x7f2e4002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.078+0000 7f2e56276640 1 -- 172.21.15.102:0/2483930456 shutdown_connections 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.078+0000 7f2e56276640 1 --2- 172.21.15.102:0/2483930456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e500feae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.078+0000 7f2e56276640 1 -- 172.21.15.102:0/2483930456 >> 172.21.15.102:0/2483930456 conn(0x7f2e500f9e90 msgr2=0x7f2e500fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.078+0000 7f2e56276640 1 -- 172.21.15.102:0/2483930456 shutdown_connections 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.078+0000 7f2e56276640 1 -- 172.21.15.102:0/2483930456 wait complete. 2024-09-19T08:54:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e56276640 1 Processor -- start 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e56276640 1 -- start start 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e56276640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e5018b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e56276640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5018bdc0 con 0x7f2e500fe6e0 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e4ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e5018b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e4ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e5018b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:58884/0 (socket says 172.21.15.102:58884) 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e4ffff640 1 -- 172.21.15.102:0/10147215 learned_addr learned my addr 172.21.15.102:0/10147215 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e4ffff640 1 -- 172.21.15.102:0/10147215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009560 con 0x7f2e500fe6e0 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.079+0000 7f2e4ffff640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e5018b880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e40005610 tx=0x7f2e40005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.080+0000 7f2e4dffb640 1 -- 172.21.15.102:0/10147215 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e40004b20 con 0x7f2e500fe6e0 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.080+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e50189fb0 con 0x7f2e500fe6e0 2024-09-19T08:54:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.080+0000 7f2e4dffb640 1 -- 172.21.15.102:0/10147215 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e40004c80 con 0x7f2e500fe6e0 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.080+0000 7f2e4dffb640 1 -- 172.21.15.102:0/10147215 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e40031a90 con 0x7f2e500fe6e0 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.080+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5018a450 con 0x7f2e500fe6e0 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.080+0000 7f2e4dffb640 1 -- 172.21.15.102:0/10147215 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f2e40031d50 con 0x7f2e500fe6e0 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.081+0000 7f2e4dffb640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2e3c038740 0x7f2e3c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.081+0000 7f2e4dffb640 1 -- 172.21.15.102:0/10147215 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2e4006c580 con 0x7f2e500fe6e0 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.081+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e500feae0 con 0x7f2e500fe6e0 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.081+0000 7f2e47fff640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2e3c038740 0x7f2e3c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.081+0000 7f2e47fff640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2e3c038740 0x7f2e3c03ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e380098c0 tx=0x7f2e38006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.086+0000 7f2e4dffb640 1 -- 172.21.15.102:0/10147215 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e40035020 con 0x7f2e500fe6e0 2024-09-19T08:54:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.306+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2e501045b0 con 0x7f2e500fe6e0 2024-09-19T08:54:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.307+0000 7f2e4dffb640 1 -- 172.21.15.102:0/10147215 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2e40035300 con 0x7f2e500fe6e0 2024-09-19T08:54:46.307 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:54:46.308 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:54:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2e3c038740 msgr2=0x7f2e3c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2e3c038740 0x7f2e3c03ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e380098c0 tx=0x7f2e38006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 msgr2=0x7f2e5018b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e5018b880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e40005610 tx=0x7f2e40005640 comp rx=0 tx=0).stop 2024-09-19T08:54:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 shutdown_connections 2024-09-19T08:54:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f2e3c038740 0x7f2e3c03ac00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 --2- 172.21.15.102:0/10147215 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e500fe6e0 0x7f2e5018b880 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 >> 172.21.15.102:0/10147215 conn(0x7f2e500f9e90 msgr2=0x7f2e500faa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 shutdown_connections 2024-09-19T08:54:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:46.309+0000 7f2e56276640 1 -- 172.21.15.102:0/10147215 wait complete. 2024-09-19T08:54:46.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:46.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:46.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:46 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/10147215' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:47.874 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:47.874 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:48.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:47 smithi049 ceph-mon[28158]: Deploying daemon prometheus.smithi049 on smithi049 2024-09-19T08:54:48.068 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:48.112 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:49.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:48 smithi049 ceph-mon[28158]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:49.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.491+0000 7f7848d45640 1 -- 172.21.15.102:0/987254372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 msgr2=0x7f7844101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.491+0000 7f7848d45640 1 --2- 172.21.15.102:0/987254372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844101df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f783c009880 tx=0x7f783c02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.491+0000 7f7848d45640 1 -- 172.21.15.102:0/987254372 shutdown_connections 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.491+0000 7f7848d45640 1 --2- 172.21.15.102:0/987254372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844101df0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.491+0000 7f7848d45640 1 -- 172.21.15.102:0/987254372 >> 172.21.15.102:0/987254372 conn(0x7f78440fd1a0 msgr2=0x7f78440ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.491+0000 7f7848d45640 1 -- 172.21.15.102:0/987254372 shutdown_connections 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.491+0000 7f7848d45640 1 -- 172.21.15.102:0/987254372 wait complete. 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.492+0000 7f7848d45640 1 Processor -- start 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.492+0000 7f7848d45640 1 -- start start 2024-09-19T08:54:49.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.492+0000 7f7848d45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:49.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.492+0000 7f7848d45640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7844197440 con 0x7f78441019f0 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.492+0000 7f784259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.492+0000 7f784259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:58908/0 (socket says 172.21.15.102:58908) 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.492+0000 7f784259c640 1 -- 172.21.15.102:0/2716654183 learned_addr learned my addr 172.21.15.102:0/2716654183 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:49.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.493+0000 7f784259c640 1 -- 172.21.15.102:0/2716654183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c009560 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.493+0000 7f784259c640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844196f00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f783c005610 tx=0x7f783c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.493+0000 7f78337fe640 1 -- 172.21.15.102:0/2716654183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f783c004b20 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.493+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7844197640 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.493+0000 7f78337fe640 1 -- 172.21.15.102:0/2716654183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f783c004c80 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.493+0000 7f78337fe640 1 -- 172.21.15.102:0/2716654183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f783c031a90 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.493+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7844197ae0 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.494+0000 7f78337fe640 1 -- 172.21.15.102:0/2716654183 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f783c031d50 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.494+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7844101df0 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.494+0000 7f78337fe640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f782c038740 0x7f782c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.494+0000 7f78337fe640 1 -- 172.21.15.102:0/2716654183 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f783c06c7c0 con 0x7f78441019f0 2024-09-19T08:54:49.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.494+0000 7f7841d9b640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f782c038740 0x7f782c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:49.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.495+0000 7f7841d9b640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f782c038740 0x7f782c03ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f783800ad30 tx=0x7f78380093f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:49.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.500+0000 7f78337fe640 1 -- 172.21.15.102:0/2716654183 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f783c0443b0 con 0x7f78441019f0 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.723+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f784402c3e0 con 0x7f78441019f0 2024-09-19T08:54:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.723+0000 7f78337fe640 1 -- 172.21.15.102:0/2716654183 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f783c035030 con 0x7f78441019f0 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:54:49.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.726+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f782c038740 msgr2=0x7f782c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.726+0000 7f7848d45640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f782c038740 0x7f782c03ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f783800ad30 tx=0x7f78380093f0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.726+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 msgr2=0x7f7844196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.726+0000 7f7848d45640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844196f00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f783c005610 tx=0x7f783c005640 comp rx=0 tx=0).stop 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.727+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 shutdown_connections 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.727+0000 7f7848d45640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f782c038740 0x7f782c03ac00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.727+0000 7f7848d45640 1 --2- 172.21.15.102:0/2716654183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78441019f0 0x7f7844196f00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.727+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 >> 172.21.15.102:0/2716654183 conn(0x7f78440fd1a0 msgr2=0x7f78440fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.727+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 shutdown_connections 2024-09-19T08:54:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:49.727+0000 7f7848d45640 1 -- 172.21.15.102:0/2716654183 wait complete. 2024-09-19T08:54:50.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:49 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/2716654183' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:51.270 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:51.270 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:51.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:50 smithi049 ceph-mon[28158]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:51.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:50 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:51.516 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:52.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 -- 172.21.15.102:0/2978827456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 msgr2=0x7fb1b80fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 --2- 172.21.15.102:0/2978827456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b80fe4b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009c20 tx=0x7fb1a802aa90 comp rx=0 tx=0).stop 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 -- 172.21.15.102:0/2978827456 shutdown_connections 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 --2- 172.21.15.102:0/2978827456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b80fe4b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 -- 172.21.15.102:0/2978827456 >> 172.21.15.102:0/2978827456 conn(0x7fb1b80f9e80 msgr2=0x7fb1b80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 -- 172.21.15.102:0/2978827456 shutdown_connections 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 -- 172.21.15.102:0/2978827456 wait complete. 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 Processor -- start 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 -- start start 2024-09-19T08:54:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b8196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.912+0000 7fb1bf887640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81974d0 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.913+0000 7fb1bd623640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b8196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.913+0000 7fb1bd623640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b8196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:58926/0 (socket says 172.21.15.102:58926) 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.913+0000 7fb1bd623640 1 -- 172.21.15.102:0/259113738 learned_addr learned my addr 172.21.15.102:0/259113738 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.913+0000 7fb1bd623640 1 -- 172.21.15.102:0/259113738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8009900 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.913+0000 7fb1bd623640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b8196f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1a802f040 tx=0x7fb1a802f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.914+0000 7fb1b67fc640 1 -- 172.21.15.102:0/259113738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1a803e070 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.914+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b81976d0 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.914+0000 7fb1b67fc640 1 -- 172.21.15.102:0/259113738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1a802fbf0 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.914+0000 7fb1b67fc640 1 -- 172.21.15.102:0/259113738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1a8004710 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.914+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8197b70 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.915+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b80fe530 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.915+0000 7fb1b67fc640 1 -- 172.21.15.102:0/259113738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fb1a800a040 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.915+0000 7fb1b67fc640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb1a0038740 0x7fb1a003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.915+0000 7fb1b67fc640 1 -- 172.21.15.102:0/259113738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb1a806c4c0 con 0x7fb1b80fe0b0 2024-09-19T08:54:52.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.915+0000 7fb1bce22640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb1a0038740 0x7fb1a003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.916+0000 7fb1bce22640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb1a0038740 0x7fb1a003ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0098c0 tx=0x7fb1ac006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:52.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:52.920+0000 7fb1b67fc640 1 -- 172.21.15.102:0/259113738 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb1a80423d0 con 0x7fb1b80fe0b0 2024-09-19T08:54:53.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:52 smithi049 ceph-mon[28158]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:53.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.146+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb1b81907f0 con 0x7fb1b80fe0b0 2024-09-19T08:54:53.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.146+0000 7fb1b67fc640 1 -- 172.21.15.102:0/259113738 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb1a8048020 con 0x7fb1b80fe0b0 2024-09-19T08:54:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:54:53.147 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:53.147 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:54:53.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb1a0038740 msgr2=0x7fb1a003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb1a0038740 0x7fb1a003ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0098c0 tx=0x7fb1ac006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 msgr2=0x7fb1b8196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b8196f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1a802f040 tx=0x7fb1a802f8a0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 shutdown_connections 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fb1a0038740 0x7fb1a003ac00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 --2- 172.21.15.102:0/259113738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1b80fe0b0 0x7fb1b8196f90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.148+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 >> 172.21.15.102:0/259113738 conn(0x7fb1b80f9e80 msgr2=0x7fb1b80fa940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.149+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 shutdown_connections 2024-09-19T08:54:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:53.149+0000 7fb1bf887640 1 -- 172.21.15.102:0/259113738 wait complete. 2024-09-19T08:54:54.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:53 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/259113738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:54.717 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:54.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:54.911 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:54.955 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:55.241 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:54 smithi049 ceph-mon[28158]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:56.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.325+0000 7f823697b640 1 -- 172.21.15.102:0/3252634474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 msgr2=0x7f82300feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.325+0000 7f823697b640 1 --2- 172.21.15.102:0/3252634474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82300feae0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8220009880 tx=0x7f822002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.325+0000 7f823697b640 1 -- 172.21.15.102:0/3252634474 shutdown_connections 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.325+0000 7f823697b640 1 --2- 172.21.15.102:0/3252634474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82300feae0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.325+0000 7f823697b640 1 -- 172.21.15.102:0/3252634474 >> 172.21.15.102:0/3252634474 conn(0x7f82300f9e90 msgr2=0x7f82300fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.325+0000 7f823697b640 1 -- 172.21.15.102:0/3252634474 shutdown_connections 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.325+0000 7f823697b640 1 -- 172.21.15.102:0/3252634474 wait complete. 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f823697b640 1 Processor -- start 2024-09-19T08:54:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f823697b640 1 -- start start 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f823697b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82301045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f823697b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8230104ae0 con 0x7f82300fe6e0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f822ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82301045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f822ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82301045a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:55088/0 (socket says 172.21.15.102:55088) 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f822ffff640 1 -- 172.21.15.102:0/3049867391 learned_addr learned my addr 172.21.15.102:0/3049867391 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.326+0000 7f822ffff640 1 -- 172.21.15.102:0/3049867391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220009560 con 0x7f82300fe6e0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.327+0000 7f822ffff640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82301045a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8220005610 tx=0x7f8220005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.327+0000 7f822d7fa640 1 -- 172.21.15.102:0/3049867391 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8220004b20 con 0x7f82300fe6e0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.327+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8230102cd0 con 0x7f82300fe6e0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.327+0000 7f822d7fa640 1 -- 172.21.15.102:0/3049867391 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8220004c80 con 0x7f82300fe6e0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.327+0000 7f822d7fa640 1 -- 172.21.15.102:0/3049867391 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8220031a90 con 0x7f82300fe6e0 2024-09-19T08:54:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.327+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8230103170 con 0x7f82300fe6e0 2024-09-19T08:54:56.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.328+0000 7f822d7fa640 1 -- 172.21.15.102:0/3049867391 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f8220031d50 con 0x7f82300fe6e0 2024-09-19T08:54:56.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.328+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8230105fd0 con 0x7f82300fe6e0 2024-09-19T08:54:56.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.328+0000 7f822d7fa640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8218038740 0x7f821803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.328+0000 7f822d7fa640 1 -- 172.21.15.102:0/3049867391 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f822006c4c0 con 0x7f82300fe6e0 2024-09-19T08:54:56.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.328+0000 7f822f7fe640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8218038740 0x7f821803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.329+0000 7f822f7fe640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8218038740 0x7f821803ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f82240098c0 tx=0x7f8224006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.333+0000 7f822d7fa640 1 -- 172.21.15.102:0/3049867391 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f82200443b0 con 0x7f82300fe6e0 2024-09-19T08:54:56.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.554+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f82300feae0 con 0x7f82300fe6e0 2024-09-19T08:54:56.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.555+0000 7f822d7fa640 1 -- 172.21.15.102:0/3049867391 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8220035070 con 0x7f82300fe6e0 2024-09-19T08:54:56.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:54:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:54:56.556 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:54:56.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8218038740 msgr2=0x7f821803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8218038740 0x7f821803ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f82240098c0 tx=0x7f8224006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 msgr2=0x7f82301045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82301045a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8220005610 tx=0x7f8220005640 comp rx=0 tx=0).stop 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 shutdown_connections 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7f8218038740 0x7f821803ac00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 --2- 172.21.15.102:0/3049867391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82300fe6e0 0x7f82301045a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 >> 172.21.15.102:0/3049867391 conn(0x7f82300f9e90 msgr2=0x7f82300fa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 shutdown_connections 2024-09-19T08:54:56.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:56.557+0000 7f823697b640 1 -- 172.21.15.102:0/3049867391 wait complete. 2024-09-19T08:54:57.226 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:56 smithi049 ceph-mon[28158]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:54:57.226 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:56 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:57.226 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:56 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:57.226 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:56 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' 2024-09-19T08:54:57.226 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:56 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-19T08:54:57.226 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:56 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/3049867391' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:54:58.164 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:54:58.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:54:58.358 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:58.373 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:58 smithi049 ceph-mon[28158]: from='mgr.14162 172.21.15.49:0/3475617498' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-19T08:54:58.373 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:54:58 smithi049 ceph-mon[28158]: mgrmap e14: smithi049.qdvksw(active, since 57s) 2024-09-19T08:54:58.401 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.843+0000 7fee7d8e8640 1 -- 172.21.15.102:0/3025777061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 msgr2=0x7fee780fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.843+0000 7fee7d8e8640 1 --2- 172.21.15.102:0/3025777061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fead0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee70009c20 tx=0x7fee7002aa90 comp rx=0 tx=0).stop 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.843+0000 7fee7d8e8640 1 -- 172.21.15.102:0/3025777061 shutdown_connections 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.843+0000 7fee7d8e8640 1 --2- 172.21.15.102:0/3025777061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fead0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.843+0000 7fee7d8e8640 1 -- 172.21.15.102:0/3025777061 >> 172.21.15.102:0/3025777061 conn(0x7fee780f9e80 msgr2=0x7fee780fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.843+0000 7fee7d8e8640 1 -- 172.21.15.102:0/3025777061 shutdown_connections 2024-09-19T08:54:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.843+0000 7fee7d8e8640 1 -- 172.21.15.102:0/3025777061 wait complete. 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.844+0000 7fee7d8e8640 1 Processor -- start 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.844+0000 7fee7d8e8640 1 -- start start 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.844+0000 7fee7d8e8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.844+0000 7fee7d8e8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780fc230 con 0x7fee780fe6d0 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.844+0000 7fee76ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.844+0000 7fee76ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:55098/0 (socket says 172.21.15.102:55098) 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.844+0000 7fee76ffd640 1 -- 172.21.15.102:0/1622611087 learned_addr learned my addr 172.21.15.102:0/1622611087 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.845+0000 7fee76ffd640 1 -- 172.21.15.102:0/1622611087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70009900 con 0x7fee780fe6d0 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.845+0000 7fee76ffd640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fbcf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee700098d0 tx=0x7fee7002f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.845+0000 7fee7c8e6640 1 -- 172.21.15.102:0/1622611087 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee7003e070 con 0x7fee780fe6d0 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.845+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee780fa420 con 0x7fee780fe6d0 2024-09-19T08:54:59.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.845+0000 7fee7c8e6640 1 -- 172.21.15.102:0/1622611087 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee7002fbc0 con 0x7fee780fe6d0 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.845+0000 7fee7c8e6640 1 -- 172.21.15.102:0/1622611087 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee70004880 con 0x7fee780fe6d0 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.845+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee780fa8c0 con 0x7fee780fe6d0 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.846+0000 7fee7c8e6640 1 -- 172.21.15.102:0/1622611087 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7fee7000a040 con 0x7fee780fe6d0 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.846+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78104ec0 con 0x7fee780fe6d0 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.846+0000 7fee7c8e6640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 0x7fee6403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.846+0000 7fee7c8e6640 1 -- 172.21.15.102:0/1622611087 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fee7006c1d0 con 0x7fee780fe6d0 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.846+0000 7fee767fc640 1 -- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 msgr2=0x7fee6403ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/4115442638 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.846+0000 7fee767fc640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 0x7fee6403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:54:59.851+0000 7fee7c8e6640 1 -- 172.21.15.102:0/1622611087 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fee7002e3c0 con 0x7fee780fe6d0 2024-09-19T08:55:00.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.047+0000 7fee767fc640 1 -- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 msgr2=0x7fee6403ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/4115442638 2024-09-19T08:55:00.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.047+0000 7fee767fc640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 0x7fee6403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:55:00.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.075+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fee780feb50 con 0x7fee780fe6d0 2024-09-19T08:55:00.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.076+0000 7fee7c8e6640 1 -- 172.21.15.102:0/1622611087 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fee70047300 con 0x7fee780fe6d0 2024-09-19T08:55:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:00.076 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:00.076 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 msgr2=0x7fee6403ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 0x7fee6403ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 msgr2=0x7fee780fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fbcf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fee700098d0 tx=0x7fee7002f8a0 comp rx=0 tx=0).stop 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 shutdown_connections 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:6800/4115442638,v1:172.21.15.49:6801/4115442638] conn(0x7fee64038790 0x7fee6403ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 --2- 172.21.15.102:0/1622611087 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee780fe6d0 0x7fee780fbcf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 >> 172.21.15.102:0/1622611087 conn(0x7fee780f9e80 msgr2=0x7fee78067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:00.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 shutdown_connections 2024-09-19T08:55:00.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:00.078+0000 7fee7d8e8640 1 -- 172.21.15.102:0/1622611087 wait complete. 2024-09-19T08:55:00.353 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:00 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/1622611087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:01.641 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:55:01.641 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:01.833 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:55:01.877 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:55:02.272 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: Active manager daemon smithi049.qdvksw restarted 2024-09-19T08:55:02.272 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: Activating manager daemon smithi049.qdvksw 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: mgrmap e15: smithi049.qdvksw(active, starting, since 0.00325386s) 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: Manager daemon smithi049.qdvksw is now available 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:02.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:55:03.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:03 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:55:03.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:03 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T08:55:03.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:03 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:03.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:03 smithi049 ceph-mon[28158]: mgrmap e16: smithi049.qdvksw(active, since 1.00661s) 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 -- 172.21.15.102:0/3995549498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 msgr2=0x7efdc00fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 --2- 172.21.15.102:0/3995549498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc00fead0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009880 tx=0x7efdb402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 -- 172.21.15.102:0/3995549498 shutdown_connections 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 --2- 172.21.15.102:0/3995549498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc00fead0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 -- 172.21.15.102:0/3995549498 >> 172.21.15.102:0/3995549498 conn(0x7efdc00f9e80 msgr2=0x7efdc00fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 -- 172.21.15.102:0/3995549498 shutdown_connections 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 -- 172.21.15.102:0/3995549498 wait complete. 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 Processor -- start 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.358+0000 7efdc6be6640 1 -- start start 2024-09-19T08:55:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.359+0000 7efdc6be6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc0194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.359+0000 7efdc6be6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc0195280 con 0x7efdc00fe6d0 2024-09-19T08:55:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.359+0000 7efdc4982640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc0194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.359+0000 7efdc4982640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc0194d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:55120/0 (socket says 172.21.15.102:55120) 2024-09-19T08:55:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.359+0000 7efdc4982640 1 -- 172.21.15.102:0/962960523 learned_addr learned my addr 172.21.15.102:0/962960523 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:55:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.359+0000 7efdc4982640 1 -- 172.21.15.102:0/962960523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4009560 con 0x7efdc00fe6d0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.359+0000 7efdc4982640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc0194d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009230 tx=0x7efdb40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.360+0000 7efdbdffb640 1 -- 172.21.15.102:0/962960523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdb4004aa0 con 0x7efdc00fe6d0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.360+0000 7efdbdffb640 1 -- 172.21.15.102:0/962960523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb4004c00 con 0x7efdc00fe6d0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.360+0000 7efdbdffb640 1 -- 172.21.15.102:0/962960523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdb4031a60 con 0x7efdc00fe6d0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.360+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc0195480 con 0x7efdc00fe6d0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.360+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc0195920 con 0x7efdc00fe6d0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.361+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc00fead0 con 0x7efdc00fe6d0 2024-09-19T08:55:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.361+0000 7efdbdffb640 1 -- 172.21.15.102:0/962960523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 16) v1 ==== 45477+0+0 (secure 0 0 0) 0x7efdb4031bc0 con 0x7efdc00fe6d0 2024-09-19T08:55:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.361+0000 7efdbdffb640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7efdb0038610 0x7efdb003aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.361+0000 7efdbdffb640 1 -- 172.21.15.102:0/962960523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7efdb406c2d0 con 0x7efdc00fe6d0 2024-09-19T08:55:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.361+0000 7efdbffff640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7efdb0038610 0x7efdb003aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.362+0000 7efdbffff640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7efdb0038610 0x7efdb003aad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efdac0098c0 tx=0x7efdac006db0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.366+0000 7efdbdffb640 1 -- 172.21.15.102:0/962960523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efdb404d7c0 con 0x7efdc00fe6d0 2024-09-19T08:55:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.602+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efdc018e510 con 0x7efdc00fe6d0 2024-09-19T08:55:03.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.603+0000 7efdbdffb640 1 -- 172.21.15.102:0/962960523 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7efdb4035090 con 0x7efdc00fe6d0 2024-09-19T08:55:03.603 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:03.604 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:03.604 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:55:03.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7efdb0038610 msgr2=0x7efdb003aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:03.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7efdb0038610 0x7efdb003aad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efdac0098c0 tx=0x7efdac006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:03.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 msgr2=0x7efdc0194d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:03.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc0194d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009230 tx=0x7efdb40056e0 comp rx=0 tx=0).stop 2024-09-19T08:55:03.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 shutdown_connections 2024-09-19T08:55:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7efdb0038610 0x7efdb003aad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 --2- 172.21.15.102:0/962960523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efdc00fe6d0 0x7efdc0194d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 >> 172.21.15.102:0/962960523 conn(0x7efdc00f9e80 msgr2=0x7efdc0067dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 shutdown_connections 2024-09-19T08:55:03.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:03.605+0000 7efdc6be6640 1 -- 172.21.15.102:0/962960523 wait complete. 2024-09-19T08:55:04.502 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:04.502 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:04 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/962960523' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:04.502 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:04 smithi049 ceph-mon[28158]: [19/Sep/2024:08:55:04] ENGINE Bus STARTING 2024-09-19T08:55:04.502 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:05.196 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:55:05.196 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:05.385 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:05 smithi049 ceph-mon[28158]: [19/Sep/2024:08:55:04] ENGINE Serving on https://172.21.15.49:7150 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:05 smithi049 ceph-mon[28158]: [19/Sep/2024:08:55:04] ENGINE Error in HTTPServer.serve 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Traceback (most recent call last): 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._run(expiration_interval) 2024-09-19T08:55:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s = self.context.wrap_socket( 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: return self.sslsocket_class._create( 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self.do_handshake() 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._sslobj.do_handshake() 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:55:05.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:05 smithi049 ceph-mon[28158]: [19/Sep/2024:08:55:04] ENGINE Serving on http://172.21.15.49:8765 2024-09-19T08:55:05.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:05 smithi049 ceph-mon[28158]: [19/Sep/2024:08:55:04] ENGINE Bus STARTED 2024-09-19T08:55:05.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:05 smithi049 ceph-mon[28158]: mgrmap e17: smithi049.qdvksw(active, since 2s) 2024-09-19T08:55:05.816 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:55:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T08:55:07.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:07 smithi049 ceph-mon[28158]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T08:55:08.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.077+0000 7f520dc7e640 1 -- 172.21.15.102:0/975111147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 msgr2=0x7f5208100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.077+0000 7f520dc7e640 1 --2- 172.21.15.102:0/975111147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208100e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009880 tx=0x7f51f802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.077+0000 7f520dc7e640 1 -- 172.21.15.102:0/975111147 shutdown_connections 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.077+0000 7f520dc7e640 1 --2- 172.21.15.102:0/975111147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208100e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.077+0000 7f520dc7e640 1 -- 172.21.15.102:0/975111147 >> 172.21.15.102:0/975111147 conn(0x7f52080fa440 msgr2=0x7f52080fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.077+0000 7f520dc7e640 1 -- 172.21.15.102:0/975111147 shutdown_connections 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.077+0000 7f520dc7e640 1 -- 172.21.15.102:0/975111147 wait complete. 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.078+0000 7f520dc7e640 1 Processor -- start 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.078+0000 7f520dc7e640 1 -- start start 2024-09-19T08:55:08.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.078+0000 7f520dc7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208195160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.078+0000 7f520dc7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081956a0 con 0x7f5208100a60 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.078+0000 7f52077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208195160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f52077fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208195160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:60428/0 (socket says 172.21.15.102:60428) 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f52077fe640 1 -- 172.21.15.102:0/1822891900 learned_addr learned my addr 172.21.15.102:0/1822891900 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f52077fe640 1 -- 172.21.15.102:0/1822891900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009560 con 0x7f5208100a60 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f52077fe640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208195160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009230 tx=0x7f51f80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f5204ff9640 1 -- 172.21.15.102:0/1822891900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51f8004aa0 con 0x7f5208100a60 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f5204ff9640 1 -- 172.21.15.102:0/1822891900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51f8004c00 con 0x7f5208100a60 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52081958a0 con 0x7f5208100a60 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f5204ff9640 1 -- 172.21.15.102:0/1822891900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51f8031940 con 0x7f5208100a60 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.079+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208195cc0 con 0x7f5208100a60 2024-09-19T08:55:08.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.080+0000 7f5204ff9640 1 -- 172.21.15.102:0/1822891900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f51f80035f0 con 0x7f5208100a60 2024-09-19T08:55:08.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.080+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5208068700 con 0x7f5208100a60 2024-09-19T08:55:08.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.080+0000 7f5204ff9640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51f0038830 0x7f51f003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:08.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.080+0000 7f5204ff9640 1 -- 172.21.15.102:0/1822891900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f51f806c650 con 0x7f5208100a60 2024-09-19T08:55:08.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.081+0000 7f5206ffd640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51f0038830 0x7f51f003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:08.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.081+0000 7f5206ffd640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51f0038830 0x7f51f003acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0098c0 tx=0x7f51fc006db0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:08.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.085+0000 7f5204ff9640 1 -- 172.21.15.102:0/1822891900 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f51f803a9b0 con 0x7f5208100a60 2024-09-19T08:55:08.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.313+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5208109d20 con 0x7f5208100a60 2024-09-19T08:55:08.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.314+0000 7f5204ff9640 1 -- 172.21.15.102:0/1822891900 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f51f8035070 con 0x7f5208100a60 2024-09-19T08:55:08.314 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:08.314 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51f0038830 msgr2=0x7f51f003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51f0038830 0x7f51f003acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0098c0 tx=0x7f51fc006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 msgr2=0x7f5208195160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208195160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009230 tx=0x7f51f80056e0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 shutdown_connections 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51f0038830 0x7f51f003acf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 --2- 172.21.15.102:0/1822891900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5208100a60 0x7f5208195160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 >> 172.21.15.102:0/1822891900 conn(0x7f52080fa440 msgr2=0x7f5208101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 shutdown_connections 2024-09-19T08:55:08.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:08.316+0000 7f520dc7e640 1 -- 172.21.15.102:0/1822891900 wait complete. 2024-09-19T08:55:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:55:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:08 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/1822891900' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:09.892 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:55:09.893 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:10.230 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:10.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:09 smithi049 ceph-mon[28158]: Deploying daemon ceph-exporter.smithi102 on smithi102 2024-09-19T08:55:11.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.773+0000 7f2f734b2640 1 -- 172.21.15.102:0/2496232070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 msgr2=0x7f2f6c100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:11.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.773+0000 7f2f734b2640 1 --2- 172.21.15.102:0/2496232070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c100d70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009880 tx=0x7f2f6802a670 comp rx=0 tx=0).stop 2024-09-19T08:55:11.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.773+0000 7f2f734b2640 1 -- 172.21.15.102:0/2496232070 shutdown_connections 2024-09-19T08:55:11.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.773+0000 7f2f734b2640 1 --2- 172.21.15.102:0/2496232070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c100d70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.773+0000 7f2f734b2640 1 -- 172.21.15.102:0/2496232070 >> 172.21.15.102:0/2496232070 conn(0x7f2f6c0fa3b0 msgr2=0x7f2f6c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.773+0000 7f2f734b2640 1 -- 172.21.15.102:0/2496232070 shutdown_connections 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.773+0000 7f2f734b2640 1 -- 172.21.15.102:0/2496232070 wait complete. 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.774+0000 7f2f734b2640 1 Processor -- start 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.774+0000 7f2f734b2640 1 -- start start 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.774+0000 7f2f734b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c195110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.774+0000 7f2f734b2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c195650 con 0x7f2f6c100990 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.774+0000 7f2f7124e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c195110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.774+0000 7f2f7124e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c195110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:60438/0 (socket says 172.21.15.102:60438) 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.774+0000 7f2f7124e640 1 -- 172.21.15.102:0/936817381 learned_addr learned my addr 172.21.15.102:0/936817381 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.775+0000 7f2f7124e640 1 -- 172.21.15.102:0/936817381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68009560 con 0x7f2f6c100990 2024-09-19T08:55:11.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.775+0000 7f2f7124e640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c195110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009230 tx=0x7f2f680056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.775+0000 7f2f5e7fc640 1 -- 172.21.15.102:0/936817381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f68004aa0 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.775+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c195850 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.775+0000 7f2f5e7fc640 1 -- 172.21.15.102:0/936817381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f68004c00 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.775+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c195c70 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.775+0000 7f2f5e7fc640 1 -- 172.21.15.102:0/936817381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f68031810 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.776+0000 7f2f5e7fc640 1 -- 172.21.15.102:0/936817381 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f2f68031970 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.776+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c102870 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.776+0000 7f2f5e7fc640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2f58038830 0x7f2f5803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.776+0000 7f2f5e7fc640 1 -- 172.21.15.102:0/936817381 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2f6806c880 con 0x7f2f6c100990 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.777+0000 7f2f70a4d640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2f58038830 0x7f2f5803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:11.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.777+0000 7f2f70a4d640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2f58038830 0x7f2f5803acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f600098c0 tx=0x7f2f60006db0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:11.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:11.782+0000 7f2f5e7fc640 1 -- 172.21.15.102:0/936817381 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2f680437d0 con 0x7f2f6c100990 2024-09-19T08:55:12.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.016+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2f6c068740 con 0x7f2f6c100990 2024-09-19T08:55:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.017+0000 7f2f5e7fc640 1 -- 172.21.15.102:0/936817381 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2f68035030 con 0x7f2f6c100990 2024-09-19T08:55:12.017 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:12.017 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:12.018 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:55:12.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2f58038830 msgr2=0x7f2f5803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2f58038830 0x7f2f5803acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f600098c0 tx=0x7f2f60006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 msgr2=0x7f2f6c195110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c195110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009230 tx=0x7f2f680056e0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 shutdown_connections 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2f58038830 0x7f2f5803acf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 --2- 172.21.15.102:0/936817381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f6c100990 0x7f2f6c195110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 >> 172.21.15.102:0/936817381 conn(0x7f2f6c0fa3b0 msgr2=0x7f2f6c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 shutdown_connections 2024-09-19T08:55:12.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:12.020+0000 7f2f734b2640 1 -- 172.21.15.102:0/936817381 wait complete. 2024-09-19T08:55:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:12 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/936817381' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:13.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:13.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:13.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:13.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:13.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T08:55:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-19T08:55:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:13 smithi049 ceph-mon[28158]: Deploying daemon crash.smithi102 on smithi102 2024-09-19T08:55:13.878 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:55:13.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:16.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 -- 172.21.15.102:0/3923087407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 msgr2=0x7f8784104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 --2- 172.21.15.102:0/3923087407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784104ae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8778009880 tx=0x7f877802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 -- 172.21.15.102:0/3923087407 shutdown_connections 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 --2- 172.21.15.102:0/3923087407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784104ae0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 -- 172.21.15.102:0/3923087407 >> 172.21.15.102:0/3923087407 conn(0x7f87840fa440 msgr2=0x7f87840fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 -- 172.21.15.102:0/3923087407 shutdown_connections 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 -- 172.21.15.102:0/3923087407 wait complete. 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 Processor -- start 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.163+0000 7f878b417640 1 -- start start 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f878b417640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784193d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f878b417640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784068d00 con 0x7f8784104700 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f87891b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784193d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f87891b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784193d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:46420/0 (socket says 172.21.15.102:46420) 2024-09-19T08:55:16.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f87891b3640 1 -- 172.21.15.102:0/1833637314 learned_addr learned my addr 172.21.15.102:0/1833637314 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:55:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f87891b3640 1 -- 172.21.15.102:0/1833637314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009560 con 0x7f8784104700 2024-09-19T08:55:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f87891b3640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784193d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8778009230 tx=0x7f87780056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f87767fc640 1 -- 172.21.15.102:0/1833637314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8778004aa0 con 0x7f8784104700 2024-09-19T08:55:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.164+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87841942a0 con 0x7f8784104700 2024-09-19T08:55:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.165+0000 7f87767fc640 1 -- 172.21.15.102:0/1833637314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8778004c00 con 0x7f8784104700 2024-09-19T08:55:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.165+0000 7f87767fc640 1 -- 172.21.15.102:0/1833637314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8778031940 con 0x7f8784104700 2024-09-19T08:55:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.165+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8784194720 con 0x7f8784104700 2024-09-19T08:55:16.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.165+0000 7f87767fc640 1 -- 172.21.15.102:0/1833637314 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f8778031aa0 con 0x7f8784104700 2024-09-19T08:55:16.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.166+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87840ffe40 con 0x7f8784104700 2024-09-19T08:55:16.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.166+0000 7f87767fc640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8770038830 0x7f877003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:16.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.166+0000 7f87767fc640 1 -- 172.21.15.102:0/1833637314 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f877806c760 con 0x7f8784104700 2024-09-19T08:55:16.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.166+0000 7f87889b2640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8770038830 0x7f877003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:16.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.167+0000 7f87889b2640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8770038830 0x7f877003acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87800098c0 tx=0x7f8780006db0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:16.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.171+0000 7f87767fc640 1 -- 172.21.15.102:0/1833637314 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f877803c7f0 con 0x7f8784104700 2024-09-19T08:55:16.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.410+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f87840685d0 con 0x7f8784104700 2024-09-19T08:55:16.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.410+0000 7f87767fc640 1 -- 172.21.15.102:0/1833637314 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8778035030 con 0x7f8784104700 2024-09-19T08:55:16.410 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:16.410 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:16.411 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:55:16.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8770038830 msgr2=0x7f877003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8770038830 0x7f877003acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87800098c0 tx=0x7f8780006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 msgr2=0x7f8784193d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784193d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8778009230 tx=0x7f87780056e0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 shutdown_connections 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8770038830 0x7f877003acf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 --2- 172.21.15.102:0/1833637314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8784104700 0x7f8784193d60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.412+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 >> 172.21.15.102:0/1833637314 conn(0x7f87840fa440 msgr2=0x7f87840fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.413+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 shutdown_connections 2024-09-19T08:55:16.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:16.413+0000 7f878b417640 1 -- 172.21.15.102:0/1833637314 wait complete. 2024-09-19T08:55:17.047 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:16 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:17.047 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:16 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:17.047 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:16 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:17.047 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:16 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:17.047 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:16 smithi049 ceph-mon[28158]: Deploying daemon node-exporter.smithi102 on smithi102 2024-09-19T08:55:17.047 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:16 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/1833637314' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:17.943 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:55:17.943 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:18.148 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:18.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:18.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:55:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.712+0000 7f92fca70640 1 -- 172.21.15.102:0/2817752378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 msgr2=0x7f92f8072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.712+0000 7f92fca70640 1 --2- 172.21.15.102:0/2817752378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f8072b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009880 tx=0x7f92e002a670 comp rx=0 tx=0).stop 2024-09-19T08:55:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.712+0000 7f92fca70640 1 -- 172.21.15.102:0/2817752378 shutdown_connections 2024-09-19T08:55:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.712+0000 7f92fca70640 1 --2- 172.21.15.102:0/2817752378 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f8072b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.712+0000 7f92fca70640 1 -- 172.21.15.102:0/2817752378 >> 172.21.15.102:0/2817752378 conn(0x7f92f80fb850 msgr2=0x7f92f80fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.712+0000 7f92fca70640 1 -- 172.21.15.102:0/2817752378 shutdown_connections 2024-09-19T08:55:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.712+0000 7f92fca70640 1 -- 172.21.15.102:0/2817752378 wait complete. 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.713+0000 7f92fca70640 1 Processor -- start 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.713+0000 7f92fca70640 1 -- start start 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.713+0000 7f92fca70640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f81972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.713+0000 7f92fca70640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f8197810 con 0x7f92f8072740 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.713+0000 7f92f659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f81972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.713+0000 7f92f659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f81972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:46432/0 (socket says 172.21.15.102:46432) 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.713+0000 7f92f659c640 1 -- 172.21.15.102:0/285298597 learned_addr learned my addr 172.21.15.102:0/285298597 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:55:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.714+0000 7f92f659c640 1 -- 172.21.15.102:0/285298597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0009560 con 0x7f92f8072740 2024-09-19T08:55:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.714+0000 7f92f659c640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f81972d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009230 tx=0x7f92e00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.714+0000 7f92ef7fe640 1 -- 172.21.15.102:0/285298597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e0004aa0 con 0x7f92f8072740 2024-09-19T08:55:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.714+0000 7f92ef7fe640 1 -- 172.21.15.102:0/285298597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92e0004c00 con 0x7f92f8072740 2024-09-19T08:55:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.714+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f8197a10 con 0x7f92f8072740 2024-09-19T08:55:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.714+0000 7f92ef7fe640 1 -- 172.21.15.102:0/285298597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e0031940 con 0x7f92f8072740 2024-09-19T08:55:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.714+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f8197e30 con 0x7f92f8072740 2024-09-19T08:55:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.715+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f8073e70 con 0x7f92f8072740 2024-09-19T08:55:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.715+0000 7f92ef7fe640 1 -- 172.21.15.102:0/285298597 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f92e0031aa0 con 0x7f92f8072740 2024-09-19T08:55:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.716+0000 7f92ef7fe640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f92e4038830 0x7f92e403acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.716+0000 7f92ef7fe640 1 -- 172.21.15.102:0/285298597 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f92e006c5b0 con 0x7f92f8072740 2024-09-19T08:55:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.716+0000 7f92f5d9b640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f92e4038830 0x7f92e403acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.716+0000 7f92f5d9b640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f92e4038830 0x7f92e403acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098c0 tx=0x7f92e8006db0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.720+0000 7f92ef7fe640 1 -- 172.21.15.102:0/285298597 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f92e0003d20 con 0x7f92f8072740 2024-09-19T08:55:20.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.961+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f92f810be10 con 0x7f92f8072740 2024-09-19T08:55:20.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.962+0000 7f92ef7fe640 1 -- 172.21.15.102:0/285298597 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f92e0035020 con 0x7f92f8072740 2024-09-19T08:55:20.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:20.962 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:20.963 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:55:20.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f92e4038830 msgr2=0x7f92e403acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:20.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f92e4038830 0x7f92e403acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098c0 tx=0x7f92e8006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 msgr2=0x7f92f81972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f81972d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009230 tx=0x7f92e00056e0 comp rx=0 tx=0).stop 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 shutdown_connections 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f92e4038830 0x7f92e403acf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 --2- 172.21.15.102:0/285298597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92f8072740 0x7f92f81972d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 >> 172.21.15.102:0/285298597 conn(0x7f92f80fb850 msgr2=0x7f92f8103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 shutdown_connections 2024-09-19T08:55:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:20.964+0000 7f92fca70640 1 -- 172.21.15.102:0/285298597 wait complete. 2024-09-19T08:55:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:55:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:55:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:55:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: Deploying daemon mgr.smithi102.csalqv on smithi102 2024-09-19T08:55:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:21 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/285298597' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:23.244 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:55:23.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:24.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:24 smithi049 ceph-mon[28158]: Deploying daemon mon.smithi102 on smithi102 2024-09-19T08:55:25.021 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:25.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:25 smithi049 ceph-mon[28158]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:27.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 -- 172.21.15.102:0/2827705274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 msgr2=0x7fe828105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 --2- 172.21.15.102:0/2827705274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe828105b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe818009880 tx=0x7fe81802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 -- 172.21.15.102:0/2827705274 shutdown_connections 2024-09-19T08:55:27.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 --2- 172.21.15.102:0/2827705274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe828105b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 -- 172.21.15.102:0/2827705274 >> 172.21.15.102:0/2827705274 conn(0x7fe8280fb850 msgr2=0x7fe8280fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:27.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 -- 172.21.15.102:0/2827705274 shutdown_connections 2024-09-19T08:55:27.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 -- 172.21.15.102:0/2827705274 wait complete. 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.009+0000 7fe82cf53640 1 Processor -- start 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.010+0000 7fe82cf53640 1 -- start start 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.010+0000 7fe82cf53640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe8280727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.010+0000 7fe82cf53640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280746c0 con 0x7fe828105750 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.010+0000 7fe82659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe8280727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.010+0000 7fe82659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe8280727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.102:45550/0 (socket says 172.21.15.102:45550) 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.010+0000 7fe82659c640 1 -- 172.21.15.102:0/117875826 learned_addr learned my addr 172.21.15.102:0/117875826 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.010+0000 7fe82659c640 1 -- 172.21.15.102:0/117875826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009560 con 0x7fe828105750 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.011+0000 7fe82659c640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe8280727b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe818009230 tx=0x7fe8180056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.011+0000 7fe8177fe640 1 -- 172.21.15.102:0/117875826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe818004aa0 con 0x7fe828105750 2024-09-19T08:55:27.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.011+0000 7fe8177fe640 1 -- 172.21.15.102:0/117875826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe818004c00 con 0x7fe828105750 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.011+0000 7fe8177fe640 1 -- 172.21.15.102:0/117875826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe818031940 con 0x7fe828105750 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.011+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe828072cf0 con 0x7fe828105750 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.011+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe828073170 con 0x7fe828105750 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.012+0000 7fe8177fe640 1 -- 172.21.15.102:0/117875826 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fe818031aa0 con 0x7fe828105750 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.012+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe828100e90 con 0x7fe828105750 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.012+0000 7fe8177fe640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe810038880 0x7fe81003ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.012+0000 7fe8177fe640 1 -- 172.21.15.102:0/117875826 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe81806c5a0 con 0x7fe828105750 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.012+0000 7fe825d9b640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe810038880 0x7fe81003ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.013+0000 7fe825d9b640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe810038880 0x7fe81003ad40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0098c0 tx=0x7fe81c006db0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:27.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.017+0000 7fe8177fe640 1 -- 172.21.15.102:0/117875826 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe81803abe0 con 0x7fe828105750 2024-09-19T08:55:27.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.248+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe828073440 con 0x7fe828105750 2024-09-19T08:55:27.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.248+0000 7fe8177fe640 1 -- 172.21.15.102:0/117875826 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe818040020 con 0x7fe828105750 2024-09-19T08:55:27.248 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:27.249 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:52:57.894000Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:27.249 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe810038880 msgr2=0x7fe81003ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe810038880 0x7fe81003ad40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0098c0 tx=0x7fe81c006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 msgr2=0x7fe8280727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe8280727b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe818009230 tx=0x7fe8180056e0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 shutdown_connections 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe810038880 0x7fe81003ad40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 --2- 172.21.15.102:0/117875826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe828105750 0x7fe8280727b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 >> 172.21.15.102:0/117875826 conn(0x7fe8280fb850 msgr2=0x7fe8280fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 shutdown_connections 2024-09-19T08:55:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:27.251+0000 7fe82cf53640 1 -- 172.21.15.102:0/117875826 wait complete. 2024-09-19T08:55:27.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:27 smithi049 ceph-mon[28158]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:27.919 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:27 smithi102 systemd[1]: Started Ceph mon.smithi102 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T08:55:29.325 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T08:55:29.325 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:29.527 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:55:33.140 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:55:33.140 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.140 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: mon.smithi049 calling monitor election 2024-09-19T08:55:33.140 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:33.140 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.140 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.140 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: mon.smithi102 calling monitor election 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: mon.smithi049 is new leader, mons smithi049,smithi102 in quorum (ranks 0,1) 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi102=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: fsmap 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: mgrmap e17: smithi049.qdvksw(active, since 30s) 2024-09-19T08:55:33.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: overall HEALTH_OK 2024-09-19T08:55:33.142 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: Standby manager daemon smithi102.csalqv started 2024-09-19T08:55:33.142 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.142 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.142 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.142 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.142 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:55:33.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: mon.smithi049 calling monitor election 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: mon.smithi102 calling monitor election 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: mon.smithi049 is new leader, mons smithi049,smithi102 in quorum (ranks 0,1) 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi102=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: fsmap 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: mgrmap e17: smithi049.qdvksw(active, since 30s) 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: overall HEALTH_OK 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv started 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:33.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.811+0000 7f32a9597640 1 -- 172.21.15.102:0/1303309455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4104770 msgr2=0x7f3290005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.811+0000 7f32a9597640 1 --2- 172.21.15.102:0/1303309455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4104770 0x7f3290005580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3294011c50 tx=0x7f329402be50 comp rx=0 tx=0).stop 2024-09-19T08:55:33.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.811+0000 7f32a9597640 1 -- 172.21.15.102:0/1303309455 shutdown_connections 2024-09-19T08:55:33.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.811+0000 7f32a9597640 1 --2- 172.21.15.102:0/1303309455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4104770 0x7f3290005580 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.811+0000 7f32a9597640 1 -- 172.21.15.102:0/1303309455 >> 172.21.15.102:0/1303309455 conn(0x7f32a40fa470 msgr2=0x7f32a40fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.811+0000 7f32a9597640 1 -- 172.21.15.102:0/1303309455 shutdown_connections 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.811+0000 7f32a9597640 1 -- 172.21.15.102:0/1303309455 wait complete. 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.812+0000 7f32a9597640 1 Processor -- start 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a9597640 1 -- start start 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a9597640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 0x7f32a4196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a9597640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4196590 0x7f32a41969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a9597640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a419f0c0 con 0x7f32a4196590 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a9597640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a419f200 con 0x7f32a4104770 2024-09-19T08:55:33.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 0x7f32a4196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 0x7f32a4196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58372/0 (socket says 172.21.15.102:58372) 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a2ffd640 1 -- 172.21.15.102:0/1953142480 learned_addr learned my addr 172.21.15.102:0/1953142480 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a2ffd640 1 -- 172.21.15.102:0/1953142480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 msgr2=0x7f32a4196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a2ffd640 1 -- 172.21.15.102:0/1953142480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 msgr2=0x7f32a4196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a2ffd640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 0x7f32a4196050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f32a2ffd640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 0x7f32a4196050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f329a7fc640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4196590 0x7f32a41969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f329a7fc640 1 -- 172.21.15.102:0/1953142480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 msgr2=0x7f32a4196050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f329a7fc640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 0x7f32a4196050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.813+0000 7f329a7fc640 1 -- 172.21.15.102:0/1953142480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294011930 con 0x7f32a4196590 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.814+0000 7f329a7fc640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4196590 0x7f32a41969f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b400 tx=0x7f328c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.814+0000 7f32a0ff9640 1 -- 172.21.15.102:0/1953142480 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328c011800 con 0x7f32a4196590 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.814+0000 7f32a0ff9640 1 -- 172.21.15.102:0/1953142480 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f328c011e20 con 0x7f32a4196590 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.814+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a419f400 con 0x7f32a4196590 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.814+0000 7f32a0ff9640 1 -- 172.21.15.102:0/1953142480 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328c00f2e0 con 0x7f32a4196590 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.814+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a419f900 con 0x7f32a4196590 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.815+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a40ffeb0 con 0x7f32a4196590 2024-09-19T08:55:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.815+0000 7f32a0ff9640 1 -- 172.21.15.102:0/1953142480 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f328c010380 con 0x7f32a4196590 2024-09-19T08:55:33.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.816+0000 7f32a0ff9640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f328406ccd0 0x7f328406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.816+0000 7f32a0ff9640 1 -- 172.21.15.102:0/1953142480 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f328c08ae20 con 0x7f32a4196590 2024-09-19T08:55:33.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.816+0000 7f32a2ffd640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f328406ccd0 0x7f328406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.817+0000 7f32a2ffd640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f328406ccd0 0x7f328406f190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3294005940 tx=0x7f32940058b0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:33.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:33.821+0000 7f32a0ff9640 1 -- 172.21.15.102:0/1953142480 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f328c056270 con 0x7f32a4196590 2024-09-19T08:55:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:33 smithi102 ceph-mon[35280]: mgrmap e18: smithi049.qdvksw(active, since 30s), standbys: smithi102.csalqv 2024-09-19T08:55:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:33 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T08:55:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:33 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:33 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:34.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.063+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f32a4106630 con 0x7f32a4196590 2024-09-19T08:55:34.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.064+0000 7f32a0ff9640 1 -- 172.21.15.102:0/1953142480 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f328c059890 con 0x7f32a4196590 2024-09-19T08:55:34.064 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:55:34.064 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"fsid":"63845326-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:55:27.778128Z","created":"2024-09-19T08:52:57.894000Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi102","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:55:34.064 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 2 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f328406ccd0 msgr2=0x7f328406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f328406ccd0 0x7f328406f190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3294005940 tx=0x7f32940058b0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4196590 msgr2=0x7f32a41969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4196590 0x7f32a41969f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b400 tx=0x7f328c00b8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 shutdown_connections 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f328406ccd0 0x7f328406f190 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32a4196590 0x7f32a41969f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 --2- 172.21.15.102:0/1953142480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a4104770 0x7f32a4196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 >> 172.21.15.102:0/1953142480 conn(0x7f32a40fa470 msgr2=0x7f32a40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 shutdown_connections 2024-09-19T08:55:34.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:55:34.066+0000 7f32a9597640 1 -- 172.21.15.102:0/1953142480 wait complete. 2024-09-19T08:55:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:33 smithi049 ceph-mon[28158]: mgrmap e18: smithi049.qdvksw(active, since 30s), standbys: smithi102.csalqv 2024-09-19T08:55:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:33 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T08:55:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:33 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:33 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:55:35.212 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:34 smithi102 ceph-mon[35280]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:35.212 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:34 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/1953142480' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:35.234 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:55:35.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:55:35.257 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:34 smithi049 ceph-mon[28158]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:35.257 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:34 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/1953142480' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:35.452 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:55:36.169 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.169 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.169 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:36.169 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:55:36.170 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T08:55:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T08:55:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:55:36.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:37.206 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:36 smithi049 ceph-mon[28158]: Reconfiguring mon.smithi049 (unknown last config time)... 2024-09-19T08:55:37.206 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:36 smithi049 ceph-mon[28158]: Reconfiguring daemon mon.smithi049 on smithi049 2024-09-19T08:55:37.206 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:36 smithi049 ceph-mon[28158]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:37.207 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:36 smithi102 ceph-mon[35280]: Reconfiguring mon.smithi049 (unknown last config time)... 2024-09-19T08:55:37.207 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:36 smithi102 ceph-mon[35280]: Reconfiguring daemon mon.smithi049 on smithi049 2024-09-19T08:55:37.207 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:36 smithi102 ceph-mon[35280]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:37.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.501+0000 7f7268cd1640 1 -- 172.21.15.49:0/2379826742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 msgr2=0x7f7264104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.501+0000 7f7268cd1640 1 --2- 172.21.15.49:0/2379826742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264104b40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f725c009880 tx=0x7f725c02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.501+0000 7f7268cd1640 1 -- 172.21.15.49:0/2379826742 shutdown_connections 2024-09-19T08:55:37.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.501+0000 7f7268cd1640 1 --2- 172.21.15.49:0/2379826742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264104b40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.501+0000 7f7268cd1640 1 -- 172.21.15.49:0/2379826742 >> 172.21.15.49:0/2379826742 conn(0x7f7264076550 msgr2=0x7f7264076960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:37.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.501+0000 7f7268cd1640 1 -- 172.21.15.49:0/2379826742 shutdown_connections 2024-09-19T08:55:37.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.501+0000 7f7268cd1640 1 -- 172.21.15.49:0/2379826742 wait complete. 2024-09-19T08:55:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f7268cd1640 1 Processor -- start 2024-09-19T08:55:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f7268cd1640 1 -- start start 2024-09-19T08:55:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f7268cd1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f7268cd1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7264195750 0x7f7264199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f7268cd1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7264195d50 con 0x7f7264104760 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f7268cd1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7264195ec0 con 0x7f7264195750 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f726259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f726259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264195210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52304/0 (socket says 172.21.15.49:52304) 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f726259c640 1 -- 172.21.15.49:0/2714236224 learned_addr learned my addr 172.21.15.49:0/2714236224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f726259c640 1 -- 172.21.15.49:0/2714236224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7264195750 msgr2=0x7f7264199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f7261d9b640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7264195750 0x7f7264199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f726259c640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7264195750 0x7f7264199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.502+0000 7f726259c640 1 -- 172.21.15.49:0/2714236224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c009560 con 0x7f7264104760 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.503+0000 7f726259c640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264195210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f725c006010 tx=0x7f725c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.503+0000 7f725b7fe640 1 -- 172.21.15.49:0/2714236224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f725c004aa0 con 0x7f7264104760 2024-09-19T08:55:37.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.503+0000 7f725b7fe640 1 -- 172.21.15.49:0/2714236224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f725c004c00 con 0x7f7264104760 2024-09-19T08:55:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.503+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726419a100 con 0x7f7264104760 2024-09-19T08:55:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.503+0000 7f725b7fe640 1 -- 172.21.15.49:0/2714236224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f725c003980 con 0x7f7264104760 2024-09-19T08:55:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.503+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726419a6d0 con 0x7f7264104760 2024-09-19T08:55:37.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.504+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726419a950 con 0x7f7264104760 2024-09-19T08:55:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.504+0000 7f725b7fe640 1 -- 172.21.15.49:0/2714236224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f725c003c40 con 0x7f7264104760 2024-09-19T08:55:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.505+0000 7f725b7fe640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f725006cd20 0x7f725006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.505+0000 7f725b7fe640 1 -- 172.21.15.49:0/2714236224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f725c0ac190 con 0x7f7264104760 2024-09-19T08:55:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.505+0000 7f7261d9b640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f725006cd20 0x7f725006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.505+0000 7f7261d9b640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f725006cd20 0x7f725006f1e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f724c006fd0 tx=0x7f724c008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:37.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.509+0000 7f725b7fe640 1 -- 172.21.15.49:0/2714236224 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f725c077640 con 0x7f7264104760 2024-09-19T08:55:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.685+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f72640ff570 con 0x7f7264104760 2024-09-19T08:55:37.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.686+0000 7f725b7fe640 1 -- 172.21.15.49:0/2714236224 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f725c04a100 con 0x7f7264104760 2024-09-19T08:55:37.685 INFO:teuthology.orchestra.run.smithi049.stdout:# minimal ceph.conf for 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:37.685 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-09-19T08:55:37.685 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:37.686 INFO:teuthology.orchestra.run.smithi049.stdout: mon_host = [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-19T08:55:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f725006cd20 msgr2=0x7f725006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f725006cd20 0x7f725006f1e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f724c006fd0 tx=0x7f724c008040 comp rx=0 tx=0).stop 2024-09-19T08:55:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 msgr2=0x7f7264195210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264195210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f725c006010 tx=0x7f725c0055a0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 shutdown_connections 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f725006cd20 0x7f725006f1e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7264195750 0x7f7264199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 --2- 172.21.15.49:0/2714236224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7264104760 0x7f7264195210 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 >> 172.21.15.49:0/2714236224 conn(0x7f7264076550 msgr2=0x7f7264101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 shutdown_connections 2024-09-19T08:55:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:37.688+0000 7f7268cd1640 1 -- 172.21.15.49:0/2714236224 wait complete. 2024-09-19T08:55:38.286 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:38.286 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:38 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2714236224' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:38.286 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:38.286 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:38.286 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:55:38.286 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:55:38.286 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:38 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2714236224' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:55:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:55:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:38.647 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:55:38.647 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:55:38.647 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:55:38.717 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:55:38.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:38.783 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:55:38.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:55:38.815 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:55:38.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:38.881 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:55:38.882 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:55:38.882 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:55:38.898 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:55:38.898 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-09-19T08:55:38.954 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 08:54:55.363442247 +0000 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 08:49:07.354748477 +0000 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 08:49:07.354748477 +0000 2024-09-19T08:55:38.955 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 08:49:07.354748477 +0000 2024-09-19T08:55:38.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:55:39.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T08:55:39.019 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T08:55:39.019 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.0936e-05 s, 5.6 MB/s 2024-09-19T08:55:39.020 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:55:39.076 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-09-19T08:55:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:55:39.134 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:39.134 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T08:55:39.134 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:39.134 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:39.134 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 08:54:55.364442219 +0000 2024-09-19T08:55:39.134 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 08:49:07.679739357 +0000 2024-09-19T08:55:39.135 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 08:49:07.679739357 +0000 2024-09-19T08:55:39.135 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 08:49:07.679739357 +0000 2024-09-19T08:55:39.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:55:39.186 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:39 smithi049 ceph-mon[28158]: Reconfiguring mgr.smithi049.qdvksw (unknown last config time)... 2024-09-19T08:55:39.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:39 smithi049 ceph-mon[28158]: Reconfiguring daemon mgr.smithi049.qdvksw on smithi049 2024-09-19T08:55:39.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:39 smithi049 ceph-mon[28158]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:39.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T08:55:39.198 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T08:55:39.198 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.5785e-05 s, 5.3 MB/s 2024-09-19T08:55:39.200 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:55:39.257 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-09-19T08:55:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:55:39.314 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:39.314 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:55:39.314 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:39.315 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:39.315 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 08:54:55.364442219 +0000 2024-09-19T08:55:39.315 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 08:49:08.004730238 +0000 2024-09-19T08:55:39.315 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 08:49:08.004730238 +0000 2024-09-19T08:55:39.315 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 08:49:08.004730238 +0000 2024-09-19T08:55:39.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:55:39.350 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:39 smithi102 ceph-mon[35280]: Reconfiguring mgr.smithi049.qdvksw (unknown last config time)... 2024-09-19T08:55:39.350 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:39 smithi102 ceph-mon[35280]: Reconfiguring daemon mgr.smithi049.qdvksw on smithi049 2024-09-19T08:55:39.350 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:39 smithi102 ceph-mon[35280]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:39.378 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T08:55:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T08:55:39.379 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000107632 s, 4.8 MB/s 2024-09-19T08:55:39.380 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:55:39.437 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-09-19T08:55:39.493 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:55:39.493 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:39.493 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:55:39.493 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:39.493 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:39.493 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-19 08:54:55.364442219 +0000 2024-09-19T08:55:39.493 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 08:49:08.336720922 +0000 2024-09-19T08:55:39.494 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 08:49:08.336720922 +0000 2024-09-19T08:55:39.494 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-19 08:49:08.336720922 +0000 2024-09-19T08:55:39.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:55:39.557 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-19T08:55:39.557 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-19T08:55:39.557 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000101073 s, 5.1 MB/s 2024-09-19T08:55:39.558 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:55:39.615 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:55:39.615 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:55:39.632 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:55:39.632 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-19T08:55:39.687 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:55:39.687 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T08:55:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 08:55:25.804231795 +0000 2024-09-19T08:55:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 08:49:00.226368411 +0000 2024-09-19T08:55:39.688 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 08:49:00.226368411 +0000 2024-09-19T08:55:39.688 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 08:49:00.226368411 +0000 2024-09-19T08:55:39.688 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:55:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T08:55:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T08:55:39.753 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000208848 s, 2.5 MB/s 2024-09-19T08:55:39.754 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:55:39.811 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-19T08:55:39.866 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:55:39.866 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:39.867 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T08:55:39.867 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:39.867 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:39.867 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 08:55:25.804231795 +0000 2024-09-19T08:55:39.867 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 08:49:00.548361551 +0000 2024-09-19T08:55:39.867 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 08:49:00.548361551 +0000 2024-09-19T08:55:39.867 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 08:49:00.548361551 +0000 2024-09-19T08:55:39.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:55:39.930 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T08:55:39.930 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T08:55:39.930 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000174758 s, 2.9 MB/s 2024-09-19T08:55:39.931 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:55:39.988 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 08:55:25.805231774 +0000 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 08:49:00.886354351 +0000 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 08:49:00.886354351 +0000 2024-09-19T08:55:40.043 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 08:49:00.886354351 +0000 2024-09-19T08:55:40.043 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:55:40.105 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T08:55:40.106 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T08:55:40.106 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000176724 s, 2.9 MB/s 2024-09-19T08:55:40.107 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:55:40.162 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-19T08:55:40.217 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 08:55:25.805231774 +0000 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 08:49:01.220347235 +0000 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 08:49:01.220347235 +0000 2024-09-19T08:55:40.218 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 08:49:01.220347235 +0000 2024-09-19T08:55:40.218 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:55:40.280 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T08:55:40.281 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T08:55:40.281 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000198964 s, 2.6 MB/s 2024-09-19T08:55:40.282 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:55:40.338 INFO:tasks.cephadm:Deploying osd.0 on smithi049 with /dev/vg_nvme/lv_4... 2024-09-19T08:55:40.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:55:41.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:40 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:41.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:40 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:41.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:40 smithi049 ceph-mon[28158]: Reconfiguring ceph-exporter.smithi049 (monmap changed)... 2024-09-19T08:55:41.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:40 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T08:55:41.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:40 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:41.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:40 smithi049 ceph-mon[28158]: Reconfiguring daemon ceph-exporter.smithi049 on smithi049 2024-09-19T08:55:41.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:40 smithi049 ceph-mon[28158]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:55:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:40 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:40 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:40 smithi102 ceph-mon[35280]: Reconfiguring ceph-exporter.smithi049 (monmap changed)... 2024-09-19T08:55:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:40 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T08:55:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:40 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:40 smithi102 ceph-mon[35280]: Reconfiguring daemon ceph-exporter.smithi049 on smithi049 2024-09-19T08:55:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:40 smithi102 ceph-mon[35280]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:42 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:42 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:42 smithi049 ceph-mon[28158]: Reconfiguring crash.smithi049 (monmap changed)... 2024-09-19T08:55:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:42 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T08:55:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:42 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:42 smithi049 ceph-mon[28158]: Reconfiguring daemon crash.smithi049 on smithi049 2024-09-19T08:55:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:42 smithi049 ceph-mon[28158]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:42 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:42 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:42 smithi102 ceph-mon[35280]: Reconfiguring crash.smithi049 (monmap changed)... 2024-09-19T08:55:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:42 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T08:55:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:42 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:42 smithi102 ceph-mon[35280]: Reconfiguring daemon crash.smithi049 on smithi049 2024-09-19T08:55:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:42 smithi102 ceph-mon[35280]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:44.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:44.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:44.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:44 smithi049 ceph-mon[28158]: Reconfiguring alertmanager.smithi049 (dependencies changed)... 2024-09-19T08:55:44.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:44 smithi049 ceph-mon[28158]: Reconfiguring daemon alertmanager.smithi049 on smithi049 2024-09-19T08:55:44.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:44.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:44.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:44 smithi102 ceph-mon[35280]: Reconfiguring alertmanager.smithi049 (dependencies changed)... 2024-09-19T08:55:44.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:44 smithi102 ceph-mon[35280]: Reconfiguring daemon alertmanager.smithi049 on smithi049 2024-09-19T08:55:45.403 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:45 smithi049 ceph-mon[28158]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:45 smithi102 ceph-mon[35280]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:47.437 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:47 smithi049 ceph-mon[28158]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:47.437 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:55:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:47 smithi102 ceph-mon[35280]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:55:49.498 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:49 smithi049 ceph-mon[28158]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:49.499 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:49 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:49.499 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:49 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:49.507 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:49 smithi102 ceph-mon[35280]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:49.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:49 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:49.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:49 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:49.784 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:55:49.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2024-09-19T08:55:50.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:50 smithi049 ceph-mon[28158]: Reconfiguring grafana.smithi049 (dependencies changed)... 2024-09-19T08:55:50.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:50 smithi049 ceph-mon[28158]: Reconfiguring daemon grafana.smithi049 on smithi049 2024-09-19T08:55:50.394 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:50 smithi102 ceph-mon[35280]: Reconfiguring grafana.smithi049 (dependencies changed)... 2024-09-19T08:55:50.394 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:50 smithi102 ceph-mon[35280]: Reconfiguring daemon grafana.smithi049 on smithi049 2024-09-19T08:55:50.463 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:55:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:51 smithi102 ceph-mon[35280]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:51.516 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:51 smithi049 ceph-mon[28158]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 -- 172.21.15.49:0/4187256177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 msgr2=0x7fabe8100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 --2- 172.21.15.49:0/4187256177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8100100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009880 tx=0x7fabdc02a4a0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 -- 172.21.15.49:0/4187256177 shutdown_connections 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 --2- 172.21.15.49:0/4187256177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8100100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 --2- 172.21.15.49:0/4187256177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe80fea80 0x7fabe80fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 -- 172.21.15.49:0/4187256177 >> 172.21.15.49:0/4187256177 conn(0x7fabe80fa230 msgr2=0x7fabe80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 -- 172.21.15.49:0/4187256177 shutdown_connections 2024-09-19T08:55:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.033+0000 7fabeccf6640 1 -- 172.21.15.49:0/4187256177 wait complete. 2024-09-19T08:55:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.034+0000 7fabeccf6640 1 Processor -- start 2024-09-19T08:55:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.034+0000 7fabeccf6640 1 -- start start 2024-09-19T08:55:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.034+0000 7fabeccf6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe80fea80 0x7fabe8195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.034+0000 7fabeccf6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.034+0000 7fabeccf6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8196140 con 0x7fabe80ffc80 2024-09-19T08:55:52.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.034+0000 7fabeccf6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe81962b0 con 0x7fabe80fea80 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60450/0 (socket says 172.21.15.49:60450) 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe5d9b640 1 -- 172.21.15.49:0/1482591581 learned_addr learned my addr 172.21.15.49:0/1482591581 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe659c640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe80fea80 0x7fabe8195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe5d9b640 1 -- 172.21.15.49:0/1482591581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe80fea80 msgr2=0x7fabe8195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe5d9b640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe80fea80 0x7fabe8195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe5d9b640 1 -- 172.21.15.49:0/1482591581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc009560 con 0x7fabe80ffc80 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabe5d9b640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8195b70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0055a0 tx=0x7fabdc0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabd77fe640 1 -- 172.21.15.49:0/1482591581 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabdc004b20 con 0x7fabe80ffc80 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabd77fe640 1 -- 172.21.15.49:0/1482591581 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabdc004c80 con 0x7fabe80ffc80 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe819acf0 con 0x7fabe80ffc80 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabd77fe640 1 -- 172.21.15.49:0/1482591581 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabdc003bc0 con 0x7fabe80ffc80 2024-09-19T08:55:52.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.035+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe819b260 con 0x7fabe80ffc80 2024-09-19T08:55:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.037+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe8107690 con 0x7fabe80ffc80 2024-09-19T08:55:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.037+0000 7fabd77fe640 1 -- 172.21.15.49:0/1482591581 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fabdc03c470 con 0x7fabe80ffc80 2024-09-19T08:55:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.037+0000 7fabd77fe640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fabd006cbc0 0x7fabd006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.037+0000 7fabd77fe640 1 -- 172.21.15.49:0/1482591581 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fabdc0ac3a0 con 0x7fabe80ffc80 2024-09-19T08:55:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.037+0000 7fabe659c640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fabd006cbc0 0x7fabd006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.038+0000 7fabe659c640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fabd006cbc0 0x7fabd006f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabd8005fd0 tx=0x7fabd800b390 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.042+0000 7fabd77fe640 1 -- 172.21.15.49:0/1482591581 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fabdc077970 con 0x7fabe80ffc80 2024-09-19T08:55:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:55:52.228+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fabe819b450 con 0x7fabd006cbc0 2024-09-19T08:55:52.439 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:52 smithi049 ceph-mon[28158]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:52.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:52 smithi102 ceph-mon[35280]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:53 smithi049 ceph-mon[28158]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:53.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:53 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:53.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:53 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:53.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:53 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:53 smithi102 ceph-mon[35280]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:53 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:55:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:53 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:55:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:53 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:54.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:54 smithi102 ceph-mon[35280]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:54.525 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:54 smithi049 ceph-mon[28158]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:57.108 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:57 smithi049 ceph-mon[28158]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:57.108 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:57.109 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:57.109 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:57 smithi049 ceph-mon[28158]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2024-09-19T08:55:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:57 smithi102 ceph-mon[35280]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:55:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:57 smithi102 ceph-mon[35280]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2024-09-19T08:55:58.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:58 smithi102 ceph-mon[35280]: Reconfiguring daemon prometheus.smithi049 on smithi049 2024-09-19T08:55:58.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:58 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2117226821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5edac5e-6fcf-4e95-99a5-31c60b8acca9"}]: dispatch 2024-09-19T08:55:58.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:58 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2117226821' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5edac5e-6fcf-4e95-99a5-31c60b8acca9"}]': finished 2024-09-19T08:55:58.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:58 smithi102 ceph-mon[35280]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:55:58.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:58 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:58.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:58 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/130279266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:58.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:58 smithi049 ceph-mon[28158]: Reconfiguring daemon prometheus.smithi049 on smithi049 2024-09-19T08:55:58.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:58 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2117226821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5edac5e-6fcf-4e95-99a5-31c60b8acca9"}]: dispatch 2024-09-19T08:55:58.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:58 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2117226821' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5edac5e-6fcf-4e95-99a5-31c60b8acca9"}]': finished 2024-09-19T08:55:58.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:58 smithi049 ceph-mon[28158]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:55:58.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:58 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:55:58.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:58 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/130279266' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:55:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:55:59 smithi102 ceph-mon[35280]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:59.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:55:59 smithi049 ceph-mon[28158]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:01.376 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:01 smithi049 ceph-mon[28158]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:01 smithi102 ceph-mon[35280]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:03.295 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:03 smithi049 ceph-mon[28158]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:03.295 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:03 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:03 smithi102 ceph-mon[35280]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:03 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:05.401 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:05 smithi049 ceph-mon[28158]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:05.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:05 smithi102 ceph-mon[35280]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:07.266 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:07 smithi049 ceph-mon[28158]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:07.266 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:07.266 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:07.267 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T08:56:07.267 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:07.369 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:07 smithi102 ceph-mon[35280]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:07.369 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:07 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:07.369 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:07 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:07.369 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:07 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T08:56:07.370 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:07 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:08.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:08 smithi049 ceph-mon[28158]: Reconfiguring ceph-exporter.smithi102 (monmap changed)... 2024-09-19T08:56:08.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:08 smithi049 ceph-mon[28158]: Reconfiguring daemon ceph-exporter.smithi102 on smithi102 2024-09-19T08:56:08.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:08.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:08.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T08:56:08.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:08 smithi102 ceph-mon[35280]: Reconfiguring ceph-exporter.smithi102 (monmap changed)... 2024-09-19T08:56:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:08 smithi102 ceph-mon[35280]: Reconfiguring daemon ceph-exporter.smithi102 on smithi102 2024-09-19T08:56:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T08:56:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:09 smithi049 ceph-mon[28158]: Reconfiguring crash.smithi102 (monmap changed)... 2024-09-19T08:56:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:09 smithi049 ceph-mon[28158]: Reconfiguring daemon crash.smithi102 on smithi102 2024-09-19T08:56:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:09 smithi049 ceph-mon[28158]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:09 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:56:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:09 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:09.454 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:09 smithi102 ceph-mon[35280]: Reconfiguring crash.smithi102 (monmap changed)... 2024-09-19T08:56:09.454 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:09 smithi102 ceph-mon[35280]: Reconfiguring daemon crash.smithi102 on smithi102 2024-09-19T08:56:09.454 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:09 smithi102 ceph-mon[35280]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:09.454 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:09 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:56:09.454 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:09 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:10.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: Deploying daemon osd.0 on smithi049 2024-09-19T08:56:10.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:10.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:10.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: Reconfiguring mgr.smithi102.csalqv (monmap changed)... 2024-09-19T08:56:10.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:10.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:10.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:10.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:10 smithi049 ceph-mon[28158]: Reconfiguring daemon mgr.smithi102.csalqv on smithi102 2024-09-19T08:56:10.430 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: Deploying daemon osd.0 on smithi049 2024-09-19T08:56:10.430 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:10.430 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:10.430 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: Reconfiguring mgr.smithi102.csalqv (monmap changed)... 2024-09-19T08:56:10.430 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:10.430 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:10.431 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:10.431 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:10 smithi102 ceph-mon[35280]: Reconfiguring daemon mgr.smithi102.csalqv on smithi102 2024-09-19T08:56:11.250 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:11 smithi102 ceph-mon[35280]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:11.250 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:11 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:11.250 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:11 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:11.250 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:11 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:11.250 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:11 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:11.250 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:11 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:11 smithi049 ceph-mon[28158]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:11 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:11 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:11 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:11 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:11.459 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:11 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: Reconfiguring mon.smithi102 (monmap changed)... 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: Reconfiguring daemon mon.smithi102 on smithi102 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T08:56:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T08:56:12.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T08:56:12.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T08:56:12.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:12.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: Reconfiguring mon.smithi102 (monmap changed)... 2024-09-19T08:56:12.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: Reconfiguring daemon mon.smithi102 on smithi102 2024-09-19T08:56:12.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T08:56:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:12.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:13.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:13 smithi049 ceph-mon[28158]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T08:56:13.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:13 smithi049 ceph-mon[28158]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T08:56:13.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:13 smithi049 ceph-mon[28158]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T08:56:13.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:13 smithi049 ceph-mon[28158]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T08:56:13.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:13 smithi049 ceph-mon[28158]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T08:56:13.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:13 smithi049 ceph-mon[28158]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T08:56:13.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:13 smithi049 ceph-mon[28158]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:13 smithi102 ceph-mon[35280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T08:56:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:13 smithi102 ceph-mon[35280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T08:56:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:13 smithi102 ceph-mon[35280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T08:56:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:13 smithi102 ceph-mon[35280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T08:56:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:13 smithi102 ceph-mon[35280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T08:56:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:13 smithi102 ceph-mon[35280]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi049.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T08:56:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:13 smithi102 ceph-mon[35280]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:14 smithi049 ceph-mon[28158]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:14.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:14.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:14 smithi102 ceph-mon[35280]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:17.172 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:17 smithi049 ceph-mon[28158]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:17.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:17 smithi102 ceph-mon[35280]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:17.938 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 0 on host 'smithi049' 2024-09-19T08:56:17.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.938+0000 7fabd77fe640 1 -- 172.21.15.49:0/1482591581 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fabe819b450 con 0x7fabd006cbc0 2024-09-19T08:56:17.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fabd006cbc0 msgr2=0x7fabd006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fabd006cbc0 0x7fabd006f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabd8005fd0 tx=0x7fabd800b390 comp rx=0 tx=0).stop 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 msgr2=0x7fabe8195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8195b70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0055a0 tx=0x7fabdc0055d0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 shutdown_connections 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fabd006cbc0 0x7fabd006f080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe80ffc80 0x7fabe8195b70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 --2- 172.21.15.49:0/1482591581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe80fea80 0x7fabe8195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 >> 172.21.15.49:0/1482591581 conn(0x7fabe80fa230 msgr2=0x7fabe8068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 shutdown_connections 2024-09-19T08:56:17.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:17.941+0000 7fabeccf6640 1 -- 172.21.15.49:0/1482591581 wait complete. 2024-09-19T08:56:18.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:18 smithi049 ceph-mon[28158]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:56:18.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:18.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:18.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:18 smithi102 ceph-mon[35280]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:56:18.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:18.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:19.354 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:19 smithi049 ceph-mon[28158]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:19.355 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:19 smithi049 ceph-mon[28158]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:56:19.355 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:19 smithi049 ceph-mon[28158]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:56:19.355 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:19 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:19.355 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:19 smithi049 ceph-mon[28158]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T08:56:19.355 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:19 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:19.355 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:19 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:19.376 DEBUG:teuthology.orchestra.run.smithi049:osd.0> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:56:19.378 INFO:tasks.cephadm:Deploying osd.1 on smithi049 with /dev/vg_nvme/lv_3... 2024-09-19T08:56:19.378 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:56:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:19 smithi102 ceph-mon[35280]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:19 smithi102 ceph-mon[35280]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:56:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:19 smithi102 ceph-mon[35280]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:56:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:19 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:19 smithi102 ceph-mon[35280]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T08:56:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:19 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:19 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:19.625 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:56:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:20 smithi102 ceph-mon[35280]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T08:56:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:20 smithi102 ceph-mon[35280]: osdmap e8: 1 total, 0 up, 1 in 2024-09-19T08:56:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:20 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:20 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:20.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:20 smithi049 ceph-mon[28158]: from='osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T08:56:20.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:20 smithi049 ceph-mon[28158]: osdmap e8: 1 total, 0 up, 1 in 2024-09-19T08:56:20.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:20 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:20.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:20 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:21 smithi049 ceph-mon[28158]: purged_snaps scrub starts 2024-09-19T08:56:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:21 smithi049 ceph-mon[28158]: purged_snaps scrub ok 2024-09-19T08:56:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:21 smithi049 ceph-mon[28158]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:21 smithi049 ceph-mon[28158]: osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] boot 2024-09-19T08:56:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:21 smithi049 ceph-mon[28158]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:56:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:21 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:21 smithi102 ceph-mon[35280]: purged_snaps scrub starts 2024-09-19T08:56:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:21 smithi102 ceph-mon[35280]: purged_snaps scrub ok 2024-09-19T08:56:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:21 smithi102 ceph-mon[35280]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:21 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:21 smithi102 ceph-mon[35280]: osd.0 [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] boot 2024-09-19T08:56:21.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:21 smithi102 ceph-mon[35280]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:56:21.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:21 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:22.093 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:56:22.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_3 2024-09-19T08:56:22.387 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:22 smithi049 ceph-mon[28158]: osdmap e10: 1 total, 1 up, 1 in 2024-09-19T08:56:22.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:22 smithi102 ceph-mon[35280]: osdmap e10: 1 total, 1 up, 1 in 2024-09-19T08:56:23.337 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:23 smithi049 ceph-mon[28158]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:23.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:23 smithi102 ceph-mon[35280]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:23.579 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:56:25.240 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:25.240 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.240 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.240 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:25.240 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.241 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:25.241 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:25.241 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.241 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:25.501 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:25.501 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.501 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.501 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:25.501 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.501 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:25.501 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:25.502 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:25.502 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 -- 172.21.15.49:0/2612133575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 msgr2=0x7f0624100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 --2- 172.21.15.49:0/2612133575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 0x7f0624100120 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f06180097e0 tx=0x7f061802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 -- 172.21.15.49:0/2612133575 shutdown_connections 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 --2- 172.21.15.49:0/2612133575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 0x7f0624100120 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 --2- 172.21.15.49:0/2612133575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 0x7f06240feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 -- 172.21.15.49:0/2612133575 >> 172.21.15.49:0/2612133575 conn(0x7f06240fa250 msgr2=0x7f06240fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 -- 172.21.15.49:0/2612133575 shutdown_connections 2024-09-19T08:56:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.728+0000 7f06289f3640 1 -- 172.21.15.49:0/2612133575 wait complete. 2024-09-19T08:56:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.729+0000 7f06289f3640 1 Processor -- start 2024-09-19T08:56:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.729+0000 7f06289f3640 1 -- start start 2024-09-19T08:56:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.729+0000 7f06289f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 0x7f06241933d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.729+0000 7f06289f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 0x7f0624193910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.729+0000 7f06289f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624193ee0 con 0x7f06240feaa0 2024-09-19T08:56:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.729+0000 7f06289f3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624194050 con 0x7f06240ffca0 2024-09-19T08:56:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.729+0000 7f062259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 0x7f06241933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f062259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 0x7f06241933d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59284/0 (socket says 172.21.15.49:59284) 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f062259c640 1 -- 172.21.15.49:0/4291286015 learned_addr learned my addr 172.21.15.49:0/4291286015 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f0621d9b640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 0x7f0624193910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f062259c640 1 -- 172.21.15.49:0/4291286015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 msgr2=0x7f0624193910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f062259c640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 0x7f0624193910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f062259c640 1 -- 172.21.15.49:0/4291286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061400d570 con 0x7f06240feaa0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f062259c640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 0x7f06241933d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f061400c710 tx=0x7f061400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f06137fe640 1 -- 172.21.15.49:0/4291286015 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0614012040 con 0x7f06240feaa0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f06137fe640 1 -- 172.21.15.49:0/4291286015 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0614016420 con 0x7f06240feaa0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0618009490 con 0x7f06240feaa0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f06137fe640 1 -- 172.21.15.49:0/4291286015 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06140155b0 con 0x7f06240feaa0 2024-09-19T08:56:25.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.730+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0624198eb0 con 0x7f06240feaa0 2024-09-19T08:56:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.731+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0624106580 con 0x7f06240feaa0 2024-09-19T08:56:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.732+0000 7f06137fe640 1 -- 172.21.15.49:0/4291286015 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f0614016590 con 0x7f06240feaa0 2024-09-19T08:56:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.732+0000 7f06137fe640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f060c06cbd0 0x7f060c06f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.732+0000 7f06137fe640 1 -- 172.21.15.49:0/4291286015 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f061408cff0 con 0x7f06240feaa0 2024-09-19T08:56:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.732+0000 7f0621d9b640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f060c06cbd0 0x7f060c06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.733+0000 7f0621d9b640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f060c06cbd0 0x7f060c06f090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06241948f0 tx=0x7f0618030870 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.737+0000 7f06137fe640 1 -- 172.21.15.49:0/4291286015 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0614058240 con 0x7f06240feaa0 2024-09-19T08:56:25.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:25.929+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f06241045f0 con 0x7f060c06cbd0 2024-09-19T08:56:26.221 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:26 smithi049 ceph-mon[28158]: Detected new or changed devices on smithi049 2024-09-19T08:56:26.221 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:26 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi049 to 11840M 2024-09-19T08:56:26.221 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:26.221 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:26.222 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:26.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:26 smithi102 ceph-mon[35280]: Detected new or changed devices on smithi049 2024-09-19T08:56:26.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:26 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi049 to 11840M 2024-09-19T08:56:26.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:26.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:26.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:27.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:27 smithi049 ceph-mon[28158]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:27.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:27 smithi049 ceph-mon[28158]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:27.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:27.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:27 smithi102 ceph-mon[35280]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:27 smithi102 ceph-mon[35280]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:29 smithi102 ceph-mon[35280]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:29 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/4056666154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114e8646-e806-40cf-90ec-94f4f86baabe"}]: dispatch 2024-09-19T08:56:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:29 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/4056666154' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "114e8646-e806-40cf-90ec-94f4f86baabe"}]': finished 2024-09-19T08:56:29.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:29 smithi102 ceph-mon[35280]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:56:29.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:29 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:29 smithi049 ceph-mon[28158]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:29 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/4056666154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114e8646-e806-40cf-90ec-94f4f86baabe"}]: dispatch 2024-09-19T08:56:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:29 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/4056666154' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "114e8646-e806-40cf-90ec-94f4f86baabe"}]': finished 2024-09-19T08:56:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:29 smithi049 ceph-mon[28158]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:56:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:29 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:30.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:30 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1885494345' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:30.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:30 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1885494345' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:31 smithi102 ceph-mon[35280]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:31 smithi049 ceph-mon[28158]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:32 smithi102 ceph-mon[35280]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:32 smithi049 ceph-mon[28158]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:35.405 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:35 smithi049 ceph-mon[28158]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:35 smithi102 ceph-mon[35280]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:56:36.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:36.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:56:36.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:37.255 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:37 smithi049 ceph-mon[28158]: Deploying daemon osd.1 on smithi049 2024-09-19T08:56:37.256 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:37 smithi049 ceph-mon[28158]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:37.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:37 smithi102 ceph-mon[35280]: Deploying daemon osd.1 on smithi049 2024-09-19T08:56:38.278 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:37 smithi102 ceph-mon[35280]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:39.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:39 smithi102 ceph-mon[35280]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:39.526 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:39 smithi049 ceph-mon[28158]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:41.416 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:41 smithi049 ceph-mon[28158]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:41.417 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:41.417 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:41.417 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:41.425 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:41 smithi102 ceph-mon[35280]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:41.425 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:41.425 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:41.425 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:43 smithi102 ceph-mon[35280]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:43.544 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:43 smithi049 ceph-mon[28158]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:43.544 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:43.544 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:44.706 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 1 on host 'smithi049' 2024-09-19T08:56:44.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.706+0000 7f06137fe640 1 -- 172.21.15.49:0/4291286015 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f06241045f0 con 0x7f060c06cbd0 2024-09-19T08:56:44.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f060c06cbd0 msgr2=0x7f060c06f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f060c06cbd0 0x7f060c06f090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06241948f0 tx=0x7f0618030870 comp rx=0 tx=0).stop 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 msgr2=0x7f06241933d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 0x7f06241933d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f061400c710 tx=0x7f061400cbd0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 shutdown_connections 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f060c06cbd0 0x7f060c06f090 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06240ffca0 0x7f0624193910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 --2- 172.21.15.49:0/4291286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06240feaa0 0x7f06241933d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 >> 172.21.15.49:0/4291286015 conn(0x7f06240fa250 msgr2=0x7f0624102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 shutdown_connections 2024-09-19T08:56:44.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:44.708+0000 7f06289f3640 1 -- 172.21.15.49:0/4291286015 wait complete. 2024-09-19T08:56:45.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:45 smithi049 ceph-mon[28158]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:45.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:45 smithi049 ceph-mon[28158]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:56:45.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:45 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:45.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:45 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:45.362 DEBUG:teuthology.orchestra.run.smithi049:osd.1> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:56:45.364 INFO:tasks.cephadm:Deploying osd.2 on smithi049 with /dev/vg_nvme/lv_2... 2024-09-19T08:56:45.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:56:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:45 smithi102 ceph-mon[35280]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:45 smithi102 ceph-mon[35280]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:56:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:45 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:45 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:46.151 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:56:46.404 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:46 smithi049 ceph-mon[28158]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:56:46.404 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:46 smithi049 ceph-mon[28158]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:56:46.404 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:46 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:46.405 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:46 smithi049 ceph-mon[28158]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T08:56:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:46 smithi102 ceph-mon[35280]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:56:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:46 smithi102 ceph-mon[35280]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:56:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:46 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:46 smithi102 ceph-mon[35280]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T08:56:47.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:47.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T08:56:47.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: osdmap e13: 2 total, 1 up, 2 in 2024-09-19T08:56:47.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:47.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:47.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' 2024-09-19T08:56:47.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:47.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:47.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:56:46 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[54442]: 2024-09-19T08:56:46.912+0000 7f73af61f640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:56:47.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:56:46 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[54442]: 2024-09-19T08:56:46.915+0000 7f73a6417640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:56:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T08:56:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: osdmap e13: 2 total, 1 up, 2 in 2024-09-19T08:56:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: from='osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521]' entity='osd.1' 2024-09-19T08:56:47.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:56:47.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:48.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:48 smithi049 ceph-mon[28158]: purged_snaps scrub starts 2024-09-19T08:56:48.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:48 smithi049 ceph-mon[28158]: purged_snaps scrub ok 2024-09-19T08:56:48.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:48 smithi049 ceph-mon[28158]: osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] boot 2024-09-19T08:56:48.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:48 smithi049 ceph-mon[28158]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:56:48.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:48 smithi102 ceph-mon[35280]: purged_snaps scrub starts 2024-09-19T08:56:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:48 smithi102 ceph-mon[35280]: purged_snaps scrub ok 2024-09-19T08:56:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:48 smithi102 ceph-mon[35280]: osd.1 [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] boot 2024-09-19T08:56:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:48 smithi102 ceph-mon[35280]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:56:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:49.243 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:49 smithi049 ceph-mon[28158]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:49.246 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:56:49.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi049:vg_nvme/lv_2 2024-09-19T08:56:49.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:49 smithi102 ceph-mon[35280]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:49.808 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:56:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:50 smithi102 ceph-mon[35280]: osdmap e15: 2 total, 2 up, 2 in 2024-09-19T08:56:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:50 smithi102 ceph-mon[35280]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:50.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:50 smithi049 ceph-mon[28158]: osdmap e15: 2 total, 2 up, 2 in 2024-09-19T08:56:50.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:50.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:50.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:50 smithi049 ceph-mon[28158]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:51.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 -- 172.21.15.49:0/1491607786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8100680 msgr2=0x7f00f8102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:51.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 --2- 172.21.15.49:0/1491607786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8100680 0x7f00f8102a70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00e80098b0 tx=0x7f00e802a4d0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 -- 172.21.15.49:0/1491607786 shutdown_connections 2024-09-19T08:56:51.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 --2- 172.21.15.49:0/1491607786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f8102fb0 0x7f00f81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 --2- 172.21.15.49:0/1491607786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8100680 0x7f00f8102a70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 -- 172.21.15.49:0/1491607786 >> 172.21.15.49:0/1491607786 conn(0x7f00f80fa280 msgr2=0x7f00f80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 -- 172.21.15.49:0/1491607786 shutdown_connections 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 -- 172.21.15.49:0/1491607786 wait complete. 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.986+0000 7f00fddbc640 1 Processor -- start 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00fddbc640 1 -- start start 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00fddbc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f8100680 0x7f00f81956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00fddbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8102fb0 0x7f00f8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00fddbc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8196170 con 0x7f00f8102fb0 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00fddbc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f81962e0 con 0x7f00f8100680 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00eeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8102fb0 0x7f00f8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:51.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00eeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8102fb0 0x7f00f8195c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60480/0 (socket says 172.21.15.49:60480) 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00eeffd640 1 -- 172.21.15.49:0/2995890755 learned_addr learned my addr 172.21.15.49:0/2995890755 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00f77fe640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f8100680 0x7f00f81956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00eeffd640 1 -- 172.21.15.49:0/2995890755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f8100680 msgr2=0x7f00f81956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00eeffd640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f8100680 0x7f00f81956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.987+0000 7f00eeffd640 1 -- 172.21.15.49:0/2995890755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8009560 con 0x7f00f8102fb0 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.988+0000 7f00eeffd640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8102fb0 0x7f00f8195c30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c8f0 tx=0x7f00e000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.988+0000 7f00f57fa640 1 -- 172.21.15.49:0/2995890755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e0004410 con 0x7f00f8102fb0 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.988+0000 7f00f57fa640 1 -- 172.21.15.49:0/2995890755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00e0007c60 con 0x7f00f8102fb0 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.988+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f819adc0 con 0x7f00f8102fb0 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.988+0000 7f00f57fa640 1 -- 172.21.15.49:0/2995890755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e000f450 con 0x7f00f8102fb0 2024-09-19T08:56:51.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.988+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f819b2c0 con 0x7f00f8102fb0 2024-09-19T08:56:51.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.989+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f8108810 con 0x7f00f8102fb0 2024-09-19T08:56:51.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.989+0000 7f00f57fa640 1 -- 172.21.15.49:0/2995890755 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f00e00077a0 con 0x7f00f8102fb0 2024-09-19T08:56:51.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.990+0000 7f00f57fa640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f00e406cbd0 0x7f00e406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:51.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.990+0000 7f00f57fa640 1 -- 172.21.15.49:0/2995890755 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f00e008b440 con 0x7f00f8102fb0 2024-09-19T08:56:51.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.990+0000 7f00f77fe640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f00e406cbd0 0x7f00e406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:51.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.990+0000 7f00f77fe640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f00e406cbd0 0x7f00e406f090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00e8006010 tx=0x7f00e80314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:51.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:51.994+0000 7f00f57fa640 1 -- 172.21.15.49:0/2995890755 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f00e0056590 con 0x7f00f8102fb0 2024-09-19T08:56:52.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:56:52.176+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f00f81039d0 con 0x7f00e406cbd0 2024-09-19T08:56:53.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:53 smithi049 ceph-mon[28158]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:53.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:53 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:53.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:53 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:53.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:53 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:53 smithi102 ceph-mon[35280]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:53 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:53 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:53 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:54.426 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:54 smithi049 ceph-mon[28158]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:54.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:54 smithi102 ceph-mon[35280]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:55.296 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:55.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.298 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:55.406 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:56.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:56 smithi102 ceph-mon[35280]: Detected new or changed devices on smithi049 2024-09-19T08:56:56.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:56 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi049 to 5920M 2024-09-19T08:56:56.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:56 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1467653741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "551521d5-2a1d-4ab1-9071-31885cbb5dd7"}]: dispatch 2024-09-19T08:56:56.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:56 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1467653741' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "551521d5-2a1d-4ab1-9071-31885cbb5dd7"}]': finished 2024-09-19T08:56:56.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:56 smithi102 ceph-mon[35280]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:56:56.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:56 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:56:56.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:56 smithi049 ceph-mon[28158]: Detected new or changed devices on smithi049 2024-09-19T08:56:56.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:56 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi049 to 5920M 2024-09-19T08:56:56.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:56 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1467653741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "551521d5-2a1d-4ab1-9071-31885cbb5dd7"}]: dispatch 2024-09-19T08:56:56.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:56 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1467653741' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "551521d5-2a1d-4ab1-9071-31885cbb5dd7"}]': finished 2024-09-19T08:56:56.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:56 smithi049 ceph-mon[28158]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:56:56.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:56 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:56:57.391 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:57 smithi049 ceph-mon[28158]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:57.391 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:57 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1736934366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:57.391 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:57.392 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:57 smithi102 ceph-mon[35280]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:57 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1736934366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:56:59.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:56:59 smithi049 ceph-mon[28158]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:56:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:56:59 smithi102 ceph-mon[35280]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:00 smithi049 ceph-mon[28158]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:00 smithi102 ceph-mon[35280]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:02.449 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:02.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:02 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:03.411 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:03 smithi049 ceph-mon[28158]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:03.411 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:03 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:57:03.412 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:03 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:03 smithi102 ceph-mon[35280]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:03 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:57:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:03 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:04.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:04 smithi049 ceph-mon[28158]: Deploying daemon osd.2 on smithi049 2024-09-19T08:57:04.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:04 smithi102 ceph-mon[35280]: Deploying daemon osd.2 on smithi049 2024-09-19T08:57:05.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:05 smithi049 ceph-mon[28158]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:05.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:05 smithi102 ceph-mon[35280]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:07.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:07 smithi102 ceph-mon[35280]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:07.549 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:07 smithi049 ceph-mon[28158]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:08.376 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:08.376 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:08.376 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:09.409 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:09 smithi102 ceph-mon[35280]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:09.417 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:09 smithi049 ceph-mon[28158]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:10.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:10 smithi049 ceph-mon[28158]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:10.424 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:10 smithi102 ceph-mon[35280]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:11.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.762+0000 7f00f57fa640 1 -- 172.21.15.49:0/2995890755 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f00f81039d0 con 0x7f00e406cbd0 2024-09-19T08:57:11.763 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 2 on host 'smithi049' 2024-09-19T08:57:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f00e406cbd0 msgr2=0x7f00e406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f00e406cbd0 0x7f00e406f090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00e8006010 tx=0x7f00e80314e0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8102fb0 msgr2=0x7f00f8195c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8102fb0 0x7f00f8195c30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c8f0 tx=0x7f00e000cdb0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 shutdown_connections 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f00e406cbd0 0x7f00e406f090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f8102fb0 0x7f00f8195c30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 --2- 172.21.15.49:0/2995890755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f8100680 0x7f00f81956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 >> 172.21.15.49:0/2995890755 conn(0x7f00f80fa280 msgr2=0x7f00f80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 shutdown_connections 2024-09-19T08:57:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:57:11.764+0000 7f00fddbc640 1 -- 172.21.15.49:0/2995890755 wait complete. 2024-09-19T08:57:12.780 DEBUG:teuthology.orchestra.run.smithi049:osd.2> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:57:12.782 INFO:tasks.cephadm:Deploying osd.3 on smithi102 with /dev/vg_nvme/lv_4... 2024-09-19T08:57:12.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:57:12.998 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:57:13.007 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:13.008 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:12 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:13.008 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:12 smithi049 ceph-mon[28158]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:13.008 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:12 smithi049 ceph-mon[28158]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:13.118 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:13.118 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:12 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:13.118 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:12 smithi102 ceph-mon[35280]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:13.118 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:12 smithi102 ceph-mon[35280]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:14.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:13 smithi049 ceph-mon[28158]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:57:14.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:13 smithi049 ceph-mon[28158]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:57:14.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:13 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:14.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:13 smithi049 ceph-mon[28158]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T08:57:14.089 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:13 smithi102 ceph-mon[35280]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:57:14.089 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:13 smithi102 ceph-mon[35280]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:57:14.089 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:13 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:14.089 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:13 smithi102 ceph-mon[35280]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T08:57:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-mon[28158]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T08:57:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-mon[28158]: osdmap e18: 3 total, 2 up, 3 in 2024-09-19T08:57:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-mon[28158]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-mon[28158]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' 2024-09-19T08:57:14.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[62047]: 2024-09-19T08:57:14.612+0000 7f8775bef640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:57:14.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:14 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[62047]: 2024-09-19T08:57:14.617+0000 7f876e222640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:57:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:14 smithi102 ceph-mon[35280]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-19T08:57:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:14 smithi102 ceph-mon[35280]: osdmap e18: 3 total, 2 up, 3 in 2024-09-19T08:57:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:14 smithi102 ceph-mon[35280]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:14 smithi102 ceph-mon[35280]: from='osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759]' entity='osd.2' 2024-09-19T08:57:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:57:15.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_4 2024-09-19T08:57:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:57:15.982 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: purged_snaps scrub starts 2024-09-19T08:57:15.982 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: purged_snaps scrub ok 2024-09-19T08:57:15.982 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:15.982 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:15.983 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:15.983 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] boot 2024-09-19T08:57:15.983 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:57:15.983 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:15 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: purged_snaps scrub starts 2024-09-19T08:57:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: purged_snaps scrub ok 2024-09-19T08:57:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: osd.2 [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] boot 2024-09-19T08:57:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:57:16.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:15 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:17.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:16 smithi102 ceph-mon[35280]: pgmap v74: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:17.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:16 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:17.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:16 smithi049 ceph-mon[28158]: pgmap v74: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:17.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:16 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 -- 172.21.15.102:0/3194992872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 msgr2=0x7feb34101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 --2- 172.21.15.102:0/3194992872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb34101210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feb28009880 tx=0x7feb2802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 -- 172.21.15.102:0/3194992872 shutdown_connections 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 --2- 172.21.15.102:0/3194992872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb34101210 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 --2- 172.21.15.102:0/3194992872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb340ffb90 0x7feb340fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 -- 172.21.15.102:0/3194992872 >> 172.21.15.102:0/3194992872 conn(0x7feb340fb320 msgr2=0x7feb340fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 -- 172.21.15.102:0/3194992872 shutdown_connections 2024-09-19T08:57:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 -- 172.21.15.102:0/3194992872 wait complete. 2024-09-19T08:57:17.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.095+0000 7feb38eee640 1 Processor -- start 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb38eee640 1 -- start start 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb38eee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb340ffb90 0x7feb34074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb38eee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb340728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb38eee640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb34072de0 con 0x7feb340ffb90 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb38eee640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb34072f50 con 0x7feb34100d90 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb31d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb340728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb31d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb340728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49612/0 (socket says 172.21.15.102:49612) 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb31d9b640 1 -- 172.21.15.102:0/4085246911 learned_addr learned my addr 172.21.15.102:0/4085246911 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb3259c640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb340ffb90 0x7feb34074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb31d9b640 1 -- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb340ffb90 msgr2=0x7feb34074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb31d9b640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb340ffb90 0x7feb34074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb31d9b640 1 -- 172.21.15.102:0/4085246911 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb28009560 con 0x7feb34100d90 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb31d9b640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb340728a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb280054f0 tx=0x7feb28005520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb28004aa0 con 0x7feb34100d90 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb28004c00 con 0x7feb34100d90 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.096+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb340731d0 con 0x7feb34100d90 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.097+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb28003ac0 con 0x7feb34100d90 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.097+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3419d690 con 0x7feb34100d90 2024-09-19T08:57:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.097+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3418f730 con 0x7feb34100d90 2024-09-19T08:57:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.098+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7feb28003d30 con 0x7feb34100d90 2024-09-19T08:57:17.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.098+0000 7feb237fe640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7feb1c06cbd0 0x7feb1c06f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:17.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.098+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3221+0+0 (secure 0 0 0) 0x7feb280ac970 con 0x7feb34100d90 2024-09-19T08:57:17.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.099+0000 7feb3259c640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7feb1c06cbd0 0x7feb1c06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:17.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.099+0000 7feb3259c640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7feb1c06cbd0 0x7feb1c06f090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb24005fd0 tx=0x7feb2400b390 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.103+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb28077810 con 0x7feb34100d90 2024-09-19T08:57:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:17.273+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7feb340608f0 con 0x7feb1c06cbd0 2024-09-19T08:57:17.959 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:17.959 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:17 smithi102 ceph-mon[35280]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:57:17.959 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:17.959 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:17.959 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:17.959 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:17.959 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:18.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:18.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:17 smithi049 ceph-mon[28158]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:57:18.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:18.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:18.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:18.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:18.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:18.841 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:18.841 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:18.841 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T08:57:18.841 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:18.841 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: Detected new or changed devices on smithi049 2024-09-19T08:57:18.841 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi049 to 3946M 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:18.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:18 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:19.052 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:18 smithi049 sudo[66368]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:19.052 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:18 smithi049 sudo[66368]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:19.052 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:18 smithi049 sudo[66368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:19.052 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:18 smithi049 sudo[66368]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: Detected new or changed devices on smithi049 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi049 to 3946M 2024-09-19T08:57:19.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:19.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:19.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:19.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:19.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:18 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:19.707 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66417]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:19.707 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66417]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:19.707 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:19.707 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66417]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:20.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66506]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:20.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66506]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:20.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:20.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:19 smithi049 sudo[66506]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:20.469 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66557]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:20.469 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66557]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:20.470 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:20.470 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66557]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:20.470 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T08:57:20.470 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:20.470 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/3557790827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "045c1198-0304-45d4-8f1f-082605b54826"}]: dispatch 2024-09-19T08:57:20.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "045c1198-0304-45d4-8f1f-082605b54826"}]: dispatch 2024-09-19T08:57:20.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "045c1198-0304-45d4-8f1f-082605b54826"}]': finished 2024-09-19T08:57:20.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:57:20.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:20.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:20 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/2102618610' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:20.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:20.503+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7feb28031c70 con 0x7feb34100d90 2024-09-19T08:57:20.503 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T08:57:20.504 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:20.504 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/3557790827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "045c1198-0304-45d4-8f1f-082605b54826"}]: dispatch 2024-09-19T08:57:20.504 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "045c1198-0304-45d4-8f1f-082605b54826"}]: dispatch 2024-09-19T08:57:20.504 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "045c1198-0304-45d4-8f1f-082605b54826"}]': finished 2024-09-19T08:57:20.505 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:57:20.505 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:20.505 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:20 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/2102618610' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:21.052 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66586]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:21.052 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66586]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:21.052 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:21.052 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:20 smithi049 sudo[66586]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:21.425 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:21 smithi049 ceph-mon[28158]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:21.425 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:21 smithi049 ceph-mon[28158]: mgrmap e19: smithi049.qdvksw(active, since 2m), standbys: smithi102.csalqv 2024-09-19T08:57:21.426 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66632]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:21.426 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66632]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:21.426 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:21.426 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66632]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:21 smithi102 ceph-mon[35280]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:21 smithi102 ceph-mon[35280]: mgrmap e19: smithi049.qdvksw(active, since 2m), standbys: smithi102.csalqv 2024-09-19T08:57:21.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66667]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:21.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66667]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:21.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:21.710 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:21 smithi049 sudo[66667]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:22.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 sudo[66724]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:22.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 sudo[66724]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:22.529 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 sudo[66724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:22.529 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 sudo[66724]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:22.635 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40009]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:22.636 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40009]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:22.636 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:22.636 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40009]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:22.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 ceph-mon[28158]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:22.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 ceph-mon[28158]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:22.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 ceph-mon[28158]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:22.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:57:22.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:57:22.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:57:22.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:22 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40197]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40197]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 sudo[40197]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 ceph-mon[35280]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 ceph-mon[35280]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 ceph-mon[35280]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:57:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:57:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T08:57:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:22 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:23.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:24.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:24.903 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:24 smithi102 ceph-mon[35280]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:25.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:24 smithi049 ceph-mon[28158]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:27.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:27 smithi049 ceph-mon[28158]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:27.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:57:27.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:27.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:27 smithi102 ceph-mon[35280]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:27.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:57:27.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:28.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:28 smithi102 ceph-mon[35280]: Deploying daemon osd.3 on smithi102 2024-09-19T08:57:28.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:28 smithi049 ceph-mon[28158]: Deploying daemon osd.3 on smithi102 2024-09-19T08:57:29.457 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:29 smithi102 ceph-mon[35280]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:29 smithi049 ceph-mon[28158]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:31.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:31 smithi102 ceph-mon[35280]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:31.446 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:31.446 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:31.446 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:31 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:31 smithi049 ceph-mon[28158]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:31 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:32.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:32.453 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:33.467 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:33 smithi102 ceph-mon[35280]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:33.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:33 smithi049 ceph-mon[28158]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:34.528 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 3 on host 'smithi102' 2024-09-19T08:57:34.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.527+0000 7feb237fe640 1 -- 172.21.15.102:0/4085246911 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feb340608f0 con 0x7feb1c06cbd0 2024-09-19T08:57:34.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7feb1c06cbd0 msgr2=0x7feb1c06f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:34.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7feb1c06cbd0 0x7feb1c06f090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb24005fd0 tx=0x7feb2400b390 comp rx=0 tx=0).stop 2024-09-19T08:57:34.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 msgr2=0x7feb340728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb340728a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb280054f0 tx=0x7feb28005520 comp rx=0 tx=0).stop 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 shutdown_connections 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7feb1c06cbd0 0x7feb1c06f090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb34100d90 0x7feb340728a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 --2- 172.21.15.102:0/4085246911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb340ffb90 0x7feb34074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 >> 172.21.15.102:0/4085246911 conn(0x7feb340fb320 msgr2=0x7feb34104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 shutdown_connections 2024-09-19T08:57:34.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:34.530+0000 7feb38eee640 1 -- 172.21.15.102:0/4085246911 wait complete. 2024-09-19T08:57:35.098 DEBUG:teuthology.orchestra.run.smithi102:osd.3> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:57:35.100 INFO:tasks.cephadm:Deploying osd.4 on smithi102 with /dev/vg_nvme/lv_3... 2024-09-19T08:57:35.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:57:35.340 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:57:35.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:35 smithi102 ceph-mon[35280]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:35.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:35.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:35 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:35.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:35 smithi102 ceph-mon[35280]: from='osd.3 [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:57:35.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:35 smithi102 ceph-mon[35280]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:57:35.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:35 smithi049 ceph-mon[28158]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:35.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:35.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:35 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:35.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:35 smithi049 ceph-mon[28158]: from='osd.3 [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:57:35.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:35 smithi049 ceph-mon[28158]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:57:36.448 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:36.449 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:36.449 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:57:36.449 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:57:36.449 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:36.449 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: from='osd.3 [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:57:36.449 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:57:36.449 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-mon[35280]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:36.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:36.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:36.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:57:36.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:57:36.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: from='osd.3 [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:57:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:57:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:36 smithi049 ceph-mon[28158]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:36.737 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[41234]: 2024-09-19T08:57:36.535+0000 7fd5635ed640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:57:36.737 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 08:57:36 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[41234]: 2024-09-19T08:57:36.541+0000 7fd55fc28640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:57:37.571 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:57:37.590 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_3 2024-09-19T08:57:37.727 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:37 smithi102 ceph-mon[35280]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T08:57:37.727 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:37 smithi102 ceph-mon[35280]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T08:57:37.727 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:37 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:37.727 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:37 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:37.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:37 smithi049 ceph-mon[28158]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T08:57:37.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:37 smithi049 ceph-mon[28158]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T08:57:37.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:37 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:37.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:37 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:57:38.654 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:38 smithi102 ceph-mon[35280]: purged_snaps scrub starts 2024-09-19T08:57:38.654 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:38 smithi102 ceph-mon[35280]: purged_snaps scrub ok 2024-09-19T08:57:38.654 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:38 smithi102 ceph-mon[35280]: osd.3 [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] boot 2024-09-19T08:57:38.654 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:38 smithi102 ceph-mon[35280]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:57:38.655 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:38.655 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:38 smithi102 ceph-mon[35280]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:38.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:38 smithi049 ceph-mon[28158]: purged_snaps scrub starts 2024-09-19T08:57:38.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:38 smithi049 ceph-mon[28158]: purged_snaps scrub ok 2024-09-19T08:57:38.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:38 smithi049 ceph-mon[28158]: osd.3 [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] boot 2024-09-19T08:57:38.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:38 smithi049 ceph-mon[28158]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:57:38.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:38.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:38 smithi049 ceph-mon[28158]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:39.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:39 smithi049 ceph-mon[28158]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:57:39.850 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:39 smithi102 ceph-mon[35280]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- 172.21.15.102:0/1488526250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 msgr2=0x7fee841053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 --2- 172.21.15.102:0/1488526250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee841053d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee78009880 tx=0x7fee7802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- 172.21.15.102:0/1488526250 shutdown_connections 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 --2- 172.21.15.102:0/1488526250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee841053d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 --2- 172.21.15.102:0/1488526250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee841006b0 0x7fee84102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- 172.21.15.102:0/1488526250 >> 172.21.15.102:0/1488526250 conn(0x7fee840fa230 msgr2=0x7fee840fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- 172.21.15.102:0/1488526250 shutdown_connections 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- 172.21.15.102:0/1488526250 wait complete. 2024-09-19T08:57:40.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 Processor -- start 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- start start 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee841006b0 0x7fee84195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee84195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84196210 con 0x7fee841006b0 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.520+0000 7fee8ac75640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84196380 con 0x7fee84102fe0 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee83fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee84195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee83fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee84195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57702/0 (socket says 172.21.15.102:57702) 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee83fff640 1 -- 172.21.15.102:0/2610919081 learned_addr learned my addr 172.21.15.102:0/2610919081 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:57:40.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee88a11640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee841006b0 0x7fee84195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee83fff640 1 -- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee841006b0 msgr2=0x7fee84195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee83fff640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee841006b0 0x7fee84195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee83fff640 1 -- 172.21.15.102:0/2610919081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78009560 con 0x7fee84102fe0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee88a11640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee841006b0 0x7fee84195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee83fff640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee84195c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee7802a9c0 tx=0x7fee78005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee81ffb640 1 -- 172.21.15.102:0/2610919081 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee78004b20 con 0x7fee84102fe0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8419adc0 con 0x7fee84102fe0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee81ffb640 1 -- 172.21.15.102:0/2610919081 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee78004c80 con 0x7fee84102fe0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.521+0000 7fee81ffb640 1 -- 172.21.15.102:0/2610919081 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee78003b80 con 0x7fee84102fe0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.522+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8419b330 con 0x7fee84102fe0 2024-09-19T08:57:40.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.522+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee841087e0 con 0x7fee84102fe0 2024-09-19T08:57:40.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.523+0000 7fee81ffb640 1 -- 172.21.15.102:0/2610919081 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fee78031640 con 0x7fee84102fe0 2024-09-19T08:57:40.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.523+0000 7fee81ffb640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee6c06cc50 0x7fee6c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:40.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.523+0000 7fee81ffb640 1 -- 172.21.15.102:0/2610919081 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3803+0+0 (secure 0 0 0) 0x7fee780acf00 con 0x7fee84102fe0 2024-09-19T08:57:40.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.524+0000 7fee88a11640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee6c06cc50 0x7fee6c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:40.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.524+0000 7fee88a11640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee6c06cc50 0x7fee6c06f110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee74006fd0 tx=0x7fee74008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:40.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.528+0000 7fee81ffb640 1 -- 172.21.15.102:0/2610919081 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fee78077950 con 0x7fee84102fe0 2024-09-19T08:57:40.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:40.705+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fee84103a00 con 0x7fee6c06cc50 2024-09-19T08:57:40.706 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:40 smithi102 ceph-mon[35280]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T08:57:40.706 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:40 smithi102 ceph-mon[35280]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:40.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:40 smithi049 ceph-mon[28158]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T08:57:40.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:40 smithi049 ceph-mon[28158]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:41.847 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: Detected new or changed devices on smithi102 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi102 to 14912M 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:41.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:41.849 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:41.849 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:41.849 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:41.849 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:41.849 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:41.849 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:41 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:42.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T08:57:42.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:42.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:42.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:42.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:42.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: Detected new or changed devices on smithi102 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi102 to 14912M 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:41 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:42.836 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:42 smithi102 ceph-mon[35280]: osdmap e30: 4 total, 4 up, 4 in 2024-09-19T08:57:42.836 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:42 smithi102 ceph-mon[35280]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:42.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:42 smithi049 ceph-mon[28158]: osdmap e30: 4 total, 4 up, 4 in 2024-09-19T08:57:42.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:42 smithi049 ceph-mon[28158]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:43.674 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:43 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/2641858438' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff3b1b75-7d2a-4613-8289-b4474ddd2eb6"}]: dispatch 2024-09-19T08:57:43.675 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:43 smithi102 ceph-mon[35280]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff3b1b75-7d2a-4613-8289-b4474ddd2eb6"}]: dispatch 2024-09-19T08:57:43.675 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:43 smithi102 ceph-mon[35280]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff3b1b75-7d2a-4613-8289-b4474ddd2eb6"}]': finished 2024-09-19T08:57:43.675 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:43 smithi102 ceph-mon[35280]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:57:43.675 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:57:44.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:43 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/2641858438' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff3b1b75-7d2a-4613-8289-b4474ddd2eb6"}]: dispatch 2024-09-19T08:57:44.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:43 smithi049 ceph-mon[28158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff3b1b75-7d2a-4613-8289-b4474ddd2eb6"}]: dispatch 2024-09-19T08:57:44.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:43 smithi049 ceph-mon[28158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff3b1b75-7d2a-4613-8289-b4474ddd2eb6"}]': finished 2024-09-19T08:57:44.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:43 smithi049 ceph-mon[28158]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:57:44.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:57:45.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:44 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/2491385993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:45.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:44 smithi102 ceph-mon[35280]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-19T08:57:45.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:44 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/2491385993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:45.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:44 smithi049 ceph-mon[28158]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-19T08:57:47.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:47 smithi049 ceph-mon[28158]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:57:47.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:47 smithi102 ceph-mon[35280]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:57:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:57:49.324 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:49 smithi102 ceph-mon[35280]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T08:57:49.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:49 smithi049 ceph-mon[28158]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T08:57:50.413 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:57:50.413 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:50.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:57:50.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:51.415 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:51 smithi102 ceph-mon[35280]: Deploying daemon osd.4 on smithi102 2024-09-19T08:57:51.416 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:51 smithi102 ceph-mon[35280]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T08:57:51.453 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:51 smithi049 ceph-mon[28158]: Deploying daemon osd.4 on smithi102 2024-09-19T08:57:51.453 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:51 smithi049 ceph-mon[28158]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T08:57:53.414 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:53 smithi102 ceph-mon[35280]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:57:53.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:53 smithi049 ceph-mon[28158]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:57:55.417 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:55 smithi102 ceph-mon[35280]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T08:57:55.418 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:55.418 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:55.418 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:55.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:55 smithi049 ceph-mon[28158]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T08:57:55.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:55.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:55.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:57.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:57 smithi049 ceph-mon[28158]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:57.420 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:57 smithi102 ceph-mon[35280]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.451+0000 7fee81ffb640 1 -- 172.21.15.102:0/2610919081 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fee84103a00 con 0x7fee6c06cc50 2024-09-19T08:57:57.451 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 4 on host 'smithi102' 2024-09-19T08:57:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee6c06cc50 msgr2=0x7fee6c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee6c06cc50 0x7fee6c06f110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee74006fd0 tx=0x7fee74008040 comp rx=0 tx=0).stop 2024-09-19T08:57:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 msgr2=0x7fee84195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee84195c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee7802a9c0 tx=0x7fee78005610 comp rx=0 tx=0).stop 2024-09-19T08:57:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 shutdown_connections 2024-09-19T08:57:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee6c06cc50 0x7fee6c06f110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee84102fe0 0x7fee84195c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 --2- 172.21.15.102:0/2610919081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee841006b0 0x7fee84195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 >> 172.21.15.102:0/2610919081 conn(0x7fee840fa230 msgr2=0x7fee840fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 shutdown_connections 2024-09-19T08:57:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:57:57.453+0000 7fee8ac75640 1 -- 172.21.15.102:0/2610919081 wait complete. 2024-09-19T08:57:58.413 DEBUG:teuthology.orchestra.run.smithi102:osd.4> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:57:58.416 INFO:tasks.cephadm:Deploying osd.5 on smithi102 with /dev/vg_nvme/lv_2... 2024-09-19T08:57:58.416 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:57:58.712 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:58 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:58.712 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:58 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:58.712 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:58 smithi102 ceph-mon[35280]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:58.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:58 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:58.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:58 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:57:58.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:58 smithi049 ceph-mon[28158]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:59.008 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 08:57:58 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[48086]: 2024-09-19T08:57:58.776+0000 7efed6231640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:57:59.223 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:57:59.624 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:59 smithi102 ceph-mon[35280]: from='osd.4 [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:57:59.624 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:57:59 smithi102 ceph-mon[35280]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:57:59.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:59 smithi049 ceph-mon[28158]: from='osd.4 [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:57:59.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:57:59 smithi049 ceph-mon[28158]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: from='osd.4 [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:00.646 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:00 smithi102 ceph-mon[35280]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:00.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:58:00.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T08:58:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: from='osd.4 [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:00 smithi049 ceph-mon[28158]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:01.609 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 08:58:01 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[48086]: 2024-09-19T08:58:01.325+0000 7efed198f640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:58:01.609 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 08:58:01 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[48086]: 2024-09-19T08:58:01.333+0000 7efec9fc2640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:58:01.609 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:01 smithi102 ceph-mon[35280]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T08:58:01.609 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:01 smithi102 ceph-mon[35280]: osdmap e33: 5 total, 4 up, 5 in 2024-09-19T08:58:01.609 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:01 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:01.609 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:01 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:01.609 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:01 smithi102 ceph-mon[35280]: from='osd.4 ' entity='osd.4' 2024-09-19T08:58:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:01 smithi049 ceph-mon[28158]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T08:58:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:01 smithi049 ceph-mon[28158]: osdmap e33: 5 total, 4 up, 5 in 2024-09-19T08:58:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:01 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:01 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:01 smithi049 ceph-mon[28158]: from='osd.4 ' entity='osd.4' 2024-09-19T08:58:02.421 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T08:58:02.442 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_2 2024-09-19T08:58:02.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:02 smithi049 ceph-mon[28158]: purged_snaps scrub starts 2024-09-19T08:58:02.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:02 smithi049 ceph-mon[28158]: purged_snaps scrub ok 2024-09-19T08:58:02.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:02 smithi049 ceph-mon[28158]: osd.4 [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] boot 2024-09-19T08:58:02.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:02 smithi049 ceph-mon[28158]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T08:58:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:02 smithi049 ceph-mon[28158]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 487 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:02.702 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:02 smithi102 ceph-mon[35280]: purged_snaps scrub starts 2024-09-19T08:58:02.702 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:02 smithi102 ceph-mon[35280]: purged_snaps scrub ok 2024-09-19T08:58:02.702 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:02 smithi102 ceph-mon[35280]: osd.4 [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] boot 2024-09-19T08:58:02.702 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:02 smithi102 ceph-mon[35280]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T08:58:02.702 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:02 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:02.702 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:02 smithi102 ceph-mon[35280]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 487 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:02.702 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:02 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:02.917 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:58:03.654 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:03 smithi102 ceph-mon[35280]: osdmap e35: 5 total, 5 up, 5 in 2024-09-19T08:58:03.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:03 smithi049 ceph-mon[28158]: osdmap e35: 5 total, 5 up, 5 in 2024-09-19T08:58:04.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:04 smithi102 ceph-mon[35280]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 487 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:04.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:04 smithi049 ceph-mon[28158]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 487 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 -- 172.21.15.102:0/2079238626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280ffcf0 msgr2=0x7f3628100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 --2- 172.21.15.102:0/2079238626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280ffcf0 0x7f3628100170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3618009880 tx=0x7f361802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 -- 172.21.15.102:0/2079238626 shutdown_connections 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 --2- 172.21.15.102:0/2079238626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280ffcf0 0x7f3628100170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 --2- 172.21.15.102:0/2079238626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36280feaf0 0x7f36280feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 -- 172.21.15.102:0/2079238626 >> 172.21.15.102:0/2079238626 conn(0x7f36280fa280 msgr2=0x7f36280fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 -- 172.21.15.102:0/2079238626 shutdown_connections 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.185+0000 7f363038a640 1 -- 172.21.15.102:0/2079238626 wait complete. 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f363038a640 1 Processor -- start 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f363038a640 1 -- start start 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f363038a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280feaf0 0x7f36281945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f363038a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36280ffcf0 0x7f3628194b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:05.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f363038a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628195100 con 0x7f36280ffcf0 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f363038a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628195270 con 0x7f36280feaf0 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f362e126640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280feaf0 0x7f36281945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f362e126640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280feaf0 0x7f36281945f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39400/0 (socket says 172.21.15.102:39400) 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f362e126640 1 -- 172.21.15.102:0/2654189293 learned_addr learned my addr 172.21.15.102:0/2654189293 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.186+0000 7f362d925640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36280ffcf0 0x7f3628194b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f362e126640 1 -- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36280ffcf0 msgr2=0x7f3628194b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f362e126640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36280ffcf0 0x7f3628194b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f362e126640 1 -- 172.21.15.102:0/2654189293 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618009560 con 0x7f36280feaf0 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f362e126640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280feaf0 0x7f36281945f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f362400e940 tx=0x7f362400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f361f7fe640 1 -- 172.21.15.102:0/2654189293 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36240096e0 con 0x7f36280feaf0 2024-09-19T08:58:05.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3628199cc0 con 0x7f36280feaf0 2024-09-19T08:58:05.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f361f7fe640 1 -- 172.21.15.102:0/2654189293 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36240044f0 con 0x7f36280feaf0 2024-09-19T08:58:05.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f361f7fe640 1 -- 172.21.15.102:0/2654189293 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3624010430 con 0x7f36280feaf0 2024-09-19T08:58:05.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.187+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362819a190 con 0x7f36280feaf0 2024-09-19T08:58:05.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.188+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36280feef0 con 0x7f36280feaf0 2024-09-19T08:58:05.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.188+0000 7f361f7fe640 1 -- 172.21.15.102:0/2654189293 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f362400cc90 con 0x7f36280feaf0 2024-09-19T08:58:05.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.189+0000 7f361f7fe640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f361406cc50 0x7f361406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:05.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.189+0000 7f361f7fe640 1 -- 172.21.15.102:0/2654189293 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f3624014070 con 0x7f36280feaf0 2024-09-19T08:58:05.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.189+0000 7f362d925640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f361406cc50 0x7f361406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:05.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.189+0000 7f362d925640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f361406cc50 0x7f361406f110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3618000c00 tx=0x7f36180314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:05.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.193+0000 7f361f7fe640 1 -- 172.21.15.102:0/2654189293 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3624056a60 con 0x7f36280feaf0 2024-09-19T08:58:05.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:05.362+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f362802c5d0 con 0x7f361406cc50 2024-09-19T08:58:06.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: Detected new or changed devices on smithi102 2024-09-19T08:58:06.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi102 to 7456M 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:06.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:05 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:06.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: Detected new or changed devices on smithi102 2024-09-19T08:58:06.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi102 to 7456M 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:06.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:06.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:06.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:05 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:07.177 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:06 smithi102 ceph-mon[35280]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:07.177 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:06 smithi102 ceph-mon[35280]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 487 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:07.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:06 smithi049 ceph-mon[28158]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:07.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:06 smithi049 ceph-mon[28158]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 487 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:07 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/3307740678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab307451-1db6-458f-94d9-d20444cf2a0b"}]: dispatch 2024-09-19T08:58:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:07 smithi102 ceph-mon[35280]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab307451-1db6-458f-94d9-d20444cf2a0b"}]: dispatch 2024-09-19T08:58:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:07 smithi102 ceph-mon[35280]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab307451-1db6-458f-94d9-d20444cf2a0b"}]': finished 2024-09-19T08:58:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:07 smithi102 ceph-mon[35280]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:58:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:07 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:08.263 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:07 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/3307740678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab307451-1db6-458f-94d9-d20444cf2a0b"}]: dispatch 2024-09-19T08:58:08.263 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:07 smithi049 ceph-mon[28158]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab307451-1db6-458f-94d9-d20444cf2a0b"}]: dispatch 2024-09-19T08:58:08.263 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:07 smithi049 ceph-mon[28158]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab307451-1db6-458f-94d9-d20444cf2a0b"}]': finished 2024-09-19T08:58:08.263 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:07 smithi049 ceph-mon[28158]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T08:58:08.264 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:07 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:09.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:08 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/2632298930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:09.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:08 smithi102 ceph-mon[35280]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:08 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/2632298930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:08 smithi049 ceph-mon[28158]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:11.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:11 smithi102 ceph-mon[35280]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:11 smithi049 ceph-mon[28158]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:13.391 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:13 smithi102 ceph-mon[35280]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:13.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:13 smithi049 ceph-mon[28158]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:15 smithi102 ceph-mon[35280]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:15 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:58:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:15 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:15 smithi049 ceph-mon[28158]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:15 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:58:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:15 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:16.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:16 smithi102 ceph-mon[35280]: Deploying daemon osd.5 on smithi102 2024-09-19T08:58:16.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:16 smithi049 ceph-mon[28158]: Deploying daemon osd.5 on smithi102 2024-09-19T08:58:17.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:17 smithi049 ceph-mon[28158]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:17.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:17 smithi102 ceph-mon[35280]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:19 smithi102 ceph-mon[35280]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:19.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:19 smithi049 ceph-mon[28158]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:20 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:20 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:20 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:20.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:20 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:20.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:20 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:20.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:20 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:21.453 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:21 smithi049 ceph-mon[28158]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:21 smithi102 ceph-mon[35280]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:21.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.861+0000 7f361f7fe640 1 -- 172.21.15.102:0/2654189293 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f362802c5d0 con 0x7f361406cc50 2024-09-19T08:58:21.862 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 5 on host 'smithi102' 2024-09-19T08:58:21.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.863+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f361406cc50 msgr2=0x7f361406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.863+0000 7f363038a640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f361406cc50 0x7f361406f110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3618000c00 tx=0x7f36180314e0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.863+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280feaf0 msgr2=0x7f36281945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.863+0000 7f363038a640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280feaf0 0x7f36281945f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f362400e940 tx=0x7f362400ee00 comp rx=0 tx=0).stop 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.864+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 shutdown_connections 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.864+0000 7f363038a640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f361406cc50 0x7f361406f110 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.864+0000 7f363038a640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36280ffcf0 0x7f3628194b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.864+0000 7f363038a640 1 --2- 172.21.15.102:0/2654189293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36280feaf0 0x7f36281945f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.864+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 >> 172.21.15.102:0/2654189293 conn(0x7f36280fa280 msgr2=0x7f36281033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.864+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 shutdown_connections 2024-09-19T08:58:21.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:21.864+0000 7f363038a640 1 -- 172.21.15.102:0/2654189293 wait complete. 2024-09-19T08:58:22.482 DEBUG:teuthology.orchestra.run.smithi102:osd.5> sudo journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:58:22.485 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-19T08:58:22.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:58:22.695 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:23.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:22 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:23.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:22 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:23.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:22 smithi049 ceph-mon[28158]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:23.150 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:22 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:23.150 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:22 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:23.150 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:22 smithi102 ceph-mon[35280]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:23.508 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 08:58:23 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[54982]: 2024-09-19T08:58:23.321+0000 7faaf7ae4640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:58:24.165 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:23 smithi049 ceph-mon[28158]: from='osd.5 [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:58:24.165 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:23 smithi049 ceph-mon[28158]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:58:24.166 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:24.166 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:23 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:24.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:23 smithi102 ceph-mon[35280]: from='osd.5 [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:58:24.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:23 smithi102 ceph-mon[35280]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:58:24.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:24.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:23 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 -- 172.21.15.49:0/23855118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0fea80 msgr2=0x7f268c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 --2- 172.21.15.49:0/23855118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0fea80 0x7f268c0fee80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f267c009880 tx=0x7f267c02a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 -- 172.21.15.49:0/23855118 shutdown_connections 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 --2- 172.21.15.49:0/23855118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f268c0ffc80 0x7f268c100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 --2- 172.21.15.49:0/23855118 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0fea80 0x7f268c0fee80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 -- 172.21.15.49:0/23855118 >> 172.21.15.49:0/23855118 conn(0x7f268c0fa230 msgr2=0x7f268c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 -- 172.21.15.49:0/23855118 shutdown_connections 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.494+0000 7f2690f85640 1 -- 172.21.15.49:0/23855118 wait complete. 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2690f85640 1 Processor -- start 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2690f85640 1 -- start start 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2690f85640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f268c0fea80 0x7f268c195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2690f85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0ffc80 0x7f268c195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2690f85640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c196150 con 0x7f268c0ffc80 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2690f85640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c1962c0 con 0x7f268c0fea80 2024-09-19T08:58:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2689d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0ffc80 0x7f268c195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2689d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0ffc80 0x7f268c195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60432/0 (socket says 172.21.15.49:60432) 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2689d9b640 1 -- 172.21.15.49:0/3986287972 learned_addr learned my addr 172.21.15.49:0/3986287972 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f268a59c640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f268c0fea80 0x7f268c195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2689d9b640 1 -- 172.21.15.49:0/3986287972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f268c0fea80 msgr2=0x7f268c195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2689d9b640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f268c0fea80 0x7f268c195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f2689d9b640 1 -- 172.21.15.49:0/3986287972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c009560 con 0x7f268c0ffc80 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.495+0000 7f268a59c640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f268c0fea80 0x7f268c195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.496+0000 7f2689d9b640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0ffc80 0x7f268c195b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f268000d900 tx=0x7f268000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.496+0000 7f267b7fe640 1 -- 172.21.15.49:0/3986287972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2680009c00 con 0x7f268c0ffc80 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.496+0000 7f267b7fe640 1 -- 172.21.15.49:0/3986287972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2680009d60 con 0x7f268c0ffc80 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.496+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c19ad60 con 0x7f268c0ffc80 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.496+0000 7f267b7fe640 1 -- 172.21.15.49:0/3986287972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26800049d0 con 0x7f268c0ffc80 2024-09-19T08:58:24.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.496+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c19b2b0 con 0x7f268c0ffc80 2024-09-19T08:58:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.497+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c107670 con 0x7f268c0ffc80 2024-09-19T08:58:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.497+0000 7f267b7fe640 1 -- 172.21.15.49:0/3986287972 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2680004020 con 0x7f268c0ffc80 2024-09-19T08:58:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.498+0000 7f267b7fe640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f267406cc50 0x7f267406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.498+0000 7f267b7fe640 1 -- 172.21.15.49:0/3986287972 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4342+0+0 (secure 0 0 0) 0x7f268008bbb0 con 0x7f268c0ffc80 2024-09-19T08:58:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.498+0000 7f268a59c640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f267406cc50 0x7f267406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.498+0000 7f268a59c640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f267406cc50 0x7f267406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f267c009230 tx=0x7f267c0314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.502+0000 7f267b7fe640 1 -- 172.21.15.49:0/3986287972 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2680056380 con 0x7f268c0ffc80 2024-09-19T08:58:24.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.676+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f268c107800 con 0x7f268c0ffc80 2024-09-19T08:58:24.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.677+0000 7f267b7fe640 1 -- 172.21.15.49:0/3986287972 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f26800599a0 con 0x7f268c0ffc80 2024-09-19T08:58:24.677 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:58:24.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f267406cc50 msgr2=0x7f267406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f267406cc50 0x7f267406f110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f267c009230 tx=0x7f267c0314e0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0ffc80 msgr2=0x7f268c195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0ffc80 0x7f268c195b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f268000d900 tx=0x7f268000ddc0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 shutdown_connections 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f267406cc50 0x7f267406f110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f268c0ffc80 0x7f268c195b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 --2- 172.21.15.49:0/3986287972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f268c0fea80 0x7f268c195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 >> 172.21.15.49:0/3986287972 conn(0x7f268c0fa230 msgr2=0x7f268c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 shutdown_connections 2024-09-19T08:58:24.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:24.679+0000 7f2690f85640 1 -- 172.21.15.49:0/3986287972 wait complete. 2024-09-19T08:58:24.975 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:24 smithi049 ceph-mon[28158]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:58:24.975 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:24 smithi049 ceph-mon[28158]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T08:58:24.975 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:24 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:24.976 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:24 smithi049 ceph-mon[28158]: from='osd.5 [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:24.976 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:24 smithi049 ceph-mon[28158]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:24.976 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:24 smithi049 ceph-mon[28158]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:24.976 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:24 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3986287972' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:58:25.140 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:24 smithi102 ceph-mon[35280]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:58:25.140 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:24 smithi102 ceph-mon[35280]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T08:58:25.140 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:24 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:25.140 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:24 smithi102 ceph-mon[35280]: from='osd.5 [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:25.140 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:24 smithi102 ceph-mon[35280]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T08:58:25.140 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:24 smithi102 ceph-mon[35280]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:25.140 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:24 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3986287972' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:58:25.281 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726736281,"num_in_osds":6,"osd_in_since":1726736287,"num_remapped_pgs":0} 2024-09-19T08:58:25.755 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 08:58:25 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[54982]: 2024-09-19T08:58:25.666+0000 7faaf3242640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:58:25.755 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 08:58:25 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[54982]: 2024-09-19T08:58:25.675+0000 7faaeb875640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:58:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:25 smithi102 ceph-mon[35280]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T08:58:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:25 smithi102 ceph-mon[35280]: osdmap e38: 6 total, 5 up, 6 in 2024-09-19T08:58:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:25 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:25 smithi102 ceph-mon[35280]: from='osd.5 ' entity='osd.5' 2024-09-19T08:58:26.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:58:26.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:25 smithi049 ceph-mon[28158]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T08:58:26.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:25 smithi049 ceph-mon[28158]: osdmap e38: 6 total, 5 up, 6 in 2024-09-19T08:58:26.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:26.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:25 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:26.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:25 smithi049 ceph-mon[28158]: from='osd.5 ' entity='osd.5' 2024-09-19T08:58:26.504 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:26.896 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:26 smithi049 ceph-mon[28158]: purged_snaps scrub starts 2024-09-19T08:58:26.896 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:26 smithi049 ceph-mon[28158]: purged_snaps scrub ok 2024-09-19T08:58:26.896 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:26.896 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:26 smithi049 ceph-mon[28158]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:26.897 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:26 smithi049 ceph-mon[28158]: osd.5 [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] boot 2024-09-19T08:58:26.897 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:26 smithi049 ceph-mon[28158]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:58:26.897 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:27.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:26 smithi102 ceph-mon[35280]: purged_snaps scrub starts 2024-09-19T08:58:27.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:26 smithi102 ceph-mon[35280]: purged_snaps scrub ok 2024-09-19T08:58:27.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:27.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:26 smithi102 ceph-mon[35280]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:27.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:26 smithi102 ceph-mon[35280]: osd.5 [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] boot 2024-09-19T08:58:27.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:26 smithi102 ceph-mon[35280]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T08:58:27.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 -- 172.21.15.49:0/2348582976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700ffb90 msgr2=0x7f10700fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 --2- 172.21.15.49:0/2348582976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700ffb90 0x7f10700fff90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f106c009880 tx=0x7f106c02a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 -- 172.21.15.49:0/2348582976 shutdown_connections 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 --2- 172.21.15.49:0/2348582976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1070100d90 0x7f1070101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 --2- 172.21.15.49:0/2348582976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10700ffb90 0x7f10700fff90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 -- 172.21.15.49:0/2348582976 >> 172.21.15.49:0/2348582976 conn(0x7f10700fb360 msgr2=0x7f10700fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 -- 172.21.15.49:0/2348582976 shutdown_connections 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.086+0000 7f10781aa640 1 -- 172.21.15.49:0/2348582976 wait complete. 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f10781aa640 1 Processor -- start 2024-09-19T08:58:28.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f10781aa640 1 -- start start 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f10781aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10700ffb90 0x7f1070195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f10781aa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1070100d90 0x7f1070195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f10781aa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10701961a0 con 0x7f1070100d90 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f10781aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070196310 con 0x7f10700ffb90 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f1075745640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1070100d90 0x7f1070195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f1075745640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1070100d90 0x7f1070195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60458/0 (socket says 172.21.15.49:60458) 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.087+0000 7f1075745640 1 -- 172.21.15.49:0/2084329262 learned_addr learned my addr 172.21.15.49:0/2084329262 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f1075745640 1 -- 172.21.15.49:0/2084329262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10700ffb90 msgr2=0x7f1070195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f1075745640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10700ffb90 0x7f1070195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f1075745640 1 -- 172.21.15.49:0/2084329262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c009560 con 0x7f1070100d90 2024-09-19T08:58:28.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f1075745640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1070100d90 0x7f1070195bd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f106000d720 tx=0x7f106000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f1066ffd640 1 -- 172.21.15.49:0/2084329262 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10600051f0 con 0x7f1070100d90 2024-09-19T08:58:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107019adb0 con 0x7f1070100d90 2024-09-19T08:58:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f1066ffd640 1 -- 172.21.15.49:0/2084329262 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1060009ce0 con 0x7f1070100d90 2024-09-19T08:58:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f1066ffd640 1 -- 172.21.15.49:0/2084329262 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1060010460 con 0x7f1070100d90 2024-09-19T08:58:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.088+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107019b350 con 0x7f1070100d90 2024-09-19T08:58:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.089+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10700fff90 con 0x7f1070100d90 2024-09-19T08:58:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.090+0000 7f1066ffd640 1 -- 172.21.15.49:0/2084329262 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1060009820 con 0x7f1070100d90 2024-09-19T08:58:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.090+0000 7f1066ffd640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f105c06cc50 0x7f105c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.091+0000 7f1066ffd640 1 -- 172.21.15.49:0/2084329262 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f106008bb10 con 0x7f1070100d90 2024-09-19T08:58:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.091+0000 7f1075f46640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f105c06cc50 0x7f105c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:28.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.091+0000 7f1075f46640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f105c06cc50 0x7f105c06f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f106c02a9c0 tx=0x7f106c000bc0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.097+0000 7f1066ffd640 1 -- 172.21.15.49:0/2084329262 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1060056220 con 0x7f1070100d90 2024-09-19T08:58:28.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.269+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f107018f730 con 0x7f1070100d90 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: Detected new or changed devices on smithi102 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi102 to 4970M 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:28.270 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:28.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:28.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:28.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:28 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.269+0000 7f1066ffd640 1 -- 172.21.15.49:0/2084329262 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f1060059840 con 0x7f1070100d90 2024-09-19T08:58:28.271 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:58:28.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.271+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f105c06cc50 msgr2=0x7f105c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:28.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f105c06cc50 0x7f105c06f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f106c02a9c0 tx=0x7f106c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1070100d90 msgr2=0x7f1070195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:28.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1070100d90 0x7f1070195bd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f106000d720 tx=0x7f106000dbe0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 shutdown_connections 2024-09-19T08:58:28.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f105c06cc50 0x7f105c06f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1070100d90 0x7f1070195bd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 --2- 172.21.15.49:0/2084329262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10700ffb90 0x7f1070195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:28.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 >> 172.21.15.49:0/2084329262 conn(0x7f10700fb360 msgr2=0x7f1070104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:28.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 shutdown_connections 2024-09-19T08:58:28.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:28.272+0000 7f10781aa640 1 -- 172.21.15.49:0/2084329262 wait complete. 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: Detected new or changed devices on smithi102 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi102 to 4970M 2024-09-19T08:58:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:28 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:58:28.997 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726736306,"num_in_osds":6,"osd_in_since":1726736287,"num_remapped_pgs":0} 2024-09-19T08:58:28.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:58:29.247 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:29 smithi049 ceph-mon[28158]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:29 smithi049 ceph-mon[28158]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T08:58:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:29 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2084329262' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:58:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:29 smithi102 ceph-mon[35280]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:29 smithi102 ceph-mon[35280]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T08:58:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:29 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2084329262' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:58:30.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 -- 172.21.15.49:0/3611573566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fedc0 msgr2=0x7f204c102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 --2- 172.21.15.49:0/3611573566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fedc0 0x7f204c102e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f203c00a990 tx=0x7f203c02b7d0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 -- 172.21.15.49:0/3611573566 shutdown_connections 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 --2- 172.21.15.49:0/3611573566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fedc0 0x7f204c102e10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 --2- 172.21.15.49:0/3611573566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f204c0fe410 0x7f204c0fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 -- 172.21.15.49:0/3611573566 >> 172.21.15.49:0/3611573566 conn(0x7f204c0f9e70 msgr2=0x7f204c0fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 -- 172.21.15.49:0/3611573566 shutdown_connections 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 -- 172.21.15.49:0/3611573566 wait complete. 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 Processor -- start 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.964+0000 7f2053bad640 1 -- start start 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2053bad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fe410 0x7f204c0ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2053bad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f204c0fedc0 0x7f204c1003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2053bad640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c100930 con 0x7f204c0fe410 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2053bad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c100aa0 con 0x7f204c0fedc0 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051949640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fe410 0x7f204c0ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051949640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fe410 0x7f204c0ffeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53508/0 (socket says 172.21.15.49:53508) 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051949640 1 -- 172.21.15.49:0/3606178771 learned_addr learned my addr 172.21.15.49:0/3606178771 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051148640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f204c0fedc0 0x7f204c1003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051949640 1 -- 172.21.15.49:0/3606178771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f204c0fedc0 msgr2=0x7f204c1003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051949640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f204c0fedc0 0x7f204c1003f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051949640 1 -- 172.21.15.49:0/3606178771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c00a670 con 0x7f204c0fe410 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2051949640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fe410 0x7f204c0ffeb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f204800d6f0 tx=0x7f204800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2042ffd640 1 -- 172.21.15.49:0/3606178771 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2048009a30 con 0x7f204c0fe410 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.965+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c1a1ca0 con 0x7f204c0fe410 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.966+0000 7f2042ffd640 1 -- 172.21.15.49:0/3606178771 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20480054e0 con 0x7f204c0fe410 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.966+0000 7f2042ffd640 1 -- 172.21.15.49:0/3606178771 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2048010460 con 0x7f204c0fe410 2024-09-19T08:58:30.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.966+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c1a2000 con 0x7f204c0fe410 2024-09-19T08:58:30.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.967+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c0ff8f0 con 0x7f204c0fe410 2024-09-19T08:58:30.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.967+0000 7f2042ffd640 1 -- 172.21.15.49:0/3606178771 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2048009b90 con 0x7f204c0fe410 2024-09-19T08:58:30.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.968+0000 7f2042ffd640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f203806cc50 0x7f203806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:30.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.968+0000 7f2051148640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f203806cc50 0x7f203806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:30.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.968+0000 7f2042ffd640 1 -- 172.21.15.49:0/3606178771 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f204808b920 con 0x7f204c0fe410 2024-09-19T08:58:30.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.969+0000 7f2051148640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f203806cc50 0x7f203806f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f203c006010 tx=0x7f203c008760 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:30.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:30.972+0000 7f2042ffd640 1 -- 172.21.15.49:0/3606178771 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2048056160 con 0x7f204c0fe410 2024-09-19T08:58:31.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.145+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f204c1013e0 con 0x7f204c0fe410 2024-09-19T08:58:31.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.146+0000 7f2042ffd640 1 -- 172.21.15.49:0/3606178771 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11337 (secure 0 0 0) 0x7f2048017090 con 0x7f204c0fe410 2024-09-19T08:58:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:58:31.145 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"fsid":"63845326-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:53:00.909312+0000","modified":"2024-09-19T08:58:28.090949+0000","last_up_change":"2024-09-19T08:58:26.668729+0000","last_in_change":"2024-09-19T08:58:07.446405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:16.550605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5edac5e-6fcf-4e95-99a5-31c60b8acca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6803","nonce":4011886204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6805","nonce":4011886204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6809","nonce":4011886204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6807","nonce":4011886204}]},"public_addr":"172.21.15.49:6803/4011886204","cluster_addr":"172.21.15.49:6805/4011886204","heartbeat_back_addr":"172.21.15.49:6809/4011886204","heartbeat_front_addr":"172.21.15.49:6807/4011886204","state":["exists","up"]},{"osd":1,"uuid":"114e8646-e806-40cf-90ec-94f4f86baabe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6811","nonce":3633441521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6813","nonce":3633441521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6817","nonce":3633441521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6815","nonce":3633441521}]},"public_addr":"172.21.15.49:6811/3633441521","cluster_addr":"172.21.15.49:6813/3633441521","heartbeat_back_addr":"172.21.15.49:6817/3633441521","heartbeat_front_addr":"172.21.15.49:6815/3633441521","state":["exists","up"]},{"osd":2,"uuid":"551521d5-2a1d-4ab1-9071-31885cbb5dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6819","nonce":3569205759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6821","nonce":3569205759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6825","nonce":3569205759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6823","nonce":3569205759}]},"public_addr":"172.21.15.49:6819/3569205759","cluster_addr":"172.21.15.49:6821/3569205759","heartbeat_back_addr":"172.21.15.49:6825/3569205759","heartbeat_front_addr":"172.21.15.49:6823/3569205759","state":["exists","up"]},{"osd":3,"uuid":"045c1198-0304-45d4-8f1f-082605b54826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6801","nonce":1601429235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6803","nonce":1601429235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6807","nonce":1601429235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6805","nonce":1601429235}]},"public_addr":"172.21.15.102:6801/1601429235","cluster_addr":"172.21.15.102:6803/1601429235","heartbeat_back_addr":"172.21.15.102:6807/1601429235","heartbeat_front_addr":"172.21.15.102:6805/1601429235","state":["exists","up"]},{"osd":4,"uuid":"ff3b1b75-7d2a-4613-8289-b4474ddd2eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6809","nonce":1101039955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6811","nonce":1101039955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6815","nonce":1101039955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6813","nonce":1101039955}]},"public_addr":"172.21.15.102:6809/1101039955","cluster_addr":"172.21.15.102:6811/1101039955","heartbeat_back_addr":"172.21.15.102:6815/1101039955","heartbeat_front_addr":"172.21.15.102:6813/1101039955","state":["exists","up"]},{"osd":5,"uuid":"ab307451-1db6-458f-94d9-d20444cf2a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6817","nonce":487766051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6819","nonce":487766051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6823","nonce":487766051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6821","nonce":487766051}]},"public_addr":"172.21.15.102:6817/487766051","cluster_addr":"172.21.15.102:6819/487766051","heartbeat_back_addr":"172.21.15.102:6823/487766051","heartbeat_front_addr":"172.21.15.102:6821/487766051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:18.891287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:45.696853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:13.008564+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:35.970470+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:59.792032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:24.357495+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6801/4115442638":"2024-09-20T08:55:02.044798+0000","172.21.15.49:6800/1436634671":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1518344664":"2024-09-20T08:55:02.044798+0000","172.21.15.49:0/3532044078":"2024-09-20T08:55:02.044798+0000","172.21.15.49:0/438801189":"2024-09-20T08:53:25.290361+0000","172.21.15.49:6801/1436634671":"2024-09-20T08:53:25.290361+0000","172.21.15.49:6801/1902543814":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/2691016053":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1246626107":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/2514955449":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1109277774":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/486100308":"2024-09-20T08:53:59.836934+0000","172.21.15.49:6800/1902543814":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/4103089507":"2024-09-20T08:55:02.044798+0000","172.21.15.49:6800/4115442638":"2024-09-20T08:55:02.044798+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:58:31.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f203806cc50 msgr2=0x7f203806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:31.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f203806cc50 0x7f203806f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f203c006010 tx=0x7f203c008760 comp rx=0 tx=0).stop 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fe410 msgr2=0x7f204c0ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fe410 0x7f204c0ffeb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f204800d6f0 tx=0x7f204800dbb0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 shutdown_connections 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f203806cc50 0x7f203806f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f204c0fedc0 0x7f204c1003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 --2- 172.21.15.49:0/3606178771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f204c0fe410 0x7f204c0ffeb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 >> 172.21.15.49:0/3606178771 conn(0x7f204c0f9e70 msgr2=0x7f204c102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 shutdown_connections 2024-09-19T08:58:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:31.148+0000 7f2053bad640 1 -- 172.21.15.49:0/3606178771 wait complete. 2024-09-19T08:58:31.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:31 smithi102 ceph-mon[35280]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:31.499 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:31 smithi049 ceph-mon[28158]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:31.868 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:57:16.550605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:58:31.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T08:58:32.079 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:32.387 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:32 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3606178771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:58:32.387 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:32 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3606178771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:58:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:33.417 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:33 smithi049 ceph-mon[28158]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:33.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:33 smithi102 ceph-mon[35280]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:33.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/3208923209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8101650 msgr2=0x7f5fc8109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/3208923209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8101650 0x7f5fc8109b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009880 tx=0x7f5fb002a530 comp rx=0 tx=0).stop 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/3208923209 shutdown_connections 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/3208923209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8101650 0x7f5fc8109b40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/3208923209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fc8100d30 0x7f5fc8101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/3208923209 >> 172.21.15.49:0/3208923209 conn(0x7f5fc80758a0 msgr2=0x7f5fc80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/3208923209 shutdown_connections 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/3208923209 wait complete. 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.650+0000 7f5fcf1cc640 1 Processor -- start 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fcf1cc640 1 -- start start 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fcf1cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8100d30 0x7f5fc819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fcf1cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fc8101650 0x7f5fc819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fcf1cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc819c390 con 0x7f5fc8100d30 2024-09-19T08:58:33.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fcf1cc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc8195920 con 0x7f5fc8101650 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fccf68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8100d30 0x7f5fc819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fccf68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8100d30 0x7f5fc819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53526/0 (socket says 172.21.15.49:53526) 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fccf68640 1 -- 172.21.15.49:0/4227856248 learned_addr learned my addr 172.21.15.49:0/4227856248 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fc7fff640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fc8101650 0x7f5fc819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fccf68640 1 -- 172.21.15.49:0/4227856248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fc8101650 msgr2=0x7f5fc819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fccf68640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fc8101650 0x7f5fc819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fccf68640 1 -- 172.21.15.49:0/4227856248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0009560 con 0x7f5fc8100d30 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.651+0000 7f5fccf68640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8100d30 0x7f5fc819b830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c8f0 tx=0x7f5fc000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.652+0000 7f5fc5ffb640 1 -- 172.21.15.49:0/4227856248 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fc0007b80 con 0x7f5fc8100d30 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.652+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc8195c00 con 0x7f5fc8100d30 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.652+0000 7f5fc5ffb640 1 -- 172.21.15.49:0/4227856248 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fc00054e0 con 0x7f5fc8100d30 2024-09-19T08:58:33.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.652+0000 7f5fc5ffb640 1 -- 172.21.15.49:0/4227856248 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fc000f450 con 0x7f5fc8100d30 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.652+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc8196120 con 0x7f5fc8100d30 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.653+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc8068490 con 0x7f5fc8100d30 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.653+0000 7f5fc5ffb640 1 -- 172.21.15.49:0/4227856248 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5fc0004f60 con 0x7f5fc8100d30 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.654+0000 7f5fc5ffb640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f5fb406cc50 0x7f5fb406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.654+0000 7f5fc5ffb640 1 -- 172.21.15.49:0/4227856248 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5fc008bcc0 con 0x7f5fc8100d30 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.654+0000 7f5fc7fff640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f5fb406cc50 0x7f5fb406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.654+0000 7f5fc7fff640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f5fb406cc50 0x7f5fb406f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0000c00 tx=0x7f5fb0005750 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.658+0000 7f5fc5ffb640 1 -- 172.21.15.49:0/4227856248 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5fc0056480 con 0x7f5fc8100d30 2024-09-19T08:58:33.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.832+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fc81043e0 con 0x7f5fc8100d30 2024-09-19T08:58:33.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.833+0000 7f5fc5ffb640 1 -- 172.21.15.49:0/4227856248 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fc001d020 con 0x7f5fc8100d30 2024-09-19T08:58:33.833 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f5fb406cc50 msgr2=0x7f5fb406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f5fb406cc50 0x7f5fb406f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0000c00 tx=0x7f5fb0005750 comp rx=0 tx=0).stop 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8100d30 msgr2=0x7f5fc819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8100d30 0x7f5fc819b830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c8f0 tx=0x7f5fc000cdb0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 shutdown_connections 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f5fb406cc50 0x7f5fb406f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fc8101650 0x7f5fc819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 --2- 172.21.15.49:0/4227856248 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fc8100d30 0x7f5fc819b830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 >> 172.21.15.49:0/4227856248 conn(0x7f5fc80758a0 msgr2=0x7f5fc8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.835+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 shutdown_connections 2024-09-19T08:58:33.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:33.836+0000 7f5fcf1cc640 1 -- 172.21.15.49:0/4227856248 wait complete. 2024-09-19T08:58:34.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:34 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/4227856248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:58:34.532 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:34 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/4227856248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:58:34.556 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T08:58:34.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T08:58:34.765 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:35.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:35 smithi049 ceph-mon[28158]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:35 smithi102 ceph-mon[35280]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 -- 172.21.15.49:0/1155709124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04100670 msgr2=0x7f3c04102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1155709124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04100670 0x7f3c04102a60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009880 tx=0x7f3bf402a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 -- 172.21.15.49:0/1155709124 shutdown_connections 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1155709124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c04102fa0 0x7f3c04105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1155709124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04100670 0x7f3c04102a60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 -- 172.21.15.49:0/1155709124 >> 172.21.15.49:0/1155709124 conn(0x7f3c040fa230 msgr2=0x7f3c040fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 -- 172.21.15.49:0/1155709124 shutdown_connections 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 -- 172.21.15.49:0/1155709124 wait complete. 2024-09-19T08:58:36.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.284+0000 7f3c099ee640 1 Processor -- start 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c099ee640 1 -- start start 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c099ee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c04100670 0x7f3c040fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c099ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04102fa0 0x7f3c040fe620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c099ee640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040feb60 con 0x7f3c04102fa0 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c099ee640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040fecd0 con 0x7f3c04100670 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c027fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04102fa0 0x7f3c040fe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c027fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04102fa0 0x7f3c040fe620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53550/0 (socket says 172.21.15.49:53550) 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c027fc640 1 -- 172.21.15.49:0/1389886659 learned_addr learned my addr 172.21.15.49:0/1389886659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c02ffd640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c04100670 0x7f3c040fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c027fc640 1 -- 172.21.15.49:0/1389886659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c04100670 msgr2=0x7f3c040fffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c027fc640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c04100670 0x7f3c040fffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c027fc640 1 -- 172.21.15.49:0/1389886659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009560 con 0x7f3c04102fa0 2024-09-19T08:58:36.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.285+0000 7f3c02ffd640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c04100670 0x7f3c040fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:36.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.286+0000 7f3c027fc640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04102fa0 0x7f3c040fe620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c8f0 tx=0x7f3bf800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:36.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.286+0000 7f3c089ec640 1 -- 172.21.15.49:0/1389886659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf8007b80 con 0x7f3c04102fa0 2024-09-19T08:58:36.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.286+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c040fefb0 con 0x7f3c04102fa0 2024-09-19T08:58:36.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.286+0000 7f3c089ec640 1 -- 172.21.15.49:0/1389886659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bf8007ce0 con 0x7f3c04102fa0 2024-09-19T08:58:36.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.286+0000 7f3c089ec640 1 -- 172.21.15.49:0/1389886659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf80187b0 con 0x7f3c04102fa0 2024-09-19T08:58:36.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.286+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0419d630 con 0x7f3c04102fa0 2024-09-19T08:58:36.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.287+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c04108750 con 0x7f3c04102fa0 2024-09-19T08:58:36.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.287+0000 7f3c089ec640 1 -- 172.21.15.49:0/1389886659 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3bf800f450 con 0x7f3c04102fa0 2024-09-19T08:58:36.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.288+0000 7f3c089ec640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f3bec06cc50 0x7f3bec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:36.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.288+0000 7f3c089ec640 1 -- 172.21.15.49:0/1389886659 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3bf808c0c0 con 0x7f3c04102fa0 2024-09-19T08:58:36.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.288+0000 7f3c02ffd640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f3bec06cc50 0x7f3bec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:36.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.288+0000 7f3c02ffd640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f3bec06cc50 0x7f3bec06f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000c00 tx=0x7f3bf40314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:36.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.292+0000 7f3c089ec640 1 -- 172.21.15.49:0/1389886659 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3bf80567d0 con 0x7f3c04102fa0 2024-09-19T08:58:36.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.528+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3c0419d9e0 con 0x7f3c04102fa0 2024-09-19T08:58:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.532+0000 7f3c089ec640 1 -- 172.21.15.49:0/1389886659 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3bf8059df0 con 0x7f3c04102fa0 2024-09-19T08:58:36.531 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-09-19T08:58:36.532 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQC85+tmUEqQHxAA+Hj2iLJCv72zpqEkJhDECw== 2024-09-19T08:58:36.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f3bec06cc50 msgr2=0x7f3bec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f3bec06cc50 0x7f3bec06f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4000c00 tx=0x7f3bf40314e0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04102fa0 msgr2=0x7f3c040fe620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04102fa0 0x7f3c040fe620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c8f0 tx=0x7f3bf800cdb0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 shutdown_connections 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f3bec06cc50 0x7f3bec06f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c04102fa0 0x7f3c040fe620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 --2- 172.21.15.49:0/1389886659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c04100670 0x7f3c040fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 >> 172.21.15.49:0/1389886659 conn(0x7f3c040fa230 msgr2=0x7f3c040fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 shutdown_connections 2024-09-19T08:58:36.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:36.534+0000 7f3c099ee640 1 -- 172.21.15.49:0/1389886659 wait complete. 2024-09-19T08:58:37.171 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:37 smithi049 ceph-mon[28158]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:37.172 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:37 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1389886659' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:58:37.172 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:37 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1389886659' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:58:37.195 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T08:58:37.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T08:58:37.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T08:58:37.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T08:58:37.371 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:37 smithi102 ceph-mon[35280]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:37.371 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:37 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1389886659' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:58:37.371 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:37 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1389886659' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:58:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi102/config 2024-09-19T08:58:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 -- 172.21.15.102:0/27302013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80fea70 msgr2=0x7f03b80fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 --2- 172.21.15.102:0/27302013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80fea70 0x7f03b80fee70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009880 tx=0x7f03a802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 -- 172.21.15.102:0/27302013 shutdown_connections 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 --2- 172.21.15.102:0/27302013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03b80ffc70 0x7f03b81000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 --2- 172.21.15.102:0/27302013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80fea70 0x7f03b80fee70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 -- 172.21.15.102:0/27302013 >> 172.21.15.102:0/27302013 conn(0x7f03b80fa200 msgr2=0x7f03b80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 -- 172.21.15.102:0/27302013 shutdown_connections 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 -- 172.21.15.102:0/27302013 wait complete. 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 Processor -- start 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.979+0000 7f03be81a640 1 -- start start 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03be81a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03b80fea70 0x7f03b80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03be81a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80ffc70 0x7f03b819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03be81a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b819a9e0 con 0x7f03b80fea70 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03be81a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b819ab50 con 0x7f03b80ffc70 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80ffc70 0x7f03b819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80ffc70 0x7f03b819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45328/0 (socket says 172.21.15.102:45328) 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b77fe640 1 -- 172.21.15.102:0/1533579833 learned_addr learned my addr 172.21.15.102:0/1533579833 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b7fff640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03b80fea70 0x7f03b80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b77fe640 1 -- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03b80fea70 msgr2=0x7f03b80687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b77fe640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03b80fea70 0x7f03b80687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b77fe640 1 -- 172.21.15.102:0/1533579833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8009560 con 0x7f03b80ffc70 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b7fff640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03b80fea70 0x7f03b80687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b77fe640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80ffc70 0x7f03b819a410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00b420 tx=0x7f03ac00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b57fa640 1 -- 172.21.15.102:0/1533579833 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03ac011800 con 0x7f03b80ffc70 2024-09-19T08:58:38.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b57fa640 1 -- 172.21.15.102:0/1533579833 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03ac011e20 con 0x7f03b80ffc70 2024-09-19T08:58:38.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b819ae30 con 0x7f03b80ffc70 2024-09-19T08:58:38.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.980+0000 7f03b57fa640 1 -- 172.21.15.102:0/1533579833 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03ac00f2e0 con 0x7f03b80ffc70 2024-09-19T08:58:38.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.981+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b819b3d0 con 0x7f03b80ffc70 2024-09-19T08:58:38.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.981+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b80feef0 con 0x7f03b80ffc70 2024-09-19T08:58:38.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.982+0000 7f03b57fa640 1 -- 172.21.15.102:0/1533579833 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f03ac010380 con 0x7f03b80ffc70 2024-09-19T08:58:38.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.982+0000 7f03b57fa640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03a006cc50 0x7f03a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:38.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.982+0000 7f03b57fa640 1 -- 172.21.15.102:0/1533579833 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f03ac08b880 con 0x7f03b80ffc70 2024-09-19T08:58:38.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.982+0000 7f03b7fff640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03a006cc50 0x7f03a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:38.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.983+0000 7f03b7fff640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03a006cc50 0x7f03a006f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03b8068d10 tx=0x7f03a80314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:38.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:38.987+0000 7f03b57fa640 1 -- 172.21.15.102:0/1533579833 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03ac055f90 con 0x7f03b80ffc70 2024-09-19T08:58:39.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.212+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f03b81076e0 con 0x7f03b80ffc70 2024-09-19T08:58:39.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.219+0000 7f03b57fa640 1 -- 172.21.15.102:0/1533579833 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f03ac0595b0 con 0x7f03b80ffc70 2024-09-19T08:58:39.219 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-09-19T08:58:39.219 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC/5+tmSQ/FDBAAiCqg2z1jI4SfdhZfRm8SIQ== 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03a006cc50 msgr2=0x7f03a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03a006cc50 0x7f03a006f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03b8068d10 tx=0x7f03a80314e0 comp rx=0 tx=0).stop 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80ffc70 msgr2=0x7f03b819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80ffc70 0x7f03b819a410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00b420 tx=0x7f03ac00b8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 shutdown_connections 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03a006cc50 0x7f03a006f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03b80ffc70 0x7f03b819a410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 --2- 172.21.15.102:0/1533579833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03b80fea70 0x7f03b80687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 >> 172.21.15.102:0/1533579833 conn(0x7f03b80fa200 msgr2=0x7f03b8102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 shutdown_connections 2024-09-19T08:58:39.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T08:58:39.221+0000 7f03be81a640 1 -- 172.21.15.102:0/1533579833 wait complete. 2024-09-19T08:58:39.494 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:39 smithi102 ceph-mon[35280]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:39.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:39 smithi049 ceph-mon[28158]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:39.841 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T08:58:39.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-19T08:58:39.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T08:58:39.879 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T08:58:39.880 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T08:58:39.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T08:58:40.099 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:40.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:40 smithi049 ceph-mon[28158]: from='client.? 172.21.15.102:0/1533579833' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:58:40.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:40 smithi049 ceph-mon[28158]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:58:40.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:40 smithi049 ceph-mon[28158]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:58:40.452 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:40 smithi102 ceph-mon[35280]: from='client.? 172.21.15.102:0/1533579833' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:58:40.452 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:40 smithi102 ceph-mon[35280]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:58:40.453 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:40 smithi102 ceph-mon[35280]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:58:41.278 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:41 smithi049 ceph-mon[28158]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:41.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:41 smithi102 ceph-mon[35280]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 -- 172.21.15.49:0/2520215059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 msgr2=0x7f2e80105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 --2- 172.21.15.49:0/2520215059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e80105fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009880 tx=0x7f2e7c02a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 -- 172.21.15.49:0/2520215059 shutdown_connections 2024-09-19T08:58:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 --2- 172.21.15.49:0/2520215059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e800ffb40 0x7f2e800fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 --2- 172.21.15.49:0/2520215059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e80105fd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 -- 172.21.15.49:0/2520215059 >> 172.21.15.49:0/2520215059 conn(0x7f2e800fb860 msgr2=0x7f2e800fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:41.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 -- 172.21.15.49:0/2520215059 shutdown_connections 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.810+0000 7f2e87832640 1 -- 172.21.15.49:0/2520215059 wait complete. 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.811+0000 7f2e87832640 1 Processor -- start 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.811+0000 7f2e87832640 1 -- start start 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.811+0000 7f2e87832640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e800ffb40 0x7f2e8019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.811+0000 7f2e87832640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e8019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.811+0000 7f2e87832640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8019c360 con 0x7f2e80105bf0 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.811+0000 7f2e87832640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e801958f0 con 0x7f2e800ffb40 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.811+0000 7f2e84dcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e8019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e84dcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e8019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36220/0 (socket says 172.21.15.49:36220) 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e84dcd640 1 -- 172.21.15.49:0/788625621 learned_addr learned my addr 172.21.15.49:0/788625621 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e855ce640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e800ffb40 0x7f2e8019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:41.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e84dcd640 1 -- 172.21.15.49:0/788625621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e800ffb40 msgr2=0x7f2e8019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e84dcd640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e800ffb40 0x7f2e8019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:41.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e84dcd640 1 -- 172.21.15.49:0/788625621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c009560 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e84dcd640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e8019bd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000c8f0 tx=0x7f2e7000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e767fc640 1 -- 172.21.15.49:0/788625621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e70007b80 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e80195bd0 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e767fc640 1 -- 172.21.15.49:0/788625621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e700054e0 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e767fc640 1 -- 172.21.15.49:0/788625621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e7000f450 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.812+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e801961a0 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.813+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e801011f0 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.814+0000 7f2e767fc640 1 -- 172.21.15.49:0/788625621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2e70004f60 con 0x7f2e80105bf0 2024-09-19T08:58:41.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.814+0000 7f2e767fc640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e6c06cc50 0x7f2e6c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:41.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.814+0000 7f2e767fc640 1 -- 172.21.15.49:0/788625621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2e7008bcc0 con 0x7f2e80105bf0 2024-09-19T08:58:41.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.814+0000 7f2e855ce640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e6c06cc50 0x7f2e6c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:41.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.815+0000 7f2e855ce640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e6c06cc50 0x7f2e6c06f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009230 tx=0x7f2e7c0058d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:41.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:41.819+0000 7f2e767fc640 1 -- 172.21.15.49:0/788625621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e70056480 con 0x7f2e80105bf0 2024-09-19T08:58:42.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.035+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2e800fffa0 con 0x7f2e80105bf0 2024-09-19T08:58:42.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.038+0000 7f2e767fc640 1 -- 172.21.15.49:0/788625621 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174013 (secure 0 0 0) 0x7f2e70059aa0 con 0x7f2e80105bf0 2024-09-19T08:58:42.040 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:58:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e6c06cc50 msgr2=0x7f2e6c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e6c06cc50 0x7f2e6c06f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009230 tx=0x7f2e7c0058d0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 msgr2=0x7f2e8019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e8019bd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000c8f0 tx=0x7f2e7000cdb0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 shutdown_connections 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e6c06cc50 0x7f2e6c06f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e80105bf0 0x7f2e8019bd40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 --2- 172.21.15.49:0/788625621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e800ffb40 0x7f2e8019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 >> 172.21.15.49:0/788625621 conn(0x7f2e800fb860 msgr2=0x7f2e800fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 shutdown_connections 2024-09-19T08:58:42.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:42.040+0000 7f2e87832640 1 -- 172.21.15.49:0/788625621 wait complete. 2024-09-19T08:58:42.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:42 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/788625621' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:58:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:42 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/788625621' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:58:42.765 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"flags":0,"active_gid":14211,"active_name":"smithi049.qdvksw","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2913047787},{"type":"v1","addr":"172.21.15.49:6801","nonce":2913047787}]},"active_addr":"172.21.15.49:6801/2913047787","active_change":"2024-09-19T08:55:02.044971+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14232,"name":"smithi102.csalqv","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.49:8443/","prometheus":"http://172.21.15.49:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1944713960}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3682333928}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3838335144}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3048457886}]}]} 2024-09-19T08:58:42.772 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T08:58:42.772 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T08:58:42.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:58:42.981 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:43.397 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:43 smithi049 ceph-mon[28158]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:43 smithi102 ceph-mon[35280]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.602+0000 7f60de1c1640 1 -- 172.21.15.49:0/1387711461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 msgr2=0x7f60d81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.602+0000 7f60de1c1640 1 --2- 172.21.15.49:0/1387711461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d81047a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009880 tx=0x7f60cc02a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.602+0000 7f60de1c1640 1 -- 172.21.15.49:0/1387711461 shutdown_connections 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.602+0000 7f60de1c1640 1 --2- 172.21.15.49:0/1387711461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d81047a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.602+0000 7f60de1c1640 1 --2- 172.21.15.49:0/1387711461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d80ffda0 0x7f60d8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.602+0000 7f60de1c1640 1 -- 172.21.15.49:0/1387711461 >> 172.21.15.49:0/1387711461 conn(0x7f60d80fb840 msgr2=0x7f60d80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.603+0000 7f60de1c1640 1 -- 172.21.15.49:0/1387711461 shutdown_connections 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.603+0000 7f60de1c1640 1 -- 172.21.15.49:0/1387711461 wait complete. 2024-09-19T08:58:44.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.603+0000 7f60de1c1640 1 Processor -- start 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.603+0000 7f60de1c1640 1 -- start start 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60de1c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d80ffda0 0x7f60d80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60de1c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60de1c1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8073230 con 0x7f60d8100750 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60de1c1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80733a0 con 0x7f60d80ffda0 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d8072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36240/0 (socket says 172.21.15.49:36240) 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d6ffd640 1 -- 172.21.15.49:0/51906347 learned_addr learned my addr 172.21.15.49:0/51906347 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d77fe640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d80ffda0 0x7f60d80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d6ffd640 1 -- 172.21.15.49:0/51906347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d80ffda0 msgr2=0x7f60d80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d6ffd640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d80ffda0 0x7f60d80727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d6ffd640 1 -- 172.21.15.49:0/51906347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc009560 con 0x7f60d8100750 2024-09-19T08:58:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d6ffd640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d8072cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f60cc02a9c0 tx=0x7f60cc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d4ff9640 1 -- 172.21.15.49:0/51906347 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60cc004aa0 con 0x7f60d8100750 2024-09-19T08:58:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d8073620 con 0x7f60d8100750 2024-09-19T08:58:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d4ff9640 1 -- 172.21.15.49:0/51906347 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60cc004c00 con 0x7f60d8100750 2024-09-19T08:58:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.604+0000 7f60d4ff9640 1 -- 172.21.15.49:0/51906347 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60cc003980 con 0x7f60d8100750 2024-09-19T08:58:44.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.605+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d81a1f10 con 0x7f60d8100750 2024-09-19T08:58:44.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.606+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d8101280 con 0x7f60d8100750 2024-09-19T08:58:44.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.606+0000 7f60d4ff9640 1 -- 172.21.15.49:0/51906347 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f60cc003bf0 con 0x7f60d8100750 2024-09-19T08:58:44.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.606+0000 7f60d4ff9640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60c006cc50 0x7f60c006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:44.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.606+0000 7f60d4ff9640 1 -- 172.21.15.49:0/51906347 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f60cc0ace20 con 0x7f60d8100750 2024-09-19T08:58:44.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.606+0000 7f60d77fe640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60c006cc50 0x7f60c006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:44.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.607+0000 7f60d77fe640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60c006cc50 0x7f60c006f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60c8005fd0 tx=0x7f60c800b590 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:44.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.611+0000 7f60d4ff9640 1 -- 172.21.15.49:0/51906347 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f60cc077530 con 0x7f60d8100750 2024-09-19T08:58:44.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.781+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60d8100180 con 0x7f60d8100750 2024-09-19T08:58:44.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.782+0000 7f60d4ff9640 1 -- 172.21.15.49:0/51906347 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11337 (secure 0 0 0) 0x7f60cc07ab50 con 0x7f60d8100750 2024-09-19T08:58:44.781 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:58:44.782 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"fsid":"63845326-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:53:00.909312+0000","modified":"2024-09-19T08:58:28.090949+0000","last_up_change":"2024-09-19T08:58:26.668729+0000","last_in_change":"2024-09-19T08:58:07.446405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:16.550605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5edac5e-6fcf-4e95-99a5-31c60b8acca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6803","nonce":4011886204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6805","nonce":4011886204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6809","nonce":4011886204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6807","nonce":4011886204}]},"public_addr":"172.21.15.49:6803/4011886204","cluster_addr":"172.21.15.49:6805/4011886204","heartbeat_back_addr":"172.21.15.49:6809/4011886204","heartbeat_front_addr":"172.21.15.49:6807/4011886204","state":["exists","up"]},{"osd":1,"uuid":"114e8646-e806-40cf-90ec-94f4f86baabe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6811","nonce":3633441521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6813","nonce":3633441521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6817","nonce":3633441521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6815","nonce":3633441521}]},"public_addr":"172.21.15.49:6811/3633441521","cluster_addr":"172.21.15.49:6813/3633441521","heartbeat_back_addr":"172.21.15.49:6817/3633441521","heartbeat_front_addr":"172.21.15.49:6815/3633441521","state":["exists","up"]},{"osd":2,"uuid":"551521d5-2a1d-4ab1-9071-31885cbb5dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6819","nonce":3569205759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6821","nonce":3569205759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6825","nonce":3569205759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6823","nonce":3569205759}]},"public_addr":"172.21.15.49:6819/3569205759","cluster_addr":"172.21.15.49:6821/3569205759","heartbeat_back_addr":"172.21.15.49:6825/3569205759","heartbeat_front_addr":"172.21.15.49:6823/3569205759","state":["exists","up"]},{"osd":3,"uuid":"045c1198-0304-45d4-8f1f-082605b54826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6801","nonce":1601429235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6803","nonce":1601429235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6807","nonce":1601429235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6805","nonce":1601429235}]},"public_addr":"172.21.15.102:6801/1601429235","cluster_addr":"172.21.15.102:6803/1601429235","heartbeat_back_addr":"172.21.15.102:6807/1601429235","heartbeat_front_addr":"172.21.15.102:6805/1601429235","state":["exists","up"]},{"osd":4,"uuid":"ff3b1b75-7d2a-4613-8289-b4474ddd2eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6809","nonce":1101039955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6811","nonce":1101039955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6815","nonce":1101039955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6813","nonce":1101039955}]},"public_addr":"172.21.15.102:6809/1101039955","cluster_addr":"172.21.15.102:6811/1101039955","heartbeat_back_addr":"172.21.15.102:6815/1101039955","heartbeat_front_addr":"172.21.15.102:6813/1101039955","state":["exists","up"]},{"osd":5,"uuid":"ab307451-1db6-458f-94d9-d20444cf2a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6817","nonce":487766051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6819","nonce":487766051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6823","nonce":487766051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6821","nonce":487766051}]},"public_addr":"172.21.15.102:6817/487766051","cluster_addr":"172.21.15.102:6819/487766051","heartbeat_back_addr":"172.21.15.102:6823/487766051","heartbeat_front_addr":"172.21.15.102:6821/487766051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:18.891287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:45.696853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:13.008564+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:35.970470+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:59.792032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:24.357495+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6801/4115442638":"2024-09-20T08:55:02.044798+0000","172.21.15.49:6800/1436634671":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1518344664":"2024-09-20T08:55:02.044798+0000","172.21.15.49:0/3532044078":"2024-09-20T08:55:02.044798+0000","172.21.15.49:0/438801189":"2024-09-20T08:53:25.290361+0000","172.21.15.49:6801/1436634671":"2024-09-20T08:53:25.290361+0000","172.21.15.49:6801/1902543814":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/2691016053":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1246626107":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/2514955449":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1109277774":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/486100308":"2024-09-20T08:53:59.836934+0000","172.21.15.49:6800/1902543814":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/4103089507":"2024-09-20T08:55:02.044798+0000","172.21.15.49:6800/4115442638":"2024-09-20T08:55:02.044798+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60c006cc50 msgr2=0x7f60c006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60c006cc50 0x7f60c006f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60c8005fd0 tx=0x7f60c800b590 comp rx=0 tx=0).stop 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 msgr2=0x7f60d8072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d8072cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f60cc02a9c0 tx=0x7f60cc0055a0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 shutdown_connections 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60c006cc50 0x7f60c006f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60d8100750 0x7f60d8072cf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 --2- 172.21.15.49:0/51906347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d80ffda0 0x7f60d80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.784+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 >> 172.21.15.49:0/51906347 conn(0x7f60d80fb840 msgr2=0x7f60d80fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.785+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 shutdown_connections 2024-09-19T08:58:44.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:44.785+0000 7f60de1c1640 1 -- 172.21.15.49:0/51906347 wait complete. 2024-09-19T08:58:45.499 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:45 smithi049 ceph-mon[28158]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:45.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:45 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/51906347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:58:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:45 smithi102 ceph-mon[35280]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:45 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/51906347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:58:45.526 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T08:58:45.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:58:45.738 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:47.385 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:47 smithi049 ceph-mon[28158]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:47.385 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 -- 172.21.15.49:0/374868781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 msgr2=0x7f03e8109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/374868781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e8109ac0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009880 tx=0x7f03dc02a530 comp rx=0 tx=0).stop 2024-09-19T08:58:47.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 -- 172.21.15.49:0/374868781 shutdown_connections 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/374868781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e8109ac0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/374868781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03e8100cb0 0x7f03e8101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 -- 172.21.15.49:0/374868781 >> 172.21.15.49:0/374868781 conn(0x7f03e80758a0 msgr2=0x7f03e80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 -- 172.21.15.49:0/374868781 shutdown_connections 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.384+0000 7f03ef5fd640 1 -- 172.21.15.49:0/374868781 wait complete. 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ef5fd640 1 Processor -- start 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ef5fd640 1 -- start start 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ef5fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03e8100cb0 0x7f03e819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ef5fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ef5fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e819c3b0 con 0x7f03e81015d0 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ef5fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e8195940 con 0x7f03e8100cb0 2024-09-19T08:58:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ecb98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ecb98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36262/0 (socket says 172.21.15.49:36262) 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ecb98640 1 -- 172.21.15.49:0/532396537 learned_addr learned my addr 172.21.15.49:0/532396537 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ed399640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03e8100cb0 0x7f03e819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ecb98640 1 -- 172.21.15.49:0/532396537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03e8100cb0 msgr2=0x7f03e819b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ecb98640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03e8100cb0 0x7f03e819b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.385+0000 7f03ecb98640 1 -- 172.21.15.49:0/532396537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc009560 con 0x7f03e81015d0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.386+0000 7f03ecb98640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e819bd90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f03dc02aa50 tx=0x7f03dc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.386+0000 7f03e67fc640 1 -- 172.21.15.49:0/532396537 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc0048d0 con 0x7f03e81015d0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.386+0000 7f03e67fc640 1 -- 172.21.15.49:0/532396537 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03dc031640 con 0x7f03e81015d0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.386+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e8195bc0 con 0x7f03e81015d0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.386+0000 7f03e67fc640 1 -- 172.21.15.49:0/532396537 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc0038d0 con 0x7f03e81015d0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.386+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e81960b0 con 0x7f03e81015d0 2024-09-19T08:58:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.387+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e8068510 con 0x7f03e81015d0 2024-09-19T08:58:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.387+0000 7f03e67fc640 1 -- 172.21.15.49:0/532396537 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f03dc02ad50 con 0x7f03e81015d0 2024-09-19T08:58:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.388+0000 7f03e67fc640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03d006cc50 0x7f03d006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.388+0000 7f03e67fc640 1 -- 172.21.15.49:0/532396537 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f03dc0acaf0 con 0x7f03e81015d0 2024-09-19T08:58:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.388+0000 7f03ed399640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03d006cc50 0x7f03d006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.388+0000 7f03ed399640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03d006cc50 0x7f03d006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03d8005fd0 tx=0x7f03d8009680 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:47.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.392+0000 7f03e67fc640 1 -- 172.21.15.49:0/532396537 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03dc077330 con 0x7f03e81015d0 2024-09-19T08:58:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:47 smithi102 ceph-mon[35280]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:58:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.564+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03e8104310 con 0x7f03e81015d0 2024-09-19T08:58:47.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.564+0000 7f03e67fc640 1 -- 172.21.15.49:0/532396537 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11337 (secure 0 0 0) 0x7f03dc07a950 con 0x7f03e81015d0 2024-09-19T08:58:47.566 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:58:47.566 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"fsid":"63845326-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:53:00.909312+0000","modified":"2024-09-19T08:58:28.090949+0000","last_up_change":"2024-09-19T08:58:26.668729+0000","last_in_change":"2024-09-19T08:58:07.446405+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:16.550605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b5edac5e-6fcf-4e95-99a5-31c60b8acca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6803","nonce":4011886204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6805","nonce":4011886204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6809","nonce":4011886204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":4011886204},{"type":"v1","addr":"172.21.15.49:6807","nonce":4011886204}]},"public_addr":"172.21.15.49:6803/4011886204","cluster_addr":"172.21.15.49:6805/4011886204","heartbeat_back_addr":"172.21.15.49:6809/4011886204","heartbeat_front_addr":"172.21.15.49:6807/4011886204","state":["exists","up"]},{"osd":1,"uuid":"114e8646-e806-40cf-90ec-94f4f86baabe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6811","nonce":3633441521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6813","nonce":3633441521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6817","nonce":3633441521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3633441521},{"type":"v1","addr":"172.21.15.49:6815","nonce":3633441521}]},"public_addr":"172.21.15.49:6811/3633441521","cluster_addr":"172.21.15.49:6813/3633441521","heartbeat_back_addr":"172.21.15.49:6817/3633441521","heartbeat_front_addr":"172.21.15.49:6815/3633441521","state":["exists","up"]},{"osd":2,"uuid":"551521d5-2a1d-4ab1-9071-31885cbb5dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6819","nonce":3569205759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6821","nonce":3569205759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6825","nonce":3569205759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":3569205759},{"type":"v1","addr":"172.21.15.49:6823","nonce":3569205759}]},"public_addr":"172.21.15.49:6819/3569205759","cluster_addr":"172.21.15.49:6821/3569205759","heartbeat_back_addr":"172.21.15.49:6825/3569205759","heartbeat_front_addr":"172.21.15.49:6823/3569205759","state":["exists","up"]},{"osd":3,"uuid":"045c1198-0304-45d4-8f1f-082605b54826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6801","nonce":1601429235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6803","nonce":1601429235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6807","nonce":1601429235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1601429235},{"type":"v1","addr":"172.21.15.102:6805","nonce":1601429235}]},"public_addr":"172.21.15.102:6801/1601429235","cluster_addr":"172.21.15.102:6803/1601429235","heartbeat_back_addr":"172.21.15.102:6807/1601429235","heartbeat_front_addr":"172.21.15.102:6805/1601429235","state":["exists","up"]},{"osd":4,"uuid":"ff3b1b75-7d2a-4613-8289-b4474ddd2eb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6809","nonce":1101039955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6811","nonce":1101039955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6815","nonce":1101039955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1101039955},{"type":"v1","addr":"172.21.15.102:6813","nonce":1101039955}]},"public_addr":"172.21.15.102:6809/1101039955","cluster_addr":"172.21.15.102:6811/1101039955","heartbeat_back_addr":"172.21.15.102:6815/1101039955","heartbeat_front_addr":"172.21.15.102:6813/1101039955","state":["exists","up"]},{"osd":5,"uuid":"ab307451-1db6-458f-94d9-d20444cf2a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6817","nonce":487766051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6819","nonce":487766051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6823","nonce":487766051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":487766051},{"type":"v1","addr":"172.21.15.102:6821","nonce":487766051}]},"public_addr":"172.21.15.102:6817/487766051","cluster_addr":"172.21.15.102:6819/487766051","heartbeat_back_addr":"172.21.15.102:6823/487766051","heartbeat_front_addr":"172.21.15.102:6821/487766051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:18.891287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:45.696853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:13.008564+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:35.970470+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:59.792032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:24.357495+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6801/4115442638":"2024-09-20T08:55:02.044798+0000","172.21.15.49:6800/1436634671":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1518344664":"2024-09-20T08:55:02.044798+0000","172.21.15.49:0/3532044078":"2024-09-20T08:55:02.044798+0000","172.21.15.49:0/438801189":"2024-09-20T08:53:25.290361+0000","172.21.15.49:6801/1436634671":"2024-09-20T08:53:25.290361+0000","172.21.15.49:6801/1902543814":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/2691016053":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1246626107":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/2514955449":"2024-09-20T08:53:25.290361+0000","172.21.15.49:0/1109277774":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/486100308":"2024-09-20T08:53:59.836934+0000","172.21.15.49:6800/1902543814":"2024-09-20T08:53:59.836934+0000","172.21.15.49:0/4103089507":"2024-09-20T08:55:02.044798+0000","172.21.15.49:6800/4115442638":"2024-09-20T08:55:02.044798+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:58:47.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03d006cc50 msgr2=0x7f03d006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:47.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03d006cc50 0x7f03d006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f03d8005fd0 tx=0x7f03d8009680 comp rx=0 tx=0).stop 2024-09-19T08:58:47.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 msgr2=0x7f03e819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e819bd90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f03dc02aa50 tx=0x7f03dc0055a0 comp rx=0 tx=0).stop 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 shutdown_connections 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f03d006cc50 0x7f03d006f110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03e81015d0 0x7f03e819bd90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 --2- 172.21.15.49:0/532396537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03e8100cb0 0x7f03e819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 >> 172.21.15.49:0/532396537 conn(0x7f03e80758a0 msgr2=0x7f03e8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 shutdown_connections 2024-09-19T08:58:47.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:47.567+0000 7f03ef5fd640 1 -- 172.21.15.49:0/532396537 wait complete. 2024-09-19T08:58:48.130 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T08:58:48.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T08:58:48.131 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T08:58:48.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T08:58:48.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T08:58:48.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T08:58:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:48.465 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:48 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/532396537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:58:48.516 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:48.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:48 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/532396537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:58:49.503 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:49 smithi049 ceph-mon[28158]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:49.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:49 smithi102 ceph-mon[35280]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:50.446 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:50.455 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:51.277 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:51 smithi049 ceph-mon[28158]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:51 smithi102 ceph-mon[35280]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 -- 172.21.15.49:0/4177328518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640100c50 msgr2=0x7f8640101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 --2- 172.21.15.49:0/4177328518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640100c50 0x7f8640101030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86280098b0 tx=0x7f862802a4d0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 -- 172.21.15.49:0/4177328518 shutdown_connections 2024-09-19T08:58:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 --2- 172.21.15.49:0/4177328518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8640101600 0x7f8640109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 --2- 172.21.15.49:0/4177328518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640100c50 0x7f8640101030 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 -- 172.21.15.49:0/4177328518 >> 172.21.15.49:0/4177328518 conn(0x7f86400fa700 msgr2=0x7f86400fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 -- 172.21.15.49:0/4177328518 shutdown_connections 2024-09-19T08:58:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.198+0000 7f8644cab640 1 -- 172.21.15.49:0/4177328518 wait complete. 2024-09-19T08:58:52.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f8644cab640 1 Processor -- start 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f8644cab640 1 -- start start 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f8644cab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8640100c50 0x7f864019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f8644cab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101600 0x7f864019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f8644cab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640195940 con 0x7f8640101600 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f8644cab640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640195a80 con 0x7f8640100c50 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f863dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101600 0x7f864019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f863dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101600 0x7f864019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42604/0 (socket says 172.21.15.49:42604) 2024-09-19T08:58:52.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f863dd9b640 1 -- 172.21.15.49:0/1434960400 learned_addr learned my addr 172.21.15.49:0/1434960400 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.199+0000 7f863e59c640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8640100c50 0x7f864019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f863dd9b640 1 -- 172.21.15.49:0/1434960400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8640100c50 msgr2=0x7f864019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f863dd9b640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8640100c50 0x7f864019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f863dd9b640 1 -- 172.21.15.49:0/1434960400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009560 con 0x7f8640101600 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f863dd9b640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101600 0x7f864019be20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f863000d6f0 tx=0x7f863000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8630009a30 con 0x7f8640101600 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8640195d60 con 0x7f8640101600 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86300054e0 con 0x7f8640101600 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8630010460 con 0x7f8640101600 2024-09-19T08:58:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.200+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86401962b0 con 0x7f8640101600 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.201+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f864010d0c0 con 0x7f8640101600 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.202+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8630009b90 con 0x7f8640101600 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.202+0000 7f86377fe640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f862c06cc50 0x7f862c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.202+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f863008be00 con 0x7f8640101600 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.202+0000 7f863e59c640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f862c06cc50 0x7f862c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.202+0000 7f86377fe640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] conn(0x7f862c0729e0 0x7f862c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.202+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 --> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f862c0754b0 con 0x7f862c0729e0 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.202+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f863008c260 con 0x7f8640101600 2024-09-19T08:58:52.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.203+0000 7f863ed9d640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] conn(0x7f862c0729e0 0x7f862c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:52.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.203+0000 7f863e59c640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f862c06cc50 0x7f862c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8628009880 tx=0x7f86280058d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:52.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.203+0000 7f863ed9d640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] conn(0x7f862c0729e0 0x7f862c074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:52.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.204+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== osd.1 v2:172.21.15.49:6810/3633441521 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f862c0754b0 con 0x7f862c0729e0 2024-09-19T08:58:52.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.217+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 --> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8640196710 con 0x7f862c0729e0 2024-09-19T08:58:52.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.217+0000 7f86377fe640 1 -- 172.21.15.49:0/1434960400 <== osd.1 v2:172.21.15.49:6810/3633441521 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8640196710 con 0x7f862c0729e0 2024-09-19T08:58:52.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] conn(0x7f862c0729e0 msgr2=0x7f862c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:52.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] conn(0x7f862c0729e0 0x7f862c074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f862c06cc50 msgr2=0x7f862c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f862c06cc50 0x7f862c06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8628009880 tx=0x7f86280058d0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101600 msgr2=0x7f864019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101600 0x7f864019be20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f863000d6f0 tx=0x7f863000dbb0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 shutdown_connections 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6810/3633441521,v1:172.21.15.49:6811/3633441521] conn(0x7f862c0729e0 0x7f862c074e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f862c06cc50 0x7f862c06f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8640101600 0x7f864019be20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 --2- 172.21.15.49:0/1434960400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8640100c50 0x7f864019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 >> 172.21.15.49:0/1434960400 conn(0x7f86400fa700 msgr2=0x7f8640101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 shutdown_connections 2024-09-19T08:58:52.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:52.218+0000 7f8644cab640 1 -- 172.21.15.49:0/1434960400 wait complete. 2024-09-19T08:58:52.230 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:58:53.441 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:53 smithi049 ceph-mon[28158]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:53 smithi102 ceph-mon[35280]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.297+0000 7fee4847d640 1 -- 172.21.15.49:0/105641507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40100d50 msgr2=0x7fee40101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.297+0000 7fee4847d640 1 --2- 172.21.15.49:0/105641507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40100d50 0x7fee40101130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009880 tx=0x7fee3c02a530 comp rx=0 tx=0).stop 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 -- 172.21.15.49:0/105641507 shutdown_connections 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 --2- 172.21.15.49:0/105641507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee40101670 0x7fee40109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 --2- 172.21.15.49:0/105641507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40100d50 0x7fee40101130 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 -- 172.21.15.49:0/105641507 >> 172.21.15.49:0/105641507 conn(0x7fee400758a0 msgr2=0x7fee400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 -- 172.21.15.49:0/105641507 shutdown_connections 2024-09-19T08:58:53.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 -- 172.21.15.49:0/105641507 wait complete. 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 Processor -- start 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 -- start start 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.298+0000 7fee4847d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee40100d50 0x7fee4019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee4847d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40101670 0x7fee4019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee4847d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4019c510 con 0x7fee40101670 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee4847d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee40195aa0 con 0x7fee40100d50 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee45a18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40101670 0x7fee4019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee45a18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40101670 0x7fee4019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42610/0 (socket says 172.21.15.49:42610) 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee45a18640 1 -- 172.21.15.49:0/2434078145 learned_addr learned my addr 172.21.15.49:0/2434078145 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee46219640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee40100d50 0x7fee4019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:53.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee45a18640 1 -- 172.21.15.49:0/2434078145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee40100d50 msgr2=0x7fee4019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee45a18640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee40100d50 0x7fee4019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee45a18640 1 -- 172.21.15.49:0/2434078145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c009560 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee45a18640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40101670 0x7fee4019bef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee3000b420 tx=0x7fee3000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee30011800 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee30011e20 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee40195d80 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee3000f2e0 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.299+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee401962d0 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.300+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee4010d080 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.302+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fee30010380 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.302+0000 7fee377fe640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee2c06cc50 0x7fee2c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.302+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fee3008c350 con 0x7fee40101670 2024-09-19T08:58:53.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.302+0000 7fee46219640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee2c06cc50 0x7fee2c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.302+0000 7fee377fe640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] conn(0x7fee2c0729e0 0x7fee2c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.302+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 --> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee2c0754b0 con 0x7fee2c0729e0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.302+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee3008c7b0 con 0x7fee40101670 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.303+0000 7fee46a1a640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] conn(0x7fee2c0729e0 0x7fee2c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.303+0000 7fee46219640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee2c06cc50 0x7fee2c06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee3c000c00 tx=0x7fee3c031400 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.303+0000 7fee46a1a640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] conn(0x7fee2c0729e0 0x7fee2c074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.304+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== osd.0 v2:172.21.15.49:6802/4011886204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fee2c0754b0 con 0x7fee2c0729e0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.317+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 --> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee40068470 con 0x7fee2c0729e0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.317+0000 7fee377fe640 1 -- 172.21.15.49:0/2434078145 <== osd.0 v2:172.21.15.49:6802/4011886204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee40068470 con 0x7fee2c0729e0 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.318+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] conn(0x7fee2c0729e0 msgr2=0x7fee2c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.318+0000 7fee4847d640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] conn(0x7fee2c0729e0 0x7fee2c074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee2c06cc50 msgr2=0x7fee2c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee2c06cc50 0x7fee2c06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee3c000c00 tx=0x7fee3c031400 comp rx=0 tx=0).stop 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40101670 msgr2=0x7fee4019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40101670 0x7fee4019bef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fee3000b420 tx=0x7fee3000b8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 shutdown_connections 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6802/4011886204,v1:172.21.15.49:6803/4011886204] conn(0x7fee2c0729e0 0x7fee2c074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee2c06cc50 0x7fee2c06f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee40101670 0x7fee4019bef0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 --2- 172.21.15.49:0/2434078145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee40100d50 0x7fee4019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 >> 172.21.15.49:0/2434078145 conn(0x7fee400758a0 msgr2=0x7fee40101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 shutdown_connections 2024-09-19T08:58:53.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:53.319+0000 7fee4847d640 1 -- 172.21.15.49:0/2434078145 wait complete. 2024-09-19T08:58:54.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.168+0000 7f7f13334640 1 -- 172.21.15.49:0/2972445003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c1049f0 msgr2=0x7f7f0c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.168+0000 7f7f13334640 1 --2- 172.21.15.49:0/2972445003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c1049f0 0x7f7f0c104dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009880 tx=0x7f7f0802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.168+0000 7f7f13334640 1 -- 172.21.15.49:0/2972445003 shutdown_connections 2024-09-19T08:58:54.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.168+0000 7f7f13334640 1 --2- 172.21.15.49:0/2972445003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c0fe9f0 0x7f7f0c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.168+0000 7f7f13334640 1 --2- 172.21.15.49:0/2972445003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c1049f0 0x7f7f0c104dd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.168+0000 7f7f13334640 1 -- 172.21.15.49:0/2972445003 >> 172.21.15.49:0/2972445003 conn(0x7f7f0c0758a0 msgr2=0x7f7f0c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.169+0000 7f7f13334640 1 -- 172.21.15.49:0/2972445003 shutdown_connections 2024-09-19T08:58:54.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.169+0000 7f7f13334640 1 -- 172.21.15.49:0/2972445003 wait complete. 2024-09-19T08:58:54.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.169+0000 7f7f13334640 1 Processor -- start 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.169+0000 7f7f13334640 1 -- start start 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f13334640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0fe9f0 0x7f7f0c0fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f13334640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c1049f0 0x7f7f0c0fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f13334640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0fb800 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f13334640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0fb940 con 0x7f7f0c1049f0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f110d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0fe9f0 0x7f7f0c0fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f110d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0fe9f0 0x7f7f0c0fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42624/0 (socket says 172.21.15.49:42624) 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f110d0640 1 -- 172.21.15.49:0/378838073 learned_addr learned my addr 172.21.15.49:0/378838073 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f108cf640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c1049f0 0x7f7f0c0fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f110d0640 1 -- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c1049f0 msgr2=0x7f7f0c0fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f110d0640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c1049f0 0x7f7f0c0fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f110d0640 1 -- 172.21.15.49:0/378838073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009560 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f110d0640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0fe9f0 0x7f7f0c0fad80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7f08006010 tx=0x7f7f080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f080048d0 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f08031640 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c0fbbc0 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.170+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f08003820 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.171+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c1a2040 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.171+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f0c100130 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.172+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7f080317b0 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.172+0000 7f7f027fc640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7ef806cc60 0x7f7ef806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.173+0000 7f7f108cf640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7ef806cc60 0x7f7ef806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.173+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7f080acd90 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.173+0000 7f7f027fc640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] conn(0x7f7ef80729f0 0x7f7ef8074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.173+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 --> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ef80754c0 con 0x7f7ef80729f0 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.173+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f080b2470 con 0x7f7f0c0fe9f0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.173+0000 7f7f108cf640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7ef806cc60 0x7f7ef806f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0fc880 tx=0x7f7efc005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.173+0000 7f7f118d1640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] conn(0x7f7ef80729f0 0x7f7ef8074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.174+0000 7f7f118d1640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] conn(0x7f7ef80729f0 0x7f7ef8074e10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.174+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== osd.4 v2:172.21.15.102:6808/1101039955 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7ef80754c0 con 0x7f7ef80729f0 2024-09-19T08:58:54.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.190+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 --> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f0c10bec0 con 0x7f7ef80729f0 2024-09-19T08:58:54.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.190+0000 7f7f027fc640 1 -- 172.21.15.49:0/378838073 <== osd.4 v2:172.21.15.102:6808/1101039955 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7f0c10bec0 con 0x7f7ef80729f0 2024-09-19T08:58:54.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] conn(0x7f7ef80729f0 msgr2=0x7f7ef8074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] conn(0x7f7ef80729f0 0x7f7ef8074e10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7ef806cc60 msgr2=0x7f7ef806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7ef806cc60 0x7f7ef806f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0fc880 tx=0x7f7efc005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0fe9f0 msgr2=0x7f7f0c0fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0fe9f0 0x7f7f0c0fad80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7f08006010 tx=0x7f7f080055a0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 shutdown_connections 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:6808/1101039955,v1:172.21.15.102:6809/1101039955] conn(0x7f7ef80729f0 0x7f7ef8074e10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7ef806cc60 0x7f7ef806f120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0c1049f0 0x7f7f0c0fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 --2- 172.21.15.49:0/378838073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f0c0fe9f0 0x7f7f0c0fad80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 >> 172.21.15.49:0/378838073 conn(0x7f7f0c0758a0 msgr2=0x7f7f0c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 shutdown_connections 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:54.191+0000 7f7f13334640 1 -- 172.21.15.49:0/378838073 wait complete. 2024-09-19T08:58:55.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:55 smithi049 ceph-mon[28158]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:55.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:55 smithi102 ceph-mon[35280]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:57 smithi102 ceph-mon[35280]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:57.525 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:57 smithi049 ceph-mon[28158]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:57.589 INFO:teuthology.orchestra.run.smithi049.stdout:60129542171 2024-09-19T08:58:57.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T08:58:58.329 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:58:58 smithi049 ceph-mon[28158]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:58.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:58:58 smithi102 ceph-mon[35280]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 -- 172.21.15.49:0/607045697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2880ffda0 msgr2=0x7fe288100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 --2- 172.21.15.49:0/607045697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2880ffda0 0x7fe288100180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe278009880 tx=0x7fe27802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 -- 172.21.15.49:0/607045697 shutdown_connections 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 --2- 172.21.15.49:0/607045697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe288100750 0x7fe2881047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 --2- 172.21.15.49:0/607045697 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2880ffda0 0x7fe288100180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 -- 172.21.15.49:0/607045697 >> 172.21.15.49:0/607045697 conn(0x7fe2880fb840 msgr2=0x7fe2880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 -- 172.21.15.49:0/607045697 shutdown_connections 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.645+0000 7fe28e301640 1 -- 172.21.15.49:0/607045697 wait complete. 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.646+0000 7fe28e301640 1 Processor -- start 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.646+0000 7fe28e301640 1 -- start start 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe28e301640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2880ffda0 0x7fe2880727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe28e301640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe288100750 0x7fe288072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe28e301640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe288073230 con 0x7fe288100750 2024-09-19T08:58:58.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe28e301640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880733a0 con 0x7fe2880ffda0 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe2877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe288100750 0x7fe288072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe2877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe288100750 0x7fe288072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42658/0 (socket says 172.21.15.49:42658) 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe2877fe640 1 -- 172.21.15.49:0/2056393570 learned_addr learned my addr 172.21.15.49:0/2056393570 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe287fff640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2880ffda0 0x7fe2880727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe2877fe640 1 -- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2880ffda0 msgr2=0x7fe2880727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe2877fe640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2880ffda0 0x7fe2880727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.647+0000 7fe2877fe640 1 -- 172.21.15.49:0/2056393570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009560 con 0x7fe288100750 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.648+0000 7fe2877fe640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe288100750 0x7fe288072cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00b420 tx=0x7fe27c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.648+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27c011800 con 0x7fe288100750 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.648+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2881a1d90 con 0x7fe288100750 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.648+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2881a20f0 con 0x7fe288100750 2024-09-19T08:58:58.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.648+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe27c011e20 con 0x7fe288100750 2024-09-19T08:58:58.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.648+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27c00f2e0 con 0x7fe288100750 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.649+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe274000fc0 con 0x7fe288100750 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.650+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe27c00f590 con 0x7fe288100750 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.650+0000 7fe2857fa640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe27006cc50 0x7fe27006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.650+0000 7fe287fff640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe27006cc50 0x7fe27006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.650+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe27c08b670 con 0x7fe288100750 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.651+0000 7fe2857fa640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] conn(0x7fe2700729e0 0x7fe270074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.651+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 --> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2700754b0 con 0x7fe2700729e0 2024-09-19T08:58:58.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.651+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe27c08dd40 con 0x7fe288100750 2024-09-19T08:58:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.651+0000 7fe28c89e640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] conn(0x7fe2700729e0 0x7fe270074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.651+0000 7fe287fff640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe27006cc50 0x7fe27006f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe278009230 tx=0x7fe2780058d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.651+0000 7fe28c89e640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] conn(0x7fe2700729e0 0x7fe270074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.652+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== osd.5 v2:172.21.15.102:6816/487766051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe2700754b0 con 0x7fe2700729e0 2024-09-19T08:58:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.667+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 --> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe274002c20 con 0x7fe2700729e0 2024-09-19T08:58:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.667+0000 7fe2857fa640 1 -- 172.21.15.49:0/2056393570 <== osd.5 v2:172.21.15.102:6816/487766051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe274002c20 con 0x7fe2700729e0 2024-09-19T08:58:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.667+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] conn(0x7fe2700729e0 msgr2=0x7fe270074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.667+0000 7fe28e301640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] conn(0x7fe2700729e0 0x7fe270074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe27006cc50 msgr2=0x7fe27006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe27006cc50 0x7fe27006f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe278009230 tx=0x7fe2780058d0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe288100750 msgr2=0x7fe288072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe288100750 0x7fe288072cf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00b420 tx=0x7fe27c00b8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 shutdown_connections 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe27006cc50 0x7fe27006f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe288100750 0x7fe288072cf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:6816/487766051,v1:172.21.15.102:6817/487766051] conn(0x7fe2700729e0 0x7fe270074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 --2- 172.21.15.49:0/2056393570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2880ffda0 0x7fe2880727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 >> 172.21.15.49:0/2056393570 conn(0x7fe2880fb840 msgr2=0x7fe2880fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 shutdown_connections 2024-09-19T08:58:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.668+0000 7fe28e301640 1 -- 172.21.15.49:0/2056393570 wait complete. 2024-09-19T08:58:58.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 -- 172.21.15.49:0/3534125534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 msgr2=0x7ff16c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 --2- 172.21.15.49:0/3534125534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c104dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009880 tx=0x7ff15c02a4a0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 -- 172.21.15.49:0/3534125534 shutdown_connections 2024-09-19T08:58:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 --2- 172.21.15.49:0/3534125534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff16c0fe9f0 0x7ff16c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 --2- 172.21.15.49:0/3534125534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c104dd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 -- 172.21.15.49:0/3534125534 >> 172.21.15.49:0/3534125534 conn(0x7ff16c0758a0 msgr2=0x7ff16c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 -- 172.21.15.49:0/3534125534 shutdown_connections 2024-09-19T08:58:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.521+0000 7ff170e18640 1 -- 172.21.15.49:0/3534125534 wait complete. 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff170e18640 1 Processor -- start 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff170e18640 1 -- start start 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff170e18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff16c0fe9f0 0x7ff16c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff170e18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff170e18640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c197510 con 0x7ff16c1049f0 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff170e18640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c197680 con 0x7ff16c0fe9f0 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff169d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff169d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42636/0 (socket says 172.21.15.49:42636) 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff169d9b640 1 -- 172.21.15.49:0/3138942548 learned_addr learned my addr 172.21.15.49:0/3138942548 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:58:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.522+0000 7ff16a59c640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff16c0fe9f0 0x7ff16c196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff169d9b640 1 -- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff16c0fe9f0 msgr2=0x7ff16c196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff169d9b640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff16c0fe9f0 0x7ff16c196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff169d9b640 1 -- 172.21.15.49:0/3138942548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c009560 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff169d9b640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c196f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b420 tx=0x7ff16000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff160011800 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16c19fa70 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff160011e20 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff16000f2e0 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.523+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16c19fee0 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.524+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff16c10bfe0 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.525+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff160010380 con 0x7ff16c1049f0 2024-09-19T08:58:58.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.525+0000 7ff15b7fe640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff15406cc50 0x7ff15406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.525+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff16008b880 con 0x7ff16c1049f0 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.525+0000 7ff16a59c640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff15406cc50 0x7ff15406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.525+0000 7ff15b7fe640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] conn(0x7ff1540729e0 0x7ff154074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.525+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 --> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1540754b0 con 0x7ff1540729e0 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.525+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1600902a0 con 0x7ff16c1049f0 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.526+0000 7ff16ad9d640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] conn(0x7ff1540729e0 0x7ff154074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.526+0000 7ff16a59c640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff15406cc50 0x7ff15406f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff15c000c00 tx=0x7ff15c005a20 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.526+0000 7ff16ad9d640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] conn(0x7ff1540729e0 0x7ff154074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.527+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== osd.3 v2:172.21.15.102:6800/1601429235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff1540754b0 con 0x7ff1540729e0 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.540+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 --> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff16c100130 con 0x7ff1540729e0 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff15b7fe640 1 -- 172.21.15.49:0/3138942548 <== osd.3 v2:172.21.15.102:6800/1601429235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff16c100130 con 0x7ff1540729e0 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] conn(0x7ff1540729e0 msgr2=0x7ff154074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] conn(0x7ff1540729e0 0x7ff154074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff15406cc50 msgr2=0x7ff15406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff15406cc50 0x7ff15406f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff15c000c00 tx=0x7ff15c005a20 comp rx=0 tx=0).stop 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 msgr2=0x7ff16c196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c196f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff16000b420 tx=0x7ff16000b8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 shutdown_connections 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:6800/1601429235,v1:172.21.15.102:6801/1601429235] conn(0x7ff1540729e0 0x7ff154074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff15406cc50 0x7ff15406f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff16c1049f0 0x7ff16c196f40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 --2- 172.21.15.49:0/3138942548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff16c0fe9f0 0x7ff16c196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 >> 172.21.15.49:0/3138942548 conn(0x7ff16c0758a0 msgr2=0x7ff16c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 shutdown_connections 2024-09-19T08:58:58.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:58:58.541+0000 7ff170e18640 1 -- 172.21.15.49:0/3138942548 wait complete. 2024-09-19T08:58:59.407 INFO:teuthology.orchestra.run.smithi049.stdout:111669149715 2024-09-19T08:58:59.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T08:58:59.794 INFO:teuthology.orchestra.run.smithi049.stdout:146028888077 2024-09-19T08:58:59.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T08:59:00.349 INFO:teuthology.orchestra.run.smithi049.stdout:38654705698 2024-09-19T08:59:00.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T08:59:01.011 INFO:teuthology.orchestra.run.smithi049.stdout:167503724554 2024-09-19T08:59:01.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T08:59:01.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.189+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1511457793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a540ffda0 msgr2=0x7f2a54100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:01.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.189+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1511457793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a540ffda0 0x7f2a54100180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009880 tx=0x7f2a4802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.189+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1511457793 shutdown_connections 2024-09-19T08:59:01.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.189+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1511457793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a54100750 0x7f2a541047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.189+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1511457793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a540ffda0 0x7f2a54100180 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.189+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1511457793 >> 172.21.15.49:0/1511457793 conn(0x7f2a540fb840 msgr2=0x7f2a540fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:01.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.190+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1511457793 shutdown_connections 2024-09-19T08:59:01.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.190+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1511457793 wait complete. 2024-09-19T08:59:01.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.190+0000 7f2a5ab6f640 1 Processor -- start 2024-09-19T08:59:01.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.190+0000 7f2a5ab6f640 1 -- start start 2024-09-19T08:59:01.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a5ab6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540ffda0 0x7f2a540727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:01.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a5ab6f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a54100750 0x7f2a54072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:01.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a5ab6f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54073230 con 0x7f2a54100750 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a5ab6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540733a0 con 0x7f2a540ffda0 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a54100750 0x7f2a54072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a54100750 0x7f2a54072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58474/0 (socket says 172.21.15.49:58474) 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a53fff640 1 -- 172.21.15.49:0/1950674333 learned_addr learned my addr 172.21.15.49:0/1950674333 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a5890b640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540ffda0 0x7f2a540727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a53fff640 1 -- 172.21.15.49:0/1950674333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540ffda0 msgr2=0x7f2a540727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a53fff640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540ffda0 0x7f2a540727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a53fff640 1 -- 172.21.15.49:0/1950674333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48009560 con 0x7f2a54100750 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a53fff640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a54100750 0x7f2a54072cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000b420 tx=0x7f2a4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a40011800 con 0x7f2a54100750 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.191+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a40011e20 con 0x7f2a54100750 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.192+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a541a1d90 con 0x7f2a54100750 2024-09-19T08:59:01.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.192+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a4000f2e0 con 0x7f2a54100750 2024-09-19T08:59:01.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.192+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a541a20f0 con 0x7f2a54100750 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.193+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a5410d0f0 con 0x7f2a54100750 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.193+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2a40010380 con 0x7f2a54100750 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a51ffb640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2a4406cc60 0x7f2a4406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2a4008b7c0 con 0x7f2a54100750 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a5890b640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2a4406cc60 0x7f2a4406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a51ffb640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] conn(0x7f2a440729f0 0x7f2a44074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 --> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a440754c0 con 0x7f2a440729f0 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a400902a0 con 0x7f2a54100750 2024-09-19T08:59:01.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a5910c640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] conn(0x7f2a440729f0 0x7f2a44074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:01.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a5890b640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2a4406cc60 0x7f2a4406f120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a48031420 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:01.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.194+0000 7f2a5910c640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] conn(0x7f2a440729f0 0x7f2a44074e10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:01.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.195+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== osd.2 v2:172.21.15.49:6818/3569205759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2a440754c0 con 0x7f2a440729f0 2024-09-19T08:59:01.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.208+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 --> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a54060b30 con 0x7f2a440729f0 2024-09-19T08:59:01.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a51ffb640 1 -- 172.21.15.49:0/1950674333 <== osd.2 v2:172.21.15.49:6818/3569205759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a54060b30 con 0x7f2a440729f0 2024-09-19T08:59:01.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] conn(0x7f2a440729f0 msgr2=0x7f2a44074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:01.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] conn(0x7f2a440729f0 0x7f2a44074e10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2a4406cc60 msgr2=0x7f2a4406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2a4406cc60 0x7f2a4406f120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a48031420 comp rx=0 tx=0).stop 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a54100750 msgr2=0x7f2a54072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a54100750 0x7f2a54072cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000b420 tx=0x7f2a4000b8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 shutdown_connections 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6818/3569205759,v1:172.21.15.49:6819/3569205759] conn(0x7f2a440729f0 0x7f2a44074e10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2a4406cc60 0x7f2a4406f120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a54100750 0x7f2a54072cf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 --2- 172.21.15.49:0/1950674333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a540ffda0 0x7f2a540727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 >> 172.21.15.49:0/1950674333 conn(0x7f2a540fb840 msgr2=0x7f2a540fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 shutdown_connections 2024-09-19T08:59:01.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:01.209+0000 7f2a5ab6f640 1 -- 172.21.15.49:0/1950674333 wait complete. 2024-09-19T08:59:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:01 smithi049 ceph-mon[28158]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:01 smithi102 ceph-mon[35280]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:01.865 INFO:teuthology.orchestra.run.smithi049.stdout:81604378649 2024-09-19T08:59:01.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T08:59:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:02.008 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:02.014 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:02.385 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:02.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:02 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:03.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:03 smithi049 ceph-mon[28158]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:03.484 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:03 smithi102 ceph-mon[35280]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:05 smithi049 ceph-mon[28158]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:05.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:05 smithi102 ceph-mon[35280]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:07.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 -- 172.21.15.49:0/1852312944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c100750 msgr2=0x7f056c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 --2- 172.21.15.49:0/1852312944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c100750 0x7f056c1047a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0560009880 tx=0x7f056002a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 -- 172.21.15.49:0/1852312944 shutdown_connections 2024-09-19T08:59:07.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 --2- 172.21.15.49:0/1852312944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c100750 0x7f056c1047a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 --2- 172.21.15.49:0/1852312944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056c0ffda0 0x7f056c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 -- 172.21.15.49:0/1852312944 >> 172.21.15.49:0/1852312944 conn(0x7f056c0fb840 msgr2=0x7f056c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:07.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 -- 172.21.15.49:0/1852312944 shutdown_connections 2024-09-19T08:59:07.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 -- 172.21.15.49:0/1852312944 wait complete. 2024-09-19T08:59:07.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 Processor -- start 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.295+0000 7f0571ae3640 1 -- start start 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f0571ae3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c0ffda0 0x7f056c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f0571ae3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056c100750 0x7f056c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f0571ae3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c073230 con 0x7f056c0ffda0 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f0571ae3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c073370 con 0x7f056c100750 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c0ffda0 0x7f056c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c0ffda0 0x7f056c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58494/0 (socket says 172.21.15.49:58494) 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056b7fe640 1 -- 172.21.15.49:0/2794085227 learned_addr learned my addr 172.21.15.49:0/2794085227 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056affd640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056c100750 0x7f056c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056b7fe640 1 -- 172.21.15.49:0/2794085227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056c100750 msgr2=0x7f056c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056b7fe640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056c100750 0x7f056c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056b7fe640 1 -- 172.21.15.49:0/2794085227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560009560 con 0x7f056c0ffda0 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056affd640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056c100750 0x7f056c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f056b7fe640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c0ffda0 0x7f056c0727b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f055c00d6f0 tx=0x7f055c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f0568ff9640 1 -- 172.21.15.49:0/2794085227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c009a30 con 0x7f056c0ffda0 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f0568ff9640 1 -- 172.21.15.49:0/2794085227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f055c0054e0 con 0x7f056c0ffda0 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.296+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c1a1cd0 con 0x7f056c0ffda0 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.297+0000 7f0568ff9640 1 -- 172.21.15.49:0/2794085227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c010460 con 0x7f056c0ffda0 2024-09-19T08:59:07.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.297+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c1a20e0 con 0x7f056c0ffda0 2024-09-19T08:59:07.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.298+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c101280 con 0x7f056c0ffda0 2024-09-19T08:59:07.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.298+0000 7f0568ff9640 1 -- 172.21.15.49:0/2794085227 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f055c009b90 con 0x7f056c0ffda0 2024-09-19T08:59:07.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.299+0000 7f0568ff9640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f055406cc60 0x7f055406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:07.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.299+0000 7f0568ff9640 1 -- 172.21.15.49:0/2794085227 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f055c08bac0 con 0x7f056c0ffda0 2024-09-19T08:59:07.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.299+0000 7f056affd640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f055406cc60 0x7f055406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:07.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.299+0000 7f056affd640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f055406cc60 0x7f055406f120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0560000c00 tx=0x7f05600041a0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:07.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.303+0000 7f0568ff9640 1 -- 172.21.15.49:0/2794085227 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f055c0561d0 con 0x7f056c0ffda0 2024-09-19T08:59:07.407 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:07 smithi049 ceph-mon[28158]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:07.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.477+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f056c073da0 con 0x7f056c0ffda0 2024-09-19T08:59:07.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.477+0000 7f0568ff9640 1 -- 172.21.15.49:0/2794085227 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f055c0597f0 con 0x7f056c0ffda0 2024-09-19T08:59:07.477 INFO:teuthology.orchestra.run.smithi049.stdout:167503724555 2024-09-19T08:59:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.479+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f055406cc60 msgr2=0x7f055406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.479+0000 7f0571ae3640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f055406cc60 0x7f055406f120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0560000c00 tx=0x7f05600041a0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.479+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c0ffda0 msgr2=0x7f056c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.479+0000 7f0571ae3640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c0ffda0 0x7f056c0727b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f055c00d6f0 tx=0x7f055c00dbb0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.480+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 shutdown_connections 2024-09-19T08:59:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.480+0000 7f0571ae3640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f055406cc60 0x7f055406f120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.480+0000 7f0571ae3640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056c100750 0x7f056c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.480+0000 7f0571ae3640 1 --2- 172.21.15.49:0/2794085227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f056c0ffda0 0x7f056c0727b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.480+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 >> 172.21.15.49:0/2794085227 conn(0x7f056c0fb840 msgr2=0x7f056c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.480+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 shutdown_connections 2024-09-19T08:59:07.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.480+0000 7f0571ae3640 1 -- 172.21.15.49:0/2794085227 wait complete. 2024-09-19T08:59:07.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:07 smithi102 ceph-mon[35280]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 -- 172.21.15.49:0/2202148566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c100cb0 msgr2=0x7fc02c101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 --2- 172.21.15.49:0/2202148566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c100cb0 0x7fc02c101090 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc028009880 tx=0x7fc02802a530 comp rx=0 tx=0).stop 2024-09-19T08:59:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 -- 172.21.15.49:0/2202148566 shutdown_connections 2024-09-19T08:59:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 --2- 172.21.15.49:0/2202148566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc02c1015d0 0x7fc02c109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 --2- 172.21.15.49:0/2202148566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c100cb0 0x7fc02c101090 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 -- 172.21.15.49:0/2202148566 >> 172.21.15.49:0/2202148566 conn(0x7fc02c0758a0 msgr2=0x7fc02c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:07.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 -- 172.21.15.49:0/2202148566 shutdown_connections 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 -- 172.21.15.49:0/2202148566 wait complete. 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 Processor -- start 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.489+0000 7fc034557640 1 -- start start 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc034557640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc02c100cb0 0x7fc02c19dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc034557640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c1015d0 0x7fc02c19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc034557640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c197b10 con 0x7fc02c1015d0 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc034557640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c197c50 con 0x7fc02c100cb0 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc031af2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c1015d0 0x7fc02c19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc0322f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc02c100cb0 0x7fc02c19dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc031af2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c1015d0 0x7fc02c19dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58510/0 (socket says 172.21.15.49:58510) 2024-09-19T08:59:07.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc031af2640 1 -- 172.21.15.49:0/954606176 learned_addr learned my addr 172.21.15.49:0/954606176 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc031af2640 1 -- 172.21.15.49:0/954606176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc02c100cb0 msgr2=0x7fc02c19dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc031af2640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc02c100cb0 0x7fc02c19dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc031af2640 1 -- 172.21.15.49:0/954606176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009560 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.490+0000 7fc031af2640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c1015d0 0x7fc02c19dff0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c8f0 tx=0x7fc01c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.491+0000 7fc0237fe640 1 -- 172.21.15.49:0/954606176 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01c007b80 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.491+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c197f30 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.491+0000 7fc0237fe640 1 -- 172.21.15.49:0/954606176 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc01c00ae50 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.491+0000 7fc0237fe640 1 -- 172.21.15.49:0/954606176 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01c004e50 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.491+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c198480 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.492+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c068510 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.492+0000 7fc0237fe640 1 -- 172.21.15.49:0/954606176 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc01c004ff0 con 0x7fc02c1015d0 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.493+0000 7fc0237fe640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc01806cbf0 0x7fc01806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:07.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.493+0000 7fc0322f3640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc01806cbf0 0x7fc01806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.493+0000 7fc0237fe640 1 -- 172.21.15.49:0/954606176 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc01c08bc20 con 0x7fc02c1015d0 2024-09-19T08:59:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.494+0000 7fc0322f3640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc01806cbf0 0x7fc01806f0b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc028009230 tx=0x7fc0280058d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:07.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.497+0000 7fc0237fe640 1 -- 172.21.15.49:0/954606176 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc01c0563e0 con 0x7fc02c1015d0 2024-09-19T08:59:07.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.670+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc02c10cda0 con 0x7fc02c1015d0 2024-09-19T08:59:07.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.671+0000 7fc0237fe640 1 -- 172.21.15.49:0/954606176 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc01c01d020 con 0x7fc02c1015d0 2024-09-19T08:59:07.670 INFO:teuthology.orchestra.run.smithi049.stdout:146028888079 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc01806cbf0 msgr2=0x7fc01806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc01806cbf0 0x7fc01806f0b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc028009230 tx=0x7fc0280058d0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c1015d0 msgr2=0x7fc02c19dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c1015d0 0x7fc02c19dff0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00c8f0 tx=0x7fc01c00cdb0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 shutdown_connections 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc01806cbf0 0x7fc01806f0b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc02c1015d0 0x7fc02c19dff0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 --2- 172.21.15.49:0/954606176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc02c100cb0 0x7fc02c19dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 >> 172.21.15.49:0/954606176 conn(0x7fc02c0758a0 msgr2=0x7fc02c0ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:07.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 shutdown_connections 2024-09-19T08:59:07.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:07.673+0000 7fc034557640 1 -- 172.21.15.49:0/954606176 wait complete. 2024-09-19T08:59:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.179+0000 7fcd5621b640 1 -- 172.21.15.49:0/24318452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 msgr2=0x7fcd501010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.179+0000 7fcd5621b640 1 --2- 172.21.15.49:0/24318452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd501010f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd380098b0 tx=0x7fcd3802a560 comp rx=0 tx=0).stop 2024-09-19T08:59:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.179+0000 7fcd5621b640 1 -- 172.21.15.49:0/24318452 shutdown_connections 2024-09-19T08:59:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.179+0000 7fcd5621b640 1 --2- 172.21.15.49:0/24318452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd50101630 0x7fcd50109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.179+0000 7fcd5621b640 1 --2- 172.21.15.49:0/24318452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd501010f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.179+0000 7fcd5621b640 1 -- 172.21.15.49:0/24318452 >> 172.21.15.49:0/24318452 conn(0x7fcd500758a0 msgr2=0x7fcd500fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:08.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.180+0000 7fcd5621b640 1 -- 172.21.15.49:0/24318452 shutdown_connections 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.180+0000 7fcd5621b640 1 -- 172.21.15.49:0/24318452 wait complete. 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.180+0000 7fcd5621b640 1 Processor -- start 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd5621b640 1 -- start start 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd5621b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd5019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd5621b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd50101630 0x7fcd5019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd5621b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5019c510 con 0x7fcd50100d10 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd5621b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50195aa0 con 0x7fcd50101630 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd5019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd5019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58530/0 (socket says 172.21.15.49:58530) 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4f7fe640 1 -- 172.21.15.49:0/2679058450 learned_addr learned my addr 172.21.15.49:0/2679058450 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4f7fe640 1 -- 172.21.15.49:0/2679058450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd50101630 msgr2=0x7fcd5019bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4effd640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd50101630 0x7fcd5019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4f7fe640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd50101630 0x7fcd5019bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4f7fe640 1 -- 172.21.15.49:0/2679058450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009560 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4effd640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd50101630 0x7fcd5019bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4f7fe640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd5019b9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd38006010 tx=0x7fcd380055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.181+0000 7fcd4cff9640 1 -- 172.21.15.49:0/2679058450 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd38004aa0 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.182+0000 7fcd4cff9640 1 -- 172.21.15.49:0/2679058450 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd38004c00 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.182+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd50195d20 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.182+0000 7fcd4cff9640 1 -- 172.21.15.49:0/2679058450 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd38003a20 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.182+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd50196210 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.183+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd500684b0 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.183+0000 7fcd4cff9640 1 -- 172.21.15.49:0/2679058450 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcd38003bc0 con 0x7fcd50100d10 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.184+0000 7fcd4cff9640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd3c06cc50 0x7fcd3c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.184+0000 7fcd4effd640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd3c06cc50 0x7fcd3c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.184+0000 7fcd4cff9640 1 -- 172.21.15.49:0/2679058450 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcd380ad040 con 0x7fcd50100d10 2024-09-19T08:59:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.184+0000 7fcd4effd640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd3c06cc50 0x7fcd3c06f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd40006fd0 tx=0x7fcd40008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.188+0000 7fcd4cff9640 1 -- 172.21.15.49:0/2679058450 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd380777d0 con 0x7fcd50100d10 2024-09-19T08:59:08.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:08 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2794085227' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:59:08.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:08 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/954606176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:59:08.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.367+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd50104400 con 0x7fcd50100d10 2024-09-19T08:59:08.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.367+0000 7fcd4cff9640 1 -- 172.21.15.49:0/2679058450 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd3807adf0 con 0x7fcd50100d10 2024-09-19T08:59:08.367 INFO:teuthology.orchestra.run.smithi049.stdout:60129542174 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd3c06cc50 msgr2=0x7fcd3c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd3c06cc50 0x7fcd3c06f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd40006fd0 tx=0x7fcd40008040 comp rx=0 tx=0).stop 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 msgr2=0x7fcd5019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd5019b9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd38006010 tx=0x7fcd380055a0 comp rx=0 tx=0).stop 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 shutdown_connections 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd3c06cc50 0x7fcd3c06f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd50101630 0x7fcd5019bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 --2- 172.21.15.49:0/2679058450 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd50100d10 0x7fcd5019b9b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 >> 172.21.15.49:0/2679058450 conn(0x7fcd500758a0 msgr2=0x7fcd50101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:08.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 shutdown_connections 2024-09-19T08:59:08.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:08.369+0000 7fcd5621b640 1 -- 172.21.15.49:0/2679058450 wait complete. 2024-09-19T08:59:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:08 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2794085227' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:59:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:08 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/954606176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:59:08.634 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:09.395 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:09 smithi049 ceph-mon[28158]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:09.395 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:09 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2679058450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:59:09.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:09 smithi102 ceph-mon[35280]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:09.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:09 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2679058450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:59:09.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724555 for osd.5 2024-09-19T08:59:09.786 DEBUG:teuthology.parallel:result is None 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 -- 172.21.15.49:0/3880742301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 msgr2=0x7ff798101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 --2- 172.21.15.49:0/3880742301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff798101130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff794009880 tx=0x7ff79402a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 -- 172.21.15.49:0/3880742301 shutdown_connections 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 --2- 172.21.15.49:0/3880742301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff798101670 0x7ff798109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 --2- 172.21.15.49:0/3880742301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff798101130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 -- 172.21.15.49:0/3880742301 >> 172.21.15.49:0/3880742301 conn(0x7ff7980fa730 msgr2=0x7ff7980fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 -- 172.21.15.49:0/3880742301 shutdown_connections 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.958+0000 7ff7a0428640 1 -- 172.21.15.49:0/3880742301 wait complete. 2024-09-19T08:59:09.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff7a0428640 1 Processor -- start 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff7a0428640 1 -- start start 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff7a0428640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff79819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff7a0428640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff798101670 0x7ff79819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff7a0428640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798195970 con 0x7ff798100d50 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff7a0428640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798195ab0 con 0x7ff798101670 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff79e1c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff79819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff79e1c4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff79819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58546/0 (socket says 172.21.15.49:58546) 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.959+0000 7ff79e1c4640 1 -- 172.21.15.49:0/888547908 learned_addr learned my addr 172.21.15.49:0/888547908 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff79d9c3640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff798101670 0x7ff79819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff79e1c4640 1 -- 172.21.15.49:0/888547908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff798101670 msgr2=0x7ff79819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff79e1c4640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff798101670 0x7ff79819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff79e1c4640 1 -- 172.21.15.49:0/888547908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009560 con 0x7ff798100d50 2024-09-19T08:59:09.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff79d9c3640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff798101670 0x7ff79819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:09.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff79e1c4640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff79819b910 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff794006010 tx=0x7ff7940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff78b7fe640 1 -- 172.21.15.49:0/888547908 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff794004aa0 con 0x7ff798100d50 2024-09-19T08:59:09.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff798195d90 con 0x7ff798100d50 2024-09-19T08:59:09.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff78b7fe640 1 -- 172.21.15.49:0/888547908 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff794004c00 con 0x7ff798100d50 2024-09-19T08:59:09.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff78b7fe640 1 -- 172.21.15.49:0/888547908 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff794003a20 con 0x7ff798100d50 2024-09-19T08:59:09.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.960+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7981962e0 con 0x7ff798100d50 2024-09-19T08:59:09.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.961+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff798068cd0 con 0x7ff798100d50 2024-09-19T08:59:09.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.962+0000 7ff78b7fe640 1 -- 172.21.15.49:0/888547908 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff794031c90 con 0x7ff798100d50 2024-09-19T08:59:09.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.962+0000 7ff78b7fe640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff78406cc60 0x7ff78406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.962+0000 7ff78b7fe640 1 -- 172.21.15.49:0/888547908 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff7940ad110 con 0x7ff798100d50 2024-09-19T08:59:09.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.962+0000 7ff79d9c3640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff78406cc60 0x7ff78406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.963+0000 7ff79d9c3640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff78406cc60 0x7ff78406f120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7981971c0 tx=0x7ff78c008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:09.966+0000 7ff78b7fe640 1 -- 172.21.15.49:0/888547908 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff794077820 con 0x7ff798100d50 2024-09-19T08:59:10.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.144+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff7981011b0 con 0x7ff798100d50 2024-09-19T08:59:10.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.144+0000 7ff78b7fe640 1 -- 172.21.15.49:0/888547908 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff79407ae40 con 0x7ff798100d50 2024-09-19T08:59:10.144 INFO:teuthology.orchestra.run.smithi049.stdout:38654705701 2024-09-19T08:59:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff78406cc60 msgr2=0x7ff78406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff78406cc60 0x7ff78406f120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7981971c0 tx=0x7ff78c008040 comp rx=0 tx=0).stop 2024-09-19T08:59:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 msgr2=0x7ff79819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff79819b910 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff794006010 tx=0x7ff7940055a0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 shutdown_connections 2024-09-19T08:59:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff78406cc60 0x7ff78406f120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff798101670 0x7ff79819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.146+0000 7ff7a0428640 1 --2- 172.21.15.49:0/888547908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff798100d50 0x7ff79819b910 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.147+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 >> 172.21.15.49:0/888547908 conn(0x7ff7980fa730 msgr2=0x7ff798102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.147+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 shutdown_connections 2024-09-19T08:59:10.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:10.147+0000 7ff7a0428640 1 -- 172.21.15.49:0/888547908 wait complete. 2024-09-19T08:59:10.274 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:10 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/888547908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:59:10.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:10 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/888547908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:59:10.944 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705701 for osd.0 2024-09-19T08:59:10.944 DEBUG:teuthology.parallel:result is None 2024-09-19T08:59:11.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:11 smithi049 ceph-mon[28158]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:11.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:11 smithi102 ceph-mon[35280]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:12.561 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888077 got 146028888079 for osd.4 2024-09-19T08:59:12.562 DEBUG:teuthology.parallel:result is None 2024-09-19T08:59:13.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.081+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/4078736275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 msgr2=0x7f4aa01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.081+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/4078736275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa01047a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009880 tx=0x7f4a9402a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.081+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/4078736275 shutdown_connections 2024-09-19T08:59:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.081+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/4078736275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa01047a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.081+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/4078736275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa00ffda0 0x7f4aa0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.081+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/4078736275 >> 172.21.15.49:0/4078736275 conn(0x7f4aa00fb840 msgr2=0x7f4aa00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.081+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/4078736275 shutdown_connections 2024-09-19T08:59:13.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.082+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/4078736275 wait complete. 2024-09-19T08:59:13.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.082+0000 7f4aa5ebc640 1 Processor -- start 2024-09-19T08:59:13.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.082+0000 7f4aa5ebc640 1 -- start start 2024-09-19T08:59:13.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.082+0000 7f4aa5ebc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa00ffda0 0x7f4aa019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.082+0000 7f4aa5ebc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.082+0000 7f4aa5ebc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0195930 con 0x7f4aa0100750 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.082+0000 7f4aa5ebc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0195a70 con 0x7f4aa00ffda0 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41442/0 (socket says 172.21.15.49:41442) 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9effd640 1 -- 172.21.15.49:0/424178187 learned_addr learned my addr 172.21.15.49:0/424178187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9f7fe640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa00ffda0 0x7f4aa019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9effd640 1 -- 172.21.15.49:0/424178187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa00ffda0 msgr2=0x7f4aa019b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9effd640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa00ffda0 0x7f4aa019b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9effd640 1 -- 172.21.15.49:0/424178187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009560 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9effd640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa019be10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4a9402a9c0 tx=0x7f4a940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9cff9640 1 -- 172.21.15.49:0/424178187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a94004aa0 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9cff9640 1 -- 172.21.15.49:0/424178187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a94004c00 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa0195cf0 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4a9cff9640 1 -- 172.21.15.49:0/424178187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a94003980 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.083+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa01961e0 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.084+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa0101280 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.085+0000 7f4a9cff9640 1 -- 172.21.15.49:0/424178187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4a94003b00 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.085+0000 7f4a9cff9640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4a8806cc50 0x7f4a8806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.085+0000 7f4a9cff9640 1 -- 172.21.15.49:0/424178187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4a940ace40 con 0x7f4aa0100750 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.085+0000 7f4a9f7fe640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4a8806cc50 0x7f4a8806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.086+0000 7f4a9f7fe640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4a8806cc50 0x7f4a8806f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a90005fd0 tx=0x7f4a9000b390 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.090+0000 7f4a9cff9640 1 -- 172.21.15.49:0/424178187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4a94077680 con 0x7f4aa0100750 2024-09-19T08:59:13.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.264+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4aa01080b0 con 0x7f4aa0100750 2024-09-19T08:59:13.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.264+0000 7f4a9cff9640 1 -- 172.21.15.49:0/424178187 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a9407aca0 con 0x7f4aa0100750 2024-09-19T08:59:13.264 INFO:teuthology.orchestra.run.smithi049.stdout:81604378651 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4a8806cc50 msgr2=0x7f4a8806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4a8806cc50 0x7f4a8806f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a90005fd0 tx=0x7f4a9000b390 comp rx=0 tx=0).stop 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 msgr2=0x7f4aa019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa019be10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4a9402a9c0 tx=0x7f4a940055a0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 shutdown_connections 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4a8806cc50 0x7f4a8806f110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4aa0100750 0x7f4aa019be10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 --2- 172.21.15.49:0/424178187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4aa00ffda0 0x7f4aa019b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 >> 172.21.15.49:0/424178187 conn(0x7f4aa00fb840 msgr2=0x7f4aa00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 shutdown_connections 2024-09-19T08:59:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:13.266+0000 7f4aa5ebc640 1 -- 172.21.15.49:0/424178187 wait complete. 2024-09-19T08:59:13.337 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:13 smithi049 ceph-mon[28158]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:13 smithi102 ceph-mon[35280]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:14.042 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-09-19T08:59:14.042 DEBUG:teuthology.parallel:result is None 2024-09-19T08:59:14.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:14 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/424178187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:59:14.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542171 got 60129542174 for osd.1 2024-09-19T08:59:14.460 DEBUG:teuthology.parallel:result is None 2024-09-19T08:59:14.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:14 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/424178187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:59:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 -- 172.21.15.49:0/1312289315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 msgr2=0x7f60e00fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 --2- 172.21.15.49:0/1312289315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e00fffb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009880 tx=0x7f60c802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 -- 172.21.15.49:0/1312289315 shutdown_connections 2024-09-19T08:59:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 --2- 172.21.15.49:0/1312289315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e00fffb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 --2- 172.21.15.49:0/1312289315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e0105c00 0x7f60e0105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 -- 172.21.15.49:0/1312289315 >> 172.21.15.49:0/1312289315 conn(0x7f60e00fb830 msgr2=0x7f60e00fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:14.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 -- 172.21.15.49:0/1312289315 shutdown_connections 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 -- 172.21.15.49:0/1312289315 wait complete. 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 Processor -- start 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.650+0000 7f60e6339640 1 -- start start 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60e6339640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60e6339640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e0105c00 0x7f60e019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60e6339640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e019c390 con 0x7f60e00ffb50 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60e6339640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0195920 con 0x7f60e0105c00 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60dffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60dffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41472/0 (socket says 172.21.15.49:41472) 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60dffff640 1 -- 172.21.15.49:0/2496372017 learned_addr learned my addr 172.21.15.49:0/2496372017 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60d7fff640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e0105c00 0x7f60e019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60dffff640 1 -- 172.21.15.49:0/2496372017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e0105c00 msgr2=0x7f60e019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:14.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60dffff640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e0105c00 0x7f60e019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60dffff640 1 -- 172.21.15.49:0/2496372017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8009560 con 0x7f60e00ffb50 2024-09-19T08:59:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60dffff640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e019b830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c810 tx=0x7f60d000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60ddffb640 1 -- 172.21.15.49:0/2496372017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d00041f0 con 0x7f60e00ffb50 2024-09-19T08:59:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60ddffb640 1 -- 172.21.15.49:0/2496372017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60d0007e70 con 0x7f60e00ffb50 2024-09-19T08:59:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0195c00 con 0x7f60e00ffb50 2024-09-19T08:59:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.651+0000 7f60ddffb640 1 -- 172.21.15.49:0/2496372017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d00049d0 con 0x7f60e00ffb50 2024-09-19T08:59:14.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.652+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e0196120 con 0x7f60e00ffb50 2024-09-19T08:59:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.653+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e0101200 con 0x7f60e00ffb50 2024-09-19T08:59:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.653+0000 7f60ddffb640 1 -- 172.21.15.49:0/2496372017 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f60d00079b0 con 0x7f60e00ffb50 2024-09-19T08:59:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.654+0000 7f60ddffb640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60cc06cc50 0x7f60cc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.654+0000 7f60ddffb640 1 -- 172.21.15.49:0/2496372017 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f60d008bd60 con 0x7f60e00ffb50 2024-09-19T08:59:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.654+0000 7f60d7fff640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60cc06cc50 0x7f60cc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:14.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.654+0000 7f60d7fff640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60cc06cc50 0x7f60cc06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000c00 tx=0x7f60c8005a20 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:14.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.658+0000 7f60ddffb640 1 -- 172.21.15.49:0/2496372017 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f60d0056470 con 0x7f60e00ffb50 2024-09-19T08:59:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.831+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f60e00fffb0 con 0x7f60e00ffb50 2024-09-19T08:59:14.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.832+0000 7f60ddffb640 1 -- 172.21.15.49:0/2496372017 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60d001d020 con 0x7f60e00ffb50 2024-09-19T08:59:14.831 INFO:teuthology.orchestra.run.smithi049.stdout:111669149719 2024-09-19T08:59:14.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60cc06cc50 msgr2=0x7f60cc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60cc06cc50 0x7f60cc06f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000c00 tx=0x7f60c8005a20 comp rx=0 tx=0).stop 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 msgr2=0x7f60e019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e019b830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c810 tx=0x7f60d000ccd0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 shutdown_connections 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f60cc06cc50 0x7f60cc06f110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60e0105c00 0x7f60e019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 --2- 172.21.15.49:0/2496372017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e00ffb50 0x7f60e019b830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 >> 172.21.15.49:0/2496372017 conn(0x7f60e00fb830 msgr2=0x7f60e00fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 shutdown_connections 2024-09-19T08:59:14.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:14.834+0000 7f60e6339640 1 -- 172.21.15.49:0/2496372017 wait complete. 2024-09-19T08:59:15.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:15 smithi049 ceph-mon[28158]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:15.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:15 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2496372017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:59:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:15 smithi102 ceph-mon[35280]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:15 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2496372017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:59:15.516 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149719 for osd.3 2024-09-19T08:59:15.517 DEBUG:teuthology.parallel:result is None 2024-09-19T08:59:15.517 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:59:15.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:59:15.732 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:16.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:16 smithi102 ceph-mon[35280]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:16.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:16 smithi049 ceph-mon[28158]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:17.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 -- 172.21.15.49:0/119701233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568101610 msgr2=0x7fa568109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:17.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/119701233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568101610 0x7fa568109b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0098b0 tx=0x7fa55c02a4d0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 -- 172.21.15.49:0/119701233 shutdown_connections 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/119701233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568101610 0x7fa568109b00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/119701233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568100c60 0x7fa568101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 -- 172.21.15.49:0/119701233 >> 172.21.15.49:0/119701233 conn(0x7fa5680fa730 msgr2=0x7fa5680fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 -- 172.21.15.49:0/119701233 shutdown_connections 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.372+0000 7fa56ecf3640 1 -- 172.21.15.49:0/119701233 wait complete. 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ecf3640 1 Processor -- start 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ecf3640 1 -- start start 2024-09-19T08:59:17.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ecf3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568100c60 0x7fa568197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ecf3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101610 0x7fa568198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ecf3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568198a00 con 0x7fa568100c60 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ecf3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56819c770 con 0x7fa568101610 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ca8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568100c60 0x7fa568197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ca8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568100c60 0x7fa568197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41496/0 (socket says 172.21.15.49:41496) 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ca8f640 1 -- 172.21.15.49:0/417633636 learned_addr learned my addr 172.21.15.49:0/417633636 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ca8f640 1 -- 172.21.15.49:0/417633636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101610 msgr2=0x7fa568198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa567fff640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101610 0x7fa568198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ca8f640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101610 0x7fa568198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ca8f640 1 -- 172.21.15.49:0/417633636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009560 con 0x7fa568100c60 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.373+0000 7fa56ca8f640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568100c60 0x7fa568197e30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa55800b420 tx=0x7fa55800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.374+0000 7fa565ffb640 1 -- 172.21.15.49:0/417633636 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa558011800 con 0x7fa568100c60 2024-09-19T08:59:17.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.374+0000 7fa565ffb640 1 -- 172.21.15.49:0/417633636 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa558011e20 con 0x7fa568100c60 2024-09-19T08:59:17.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.374+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56819ca50 con 0x7fa568100c60 2024-09-19T08:59:17.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.374+0000 7fa565ffb640 1 -- 172.21.15.49:0/417633636 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55800f2e0 con 0x7fa568100c60 2024-09-19T08:59:17.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.374+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56819cfa0 con 0x7fa568100c60 2024-09-19T08:59:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.375+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa568068d30 con 0x7fa568100c60 2024-09-19T08:59:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.375+0000 7fa565ffb640 1 -- 172.21.15.49:0/417633636 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa558010380 con 0x7fa568100c60 2024-09-19T08:59:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.376+0000 7fa565ffb640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa55006cc50 0x7fa55006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.376+0000 7fa567fff640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa55006cc50 0x7fa55006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.376+0000 7fa565ffb640 1 -- 172.21.15.49:0/417633636 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa55808b880 con 0x7fa568100c60 2024-09-19T08:59:17.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.376+0000 7fa567fff640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa55006cc50 0x7fa55006f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa55c000c00 tx=0x7fa55c004120 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:17.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.380+0000 7fa565ffb640 1 -- 172.21.15.49:0/417633636 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa558055f90 con 0x7fa568100c60 2024-09-19T08:59:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:17.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.548+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa568199200 con 0x7fa55006cc50 2024-09-19T08:59:17.548 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:17.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.550+0000 7fa565ffb640 1 -- 172.21.15.49:0/417633636 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28217 (secure 0 0 0) 0x7fa568199200 con 0x7fa55006cc50 2024-09-19T08:59:17.550 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:59:17.550 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-19T08:59:17.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa55006cc50 msgr2=0x7fa55006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:17.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa55006cc50 0x7fa55006f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa55c000c00 tx=0x7fa55c004120 comp rx=0 tx=0).stop 2024-09-19T08:59:17.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568100c60 msgr2=0x7fa568197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:17.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568100c60 0x7fa568197e30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa55800b420 tx=0x7fa55800b8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 shutdown_connections 2024-09-19T08:59:17.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa55006cc50 0x7fa55006f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa568101610 0x7fa568198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 --2- 172.21.15.49:0/417633636 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa568100c60 0x7fa568197e30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:17.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 >> 172.21.15.49:0/417633636 conn(0x7fa5680fa730 msgr2=0x7fa5680ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:17.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 shutdown_connections 2024-09-19T08:59:17.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:17.552+0000 7fa56ecf3640 1 -- 172.21.15.49:0/417633636 wait complete. 2024-09-19T08:59:18.258 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-19T08:59:16.091410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":194680,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":190710,"kb_avail":562276232,"statfs":{"total":575970213888,"available":575770861568,"internally_reserved":0,"allocated":3964928,"data_stored":2608497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":195287718},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002121"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T08:58:26.672042+0000","last_change":"2024-09-19T08:58:01.463914+0000","last_active":"2024-09-19T08:58:26.672042+0000","last_peered":"2024-09-19T08:58:26.672042+0000","last_clean":"2024-09-19T08:58:26.672042+0000","last_became_active":"2024-09-19T08:58:01.463548+0000","last_became_peered":"2024-09-19T08:58:01.463548+0000","last_unstale":"2024-09-19T08:58:26.672042+0000","last_undegraded":"2024-09-19T08:58:26.672042+0000","last_fullsized":"2024-09-19T08:58:26.672042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:16.775851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:16.775851+0000","last_clean_scrub_stamp":"2024-09-19T08:57:16.775851+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:26.278601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.374},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.436},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.5},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Sep 19 08:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.373},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Sep 19 08:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.27100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39664,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93705488,"statfs":{"total":95995035648,"available":95954419712,"internally_reserved":0,"allocated":360448,"data_stored":139008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.222}]},{"osd":1,"last update":"Thu Sep 19 08:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Sep 19 08:58:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.499}]},{"osd":4,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.318,"15min":0.314},"min":{"1min":0.24299999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.32900000000000001,"15min":0.32300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Sep 19 08:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.308},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Sep 19 08:58:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 19 08:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.249,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.495,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Sep 19 08:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Sep 19 08:58:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Sep 19 08:59:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:59:18.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:59:18.476 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:18.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:18 smithi102 ceph-mon[35280]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:59:18.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:18 smithi102 ceph-mon[35280]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:18.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:18 smithi049 ceph-mon[28158]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:59:18.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:18 smithi049 ceph-mon[28158]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 -- 172.21.15.49:0/636793090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 msgr2=0x7f88c4104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 --2- 172.21.15.49:0/636793090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c4104e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009880 tx=0x7f88b402a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 -- 172.21.15.49:0/636793090 shutdown_connections 2024-09-19T08:59:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 --2- 172.21.15.49:0/636793090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40fea20 0x7f88c40fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 --2- 172.21.15.49:0/636793090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c4104e00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 -- 172.21.15.49:0/636793090 >> 172.21.15.49:0/636793090 conn(0x7f88c40fa700 msgr2=0x7f88c40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 -- 172.21.15.49:0/636793090 shutdown_connections 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.109+0000 7f88cabc6640 1 -- 172.21.15.49:0/636793090 wait complete. 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88cabc6640 1 Processor -- start 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88cabc6640 1 -- start start 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88cabc6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40fea20 0x7f88c419a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88cabc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88cabc6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c419b3e0 con 0x7f88c4104a20 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88cabc6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4194970 con 0x7f88c40fea20 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c419adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41512/0 (socket says 172.21.15.49:41512) 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88c3fff640 1 -- 172.21.15.49:0/826711574 learned_addr learned my addr 172.21.15.49:0/826711574 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:20.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.110+0000 7f88c8962640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40fea20 0x7f88c419a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88c3fff640 1 -- 172.21.15.49:0/826711574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40fea20 msgr2=0x7f88c419a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88c3fff640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40fea20 0x7f88c419a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88c3fff640 1 -- 172.21.15.49:0/826711574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009560 con 0x7f88c4104a20 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88c3fff640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c419adc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00b420 tx=0x7f88ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88c1ffb640 1 -- 172.21.15.49:0/826711574 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ac011800 con 0x7f88c4104a20 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88c1ffb640 1 -- 172.21.15.49:0/826711574 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88ac011e20 con 0x7f88c4104a20 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c4194c50 con 0x7f88c4104a20 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88c1ffb640 1 -- 172.21.15.49:0/826711574 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ac00f2e0 con 0x7f88c4104a20 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.111+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c41951a0 con 0x7f88c4104a20 2024-09-19T08:59:20.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.112+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c4100160 con 0x7f88c4104a20 2024-09-19T08:59:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.113+0000 7f88c1ffb640 1 -- 172.21.15.49:0/826711574 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f88ac010380 con 0x7f88c4104a20 2024-09-19T08:59:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.113+0000 7f88c1ffb640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f88b006ee60 0x7f88b0071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.114+0000 7f88c1ffb640 1 -- 172.21.15.49:0/826711574 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f88ac08b720 con 0x7f88c4104a20 2024-09-19T08:59:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.114+0000 7f88c8962640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f88b006ee60 0x7f88b0071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:20.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.114+0000 7f88c8962640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f88b006ee60 0x7f88b0071320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009230 tx=0x7f88b40058d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:20.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.118+0000 7f88c1ffb640 1 -- 172.21.15.49:0/826711574 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f88ac055eb0 con 0x7f88c4104a20 2024-09-19T08:59:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.286+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88c410bd10 con 0x7f88b006ee60 2024-09-19T08:59:20.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.287+0000 7f88c1ffb640 1 -- 172.21.15.49:0/826711574 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28260 (secure 0 0 0) 0x7f88c410bd10 con 0x7f88b006ee60 2024-09-19T08:59:20.289 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:59:20.290 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.289+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f88b006ee60 msgr2=0x7f88b0071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.289+0000 7f88cabc6640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f88b006ee60 0x7f88b0071320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009230 tx=0x7f88b40058d0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.289+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 msgr2=0x7f88c419adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.289+0000 7f88cabc6640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c419adc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00b420 tx=0x7f88ac00b8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.290+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 shutdown_connections 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.290+0000 7f88cabc6640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f88b006ee60 0x7f88b0071320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.290+0000 7f88cabc6640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c4104a20 0x7f88c419adc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.290+0000 7f88cabc6640 1 --2- 172.21.15.49:0/826711574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40fea20 0x7f88c419a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.290+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 >> 172.21.15.49:0/826711574 conn(0x7f88c40fa700 msgr2=0x7f88c40fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.290+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 shutdown_connections 2024-09-19T08:59:20.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:20.290+0000 7f88cabc6640 1 -- 172.21.15.49:0/826711574 wait complete. 2024-09-19T08:59:20.908 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-19T08:59:20.092281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":194680,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":190710,"kb_avail":562276232,"statfs":{"total":575970213888,"available":575770861568,"internally_reserved":0,"allocated":3964928,"data_stored":2608497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":195287718},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002227"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-19T08:58:26.672042+0000","last_change":"2024-09-19T08:58:01.463914+0000","last_active":"2024-09-19T08:58:26.672042+0000","last_peered":"2024-09-19T08:58:26.672042+0000","last_clean":"2024-09-19T08:58:26.672042+0000","last_became_active":"2024-09-19T08:58:01.463548+0000","last_became_peered":"2024-09-19T08:58:01.463548+0000","last_unstale":"2024-09-19T08:58:26.672042+0000","last_undegraded":"2024-09-19T08:58:26.672042+0000","last_fullsized":"2024-09-19T08:58:26.672042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:16.775851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:16.775851+0000","last_clean_scrub_stamp":"2024-09-19T08:57:16.775851+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:26.278601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31472,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713680,"statfs":{"total":95995035648,"available":95962808320,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.626},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.503}]},{"osd":1,"last update":"Thu Sep 19 08:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.432}]},{"osd":2,"last update":"Thu Sep 19 08:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39664,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93705488,"statfs":{"total":95995035648,"available":95954419712,"internally_reserved":0,"allocated":360448,"data_stored":139008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.222}]},{"osd":1,"last update":"Thu Sep 19 08:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Sep 19 08:58:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.499}]},{"osd":4,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 08:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.318,"15min":0.314},"min":{"1min":0.24299999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.32900000000000001,"15min":0.32300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.307}]},{"osd":2,"last update":"Thu Sep 19 08:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Sep 19 08:58:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Sep 19 08:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 19 08:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.249,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.495,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Sep 19 08:58:18 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.22},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Sep 19 08:58:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Sep 19 08:59:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:59:20.909 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:59:20.909 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T08:59:20.909 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T08:59:20.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T08:59:21.115 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:21.458 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:21 smithi049 ceph-mon[28158]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:21 smithi102 ceph-mon[35280]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:22.462 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:22 smithi049 ceph-mon[28158]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:59:22.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:22 smithi102 ceph-mon[35280]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 -- 172.21.15.49:0/4050163302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0fe840 msgr2=0x7fd27c0fec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 --2- 172.21.15.49:0/4050163302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0fe840 0x7fd27c0fec20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd278009880 tx=0x7fd27802a490 comp rx=0 tx=0).stop 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 -- 172.21.15.49:0/4050163302 shutdown_connections 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 --2- 172.21.15.49:0/4050163302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c0ff1f0 0x7fd27c10beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 --2- 172.21.15.49:0/4050163302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0fe840 0x7fd27c0fec20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 -- 172.21.15.49:0/4050163302 >> 172.21.15.49:0/4050163302 conn(0x7fd27c0758a0 msgr2=0x7fd27c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 -- 172.21.15.49:0/4050163302 shutdown_connections 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 -- 172.21.15.49:0/4050163302 wait complete. 2024-09-19T08:59:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 Processor -- start 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.655+0000 7fd2834fe640 1 -- start start 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2834fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c0fe840 0x7fd27c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2834fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0ff1f0 0x7fd27c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2834fe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c198960 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2834fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c19c6d0 con 0x7fd27c0fe840 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd280a99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0ff1f0 0x7fd27c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd280a99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0ff1f0 0x7fd27c1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52872/0 (socket says 172.21.15.49:52872) 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd280a99640 1 -- 172.21.15.49:0/2040997302 learned_addr learned my addr 172.21.15.49:0/2040997302 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd28129a640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c0fe840 0x7fd27c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd280a99640 1 -- 172.21.15.49:0/2040997302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c0fe840 msgr2=0x7fd27c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd280a99640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c0fe840 0x7fd27c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd280a99640 1 -- 172.21.15.49:0/2040997302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278009560 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd280a99640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0ff1f0 0x7fd27c1982d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00b420 tx=0x7fd26c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2727fc640 1 -- 172.21.15.49:0/2040997302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd26c011800 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c19c9b0 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2727fc640 1 -- 172.21.15.49:0/2040997302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd26c011e20 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.656+0000 7fd2727fc640 1 -- 172.21.15.49:0/2040997302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd26c00f2e0 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.657+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c19cf00 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.658+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c068510 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.658+0000 7fd2727fc640 1 -- 172.21.15.49:0/2040997302 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd26c010380 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.659+0000 7fd2727fc640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd26806cc50 0x7fd26806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.659+0000 7fd2727fc640 1 -- 172.21.15.49:0/2040997302 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd26c08b880 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.659+0000 7fd28129a640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd26806cc50 0x7fd26806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.659+0000 7fd28129a640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd26806cc50 0x7fd26806f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd278000c00 tx=0x7fd278005a20 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.663+0000 7fd2727fc640 1 -- 172.21.15.49:0/2040997302 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd26c055f90 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.873+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd27c0feca0 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.873+0000 7fd2727fc640 1 -- 172.21.15.49:0/2040997302 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd26c0595b0 con 0x7fd27c0ff1f0 2024-09-19T08:59:22.874 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:59:22.874 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T08:59:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.875+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd26806cc50 msgr2=0x7fd26806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.875+0000 7fd2834fe640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd26806cc50 0x7fd26806f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd278000c00 tx=0x7fd278005a20 comp rx=0 tx=0).stop 2024-09-19T08:59:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0ff1f0 msgr2=0x7fd27c1982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0ff1f0 0x7fd27c1982d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00b420 tx=0x7fd26c00b8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 shutdown_connections 2024-09-19T08:59:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd26806cc50 0x7fd26806f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd27c0ff1f0 0x7fd27c1982d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 --2- 172.21.15.49:0/2040997302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c0fe840 0x7fd27c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 >> 172.21.15.49:0/2040997302 conn(0x7fd27c0758a0 msgr2=0x7fd27c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:22.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 shutdown_connections 2024-09-19T08:59:22.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:22.876+0000 7fd2834fe640 1 -- 172.21.15.49:0/2040997302 wait complete. 2024-09-19T08:59:23.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:23 smithi102 ceph-mon[35280]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:23.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:23 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2040997302' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:59:23.543 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:23 smithi049 ceph-mon[28158]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:23.544 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:23 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2040997302' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:59:23.565 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T08:59:23.566 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T08:59:23.566 INFO:teuthology.run_tasks:Running task print... 2024-09-19T08:59:23.577 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-09-19T08:59:23.577 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:59:23.607 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:59:23.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-19T08:59:23.816 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:25.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:25 smithi049 ceph-mon[28158]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:25.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 -- 172.21.15.49:0/3464979217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580ffc80 msgr2=0x7f4c58100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:25.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 --2- 172.21.15.49:0/3464979217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580ffc80 0x7f4c58100100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009880 tx=0x7f4c4c02a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 -- 172.21.15.49:0/3464979217 shutdown_connections 2024-09-19T08:59:25.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 --2- 172.21.15.49:0/3464979217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580ffc80 0x7f4c58100100 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 --2- 172.21.15.49:0/3464979217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580fea80 0x7f4c580fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 -- 172.21.15.49:0/3464979217 >> 172.21.15.49:0/3464979217 conn(0x7f4c580fa230 msgr2=0x7f4c580fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 -- 172.21.15.49:0/3464979217 shutdown_connections 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.290+0000 7f4c5e075640 1 -- 172.21.15.49:0/3464979217 wait complete. 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c5e075640 1 Processor -- start 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c5e075640 1 -- start start 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c5e075640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580fea80 0x7f4c58197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c5e075640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580ffc80 0x7f4c58197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:25.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c5e075640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58198320 con 0x7f4c580fea80 2024-09-19T08:59:25.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c5e075640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58198490 con 0x7f4c580ffc80 2024-09-19T08:59:25.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580fea80 0x7f4c58197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:25.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580fea80 0x7f4c58197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52902/0 (socket says 172.21.15.49:52902) 2024-09-19T08:59:25.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c577fe640 1 -- 172.21.15.49:0/2992653726 learned_addr learned my addr 172.21.15.49:0/2992653726 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:25.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.291+0000 7f4c56ffd640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580ffc80 0x7f4c58197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:25.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c577fe640 1 -- 172.21.15.49:0/2992653726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580ffc80 msgr2=0x7f4c58197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:25.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c577fe640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580ffc80 0x7f4c58197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c577fe640 1 -- 172.21.15.49:0/2992653726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c009560 con 0x7f4c580fea80 2024-09-19T08:59:25.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c56ffd640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580ffc80 0x7f4c58197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:25.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c577fe640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580fea80 0x7f4c58197810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d900 tx=0x7f4c4800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:25.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c54ff9640 1 -- 172.21.15.49:0/2992653726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c48009c00 con 0x7f4c580fea80 2024-09-19T08:59:25.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c54ff9640 1 -- 172.21.15.49:0/2992653726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c48009d60 con 0x7f4c580fea80 2024-09-19T08:59:25.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5819cee0 con 0x7f4c580fea80 2024-09-19T08:59:25.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c54ff9640 1 -- 172.21.15.49:0/2992653726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c4800f7b0 con 0x7f4c580fea80 2024-09-19T08:59:25.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.292+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5819d3a0 con 0x7f4c580fea80 2024-09-19T08:59:25.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.293+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c580fee80 con 0x7f4c580fea80 2024-09-19T08:59:25.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.293+0000 7f4c54ff9640 1 -- 172.21.15.49:0/2992653726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4c48010460 con 0x7f4c580fea80 2024-09-19T08:59:25.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.294+0000 7f4c54ff9640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4c4006cc50 0x7f4c4006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:25.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.294+0000 7f4c54ff9640 1 -- 172.21.15.49:0/2992653726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4c4808c1f0 con 0x7f4c580fea80 2024-09-19T08:59:25.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.294+0000 7f4c56ffd640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4c4006cc50 0x7f4c4006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:25.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.294+0000 7f4c56ffd640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4c4006cc50 0x7f4c4006f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c000c00 tx=0x7f4c4c0314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:25.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.298+0000 7f4c54ff9640 1 -- 172.21.15.49:0/2992653726 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4c48056980 con 0x7f4c580fea80 2024-09-19T08:59:25.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.469+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f4c58107670 con 0x7f4c580fea80 2024-09-19T08:59:25.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.474+0000 7f4c54ff9640 1 -- 172.21.15.49:0/2992653726 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v24)=0 v24) v1 ==== 143+0+0 (secure 0 0 0) 0x7f4c48059fa0 con 0x7f4c580fea80 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4c4006cc50 msgr2=0x7f4c4006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4c4006cc50 0x7f4c4006f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c000c00 tx=0x7f4c4c0314e0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580fea80 msgr2=0x7f4c58197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580fea80 0x7f4c58197810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d900 tx=0x7f4c4800ddc0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 shutdown_connections 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4c4006cc50 0x7f4c4006f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c580ffc80 0x7f4c58197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 --2- 172.21.15.49:0/2992653726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c580fea80 0x7f4c58197810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:25.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 >> 172.21.15.49:0/2992653726 conn(0x7f4c580fa230 msgr2=0x7f4c580fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:25.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 shutdown_connections 2024-09-19T08:59:25.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:25.476+0000 7f4c5e075640 1 -- 172.21.15.49:0/2992653726 wait complete. 2024-09-19T08:59:25.507 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:25 smithi102 ceph-mon[35280]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:26.196 INFO:teuthology.run_tasks:Running task print... 2024-09-19T08:59:26.204 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-19T08:59:26.204 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:59:26.240 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:59:26.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T08:59:26.447 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:26.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:26 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2992653726' entity='client.admin' 2024-09-19T08:59:26.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:26.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:26.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:26.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:26 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:26.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:26 smithi102 ceph-mon[35280]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:26.785 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:26 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2992653726' entity='client.admin' 2024-09-19T08:59:26.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:26.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:26.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:26.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:26 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:26.786 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:26 smithi049 ceph-mon[28158]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 -- 172.21.15.49:0/1702015481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240feaa0 msgr2=0x7f34240feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 --2- 172.21.15.49:0/1702015481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240feaa0 0x7f34240feea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3420009880 tx=0x7f342002a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 -- 172.21.15.49:0/1702015481 shutdown_connections 2024-09-19T08:59:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 --2- 172.21.15.49:0/1702015481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34240ffca0 0x7f3424100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 --2- 172.21.15.49:0/1702015481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240feaa0 0x7f34240feea0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 -- 172.21.15.49:0/1702015481 >> 172.21.15.49:0/1702015481 conn(0x7f34240fa230 msgr2=0x7f34240fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 -- 172.21.15.49:0/1702015481 shutdown_connections 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 -- 172.21.15.49:0/1702015481 wait complete. 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.037+0000 7f342b575640 1 Processor -- start 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f342b575640 1 -- start start 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f342b575640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34240feaa0 0x7f3424197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f342b575640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240ffca0 0x7f3424197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f342b575640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424198450 con 0x7f34240ffca0 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f342b575640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34241985c0 con 0x7f34240feaa0 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3428b10640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240ffca0 0x7f3424197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3428b10640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240ffca0 0x7f3424197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52924/0 (socket says 172.21.15.49:52924) 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3428b10640 1 -- 172.21.15.49:0/3366952909 learned_addr learned my addr 172.21.15.49:0/3366952909 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3429311640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34240feaa0 0x7f3424197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3428b10640 1 -- 172.21.15.49:0/3366952909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34240feaa0 msgr2=0x7f3424197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3428b10640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34240feaa0 0x7f3424197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3428b10640 1 -- 172.21.15.49:0/3366952909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009560 con 0x7f34240ffca0 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.038+0000 7f3428b10640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240ffca0 0x7f3424197e80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f341400b450 tx=0x7f341400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.039+0000 7f341a7fc640 1 -- 172.21.15.49:0/3366952909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3414011860 con 0x7f34240ffca0 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.039+0000 7f341a7fc640 1 -- 172.21.15.49:0/3366952909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3414011e80 con 0x7f34240ffca0 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.039+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342419d060 con 0x7f34240ffca0 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.039+0000 7f341a7fc640 1 -- 172.21.15.49:0/3366952909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341400f570 con 0x7f34240ffca0 2024-09-19T08:59:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.039+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342419d630 con 0x7f34240ffca0 2024-09-19T08:59:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.040+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3424107710 con 0x7f34240ffca0 2024-09-19T08:59:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.040+0000 7f341a7fc640 1 -- 172.21.15.49:0/3366952909 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f34140103e0 con 0x7f34240ffca0 2024-09-19T08:59:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.041+0000 7f341a7fc640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f341006cc50 0x7f341006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.041+0000 7f341a7fc640 1 -- 172.21.15.49:0/3366952909 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f341408bcb0 con 0x7f34240ffca0 2024-09-19T08:59:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.041+0000 7f3429311640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f341006cc50 0x7f341006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.041+0000 7f3429311640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f341006cc50 0x7f341006f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3420009230 tx=0x7f34200314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.045+0000 7f341a7fc640 1 -- 172.21.15.49:0/3366952909 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3414056440 con 0x7f34240ffca0 2024-09-19T08:59:28.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.231+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34240fc450 con 0x7f341006cc50 2024-09-19T08:59:28.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.232+0000 7f341a7fc640 1 -- 172.21.15.49:0/3366952909 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f34240fc450 con 0x7f341006cc50 2024-09-19T08:59:28.232 INFO:teuthology.orchestra.run.smithi049.stdout:Backend: cephadm 2024-09-19T08:59:28.232 INFO:teuthology.orchestra.run.smithi049.stdout:Available: Yes 2024-09-19T08:59:28.232 INFO:teuthology.orchestra.run.smithi049.stdout:Paused: No 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f341006cc50 msgr2=0x7f341006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f341006cc50 0x7f341006f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3420009230 tx=0x7f34200314e0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240ffca0 msgr2=0x7f3424197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240ffca0 0x7f3424197e80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f341400b450 tx=0x7f341400b910 comp rx=0 tx=0).stop 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 shutdown_connections 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f341006cc50 0x7f341006f110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34240ffca0 0x7f3424197e80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 --2- 172.21.15.49:0/3366952909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34240feaa0 0x7f3424197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:28.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 >> 172.21.15.49:0/3366952909 conn(0x7f34240fa230 msgr2=0x7f34240fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:28.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.235+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 shutdown_connections 2024-09-19T08:59:28.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:28.236+0000 7f342b575640 1 -- 172.21.15.49:0/3366952909 wait complete. 2024-09-19T08:59:28.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T08:59:29.082 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:29.426 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:29 smithi049 ceph-mon[28158]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:29 smithi102 ceph-mon[35280]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:30.405 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:30 smithi049 ceph-mon[28158]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:30.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:30 smithi102 ceph-mon[35280]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 -- 172.21.15.49:0/2175048354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 msgr2=0x7fdbc00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/2175048354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc00feef0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009880 tx=0x7fdbb002a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 -- 172.21.15.49:0/2175048354 shutdown_connections 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/2175048354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc00ffcf0 0x7fdbc0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/2175048354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc00feef0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 -- 172.21.15.49:0/2175048354 >> 172.21.15.49:0/2175048354 conn(0x7fdbc00fa280 msgr2=0x7fdbc00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 -- 172.21.15.49:0/2175048354 shutdown_connections 2024-09-19T08:59:30.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 -- 172.21.15.49:0/2175048354 wait complete. 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 Processor -- start 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.618+0000 7fdbc56a1640 1 -- start start 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbc56a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc01978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbc56a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc00ffcf0 0x7fdbc0197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbc56a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0198320 con 0x7fdbc00feaf0 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbc56a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0198490 con 0x7fdbc00ffcf0 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc01978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc01978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33058/0 (socket says 172.21.15.49:33058) 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbeffd640 1 -- 172.21.15.49:0/4251731698 learned_addr learned my addr 172.21.15.49:0/4251731698 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbe7fc640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc00ffcf0 0x7fdbc0197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbeffd640 1 -- 172.21.15.49:0/4251731698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc00ffcf0 msgr2=0x7fdbc0197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbeffd640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc00ffcf0 0x7fdbc0197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbeffd640 1 -- 172.21.15.49:0/4251731698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb0009560 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbe7fc640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc00ffcf0 0x7fdbc0197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbbeffd640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc01978a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdbb002a9c0 tx=0x7fdbb0005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdba7fff640 1 -- 172.21.15.49:0/4251731698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb0004b20 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdba7fff640 1 -- 172.21.15.49:0/4251731698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbb0004c80 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc019cf10 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.619+0000 7fdba7fff640 1 -- 172.21.15.49:0/4251731698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb0003bc0 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.620+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc019d330 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.621+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc01076e0 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.621+0000 7fdba7fff640 1 -- 172.21.15.49:0/4251731698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdbb0031640 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.622+0000 7fdba7fff640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fdba806cc60 0x7fdba806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.622+0000 7fdbbe7fc640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fdba806cc60 0x7fdba806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.622+0000 7fdba7fff640 1 -- 172.21.15.49:0/4251731698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fdbb00ad180 con 0x7fdbc00feaf0 2024-09-19T08:59:30.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.622+0000 7fdbbe7fc640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fdba806cc60 0x7fdba806f120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0198dc0 tx=0x7fdbb400a5c0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:30.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.626+0000 7fdba7fff640 1 -- 172.21.15.49:0/4251731698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdbb0077890 con 0x7fdbc00feaf0 2024-09-19T08:59:30.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.807+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbc00683f0 con 0x7fdba806cc60 2024-09-19T08:59:30.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.815+0000 7fdba7fff640 1 -- 172.21.15.49:0/4251731698 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3100 (secure 0 0 0) 0x7fdbc00683f0 con 0x7fdba806cc60 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (3m) 2m ago 4m 26.2M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (5m) 2m ago 5m 7147k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (4m) 66s ago 4m 7042k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (5m) 2m ago 5m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (4m) 66s ago 4m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (3m) 2m ago 4m 75.1M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:9283,8765,8443 running (6m) 2m ago 6m 479M - 18.2.4-855-g19e2a2be 980a0bfcd684 b57193f2a38e 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (4m) 66s ago 4m 437M - 18.2.4-855-g19e2a2be 980a0bfcd684 7393ef52f781 2024-09-19T08:59:30.816 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 2m ago 6m 45.2M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (4m) 66s ago 4m 43.4M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (5m) 2m ago 5m 15.3M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (4m) 66s ago 4m 16.3M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 2m ago 3m 40.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (2m) 2m ago 2m 48.4M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 2m ago 2m 46.2M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (2m) 66s ago 119s 41.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (96s) 66s ago 95s 46.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (71s) 66s ago 71s 12.1M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T08:59:30.817 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (3m) 2m ago 4m 38.2M - 2.43.0 a07b618ecd1d 2151f61fb8cc 2024-09-19T08:59:30.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.817+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fdba806cc60 msgr2=0x7fdba806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.817+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fdba806cc60 0x7fdba806f120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0198dc0 tx=0x7fdbb400a5c0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.817+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 msgr2=0x7fdbc01978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:30.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.817+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc01978a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdbb002a9c0 tx=0x7fdbb0005610 comp rx=0 tx=0).stop 2024-09-19T08:59:30.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.818+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 shutdown_connections 2024-09-19T08:59:30.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.818+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fdba806cc60 0x7fdba806f120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.818+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc00ffcf0 0x7fdbc0197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.818+0000 7fdbc56a1640 1 --2- 172.21.15.49:0/4251731698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdbc00feaf0 0x7fdbc01978a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.818+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 >> 172.21.15.49:0/4251731698 conn(0x7fdbc00fa280 msgr2=0x7fdbc0067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.818+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 shutdown_connections 2024-09-19T08:59:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:30.818+0000 7fdbc56a1640 1 -- 172.21.15.49:0/4251731698 wait complete. 2024-09-19T08:59:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:31 smithi102 ceph-mon[35280]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:31 smithi049 ceph-mon[28158]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:31.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T08:59:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:32.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:32 smithi049 ceph-mon[28158]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:32.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:32 smithi102 ceph-mon[35280]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:33.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 -- 172.21.15.49:0/986597462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101190 msgr2=0x7ff658101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:33.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 --2- 172.21.15.49:0/986597462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101190 0x7ff658101590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff648009880 tx=0x7ff64802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 -- 172.21.15.49:0/986597462 shutdown_connections 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 --2- 172.21.15.49:0/986597462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff658101b60 0x7ff6580fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 --2- 172.21.15.49:0/986597462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101190 0x7ff658101590 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 -- 172.21.15.49:0/986597462 >> 172.21.15.49:0/986597462 conn(0x7ff6580f99c0 msgr2=0x7ff6580fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 -- 172.21.15.49:0/986597462 shutdown_connections 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.366+0000 7ff65e466640 1 -- 172.21.15.49:0/986597462 wait complete. 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff65e466640 1 Processor -- start 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff65e466640 1 -- start start 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff65e466640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff658101190 0x7ff658100840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff65e466640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101b60 0x7ff6580feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff65e466640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580ff420 con 0x7ff658101b60 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff65e466640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580ff590 con 0x7ff658101190 2024-09-19T08:59:33.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff6577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101b60 0x7ff6580feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff6577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101b60 0x7ff6580feee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33074/0 (socket says 172.21.15.49:33074) 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff6577fe640 1 -- 172.21.15.49:0/1899440892 learned_addr learned my addr 172.21.15.49:0/1899440892 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.367+0000 7ff657fff640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff658101190 0x7ff658100840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff6577fe640 1 -- 172.21.15.49:0/1899440892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff658101190 msgr2=0x7ff658100840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff6577fe640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff658101190 0x7ff658100840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff6577fe640 1 -- 172.21.15.49:0/1899440892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648009560 con 0x7ff658101b60 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff657fff640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff658101190 0x7ff658100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff6577fe640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101b60 0x7ff6580feee0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff64000d6c0 tx=0x7ff64000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff6557fa640 1 -- 172.21.15.49:0/1899440892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6400051f0 con 0x7ff658101b60 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff6557fa640 1 -- 172.21.15.49:0/1899440892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff640009ce0 con 0x7ff658101b60 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff6557fa640 1 -- 172.21.15.49:0/1899440892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff640010460 con 0x7ff658101b60 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6580ff870 con 0x7ff658101b60 2024-09-19T08:59:33.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.368+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65819d6f0 con 0x7ff658101b60 2024-09-19T08:59:33.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.369+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65818f750 con 0x7ff658101b60 2024-09-19T08:59:33.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.370+0000 7ff6557fa640 1 -- 172.21.15.49:0/1899440892 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff640005350 con 0x7ff658101b60 2024-09-19T08:59:33.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.370+0000 7ff6557fa640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff64406cc60 0x7ff64406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:33.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.370+0000 7ff6557fa640 1 -- 172.21.15.49:0/1899440892 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff64008b8e0 con 0x7ff658101b60 2024-09-19T08:59:33.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.370+0000 7ff657fff640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff64406cc60 0x7ff64406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:33.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.371+0000 7ff657fff640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff64406cc60 0x7ff64406f120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff648006010 tx=0x7ff648005db0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:33.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.375+0000 7ff6557fa640 1 -- 172.21.15.49:0/1899440892 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff640056070 con 0x7ff658101b60 2024-09-19T08:59:33.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:33 smithi102 ceph-mon[35280]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:33.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:33 smithi049 ceph-mon[28158]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:33.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.554+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff65802c4c0 con 0x7ff64406cc60 2024-09-19T08:59:33.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.559+0000 7ff6557fa640 1 -- 172.21.15.49:0/1899440892 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7ff65802c4c0 con 0x7ff64406cc60 2024-09-19T08:59:33.559 INFO:teuthology.orchestra.run.smithi049.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T08:59:33.559 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-19T08:59:33.559 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-19T08:59:33.559 INFO:teuthology.orchestra.run.smithi049.stdout:crash 2/2 2m ago 5m * 2024-09-19T08:59:33.559 INFO:teuthology.orchestra.run.smithi049.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-19T08:59:33.559 INFO:teuthology.orchestra.run.smithi049.stdout:mgr 2/2 2m ago 5m count:2 2024-09-19T08:59:33.560 INFO:teuthology.orchestra.run.smithi049.stdout:mon 2/2 2m ago 5m smithi049:172.21.15.49=smithi049;smithi102:172.21.15.102=smithi102;count:2 2024-09-19T08:59:33.560 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-19T08:59:33.560 INFO:teuthology.orchestra.run.smithi049.stdout:osd 6 2m ago - 2024-09-19T08:59:33.560 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-19T08:59:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff64406cc60 msgr2=0x7ff64406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff64406cc60 0x7ff64406f120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff648006010 tx=0x7ff648005db0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101b60 msgr2=0x7ff6580feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101b60 0x7ff6580feee0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff64000d6c0 tx=0x7ff64000db80 comp rx=0 tx=0).stop 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 shutdown_connections 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff64406cc60 0x7ff64406f120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff658101b60 0x7ff6580feee0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 --2- 172.21.15.49:0/1899440892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff658101190 0x7ff658100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 >> 172.21.15.49:0/1899440892 conn(0x7ff6580f99c0 msgr2=0x7ff658104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 shutdown_connections 2024-09-19T08:59:33.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:33.561+0000 7ff65e466640 1 -- 172.21.15.49:0/1899440892 wait complete. 2024-09-19T08:59:34.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T08:59:34.338 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:35.506 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:35 smithi049 ceph-mon[28158]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:35.506 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:35 smithi049 ceph-mon[28158]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:35 smithi102 ceph-mon[35280]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:35 smithi102 ceph-mon[35280]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 -- 172.21.15.49:0/1166639505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 msgr2=0x7fb854105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 --2- 172.21.15.49:0/1166639505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854105350 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0098b0 tx=0x7fb83c02a4d0 comp rx=0 tx=0).stop 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 -- 172.21.15.49:0/1166639505 shutdown_connections 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 --2- 172.21.15.49:0/1166639505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854105350 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 --2- 172.21.15.49:0/1166639505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb854100630 0x7fb854102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 -- 172.21.15.49:0/1166639505 >> 172.21.15.49:0/1166639505 conn(0x7fb8540fa250 msgr2=0x7fb8540fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 -- 172.21.15.49:0/1166639505 shutdown_connections 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.821+0000 7fb859c87640 1 -- 172.21.15.49:0/1166639505 wait complete. 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb859c87640 1 Processor -- start 2024-09-19T08:59:35.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb859c87640 1 -- start start 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb859c87640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb854100630 0x7fb854197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb859c87640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb859c87640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854198460 con 0x7fb854102f60 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb859c87640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541985d0 con 0x7fb854100630 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb84bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb84bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33094/0 (socket says 172.21.15.49:33094) 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb84bfff640 1 -- 172.21.15.49:0/3231803680 learned_addr learned my addr 172.21.15.49:0/3231803680 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.822+0000 7fb8537fe640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb854100630 0x7fb854197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb84bfff640 1 -- 172.21.15.49:0/3231803680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb854100630 msgr2=0x7fb854197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb84bfff640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb854100630 0x7fb854197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:35.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb84bfff640 1 -- 172.21.15.49:0/3231803680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009560 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb84bfff640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854197e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005610 tx=0x7fb83c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb8517fa640 1 -- 172.21.15.49:0/3231803680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb83c004ba0 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb8517fa640 1 -- 172.21.15.49:0/3231803680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb83c004d00 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85419d010 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb8517fa640 1 -- 172.21.15.49:0/3231803680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb83c003bf0 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.823+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85419d580 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.824+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8540fbd40 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.825+0000 7fb8517fa640 1 -- 172.21.15.49:0/3231803680 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb83c031640 con 0x7fb854102f60 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.825+0000 7fb8517fa640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fb84006cc50 0x7fb84006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:35.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.825+0000 7fb8517fa640 1 -- 172.21.15.49:0/3231803680 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb83c0ad160 con 0x7fb854102f60 2024-09-19T08:59:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.825+0000 7fb8537fe640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fb84006cc50 0x7fb84006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:35.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.826+0000 7fb8537fe640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fb84006cc50 0x7fb84006f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb844009890 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:35.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:35.829+0000 7fb8517fa640 1 -- 172.21.15.49:0/3231803680 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb83c0778f0 con 0x7fb854102f60 2024-09-19T08:59:36.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.014+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb85402c4f0 con 0x7fb84006cc50 2024-09-19T08:59:36.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.016+0000 7fb8517fa640 1 -- 172.21.15.49:0/3231803680 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fb85402c4f0 con 0x7fb84006cc50 2024-09-19T08:59:36.016 INFO:teuthology.orchestra.run.smithi049.stdout:HOST ADDR LABELS STATUS 2024-09-19T08:59:36.016 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 172.21.15.49 2024-09-19T08:59:36.016 INFO:teuthology.orchestra.run.smithi049.stdout:smithi102 172.21.15.102 2024-09-19T08:59:36.016 INFO:teuthology.orchestra.run.smithi049.stdout:2 hosts in cluster 2024-09-19T08:59:36.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fb84006cc50 msgr2=0x7fb84006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fb84006cc50 0x7fb84006f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb844009890 tx=0x7fb844008040 comp rx=0 tx=0).stop 2024-09-19T08:59:36.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 msgr2=0x7fb854197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:36.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854197e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005610 tx=0x7fb83c005640 comp rx=0 tx=0).stop 2024-09-19T08:59:36.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 shutdown_connections 2024-09-19T08:59:36.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fb84006cc50 0x7fb84006f110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb854102f60 0x7fb854197e90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 --2- 172.21.15.49:0/3231803680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb854100630 0x7fb854197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:36.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 >> 172.21.15.49:0/3231803680 conn(0x7fb8540fa250 msgr2=0x7fb854103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:36.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 shutdown_connections 2024-09-19T08:59:36.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:36.018+0000 7fb859c87640 1 -- 172.21.15.49:0/3231803680 wait complete. 2024-09-19T08:59:36.632 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T08:59:36.840 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:37.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:37 smithi049 ceph-mon[28158]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:37.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:37 smithi049 ceph-mon[28158]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:37.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:37 smithi102 ceph-mon[35280]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:37.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:37 smithi102 ceph-mon[35280]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 -- 172.21.15.49:0/1156265206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 msgr2=0x7f5200105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 --2- 172.21.15.49:0/1156265206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200105350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f51e80098b0 tx=0x7f51e802a4d0 comp rx=0 tx=0).stop 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 -- 172.21.15.49:0/1156265206 shutdown_connections 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 --2- 172.21.15.49:0/1156265206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200105350 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 --2- 172.21.15.49:0/1156265206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5200100630 0x7f5200102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 -- 172.21.15.49:0/1156265206 >> 172.21.15.49:0/1156265206 conn(0x7f52000fa250 msgr2=0x7f52000fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 -- 172.21.15.49:0/1156265206 shutdown_connections 2024-09-19T08:59:38.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.459+0000 7f5204ca2640 1 -- 172.21.15.49:0/1156265206 wait complete. 2024-09-19T08:59:38.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.460+0000 7f5204ca2640 1 Processor -- start 2024-09-19T08:59:38.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.460+0000 7f5204ca2640 1 -- start start 2024-09-19T08:59:38.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.460+0000 7f5204ca2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5200100630 0x7f5200195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:38.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.460+0000 7f5204ca2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:38.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.460+0000 7f5204ca2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200196260 con 0x7f5200102f60 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.460+0000 7f5204ca2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52001963d0 con 0x7f5200100630 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.460+0000 7f51fdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51fdd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200195c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33106/0 (socket says 172.21.15.49:33106) 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51fdd9b640 1 -- 172.21.15.49:0/2123656325 learned_addr learned my addr 172.21.15.49:0/2123656325 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51fe59c640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5200100630 0x7f5200195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51fdd9b640 1 -- 172.21.15.49:0/2123656325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5200100630 msgr2=0x7f5200195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51fdd9b640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5200100630 0x7f5200195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51fdd9b640 1 -- 172.21.15.49:0/2123656325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8009560 con 0x7f5200102f60 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51fdd9b640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200195c90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005610 tx=0x7f51e8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51f77fe640 1 -- 172.21.15.49:0/2123656325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e8004ba0 con 0x7f5200102f60 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51f77fe640 1 -- 172.21.15.49:0/2123656325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51e8004d00 con 0x7f5200102f60 2024-09-19T08:59:38.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520019ae10 con 0x7f5200102f60 2024-09-19T08:59:38.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f51f77fe640 1 -- 172.21.15.49:0/2123656325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51e8003bf0 con 0x7f5200102f60 2024-09-19T08:59:38.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.461+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520019b350 con 0x7f5200102f60 2024-09-19T08:59:38.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.462+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5200100a90 con 0x7f5200102f60 2024-09-19T08:59:38.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.463+0000 7f51f77fe640 1 -- 172.21.15.49:0/2123656325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f51e8031640 con 0x7f5200102f60 2024-09-19T08:59:38.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.463+0000 7f51f77fe640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51ec06cc50 0x7f51ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:38.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.463+0000 7f51f77fe640 1 -- 172.21.15.49:0/2123656325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f51e80ad180 con 0x7f5200102f60 2024-09-19T08:59:38.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.463+0000 7f51fe59c640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51ec06cc50 0x7f51ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:38.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.464+0000 7f51fe59c640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51ec06cc50 0x7f51ec06f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009890 tx=0x7f51f0008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:38.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.468+0000 7f51f77fe640 1 -- 172.21.15.49:0/2123656325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f51e8077910 con 0x7f5200102f60 2024-09-19T08:59:38.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.649+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f52001039a0 con 0x7f51ec06cc50 2024-09-19T08:59:38.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.651+0000 7f51f77fe640 1 -- 172.21.15.49:0/2123656325 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f52001039a0 con 0x7f51ec06cc50 2024-09-19T08:59:38.651 INFO:teuthology.orchestra.run.smithi049.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T08:59:38.651 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500D2480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:59:38.651 INFO:teuthology.orchestra.run.smithi049.stdout:smithi102 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VK400BGN 372G No 71s ago Has a FileSystem, LVM detected 2024-09-19T08:59:38.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51ec06cc50 msgr2=0x7f51ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:38.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51ec06cc50 0x7f51ec06f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009890 tx=0x7f51f0008040 comp rx=0 tx=0).stop 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 msgr2=0x7f5200195c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200195c90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005610 tx=0x7f51e8005640 comp rx=0 tx=0).stop 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 shutdown_connections 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f51ec06cc50 0x7f51ec06f110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5200102f60 0x7f5200195c90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 --2- 172.21.15.49:0/2123656325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5200100630 0x7f5200195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 >> 172.21.15.49:0/2123656325 conn(0x7f52000fa250 msgr2=0x7f52000fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 shutdown_connections 2024-09-19T08:59:38.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:38.653+0000 7f5204ca2640 1 -- 172.21.15.49:0/2123656325 wait complete. 2024-09-19T08:59:39.294 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:59:39.310 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:59:39.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-19T08:59:39.369 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:39 smithi049 ceph-mon[28158]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:39.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:39 smithi102 ceph-mon[35280]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:39.520 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:40.294 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:40 smithi049 ceph-mon[28158]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:40.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:40 smithi102 ceph-mon[35280]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 -- 172.21.15.49:0/3209814504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0feaa0 msgr2=0x7faf7c0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 --2- 172.21.15.49:0/3209814504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0feaa0 0x7faf7c0feea0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf78009880 tx=0x7faf7802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 -- 172.21.15.49:0/3209814504 shutdown_connections 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 --2- 172.21.15.49:0/3209814504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7c0ffca0 0x7faf7c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 --2- 172.21.15.49:0/3209814504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0feaa0 0x7faf7c0feea0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 -- 172.21.15.49:0/3209814504 >> 172.21.15.49:0/3209814504 conn(0x7faf7c0fa250 msgr2=0x7faf7c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 -- 172.21.15.49:0/3209814504 shutdown_connections 2024-09-19T08:59:41.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.018+0000 7faf832f1640 1 -- 172.21.15.49:0/3209814504 wait complete. 2024-09-19T08:59:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf832f1640 1 Processor -- start 2024-09-19T08:59:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf832f1640 1 -- start start 2024-09-19T08:59:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf832f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7c0feaa0 0x7faf7c195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf832f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0ffca0 0x7faf7c195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:41.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf832f1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c196170 con 0x7faf7c0ffca0 2024-09-19T08:59:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf832f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c1962e0 con 0x7faf7c0feaa0 2024-09-19T08:59:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf8088c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0ffca0 0x7faf7c195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf8088c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0ffca0 0x7faf7c195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55234/0 (socket says 172.21.15.49:55234) 2024-09-19T08:59:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf8088c640 1 -- 172.21.15.49:0/888944220 learned_addr learned my addr 172.21.15.49:0/888944220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.019+0000 7faf8108d640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7c0feaa0 0x7faf7c195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf8088c640 1 -- 172.21.15.49:0/888944220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7c0feaa0 msgr2=0x7faf7c195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:41.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf8088c640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7c0feaa0 0x7faf7c195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf8088c640 1 -- 172.21.15.49:0/888944220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009560 con 0x7faf7c0ffca0 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf8088c640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0ffca0 0x7faf7c195ba0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c840 tx=0x7faf6c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf727fc640 1 -- 172.21.15.49:0/888944220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf6c0041f0 con 0x7faf7c0ffca0 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf727fc640 1 -- 172.21.15.49:0/888944220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf6c007e70 con 0x7faf7c0ffca0 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c19ad80 con 0x7faf7c0ffca0 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf727fc640 1 -- 172.21.15.49:0/888944220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf6c0049d0 con 0x7faf7c0ffca0 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.020+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c19b350 con 0x7faf7c0ffca0 2024-09-19T08:59:41.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.021+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c107690 con 0x7faf7c0ffca0 2024-09-19T08:59:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.021+0000 7faf727fc640 1 -- 172.21.15.49:0/888944220 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faf6c0079b0 con 0x7faf7c0ffca0 2024-09-19T08:59:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.022+0000 7faf727fc640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7faf6806cc50 0x7faf6806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.022+0000 7faf727fc640 1 -- 172.21.15.49:0/888944220 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7faf6c08bc50 con 0x7faf7c0ffca0 2024-09-19T08:59:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.022+0000 7faf8108d640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7faf6806cc50 0x7faf6806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:41.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.022+0000 7faf8108d640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7faf6806cc50 0x7faf6806f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf78009230 tx=0x7faf78005b50 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:41.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.026+0000 7faf727fc640 1 -- 172.21.15.49:0/888944220 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faf6c0563e0 con 0x7faf7c0ffca0 2024-09-19T08:59:41.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:41.224+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7faf7c19b590 con 0x7faf6806cc50 2024-09-19T08:59:41.224 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:41 smithi049 ceph-mon[28158]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:41.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:41 smithi102 ceph-mon[35280]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:42 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-19T08:59:42.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:42 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-19T08:59:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.218+0000 7faf727fc640 1 -- 172.21.15.49:0/888944220 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faf7c19b590 con 0x7faf6806cc50 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7faf6806cc50 msgr2=0x7faf6806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7faf6806cc50 0x7faf6806f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf78009230 tx=0x7faf78005b50 comp rx=0 tx=0).stop 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0ffca0 msgr2=0x7faf7c195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0ffca0 0x7faf7c195ba0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c840 tx=0x7faf6c00cd00 comp rx=0 tx=0).stop 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 shutdown_connections 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7faf6806cc50 0x7faf6806f110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf7c0ffca0 0x7faf7c195ba0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 --2- 172.21.15.49:0/888944220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf7c0feaa0 0x7faf7c195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 >> 172.21.15.49:0/888944220 conn(0x7faf7c0fa250 msgr2=0x7faf7c0fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.220+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 shutdown_connections 2024-09-19T08:59:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:43.221+0000 7faf832f1640 1 -- 172.21.15.49:0/888944220 wait complete. 2024-09-19T08:59:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:43 smithi102 ceph-mon[35280]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:43 smithi102 ceph-mon[35280]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-19T08:59:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:43 smithi102 ceph-mon[35280]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T08:59:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-19T08:59:43.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:43 smithi049 ceph-mon[28158]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:43.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:43 smithi049 ceph-mon[28158]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:43.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-19T08:59:43.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:43 smithi049 ceph-mon[28158]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T08:59:43.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-19T08:59:43.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:43 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[28154]: 2024-09-19T08:59:43.193+0000 7f41c702f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:59:43.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T08:59:44.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-19T08:59:44.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T08:59:44.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: osdmap e43: 6 total, 6 up, 6 in 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: fsmap cephfs:0 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:44.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:44.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:44 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:44.288 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-19T08:59:44.288 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: osdmap e43: 6 total, 6 up, 6 in 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: fsmap cephfs:0 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:44.289 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:44.290 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:44.290 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:44.290 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:44 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:45.227 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:45.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:45 smithi049 ceph-mon[28158]: Saving service mds.cephfs spec with placement count:4 2024-09-19T08:59:45.502 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:45 smithi049 ceph-mon[28158]: Deploying daemon mds.cephfs.smithi049.ibssbl on smithi049 2024-09-19T08:59:45.502 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:45 smithi049 ceph-mon[28158]: pgmap v172: 65 pgs: 10 active+clean, 13 creating+peering, 42 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:45.502 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:45 smithi049 ceph-mon[28158]: osdmap e44: 6 total, 6 up, 6 in 2024-09-19T08:59:45.507 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:45 smithi102 ceph-mon[35280]: Saving service mds.cephfs spec with placement count:4 2024-09-19T08:59:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:45 smithi102 ceph-mon[35280]: Deploying daemon mds.cephfs.smithi049.ibssbl on smithi049 2024-09-19T08:59:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:45 smithi102 ceph-mon[35280]: pgmap v172: 65 pgs: 10 active+clean, 13 creating+peering, 42 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:45 smithi102 ceph-mon[35280]: osdmap e44: 6 total, 6 up, 6 in 2024-09-19T08:59:46.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:46 smithi049 ceph-mon[28158]: osdmap e45: 6 total, 6 up, 6 in 2024-09-19T08:59:46.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:46 smithi049 ceph-mon[28158]: pgmap v175: 65 pgs: 19 active+clean, 13 creating+peering, 33 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:46 smithi102 ceph-mon[35280]: osdmap e45: 6 total, 6 up, 6 in 2024-09-19T08:59:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:46 smithi102 ceph-mon[35280]: pgmap v175: 65 pgs: 19 active+clean, 13 creating+peering, 33 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.057+0000 7f9fcbdee640 1 -- 172.21.15.49:0/1771143502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 msgr2=0x7f9fc4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.057+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/1771143502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc4101210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009880 tx=0x7f9fb402a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.057+0000 7f9fcbdee640 1 -- 172.21.15.49:0/1771143502 shutdown_connections 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.057+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/1771143502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc4101210 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.057+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/1771143502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc40ffb90 0x7f9fc40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 -- 172.21.15.49:0/1771143502 >> 172.21.15.49:0/1771143502 conn(0x7f9fc40fb320 msgr2=0x7f9fc40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 -- 172.21.15.49:0/1771143502 shutdown_connections 2024-09-19T08:59:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 -- 172.21.15.49:0/1771143502 wait complete. 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 Processor -- start 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 -- start start 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc40ffb90 0x7f9fc4074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc4199230 con 0x7f9fc4100d90 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.058+0000 7f9fcbdee640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc41993a0 con 0x7f9fc40ffb90 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9389640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9389640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc40728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55252/0 (socket says 172.21.15.49:55252) 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9389640 1 -- 172.21.15.49:0/48861921 learned_addr learned my addr 172.21.15.49:0/48861921 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9b8a640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc40ffb90 0x7f9fc4074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9389640 1 -- 172.21.15.49:0/48861921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc40ffb90 msgr2=0x7f9fc4074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9389640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc40ffb90 0x7f9fc4074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9389640 1 -- 172.21.15.49:0/48861921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4009560 con 0x7f9fc4100d90 2024-09-19T08:59:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fc9389640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc40728a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4006010 tx=0x7f9fb40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fbaffd640 1 -- 172.21.15.49:0/48861921 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb4004aa0 con 0x7f9fc4100d90 2024-09-19T08:59:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fbaffd640 1 -- 172.21.15.49:0/48861921 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fb4004c00 con 0x7f9fc4100d90 2024-09-19T08:59:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc4072de0 con 0x7f9fc4100d90 2024-09-19T08:59:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fbaffd640 1 -- 172.21.15.49:0/48861921 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb4003ac0 con 0x7f9fc4100d90 2024-09-19T08:59:47.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.059+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc40732d0 con 0x7f9fc4100d90 2024-09-19T08:59:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.060+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc40735b0 con 0x7f9fc4100d90 2024-09-19T08:59:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.061+0000 7f9fbaffd640 1 -- 172.21.15.49:0/48861921 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9fb4031640 con 0x7f9fc4100d90 2024-09-19T08:59:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.061+0000 7f9fbaffd640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9fb006cc60 0x7f9fb006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.061+0000 7f9fbaffd640 1 -- 172.21.15.49:0/48861921 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f9fb40ad450 con 0x7f9fc4100d90 2024-09-19T08:59:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.062+0000 7f9fc9b8a640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9fb006cc60 0x7f9fb006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:47.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.062+0000 7f9fc9b8a640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9fb006cc60 0x7f9fb006f120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005d00 tx=0x7f9fc0005c50 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:47.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.066+0000 7f9fbaffd640 1 -- 172.21.15.49:0/48861921 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9fb4077820 con 0x7f9fc4100d90 2024-09-19T08:59:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.277+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9fc4073770 con 0x7f9fc4100d90 2024-09-19T08:59:47.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.278+0000 7f9fbaffd640 1 -- 172.21.15.49:0/48861921 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1114 (secure 0 0 0) 0x7f9fc4073770 con 0x7f9fc4100d90 2024-09-19T08:59:47.281 INFO:teuthology.orchestra.run.smithi049.stdout:e2 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 2 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T08:59:43.193695+0000 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T08:59:47.282 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:in 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T08:59:47.283 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 0 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:59:47.284 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T08:59:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2024-09-19T08:59:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9fb006cc60 msgr2=0x7f9fb006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9fb006cc60 0x7f9fb006f120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005d00 tx=0x7f9fc0005c50 comp rx=0 tx=0).stop 2024-09-19T08:59:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 msgr2=0x7f9fc40728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc40728a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4006010 tx=0x7f9fb40055a0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 shutdown_connections 2024-09-19T08:59:47.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9fb006cc60 0x7f9fb006f120 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fc4100d90 0x7f9fc40728a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 --2- 172.21.15.49:0/48861921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc40ffb90 0x7f9fc4074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:47.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 >> 172.21.15.49:0/48861921 conn(0x7f9fc40fb320 msgr2=0x7f9fc40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:47.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 shutdown_connections 2024-09-19T08:59:47.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:47.280+0000 7f9fcbdee640 1 -- 172.21.15.49:0/48861921 wait complete. 2024-09-19T08:59:47.834 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:59:47.847 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:59:47.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-19T08:59:48.054 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:48.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:48.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/48861921' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:59:48.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:48.416 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:48.416 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:48 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T08:59:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/48861921' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:59:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:48 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:49.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: Deploying daemon mds.cephfs.smithi102.snrasw on smithi102 2024-09-19T08:59:49.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: pgmap v176: 65 pgs: 47 active+clean, 13 creating+peering, 5 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:49.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6826/1350437086,v1:172.21.15.49:6827/1350437086] up:boot 2024-09-19T08:59:49.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: daemon mds.cephfs.smithi049.ibssbl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-19T08:59:49.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:59:49.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:59:49.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: Cluster is now healthy 2024-09-19T08:59:49.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: fsmap cephfs:0 1 up:standby 2024-09-19T08:59:49.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T08:59:49.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:creating} 2024-09-19T08:59:49.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:49 smithi049 ceph-mon[28158]: daemon mds.cephfs.smithi049.ibssbl is now active in filesystem cephfs as rank 0 2024-09-19T08:59:49.401 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: Deploying daemon mds.cephfs.smithi102.snrasw on smithi102 2024-09-19T08:59:49.401 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: pgmap v176: 65 pgs: 47 active+clean, 13 creating+peering, 5 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6826/1350437086,v1:172.21.15.49:6827/1350437086] up:boot 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: daemon mds.cephfs.smithi049.ibssbl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: Cluster is now healthy 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: fsmap cephfs:0 1 up:standby 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:creating} 2024-09-19T08:59:49.402 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:49 smithi102 ceph-mon[35280]: daemon mds.cephfs.smithi049.ibssbl is now active in filesystem cephfs as rank 0 2024-09-19T08:59:49.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 -- 172.21.15.49:0/1837884912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 msgr2=0x7f01cc105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 --2- 172.21.15.49:0/1837884912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc105400 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009880 tx=0x7f01b402a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 -- 172.21.15.49:0/1837884912 shutdown_connections 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 --2- 172.21.15.49:0/1837884912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc105400 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 --2- 172.21.15.49:0/1837884912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01cc1006e0 0x7f01cc102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 -- 172.21.15.49:0/1837884912 >> 172.21.15.49:0/1837884912 conn(0x7f01cc0fa280 msgr2=0x7f01cc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 -- 172.21.15.49:0/1837884912 shutdown_connections 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.742+0000 7f01d23d3640 1 -- 172.21.15.49:0/1837884912 wait complete. 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01d23d3640 1 Processor -- start 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01d23d3640 1 -- start start 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01d23d3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01cc1006e0 0x7f01cc195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01d23d3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01d23d3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc196150 con 0x7f01cc103010 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01d23d3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc1962c0 con 0x7f01cc1006e0 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01cbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01cc1006e0 0x7f01cc195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55292/0 (socket says 172.21.15.49:55292) 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.743+0000 7f01cb7fe640 1 -- 172.21.15.49:0/716282377 learned_addr learned my addr 172.21.15.49:0/716282377 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01cb7fe640 1 -- 172.21.15.49:0/716282377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01cc1006e0 msgr2=0x7f01cc195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01cb7fe640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01cc1006e0 0x7f01cc195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01cb7fe640 1 -- 172.21.15.49:0/716282377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009560 con 0x7f01cc103010 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01cbfff640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01cc1006e0 0x7f01cc195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01cb7fe640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc195b80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f01b4004650 tx=0x7f01b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01c97fa640 1 -- 172.21.15.49:0/716282377 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b4004aa0 con 0x7f01cc103010 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc19ad60 con 0x7f01cc103010 2024-09-19T08:59:49.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01c97fa640 1 -- 172.21.15.49:0/716282377 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b4005d50 con 0x7f01cc103010 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01c97fa640 1 -- 172.21.15.49:0/716282377 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b40039e0 con 0x7f01cc103010 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.744+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc19b2b0 con 0x7f01cc103010 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.745+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc108790 con 0x7f01cc103010 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.746+0000 7f01c97fa640 1 -- 172.21.15.49:0/716282377 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f01b4031c00 con 0x7f01cc103010 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.746+0000 7f01c97fa640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f01b806cc50 0x7f01b806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.746+0000 7f01c97fa640 1 -- 172.21.15.49:0/716282377 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f01b40ad220 con 0x7f01cc103010 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.746+0000 7f01cbfff640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f01b806cc50 0x7f01b806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.746+0000 7f01cbfff640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f01b806cc50 0x7f01b806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009fc0 tx=0x7f01bc005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:49.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.750+0000 7f01c97fa640 1 -- 172.21.15.49:0/716282377 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f01b40776a0 con 0x7f01cc103010 2024-09-19T08:59:49.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:49.961+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f01cc19b4a0 con 0x7f01cc103010 2024-09-19T08:59:50.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.110+0000 7f01c97fa640 1 -- 172.21.15.49:0/716282377 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f01cc19b4a0 con 0x7f01cc103010 2024-09-19T08:59:50.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f01b806cc50 msgr2=0x7f01b806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f01b806cc50 0x7f01b806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009fc0 tx=0x7f01bc005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:50.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 msgr2=0x7f01cc195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:50.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc195b80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f01b4004650 tx=0x7f01b40055a0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 shutdown_connections 2024-09-19T08:59:50.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f01b806cc50 0x7f01b806f110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01cc103010 0x7f01cc195b80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 --2- 172.21.15.49:0/716282377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01cc1006e0 0x7f01cc195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:50.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 >> 172.21.15.49:0/716282377 conn(0x7f01cc0fa280 msgr2=0x7f01cc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:50.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 shutdown_connections 2024-09-19T08:59:50.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:50.113+0000 7f01d23d3640 1 -- 172.21.15.49:0/716282377 wait complete. 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6826/1350437086,v1:172.21.15.49:6827/1350437086] up:active 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:50.409 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:50 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/716282377' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-19T08:59:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6826/1350437086,v1:172.21.15.49:6827/1350437086] up:active 2024-09-19T08:59:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 2024-09-19T08:59:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:50.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:50.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:50.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:50.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:50.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:50 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/716282377' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-19T08:59:51.331 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: Deploying daemon mds.cephfs.smithi049.uujbrc on smithi049 2024-09-19T08:59:51.331 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: pgmap v177: 65 pgs: 65 active+clean; 578 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 742 B/s wr, 2 op/s 2024-09-19T08:59:51.331 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] up:boot 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/716282377' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: daemon mds.cephfs.smithi102.snrasw assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 1 up:standby 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:creating} 2024-09-19T08:59:51.332 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:51 smithi049 ceph-mon[28158]: daemon mds.cephfs.smithi102.snrasw is now active in filesystem cephfs as rank 1 2024-09-19T08:59:51.356 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:59:51.366 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:59:51.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-19T08:59:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: Deploying daemon mds.cephfs.smithi049.uujbrc on smithi049 2024-09-19T08:59:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: pgmap v177: 65 pgs: 65 active+clean; 578 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 742 B/s wr, 2 op/s 2024-09-19T08:59:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] up:boot 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/716282377' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: daemon mds.cephfs.smithi102.snrasw assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 1 up:standby 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:creating} 2024-09-19T08:59:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:51 smithi102 ceph-mon[35280]: daemon mds.cephfs.smithi102.snrasw is now active in filesystem cephfs as rank 1 2024-09-19T08:59:51.921 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:52.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:52 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] up:active 2024-09-19T08:59:52.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:52 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2024-09-19T08:59:52.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:52 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] up:active 2024-09-19T08:59:52.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:52 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2024-09-19T08:59:53.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:53 smithi102 ceph-mon[35280]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-19T08:59:53.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:53 smithi049 ceph-mon[28158]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 7 op/s 2024-09-19T08:59:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 -- 172.21.15.49:0/4254188352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 msgr2=0x7f29f00fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 --2- 172.21.15.49:0/4254188352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f00fee80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009880 tx=0x7f29e002a4a0 comp rx=0 tx=0).stop 2024-09-19T08:59:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 -- 172.21.15.49:0/4254188352 shutdown_connections 2024-09-19T08:59:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 --2- 172.21.15.49:0/4254188352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29f00ffc80 0x7f29f0100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:53.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 --2- 172.21.15.49:0/4254188352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f00fee80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 -- 172.21.15.49:0/4254188352 >> 172.21.15.49:0/4254188352 conn(0x7f29f00fa230 msgr2=0x7f29f00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 -- 172.21.15.49:0/4254188352 shutdown_connections 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.808+0000 7f29f4d14640 1 -- 172.21.15.49:0/4254188352 wait complete. 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29f4d14640 1 Processor -- start 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29f4d14640 1 -- start start 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29f4d14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f0068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29f4d14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29f00ffc80 0x7f29f019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29f4d14640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f019a940 con 0x7f29f00fea80 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29f4d14640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f019aa80 con 0x7f29f00ffc80 2024-09-19T08:59:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f0068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29ee59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f0068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47946/0 (socket says 172.21.15.49:47946) 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.809+0000 7f29ee59c640 1 -- 172.21.15.49:0/2843383377 learned_addr learned my addr 172.21.15.49:0/2843383377 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29edd9b640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29f00ffc80 0x7f29f019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29ee59c640 1 -- 172.21.15.49:0/2843383377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29f00ffc80 msgr2=0x7f29f019a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29ee59c640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29f00ffc80 0x7f29f019a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29ee59c640 1 -- 172.21.15.49:0/2843383377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0009560 con 0x7f29f00fea80 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29edd9b640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29f00ffc80 0x7f29f019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29ee59c640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f0068fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29e002a9c0 tx=0x7f29e0005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29df7fe640 1 -- 172.21.15.49:0/2843383377 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e0004b20 con 0x7f29f00fea80 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29df7fe640 1 -- 172.21.15.49:0/2843383377 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29e0004c80 con 0x7f29f00fea80 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f019acd0 con 0x7f29f00fea80 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29df7fe640 1 -- 172.21.15.49:0/2843383377 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e0003b80 con 0x7f29f00fea80 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.810+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f019b240 con 0x7f29f00fea80 2024-09-19T08:59:53.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.811+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f018e620 con 0x7f29f00fea80 2024-09-19T08:59:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.812+0000 7f29df7fe640 1 -- 172.21.15.49:0/2843383377 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f29e0031640 con 0x7f29f00fea80 2024-09-19T08:59:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.812+0000 7f29df7fe640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f29d806cc50 0x7f29d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.812+0000 7f29df7fe640 1 -- 172.21.15.49:0/2843383377 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f29e00ad5b0 con 0x7f29f00fea80 2024-09-19T08:59:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.812+0000 7f29edd9b640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f29d806cc50 0x7f29d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.813+0000 7f29edd9b640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f29d806cc50 0x7f29d806f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29f0069530 tx=0x7f29e4005d30 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:53.817+0000 7f29df7fe640 1 -- 172.21.15.49:0/2843383377 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29e0077980 con 0x7f29f00fea80 2024-09-19T08:59:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.030+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f29f0107690 con 0x7f29f00fea80 2024-09-19T08:59:54.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.124+0000 7f29df7fe640 1 -- 172.21.15.49:0/2843383377 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f29e007afa0 con 0x7f29f00fea80 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f29d806cc50 msgr2=0x7f29d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f29d806cc50 0x7f29d806f110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29f0069530 tx=0x7f29e4005d30 comp rx=0 tx=0).stop 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 msgr2=0x7f29f0068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f0068fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29e002a9c0 tx=0x7f29e0005610 comp rx=0 tx=0).stop 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 shutdown_connections 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f29d806cc50 0x7f29d806f110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29f00ffc80 0x7f29f019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 --2- 172.21.15.49:0/2843383377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f00fea80 0x7f29f0068fb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 >> 172.21.15.49:0/2843383377 conn(0x7f29f00fa230 msgr2=0x7f29f01033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 shutdown_connections 2024-09-19T08:59:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:54.126+0000 7f29f4d14640 1 -- 172.21.15.49:0/2843383377 wait complete. 2024-09-19T08:59:54.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:54 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2843383377' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:59:54.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:54 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2843383377' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:59:55.077 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:59:55.087 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:59:55.088 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-19T08:59:55.303 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T08:59:55.425 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:59:55.521 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2843383377' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:59:55.521 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2024-09-19T08:59:55.521 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:55.521 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:55.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:55.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:55.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:55.522 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:55 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:55.522 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-19T08:59:55.522 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2843383377' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:59:55.522 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2024-09-19T08:59:55.523 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:55.523 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:55.523 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:55.523 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:59:55.523 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:59:55.523 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:55 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:56.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:56 smithi102 ceph-mon[35280]: Deploying daemon mds.cephfs.smithi102.ojquyx on smithi102 2024-09-19T08:59:56.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:56 smithi102 ceph-mon[35280]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-19T08:59:56.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:56 smithi102 ceph-mon[35280]: Cluster is now healthy 2024-09-19T08:59:56.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:56 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:boot 2024-09-19T08:59:56.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:56 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby 2024-09-19T08:59:56.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:56 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T08:59:56.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:56 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 2024-09-19T08:59:56.395 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:56 smithi049 ceph-mon[28158]: Deploying daemon mds.cephfs.smithi102.ojquyx on smithi102 2024-09-19T08:59:56.396 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:56 smithi049 ceph-mon[28158]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-19T08:59:56.396 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:56 smithi049 ceph-mon[28158]: Cluster is now healthy 2024-09-19T08:59:56.396 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:56 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:boot 2024-09-19T08:59:56.396 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:56 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby 2024-09-19T08:59:56.396 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:56 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T08:59:56.396 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:56 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 2024-09-19T08:59:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 -- 172.21.15.49:0/1538676157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280100680 msgr2=0x7fa280102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 --2- 172.21.15.49:0/1538676157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280100680 0x7fa280102a70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa2740098b0 tx=0x7fa27402a4d0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 -- 172.21.15.49:0/1538676157 shutdown_connections 2024-09-19T08:59:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 --2- 172.21.15.49:0/1538676157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa280102fb0 0x7fa2801053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 --2- 172.21.15.49:0/1538676157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280100680 0x7fa280102a70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 -- 172.21.15.49:0/1538676157 >> 172.21.15.49:0/1538676157 conn(0x7fa2800fa280 msgr2=0x7fa2800fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 -- 172.21.15.49:0/1538676157 shutdown_connections 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.929+0000 7fa287829640 1 -- 172.21.15.49:0/1538676157 wait complete. 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa287829640 1 Processor -- start 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa287829640 1 -- start start 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa287829640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa280100680 0x7fa2801956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa287829640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280102fb0 0x7fa280195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa287829640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2801961d0 con 0x7fa280102fb0 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa287829640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa280196340 con 0x7fa280100680 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa284dc4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280102fb0 0x7fa280195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa2855c5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa280100680 0x7fa2801956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa284dc4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280102fb0 0x7fa280195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47974/0 (socket says 172.21.15.49:47974) 2024-09-19T08:59:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa284dc4640 1 -- 172.21.15.49:0/234485436 learned_addr learned my addr 172.21.15.49:0/234485436 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa284dc4640 1 -- 172.21.15.49:0/234485436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa280100680 msgr2=0x7fa2801956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa284dc4640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa280100680 0x7fa2801956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa284dc4640 1 -- 172.21.15.49:0/234485436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274009560 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.930+0000 7fa284dc4640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280102fb0 0x7fa280195c00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00d8d0 tx=0x7fa27c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.931+0000 7fa2727fc640 1 -- 172.21.15.49:0/234485436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa27c00bea0 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.931+0000 7fa2727fc640 1 -- 172.21.15.49:0/234485436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa27c009c00 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.931+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28019ade0 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.931+0000 7fa2727fc640 1 -- 172.21.15.49:0/234485436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa27c010460 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.931+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28019b300 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.932+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa280108810 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.932+0000 7fa2727fc640 1 -- 172.21.15.49:0/234485436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa27c003f10 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.933+0000 7fa2727fc640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa26c06cc50 0x7fa26c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.933+0000 7fa2727fc640 1 -- 172.21.15.49:0/234485436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa27c08bfc0 con 0x7fa280102fb0 2024-09-19T08:59:56.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.933+0000 7fa2855c5640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa26c06cc50 0x7fa26c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:56.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.933+0000 7fa2855c5640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa26c06cc50 0x7fa26c06f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa274006010 tx=0x7fa2740314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:56.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:56.937+0000 7fa2727fc640 1 -- 172.21.15.49:0/234485436 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa27c056390 con 0x7fa280102fb0 2024-09-19T08:59:57.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:57.156+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2801089f0 con 0x7fa280102fb0 2024-09-19T08:59:57.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T08:59:57.460 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.460 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.460 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.460 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.460 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.460 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:57.460 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:57 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T08:59:57.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:57.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:57.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:57 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.145+0000 7fa2727fc640 1 -- 172.21.15.49:0/234485436 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v14) v1 ==== 168+0+0 (secure 0 0 0) 0x7fa27c0599b0 con 0x7fa280102fb0 2024-09-19T08:59:58.146 INFO:teuthology.orchestra.run.smithi049.stderr:inline data enabled 2024-09-19T08:59:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa26c06cc50 msgr2=0x7fa26c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa26c06cc50 0x7fa26c06f110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa274006010 tx=0x7fa2740314e0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280102fb0 msgr2=0x7fa280195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280102fb0 0x7fa280195c00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00d8d0 tx=0x7fa27c00dd90 comp rx=0 tx=0).stop 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 shutdown_connections 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa26c06cc50 0x7fa26c06f110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa280102fb0 0x7fa280195c00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 --2- 172.21.15.49:0/234485436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa280100680 0x7fa2801956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 >> 172.21.15.49:0/234485436 conn(0x7fa2800fa280 msgr2=0x7fa2800fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 shutdown_connections 2024-09-19T08:59:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T08:59:58.148+0000 7fa287829640 1 -- 172.21.15.49:0/234485436 wait complete. 2024-09-19T08:59:58.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:58 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] up:boot 2024-09-19T08:59:58.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:58 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T08:59:58.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:58 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T08:59:58.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:58 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T08:59:58.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:58 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/234485436' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:59:58.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:58 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] up:boot 2024-09-19T08:59:58.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:58 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T08:59:58.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:58 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T08:59:58.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:58 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T08:59:58.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:58 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/234485436' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T08:59:59.109 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:59:59.119 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T08:59:59.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T08:59:59.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:59 smithi049 ceph-mon[28158]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T08:59:59.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:59 smithi049 ceph-mon[28158]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-19T08:59:59.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:59 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/234485436' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:59:59.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:59 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] up:active 2024-09-19T08:59:59.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:59 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T08:59:59.389 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:59 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:59.389 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 08:59:59 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:59 smithi102 ceph-mon[35280]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-19T08:59:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:59 smithi102 ceph-mon[35280]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-19T08:59:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:59 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/234485436' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T08:59:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:59 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] up:active 2024-09-19T08:59:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:59 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T08:59:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:59 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T08:59:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 08:59:59 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:standby-replay 2024-09-19T09:00:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: Dropping low affinity active daemon mds.cephfs.smithi049.ibssbl in favor of higher affinity standby. 2024-09-19T09:00:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: Replacing daemon mds.cephfs.smithi049.ibssbl as rank 0 with standby daemon mds.cephfs.smithi049.uujbrc 2024-09-19T09:00:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:00:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:00:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: osdmap e46: 6 total, 6 up, 6 in 2024-09-19T09:00:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:replay,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 2024-09-19T09:00:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-19T09:00:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T09:00:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: fs cephfs is degraded 2024-09-19T09:00:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:00:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:00 smithi102 ceph-mon[35280]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:00:00.542 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:standby-replay 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: Dropping low affinity active daemon mds.cephfs.smithi049.ibssbl in favor of higher affinity standby. 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: Replacing daemon mds.cephfs.smithi049.ibssbl as rank 0 with standby daemon mds.cephfs.smithi049.uujbrc 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: osdmap e46: 6 total, 6 up, 6 in 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:replay,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: fs cephfs is degraded 2024-09-19T09:00:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:00:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:00 smithi049 ceph-mon[28158]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:00:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:01 smithi049 ceph-mon[28158]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:00:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:01 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] up:boot 2024-09-19T09:00:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:01 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:resolve 2024-09-19T09:00:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:01 smithi049 ceph-mon[28158]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:resolve,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:01.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:01 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:00:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:01 smithi102 ceph-mon[35280]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:00:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:01 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] up:boot 2024-09-19T09:00:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:01 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:resolve 2024-09-19T09:00:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:01 smithi102 ceph-mon[35280]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:resolve,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:01 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:00:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:02 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:reconnect 2024-09-19T09:00:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:02 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] up:standby-replay 2024-09-19T09:00:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:02 smithi049 ceph-mon[28158]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:reconnect,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:02 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:rejoin 2024-09-19T09:00:02.492 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:02 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:reconnect 2024-09-19T09:00:02.492 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:02 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] up:standby-replay 2024-09-19T09:00:02.492 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:02 smithi102 ceph-mon[35280]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:reconnect,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:02.492 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:02 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:02.492 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:02 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:02.492 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:02 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:rejoin 2024-09-19T09:00:02.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.848+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1821053270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 msgr2=0x7f49b41053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.848+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1821053270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b41053b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009880 tx=0x7f49a802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.848+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1821053270 shutdown_connections 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.848+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1821053270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b41053b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.848+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1821053270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b4100690 0x7f49b4102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.848+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1821053270 >> 172.21.15.49:0/1821053270 conn(0x7f49b40fa250 msgr2=0x7f49b40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.849+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1821053270 shutdown_connections 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.849+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1821053270 wait complete. 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.849+0000 7f49bc4f4640 1 Processor -- start 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.849+0000 7f49bc4f4640 1 -- start start 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49bc4f4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b4100690 0x7f49b4195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49bc4f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b4195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49bc4f4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4196140 con 0x7f49b4102fc0 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49bc4f4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b41962b0 con 0x7f49b4100690 2024-09-19T09:00:02.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49b9a8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b4195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49b9a8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b4195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49572/0 (socket says 172.21.15.49:49572) 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49b9a8f640 1 -- 172.21.15.49:0/1818464539 learned_addr learned my addr 172.21.15.49:0/1818464539 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49ba290640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b4100690 0x7f49b4195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49b9a8f640 1 -- 172.21.15.49:0/1818464539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b4100690 msgr2=0x7f49b4195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49b9a8f640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b4100690 0x7f49b4195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49b9a8f640 1 -- 172.21.15.49:0/1818464539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8009560 con 0x7f49b4102fc0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49b9a8f640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b4195b70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f49a80054f0 tx=0x7f49a8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49a77fe640 1 -- 172.21.15.49:0/1818464539 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a8004aa0 con 0x7f49b4102fc0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.850+0000 7f49a77fe640 1 -- 172.21.15.49:0/1818464539 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49a8004c00 con 0x7f49b4102fc0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.851+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b419ad00 con 0x7f49b4102fc0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.851+0000 7f49a77fe640 1 -- 172.21.15.49:0/1818464539 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a8003ac0 con 0x7f49b4102fc0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.851+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b419b2d0 con 0x7f49b4102fc0 2024-09-19T09:00:02.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.852+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b4108740 con 0x7f49b4102fc0 2024-09-19T09:00:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.852+0000 7f49a77fe640 1 -- 172.21.15.49:0/1818464539 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f49a8003d80 con 0x7f49b4102fc0 2024-09-19T09:00:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.852+0000 7f49a77fe640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f49a006cc50 0x7f49a006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.853+0000 7f49a77fe640 1 -- 172.21.15.49:0/1818464539 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f49a80ad490 con 0x7f49b4102fc0 2024-09-19T09:00:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.853+0000 7f49ba290640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f49a006cc50 0x7f49a006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.853+0000 7f49ba290640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f49a006cc50 0x7f49a006f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49b0005fd0 tx=0x7f49b0005850 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:02.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:02.857+0000 7f49a77fe640 1 -- 172.21.15.49:0/1818464539 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f49a8077800 con 0x7f49b4102fc0 2024-09-19T09:00:03.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.091+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49b419b4c0 con 0x7f49b4102fc0 2024-09-19T09:00:03.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.092+0000 7f49a77fe640 1 -- 172.21.15.49:0/1818464539 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1882 (secure 0 0 0) 0x7f49b419b4c0 con 0x7f49b4102fc0 2024-09-19T09:00:03.092 INFO:teuthology.orchestra.run.smithi049.stdout:e19 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 19 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:02.161348+0000 2024-09-19T09:00:03.093 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:00:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:rejoin seq 5 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:03.095 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:03.096 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:03.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:03.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:03.096 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-09-19T09:00:03.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:03.096 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f49a006cc50 msgr2=0x7f49a006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f49a006cc50 0x7f49a006f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49b0005fd0 tx=0x7f49b0005850 comp rx=0 tx=0).stop 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 msgr2=0x7f49b4195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b4195b70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f49a80054f0 tx=0x7f49a8005520 comp rx=0 tx=0).stop 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 shutdown_connections 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f49a006cc50 0x7f49a006f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b4102fc0 0x7f49b4195b70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 --2- 172.21.15.49:0/1818464539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b4100690 0x7f49b4195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 >> 172.21.15.49:0/1818464539 conn(0x7f49b40fa250 msgr2=0x7f49b40fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 shutdown_connections 2024-09-19T09:00:03.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:03.095+0000 7f49bc4f4640 1 -- 172.21.15.49:0/1818464539 wait complete. 2024-09-19T09:00:03.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:03 smithi049 ceph-mon[28158]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T09:00:03.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:03 smithi049 ceph-mon[28158]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:rejoin,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:03.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:03 smithi049 ceph-mon[28158]: daemon mds.cephfs.smithi049.uujbrc is now active in filesystem cephfs as rank 0 2024-09-19T09:00:03.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:03 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1818464539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:00:03.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:03 smithi049 ceph-mon[28158]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:00:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:03 smithi102 ceph-mon[35280]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T09:00:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:03 smithi102 ceph-mon[35280]: fsmap cephfs:2/2 {0=cephfs.smithi049.uujbrc=up:rejoin,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:03 smithi102 ceph-mon[35280]: daemon mds.cephfs.smithi049.uujbrc is now active in filesystem cephfs as rank 0 2024-09-19T09:00:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:03 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1818464539' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:00:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:03 smithi102 ceph-mon[35280]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:00:03.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-19T09:00:03.955 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:active 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:04.350 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:04 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: mds.? [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] up:active 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 1 up:standby-replay 1 up:standby 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:04.459 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:04 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:05.365 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:05 smithi049 ceph-mon[28158]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:00:05.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:05 smithi102 ceph-mon[35280]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:00:06.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 -- 172.21.15.49:0/1212949147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5414100d90 msgr2=0x7f5414101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1212949147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5414100d90 0x7f5414101210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5408009880 tx=0x7f540802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 -- 172.21.15.49:0/1212949147 shutdown_connections 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1212949147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5414100d90 0x7f5414101210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1212949147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54140ffb90 0x7f54140fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 -- 172.21.15.49:0/1212949147 >> 172.21.15.49:0/1212949147 conn(0x7f54140fb320 msgr2=0x7f54140fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 -- 172.21.15.49:0/1212949147 shutdown_connections 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.920+0000 7f5419d2d640 1 -- 172.21.15.49:0/1212949147 wait complete. 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f5419d2d640 1 Processor -- start 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f5419d2d640 1 -- start start 2024-09-19T09:00:06.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f5419d2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54140ffb90 0x7f5414195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f5419d2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5414100d90 0x7f5414195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f5419d2d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5414196140 con 0x7f54140ffb90 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f5419d2d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54141962b0 con 0x7f5414100d90 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f54137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54140ffb90 0x7f5414195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f54137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54140ffb90 0x7f5414195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49580/0 (socket says 172.21.15.49:49580) 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f54137fe640 1 -- 172.21.15.49:0/1007325523 learned_addr learned my addr 172.21.15.49:0/1007325523 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.921+0000 7f5412ffd640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5414100d90 0x7f5414195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f54137fe640 1 -- 172.21.15.49:0/1007325523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5414100d90 msgr2=0x7f5414195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f54137fe640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5414100d90 0x7f5414195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f54137fe640 1 -- 172.21.15.49:0/1007325523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009560 con 0x7f54140ffb90 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f54137fe640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54140ffb90 0x7f5414195630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f540400e970 tx=0x7f540400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f5410ff9640 1 -- 172.21.15.49:0/1007325523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54040096e0 con 0x7f54140ffb90 2024-09-19T09:00:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f5410ff9640 1 -- 172.21.15.49:0/1007325523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54040044f0 con 0x7f54140ffb90 2024-09-19T09:00:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541419ad50 con 0x7f54140ffb90 2024-09-19T09:00:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f5410ff9640 1 -- 172.21.15.49:0/1007325523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5404010430 con 0x7f54140ffb90 2024-09-19T09:00:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.922+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541419b290 con 0x7f54140ffb90 2024-09-19T09:00:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.923+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541418f730 con 0x7f54140ffb90 2024-09-19T09:00:06.268 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:00:06.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.923+0000 7f5410ff9640 1 -- 172.21.15.49:0/1007325523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5404004030 con 0x7f54140ffb90 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.924+0000 7f5410ff9640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f53fc06cc50 0x7f53fc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.924+0000 7f5410ff9640 1 -- 172.21.15.49:0/1007325523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5404014070 con 0x7f54140ffb90 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.924+0000 7f5412ffd640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f53fc06cc50 0x7f53fc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.924+0000 7f5412ffd640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f53fc06cc50 0x7f53fc06f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5408000c00 tx=0x7f54080314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:05.928+0000 7f5410ff9640 1 -- 172.21.15.49:0/1007325523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5404056ba0 con 0x7f54140ffb90 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.137+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54141087a0 con 0x7f54140ffb90 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.138+0000 7f5410ff9640 1 -- 172.21.15.49:0/1007325523 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4859 (secure 0 0 0) 0x7f540405a1c0 con 0x7f54140ffb90 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:00:06.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f53fc06cc50 msgr2=0x7f53fc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f53fc06cc50 0x7f53fc06f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5408000c00 tx=0x7f54080314e0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54140ffb90 msgr2=0x7f5414195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54140ffb90 0x7f5414195630 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f540400e970 tx=0x7f540400ee30 comp rx=0 tx=0).stop 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 shutdown_connections 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f53fc06cc50 0x7f53fc06f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5414100d90 0x7f5414195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 --2- 172.21.15.49:0/1007325523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54140ffb90 0x7f5414195630 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 >> 172.21.15.49:0/1007325523 conn(0x7f54140fb320 msgr2=0x7f5414104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:06.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 shutdown_connections 2024-09-19T09:00:06.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:06.140+0000 7f5419d2d640 1 -- 172.21.15.49:0/1007325523 wait complete. 2024-09-19T09:00:06.957 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-19T09:00:07.178 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:07.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:06 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:07.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:06 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:07.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:06 smithi102 ceph-mon[35280]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T09:00:07.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:06 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1007325523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:07.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:06 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:07.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:06 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:07.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:06 smithi049 ceph-mon[28158]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T09:00:07.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:06 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1007325523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:09.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:09 smithi049 ceph-mon[28158]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-19T09:00:09.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:09 smithi102 ceph-mon[35280]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-19T09:00:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 -- 172.21.15.49:0/3115660957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 msgr2=0x7f7b00100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3115660957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00100120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8009880 tx=0x7f7ae802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 -- 172.21.15.49:0/3115660957 shutdown_connections 2024-09-19T09:00:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3115660957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00100120 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3115660957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b000feaa0 0x7f7b000feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 -- 172.21.15.49:0/3115660957 >> 172.21.15.49:0/3115660957 conn(0x7f7b000fa250 msgr2=0x7f7b000fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:10.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 -- 172.21.15.49:0/3115660957 shutdown_connections 2024-09-19T09:00:10.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.031+0000 7f7b050b1640 1 -- 172.21.15.49:0/3115660957 wait complete. 2024-09-19T09:00:10.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7b050b1640 1 Processor -- start 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7b050b1640 1 -- start start 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7b050b1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b000feaa0 0x7f7b00194550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7b050b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00194a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7b050b1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b00195060 con 0x7f7b000ffca0 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7b050b1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b001951d0 con 0x7f7b000feaa0 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7afe59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00194a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7afed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b000feaa0 0x7f7b00194550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.032+0000 7f7afe59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00194a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49592/0 (socket says 172.21.15.49:49592) 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7afe59c640 1 -- 172.21.15.49:0/3765097015 learned_addr learned my addr 172.21.15.49:0/3765097015 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7afe59c640 1 -- 172.21.15.49:0/3765097015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b000feaa0 msgr2=0x7f7b00194550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:10.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7afe59c640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b000feaa0 0x7f7b00194550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7afe59c640 1 -- 172.21.15.49:0/3765097015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae8009560 con 0x7f7b000ffca0 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7afe59c640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00194a90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8004650 tx=0x7f7ae80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7af7fff640 1 -- 172.21.15.49:0/3765097015 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae803e070 con 0x7f7b000ffca0 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b00068450 con 0x7f7b000ffca0 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7af7fff640 1 -- 172.21.15.49:0/3765097015 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ae8005d50 con 0x7f7b000ffca0 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7af7fff640 1 -- 172.21.15.49:0/3765097015 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae8003800 con 0x7f7b000ffca0 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.033+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b000689c0 con 0x7f7b000ffca0 2024-09-19T09:00:10.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.034+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b000feea0 con 0x7f7b000ffca0 2024-09-19T09:00:10.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.035+0000 7f7af7fff640 1 -- 172.21.15.49:0/3765097015 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7ae8031a40 con 0x7f7b000ffca0 2024-09-19T09:00:10.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.035+0000 7f7af7fff640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7aec06cc60 0x7f7aec06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:10.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.035+0000 7f7af7fff640 1 -- 172.21.15.49:0/3765097015 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7ae80ae660 con 0x7f7b000ffca0 2024-09-19T09:00:10.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.035+0000 7f7afed9d640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7aec06cc60 0x7f7aec06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:10.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.036+0000 7f7afed9d640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7aec06cc60 0x7f7aec06f120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ffb00 tx=0x7f7af0005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:10.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.040+0000 7f7af7fff640 1 -- 172.21.15.49:0/3765097015 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7ae80789d0 con 0x7f7b000ffca0 2024-09-19T09:00:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.285+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f7b001076b0 con 0x7f7b000ffca0 2024-09-19T09:00:10.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.285+0000 7f7af7fff640 1 -- 172.21.15.49:0/3765097015 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v21) v1 ==== 78+0+97 (secure 0 0 0) 0x7f7ae807bff0 con 0x7f7b000ffca0 2024-09-19T09:00:10.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7aec06cc60 msgr2=0x7f7aec06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:10.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7aec06cc60 0x7f7aec06f120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ffb00 tx=0x7f7af0005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:10.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 msgr2=0x7f7b00194a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:10.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00194a90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8004650 tx=0x7f7ae80055a0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 shutdown_connections 2024-09-19T09:00:10.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7aec06cc60 0x7f7aec06f120 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b000ffca0 0x7f7b00194a90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 --2- 172.21.15.49:0/3765097015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b000feaa0 0x7f7b00194550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:10.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 >> 172.21.15.49:0/3765097015 conn(0x7f7b000fa250 msgr2=0x7f7b00103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:10.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.288+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 shutdown_connections 2024-09-19T09:00:10.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:10.289+0000 7f7b050b1640 1 -- 172.21.15.49:0/3765097015 wait complete. 2024-09-19T09:00:10.300 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:00:11.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:11 smithi049 ceph-mon[28158]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:00:11.221 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:11 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3765097015' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-19T09:00:11.243 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-19T09:00:11.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:11.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:11 smithi102 ceph-mon[35280]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:00:11.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:11 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3765097015' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-19T09:00:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:13.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:13 smithi049 ceph-mon[28158]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:00:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:13 smithi102 ceph-mon[35280]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:00:13.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.749+0000 7fbba551c640 1 -- 172.21.15.49:0/2875312083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 msgr2=0x7fbba01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 --2- 172.21.15.49:0/2875312083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba01047a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009880 tx=0x7fbb9402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 -- 172.21.15.49:0/2875312083 shutdown_connections 2024-09-19T09:00:13.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 --2- 172.21.15.49:0/2875312083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba01047a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 --2- 172.21.15.49:0/2875312083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbba00ffda0 0x7fbba0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 -- 172.21.15.49:0/2875312083 >> 172.21.15.49:0/2875312083 conn(0x7fbba00fb840 msgr2=0x7fbba00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 -- 172.21.15.49:0/2875312083 shutdown_connections 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 -- 172.21.15.49:0/2875312083 wait complete. 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.750+0000 7fbba551c640 1 Processor -- start 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbba551c640 1 -- start start 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbba551c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbba00ffda0 0x7fbba019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbba551c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbba551c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba019c480 con 0x7fbba0100750 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbba551c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0195a10 con 0x7fbba00ffda0 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbb9e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbb9e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba019be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45600/0 (socket says 172.21.15.49:45600) 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbb9e7fc640 1 -- 172.21.15.49:0/661452044 learned_addr learned my addr 172.21.15.49:0/661452044 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:13.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbb9effd640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbba00ffda0 0x7fbba019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbb9e7fc640 1 -- 172.21.15.49:0/661452044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbba00ffda0 msgr2=0x7fbba019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.751+0000 7fbb9e7fc640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbba00ffda0 0x7fbba019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.752+0000 7fbb9e7fc640 1 -- 172.21.15.49:0/661452044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94009560 con 0x7fbba0100750 2024-09-19T09:00:13.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.752+0000 7fbb9e7fc640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba019be60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbb9402a9c0 tx=0x7fbb940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.752+0000 7fbb87fff640 1 -- 172.21.15.49:0/661452044 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb94004aa0 con 0x7fbba0100750 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.752+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba0195c90 con 0x7fbba0100750 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.752+0000 7fbb87fff640 1 -- 172.21.15.49:0/661452044 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb94004c00 con 0x7fbba0100750 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.752+0000 7fbb87fff640 1 -- 172.21.15.49:0/661452044 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb94003a20 con 0x7fbba0100750 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.752+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba0196180 con 0x7fbba0100750 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.753+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba0101280 con 0x7fbba0100750 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.754+0000 7fbb87fff640 1 -- 172.21.15.49:0/661452044 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbb94031c90 con 0x7fbba0100750 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.754+0000 7fbb87fff640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbb8806cc50 0x7fbb8806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.754+0000 7fbb87fff640 1 -- 172.21.15.49:0/661452044 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbb940ad390 con 0x7fbba0100750 2024-09-19T09:00:13.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.754+0000 7fbb9effd640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbb8806cc50 0x7fbb8806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.755+0000 7fbb9effd640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbb8806cc50 0x7fbb8806f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009990 tx=0x7fbb90009110 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.759+0000 7fbb87fff640 1 -- 172.21.15.49:0/661452044 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbb94077700 con 0x7fbba0100750 2024-09-19T09:00:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.969+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbba0100200 con 0x7fbba0100750 2024-09-19T09:00:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.970+0000 7fbb87fff640 1 -- 172.21.15.49:0/661452044 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4859 (secure 0 0 0) 0x7fbb9407ad20 con 0x7fbba0100750 2024-09-19T09:00:13.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:13.971 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:00:03.165859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14488":{"gid":14488,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.49:6827/693842732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":693842732},{"type":"v1","addr":"172.21.15.49:6827","nonce":693842732}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi102.snrasw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6825/2151748213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2151748213},{"type":"v1","addr":"172.21.15.102:6825","nonce":2151748213}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24295":{"gid":24295,"name":"cephfs.smithi102.ojquyx","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.102:6827/4054567392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4054567392},{"type":"v1","addr":"172.21.15.102:6827","nonce":4054567392}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-19T09:00:13.971 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbb8806cc50 msgr2=0x7fbb8806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbb8806cc50 0x7fbb8806f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009990 tx=0x7fbb90009110 comp rx=0 tx=0).stop 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 msgr2=0x7fbba019be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba019be60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbb9402a9c0 tx=0x7fbb940055a0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 shutdown_connections 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbb8806cc50 0x7fbb8806f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbba0100750 0x7fbba019be60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 --2- 172.21.15.49:0/661452044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbba00ffda0 0x7fbba019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 >> 172.21.15.49:0/661452044 conn(0x7fbba00fb840 msgr2=0x7fbba00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 shutdown_connections 2024-09-19T09:00:13.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:13.972+0000 7fbba551c640 1 -- 172.21.15.49:0/661452044 wait complete. 2024-09-19T09:00:14.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:14.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:14.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:14.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:14.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:14 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:14.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:14 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/661452044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:14.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:14 smithi049 ceph-mon[28158]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:00:14.734 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 21, 'max_mds': 2, 'flags': 50} 2024-09-19T09:00:14.734 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T09:00:14.763 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T09:00:14.763 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-19T09:00:14.763 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-19T09:00:14.763 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:00:14.763 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:14.763 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-19T09:00:14.763 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:00:14.763 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:14.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:14.764 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-19T09:00:14.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:14.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:14.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:14.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:14.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:14 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:14.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:14 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/661452044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:14.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:14 smithi102 ceph-mon[35280]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T09:00:14.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:14.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-19T09:00:14.853 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-19T09:00:14.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:00:14.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:14.855 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-19T09:00:14.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:14.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-09-19T09:00:14.945 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-09-19T09:00:14.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:00:14.947 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T09:00:14.947 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T09:00:14.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:00:15.192 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 -- 172.21.15.49:0/2599973725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 msgr2=0x7f3968104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 --2- 172.21.15.49:0/2599973725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f3968104dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3960009880 tx=0x7f396002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 -- 172.21.15.49:0/2599973725 shutdown_connections 2024-09-19T09:00:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 --2- 172.21.15.49:0/2599973725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39680fe9f0 0x7f39680fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 --2- 172.21.15.49:0/2599973725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f3968104dd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 -- 172.21.15.49:0/2599973725 >> 172.21.15.49:0/2599973725 conn(0x7f39680758a0 msgr2=0x7f39680fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 -- 172.21.15.49:0/2599973725 shutdown_connections 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.707+0000 7f396fff1640 1 -- 172.21.15.49:0/2599973725 wait complete. 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396fff1640 1 Processor -- start 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396fff1640 1 -- start start 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396fff1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39680fe9f0 0x7f396819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396fff1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f396819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396fff1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396819c3c0 con 0x7f39681049f0 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396fff1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968195890 con 0x7f39680fe9f0 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396d58c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f396819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396d58c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f396819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45620/0 (socket says 172.21.15.49:45620) 2024-09-19T09:00:16.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396d58c640 1 -- 172.21.15.49:0/1858834307 learned_addr learned my addr 172.21.15.49:0/1858834307 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396dd8d640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39680fe9f0 0x7f396819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396d58c640 1 -- 172.21.15.49:0/1858834307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39680fe9f0 msgr2=0x7f396819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396d58c640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39680fe9f0 0x7f396819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.708+0000 7f396d58c640 1 -- 172.21.15.49:0/1858834307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960009560 con 0x7f39681049f0 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.709+0000 7f396d58c640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f396819bd70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f395c00cc60 tx=0x7f395c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.709+0000 7f3966ffd640 1 -- 172.21.15.49:0/1858834307 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c00f450 con 0x7f39681049f0 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.709+0000 7f3966ffd640 1 -- 172.21.15.49:0/1858834307 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f395c00fa70 con 0x7f39681049f0 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.709+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968195b70 con 0x7f39681049f0 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.709+0000 7f3966ffd640 1 -- 172.21.15.49:0/1858834307 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c018b80 con 0x7f39681049f0 2024-09-19T09:00:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.709+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3968196070 con 0x7f39681049f0 2024-09-19T09:00:16.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.710+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3968100130 con 0x7f39681049f0 2024-09-19T09:00:16.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.710+0000 7f3966ffd640 1 -- 172.21.15.49:0/1858834307 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f395c018d00 con 0x7f39681049f0 2024-09-19T09:00:16.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.711+0000 7f3966ffd640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f395006cc50 0x7f395006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:16.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.711+0000 7f3966ffd640 1 -- 172.21.15.49:0/1858834307 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f395c08c810 con 0x7f39681049f0 2024-09-19T09:00:16.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.711+0000 7f396dd8d640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f395006cc50 0x7f395006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:16.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.711+0000 7f396dd8d640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f395006cc50 0x7f395006f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3960000c00 tx=0x7f3960005a20 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:16.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.715+0000 7f3966ffd640 1 -- 172.21.15.49:0/1858834307 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f395c056b80 con 0x7f39681049f0 2024-09-19T09:00:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.924+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f396810bc60 con 0x7f39681049f0 2024-09-19T09:00:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.924+0000 7f3966ffd640 1 -- 172.21.15.49:0/1858834307 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+83 (secure 0 0 0) 0x7f395c05a1a0 con 0x7f39681049f0 2024-09-19T09:00:16.924 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-19T09:00:16.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f395006cc50 msgr2=0x7f395006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f395006cc50 0x7f395006f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3960000c00 tx=0x7f3960005a20 comp rx=0 tx=0).stop 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 msgr2=0x7f396819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f396819bd70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f395c00cc60 tx=0x7f395c00a620 comp rx=0 tx=0).stop 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 shutdown_connections 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f395006cc50 0x7f395006f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39681049f0 0x7f396819bd70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 --2- 172.21.15.49:0/1858834307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f39680fe9f0 0x7f396819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 >> 172.21.15.49:0/1858834307 conn(0x7f39680758a0 msgr2=0x7f3968067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 shutdown_connections 2024-09-19T09:00:16.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:16.926+0000 7f396fff1640 1 -- 172.21.15.49:0/1858834307 wait complete. 2024-09-19T09:00:17.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:17 smithi049 ceph-mon[28158]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T09:00:17.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:17 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1858834307' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:00:17.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:17.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:17 smithi102 ceph-mon[35280]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T09:00:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:17 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1858834307' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:00:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:17.543 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:00:17.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:00:17.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-09-19T09:00:17.543 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:00:17.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:17.543 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:00:17.544 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:00:17.544 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:00:17.544 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:00:17.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:17.544 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-09-19T09:00:17.561 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:00:17.561 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:00:17.561 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:00:17.561 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:17.561 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-09-19T09:00:17.561 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42271sec preferred_lft 42271sec 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-09-19T09:00:17.562 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:17.563 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:17.563 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:17.563 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-09-19T09:00:17.563 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:00:17.563 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:17.563 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-19T09:00:17.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:00:17.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-09-19T09:00:17.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-09-19T09:00:17.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:00:17.564 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-19T09:00:17.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:17.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:17.776 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:00:17.802 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-09-19T09:00:17.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:17.804 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-09-19T09:00:17.877 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-09-19T09:00:17.878 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:00:17.878 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:00:17.878 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:00:17.878 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:00:17.878 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:17.878 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-19T09:00:17.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:00:17.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:00:17.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:00:17.879 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-19T09:00:17.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:18.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:18.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:18.192 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-19T09:00:18.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:18.208 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-09-19T09:00:18.264 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:18.264 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-19T09:00:18.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:00:18.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:00:18.265 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-19T09:00:18.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:18.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:18.384 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:00:18.384 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:18.384 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-19T09:00:18.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:00:18.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:00:18.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:00:18.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:00:18.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:00:18.385 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-19T09:00:18.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:18.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:18.514 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:18.515 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-19T09:00:18.515 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-09-19T09:00:18.515 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:00:18.515 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-19T09:00:18.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:18.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:18.593 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T09:00:18.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:00:18.594 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:18.609 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:00:18.609 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:00:18.610 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:18.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-09-19T09:00:18.732 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:00:18.789 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-09-19T09:00:18.789 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-09-19T09:00:18.789 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:18.790 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:00:18.791 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/cddebf2f7ef11d8e755ad3f47e14d8515fec4e9446e9fe9be53f93ce28c26f5e/merged 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/256932ff495f62714ef127bb88467f5b7fd94d327b0545a798cb3c91b6c45ffa/merged 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/0 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/233c453fb1daf9dc73a5397beca235c6baa1c4dde3587e4b56608daa3ff0c438/merged 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/4e1e839bd3c81b8d315d5b1a5d7aaafacd6fadb8ae7d5a93d71ed1281ad7ad5d/merged 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/d18ebdc2ae38915af80dc22bd31407bafb3cb7d03a6b59777e6c23ee01429c79/merged 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/bcc2ce176efa0455da6f4cbc41ebfa79fac74017d2ed4409023b095ccd5420f5/merged 2024-09-19T09:00:18.792 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/b574c8a7d48ea16b46d5d75566622d9ea9c8c0139b41b3a92977ad9773c94500/merged 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/34303839e17544ada8e4e7387e3cfc97dd580466dd346dcc6b38129376cfc2c7/merged 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/79751fb12088be4e2e837a766fbad7fed7d48ab0eca48faabe047f44f97c4ec8/merged 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/4b626fd1e818b6fb9fd32ee8574d28a275eda2326b3e6f799dcce289e607f3b0/merged 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/b44185f44e1b0fbeb1e588a68e70bed8a9bc8aa05eaa19e7964e06621da1ef0c/merged 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/479d58faf1065c2dd535830a9f36519b340953a898761755c38196efcfcca640/merged 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/5fea51a87c2a5ace395eb057c64ec20d6a2d1d505af152e9fa5483b0e0eda22a/merged 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:00:18.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:18.794 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-09-19T09:00:18.845 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T09:00:18.845 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T09:00:18.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-09-19T09:00:18.913 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:00:18.970 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-09-19T09:00:18.970 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-09-19T09:00:18.970 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-09-19T09:00:18.970 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-09-19T09:00:18.970 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-09-19T09:00:18.970 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-09-19T09:00:18.971 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/cddebf2f7ef11d8e755ad3f47e14d8515fec4e9446e9fe9be53f93ce28c26f5e/merged 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/256932ff495f62714ef127bb88467f5b7fd94d327b0545a798cb3c91b6c45ffa/merged 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/0 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/233c453fb1daf9dc73a5397beca235c6baa1c4dde3587e4b56608daa3ff0c438/merged 2024-09-19T09:00:18.972 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/4e1e839bd3c81b8d315d5b1a5d7aaafacd6fadb8ae7d5a93d71ed1281ad7ad5d/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/d18ebdc2ae38915af80dc22bd31407bafb3cb7d03a6b59777e6c23ee01429c79/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/bcc2ce176efa0455da6f4cbc41ebfa79fac74017d2ed4409023b095ccd5420f5/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/b574c8a7d48ea16b46d5d75566622d9ea9c8c0139b41b3a92977ad9773c94500/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/34303839e17544ada8e4e7387e3cfc97dd580466dd346dcc6b38129376cfc2c7/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/79751fb12088be4e2e837a766fbad7fed7d48ab0eca48faabe047f44f97c4ec8/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/4b626fd1e818b6fb9fd32ee8574d28a275eda2326b3e6f799dcce289e607f3b0/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/b44185f44e1b0fbeb1e588a68e70bed8a9bc8aa05eaa19e7964e06621da1ef0c/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/479d58faf1065c2dd535830a9f36519b340953a898761755c38196efcfcca640/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/containers/storage/overlay/5fea51a87c2a5ace395eb057c64ec20d6a2d1d505af152e9fa5483b0e0eda22a/merged 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:00:18.973 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:00:18.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:18.974 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-09-19T09:00:18.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-09-19T09:00:18.991+0000 7f806820b480 -1 init, newargv = 0x55fc8221bdc0 newargc=15 2024-09-19T09:00:18.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[75896]: starting ceph client 2024-09-19T09:00:18.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[75896]: starting fuse 2024-09-19T09:00:19.007 INFO:teuthology.orchestra.run.smithi049.stdout:136 2024-09-19T09:00:19.007 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [136] 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T09:00:19.008 DEBUG:teuthology.orchestra.run.smithi049:> 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> 2024-09-19T09:00:19.009 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-09-19T09:00:19.010 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-09-19T09:00:19.127 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.75896.asok 2024-09-19T09:00:19.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:19.138 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75896.asok 2024-09-19T09:00:19.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:19.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75896.asok status 2024-09-19T09:00:19.275 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:00:19.275 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-09-19T09:00:19.275 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "75896", 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 14512, 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-09-19T09:00:19.276 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 14512 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1855694255 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:00:19.277 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1855694255 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.14512 192.168.0.1:0/1855694255", 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/1855694255", 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 21, 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 46, 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-09-19T09:00:19.278 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:00:19.284 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T09:00:19.284 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:00:19.491 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:19 smithi102 ceph-mon[35280]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T09:00:19.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:19 smithi049 ceph-mon[28158]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T09:00:21.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 -- 172.21.15.49:0/3673315182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0100c60 msgr2=0x7f34c0101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 --2- 172.21.15.49:0/3673315182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0100c60 0x7f34c0101040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009c50 tx=0x7f34b002a9a0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 -- 172.21.15.49:0/3673315182 shutdown_connections 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 --2- 172.21.15.49:0/3673315182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34c0101610 0x7f34c0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 --2- 172.21.15.49:0/3673315182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0100c60 0x7f34c0101040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 -- 172.21.15.49:0/3673315182 >> 172.21.15.49:0/3673315182 conn(0x7f34c00fa730 msgr2=0x7f34c00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 -- 172.21.15.49:0/3673315182 shutdown_connections 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.091+0000 7f34c8430640 1 -- 172.21.15.49:0/3673315182 wait complete. 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c8430640 1 Processor -- start 2024-09-19T09:00:21.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c8430640 1 -- start start 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c8430640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34c0100c60 0x7f34c019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c8430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0101610 0x7f34c019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c8430640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c019c2f0 con 0x7f34c0101610 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c8430640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0195910 con 0x7f34c0100c60 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c59cb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0101610 0x7f34c019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c59cb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0101610 0x7f34c019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40448/0 (socket says 172.21.15.49:40448) 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c59cb640 1 -- 172.21.15.49:0/2330846943 learned_addr learned my addr 172.21.15.49:0/2330846943 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.092+0000 7f34c61cc640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34c0100c60 0x7f34c019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34c59cb640 1 -- 172.21.15.49:0/2330846943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34c0100c60 msgr2=0x7f34c019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34c59cb640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34c0100c60 0x7f34c019b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34c59cb640 1 -- 172.21.15.49:0/2330846943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b0009900 con 0x7f34c0101610 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34c59cb640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0101610 0x7f34c019bd60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c8a0 tx=0x7f34b400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:21.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34bf7fe640 1 -- 172.21.15.49:0/2330846943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b4007b80 con 0x7f34c0101610 2024-09-19T09:00:21.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c0195bf0 con 0x7f34c0101610 2024-09-19T09:00:21.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34bf7fe640 1 -- 172.21.15.49:0/2330846943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34b4007ce0 con 0x7f34c0101610 2024-09-19T09:00:21.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34bf7fe640 1 -- 172.21.15.49:0/2330846943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b4018810 con 0x7f34c0101610 2024-09-19T09:00:21.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.093+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c0196140 con 0x7f34c0101610 2024-09-19T09:00:21.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.094+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c0068d30 con 0x7f34c0101610 2024-09-19T09:00:21.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.095+0000 7f34bf7fe640 1 -- 172.21.15.49:0/2330846943 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f34b4018a80 con 0x7f34c0101610 2024-09-19T09:00:21.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.095+0000 7f34bf7fe640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f34a806cc50 0x7f34a806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:21.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.095+0000 7f34bf7fe640 1 -- 172.21.15.49:0/2330846943 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f34b408c3a0 con 0x7f34c0101610 2024-09-19T09:00:21.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.095+0000 7f34c61cc640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f34a806cc50 0x7f34a806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:21.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.096+0000 7f34c61cc640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f34a806cc50 0x7f34a806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34b0000f80 tx=0x7f34b003d040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:21.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.100+0000 7f34bf7fe640 1 -- 172.21.15.49:0/2330846943 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f34b4056710 con 0x7f34c0101610 2024-09-19T09:00:21.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.312+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34c0101040 con 0x7f34c0101610 2024-09-19T09:00:21.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.312+0000 7f34bf7fe640 1 -- 172.21.15.49:0/2330846943 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+83 (secure 0 0 0) 0x7f34b4059d30 con 0x7f34c0101610 2024-09-19T09:00:21.312 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-19T09:00:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f34a806cc50 msgr2=0x7f34a806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f34a806cc50 0x7f34a806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34b0000f80 tx=0x7f34b003d040 comp rx=0 tx=0).stop 2024-09-19T09:00:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0101610 msgr2=0x7f34c019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0101610 0x7f34c019bd60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c8a0 tx=0x7f34b400cd60 comp rx=0 tx=0).stop 2024-09-19T09:00:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 shutdown_connections 2024-09-19T09:00:21.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f34a806cc50 0x7f34a806f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34c0101610 0x7f34c019bd60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 --2- 172.21.15.49:0/2330846943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34c0100c60 0x7f34c019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.314+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 >> 172.21.15.49:0/2330846943 conn(0x7f34c00fa730 msgr2=0x7f34c0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.315+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 shutdown_connections 2024-09-19T09:00:21.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:21.315+0000 7f34c8430640 1 -- 172.21.15.49:0/2330846943 wait complete. 2024-09-19T09:00:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:21 smithi102 ceph-mon[35280]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T09:00:21.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:21 smithi049 ceph-mon[28158]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:00:22.002 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:00:22.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:22.003 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-19T09:00:22.022 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42209sec preferred_lft 42209sec 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-19T09:00:22.023 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:00:22.023 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:00:22.024 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:22.024 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-19T09:00:22.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:00:22.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-09-19T09:00:22.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-09-19T09:00:22.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:00:22.024 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-19T09:00:22.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:22.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:22.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:22.244 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:00:22.269 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-19T09:00:22.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:22.271 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-19T09:00:22.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:22 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2330846943' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:00:22.346 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-19T09:00:22.346 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:00:22.346 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:00:22.346 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:00:22.347 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:00:22.347 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:22.347 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-19T09:00:22.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:00:22.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:00:22.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:00:22.347 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-19T09:00:22.409 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:22 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2330846943' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:00:22.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:22.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:22.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:22.670 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-19T09:00:22.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:22.726 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-09-19T09:00:22.782 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:22.783 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-19T09:00:22.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:00:22.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-19T09:00:22.783 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-19T09:00:22.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:22.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:22.901 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-19T09:00:22.901 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:22.901 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-19T09:00:22.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-19T09:00:22.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:00:22.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-19T09:00:22.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-19T09:00:22.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-19T09:00:22.902 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-19T09:00:22.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:23.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:23.055 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:00:23.055 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-19T09:00:23.055 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-19T09:00:23.055 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:00:23.055 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-19T09:00:23.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:00:23.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:23.131 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-19T09:00:23.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:00:23.132 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:23.146 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:00:23.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:00:23.147 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:23.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-09-19T09:00:23.270 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:00:23.327 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2024-09-19T09:00:23.327 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/selinux 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2024-09-19T09:00:23.328 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/0 2024-09-19T09:00:23.329 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/af8685ceb2d4708dd29ba89477fe4aa7cc07099578bb88e4dab5ec22162bb52b/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/d28547270a32042f600c60eaf1d667fc2a0f812b60d2b78ee9b6aff6cb145073/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/8978da06240ceb8c43daed3cf04398adf0e3abd54e10b5c78b1e79d770b6d03e/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/96ab6cf13cc1edaad9ba44dab65c75f007e8590cdad7e97f2192c52251970f27/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/692d6893efd5639b5de1cd54696ac66f6e0a7ad717cb4a469c455bbf47426928/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/7fdede41bf92053b84d0106a11c863cc146c8ece697f2c3a3aa94a11f1c261bb/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/fc2e60dd131b7c8b52625c3f8d98aebea20102b446b98bc7275abcb06927dc85/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/41f3a786ebb6cb1bc762d381a00778559d7f4ca69f925d1bf3627d4c352b5cba/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/4bf8b7b40b7bbae956da22e54156c7d6e4cd629cafbec1c0c5eae13400e9f487/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/e5a96e5bfe5695758cbd5907f7a072636a9969ffb1a513beaeaa1bc1c8223ed1/merged 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2024-09-19T09:00:23.330 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:00:23.331 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:00:23.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:23.331 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-09-19T09:00:23.382 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T09:00:23.383 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-19T09:00:23.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-09-19T09:00:23.443 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:23 smithi102 ceph-mon[35280]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-19T09:00:23.449 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T09:00:23.506 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2024-09-19T09:00:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/selinux 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2024-09-19T09:00:23.508 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/0 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/af8685ceb2d4708dd29ba89477fe4aa7cc07099578bb88e4dab5ec22162bb52b/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/d28547270a32042f600c60eaf1d667fc2a0f812b60d2b78ee9b6aff6cb145073/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/8978da06240ceb8c43daed3cf04398adf0e3abd54e10b5c78b1e79d770b6d03e/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/96ab6cf13cc1edaad9ba44dab65c75f007e8590cdad7e97f2192c52251970f27/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/692d6893efd5639b5de1cd54696ac66f6e0a7ad717cb4a469c455bbf47426928/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/7fdede41bf92053b84d0106a11c863cc146c8ece697f2c3a3aa94a11f1c261bb/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/fc2e60dd131b7c8b52625c3f8d98aebea20102b446b98bc7275abcb06927dc85/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/41f3a786ebb6cb1bc762d381a00778559d7f4ca69f925d1bf3627d4c352b5cba/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/4bf8b7b40b7bbae956da22e54156c7d6e4cd629cafbec1c0c5eae13400e9f487/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/containers/storage/overlay/e5a96e5bfe5695758cbd5907f7a072636a9969ffb1a513beaeaa1bc1c8223ed1/merged 2024-09-19T09:00:23.509 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2024-09-19T09:00:23.510 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:00:23.510 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:00:23.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:23.510 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-09-19T09:00:23.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi102.stderr:2024-09-19T09:00:23.535+0000 7f14c41eb480 -1 init, newargv = 0x56047f809e40 newargc=15 2024-09-19T09:00:23.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi102.stderr:ceph-fuse[61248]: starting ceph client 2024-09-19T09:00:23.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi102.stderr:ceph-fuse[61248]: starting fuse 2024-09-19T09:00:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:23 smithi049 ceph-mon[28158]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-19T09:00:23.553 INFO:teuthology.orchestra.run.smithi102.stdout:129 2024-09-19T09:00:23.553 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-19T09:00:23.553 DEBUG:teuthology.orchestra.run.smithi102:> sudo stdin-killer -- python3 -c ' 2024-09-19T09:00:23.553 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2024-09-19T09:00:23.553 DEBUG:teuthology.orchestra.run.smithi102:> import re 2024-09-19T09:00:23.553 DEBUG:teuthology.orchestra.run.smithi102:> import os 2024-09-19T09:00:23.553 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2024-09-19T09:00:23.553 DEBUG:teuthology.orchestra.run.smithi102:> 2024-09-19T09:00:23.553 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T09:00:23.554 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2024-09-19T09:00:23.555 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2024-09-19T09:00:23.555 DEBUG:teuthology.orchestra.run.smithi102:> return f 2024-09-19T09:00:23.555 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T09:00:23.555 DEBUG:teuthology.orchestra.run.smithi102:> 2024-09-19T09:00:23.555 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.1")) 2024-09-19T09:00:23.555 DEBUG:teuthology.orchestra.run.smithi102:> ' 2024-09-19T09:00:23.670 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.1.61248.asok 2024-09-19T09:00:23.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T09:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:00:23.681 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61248.asok 2024-09-19T09:00:23.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:23.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61248.asok status 2024-09-19T09:00:23.813 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-19T09:00:23.813 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "1", 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "61248", 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 24329, 2024-09-19T09:00:23.814 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 24329 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3002433656 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-19T09:00:23.815 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3002433656 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.24329 192.168.0.1:0/3002433656", 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.1:0/3002433656", 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 21, 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 46, 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2024-09-19T09:00:23.816 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-19T09:00:23.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:23.821 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-09-19T09:00:23.821 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:23.844 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-09-19T09:00:23.844 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:23.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:23.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:23.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:23.920 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2024-09-19T09:00:23.920 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:23.936 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2024-09-19T09:00:23.936 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:23.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:00:23.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:24.243 INFO:teuthology.run_tasks:Running task print... 2024-09-19T09:00:24.254 INFO:teuthology.task.print:**** done client 2024-09-19T09:00:24.254 INFO:teuthology.run_tasks:Running task parallel... 2024-09-19T09:00:24.300 INFO:teuthology.task.parallel:starting parallel... 2024-09-19T09:00:24.300 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-19T09:00:24.301 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T09:00:24.302 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T09:00:24.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-19T09:00:24.304 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-19T09:00:24.304 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-19T09:00:24.309 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:00:24.310 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:00:24.310 INFO:tasks.workunit:timeout=3h 2024-09-19T09:00:24.310 INFO:tasks.workunit:cleanup=True 2024-09-19T09:00:24.310 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:24.331 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T09:00:24.331 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 88h/136d Inode: 1 Links: 2 2024-09-19T09:00:24.331 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:00:24.331 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T09:00:24.331 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T09:00:24.331 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-19 08:59:48.104946264 +0000 2024-09-19T09:00:24.332 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-19 09:00:23.917365471 +0000 2024-09-19T09:00:24.332 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-09-19T09:00:24.332 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:00:24.332 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:00:24.403 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 09:00:24.398745457 +0000 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 09:00:24.398745457 +0000 2024-09-19T09:00:24.421 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-19T09:00:24.421 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-19T09:00:24.422 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-19T09:00:24.491 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:00:24.492 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:00:24.509 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:00:24.531 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:24.546 INFO:tasks.workunit.client.1.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-19T09:00:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:25 smithi049 ceph-mon[28158]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T09:00:25.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:25 smithi102 ceph-mon[35280]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 -- 172.21.15.49:0/3639320042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 msgr2=0x7f9040103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 --2- 172.21.15.49:0/3639320042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040103410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9030009c20 tx=0x7f903002a970 comp rx=0 tx=0).stop 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 -- 172.21.15.49:0/3639320042 shutdown_connections 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 --2- 172.21.15.49:0/3639320042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040103410 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 --2- 172.21.15.49:0/3639320042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040101d90 0x7f9040102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 -- 172.21.15.49:0/3639320042 >> 172.21.15.49:0/3639320042 conn(0x7f90400fd540 msgr2=0x7f90400ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 -- 172.21.15.49:0/3639320042 shutdown_connections 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 -- 172.21.15.49:0/3639320042 wait complete. 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.035+0000 7f9046cdc640 1 Processor -- start 2024-09-19T09:00:26.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f9046cdc640 1 -- start start 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f9046cdc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040101d90 0x7f9040197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f9046cdc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f9046cdc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040198350 con 0x7f9040102f90 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f9046cdc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90401984c0 con 0x7f9040101d90 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f903ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f903ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40478/0 (socket says 172.21.15.49:40478) 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f903ffff640 1 -- 172.21.15.49:0/2347290124 learned_addr learned my addr 172.21.15.49:0/2347290124 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f9044a78640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040101d90 0x7f9040197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f903ffff640 1 -- 172.21.15.49:0/2347290124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040101d90 msgr2=0x7f9040197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f903ffff640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040101d90 0x7f9040197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f903ffff640 1 -- 172.21.15.49:0/2347290124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009900 con 0x7f9040102f90 2024-09-19T09:00:26.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.036+0000 7f903ffff640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040197d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9030009d40 tx=0x7f903002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.037+0000 7f903dffb640 1 -- 172.21.15.49:0/2347290124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9030030840 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.037+0000 7f903dffb640 1 -- 172.21.15.49:0/2347290124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f903002fa20 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.037+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904019ceb0 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.037+0000 7f903dffb640 1 -- 172.21.15.49:0/2347290124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f903003a660 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.037+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904019d3f0 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.038+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9040102190 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.038+0000 7f903dffb640 1 -- 172.21.15.49:0/2347290124 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f903000a040 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.039+0000 7f903dffb640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f902c06cc50 0x7f902c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.039+0000 7f903dffb640 1 -- 172.21.15.49:0/2347290124 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f903002c040 con 0x7f9040102f90 2024-09-19T09:00:26.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.039+0000 7f9044a78640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f902c06cc50 0x7f902c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:26.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.039+0000 7f9044a78640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f902c06cc50 0x7f902c06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9028005fd0 tx=0x7f902800b390 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:26.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.043+0000 7f903dffb640 1 -- 172.21.15.49:0/2347290124 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9030077d60 con 0x7f9040102f90 2024-09-19T09:00:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.216+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f904010abd0 con 0x7f9040102f90 2024-09-19T09:00:26.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.220+0000 7f903dffb640 1 -- 172.21.15.49:0/2347290124 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v26)=0 v26) v1 ==== 126+0+0 (secure 0 0 0) 0x7f903007b380 con 0x7f9040102f90 2024-09-19T09:00:26.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.222+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f902c06cc50 msgr2=0x7f902c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:26.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.222+0000 7f9046cdc640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f902c06cc50 0x7f902c06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9028005fd0 tx=0x7f902800b390 comp rx=0 tx=0).stop 2024-09-19T09:00:26.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.222+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 msgr2=0x7f9040197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:26.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.222+0000 7f9046cdc640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040197d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9030009d40 tx=0x7f903002f5f0 comp rx=0 tx=0).stop 2024-09-19T09:00:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.223+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 shutdown_connections 2024-09-19T09:00:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.223+0000 7f9046cdc640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f902c06cc50 0x7f902c06f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.223+0000 7f9046cdc640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9040102f90 0x7f9040197d80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.223+0000 7f9046cdc640 1 --2- 172.21.15.49:0/2347290124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9040101d90 0x7f9040197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.223+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 >> 172.21.15.49:0/2347290124 conn(0x7f90400fd540 msgr2=0x7f9040106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.223+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 shutdown_connections 2024-09-19T09:00:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:26.223+0000 7f9046cdc640 1 -- 172.21.15.49:0/2347290124 wait complete. 2024-09-19T09:00:26.882 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T09:00:26.882 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T09:00:26.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-19T09:00:27.131 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:27.497 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:27 smithi049 ceph-mon[28158]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T09:00:27.498 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:27 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2347290124' entity='client.admin' 2024-09-19T09:00:27.498 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:27.498 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:27.498 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:27.498 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:27 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:27 smithi102 ceph-mon[35280]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T09:00:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:27 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2347290124' entity='client.admin' 2024-09-19T09:00:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:27 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:28.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/2694203896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101b50 msgr2=0x7ff3b00fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:28.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/2694203896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101b50 0x7ff3b00fdc20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009880 tx=0x7ff3a402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/2694203896 shutdown_connections 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/2694203896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101b50 0x7ff3b00fdc20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/2694203896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3b0101180 0x7ff3b0101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/2694203896 >> 172.21.15.49:0/2694203896 conn(0x7ff3b00f99b0 msgr2=0x7ff3b00fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/2694203896 shutdown_connections 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.726+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/2694203896 wait complete. 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3b5bc5640 1 Processor -- start 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3b5bc5640 1 -- start start 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3b5bc5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101180 0x7ff3b0195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:28.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3b5bc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3b0101b50 0x7ff3b0195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3b5bc5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0196110 con 0x7ff3b0101180 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3b5bc5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0196280 con 0x7ff3b0101b50 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101180 0x7ff3b0195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101180 0x7ff3b0195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40502/0 (socket says 172.21.15.49:40502) 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.727+0000 7ff3af7fe640 1 -- 172.21.15.49:0/1351578592 learned_addr learned my addr 172.21.15.49:0/1351578592 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3aeffd640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3b0101b50 0x7ff3b0195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3af7fe640 1 -- 172.21.15.49:0/1351578592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3b0101b50 msgr2=0x7ff3b0195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3af7fe640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3b0101b50 0x7ff3b0195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3af7fe640 1 -- 172.21.15.49:0/1351578592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4009560 con 0x7ff3b0101180 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3aeffd640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3b0101b50 0x7ff3b0195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3af7fe640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101180 0x7ff3b0195690 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c8f0 tx=0x7ff3a000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3acff9640 1 -- 172.21.15.49:0/1351578592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a00041f0 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3acff9640 1 -- 172.21.15.49:0/1351578592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3a0007e10 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b019ad60 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3acff9640 1 -- 172.21.15.49:0/1351578592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a000f450 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.728+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b019b280 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.729+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b018f730 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.730+0000 7ff3acff9640 1 -- 172.21.15.49:0/1351578592 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff3a0007950 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.730+0000 7ff3acff9640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff39806cc50 0x7ff39806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.730+0000 7ff3aeffd640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff39806cc50 0x7ff39806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.730+0000 7ff3acff9640 1 -- 172.21.15.49:0/1351578592 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff3a0013070 con 0x7ff3b0101180 2024-09-19T09:00:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.731+0000 7ff3aeffd640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff39806cc50 0x7ff39806f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4000c00 tx=0x7ff3a4005d50 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.735+0000 7ff3acff9640 1 -- 172.21.15.49:0/1351578592 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3a0056720 con 0x7ff3b0101180 2024-09-19T09:00:28.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.906+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7ff3b01087a0 con 0x7ff3b0101180 2024-09-19T09:00:28.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.906+0000 7ff3acff9640 1 -- 172.21.15.49:0/1351578592 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v26)=0 v26) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff3a0059d40 con 0x7ff3b0101180 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff39806cc50 msgr2=0x7ff39806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff39806cc50 0x7ff39806f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4000c00 tx=0x7ff3a4005d50 comp rx=0 tx=0).stop 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101180 msgr2=0x7ff3b0195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101180 0x7ff3b0195690 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c8f0 tx=0x7ff3a000cdb0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 shutdown_connections 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7ff39806cc50 0x7ff39806f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3b0101b50 0x7ff3b0195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 --2- 172.21.15.49:0/1351578592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3b0101180 0x7ff3b0195690 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:28.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 >> 172.21.15.49:0/1351578592 conn(0x7ff3b00f99b0 msgr2=0x7ff3b01045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:28.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 shutdown_connections 2024-09-19T09:00:28.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:28.908+0000 7ff3b5bc5640 1 -- 172.21.15.49:0/1351578592 wait complete. 2024-09-19T09:00:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:29 smithi102 ceph-mon[35280]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-19T09:00:29.526 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:29 smithi049 ceph-mon[28158]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-19T09:00:29.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-19T09:00:29.767 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:31.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 -- 172.21.15.49:0/2921933266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 msgr2=0x7f1f34102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/2921933266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f34102a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0098b0 tx=0x7f1f2c02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 -- 172.21.15.49:0/2921933266 shutdown_connections 2024-09-19T09:00:31.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/2921933266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f34102f60 0x7f1f34105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/2921933266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f34102a20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 -- 172.21.15.49:0/2921933266 >> 172.21.15.49:0/2921933266 conn(0x7f1f340fa250 msgr2=0x7f1f340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:31.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 -- 172.21.15.49:0/2921933266 shutdown_connections 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 -- 172.21.15.49:0/2921933266 wait complete. 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 Processor -- start 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.408+0000 7f1f3b33b640 1 -- start start 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f3b33b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f340fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f3b33b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f34102f60 0x7f1f340fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f3b33b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340feb20 con 0x7f1f34100630 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f3b33b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340fec90 con 0x7f1f34102f60 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f390d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f340fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f390d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f340fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53354/0 (socket says 172.21.15.49:53354) 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f390d7640 1 -- 172.21.15.49:0/4006977803 learned_addr learned my addr 172.21.15.49:0/4006977803 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f388d6640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f34102f60 0x7f1f340fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f390d7640 1 -- 172.21.15.49:0/4006977803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f34102f60 msgr2=0x7f1f340fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f390d7640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f34102f60 0x7f1f340fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f390d7640 1 -- 172.21.15.49:0/4006977803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c009560 con 0x7f1f34100630 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f390d7640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f340fff90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c006010 tx=0x7f1f2c005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f327fc640 1 -- 172.21.15.49:0/4006977803 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2c004b20 con 0x7f1f34100630 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f327fc640 1 -- 172.21.15.49:0/4006977803 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f2c004c80 con 0x7f1f34100630 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f340fef10 con 0x7f1f34100630 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.409+0000 7f1f327fc640 1 -- 172.21.15.49:0/4006977803 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2c003bf0 con 0x7f1f34100630 2024-09-19T09:00:31.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.410+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3419d7a0 con 0x7f1f34100630 2024-09-19T09:00:31.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.411+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f34108830 con 0x7f1f34100630 2024-09-19T09:00:31.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.411+0000 7f1f327fc640 1 -- 172.21.15.49:0/4006977803 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1f2c031640 con 0x7f1f34100630 2024-09-19T09:00:31.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.412+0000 7f1f327fc640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f1f1c06cc50 0x7f1f1c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.412+0000 7f1f327fc640 1 -- 172.21.15.49:0/4006977803 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1f2c0ad420 con 0x7f1f34100630 2024-09-19T09:00:31.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.412+0000 7f1f388d6640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f1f1c06cc50 0x7f1f1c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.412+0000 7f1f388d6640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f1f1c06cc50 0x7f1f1c06f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1f340ffd10 tx=0x7f1f2800d040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.416+0000 7f1f327fc640 1 -- 172.21.15.49:0/4006977803 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1f2c077840 con 0x7f1f34100630 2024-09-19T09:00:31.416 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:31 smithi049 ceph-mon[28158]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:00:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:31 smithi102 ceph-mon[35280]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:00:31.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.589+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f1f3419d930 con 0x7f1f34100630 2024-09-19T09:00:31.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.590+0000 7f1f327fc640 1 -- 172.21.15.49:0/4006977803 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v26)=0 v26) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1f2c07ae60 con 0x7f1f34100630 2024-09-19T09:00:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f1f1c06cc50 msgr2=0x7f1f1c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f1f1c06cc50 0x7f1f1c06f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1f340ffd10 tx=0x7f1f2800d040 comp rx=0 tx=0).stop 2024-09-19T09:00:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 msgr2=0x7f1f340fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f340fff90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c006010 tx=0x7f1f2c005610 comp rx=0 tx=0).stop 2024-09-19T09:00:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 shutdown_connections 2024-09-19T09:00:31.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f1f1c06cc50 0x7f1f1c06f110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f34102f60 0x7f1f340fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 --2- 172.21.15.49:0/4006977803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f34100630 0x7f1f340fff90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 >> 172.21.15.49:0/4006977803 conn(0x7f1f340fa250 msgr2=0x7f1f340fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 shutdown_connections 2024-09-19T09:00:31.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:31.592+0000 7f1f3b33b640 1 -- 172.21.15.49:0/4006977803 wait complete. 2024-09-19T09:00:32.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-19T09:00:32.430 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:32.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:33.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:33 smithi102 ceph-mon[35280]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:00:33.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:33 smithi049 ceph-mon[28158]: pgmap v199: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:00:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.172+0000 7f8be1a21640 1 -- 172.21.15.49:0/4215452768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 msgr2=0x7f8bdc0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:34.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.172+0000 7f8be1a21640 1 --2- 172.21.15.49:0/4215452768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc0feea0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009880 tx=0x7f8bcc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.172+0000 7f8be1a21640 1 -- 172.21.15.49:0/4215452768 shutdown_connections 2024-09-19T09:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.172+0000 7f8be1a21640 1 --2- 172.21.15.49:0/4215452768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bdc0ffca0 0x7f8bdc100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.172+0000 7f8be1a21640 1 --2- 172.21.15.49:0/4215452768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc0feea0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.172+0000 7f8be1a21640 1 -- 172.21.15.49:0/4215452768 >> 172.21.15.49:0/4215452768 conn(0x7f8bdc0fa250 msgr2=0x7f8bdc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 -- 172.21.15.49:0/4215452768 shutdown_connections 2024-09-19T09:00:34.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 -- 172.21.15.49:0/4215452768 wait complete. 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 Processor -- start 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 -- start start 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bdc0ffca0 0x7f8bdc101500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc1033f0 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.173+0000 7f8be1a21640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc101a70 con 0x7f8bdc0ffca0 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bdaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bdaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc102eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53376/0 (socket says 172.21.15.49:53376) 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bdaffd640 1 -- 172.21.15.49:0/548972092 learned_addr learned my addr 172.21.15.49:0/548972092 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bda7fc640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bdc0ffca0 0x7f8bdc101500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bdaffd640 1 -- 172.21.15.49:0/548972092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bdc0ffca0 msgr2=0x7f8bdc101500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:34.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bdaffd640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bdc0ffca0 0x7f8bdc101500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bdaffd640 1 -- 172.21.15.49:0/548972092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009560 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bda7fc640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bdc0ffca0 0x7f8bdc101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8bdaffd640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc102eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc02a9c0 tx=0x7f8bcc005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8be0a1f640 1 -- 172.21.15.49:0/548972092 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bcc004b20 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8be0a1f640 1 -- 172.21.15.49:0/548972092 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bcc004c80 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc101cf0 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8be0a1f640 1 -- 172.21.15.49:0/548972092 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bcc003b80 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.174+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc102260 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.175+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc107690 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.176+0000 7f8be0a1f640 1 -- 172.21.15.49:0/548972092 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8bcc031640 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.176+0000 7f8be0a1f640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8bc406cc50 0x7f8bc406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:34.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.176+0000 7f8bda7fc640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8bc406cc50 0x7f8bc406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:34.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.176+0000 7f8be0a1f640 1 -- 172.21.15.49:0/548972092 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8bcc0ad530 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.177+0000 7f8bda7fc640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8bc406cc50 0x7f8bc406f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc102c30 tx=0x7f8bd000a5c0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:34.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.181+0000 7f8be0a1f640 1 -- 172.21.15.49:0/548972092 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8bcc0778a0 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.357+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f8bdc107820 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.358+0000 7f8be0a1f640 1 -- 172.21.15.49:0/548972092 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v26)=0 v26) v1 ==== 135+0+0 (secure 0 0 0) 0x7f8bcc077030 con 0x7f8bdc0feaa0 2024-09-19T09:00:34.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8bc406cc50 msgr2=0x7f8bc406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8bc406cc50 0x7f8bc406f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc102c30 tx=0x7f8bd000a5c0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 msgr2=0x7f8bdc102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc102eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc02a9c0 tx=0x7f8bcc005610 comp rx=0 tx=0).stop 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 shutdown_connections 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f8bc406cc50 0x7f8bc406f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bdc0ffca0 0x7f8bdc101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 --2- 172.21.15.49:0/548972092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bdc0feaa0 0x7f8bdc102eb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 >> 172.21.15.49:0/548972092 conn(0x7f8bdc0fa250 msgr2=0x7f8bdc068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 shutdown_connections 2024-09-19T09:00:34.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:34.360+0000 7f8be1a21640 1 -- 172.21.15.49:0/548972092 wait complete. 2024-09-19T09:00:35.003 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-19T09:00:35.222 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:35.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:35 smithi049 ceph-mon[28158]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:00:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:35 smithi102 ceph-mon[35280]: pgmap v200: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 -- 172.21.15.49:0/7720962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80ffcf0 msgr2=0x7fa7d8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 --2- 172.21.15.49:0/7720962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80ffcf0 0x7fa7d8100170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009880 tx=0x7fa7cc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 -- 172.21.15.49:0/7720962 shutdown_connections 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 --2- 172.21.15.49:0/7720962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80ffcf0 0x7fa7d8100170 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 --2- 172.21.15.49:0/7720962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7d80feaf0 0x7fa7d80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 -- 172.21.15.49:0/7720962 >> 172.21.15.49:0/7720962 conn(0x7fa7d80fa280 msgr2=0x7fa7d80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 -- 172.21.15.49:0/7720962 shutdown_connections 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:36.999+0000 7fa7dca48640 1 -- 172.21.15.49:0/7720962 wait complete. 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7dca48640 1 Processor -- start 2024-09-19T09:00:37.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7dca48640 1 -- start start 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7dca48640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80feaf0 0x7fa7d81956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7dca48640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7d80ffcf0 0x7fa7d8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7dca48640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8196200 con 0x7fa7d80feaf0 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7dca48640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8196370 con 0x7fa7d80ffcf0 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7d659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80feaf0 0x7fa7d81956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7d659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80feaf0 0x7fa7d81956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53386/0 (socket says 172.21.15.49:53386) 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.000+0000 7fa7d659c640 1 -- 172.21.15.49:0/3284296785 learned_addr learned my addr 172.21.15.49:0/3284296785 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7d5d9b640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7d80ffcf0 0x7fa7d8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7d659c640 1 -- 172.21.15.49:0/3284296785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7d80ffcf0 msgr2=0x7fa7d8195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7d659c640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7d80ffcf0 0x7fa7d8195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7d659c640 1 -- 172.21.15.49:0/3284296785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc009560 con 0x7fa7d80feaf0 2024-09-19T09:00:37.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7d5d9b640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7d80ffcf0 0x7fa7d8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:37.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7d659c640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80feaf0 0x7fa7d81956f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800d720 tx=0x7fa7c800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:37.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7c77fe640 1 -- 172.21.15.49:0/3284296785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7c80041f0 con 0x7fa7d80feaf0 2024-09-19T09:00:37.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7c77fe640 1 -- 172.21.15.49:0/3284296785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7c8004350 con 0x7fa7d80feaf0 2024-09-19T09:00:37.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d819ae10 con 0x7fa7d80feaf0 2024-09-19T09:00:37.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7c77fe640 1 -- 172.21.15.49:0/3284296785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7c8003df0 con 0x7fa7d80feaf0 2024-09-19T09:00:37.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.001+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d819b2d0 con 0x7fa7d80feaf0 2024-09-19T09:00:37.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.002+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d80feef0 con 0x7fa7d80feaf0 2024-09-19T09:00:37.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.003+0000 7fa7c77fe640 1 -- 172.21.15.49:0/3284296785 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa7c8010460 con 0x7fa7d80feaf0 2024-09-19T09:00:37.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.003+0000 7fa7c77fe640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa7c006cc50 0x7fa7c006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:37.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.003+0000 7fa7c77fe640 1 -- 172.21.15.49:0/3284296785 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa7c808bc20 con 0x7fa7d80feaf0 2024-09-19T09:00:37.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.003+0000 7fa7d5d9b640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa7c006cc50 0x7fa7c006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:37.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.004+0000 7fa7d5d9b640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa7c006cc50 0x7fa7c006f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc000c00 tx=0x7fa7cc005a20 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:37.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.008+0000 7fa7c77fe640 1 -- 172.21.15.49:0/3284296785 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa7c8056080 con 0x7fa7d80feaf0 2024-09-19T09:00:37.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.194+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7d8068470 con 0x7fa7c006cc50 2024-09-19T09:00:37.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.199+0000 7fa7c77fe640 1 -- 172.21.15.49:0/3284296785 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fa7d8068470 con 0x7fa7c006cc50 2024-09-19T09:00:37.200 INFO:teuthology.orchestra.run.smithi049.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa7c006cc50 msgr2=0x7fa7c006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa7c006cc50 0x7fa7c006f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc000c00 tx=0x7fa7cc005a20 comp rx=0 tx=0).stop 2024-09-19T09:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80feaf0 msgr2=0x7fa7d81956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:37.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80feaf0 0x7fa7d81956f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800d720 tx=0x7fa7c800dbe0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 shutdown_connections 2024-09-19T09:00:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa7c006cc50 0x7fa7c006f110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7d80ffcf0 0x7fa7d8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 --2- 172.21.15.49:0/3284296785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7d80feaf0 0x7fa7d81956f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 >> 172.21.15.49:0/3284296785 conn(0x7fa7d80fa280 msgr2=0x7fa7d8067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 shutdown_connections 2024-09-19T09:00:37.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:37.202+0000 7fa7dca48640 1 -- 172.21.15.49:0/3284296785 wait complete. 2024-09-19T09:00:37.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:37 smithi102 ceph-mon[35280]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-19T09:00:37.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:37 smithi049 ceph-mon[28158]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-19T09:00:37.845 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T09:00:37.846 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T09:00:37.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-19T09:00:38.077 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:00:38.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:38 smithi049 ceph-mon[28158]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:38.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:38 smithi049 ceph-mon[28158]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:00:38.467 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:38.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:38.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:38.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:38.468 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:38 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:38 smithi102 ceph-mon[35280]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:38 smithi102 ceph-mon[35280]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:00:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:38.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:38.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:38 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:00:39.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:39 smithi049 ceph-mon[28158]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:00:39.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:39 smithi049 ceph-mon[28158]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-19T09:00:39.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:39 smithi102 ceph-mon[35280]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:00:39.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:39 smithi102 ceph-mon[35280]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-19T09:00:40.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 -- 172.21.15.49:0/960981862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244103070 msgr2=0x7f8244105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 --2- 172.21.15.49:0/960981862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244103070 0x7f8244105460 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8238009880 tx=0x7f823802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 -- 172.21.15.49:0/960981862 shutdown_connections 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 --2- 172.21.15.49:0/960981862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244103070 0x7f8244105460 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 --2- 172.21.15.49:0/960981862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8244100740 0x7f8244102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 -- 172.21.15.49:0/960981862 >> 172.21.15.49:0/960981862 conn(0x7f82440fa280 msgr2=0x7f82440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 -- 172.21.15.49:0/960981862 shutdown_connections 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.985+0000 7f824a2ec640 1 -- 172.21.15.49:0/960981862 wait complete. 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f824a2ec640 1 Processor -- start 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f824a2ec640 1 -- start start 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f824a2ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244100740 0x7f8244195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f824a2ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8244103070 0x7f8244195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f824a2ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82441961a0 con 0x7f8244100740 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f824a2ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244196310 con 0x7f8244103070 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f8243fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244100740 0x7f8244195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f8243fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244100740 0x7f8244195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53412/0 (socket says 172.21.15.49:53412) 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.986+0000 7f8243fff640 1 -- 172.21.15.49:0/1059289412 learned_addr learned my addr 172.21.15.49:0/1059289412 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f82437fe640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8244103070 0x7f8244195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f8243fff640 1 -- 172.21.15.49:0/1059289412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8244103070 msgr2=0x7f8244195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f8243fff640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8244103070 0x7f8244195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f8243fff640 1 -- 172.21.15.49:0/1059289412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8238009560 con 0x7f8244100740 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f8243fff640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244100740 0x7f8244195690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f823400d900 tx=0x7f823400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f82417fa640 1 -- 172.21.15.49:0/1059289412 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8234009c00 con 0x7f8244100740 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f82417fa640 1 -- 172.21.15.49:0/1059289412 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f823400b660 con 0x7f8244100740 2024-09-19T09:00:40.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824419adb0 con 0x7f8244100740 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f82417fa640 1 -- 172.21.15.49:0/1059289412 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823400f680 con 0x7f8244100740 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.987+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824419b270 con 0x7f8244100740 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.989+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82441087e0 con 0x7f8244100740 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.989+0000 7f82417fa640 1 -- 172.21.15.49:0/1059289412 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8234010ab0 con 0x7f8244100740 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.990+0000 7f82417fa640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f822c06cc60 0x7f822c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.990+0000 7f82417fa640 1 -- 172.21.15.49:0/1059289412 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f823408bf00 con 0x7f8244100740 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.990+0000 7f82437fe640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f822c06cc60 0x7f822c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.991+0000 7f82437fe640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f822c06cc60 0x7f822c06f120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8238000c00 tx=0x7f82380314a0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:39.995+0000 7f82417fa640 1 -- 172.21.15.49:0/1059289412 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f82340563a0 con 0x7f8244100740 2024-09-19T09:00:40.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.207+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f824419b4e0 con 0x7f822c06cc60 2024-09-19T09:00:40.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.208+0000 7f82417fa640 1 -- 172.21.15.49:0/1059289412 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f824419b4e0 con 0x7f822c06cc60 2024-09-19T09:00:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.210+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f822c06cc60 msgr2=0x7f822c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.210+0000 7f824a2ec640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f822c06cc60 0x7f822c06f120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8238000c00 tx=0x7f82380314a0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.210+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244100740 msgr2=0x7f8244195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.210+0000 7f824a2ec640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244100740 0x7f8244195690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f823400d900 tx=0x7f823400ddc0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.211+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 shutdown_connections 2024-09-19T09:00:40.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.211+0000 7f824a2ec640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f822c06cc60 0x7f822c06f120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.211+0000 7f824a2ec640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8244103070 0x7f8244195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.211+0000 7f824a2ec640 1 --2- 172.21.15.49:0/1059289412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8244100740 0x7f8244195690 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.211+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 >> 172.21.15.49:0/1059289412 conn(0x7f82440fa280 msgr2=0x7f82440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.211+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 shutdown_connections 2024-09-19T09:00:40.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.211+0000 7f824a2ec640 1 -- 172.21.15.49:0/1059289412 wait complete. 2024-09-19T09:00:40.221 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:00:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 -- 172.21.15.49:0/2353357250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0fea80 msgr2=0x7fed8c0fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 --2- 172.21.15.49:0/2353357250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0fea80 0x7fed8c0fee80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fed88009880 tx=0x7fed8802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 -- 172.21.15.49:0/2353357250 shutdown_connections 2024-09-19T09:00:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 --2- 172.21.15.49:0/2353357250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c0ffc80 0x7fed8c100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 --2- 172.21.15.49:0/2353357250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0fea80 0x7fed8c0fee80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 -- 172.21.15.49:0/2353357250 >> 172.21.15.49:0/2353357250 conn(0x7fed8c0fa230 msgr2=0x7fed8c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 -- 172.21.15.49:0/2353357250 shutdown_connections 2024-09-19T09:00:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.304+0000 7fed940a3640 1 -- 172.21.15.49:0/2353357250 wait complete. 2024-09-19T09:00:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed940a3640 1 Processor -- start 2024-09-19T09:00:40.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed940a3640 1 -- start start 2024-09-19T09:00:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed940a3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c0fea80 0x7fed8c195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed940a3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0ffc80 0x7fed8c195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed940a3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c196160 con 0x7fed8c0ffc80 2024-09-19T09:00:40.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed940a3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c1962d0 con 0x7fed8c0fea80 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed9163e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0ffc80 0x7fed8c195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed9163e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0ffc80 0x7fed8c195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47672/0 (socket says 172.21.15.49:47672) 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed9163e640 1 -- 172.21.15.49:0/1797508463 learned_addr learned my addr 172.21.15.49:0/1797508463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.305+0000 7fed91e3f640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c0fea80 0x7fed8c195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed9163e640 1 -- 172.21.15.49:0/1797508463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c0fea80 msgr2=0x7fed8c195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed9163e640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c0fea80 0x7fed8c195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed9163e640 1 -- 172.21.15.49:0/1797508463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009560 con 0x7fed8c0ffc80 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed9163e640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0ffc80 0x7fed8c195b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00e9a0 tx=0x7fed7c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed82ffd640 1 -- 172.21.15.49:0/1797508463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c00cc90 con 0x7fed8c0ffc80 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed82ffd640 1 -- 172.21.15.49:0/1797508463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed7c00cdf0 con 0x7fed8c0ffc80 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c19ad70 con 0x7fed8c0ffc80 2024-09-19T09:00:40.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed82ffd640 1 -- 172.21.15.49:0/1797508463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c0187f0 con 0x7fed8c0ffc80 2024-09-19T09:00:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.306+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c19b340 con 0x7fed8c0ffc80 2024-09-19T09:00:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.307+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c107670 con 0x7fed8c0ffc80 2024-09-19T09:00:40.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.308+0000 7fed82ffd640 1 -- 172.21.15.49:0/1797508463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fed7c010c10 con 0x7fed8c0ffc80 2024-09-19T09:00:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.308+0000 7fed82ffd640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fed7806cc50 0x7fed7806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.308+0000 7fed82ffd640 1 -- 172.21.15.49:0/1797508463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fed7c014070 con 0x7fed8c0ffc80 2024-09-19T09:00:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.308+0000 7fed91e3f640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fed7806cc50 0x7fed7806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.309+0000 7fed91e3f640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fed7806cc50 0x7fed7806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed88009230 tx=0x7fed880314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.313+0000 7fed82ffd640 1 -- 172.21.15.49:0/1797508463 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fed7c052e20 con 0x7fed8c0ffc80 2024-09-19T09:00:40.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.532+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed8c19b5e0 con 0x7fed7806cc50 2024-09-19T09:00:40.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.533+0000 7fed82ffd640 1 -- 172.21.15.49:0/1797508463 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fed8c19b5e0 con 0x7fed7806cc50 2024-09-19T09:00:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fed7806cc50 msgr2=0x7fed7806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fed7806cc50 0x7fed7806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed88009230 tx=0x7fed880314e0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0ffc80 msgr2=0x7fed8c195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0ffc80 0x7fed8c195b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00e9a0 tx=0x7fed7c00ee60 comp rx=0 tx=0).stop 2024-09-19T09:00:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 shutdown_connections 2024-09-19T09:00:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fed7806cc50 0x7fed7806f110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed8c0ffc80 0x7fed8c195b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 --2- 172.21.15.49:0/1797508463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c0fea80 0x7fed8c195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 >> 172.21.15.49:0/1797508463 conn(0x7fed8c0fa230 msgr2=0x7fed8c0684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.535+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 shutdown_connections 2024-09-19T09:00:40.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.536+0000 7fed940a3640 1 -- 172.21.15.49:0/1797508463 wait complete. 2024-09-19T09:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.624+0000 7f91303ea640 1 -- 172.21.15.49:0/3502726763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128100630 msgr2=0x7f9128102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.624+0000 7f91303ea640 1 --2- 172.21.15.49:0/3502726763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128100630 0x7f9128102a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f91240098b0 tx=0x7f912402a4d0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.624+0000 7f91303ea640 1 -- 172.21.15.49:0/3502726763 shutdown_connections 2024-09-19T09:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.624+0000 7f91303ea640 1 --2- 172.21.15.49:0/3502726763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9128102f60 0x7f9128105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.624+0000 7f91303ea640 1 --2- 172.21.15.49:0/3502726763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128100630 0x7f9128102a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.624+0000 7f91303ea640 1 -- 172.21.15.49:0/3502726763 >> 172.21.15.49:0/3502726763 conn(0x7f91280fa230 msgr2=0x7f91280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 -- 172.21.15.49:0/3502726763 shutdown_connections 2024-09-19T09:00:40.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 -- 172.21.15.49:0/3502726763 wait complete. 2024-09-19T09:00:40.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 Processor -- start 2024-09-19T09:00:40.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 -- start start 2024-09-19T09:00:40.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9128100630 0x7f9128195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128102f60 0x7f9128195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128196170 con 0x7f9128102f60 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.625+0000 7f91303ea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91281962e0 con 0x7f9128100630 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912d985640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128102f60 0x7f9128195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912d985640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128102f60 0x7f9128195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47688/0 (socket says 172.21.15.49:47688) 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912d985640 1 -- 172.21.15.49:0/1159583494 learned_addr learned my addr 172.21.15.49:0/1159583494 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912e186640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9128100630 0x7f9128195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912d985640 1 -- 172.21.15.49:0/1159583494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9128100630 msgr2=0x7f9128195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912d985640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9128100630 0x7f9128195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912d985640 1 -- 172.21.15.49:0/1159583494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124009560 con 0x7f9128102f60 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f912d985640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128102f60 0x7f9128195ba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f911800e9a0 tx=0x7f911800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f911f7fe640 1 -- 172.21.15.49:0/1159583494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f911800cc90 con 0x7f9128102f60 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f911f7fe640 1 -- 172.21.15.49:0/1159583494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f911800cdf0 con 0x7f9128102f60 2024-09-19T09:00:40.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.626+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912819ad80 con 0x7f9128102f60 2024-09-19T09:00:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.627+0000 7f911f7fe640 1 -- 172.21.15.49:0/1159583494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9118010430 con 0x7f9128102f60 2024-09-19T09:00:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.627+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912819b2f0 con 0x7f9128102f60 2024-09-19T09:00:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.628+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91281087e0 con 0x7f9128102f60 2024-09-19T09:00:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.628+0000 7f911f7fe640 1 -- 172.21.15.49:0/1159583494 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9118005020 con 0x7f9128102f60 2024-09-19T09:00:40.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.629+0000 7f911f7fe640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f911406cc50 0x7f911406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.629+0000 7f911f7fe640 1 -- 172.21.15.49:0/1159583494 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9118014070 con 0x7f9128102f60 2024-09-19T09:00:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.629+0000 7f912e186640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f911406cc50 0x7f911406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.630+0000 7f912e186640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f911406cc50 0x7f911406f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9124006010 tx=0x7f91240314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.633+0000 7f911f7fe640 1 -- 172.21.15.49:0/1159583494 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9118056a80 con 0x7f9128102f60 2024-09-19T09:00:40.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.835+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f912819b5f0 con 0x7f911406cc50 2024-09-19T09:00:40.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.846+0000 7f911f7fe640 1 -- 172.21.15.49:0/1159583494 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f912819b5f0 con 0x7f911406cc50 2024-09-19T09:00:40.847 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:00:40.847 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (4m) 27s ago 6m 25.4M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:00:40.847 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (6m) 27s ago 6m 7520k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:00:40.847 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (5m) 34s ago 5m 7490k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 27s ago 6m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (5m) 34s ago 5m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (4m) 27s ago 5m 84.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (54s) 27s ago 53s 12.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (46s) 27s ago 46s 15.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (44s) 34s ago 44s 16.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (51s) 34s ago 51s 16.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:9283,8765,8443 running (7m) 27s ago 7m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 b57193f2a38e 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (5m) 34s ago 5m 438M - 18.2.4-855-g19e2a2be 980a0bfcd684 7393ef52f781 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (7m) 27s ago 7m 46.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:00:40.848 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (5m) 34s ago 5m 37.7M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 27s ago 6m 15.2M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (5m) 34s ago 5m 16.5M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (4m) 27s ago 4m 47.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 27s ago 4m 54.7M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (3m) 27s ago 3m 53.7M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (3m) 34s ago 3m 46.4M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (2m) 34s ago 2m 51.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (2m) 34s ago 2m 51.5M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:00:40.849 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (4m) 27s ago 5m 59.4M - 2.43.0 a07b618ecd1d 2151f61fb8cc 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.848+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f911406cc50 msgr2=0x7f911406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.848+0000 7f91303ea640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f911406cc50 0x7f911406f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9124006010 tx=0x7f91240314e0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.848+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128102f60 msgr2=0x7f9128195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.848+0000 7f91303ea640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128102f60 0x7f9128195ba0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f911800e9a0 tx=0x7f911800ee60 comp rx=0 tx=0).stop 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.849+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 shutdown_connections 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.849+0000 7f91303ea640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f911406cc50 0x7f911406f110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.849+0000 7f91303ea640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9128102f60 0x7f9128195ba0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.849+0000 7f91303ea640 1 --2- 172.21.15.49:0/1159583494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9128100630 0x7f9128195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.849+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 >> 172.21.15.49:0/1159583494 conn(0x7f91280fa230 msgr2=0x7f91280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.849+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 shutdown_connections 2024-09-19T09:00:40.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.849+0000 7f91303ea640 1 -- 172.21.15.49:0/1159583494 wait complete. 2024-09-19T09:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.938+0000 7fe03b2ab640 1 -- 172.21.15.49:0/2845705840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034102f30 msgr2=0x7fe034105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.938+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/2845705840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034102f30 0x7fe034105320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe0240098b0 tx=0x7fe02402a4d0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.938+0000 7fe03b2ab640 1 -- 172.21.15.49:0/2845705840 shutdown_connections 2024-09-19T09:00:40.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.938+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/2845705840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034102f30 0x7fe034105320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.938+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/2845705840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe034100600 0x7fe0341029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.938+0000 7fe03b2ab640 1 -- 172.21.15.49:0/2845705840 >> 172.21.15.49:0/2845705840 conn(0x7fe0340fa200 msgr2=0x7fe0340fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:40.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 -- 172.21.15.49:0/2845705840 shutdown_connections 2024-09-19T09:00:40.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 -- 172.21.15.49:0/2845705840 wait complete. 2024-09-19T09:00:40.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 Processor -- start 2024-09-19T09:00:40.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 -- start start 2024-09-19T09:00:40.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034100600 0x7fe0340fff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe034102f30 0x7fe0340fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340feaf0 con 0x7fe034100600 2024-09-19T09:00:40.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.939+0000 7fe03b2ab640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340fec60 con 0x7fe034102f30 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe039047640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034100600 0x7fe0340fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe039047640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034100600 0x7fe0340fff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47714/0 (socket says 172.21.15.49:47714) 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe039047640 1 -- 172.21.15.49:0/1276200212 learned_addr learned my addr 172.21.15.49:0/1276200212 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe038846640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe034102f30 0x7fe0340fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe039047640 1 -- 172.21.15.49:0/1276200212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe034102f30 msgr2=0x7fe0340fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe039047640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe034102f30 0x7fe0340fe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe039047640 1 -- 172.21.15.49:0/1276200212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024009560 con 0x7fe034100600 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe038846640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe034102f30 0x7fe0340fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe039047640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034100600 0x7fe0340fff60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe03000e970 tx=0x7fe03000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe02a7fc640 1 -- 172.21.15.49:0/1276200212 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03000cc90 con 0x7fe034100600 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0340fef40 con 0x7fe034100600 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.940+0000 7fe02a7fc640 1 -- 172.21.15.49:0/1276200212 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe03000cdf0 con 0x7fe034100600 2024-09-19T09:00:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.941+0000 7fe02a7fc640 1 -- 172.21.15.49:0/1276200212 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe030010430 con 0x7fe034100600 2024-09-19T09:00:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.941+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03419d6c0 con 0x7fe034100600 2024-09-19T09:00:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.942+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0341009e0 con 0x7fe034100600 2024-09-19T09:00:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.942+0000 7fe02a7fc640 1 -- 172.21.15.49:0/1276200212 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe0300046c0 con 0x7fe034100600 2024-09-19T09:00:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.943+0000 7fe02a7fc640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe02006cc50 0x7fe02006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:40.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.943+0000 7fe02a7fc640 1 -- 172.21.15.49:0/1276200212 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe030014070 con 0x7fe034100600 2024-09-19T09:00:40.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.943+0000 7fe038846640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe02006cc50 0x7fe02006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:40.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.943+0000 7fe038846640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe02006cc50 0x7fe02006f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe024009880 tx=0x7fe0240314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:40.947+0000 7fe02a7fc640 1 -- 172.21.15.49:0/1276200212 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe030056be0 con 0x7fe034100600 2024-09-19T09:00:41.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.216+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe03419da30 con 0x7fe034100600 2024-09-19T09:00:41.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.217+0000 7fe02a7fc640 1 -- 172.21.15.49:0/1276200212 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fe03005a200 con 0x7fe034100600 2024-09-19T09:00:41.217 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:00:41.218 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:00:41.219 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-19T09:00:41.219 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:00:41.219 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe02006cc50 msgr2=0x7fe02006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe02006cc50 0x7fe02006f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe024009880 tx=0x7fe0240314e0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034100600 msgr2=0x7fe0340fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034100600 0x7fe0340fff60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe03000e970 tx=0x7fe03000ed70 comp rx=0 tx=0).stop 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 shutdown_connections 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fe02006cc50 0x7fe02006f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe034102f30 0x7fe0340fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 --2- 172.21.15.49:0/1276200212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe034100600 0x7fe0340fff60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.219+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 >> 172.21.15.49:0/1276200212 conn(0x7fe0340fa200 msgr2=0x7fe0340fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.220+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 shutdown_connections 2024-09-19T09:00:41.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.220+0000 7fe03b2ab640 1 -- 172.21.15.49:0/1276200212 wait complete. 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 -- 172.21.15.49:0/4028669046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 msgr2=0x7fa460102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 --2- 172.21.15.49:0/4028669046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa460102190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009880 tx=0x7fa45c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 -- 172.21.15.49:0/4028669046 shutdown_connections 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 --2- 172.21.15.49:0/4028669046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa460102f90 0x7fa460103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 --2- 172.21.15.49:0/4028669046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa460102190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 -- 172.21.15.49:0/4028669046 >> 172.21.15.49:0/4028669046 conn(0x7fa4600fd540 msgr2=0x7fa4600ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 -- 172.21.15.49:0/4028669046 shutdown_connections 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.311+0000 7fa4682bf640 1 -- 172.21.15.49:0/4028669046 wait complete. 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa4682bf640 1 Processor -- start 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa4682bf640 1 -- start start 2024-09-19T09:00:41.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa4682bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa4601977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa4682bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa460102f90 0x7fa460197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa4682bf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa460198260 con 0x7fa460101d90 2024-09-19T09:00:41.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa4682bf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4601983d0 con 0x7fa460102f90 2024-09-19T09:00:41.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa46605b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa4601977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa46605b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa4601977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47732/0 (socket says 172.21.15.49:47732) 2024-09-19T09:00:41.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.312+0000 7fa46605b640 1 -- 172.21.15.49:0/3071550127 learned_addr learned my addr 172.21.15.49:0/3071550127 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa46585a640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa460102f90 0x7fa460197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa46605b640 1 -- 172.21.15.49:0/3071550127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa460102f90 msgr2=0x7fa460197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa46605b640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa460102f90 0x7fa460197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa46605b640 1 -- 172.21.15.49:0/3071550127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c009560 con 0x7fa460101d90 2024-09-19T09:00:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa46605b640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa4601977e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa45c02a9c0 tx=0x7fa45c005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa4577fe640 1 -- 172.21.15.49:0/3071550127 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c004b20 con 0x7fa460101d90 2024-09-19T09:00:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46019ce50 con 0x7fa460101d90 2024-09-19T09:00:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa4577fe640 1 -- 172.21.15.49:0/3071550127 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa45c004c80 con 0x7fa460101d90 2024-09-19T09:00:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa4577fe640 1 -- 172.21.15.49:0/3071550127 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c003b80 con 0x7fa460101d90 2024-09-19T09:00:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.313+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46019d2f0 con 0x7fa460101d90 2024-09-19T09:00:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.314+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46010a980 con 0x7fa460101d90 2024-09-19T09:00:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.315+0000 7fa4577fe640 1 -- 172.21.15.49:0/3071550127 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa45c031640 con 0x7fa460101d90 2024-09-19T09:00:41.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.315+0000 7fa4577fe640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa44c06cc50 0x7fa44c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.316+0000 7fa4577fe640 1 -- 172.21.15.49:0/3071550127 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa45c0ad500 con 0x7fa460101d90 2024-09-19T09:00:41.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.316+0000 7fa46585a640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa44c06cc50 0x7fa44c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.316+0000 7fa46585a640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa44c06cc50 0x7fa44c06f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa450005e10 tx=0x7fa450005da0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.320+0000 7fa4577fe640 1 -- 172.21.15.49:0/3071550127 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa45c077870 con 0x7fa460101d90 2024-09-19T09:00:41.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:41 smithi102 ceph-mon[35280]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T09:00:41.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:41 smithi049 ceph-mon[28158]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T09:00:41.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.559+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa46019d850 con 0x7fa460101d90 2024-09-19T09:00:41.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.560+0000 7fa4577fe640 1 -- 172.21.15.49:0/3071550127 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7fa45c07ae90 con 0x7fa460101d90 2024-09-19T09:00:41.560 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:00:41.560 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:00:41.560 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:00:41.561 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:00:41.562 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:41.563 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa44c06cc50 msgr2=0x7fa44c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa44c06cc50 0x7fa44c06f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa450005e10 tx=0x7fa450005da0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 msgr2=0x7fa4601977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa4601977e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa45c02a9c0 tx=0x7fa45c005610 comp rx=0 tx=0).stop 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 shutdown_connections 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fa44c06cc50 0x7fa44c06f110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa460102f90 0x7fa460197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 --2- 172.21.15.49:0/3071550127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa460101d90 0x7fa4601977e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 >> 172.21.15.49:0/3071550127 conn(0x7fa4600fd540 msgr2=0x7fa4600ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 shutdown_connections 2024-09-19T09:00:41.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.563+0000 7fa4682bf640 1 -- 172.21.15.49:0/3071550127 wait complete. 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 -- 172.21.15.49:0/3051231557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0fea70 msgr2=0x7f315c0fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 --2- 172.21.15.49:0/3051231557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0fea70 0x7f315c0fee70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f314c009880 tx=0x7f314c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 -- 172.21.15.49:0/3051231557 shutdown_connections 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 --2- 172.21.15.49:0/3051231557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f315c0ffc70 0x7f315c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 --2- 172.21.15.49:0/3051231557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0fea70 0x7f315c0fee70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 -- 172.21.15.49:0/3051231557 >> 172.21.15.49:0/3051231557 conn(0x7f315c0fa200 msgr2=0x7f315c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 -- 172.21.15.49:0/3051231557 shutdown_connections 2024-09-19T09:00:41.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.657+0000 7f31615dd640 1 -- 172.21.15.49:0/3051231557 wait complete. 2024-09-19T09:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.658+0000 7f31615dd640 1 Processor -- start 2024-09-19T09:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.658+0000 7f31615dd640 1 -- start start 2024-09-19T09:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.658+0000 7f31615dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f315c0fea70 0x7f315c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.658+0000 7f31615dd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0ffc70 0x7f315c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.658+0000 7f31615dd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1960b0 con 0x7f315c0ffc70 2024-09-19T09:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.658+0000 7f31615dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c196220 con 0x7f315c0fea70 2024-09-19T09:00:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.658+0000 7f315a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0ffc70 0x7f315c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f315a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0ffc70 0x7f315c195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47752/0 (socket says 172.21.15.49:47752) 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f315a7fc640 1 -- 172.21.15.49:0/873981498 learned_addr learned my addr 172.21.15.49:0/873981498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f315affd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f315c0fea70 0x7f315c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f315a7fc640 1 -- 172.21.15.49:0/873981498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f315c0fea70 msgr2=0x7f315c195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f315a7fc640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f315c0fea70 0x7f315c195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f315a7fc640 1 -- 172.21.15.49:0/873981498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009560 con 0x7f315c0ffc70 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f315a7fc640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0ffc70 0x7f315c195b70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f315000c8a0 tx=0x7f315000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f3143fff640 1 -- 172.21.15.49:0/873981498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3150007b80 con 0x7f315c0ffc70 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f3143fff640 1 -- 172.21.15.49:0/873981498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3150007ce0 con 0x7f315c0ffc70 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c19ad00 con 0x7f315c0ffc70 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f3143fff640 1 -- 172.21.15.49:0/873981498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3150018810 con 0x7f315c0ffc70 2024-09-19T09:00:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.659+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c19b280 con 0x7f315c0ffc70 2024-09-19T09:00:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.661+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c107660 con 0x7f315c0ffc70 2024-09-19T09:00:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.661+0000 7f3143fff640 1 -- 172.21.15.49:0/873981498 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3150018970 con 0x7f315c0ffc70 2024-09-19T09:00:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.662+0000 7f3143fff640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f314406cc50 0x7f314406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.662+0000 7f3143fff640 1 -- 172.21.15.49:0/873981498 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f315008c3d0 con 0x7f315c0ffc70 2024-09-19T09:00:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.662+0000 7f315affd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f314406cc50 0x7f314406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.662+0000 7f315affd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f314406cc50 0x7f314406f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f314c009230 tx=0x7f314c005b50 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.667+0000 7f3143fff640 1 -- 172.21.15.49:0/873981498 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f31500567c0 con 0x7f315c0ffc70 2024-09-19T09:00:41.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.875+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f315c068bd0 con 0x7f314406cc50 2024-09-19T09:00:41.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.877+0000 7f3143fff640 1 -- 172.21.15.49:0/873981498 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f315c068bd0 con 0x7f314406cc50 2024-09-19T09:00:41.877 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:00:41.877 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T09:00:41.877 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:00:41.877 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:00:41.878 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-09-19T09:00:41.878 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "", 2024-09-19T09:00:41.878 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 image", 2024-09-19T09:00:41.878 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:00:41.878 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:00:41.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f314406cc50 msgr2=0x7f314406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f314406cc50 0x7f314406f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f314c009230 tx=0x7f314c005b50 comp rx=0 tx=0).stop 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0ffc70 msgr2=0x7f315c195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0ffc70 0x7f315c195b70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f315000c8a0 tx=0x7f315000cd60 comp rx=0 tx=0).stop 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 shutdown_connections 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f314406cc50 0x7f314406f110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f315c0ffc70 0x7f315c195b70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 --2- 172.21.15.49:0/873981498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f315c0fea70 0x7f315c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 >> 172.21.15.49:0/873981498 conn(0x7f315c0fa200 msgr2=0x7f315c0684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 shutdown_connections 2024-09-19T09:00:41.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.879+0000 7f31615dd640 1 -- 172.21.15.49:0/873981498 wait complete. 2024-09-19T09:00:41.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 -- 172.21.15.49:0/4145444389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940feaf0 msgr2=0x7f92940feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 --2- 172.21.15.49:0/4145444389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940feaf0 0x7f92940feef0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9284009880 tx=0x7f928402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 -- 172.21.15.49:0/4145444389 shutdown_connections 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 --2- 172.21.15.49:0/4145444389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92940ffcf0 0x7f9294100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 --2- 172.21.15.49:0/4145444389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940feaf0 0x7f92940feef0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 -- 172.21.15.49:0/4145444389 >> 172.21.15.49:0/4145444389 conn(0x7f92940fa280 msgr2=0x7f92940fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 -- 172.21.15.49:0/4145444389 shutdown_connections 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 -- 172.21.15.49:0/4145444389 wait complete. 2024-09-19T09:00:41.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.969+0000 7f92997f5640 1 Processor -- start 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92997f5640 1 -- start start 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92997f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92940feaf0 0x7f9294195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92997f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940ffcf0 0x7f9294195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92997f5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92941960e0 con 0x7f92940ffcf0 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92997f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9294196250 con 0x7f92940feaf0 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940ffcf0 0x7f9294195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940ffcf0 0x7f9294195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47756/0 (socket says 172.21.15.49:47756) 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f9292ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92940feaf0 0x7f9294195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92927fc640 1 -- 172.21.15.49:0/3393240905 learned_addr learned my addr 172.21.15.49:0/3393240905 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:00:41.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92927fc640 1 -- 172.21.15.49:0/3393240905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92940feaf0 msgr2=0x7f9294195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92927fc640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92940feaf0 0x7f9294195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.970+0000 7f92927fc640 1 -- 172.21.15.49:0/3393240905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009560 con 0x7f92940ffcf0 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.971+0000 7f92927fc640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940ffcf0 0x7f9294195ba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f928800c8a0 tx=0x7f928800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.971+0000 7f927bfff640 1 -- 172.21.15.49:0/3393240905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9288007b80 con 0x7f92940ffcf0 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.971+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929419ad30 con 0x7f92940ffcf0 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.971+0000 7f927bfff640 1 -- 172.21.15.49:0/3393240905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9288007ce0 con 0x7f92940ffcf0 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.971+0000 7f927bfff640 1 -- 172.21.15.49:0/3393240905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9288018810 con 0x7f92940ffcf0 2024-09-19T09:00:41.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.971+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929419b230 con 0x7f92940ffcf0 2024-09-19T09:00:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.972+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92941076e0 con 0x7f92940ffcf0 2024-09-19T09:00:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.973+0000 7f927bfff640 1 -- 172.21.15.49:0/3393240905 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9288018a80 con 0x7f92940ffcf0 2024-09-19T09:00:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.973+0000 7f927bfff640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f927c06cc50 0x7f927c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.973+0000 7f927bfff640 1 -- 172.21.15.49:0/3393240905 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f928808c400 con 0x7f92940ffcf0 2024-09-19T09:00:41.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.973+0000 7f9292ffd640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f927c06cc50 0x7f927c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:41.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.974+0000 7f9292ffd640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f927c06cc50 0x7f927c06f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9284009230 tx=0x7f92840314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:41.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:41.978+0000 7f927bfff640 1 -- 172.21.15.49:0/3393240905 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9288056770 con 0x7f92940ffcf0 2024-09-19T09:00:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.248+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f92941078c0 con 0x7f92940ffcf0 2024-09-19T09:00:42.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.248+0000 7f927bfff640 1 -- 172.21.15.49:0/3393240905 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f9288059d90 con 0x7f92940ffcf0 2024-09-19T09:00:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:00:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:00:42.249 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:00:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.250+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f927c06cc50 msgr2=0x7f927c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.250+0000 7f92997f5640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f927c06cc50 0x7f927c06f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9284009230 tx=0x7f92840314e0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.250+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940ffcf0 msgr2=0x7f9294195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.250+0000 7f92997f5640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940ffcf0 0x7f9294195ba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f928800c8a0 tx=0x7f928800cd60 comp rx=0 tx=0).stop 2024-09-19T09:00:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.251+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 shutdown_connections 2024-09-19T09:00:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.251+0000 7f92997f5640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f927c06cc50 0x7f927c06f110 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.251+0000 7f92997f5640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92940ffcf0 0x7f9294195ba0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.251+0000 7f92997f5640 1 --2- 172.21.15.49:0/3393240905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92940feaf0 0x7f9294195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.251+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 >> 172.21.15.49:0/3393240905 conn(0x7f92940fa280 msgr2=0x7f92940fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.251+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 shutdown_connections 2024-09-19T09:00:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:00:42.251+0000 7f92997f5640 1 -- 172.21.15.49:0/3393240905 wait complete. 2024-09-19T09:00:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:42 smithi102 ceph-mon[35280]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:42 smithi102 ceph-mon[35280]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:42 smithi102 ceph-mon[35280]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:42 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1276200212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:00:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:42 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3071550127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:00:42.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:42 smithi049 ceph-mon[28158]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:42.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:42 smithi049 ceph-mon[28158]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:42.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:42 smithi049 ceph-mon[28158]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:42.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:42 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1276200212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:00:42.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:42 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3071550127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:00:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:43 smithi102 ceph-mon[35280]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:43 smithi102 ceph-mon[35280]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-19T09:00:43.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:43 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3393240905' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:00:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:43 smithi049 ceph-mon[28158]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:43 smithi049 ceph-mon[28158]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-19T09:00:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:43 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3393240905' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:00:44.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:44 smithi102 ceph-mon[35280]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T09:00:44.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:44 smithi049 ceph-mon[28158]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T09:00:47.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:47 smithi049 ceph-mon[28158]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-19T09:00:47.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:47 smithi102 ceph-mon[35280]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-19T09:00:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:00:49.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:49 smithi102 ceph-mon[35280]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-19T09:00:49.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:49 smithi049 ceph-mon[28158]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-19T09:00:51.364 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:51 smithi049 ceph-mon[28158]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-19T09:00:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:51 smithi102 ceph-mon[35280]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-19T09:00:53.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:53 smithi102 ceph-mon[35280]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:00:53.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:53 smithi049 ceph-mon[28158]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:00:55.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:55 smithi102 ceph-mon[35280]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:00:55.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:55 smithi049 ceph-mon[28158]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:00:57.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:57 smithi049 ceph-mon[28158]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:00:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:57 smithi102 ceph-mon[35280]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:00:59.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:00:59 smithi102 ceph-mon[35280]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:00:59.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:00:59 smithi049 ceph-mon[28158]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:01 smithi102 ceph-mon[35280]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:01.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:01 smithi049 ceph-mon[28158]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:02 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:02.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:02 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:03.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:03 smithi102 ceph-mon[35280]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:03.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:03 smithi049 ceph-mon[28158]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:05.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:05 smithi102 ceph-mon[35280]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:05.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:05 smithi049 ceph-mon[28158]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:07.169 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:06 smithi049 ceph-mon[28158]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:01:07.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:06 smithi102 ceph-mon[35280]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:01:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: Upgrade: Target is version 19.1.1-361-g2f599a46 (unknown) 2024-09-19T09:01:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T09:01:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: Upgrade: Need to upgrade myself (mgr.smithi049.qdvksw) 2024-09-19T09:01:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e on smithi102 2024-09-19T09:01:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:08 smithi102 ceph-mon[35280]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:08.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:08.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: Upgrade: Target is version 19.1.1-361-g2f599a46 (unknown) 2024-09-19T09:01:08.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T09:01:08.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:08.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: Upgrade: Need to upgrade myself (mgr.smithi049.qdvksw) 2024-09-19T09:01:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e on smithi102 2024-09-19T09:01:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:08 smithi049 ceph-mon[28158]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:11.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:11 smithi102 ceph-mon[35280]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:11 smithi049 ceph-mon[28158]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/1181815056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb8100110 msgr2=0x7fbbb8100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/1181815056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb8100110 0x7fbbb8100510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009880 tx=0x7fbba802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/1181815056 shutdown_connections 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/1181815056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb80fdc10 0x7fbbb80fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/1181815056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb8100110 0x7fbbb8100510 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/1181815056 >> 172.21.15.49:0/1181815056 conn(0x7fbbb80f99c0 msgr2=0x7fbbb80fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/1181815056 shutdown_connections 2024-09-19T09:01:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.375+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/1181815056 wait complete. 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.376+0000 7fbbbcaf1640 1 Processor -- start 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.376+0000 7fbbbcaf1640 1 -- start start 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.376+0000 7fbbbcaf1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb80fdc10 0x7fbbb8070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.376+0000 7fbbbcaf1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb8100110 0x7fbbb80708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.376+0000 7fbbbcaf1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8070e80 con 0x7fbbb80fdc10 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.376+0000 7fbbbcaf1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8104f10 con 0x7fbbb8100110 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb8100110 0x7fbbb80708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb80fdc10 0x7fbbb8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb80fdc10 0x7fbbb8070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44038/0 (socket says 172.21.15.49:44038) 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb8100110 0x7fbbb80708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:58282/0 (socket says 172.21.15.49:58282) 2024-09-19T09:01:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb659c640 1 -- 172.21.15.49:0/4025638451 learned_addr learned my addr 172.21.15.49:0/4025638451 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb659c640 1 -- 172.21.15.49:0/4025638451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb8100110 msgr2=0x7fbbb80708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb659c640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb8100110 0x7fbbb80708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb659c640 1 -- 172.21.15.49:0/4025638451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8009560 con 0x7fbbb80fdc10 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb5d9b640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb8100110 0x7fbbb80708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.377+0000 7fbbb659c640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb80fdc10 0x7fbbb8070370 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006010 tx=0x7fbba80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.378+0000 7fbba77fe640 1 -- 172.21.15.49:0/4025638451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbba8004aa0 con 0x7fbbb80fdc10 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.378+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb80716d0 con 0x7fbbb80fdc10 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.378+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb8071c40 con 0x7fbbb80fdc10 2024-09-19T09:01:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.378+0000 7fbba77fe640 1 -- 172.21.15.49:0/4025638451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbba8005d50 con 0x7fbbb80fdc10 2024-09-19T09:01:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.379+0000 7fbba77fe640 1 -- 172.21.15.49:0/4025638451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbba8004aa0 con 0x7fbbb80fdc10 2024-09-19T09:01:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.379+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98005280 con 0x7fbbb80fdc10 2024-09-19T09:01:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.382+0000 7fbba77fe640 1 -- 172.21.15.49:0/4025638451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbba8031b90 con 0x7fbbb80fdc10 2024-09-19T09:01:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.383+0000 7fbba77fe640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbba006cd10 0x7fbba006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.383+0000 7fbba77fe640 1 -- 172.21.15.49:0/4025638451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbba80ad4c0 con 0x7fbbb80fdc10 2024-09-19T09:01:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.383+0000 7fbbb5d9b640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbba006cd10 0x7fbba006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.384+0000 7fbbb5d9b640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbba006cd10 0x7fbba006f1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80700f0 tx=0x7fbbac005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.385+0000 7fbba77fe640 1 -- 172.21.15.49:0/4025638451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbba8077960 con 0x7fbbb80fdc10 2024-09-19T09:01:12.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.574+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb98000bf0 con 0x7fbba006cd10 2024-09-19T09:01:12.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.575+0000 7fbba77fe640 1 -- 172.21.15.49:0/4025638451 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fbb98000bf0 con 0x7fbba006cd10 2024-09-19T09:01:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbba006cd10 msgr2=0x7fbba006f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbba006cd10 0x7fbba006f1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80700f0 tx=0x7fbbac005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb80fdc10 msgr2=0x7fbbb8070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb80fdc10 0x7fbbb8070370 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006010 tx=0x7fbba80055a0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 shutdown_connections 2024-09-19T09:01:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fbba006cd10 0x7fbba006f1d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbb8100110 0x7fbbb80708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 --2- 172.21.15.49:0/4025638451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbb80fdc10 0x7fbbb8070370 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.578+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 >> 172.21.15.49:0/4025638451 conn(0x7fbbb80f99c0 msgr2=0x7fbbb80fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.579+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 shutdown_connections 2024-09-19T09:01:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.579+0000 7fbbbcaf1640 1 -- 172.21.15.49:0/4025638451 wait complete. 2024-09-19T09:01:12.592 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:01:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.669+0000 7f44bf52b640 1 -- 172.21.15.49:0/1958890617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8102fb0 msgr2=0x7f44b81053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.669+0000 7f44bf52b640 1 --2- 172.21.15.49:0/1958890617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8102fb0 0x7f44b81053a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f44a80098b0 tx=0x7f44a802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.669+0000 7f44bf52b640 1 -- 172.21.15.49:0/1958890617 shutdown_connections 2024-09-19T09:01:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.669+0000 7f44bf52b640 1 --2- 172.21.15.49:0/1958890617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8102fb0 0x7f44b81053a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.669+0000 7f44bf52b640 1 --2- 172.21.15.49:0/1958890617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8100680 0x7f44b8102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.669+0000 7f44bf52b640 1 -- 172.21.15.49:0/1958890617 >> 172.21.15.49:0/1958890617 conn(0x7f44b80fa280 msgr2=0x7f44b80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.670+0000 7f44bf52b640 1 -- 172.21.15.49:0/1958890617 shutdown_connections 2024-09-19T09:01:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.670+0000 7f44bf52b640 1 -- 172.21.15.49:0/1958890617 wait complete. 2024-09-19T09:01:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.671+0000 7f44bf52b640 1 Processor -- start 2024-09-19T09:01:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.671+0000 7f44bf52b640 1 -- start start 2024-09-19T09:01:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.671+0000 7f44bf52b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8100680 0x7f44b8195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.671+0000 7f44bf52b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8102fb0 0x7f44b8195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bf52b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8196230 con 0x7f44b8100680 2024-09-19T09:01:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bf52b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81963a0 con 0x7f44b8102fb0 2024-09-19T09:01:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bd2c7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8100680 0x7f44b8195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bcac6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8102fb0 0x7f44b8195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bd2c7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8100680 0x7f44b8195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44054/0 (socket says 172.21.15.49:44054) 2024-09-19T09:01:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bcac6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8102fb0 0x7f44b8195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:58298/0 (socket says 172.21.15.49:58298) 2024-09-19T09:01:12.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bd2c7640 1 -- 172.21.15.49:0/3251022189 learned_addr learned my addr 172.21.15.49:0/3251022189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bd2c7640 1 -- 172.21.15.49:0/3251022189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8102fb0 msgr2=0x7f44b8195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bd2c7640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8102fb0 0x7f44b8195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bd2c7640 1 -- 172.21.15.49:0/3251022189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a8009560 con 0x7f44b8100680 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bcac6640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8102fb0 0x7f44b8195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.672+0000 7f44bd2c7640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8100680 0x7f44b8195720 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009db0 tx=0x7f44b400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.673+0000 7f44ae7fc640 1 -- 172.21.15.49:0/3251022189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b40051f0 con 0x7f44b8100680 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.673+0000 7f44ae7fc640 1 -- 172.21.15.49:0/3251022189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44b4012050 con 0x7f44b8100680 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.673+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b80fe4d0 con 0x7f44b8100680 2024-09-19T09:01:12.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.673+0000 7f44ae7fc640 1 -- 172.21.15.49:0/3251022189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b4004d10 con 0x7f44b8100680 2024-09-19T09:01:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.673+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b80fe9f0 con 0x7f44b8100680 2024-09-19T09:01:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.674+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b8108800 con 0x7f44b8100680 2024-09-19T09:01:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.675+0000 7f44ae7fc640 1 -- 172.21.15.49:0/3251022189 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f44b4005350 con 0x7f44b8100680 2024-09-19T09:01:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.675+0000 7f44ae7fc640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f44a406cc50 0x7f44a406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.676+0000 7f44ae7fc640 1 -- 172.21.15.49:0/3251022189 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f44b4090370 con 0x7f44b8100680 2024-09-19T09:01:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.676+0000 7f44bcac6640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f44a406cc50 0x7f44a406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.676+0000 7f44bcac6640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f44a406cc50 0x7f44a406f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009880 tx=0x7f44a80314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.684+0000 7f44ae7fc640 1 -- 172.21.15.49:0/3251022189 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f44b405a730 con 0x7f44b8100680 2024-09-19T09:01:12.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.874+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f44b8103a50 con 0x7f44a406cc50 2024-09-19T09:01:12.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.876+0000 7f44ae7fc640 1 -- 172.21.15.49:0/3251022189 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f44b8103a50 con 0x7f44a406cc50 2024-09-19T09:01:12.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f44a406cc50 msgr2=0x7f44a406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f44a406cc50 0x7f44a406f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009880 tx=0x7f44a80314e0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8100680 msgr2=0x7f44b8195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8100680 0x7f44b8195720 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009db0 tx=0x7f44b400c6a0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 shutdown_connections 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f44a406cc50 0x7f44a406f110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44b8102fb0 0x7f44b8195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 --2- 172.21.15.49:0/3251022189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44b8100680 0x7f44b8195720 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 >> 172.21.15.49:0/3251022189 conn(0x7f44b80fa280 msgr2=0x7f44b80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 shutdown_connections 2024-09-19T09:01:12.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.878+0000 7f44bf52b640 1 -- 172.21.15.49:0/3251022189 wait complete. 2024-09-19T09:01:12.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.966+0000 7f2e9cbec640 1 -- 172.21.15.49:0/375087783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 msgr2=0x7f2e981029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.966+0000 7f2e9cbec640 1 --2- 172.21.15.49:0/375087783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e981029f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098b0 tx=0x7f2e8802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.966+0000 7f2e9cbec640 1 -- 172.21.15.49:0/375087783 shutdown_connections 2024-09-19T09:01:12.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.966+0000 7f2e9cbec640 1 --2- 172.21.15.49:0/375087783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e98102f30 0x7f2e98105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.966+0000 7f2e9cbec640 1 --2- 172.21.15.49:0/375087783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e981029f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.966+0000 7f2e9cbec640 1 -- 172.21.15.49:0/375087783 >> 172.21.15.49:0/375087783 conn(0x7f2e980fa200 msgr2=0x7f2e980fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.966+0000 7f2e9cbec640 1 -- 172.21.15.49:0/375087783 shutdown_connections 2024-09-19T09:01:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.967+0000 7f2e9cbec640 1 -- 172.21.15.49:0/375087783 wait complete. 2024-09-19T09:01:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9cbec640 1 Processor -- start 2024-09-19T09:01:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9cbec640 1 -- start start 2024-09-19T09:01:12.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9cbec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e98195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9cbec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e98102f30 0x7f2e98195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9cbec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98196120 con 0x7f2e98100600 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9cbec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98196290 con 0x7f2e98102f30 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e98195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.968+0000 7f2e9659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e98195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44062/0 (socket says 172.21.15.49:44062) 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.969+0000 7f2e9659c640 1 -- 172.21.15.49:0/3321429630 learned_addr learned my addr 172.21.15.49:0/3321429630 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.969+0000 7f2e95d9b640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e98102f30 0x7f2e98195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.969+0000 7f2e9659c640 1 -- 172.21.15.49:0/3321429630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e98102f30 msgr2=0x7f2e98195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.969+0000 7f2e9659c640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e98102f30 0x7f2e98195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.969+0000 7f2e9659c640 1 -- 172.21.15.49:0/3321429630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009560 con 0x7f2e98100600 2024-09-19T09:01:12.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.969+0000 7f2e95d9b640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e98102f30 0x7f2e98195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.969+0000 7f2e9659c640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e98195610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2e88004650 tx=0x7f2e880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.970+0000 7f2e877fe640 1 -- 172.21.15.49:0/3321429630 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e88004aa0 con 0x7f2e98100600 2024-09-19T09:01:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.970+0000 7f2e877fe640 1 -- 172.21.15.49:0/3321429630 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e88004c00 con 0x7f2e98100600 2024-09-19T09:01:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.970+0000 7f2e877fe640 1 -- 172.21.15.49:0/3321429630 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e88003a80 con 0x7f2e98100600 2024-09-19T09:01:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.970+0000 7f2e9cbec640 1 -- 172.21.15.49:0/3321429630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9819acd0 con 0x7f2e98100600 2024-09-19T09:01:12.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.970+0000 7f2e9cbec640 1 -- 172.21.15.49:0/3321429630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9819b1c0 con 0x7f2e98100600 2024-09-19T09:01:12.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.971+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c005250 con 0x7f2e98100600 2024-09-19T09:01:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.973+0000 7f2e877fe640 1 -- 172.21.15.49:0/3321429630 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2e88031c90 con 0x7f2e98100600 2024-09-19T09:01:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.974+0000 7f2e877fe640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e8006cca0 0x7f2e8006f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:12.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.974+0000 7f2e877fe640 1 -- 172.21.15.49:0/3321429630 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2e880ad2f0 con 0x7f2e98100600 2024-09-19T09:01:12.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.974+0000 7f2e95d9b640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e8006cca0 0x7f2e8006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:12.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.975+0000 7f2e95d9b640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e8006cca0 0x7f2e8006f160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e98196b30 tx=0x7f2e8c005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:12.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:12.980+0000 7f2e877fe640 1 -- 172.21.15.49:0/3321429630 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e880776c0 con 0x7f2e98100600 2024-09-19T09:01:13.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.162+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e7c000bc0 con 0x7f2e8006cca0 2024-09-19T09:01:13.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.173+0000 7f2e877fe640 1 -- 172.21.15.49:0/3321429630 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f2e7c000bc0 con 0x7f2e8006cca0 2024-09-19T09:01:13.174 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:01:13.174 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (5m) 59s ago 6m 25.4M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:01:13.174 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (6m) 59s ago 6m 7520k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:01:13.174 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (6m) 67s ago 6m 7490k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:01:13.174 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 59s ago 6m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:01:13.174 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (5m) 67s ago 5m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 59s ago 6m 84.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (86s) 59s ago 85s 12.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (79s) 59s ago 78s 15.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (76s) 67s ago 76s 16.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (83s) 67s ago 83s 16.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:9283,8765,8443 running (8m) 59s ago 8m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 b57193f2a38e 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (5m) 67s ago 5m 438M - 18.2.4-855-g19e2a2be 980a0bfcd684 7393ef52f781 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 59s ago 8m 46.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (5m) 67s ago 5m 37.7M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 59s ago 6m 15.2M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (5m) 67s ago 5m 16.5M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (4m) 59s ago 4m 47.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:01:13.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 59s ago 4m 54.7M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:01:13.176 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 59s ago 4m 53.7M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:01:13.176 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (3m) 67s ago 3m 46.4M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:01:13.176 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (3m) 67s ago 3m 51.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:01:13.176 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (2m) 67s ago 2m 51.5M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:01:13.176 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (5m) 59s ago 6m 59.4M - 2.43.0 a07b618ecd1d 2151f61fb8cc 2024-09-19T09:01:13.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e8006cca0 msgr2=0x7f2e8006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e8006cca0 0x7f2e8006f160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e98196b30 tx=0x7f2e8c005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:13.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 msgr2=0x7f2e98195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e98195610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2e88004650 tx=0x7f2e880055a0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 shutdown_connections 2024-09-19T09:01:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f2e8006cca0 0x7f2e8006f160 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e98102f30 0x7f2e98195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 --2- 172.21.15.49:0/3321429630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e98100600 0x7f2e98195610 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 >> 172.21.15.49:0/3321429630 conn(0x7f2e980fa200 msgr2=0x7f2e980fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 shutdown_connections 2024-09-19T09:01:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.176+0000 7f2e857fa640 1 -- 172.21.15.49:0/3321429630 wait complete. 2024-09-19T09:01:13.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.262+0000 7f4d7ae16640 1 -- 172.21.15.49:0/3415610149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 msgr2=0x7f4d74101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.262+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/3415610149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 0x7f4d74101250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009880 tx=0x7f4d6002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.263+0000 7f4d7ae16640 1 -- 172.21.15.49:0/3415610149 shutdown_connections 2024-09-19T09:01:13.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.263+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/3415610149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 0x7f4d74101250 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.263+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/3415610149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 0x7f4d740fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.263+0000 7f4d7ae16640 1 -- 172.21.15.49:0/3415610149 >> 172.21.15.49:0/3415610149 conn(0x7f4d740fb360 msgr2=0x7f4d740fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.263+0000 7f4d7ae16640 1 -- 172.21.15.49:0/3415610149 shutdown_connections 2024-09-19T09:01:13.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.263+0000 7f4d7ae16640 1 -- 172.21.15.49:0/3415610149 wait complete. 2024-09-19T09:01:13.264 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:13 smithi049 ceph-mon[28158]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.263+0000 7f4d7ae16640 1 Processor -- start 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d7ae16640 1 -- start start 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d7ae16640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 0x7f4d74195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d7ae16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 0x7f4d74195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d78bb2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 0x7f4d74195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d78bb2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 0x7f4d74195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:58330/0 (socket says 172.21.15.49:58330) 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d78bb2640 1 -- 172.21.15.49:0/2277420548 learned_addr learned my addr 172.21.15.49:0/2277420548 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:13.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d74196190 con 0x7f4d74100dd0 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.264+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d74196300 con 0x7f4d740ffbd0 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.265+0000 7f4d73fff640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 0x7f4d74195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.265+0000 7f4d78bb2640 1 -- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 msgr2=0x7f4d74195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.265+0000 7f4d78bb2640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 0x7f4d74195bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.265+0000 7f4d78bb2640 1 -- 172.21.15.49:0/2277420548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009560 con 0x7f4d740ffbd0 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.265+0000 7f4d73fff640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 0x7f4d74195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.265+0000 7f4d78bb2640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 0x7f4d74195680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e940 tx=0x7f4d6800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.265+0000 7f4d71ffb640 1 -- 172.21.15.49:0/2277420548 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6800cc90 con 0x7f4d740ffbd0 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.266+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d74072740 con 0x7f4d740ffbd0 2024-09-19T09:01:13.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.266+0000 7f4d71ffb640 1 -- 172.21.15.49:0/2277420548 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d680044f0 con 0x7f4d740ffbd0 2024-09-19T09:01:13.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.266+0000 7f4d71ffb640 1 -- 172.21.15.49:0/2277420548 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d68010430 con 0x7f4d740ffbd0 2024-09-19T09:01:13.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.266+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d74072d10 con 0x7f4d740ffbd0 2024-09-19T09:01:13.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.267+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d74074700 con 0x7f4d740ffbd0 2024-09-19T09:01:13.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.268+0000 7f4d71ffb640 1 -- 172.21.15.49:0/2277420548 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4d68003f20 con 0x7f4d740ffbd0 2024-09-19T09:01:13.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.269+0000 7f4d71ffb640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4d6406cc60 0x7f4d6406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.270+0000 7f4d73fff640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4d6406cc60 0x7f4d6406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.270+0000 7f4d71ffb640 1 -- 172.21.15.49:0/2277420548 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4d68014070 con 0x7f4d740ffbd0 2024-09-19T09:01:13.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.270+0000 7f4d73fff640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4d6406cc60 0x7f4d6406f120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d60031540 tx=0x7f4d60000bc0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.278+0000 7f4d71ffb640 1 -- 172.21.15.49:0/2277420548 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4d68056bc0 con 0x7f4d740ffbd0 2024-09-19T09:01:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:13 smithi102 ceph-mon[35280]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.548+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4d7402c4f0 con 0x7f4d740ffbd0 2024-09-19T09:01:13.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.549+0000 7f4d71ffb640 1 -- 172.21.15.49:0/2277420548 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f4d6805a1e0 con 0x7f4d740ffbd0 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:01:13.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:13.551 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:01:13.551 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-19T09:01:13.551 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:01:13.551 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:01:13.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4d6406cc60 msgr2=0x7f4d6406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4d6406cc60 0x7f4d6406f120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d60031540 tx=0x7f4d60000bc0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 msgr2=0x7f4d74195680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 0x7f4d74195680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e940 tx=0x7f4d6800ee00 comp rx=0 tx=0).stop 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 shutdown_connections 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f4d6406cc60 0x7f4d6406f120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d74100dd0 0x7f4d74195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 --2- 172.21.15.49:0/2277420548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d740ffbd0 0x7f4d74195680 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 >> 172.21.15.49:0/2277420548 conn(0x7f4d740fb360 msgr2=0x7f4d74104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 shutdown_connections 2024-09-19T09:01:13.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.552+0000 7f4d7ae16640 1 -- 172.21.15.49:0/2277420548 wait complete. 2024-09-19T09:01:13.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.640+0000 7fcd8ab63640 1 -- 172.21.15.49:0/3534544948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840ffcf0 msgr2=0x7fcd84100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.640+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/3534544948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840ffcf0 0x7fcd84100170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009880 tx=0x7fcd7002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.640+0000 7fcd8ab63640 1 -- 172.21.15.49:0/3534544948 shutdown_connections 2024-09-19T09:01:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.640+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/3534544948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840ffcf0 0x7fcd84100170 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.640+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/3534544948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd840feaf0 0x7fcd840feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.640+0000 7fcd8ab63640 1 -- 172.21.15.49:0/3534544948 >> 172.21.15.49:0/3534544948 conn(0x7fcd840fa280 msgr2=0x7fcd840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.641+0000 7fcd8ab63640 1 -- 172.21.15.49:0/3534544948 shutdown_connections 2024-09-19T09:01:13.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.641+0000 7fcd8ab63640 1 -- 172.21.15.49:0/3534544948 wait complete. 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.641+0000 7fcd8ab63640 1 Processor -- start 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd8ab63640 1 -- start start 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd8ab63640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840feaf0 0x7fcd84068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd8ab63640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd840ffcf0 0x7fcd8419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd8ab63640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8419a9a0 con 0x7fcd840feaf0 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd8ab63640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8419aae0 con 0x7fcd840ffcf0 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd888ff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840feaf0 0x7fcd84068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd888ff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840feaf0 0x7fcd84068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44092/0 (socket says 172.21.15.49:44092) 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd888ff640 1 -- 172.21.15.49:0/1434288132 learned_addr learned my addr 172.21.15.49:0/1434288132 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd83fff640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd840ffcf0 0x7fcd8419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.642+0000 7fcd888ff640 1 -- 172.21.15.49:0/1434288132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd840ffcf0 msgr2=0x7fcd8419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd888ff640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd840ffcf0 0x7fcd8419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd888ff640 1 -- 172.21.15.49:0/1434288132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70009560 con 0x7fcd840feaf0 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd888ff640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840feaf0 0x7fcd84068790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800e940 tx=0x7fcd7800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd81ffb640 1 -- 172.21.15.49:0/1434288132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd78009700 con 0x7fcd840feaf0 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd81ffb640 1 -- 172.21.15.49:0/1434288132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd7800cc90 con 0x7fcd840feaf0 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd81ffb640 1 -- 172.21.15.49:0/1434288132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd78010430 con 0x7fcd840feaf0 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8419ad90 con 0x7fcd840feaf0 2024-09-19T09:01:13.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.643+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8419b2b0 con 0x7fcd840feaf0 2024-09-19T09:01:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.645+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd840feef0 con 0x7fcd840feaf0 2024-09-19T09:01:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.645+0000 7fcd81ffb640 1 -- 172.21.15.49:0/1434288132 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcd78003fa0 con 0x7fcd840feaf0 2024-09-19T09:01:13.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.646+0000 7fcd81ffb640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd7406cc50 0x7fcd7406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.646+0000 7fcd83fff640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd7406cc50 0x7fcd7406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.646+0000 7fcd81ffb640 1 -- 172.21.15.49:0/1434288132 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fcd78014070 con 0x7fcd840feaf0 2024-09-19T09:01:13.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.647+0000 7fcd83fff640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd7406cc50 0x7fcd7406f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd700314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.651+0000 7fcd81ffb640 1 -- 172.21.15.49:0/1434288132 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd78056ab0 con 0x7fcd840feaf0 2024-09-19T09:01:13.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.877+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd8402c480 con 0x7fcd840feaf0 2024-09-19T09:01:13.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.877+0000 7fcd81ffb640 1 -- 172.21.15.49:0/1434288132 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7fcd7805a0d0 con 0x7fcd840feaf0 2024-09-19T09:01:13.878 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:01:13.878 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:01:13.878 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:01:13.879 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:01:13.880 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:01:13.881 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:01:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:01:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd7406cc50 msgr2=0x7fcd7406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd7406cc50 0x7fcd7406f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd700314e0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840feaf0 msgr2=0x7fcd84068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840feaf0 0x7fcd84068790 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800e940 tx=0x7fcd7800ee00 comp rx=0 tx=0).stop 2024-09-19T09:01:13.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 shutdown_connections 2024-09-19T09:01:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fcd7406cc50 0x7fcd7406f110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd840ffcf0 0x7fcd8419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 --2- 172.21.15.49:0/1434288132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd840feaf0 0x7fcd84068790 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 >> 172.21.15.49:0/1434288132 conn(0x7fcd840fa280 msgr2=0x7fcd841033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 shutdown_connections 2024-09-19T09:01:13.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.880+0000 7fcd8ab63640 1 -- 172.21.15.49:0/1434288132 wait complete. 2024-09-19T09:01:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 -- 172.21.15.49:0/1381685527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fee10 msgr2=0x7fc8cc0ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 --2- 172.21.15.49:0/1381685527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fee10 0x7fc8cc0ff270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009880 tx=0x7fc8bc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 -- 172.21.15.49:0/1381685527 shutdown_connections 2024-09-19T09:01:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 --2- 172.21.15.49:0/1381685527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fee10 0x7fc8cc0ff270 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 --2- 172.21.15.49:0/1381685527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8cc0fe4d0 0x7fc8cc0fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 -- 172.21.15.49:0/1381685527 >> 172.21.15.49:0/1381685527 conn(0x7fc8cc0fa280 msgr2=0x7fc8cc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 -- 172.21.15.49:0/1381685527 shutdown_connections 2024-09-19T09:01:13.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.966+0000 7fc8d421e640 1 -- 172.21.15.49:0/1381685527 wait complete. 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.967+0000 7fc8d421e640 1 Processor -- start 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.967+0000 7fc8d421e640 1 -- start start 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.967+0000 7fc8d421e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fe4d0 0x7fc8cc1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.967+0000 7fc8d421e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8cc0fee10 0x7fc8cc197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.967+0000 7fc8d421e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc1983c0 con 0x7fc8cc0fe4d0 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.967+0000 7fc8d421e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc198530 con 0x7fc8cc0fee10 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d1fba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fe4d0 0x7fc8cc1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d1fba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fe4d0 0x7fc8cc1978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44106/0 (socket says 172.21.15.49:44106) 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d1fba640 1 -- 172.21.15.49:0/477975694 learned_addr learned my addr 172.21.15.49:0/477975694 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d17b9640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8cc0fee10 0x7fc8cc197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d17b9640 1 -- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fe4d0 msgr2=0x7fc8cc1978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d17b9640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fe4d0 0x7fc8cc1978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d17b9640 1 -- 172.21.15.49:0/477975694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc009560 con 0x7fc8cc0fee10 2024-09-19T09:01:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d1fba640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fe4d0 0x7fc8cc1978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.968+0000 7fc8d17b9640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8cc0fee10 0x7fc8cc197df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc02a9c0 tx=0x7fc8bc0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.969+0000 7fc8c2ffd640 1 -- 172.21.15.49:0/477975694 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8bc004aa0 con 0x7fc8cc0fee10 2024-09-19T09:01:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.969+0000 7fc8c2ffd640 1 -- 172.21.15.49:0/477975694 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8bc005d50 con 0x7fc8cc0fee10 2024-09-19T09:01:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.969+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc19cf20 con 0x7fc8cc0fee10 2024-09-19T09:01:13.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.969+0000 7fc8c2ffd640 1 -- 172.21.15.49:0/477975694 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8bc0039b0 con 0x7fc8cc0fee10 2024-09-19T09:01:13.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.969+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc19d3e0 con 0x7fc8cc0fee10 2024-09-19T09:01:13.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.970+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc0fe8d0 con 0x7fc8cc0fee10 2024-09-19T09:01:13.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.971+0000 7fc8c2ffd640 1 -- 172.21.15.49:0/477975694 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc8bc031c00 con 0x7fc8cc0fee10 2024-09-19T09:01:13.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.972+0000 7fc8c2ffd640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc8b806cc60 0x7fc8b806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.972+0000 7fc8c2ffd640 1 -- 172.21.15.49:0/477975694 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc8bc0ad300 con 0x7fc8cc0fee10 2024-09-19T09:01:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.972+0000 7fc8d1fba640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc8b806cc60 0x7fc8b806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.973+0000 7fc8d1fba640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc8b806cc60 0x7fc8b806f120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8011550 tx=0x7fc8c8005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:13.980+0000 7fc8c2ffd640 1 -- 172.21.15.49:0/477975694 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc8bc077680 con 0x7fc8cc0fee10 2024-09-19T09:01:14.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.172+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8cc02c570 con 0x7fc8b806cc60 2024-09-19T09:01:14.177 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:01:14.177 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:01:14.180 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:01:14.180 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:01:14.180 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-09-19T09:01:14.180 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "0/23 daemons upgraded", 2024-09-19T09:01:14.180 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e image on host smithi102", 2024-09-19T09:01:14.180 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:01:14.180 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.174+0000 7fc8c2ffd640 1 -- 172.21.15.49:0/477975694 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc8cc02c570 con 0x7fc8b806cc60 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.177+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc8b806cc60 msgr2=0x7fc8b806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.177+0000 7fc8d421e640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc8b806cc60 0x7fc8b806f120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8011550 tx=0x7fc8c8005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.177+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8cc0fee10 msgr2=0x7fc8cc197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.178+0000 7fc8d421e640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8cc0fee10 0x7fc8cc197df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc02a9c0 tx=0x7fc8bc0055a0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.178+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 shutdown_connections 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.178+0000 7fc8d421e640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc8b806cc60 0x7fc8b806f120 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8011550 tx=0x7fc8c8005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.178+0000 7fc8d421e640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8cc0fee10 0x7fc8cc197df0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc02a9c0 tx=0x7fc8bc0055a0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.178+0000 7fc8d421e640 1 --2- 172.21.15.49:0/477975694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8cc0fe4d0 0x7fc8cc1978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.178+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 >> 172.21.15.49:0/477975694 conn(0x7fc8cc0fa280 msgr2=0x7fc8cc106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:14.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.179+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 shutdown_connections 2024-09-19T09:01:14.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.179+0000 7fc8d421e640 1 -- 172.21.15.49:0/477975694 wait complete. 2024-09-19T09:01:14.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.268+0000 7f7a841f8640 1 -- 172.21.15.49:0/3594256223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c100610 msgr2=0x7f7a7c102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.268+0000 7f7a841f8640 1 --2- 172.21.15.49:0/3594256223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c100610 0x7f7a7c102a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a780098b0 tx=0x7f7a7802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.268+0000 7f7a841f8640 1 -- 172.21.15.49:0/3594256223 shutdown_connections 2024-09-19T09:01:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.268+0000 7f7a841f8640 1 --2- 172.21.15.49:0/3594256223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a7c102f40 0x7f7a7c105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.268+0000 7f7a841f8640 1 --2- 172.21.15.49:0/3594256223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c100610 0x7f7a7c102a00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.268+0000 7f7a841f8640 1 -- 172.21.15.49:0/3594256223 >> 172.21.15.49:0/3594256223 conn(0x7f7a7c0fa230 msgr2=0x7f7a7c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.269+0000 7f7a841f8640 1 -- 172.21.15.49:0/3594256223 shutdown_connections 2024-09-19T09:01:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.269+0000 7f7a841f8640 1 -- 172.21.15.49:0/3594256223 wait complete. 2024-09-19T09:01:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.269+0000 7f7a841f8640 1 Processor -- start 2024-09-19T09:01:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.269+0000 7f7a841f8640 1 -- start start 2024-09-19T09:01:14.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a841f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a7c100610 0x7f7a7c195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a841f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c102f40 0x7f7a7c195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a841f8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c196190 con 0x7f7a7c102f40 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a841f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c196300 con 0x7f7a7c100610 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a81793640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c102f40 0x7f7a7c195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a81793640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c102f40 0x7f7a7c195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44114/0 (socket says 172.21.15.49:44114) 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a81793640 1 -- 172.21.15.49:0/2404665544 learned_addr learned my addr 172.21.15.49:0/2404665544 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a81f94640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a7c100610 0x7f7a7c195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a81793640 1 -- 172.21.15.49:0/2404665544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a7c100610 msgr2=0x7f7a7c195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a81793640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a7c100610 0x7f7a7c195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.270+0000 7f7a81793640 1 -- 172.21.15.49:0/2404665544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a78009560 con 0x7f7a7c102f40 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.271+0000 7f7a81793640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c102f40 0x7f7a7c195bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e970 tx=0x7f7a6c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:14.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.271+0000 7f7a72ffd640 1 -- 172.21.15.49:0/2404665544 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a6c009700 con 0x7f7a7c102f40 2024-09-19T09:01:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.271+0000 7f7a72ffd640 1 -- 172.21.15.49:0/2404665544 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a6c0054e0 con 0x7f7a7c102f40 2024-09-19T09:01:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.271+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c0fe460 con 0x7f7a7c102f40 2024-09-19T09:01:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.271+0000 7f7a72ffd640 1 -- 172.21.15.49:0/2404665544 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a6c010430 con 0x7f7a7c102f40 2024-09-19T09:01:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.271+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0fea30 con 0x7f7a7c102f40 2024-09-19T09:01:14.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.272+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c1087a0 con 0x7f7a7c102f40 2024-09-19T09:01:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.273+0000 7f7a72ffd640 1 -- 172.21.15.49:0/2404665544 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7a6c00cc90 con 0x7f7a7c102f40 2024-09-19T09:01:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.274+0000 7f7a72ffd640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7a6806cc50 0x7f7a6806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.274+0000 7f7a72ffd640 1 -- 172.21.15.49:0/2404665544 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7a6c014070 con 0x7f7a7c102f40 2024-09-19T09:01:14.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.274+0000 7f7a81f94640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7a6806cc50 0x7f7a6806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.274+0000 7f7a81f94640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7a6806cc50 0x7f7a6806f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a78006010 tx=0x7f7a780314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.278+0000 7f7a72ffd640 1 -- 172.21.15.49:0/2404665544 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a6c056a60 con 0x7f7a7c102f40 2024-09-19T09:01:14.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:14 smithi102 ceph-mon[35280]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:14.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:14 smithi102 ceph-mon[35280]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:14.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:14 smithi102 ceph-mon[35280]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:14.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:14 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2277420548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:01:14.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:14 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1434288132' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:01:14.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.518+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7a7c108930 con 0x7f7a7c102f40 2024-09-19T09:01:14.519 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:14 smithi049 ceph-mon[28158]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:14.519 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:14 smithi049 ceph-mon[28158]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:14.519 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:14 smithi049 ceph-mon[28158]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:14.519 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:14 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2277420548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:01:14.520 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:14 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1434288132' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:01:14.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.519+0000 7f7a72ffd640 1 -- 172.21.15.49:0/2404665544 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7a6c05a080 con 0x7f7a7c102f40 2024-09-19T09:01:14.520 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:01:14.520 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:01:14.520 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:01:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.522+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7a6806cc50 msgr2=0x7f7a6806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.522+0000 7f7a841f8640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7a6806cc50 0x7f7a6806f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a78006010 tx=0x7f7a780314e0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.522+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c102f40 msgr2=0x7f7a7c195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.522+0000 7f7a841f8640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c102f40 0x7f7a7c195bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e970 tx=0x7f7a6c00ee30 comp rx=0 tx=0).stop 2024-09-19T09:01:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.523+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 shutdown_connections 2024-09-19T09:01:14.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.523+0000 7f7a841f8640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f7a6806cc50 0x7f7a6806f110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.523+0000 7f7a841f8640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a7c102f40 0x7f7a7c195bc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.523+0000 7f7a841f8640 1 --2- 172.21.15.49:0/2404665544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a7c100610 0x7f7a7c195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.523+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 >> 172.21.15.49:0/2404665544 conn(0x7f7a7c0fa230 msgr2=0x7f7a7c0fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.523+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 shutdown_connections 2024-09-19T09:01:14.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:14.523+0000 7f7a841f8640 1 -- 172.21.15.49:0/2404665544 wait complete. 2024-09-19T09:01:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:15 smithi102 ceph-mon[35280]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:15 smithi102 ceph-mon[35280]: from='client.24387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:15 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2404665544' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:01:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:15 smithi049 ceph-mon[28158]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:15 smithi049 ceph-mon[28158]: from='client.24387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:15 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2404665544' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:01:17.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:17 smithi049 ceph-mon[28158]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:01:17.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:17 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:17 smithi102 ceph-mon[35280]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:01:17.527 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:17 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:19 smithi102 ceph-mon[35280]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:19.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:19 smithi049 ceph-mon[28158]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:21.185 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:21 smithi102 ceph-mon[35280]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:21.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:21 smithi049 ceph-mon[28158]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:23.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:23 smithi102 ceph-mon[35280]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:23.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:23 smithi049 ceph-mon[28158]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:25.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:25 smithi102 ceph-mon[35280]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:25.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:25 smithi049 ceph-mon[28158]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:27.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:27 smithi049 ceph-mon[28158]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:01:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:27 smithi102 ceph-mon[35280]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:01:28.214 INFO:tasks.workunit.client.1.smithi102.stderr:Updating files: 90% (11678/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:01:28.722 INFO:tasks.workunit.client.1.smithi102.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:01:28.722 INFO:tasks.workunit.client.1.smithi102.stderr: 2024-09-19T09:01:28.722 INFO:tasks.workunit.client.1.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:01:28.722 INFO:tasks.workunit.client.1.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:01:28.722 INFO:tasks.workunit.client.1.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:01:28.722 INFO:tasks.workunit.client.1.smithi102.stderr: 2024-09-19T09:01:28.722 INFO:tasks.workunit.client.1.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr: 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr: git switch -c 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr: 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr:Or undo this operation with: 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr: 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr: git switch - 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr: 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr: 2024-09-19T09:01:28.723 INFO:tasks.workunit.client.1.smithi102.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:01:28.725 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 93% (12055/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:01:28.728 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-19T09:01:28.793 INFO:tasks.workunit.client.1.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:01:28.796 INFO:tasks.workunit.client.1.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-19T09:01:28.796 INFO:tasks.workunit.client.1.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:01:29.488 INFO:tasks.workunit.client.1.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:01:29.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:29 smithi102 ceph-mon[35280]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:29 smithi049 ceph-mon[28158]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:29.566 INFO:tasks.workunit.client.1.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:01:29.612 INFO:tasks.workunit.client.1.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-19T09:01:29.614 INFO:tasks.workunit.client.1.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-19T09:01:29.614 INFO:tasks.workunit.client.1.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:01:29.664 INFO:tasks.workunit.client.1.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-19T09:01:29.665 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T09:01:29.666 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-19T09:01:29.723 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-19T09:01:29.725 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T09:01:29.725 DEBUG:teuthology.orchestra.run.smithi102:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-19T09:01:29.755 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:01:29.755 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-19T09:01:29.755 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:01:29.755 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:01:29.756 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-19T09:01:29.757 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:01:29.761 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:01:29.793 INFO:tasks.workunit.client.1.smithi102.stderr:+ mkdir -p fsstress 2024-09-19T09:01:29.795 INFO:tasks.workunit.client.1.smithi102.stderr:+ pushd fsstress 2024-09-19T09:01:29.797 INFO:tasks.workunit.client.1.smithi102.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:01:29.797 INFO:tasks.workunit.client.1.smithi102.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T09:01:29.827 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:01:29.829 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:01:29.830 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:01:31.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:31 smithi102 ceph-mon[35280]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:31.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:31 smithi049 ceph-mon[28158]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:01:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:32 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:32.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:32 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:33.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:33 smithi049 ceph-mon[28158]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:33.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:33 smithi102 ceph-mon[35280]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:01:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:35 smithi102 ceph-mon[35280]: pgmap v230: 65 pgs: 65 active+clean; 601 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-19T09:01:35.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:35 smithi049 ceph-mon[28158]: pgmap v230: 65 pgs: 65 active+clean; 601 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-19T09:01:35.962 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:01:36.367 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:01:36.543 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:01:36.545 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:01:36.545 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:01:36.769 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:01:36.905 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:01:36.905 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:01:36.925 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-19T09:01:36.926 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T09:01:36.926 DEBUG:teuthology.orchestra.run.smithi049:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-19T09:01:36.993 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir -p fsstress 2024-09-19T09:01:36.995 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd fsstress 2024-09-19T09:01:36.996 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:01:36.996 INFO:tasks.workunit.client.0.smithi049.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T09:01:37.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:36 smithi049 ceph-mon[28158]: Upgrade: Updating mgr.smithi102.csalqv 2024-09-19T09:01:37.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:01:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:01:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:36 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:36 smithi049 ceph-mon[28158]: Deploying daemon mgr.smithi102.csalqv on smithi102 2024-09-19T09:01:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:36 smithi049 ceph-mon[28158]: pgmap v231: 65 pgs: 65 active+clean; 601 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:01:37.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:36 smithi102 ceph-mon[35280]: Upgrade: Updating mgr.smithi102.csalqv 2024-09-19T09:01:37.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:37.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:01:37.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:01:37.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:36 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.109 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:36 smithi102 ceph-mon[35280]: Deploying daemon mgr.smithi102.csalqv on smithi102 2024-09-19T09:01:37.109 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:36 smithi102 ceph-mon[35280]: pgmap v231: 65 pgs: 65 active+clean; 601 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:01:39.305 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:39 smithi102 ceph-mon[35280]: pgmap v232: 65 pgs: 65 active+clean; 601 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:01:39.338 INFO:tasks.workunit.client.1.smithi102.stderr:+ tar xzf ltp-full.tgz 2024-09-19T09:01:39.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:39 smithi049 ceph-mon[28158]: pgmap v232: 65 pgs: 65 active+clean; 601 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:01:40.712 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:40 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:40.712 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:40 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:40.712 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:40 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:40.712 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:40 smithi102 ceph-mon[35280]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 199 MiB used, 536 GiB / 536 GiB avail; 4.4 KiB/s rd, 344 KiB/s wr, 5 op/s 2024-09-19T09:01:40.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:40 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:40.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:40 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:40.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:40 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:40.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:40 smithi049 ceph-mon[28158]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 199 MiB used, 536 GiB / 536 GiB avail; 4.4 KiB/s rd, 344 KiB/s wr, 5 op/s 2024-09-19T09:01:43.441 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:43 smithi102 ceph-mon[35280]: pgmap v234: 65 pgs: 65 active+clean; 10 MiB data, 226 MiB used, 536 GiB / 536 GiB avail; 4.4 KiB/s rd, 818 KiB/s wr, 25 op/s 2024-09-19T09:01:43.441 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.441 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.442 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.442 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:43 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:43 smithi049 ceph-mon[28158]: pgmap v234: 65 pgs: 65 active+clean; 10 MiB data, 226 MiB used, 536 GiB / 536 GiB avail; 4.4 KiB/s rd, 818 KiB/s wr, 25 op/s 2024-09-19T09:01:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:43 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:43.603 INFO:tasks.workunit.client.0.smithi049.stderr:+ tar xzf ltp-full.tgz 2024-09-19T09:01:44.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.623+0000 7fd576b30640 1 -- 172.21.15.49:0/1708268313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd570100d90 msgr2=0x7fd570101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.623+0000 7fd576b30640 1 --2- 172.21.15.49:0/1708268313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd570100d90 0x7fd570101210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009880 tx=0x7fd55c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.623+0000 7fd576b30640 1 -- 172.21.15.49:0/1708268313 shutdown_connections 2024-09-19T09:01:44.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.623+0000 7fd576b30640 1 --2- 172.21.15.49:0/1708268313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd570100d90 0x7fd570101210 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.623+0000 7fd576b30640 1 --2- 172.21.15.49:0/1708268313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5700ffb90 0x7fd5700fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.623+0000 7fd576b30640 1 -- 172.21.15.49:0/1708268313 >> 172.21.15.49:0/1708268313 conn(0x7fd5700fb360 msgr2=0x7fd5700fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 -- 172.21.15.49:0/1708268313 shutdown_connections 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 -- 172.21.15.49:0/1708268313 wait complete. 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 Processor -- start 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 -- start start 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5700ffb90 0x7fd57019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd570100d90 0x7fd57019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57019c6e0 con 0x7fd5700ffb90 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.624+0000 7fd576b30640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57019c850 con 0x7fd570100d90 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd5748cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5700ffb90 0x7fd57019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd5748cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5700ffb90 0x7fd57019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38656/0 (socket says 172.21.15.49:38656) 2024-09-19T09:01:44.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd5748cc640 1 -- 172.21.15.49:0/3234752336 learned_addr learned my addr 172.21.15.49:0/3234752336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd56ffff640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd570100d90 0x7fd57019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd56ffff640 1 -- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5700ffb90 msgr2=0x7fd57019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd56ffff640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5700ffb90 0x7fd57019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd56ffff640 1 -- 172.21.15.49:0/3234752336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c009560 con 0x7fd570100d90 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd5748cc640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5700ffb90 0x7fd57019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd56ffff640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd570100d90 0x7fd57019c110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd55c02a9c0 tx=0x7fd55c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.625+0000 7fd56dffb640 1 -- 172.21.15.49:0/3234752336 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55c004aa0 con 0x7fd570100d90 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.626+0000 7fd56dffb640 1 -- 172.21.15.49:0/3234752336 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd55c005d50 con 0x7fd570100d90 2024-09-19T09:01:44.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.626+0000 7fd56dffb640 1 -- 172.21.15.49:0/3234752336 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55c0039b0 con 0x7fd570100d90 2024-09-19T09:01:44.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.626+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5701a1290 con 0x7fd570100d90 2024-09-19T09:01:44.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.626+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5701a1800 con 0x7fd570100d90 2024-09-19T09:01:44.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.627+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd570073490 con 0x7fd570100d90 2024-09-19T09:01:44.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.628+0000 7fd56dffb640 1 -- 172.21.15.49:0/3234752336 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd55c031c00 con 0x7fd570100d90 2024-09-19T09:01:44.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.628+0000 7fd56dffb640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd56006ccb0 0x7fd56006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.628+0000 7fd56dffb640 1 -- 172.21.15.49:0/3234752336 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd55c0ad0e0 con 0x7fd570100d90 2024-09-19T09:01:44.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.628+0000 7fd5748cc640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd56006ccb0 0x7fd56006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.629+0000 7fd5748cc640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd56006ccb0 0x7fd56006f170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5640058c0 tx=0x7fd564005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.634+0000 7fd56dffb640 1 -- 172.21.15.49:0/3234752336 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd55c077620 con 0x7fd570100d90 2024-09-19T09:01:44.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.907+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd570105070 con 0x7fd56006ccb0 2024-09-19T09:01:44.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.909+0000 7fd56dffb640 1 -- 172.21.15.49:0/3234752336 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fd570105070 con 0x7fd56006ccb0 2024-09-19T09:01:44.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.911+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd56006ccb0 msgr2=0x7fd56006f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd56006ccb0 0x7fd56006f170 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5640058c0 tx=0x7fd564005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:44.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd570100d90 msgr2=0x7fd57019c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd570100d90 0x7fd57019c110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd55c02a9c0 tx=0x7fd55c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 shutdown_connections 2024-09-19T09:01:44.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fd56006ccb0 0x7fd56006f170 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd570100d90 0x7fd57019c110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 --2- 172.21.15.49:0/3234752336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5700ffb90 0x7fd57019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 >> 172.21.15.49:0/3234752336 conn(0x7fd5700fb360 msgr2=0x7fd5700fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 shutdown_connections 2024-09-19T09:01:44.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:44.912+0000 7fd576b30640 1 -- 172.21.15.49:0/3234752336 wait complete. 2024-09-19T09:01:44.922 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:01:45.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.018+0000 7f6f4caa3640 1 -- 172.21.15.49:0/1058432241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 msgr2=0x7f6f48105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.018+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/1058432241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48105400 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009880 tx=0x7f6f3c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.018+0000 7f6f4caa3640 1 -- 172.21.15.49:0/1058432241 shutdown_connections 2024-09-19T09:01:45.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.019+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/1058432241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48105400 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.019+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/1058432241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f481006e0 0x7f6f48102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.019+0000 7f6f4caa3640 1 -- 172.21.15.49:0/1058432241 >> 172.21.15.49:0/1058432241 conn(0x7f6f480fa280 msgr2=0x7f6f480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.019+0000 7f6f4caa3640 1 -- 172.21.15.49:0/1058432241 shutdown_connections 2024-09-19T09:01:45.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.019+0000 7f6f4caa3640 1 -- 172.21.15.49:0/1058432241 wait complete. 2024-09-19T09:01:45.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f4caa3640 1 Processor -- start 2024-09-19T09:01:45.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f4caa3640 1 -- start start 2024-09-19T09:01:45.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f4caa3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f481006e0 0x7f6f48195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f4caa3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f4caa3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48196150 con 0x7f6f48103010 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f4caa3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481962c0 con 0x7f6f481006e0 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f45d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f481006e0 0x7f6f48195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f45d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38680/0 (socket says 172.21.15.49:38680) 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.020+0000 7f6f45d9b640 1 -- 172.21.15.49:0/4088683353 learned_addr learned my addr 172.21.15.49:0/4088683353 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f45d9b640 1 -- 172.21.15.49:0/4088683353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f481006e0 msgr2=0x7f6f48195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f45d9b640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f481006e0 0x7f6f48195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f45d9b640 1 -- 172.21.15.49:0/4088683353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c009560 con 0x7f6f48103010 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f4659c640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f481006e0 0x7f6f48195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f45d9b640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48195b80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c004650 tx=0x7f6f3c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f377fe640 1 -- 172.21.15.49:0/4088683353 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f3c004aa0 con 0x7f6f48103010 2024-09-19T09:01:45.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4819ad60 con 0x7f6f48103010 2024-09-19T09:01:45.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f377fe640 1 -- 172.21.15.49:0/4088683353 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f3c005d50 con 0x7f6f48103010 2024-09-19T09:01:45.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f377fe640 1 -- 172.21.15.49:0/4088683353 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f3c0039e0 con 0x7f6f48103010 2024-09-19T09:01:45.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.021+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4819b2b0 con 0x7f6f48103010 2024-09-19T09:01:45.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.023+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f48108790 con 0x7f6f48103010 2024-09-19T09:01:45.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.023+0000 7f6f377fe640 1 -- 172.21.15.49:0/4088683353 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6f3c003ca0 con 0x7f6f48103010 2024-09-19T09:01:45.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.024+0000 7f6f377fe640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f6f3006cc50 0x7f6f3006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.024+0000 7f6f377fe640 1 -- 172.21.15.49:0/4088683353 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6f3c0ad290 con 0x7f6f48103010 2024-09-19T09:01:45.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.024+0000 7f6f4659c640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f6f3006cc50 0x7f6f3006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.025+0000 7f6f4659c640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f6f3006cc50 0x7f6f3006f110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009fc0 tx=0x7f6f38005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.029+0000 7f6f377fe640 1 -- 172.21.15.49:0/4088683353 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6f3c077720 con 0x7f6f48103010 2024-09-19T09:01:45.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.312+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f4819aef0 con 0x7f6f3006cc50 2024-09-19T09:01:45.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.313+0000 7f6f377fe640 1 -- 172.21.15.49:0/4088683353 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f6f4819aef0 con 0x7f6f3006cc50 2024-09-19T09:01:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f6f3006cc50 msgr2=0x7f6f3006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f6f3006cc50 0x7f6f3006f110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009fc0 tx=0x7f6f38005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 msgr2=0x7f6f48195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48195b80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c004650 tx=0x7f6f3c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 shutdown_connections 2024-09-19T09:01:45.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f6f3006cc50 0x7f6f3006f110 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f48103010 0x7f6f48195b80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 --2- 172.21.15.49:0/4088683353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f481006e0 0x7f6f48195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 >> 172.21.15.49:0/4088683353 conn(0x7f6f480fa280 msgr2=0x7f6f480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.316+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 shutdown_connections 2024-09-19T09:01:45.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.317+0000 7f6f4caa3640 1 -- 172.21.15.49:0/4088683353 wait complete. 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 -- 172.21.15.49:0/2686346944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 msgr2=0x7fc8a80feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 --2- 172.21.15.49:0/2686346944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 0x7fc8a80feef0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc898009880 tx=0x7fc89802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 -- 172.21.15.49:0/2686346944 shutdown_connections 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 --2- 172.21.15.49:0/2686346944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8a80ffcf0 0x7fc8a8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 --2- 172.21.15.49:0/2686346944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 0x7fc8a80feef0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 -- 172.21.15.49:0/2686346944 >> 172.21.15.49:0/2686346944 conn(0x7fc8a80fa280 msgr2=0x7fc8a80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 -- 172.21.15.49:0/2686346944 shutdown_connections 2024-09-19T09:01:45.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.420+0000 7fc8ae603640 1 -- 172.21.15.49:0/2686346944 wait complete. 2024-09-19T09:01:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8ae603640 1 Processor -- start 2024-09-19T09:01:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8ae603640 1 -- start start 2024-09-19T09:01:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8ae603640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 0x7fc8a81978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8ae603640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8a80ffcf0 0x7fc8a8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8ae603640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81983e0 con 0x7fc8a80feaf0 2024-09-19T09:01:45.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8ae603640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a8198550 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 0x7fc8a81978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8a7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 0x7fc8a81978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38700/0 (socket says 172.21.15.49:38700) 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc8a7fff640 1 -- 172.21.15.49:0/1749518540 learned_addr learned my addr 172.21.15.49:0/1749518540 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.421+0000 7fc89ffff640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8a80ffcf0 0x7fc8a8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc89ffff640 1 -- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 msgr2=0x7fc8a81978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc89ffff640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 0x7fc8a81978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc89ffff640 1 -- 172.21.15.49:0/1749518540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009560 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc89ffff640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8a80ffcf0 0x7fc8a8197e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e970 tx=0x7fc89000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc8a5ffb640 1 -- 172.21.15.49:0/1749518540 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc890009620 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a819cff0 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc8a5ffb640 1 -- 172.21.15.49:0/1749518540 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8900044f0 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a819d510 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.422+0000 7fc8a5ffb640 1 -- 172.21.15.49:0/1749518540 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8900049d0 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.424+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a80feef0 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.424+0000 7fc8a5ffb640 1 -- 172.21.15.49:0/1749518540 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc890004030 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.425+0000 7fc8a5ffb640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc89406cc50 0x7fc89406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.425+0000 7fc8a5ffb640 1 -- 172.21.15.49:0/1749518540 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc890014070 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.425+0000 7fc8a7fff640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc89406cc50 0x7fc89406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.426+0000 7fc8a7fff640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc89406cc50 0x7fc89406f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc898000c00 tx=0x7fc8980314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.430+0000 7fc8a5ffb640 1 -- 172.21.15.49:0/1749518540 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc8900568e0 con 0x7fc8a80ffcf0 2024-09-19T09:01:45.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:45 smithi049 ceph-mon[28158]: pgmap v235: 65 pgs: 65 active+clean; 16 MiB data, 248 MiB used, 536 GiB / 536 GiB avail; 248 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-09-19T09:01:45.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:45 smithi102 ceph-mon[35280]: pgmap v235: 65 pgs: 65 active+clean; 16 MiB data, 248 MiB used, 536 GiB / 536 GiB avail; 248 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-09-19T09:01:45.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.678+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8a80683f0 con 0x7fc89406cc50 2024-09-19T09:01:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.689+0000 7fc8a5ffb640 1 -- 172.21.15.49:0/1749518540 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc8a80683f0 con 0x7fc89406cc50 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (5m) 92s ago 7m 25.4M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (7m) 92s ago 7m 7520k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (6m) 3s ago 6m 7801k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 92s ago 7m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (6m) 3s ago 6m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 92s ago 7m 84.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (119s) 92s ago 118s 12.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:01:45.690 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (111s) 92s ago 111s 15.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (109s) 3s ago 109s 21.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (116s) 3s ago 115s 19.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:9283,8765,8443 running (8m) 92s ago 8m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 b57193f2a38e 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (6s) 3s ago 6m 62.9M - 19.1.1-361-g2f599a46 d2baa855c067 83adb7fb6aac 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 92s ago 8m 46.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (6m) 3s ago 6m 39.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (7m) 92s ago 7m 15.2M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (6m) 3s ago 6m 17.1M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 92s ago 5m 47.3M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 92s ago 5m 54.7M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 92s ago 4m 53.7M 3946M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (4m) 3s ago 4m 51.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (3m) 3s ago 3m 54.4M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:01:45.691 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (3m) 3s ago 3m 63.3M 4970M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:01:45.692 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (5m) 92s ago 6m 59.4M - 2.43.0 a07b618ecd1d 2151f61fb8cc 2024-09-19T09:01:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.692+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc89406cc50 msgr2=0x7fc89406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.692+0000 7fc8ae603640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc89406cc50 0x7fc89406f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc898000c00 tx=0x7fc8980314e0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.692+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8a80ffcf0 msgr2=0x7fc8a8197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.692+0000 7fc8ae603640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8a80ffcf0 0x7fc8a8197e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e970 tx=0x7fc89000ee30 comp rx=0 tx=0).stop 2024-09-19T09:01:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.693+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 shutdown_connections 2024-09-19T09:01:45.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.693+0000 7fc8ae603640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fc89406cc50 0x7fc89406f110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.693+0000 7fc8ae603640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8a80ffcf0 0x7fc8a8197e10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.693+0000 7fc8ae603640 1 --2- 172.21.15.49:0/1749518540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8a80feaf0 0x7fc8a81978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.693+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 >> 172.21.15.49:0/1749518540 conn(0x7fc8a80fa280 msgr2=0x7fc8a8067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.693+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 shutdown_connections 2024-09-19T09:01:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.693+0000 7fc8ae603640 1 -- 172.21.15.49:0/1749518540 wait complete. 2024-09-19T09:01:45.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 -- 172.21.15.49:0/3490061900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 msgr2=0x7f228c0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 --2- 172.21.15.49:0/3490061900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c0fff80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2280009880 tx=0x7f228002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 -- 172.21.15.49:0/3490061900 shutdown_connections 2024-09-19T09:01:45.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 --2- 172.21.15.49:0/3490061900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c100d80 0x7f228c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 --2- 172.21.15.49:0/3490061900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c0fff80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 -- 172.21.15.49:0/3490061900 >> 172.21.15.49:0/3490061900 conn(0x7f228c0fb310 msgr2=0x7f228c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 -- 172.21.15.49:0/3490061900 shutdown_connections 2024-09-19T09:01:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.789+0000 7f2292e4f640 1 -- 172.21.15.49:0/3490061900 wait complete. 2024-09-19T09:01:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2292e4f640 1 Processor -- start 2024-09-19T09:01:45.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2292e4f640 1 -- start start 2024-09-19T09:01:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2292e4f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2292e4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c100d80 0x7f228c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2292e4f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c072de0 con 0x7f228c0ffb80 2024-09-19T09:01:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2292e4f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c072f50 con 0x7f228c100d80 2024-09-19T09:01:45.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2290beb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2290beb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38716/0 (socket says 172.21.15.49:38716) 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f2290beb640 1 -- 172.21.15.49:0/1003432240 learned_addr learned my addr 172.21.15.49:0/1003432240 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.790+0000 7f228bfff640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c100d80 0x7f228c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.791+0000 7f2290beb640 1 -- 172.21.15.49:0/1003432240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c100d80 msgr2=0x7f228c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.791+0000 7f2290beb640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c100d80 0x7f228c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.791+0000 7f2290beb640 1 -- 172.21.15.49:0/1003432240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280009560 con 0x7f228c0ffb80 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.791+0000 7f228bfff640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c100d80 0x7f228c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.791+0000 7f2290beb640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c074250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f228002a9c0 tx=0x7f2280005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.791+0000 7f2289ffb640 1 -- 172.21.15.49:0/1003432240 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2280004b20 con 0x7f228c0ffb80 2024-09-19T09:01:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.791+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c0731d0 con 0x7f228c0ffb80 2024-09-19T09:01:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.792+0000 7f2289ffb640 1 -- 172.21.15.49:0/1003432240 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2280004c80 con 0x7f228c0ffb80 2024-09-19T09:01:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.792+0000 7f2289ffb640 1 -- 172.21.15.49:0/1003432240 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2280003b80 con 0x7f228c0ffb80 2024-09-19T09:01:45.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.792+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c073680 con 0x7f228c0ffb80 2024-09-19T09:01:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.793+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c108790 con 0x7f228c0ffb80 2024-09-19T09:01:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.794+0000 7f2289ffb640 1 -- 172.21.15.49:0/1003432240 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2280003ce0 con 0x7f228c0ffb80 2024-09-19T09:01:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.794+0000 7f2289ffb640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f227c06cc60 0x7f227c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.794+0000 7f2289ffb640 1 -- 172.21.15.49:0/1003432240 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f22800ad5d0 con 0x7f228c0ffb80 2024-09-19T09:01:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.795+0000 7f228bfff640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f227c06cc60 0x7f227c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:45.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.795+0000 7f228bfff640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f227c06cc60 0x7f227c06f120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2278005fd0 tx=0x7f2278005ea0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:45.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:45.803+0000 7f2289ffb640 1 -- 172.21.15.49:0/1003432240 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2280077940 con 0x7f228c0ffb80 2024-09-19T09:01:46.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.170+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f228c19d650 con 0x7f228c0ffb80 2024-09-19T09:01:46.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.170+0000 7f2289ffb640 1 -- 172.21.15.49:0/1003432240 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f228007af60 con 0x7f228c0ffb80 2024-09-19T09:01:46.171 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:01:46.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:01:46.171 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:01:46.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:46.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:01:46.171 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:01:46.172 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:01:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.173+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f227c06cc60 msgr2=0x7f227c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.173+0000 7f2292e4f640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f227c06cc60 0x7f227c06f120 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2278005fd0 tx=0x7f2278005ea0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.173+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 msgr2=0x7f228c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.173+0000 7f2292e4f640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c074250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f228002a9c0 tx=0x7f2280005610 comp rx=0 tx=0).stop 2024-09-19T09:01:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.174+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 shutdown_connections 2024-09-19T09:01:46.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.174+0000 7f2292e4f640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f227c06cc60 0x7f227c06f120 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.174+0000 7f2292e4f640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c100d80 0x7f228c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.174+0000 7f2292e4f640 1 --2- 172.21.15.49:0/1003432240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f228c0ffb80 0x7f228c074250 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.174+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 >> 172.21.15.49:0/1003432240 conn(0x7f228c0fb310 msgr2=0x7f228c103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.174+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 shutdown_connections 2024-09-19T09:01:46.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.174+0000 7f2292e4f640 1 -- 172.21.15.49:0/1003432240 wait complete. 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 -- 172.21.15.49:0/1095334552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 msgr2=0x7f5570105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 --2- 172.21.15.49:0/1095334552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 0x7f5570105320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f55600098b0 tx=0x7f556002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 -- 172.21.15.49:0/1095334552 shutdown_connections 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 --2- 172.21.15.49:0/1095334552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 0x7f5570105320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 --2- 172.21.15.49:0/1095334552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 0x7f55701029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 -- 172.21.15.49:0/1095334552 >> 172.21.15.49:0/1095334552 conn(0x7f55700fa200 msgr2=0x7f55700fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 -- 172.21.15.49:0/1095334552 shutdown_connections 2024-09-19T09:01:46.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.294+0000 7f5577826640 1 -- 172.21.15.49:0/1095334552 wait complete. 2024-09-19T09:01:46.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f5577826640 1 Processor -- start 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f5577826640 1 -- start start 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f5577826640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 0x7f5570195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f5577826640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 0x7f5570195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f5577826640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5570196150 con 0x7f5570102f30 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f5577826640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55701962c0 con 0x7f5570100600 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f5574dc1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 0x7f5570195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.295+0000 7f55755c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 0x7f5570195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55755c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 0x7f5570195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:49802/0 (socket says 172.21.15.49:49802) 2024-09-19T09:01:46.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55755c2640 1 -- 172.21.15.49:0/3739268416 learned_addr learned my addr 172.21.15.49:0/3739268416 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55755c2640 1 -- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 msgr2=0x7f5570195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55755c2640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 0x7f5570195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55755c2640 1 -- 172.21.15.49:0/3739268416 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5560009560 con 0x7f5570100600 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f5574dc1640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 0x7f5570195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55755c2640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 0x7f5570195640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f556c009c20 tx=0x7f556c00b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55667fc640 1 -- 172.21.15.49:0/3739268416 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f556c015070 con 0x7f5570100600 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55667fc640 1 -- 172.21.15.49:0/3739268416 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f556c00be40 con 0x7f5570100600 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.296+0000 7f55667fc640 1 -- 172.21.15.49:0/3739268416 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f556c018980 con 0x7f5570100600 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.297+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55700fe450 con 0x7f5570100600 2024-09-19T09:01:46.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.297+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55700fe9f0 con 0x7f5570100600 2024-09-19T09:01:46.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.298+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55701009e0 con 0x7f5570100600 2024-09-19T09:01:46.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.298+0000 7f55667fc640 1 -- 172.21.15.49:0/3739268416 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7f556c018ae0 con 0x7f5570100600 2024-09-19T09:01:46.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.299+0000 7f55667fc640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f555c06d760 0x7f555c06fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.299+0000 7f55667fc640 1 -- 172.21.15.49:0/3739268416 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f556c090d10 con 0x7f5570100600 2024-09-19T09:01:46.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.299+0000 7f5574dc1640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f555c06d760 0x7f555c06fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.300+0000 7f5574dc1640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f555c06d760 0x7f555c06fc20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5560009880 tx=0x7f55600314e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.304+0000 7f55667fc640 1 -- 172.21.15.49:0/3739268416 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f556c05b150 con 0x7f5570100600 2024-09-19T09:01:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:01:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:01:46.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv restarted 2024-09-19T09:01:46.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:01:46.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:01:46.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:01:46.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:46 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1003432240' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:01:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:01:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:01:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: Standby manager daemon smithi102.csalqv restarted 2024-09-19T09:01:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:01:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:01:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:01:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:46 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1003432240' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:01:46.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.685+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f55700feee0 con 0x7f5570100600 2024-09-19T09:01:46.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.686+0000 7f55667fc640 1 -- 172.21.15.49:0/3739268416 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f556c01e760 con 0x7f5570100600 2024-09-19T09:01:46.687 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:01:46.687 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:01:46.687 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:01:46.688 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:01:46.689 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:01:46.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:01:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:01:46.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f555c06d760 msgr2=0x7f555c06fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f555c06d760 0x7f555c06fc20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5560009880 tx=0x7f55600314e0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 msgr2=0x7f5570195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 0x7f5570195640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f556c009c20 tx=0x7f556c00b690 comp rx=0 tx=0).stop 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 shutdown_connections 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f555c06d760 0x7f555c06fc20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5570102f30 0x7f5570195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 --2- 172.21.15.49:0/3739268416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5570100600 0x7f5570195640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.689+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 >> 172.21.15.49:0/3739268416 conn(0x7f55700fa200 msgr2=0x7f55700fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.690+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 shutdown_connections 2024-09-19T09:01:46.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.690+0000 7f5577826640 1 -- 172.21.15.49:0/3739268416 wait complete. 2024-09-19T09:01:46.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 -- 172.21.15.49:0/3260063318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 msgr2=0x7fee580fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 --2- 172.21.15.49:0/3260063318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 0x7fee580fe8d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009880 tx=0x7fee4c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 -- 172.21.15.49:0/3260063318 shutdown_connections 2024-09-19T09:01:46.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 --2- 172.21.15.49:0/3260063318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 0x7fee580ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 --2- 172.21.15.49:0/3260063318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 0x7fee580fe8d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 -- 172.21.15.49:0/3260063318 >> 172.21.15.49:0/3260063318 conn(0x7fee580fa280 msgr2=0x7fee580fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 -- 172.21.15.49:0/3260063318 shutdown_connections 2024-09-19T09:01:46.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.807+0000 7fee5cd15640 1 -- 172.21.15.49:0/3260063318 wait complete. 2024-09-19T09:01:46.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.808+0000 7fee5cd15640 1 Processor -- start 2024-09-19T09:01:46.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.808+0000 7fee5cd15640 1 -- start start 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.808+0000 7fee5cd15640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 0x7fee58197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.808+0000 7fee5cd15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 0x7fee58197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.808+0000 7fee5cd15640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee58198350 con 0x7fee580fe4d0 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.808+0000 7fee5cd15640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee581984c0 con 0x7fee580fee10 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee55d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 0x7fee58197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee55d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 0x7fee58197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:49822/0 (socket says 172.21.15.49:49822) 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee55d9b640 1 -- 172.21.15.49:0/1613142002 learned_addr learned my addr 172.21.15.49:0/1613142002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee55d9b640 1 -- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 msgr2=0x7fee58197840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee5659c640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 0x7fee58197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee55d9b640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 0x7fee58197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee55d9b640 1 -- 172.21.15.49:0/1613142002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009560 con 0x7fee580fee10 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee5659c640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 0x7fee58197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:46.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.809+0000 7fee55d9b640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 0x7fee58197d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e970 tx=0x7fee4800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.810+0000 7fee477fe640 1 -- 172.21.15.49:0/1613142002 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee4800cc90 con 0x7fee580fee10 2024-09-19T09:01:46.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.810+0000 7fee477fe640 1 -- 172.21.15.49:0/1613142002 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee4800cdf0 con 0x7fee580fee10 2024-09-19T09:01:46.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.810+0000 7fee477fe640 1 -- 172.21.15.49:0/1613142002 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee48018810 con 0x7fee580fee10 2024-09-19T09:01:46.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.810+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5819cf60 con 0x7fee580fee10 2024-09-19T09:01:46.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.810+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5819d480 con 0x7fee580fee10 2024-09-19T09:01:46.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.811+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee580fe8d0 con 0x7fee580fee10 2024-09-19T09:01:46.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.812+0000 7fee477fe640 1 -- 172.21.15.49:0/1613142002 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7fee48010430 con 0x7fee580fee10 2024-09-19T09:01:46.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.812+0000 7fee477fe640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee4006d760 0x7fee4006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.812+0000 7fee477fe640 1 -- 172.21.15.49:0/1613142002 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fee48014070 con 0x7fee580fee10 2024-09-19T09:01:46.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.812+0000 7fee5659c640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee4006d760 0x7fee4006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.813+0000 7fee5659c640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee4006d760 0x7fee4006fc20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee4c031540 tx=0x7fee4c005de0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:46.817+0000 7fee477fe640 1 -- 172.21.15.49:0/1613142002 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fee48052e20 con 0x7fee580fee10 2024-09-19T09:01:47.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.099+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 --> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee5802c4f0 con 0x7fee4006d760 2024-09-19T09:01:47.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.101+0000 7fee477fe640 1 -- 172.21.15.49:0/1613142002 <== mgr.14211 v2:172.21.15.49:6800/2913047787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fee5802c4f0 con 0x7fee4006d760 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/23 daemons upgraded", 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:01:47.102 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee4006d760 msgr2=0x7fee4006fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee4006d760 0x7fee4006fc20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee4c031540 tx=0x7fee4c005de0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 msgr2=0x7fee58197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 0x7fee58197d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e970 tx=0x7fee4800ee30 comp rx=0 tx=0).stop 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 shutdown_connections 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7fee4006d760 0x7fee4006fc20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee580fee10 0x7fee58197d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 --2- 172.21.15.49:0/1613142002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee580fe4d0 0x7fee58197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.103+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 >> 172.21.15.49:0/1613142002 conn(0x7fee580fa280 msgr2=0x7fee58107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.104+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 shutdown_connections 2024-09-19T09:01:47.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.104+0000 7fee5cd15640 1 -- 172.21.15.49:0/1613142002 wait complete. 2024-09-19T09:01:47.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 -- 172.21.15.49:0/2323595808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 msgr2=0x7f9d080feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:47.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/2323595808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d080feef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009880 tx=0x7f9cf802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 -- 172.21.15.49:0/2323595808 shutdown_connections 2024-09-19T09:01:47.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/2323595808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d080ffcf0 0x7f9d08100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/2323595808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d080feef0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 -- 172.21.15.49:0/2323595808 >> 172.21.15.49:0/2323595808 conn(0x7f9d080fa280 msgr2=0x7f9d080fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:47.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 -- 172.21.15.49:0/2323595808 shutdown_connections 2024-09-19T09:01:47.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.204+0000 7f9d0d77a640 1 -- 172.21.15.49:0/2323595808 wait complete. 2024-09-19T09:01:47.206 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:47 smithi049 ceph-mon[28158]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:47.206 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:47 smithi049 ceph-mon[28158]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:47.206 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:47 smithi049 ceph-mon[28158]: pgmap v236: 65 pgs: 65 active+clean; 16 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 247 KiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-19T09:01:47.206 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:47 smithi049 ceph-mon[28158]: mgrmap e20: smithi049.qdvksw(active, since 6m), standbys: smithi102.csalqv 2024-09-19T09:01:47.207 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:47 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3739268416' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:01:47.207 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:47 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.205+0000 7f9d0d77a640 1 Processor -- start 2024-09-19T09:01:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.205+0000 7f9d0d77a640 1 -- start start 2024-09-19T09:01:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d0d77a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d0819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d0d77a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d080ffcf0 0x7f9d0819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d0d77a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0819c7f0 con 0x7f9d080feaf0 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d0d77a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0819c960 con 0x7f9d080ffcf0 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d0819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d06ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d0819bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38792/0 (socket says 172.21.15.49:38792) 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d06ffd640 1 -- 172.21.15.49:0/3958263382 learned_addr learned my addr 172.21.15.49:0/3958263382 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d067fc640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d080ffcf0 0x7f9d0819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d06ffd640 1 -- 172.21.15.49:0/3958263382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d080ffcf0 msgr2=0x7f9d0819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d06ffd640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d080ffcf0 0x7f9d0819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.206+0000 7f9d06ffd640 1 -- 172.21.15.49:0/3958263382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8009560 con 0x7f9d080feaf0 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.207+0000 7f9d06ffd640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d0819bce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cf802a9c0 tx=0x7f9cf80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.207+0000 7f9ceffff640 1 -- 172.21.15.49:0/3958263382 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf8004aa0 con 0x7f9d080feaf0 2024-09-19T09:01:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.207+0000 7f9ceffff640 1 -- 172.21.15.49:0/3958263382 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cf8005d50 con 0x7f9d080feaf0 2024-09-19T09:01:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.207+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d081a1390 con 0x7f9d080feaf0 2024-09-19T09:01:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.207+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d081a1880 con 0x7f9d080feaf0 2024-09-19T09:01:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.207+0000 7f9ceffff640 1 -- 172.21.15.49:0/3958263382 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf80039e0 con 0x7f9d080feaf0 2024-09-19T09:01:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.208+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d081076e0 con 0x7f9d080feaf0 2024-09-19T09:01:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.209+0000 7f9ceffff640 1 -- 172.21.15.49:0/3958263382 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) v1 ==== 91631+0+0 (secure 0 0 0) 0x7f9cf8031c00 con 0x7f9d080feaf0 2024-09-19T09:01:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.210+0000 7f9ceffff640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9cf006d760 0x7f9cf006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.210+0000 7f9ceffff640 1 -- 172.21.15.49:0/3958263382 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9cf80ae060 con 0x7f9d080feaf0 2024-09-19T09:01:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.210+0000 7f9d067fc640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9cf006d760 0x7f9cf006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.211+0000 7f9d067fc640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9cf006d760 0x7f9cf006fc20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009bd0 tx=0x7f9cfc005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:47.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.215+0000 7f9ceffff640 1 -- 172.21.15.49:0/3958263382 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9cf8078500 con 0x7f9d080feaf0 2024-09-19T09:01:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:47 smithi102 ceph-mon[35280]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:47 smithi102 ceph-mon[35280]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:47 smithi102 ceph-mon[35280]: pgmap v236: 65 pgs: 65 active+clean; 16 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 247 KiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-19T09:01:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:47 smithi102 ceph-mon[35280]: mgrmap e20: smithi049.qdvksw(active, since 6m), standbys: smithi102.csalqv 2024-09-19T09:01:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:47 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3739268416' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:01:47.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:47 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.536+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9d081078a0 con 0x7f9d080feaf0 2024-09-19T09:01:47.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.537+0000 7f9ceffff640 1 -- 172.21.15.49:0/3958263382 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f9cf8080e60 con 0x7f9d080feaf0 2024-09-19T09:01:47.538 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:01:47.538 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:01:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:01:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.539+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9cf006d760 msgr2=0x7f9cf006fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.539+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9cf006d760 0x7f9cf006fc20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009bd0 tx=0x7f9cfc005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.539+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 msgr2=0x7f9d0819bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.539+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d0819bce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9cf802a9c0 tx=0x7f9cf80055a0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.540+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 shutdown_connections 2024-09-19T09:01:47.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.540+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:6800/2913047787,v1:172.21.15.49:6801/2913047787] conn(0x7f9cf006d760 0x7f9cf006fc20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.540+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d080ffcf0 0x7f9d0819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.540+0000 7f9d0d77a640 1 --2- 172.21.15.49:0/3958263382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d080feaf0 0x7f9d0819bce0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:47.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.540+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 >> 172.21.15.49:0/3958263382 conn(0x7f9d080fa280 msgr2=0x7f9d08067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:47.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.540+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 shutdown_connections 2024-09-19T09:01:47.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:01:47.540+0000 7f9d0d77a640 1 -- 172.21.15.49:0/3958263382 wait complete. 2024-09-19T09:01:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:48 smithi102 ceph-mon[35280]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:48.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:48 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3958263382' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:01:48.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:48 smithi049 ceph-mon[28158]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:48.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:48 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3958263382' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:01:49.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:49 smithi102 ceph-mon[35280]: pgmap v237: 65 pgs: 65 active+clean; 28 MiB data, 291 MiB used, 536 GiB / 536 GiB avail; 247 KiB/s rd, 2.3 MiB/s wr, 94 op/s 2024-09-19T09:01:49.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:49 smithi049 ceph-mon[28158]: pgmap v237: 65 pgs: 65 active+clean; 28 MiB data, 291 MiB used, 536 GiB / 536 GiB avail; 247 KiB/s rd, 2.3 MiB/s wr, 94 op/s 2024-09-19T09:01:51.466 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:51 smithi102 ceph-mon[35280]: pgmap v238: 65 pgs: 65 active+clean; 41 MiB data, 315 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 3.4 MiB/s wr, 119 op/s 2024-09-19T09:01:51.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:51 smithi049 ceph-mon[28158]: pgmap v238: 65 pgs: 65 active+clean; 41 MiB data, 315 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 3.4 MiB/s wr, 119 op/s 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr fail", "who": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: Activating manager daemon smithi102.csalqv 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:01:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:01:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "mgr fail", "who": "smithi049.qdvksw"}]': finished 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: mgrmap e21: smithi102.csalqv(active, starting, since 0.0163741s) 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: Manager daemon smithi102.csalqv is now available 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:52.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:01:52.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:01:52.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/trash_purge_schedule"}]: dispatch 2024-09-19T09:01:52.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:52 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/trash_purge_schedule"}]: dispatch 2024-09-19T09:01:52.906 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:52.906 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:52.906 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:52.906 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:52.906 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' 2024-09-19T09:01:52.906 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:52.906 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr fail", "who": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: Activating manager daemon smithi102.csalqv 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:01:52.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.14211 172.21.15.49:0/2112248413' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "mgr fail", "who": "smithi049.qdvksw"}]': finished 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: mgrmap e21: smithi102.csalqv(active, starting, since 0.0163741s) 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: Manager daemon smithi102.csalqv is now available 2024-09-19T09:01:52.908 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/trash_purge_schedule"}]: dispatch 2024-09-19T09:01:52.909 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:52 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi102.csalqv/trash_purge_schedule"}]: dispatch 2024-09-19T09:01:54.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: Migrating agent root cert to cert store 2024-09-19T09:01:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: Migrating agent root key to cert store 2024-09-19T09:01:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: Checking for cert/key for grafana.smithi049 2024-09-19T09:01:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: Migrating grafana.smithi049 cert to cert store 2024-09-19T09:01:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: Migrating grafana.smithi049 key to cert store 2024-09-19T09:01:54.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: mgrmap e22: smithi102.csalqv(active, since 1.01356s) 2024-09-19T09:01:54.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: pgmap v3: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:01:54.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: Deploying cephadm binary to smithi049 2024-09-19T09:01:54.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:53 smithi049 ceph-mon[28158]: Deploying cephadm binary to smithi102 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: Migrating agent root cert to cert store 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: Migrating agent root key to cert store 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: Checking for cert/key for grafana.smithi049 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: Migrating grafana.smithi049 cert to cert store 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: Migrating grafana.smithi049 key to cert store 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: mgrmap e22: smithi102.csalqv(active, since 1.01356s) 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: pgmap v3: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:01:54.069 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: Deploying cephadm binary to smithi049 2024-09-19T09:01:54.070 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:53 smithi102 ceph-mon[35280]: Deploying cephadm binary to smithi102 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:54 smithi049 ceph-mon[28158]: mgrmap e23: smithi102.csalqv(active, since 2s) 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:54 smithi049 ceph-mon[28158]: pgmap v4: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:54 smithi049 ceph-mon[28158]: [19/Sep/2024:09:01:53] ENGINE Bus STARTING 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:54 smithi049 ceph-mon[28158]: [19/Sep/2024:09:01:54] ENGINE Serving on https://172.21.15.102:7150 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:54 smithi049 ceph-mon[28158]: [19/Sep/2024:09:01:54] ENGINE Error in HTTPServer.serve 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Traceback (most recent call last): 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._run(expiration_interval) 2024-09-19T09:01:55.153 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s = self.context.wrap_socket( 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: return self.sslsocket_class._create( 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self.do_handshake() 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._sslobj.do_handshake() 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:01:55.154 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:54 smithi049 ceph-mon[28158]: [19/Sep/2024:09:01:54] ENGINE Serving on http://172.21.15.102:8765 2024-09-19T09:01:55.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:54 smithi049 ceph-mon[28158]: [19/Sep/2024:09:01:54] ENGINE Bus STARTED 2024-09-19T09:01:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:54 smithi102 ceph-mon[35280]: mgrmap e23: smithi102.csalqv(active, since 2s) 2024-09-19T09:01:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:54 smithi102 ceph-mon[35280]: pgmap v4: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:01:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:54 smithi102 ceph-mon[35280]: [19/Sep/2024:09:01:53] ENGINE Bus STARTING 2024-09-19T09:01:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:54 smithi102 ceph-mon[35280]: [19/Sep/2024:09:01:54] ENGINE Serving on https://172.21.15.102:7150 2024-09-19T09:01:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:54 smithi102 ceph-mon[35280]: [19/Sep/2024:09:01:54] ENGINE Error in HTTPServer.serve 2024-09-19T09:01:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Traceback (most recent call last): 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._run(expiration_interval) 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: s = self.context.wrap_socket( 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: return self.sslsocket_class._create( 2024-09-19T09:01:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:01:55.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self.do_handshake() 2024-09-19T09:01:55.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:01:55.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._sslobj.do_handshake() 2024-09-19T09:01:55.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:01:55.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:54 smithi102 ceph-mon[35280]: [19/Sep/2024:09:01:54] ENGINE Serving on http://172.21.15.102:8765 2024-09-19T09:01:55.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:54 smithi102 ceph-mon[35280]: [19/Sep/2024:09:01:54] ENGINE Bus STARTED 2024-09-19T09:01:57.141 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:56 smithi049 ceph-mon[28158]: pgmap v5: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:01:57.142 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:56 smithi049 ceph-mon[28158]: mgrmap e24: smithi102.csalqv(active, since 4s) 2024-09-19T09:01:57.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:56 smithi102 ceph-mon[35280]: pgmap v5: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:01:57.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:56 smithi102 ceph-mon[35280]: mgrmap e24: smithi102.csalqv(active, since 4s) 2024-09-19T09:01:59.107 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:58 smithi049 ceph-mon[28158]: pgmap v6: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:01:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:58 smithi102 ceph-mon[35280]: pgmap v6: 65 pgs: 65 active+clean; 69 MiB data, 421 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:02:00.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:59 smithi102 ceph-mon[35280]: Standby manager daemon smithi049.qdvksw started 2024-09-19T09:02:00.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:59 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/crt"}]: dispatch 2024-09-19T09:02:00.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:59 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:02:00.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:59 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/key"}]: dispatch 2024-09-19T09:02:00.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:01:59 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:02:00.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:59 smithi049 ceph-mon[28158]: Standby manager daemon smithi049.qdvksw started 2024-09-19T09:02:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:59 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/crt"}]: dispatch 2024-09-19T09:02:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:59 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:02:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:59 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/key"}]: dispatch 2024-09-19T09:02:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:01:59 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/2771922528' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:02:01.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:00 smithi102 ceph-mon[35280]: pgmap v7: 65 pgs: 65 active+clean; 90 MiB data, 466 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 118 op/s 2024-09-19T09:02:01.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:00 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:02:01.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:00 smithi102 ceph-mon[35280]: mgrmap e25: smithi102.csalqv(active, since 8s), standbys: smithi049.qdvksw 2024-09-19T09:02:01.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:00 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:01.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:00 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:00 smithi049 ceph-mon[28158]: pgmap v7: 65 pgs: 65 active+clean; 90 MiB data, 466 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 118 op/s 2024-09-19T09:02:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:00 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:02:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:00 smithi049 ceph-mon[28158]: mgrmap e25: smithi102.csalqv(active, since 8s), standbys: smithi049.qdvksw 2024-09-19T09:02:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:00 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:00 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:02.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:02.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:02.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi049 to 1216M 2024-09-19T09:02:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:01 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:02.291 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:02.291 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:02.291 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.291 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.292 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.292 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.292 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.292 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:02.292 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi049 to 1216M 2024-09-19T09:02:02.292 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:01 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:03.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:02 smithi102 ceph-mon[35280]: pgmap v8: 65 pgs: 65 active+clean; 90 MiB data, 466 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 92 op/s 2024-09-19T09:02:03.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:02 smithi049 ceph-mon[28158]: pgmap v8: 65 pgs: 65 active+clean; 90 MiB data, 466 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 92 op/s 2024-09-19T09:02:05.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:04 smithi102 ceph-mon[35280]: pgmap v9: 65 pgs: 65 active+clean; 108 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 165 op/s 2024-09-19T09:02:05.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:04 smithi049 ceph-mon[28158]: pgmap v9: 65 pgs: 65 active+clean; 108 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 165 op/s 2024-09-19T09:02:06.655 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:06 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:06.655 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:06 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:06.656 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:06 smithi102 ceph-mon[35280]: pgmap v10: 65 pgs: 65 active+clean; 108 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 151 op/s 2024-09-19T09:02:06.656 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:06 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:06.656 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:06 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:06.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:06 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:06.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:06 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:06.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:06 smithi049 ceph-mon[28158]: pgmap v10: 65 pgs: 65 active+clean; 108 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 151 op/s 2024-09-19T09:02:06.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:06 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:06.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:06 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:07.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:07 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:07 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:08.679 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:08 smithi102 ceph-mon[35280]: pgmap v11: 65 pgs: 65 active+clean; 108 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 151 op/s 2024-09-19T09:02:08.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:08 smithi049 ceph-mon[28158]: pgmap v11: 65 pgs: 65 active+clean; 108 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 151 op/s 2024-09-19T09:02:10.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Adjusting osd_memory_target on smithi102 to 2240M 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: pgmap v12: 65 pgs: 65 active+clean; 128 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 5.0 MiB/s wr, 257 op/s 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:10 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Adjusting osd_memory_target on smithi102 to 2240M 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:02:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: pgmap v12: 65 pgs: 65 active+clean; 128 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 5.0 MiB/s wr, 257 op/s 2024-09-19T09:02:10.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:02:10.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:02:10.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:02:10.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:10.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:10 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:11 smithi049 ceph-mon[28158]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:02:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:11 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:11 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:11 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:11 smithi049 ceph-mon[28158]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2024-09-19T09:02:11.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:11 smithi049 ceph-mon[28158]: Reconfiguring daemon prometheus.smithi049 on smithi049 2024-09-19T09:02:11.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:11 smithi102 ceph-mon[35280]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:02:11.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:11 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:11.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:11 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:11.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:11 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:11.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:11 smithi102 ceph-mon[35280]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2024-09-19T09:02:11.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:11 smithi102 ceph-mon[35280]: Reconfiguring daemon prometheus.smithi049 on smithi049 2024-09-19T09:02:12.704 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:12 smithi049 ceph-mon[28158]: pgmap v13: 65 pgs: 65 active+clean; 128 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 187 op/s 2024-09-19T09:02:12.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:12 smithi102 ceph-mon[35280]: pgmap v13: 65 pgs: 65 active+clean; 128 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 187 op/s 2024-09-19T09:02:15.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:14 smithi102 ceph-mon[35280]: pgmap v14: 65 pgs: 65 active+clean; 145 MiB data, 646 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 312 op/s 2024-09-19T09:02:15.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:14 smithi049 ceph-mon[28158]: pgmap v14: 65 pgs: 65 active+clean; 145 MiB data, 646 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 312 op/s 2024-09-19T09:02:17.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:16 smithi102 ceph-mon[35280]: pgmap v15: 65 pgs: 65 active+clean; 145 MiB data, 646 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 229 op/s 2024-09-19T09:02:17.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:16 smithi049 ceph-mon[28158]: pgmap v15: 65 pgs: 65 active+clean; 145 MiB data, 646 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 229 op/s 2024-09-19T09:02:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 -- 172.21.15.49:0/1233720659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 msgr2=0x7f7ab40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 --2- 172.21.15.49:0/1233720659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab40feef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009880 tx=0x7f7aa402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 -- 172.21.15.49:0/1233720659 shutdown_connections 2024-09-19T09:02:17.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 --2- 172.21.15.49:0/1233720659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab40ffcf0 0x7f7ab4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 --2- 172.21.15.49:0/1233720659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab40feef0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 -- 172.21.15.49:0/1233720659 >> 172.21.15.49:0/1233720659 conn(0x7f7ab40fa280 msgr2=0x7f7ab40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 -- 172.21.15.49:0/1233720659 shutdown_connections 2024-09-19T09:02:17.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.645+0000 7f7aba498640 1 -- 172.21.15.49:0/1233720659 wait complete. 2024-09-19T09:02:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.646+0000 7f7aba498640 1 Processor -- start 2024-09-19T09:02:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.646+0000 7f7aba498640 1 -- start start 2024-09-19T09:02:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.646+0000 7f7aba498640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab4102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.646+0000 7f7aba498640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab40ffcf0 0x7f7ab41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.646+0000 7f7aba498640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4101610 con 0x7f7ab40feaf0 2024-09-19T09:02:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.646+0000 7f7aba498640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4101780 con 0x7f7ab40ffcf0 2024-09-19T09:02:17.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab4102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab4102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45408/0 (socket says 172.21.15.49:45408) 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab3fff640 1 -- 172.21.15.49:0/1044343850 learned_addr learned my addr 172.21.15.49:0/1044343850 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab37fe640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab40ffcf0 0x7f7ab41010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab3fff640 1 -- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab40ffcf0 msgr2=0x7f7ab41010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab3fff640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab40ffcf0 0x7f7ab41010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab3fff640 1 -- 172.21.15.49:0/1044343850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009560 con 0x7f7ab40feaf0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab3fff640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab4102a80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402a9c0 tx=0x7f7aa40054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab17fa640 1 -- 172.21.15.49:0/1044343850 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa4004aa0 con 0x7f7ab40feaf0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab17fa640 1 -- 172.21.15.49:0/1044343850 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7aa4004c00 con 0x7f7ab40feaf0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab4101a00 con 0x7f7ab40feaf0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7ab17fa640 1 -- 172.21.15.49:0/1044343850 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa4003a80 con 0x7f7ab40feaf0 2024-09-19T09:02:17.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.647+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4101ef0 con 0x7f7ab40feaf0 2024-09-19T09:02:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.648+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab4107700 con 0x7f7ab40feaf0 2024-09-19T09:02:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.649+0000 7f7ab17fa640 1 -- 172.21.15.49:0/1044343850 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f7aa4003cf0 con 0x7f7ab40feaf0 2024-09-19T09:02:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.649+0000 7f7ab17fa640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7a9c06d8a0 0x7f7a9c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:17.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.650+0000 7f7ab17fa640 1 -- 172.21.15.49:0/1044343850 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7aa40ae4e0 con 0x7f7ab40feaf0 2024-09-19T09:02:17.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.650+0000 7f7ab37fe640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7a9c06d8a0 0x7f7a9c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:17.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.650+0000 7f7ab37fe640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7a9c06d8a0 0x7f7a9c06fd60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4102800 tx=0x7f7aa800b390 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:17.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.654+0000 7f7ab17fa640 1 -- 172.21.15.49:0/1044343850 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f7aa4077b10 con 0x7f7ab40feaf0 2024-09-19T09:02:17.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.906+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ab4068430 con 0x7f7a9c06d8a0 2024-09-19T09:02:17.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.907+0000 7f7ab17fa640 1 -- 172.21.15.49:0/1044343850 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7ab4068430 con 0x7f7a9c06d8a0 2024-09-19T09:02:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7a9c06d8a0 msgr2=0x7f7a9c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7a9c06d8a0 0x7f7a9c06fd60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4102800 tx=0x7f7aa800b390 comp rx=0 tx=0).stop 2024-09-19T09:02:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 msgr2=0x7f7ab4102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab4102a80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402a9c0 tx=0x7f7aa40054f0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 shutdown_connections 2024-09-19T09:02:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7a9c06d8a0 0x7f7a9c06fd60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab40ffcf0 0x7f7ab41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 --2- 172.21.15.49:0/1044343850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ab40feaf0 0x7f7ab4102a80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 >> 172.21.15.49:0/1044343850 conn(0x7f7ab40fa280 msgr2=0x7f7ab4067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.910+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 shutdown_connections 2024-09-19T09:02:17.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:17.911+0000 7f7aba498640 1 -- 172.21.15.49:0/1044343850 wait complete. 2024-09-19T09:02:17.920 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:02:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 -- 172.21.15.49:0/514312361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140feda0 msgr2=0x7f44140ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 --2- 172.21.15.49:0/514312361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140feda0 0x7f44140ff200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4400009880 tx=0x7f440002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 -- 172.21.15.49:0/514312361 shutdown_connections 2024-09-19T09:02:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 --2- 172.21.15.49:0/514312361 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140feda0 0x7f44140ff200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 --2- 172.21.15.49:0/514312361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44140fe460 0x7f44140fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 -- 172.21.15.49:0/514312361 >> 172.21.15.49:0/514312361 conn(0x7f44140fa230 msgr2=0x7f44140fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 -- 172.21.15.49:0/514312361 shutdown_connections 2024-09-19T09:02:18.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.021+0000 7f441afcd640 1 -- 172.21.15.49:0/514312361 wait complete. 2024-09-19T09:02:18.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f441afcd640 1 Processor -- start 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f441afcd640 1 -- start start 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f441afcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140fe460 0x7f44141977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f441afcd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44140feda0 0x7f4414197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f441afcd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44141982c0 con 0x7f44140fe460 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f441afcd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4414198430 con 0x7f44140feda0 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f4418d69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140fe460 0x7f44141977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f4418d69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140fe460 0x7f44141977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45414/0 (socket says 172.21.15.49:45414) 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.022+0000 7f4418d69640 1 -- 172.21.15.49:0/3048189946 learned_addr learned my addr 172.21.15.49:0/3048189946 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.023+0000 7f4413fff640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44140feda0 0x7f4414197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.023+0000 7f4413fff640 1 -- 172.21.15.49:0/3048189946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140fe460 msgr2=0x7f44141977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.023+0000 7f4413fff640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140fe460 0x7f44141977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.023+0000 7f4413fff640 1 -- 172.21.15.49:0/3048189946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400009560 con 0x7f44140feda0 2024-09-19T09:02:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.023+0000 7f4413fff640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44140feda0 0x7f4414197cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f440002a9c0 tx=0x7f44000055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.023+0000 7f4411ffb640 1 -- 172.21.15.49:0/3048189946 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4400004aa0 con 0x7f44140feda0 2024-09-19T09:02:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.024+0000 7f4411ffb640 1 -- 172.21.15.49:0/3048189946 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4400005d50 con 0x7f44140feda0 2024-09-19T09:02:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.024+0000 7f4411ffb640 1 -- 172.21.15.49:0/3048189946 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44000039b0 con 0x7f44140feda0 2024-09-19T09:02:18.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.024+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441419ce70 con 0x7f44140feda0 2024-09-19T09:02:18.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.024+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441419d2f0 con 0x7f44140feda0 2024-09-19T09:02:18.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.025+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441410a950 con 0x7f44140feda0 2024-09-19T09:02:18.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.026+0000 7f4411ffb640 1 -- 172.21.15.49:0/3048189946 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f4400003be0 con 0x7f44140feda0 2024-09-19T09:02:18.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.026+0000 7f4411ffb640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f440406d890 0x7f440406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.026+0000 7f4411ffb640 1 -- 172.21.15.49:0/3048189946 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f44000ae3e0 con 0x7f44140feda0 2024-09-19T09:02:18.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.027+0000 7f4418d69640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f440406d890 0x7f440406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.027+0000 7f4418d69640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f440406d890 0x7f440406fd50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4408009c90 tx=0x7f4408005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.032+0000 7f4411ffb640 1 -- 172.21.15.49:0/3048189946 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f4400077970 con 0x7f44140feda0 2024-09-19T09:02:18.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.336+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4414108010 con 0x7f440406d890 2024-09-19T09:02:18.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.338+0000 7f4411ffb640 1 -- 172.21.15.49:0/3048189946 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4414108010 con 0x7f440406d890 2024-09-19T09:02:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.340+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f440406d890 msgr2=0x7f440406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f440406d890 0x7f440406fd50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4408009c90 tx=0x7f4408005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44140feda0 msgr2=0x7f4414197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44140feda0 0x7f4414197cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f440002a9c0 tx=0x7f44000055a0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 shutdown_connections 2024-09-19T09:02:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f440406d890 0x7f440406fd50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44140feda0 0x7f4414197cf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 --2- 172.21.15.49:0/3048189946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44140fe460 0x7f44141977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 >> 172.21.15.49:0/3048189946 conn(0x7f44140fa230 msgr2=0x7f44140fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 shutdown_connections 2024-09-19T09:02:18.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.341+0000 7f441afcd640 1 -- 172.21.15.49:0/3048189946 wait complete. 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 -- 172.21.15.49:0/2977068476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c100600 msgr2=0x7f562c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 --2- 172.21.15.49:0/2977068476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c100600 0x7f562c1029f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f561c0098b0 tx=0x7f561c02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 -- 172.21.15.49:0/2977068476 shutdown_connections 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 --2- 172.21.15.49:0/2977068476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c102f30 0x7f562c105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 --2- 172.21.15.49:0/2977068476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c100600 0x7f562c1029f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 -- 172.21.15.49:0/2977068476 >> 172.21.15.49:0/2977068476 conn(0x7f562c0fa200 msgr2=0x7f562c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 -- 172.21.15.49:0/2977068476 shutdown_connections 2024-09-19T09:02:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.455+0000 7f5631d21640 1 -- 172.21.15.49:0/2977068476 wait complete. 2024-09-19T09:02:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.456+0000 7f5631d21640 1 Processor -- start 2024-09-19T09:02:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.456+0000 7f5631d21640 1 -- start start 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.456+0000 7f5631d21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c100600 0x7f562c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.456+0000 7f5631d21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c102f30 0x7f562c197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.456+0000 7f5631d21640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c198350 con 0x7f562c102f30 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.456+0000 7f5631d21640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c1984c0 con 0x7f562c100600 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.457+0000 7f562b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c100600 0x7f562c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.457+0000 7f562b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c100600 0x7f562c197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:51662/0 (socket says 172.21.15.49:51662) 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.457+0000 7f562b7fe640 1 -- 172.21.15.49:0/3731984238 learned_addr learned my addr 172.21.15.49:0/3731984238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.457+0000 7f562affd640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c102f30 0x7f562c197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.457+0000 7f562b7fe640 1 -- 172.21.15.49:0/3731984238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c102f30 msgr2=0x7f562c197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.457+0000 7f562b7fe640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c102f30 0x7f562c197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.457+0000 7f562b7fe640 1 -- 172.21.15.49:0/3731984238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c009560 con 0x7f562c100600 2024-09-19T09:02:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.458+0000 7f562affd640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c102f30 0x7f562c197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.458+0000 7f562b7fe640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c100600 0x7f562c197840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f561c006010 tx=0x7f561c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.458+0000 7f5628ff9640 1 -- 172.21.15.49:0/3731984238 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f561c004aa0 con 0x7f562c100600 2024-09-19T09:02:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.458+0000 7f5628ff9640 1 -- 172.21.15.49:0/3731984238 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f561c004c00 con 0x7f562c100600 2024-09-19T09:02:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.458+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562c19cf00 con 0x7f562c100600 2024-09-19T09:02:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.459+0000 7f5628ff9640 1 -- 172.21.15.49:0/3731984238 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f561c003a80 con 0x7f562c100600 2024-09-19T09:02:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.459+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562c19d3f0 con 0x7f562c100600 2024-09-19T09:02:18.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.460+0000 7f5628ff9640 1 -- 172.21.15.49:0/3731984238 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f561c003be0 con 0x7f562c100600 2024-09-19T09:02:18.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.460+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562c0ff050 con 0x7f562c100600 2024-09-19T09:02:18.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.461+0000 7f5628ff9640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f561406d8a0 0x7f561406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.461+0000 7f5628ff9640 1 -- 172.21.15.49:0/3731984238 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f561c0ae400 con 0x7f562c100600 2024-09-19T09:02:18.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.461+0000 7f562affd640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f561406d8a0 0x7f561406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.462+0000 7f562affd640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f561406d8a0 0x7f561406fd60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f562c198d60 tx=0x7f5620005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.466+0000 7f5628ff9640 1 -- 172.21.15.49:0/3731984238 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f561c077990 con 0x7f562c100600 2024-09-19T09:02:18.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.730+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f562c19d660 con 0x7f561406d8a0 2024-09-19T09:02:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.741+0000 7f5628ff9640 1 -- 172.21.15.49:0/3731984238 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f562c19d660 con 0x7f561406d8a0 2024-09-19T09:02:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:02:18.742 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (6m) 18s ago 7m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (8m) 18s ago 8m 7968k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (7m) 13s ago 7m 7822k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 18s ago 7m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (7m) 13s ago 7m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (6m) 18s ago 7m 84.0M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (2m) 18s ago 2m 78.4M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (2m) 18s ago 2m 108M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (2m) 13s ago 2m 22.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (2m) 13s ago 2m 21.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:9283,8765,8443 running (9m) 18s ago 9m 193M - 18.2.4-855-g19e2a2be 980a0bfcd684 b57193f2a38e 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (39s) 13s ago 6m 483M - 19.1.1-361-g2f599a46 d2baa855c067 83adb7fb6aac 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 18s ago 9m 51.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:02:18.743 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (6m) 13s ago 6m 43.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (7m) 18s ago 7m 15.7M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (6m) 13s ago 6m 16.7M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 18s ago 6m 64.7M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 18s ago 5m 75.1M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 18s ago 5m 66.5M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (4m) 13s ago 4m 72.9M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (4m) 13s ago 4m 71.8M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (3m) 13s ago 3m 72.5M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:02:18.744 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (6m) 18s ago 7m 63.7M - 2.43.0 a07b618ecd1d 2151f61fb8cc 2024-09-19T09:02:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f561406d8a0 msgr2=0x7f561406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f561406d8a0 0x7f561406fd60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f562c198d60 tx=0x7f5620005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c100600 msgr2=0x7f562c197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c100600 0x7f562c197840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f561c006010 tx=0x7f561c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 shutdown_connections 2024-09-19T09:02:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f561406d8a0 0x7f561406fd60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f562c102f30 0x7f562c197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 --2- 172.21.15.49:0/3731984238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f562c100600 0x7f562c197840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 >> 172.21.15.49:0/3731984238 conn(0x7f562c0fa200 msgr2=0x7f562c0fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 shutdown_connections 2024-09-19T09:02:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.744+0000 7f5631d21640 1 -- 172.21.15.49:0/3731984238 wait complete. 2024-09-19T09:02:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 -- 172.21.15.49:0/694690591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0ffcf0 msgr2=0x7f84ec100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 --2- 172.21.15.49:0/694690591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0ffcf0 0x7f84ec100170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009880 tx=0x7f84e002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 -- 172.21.15.49:0/694690591 shutdown_connections 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 --2- 172.21.15.49:0/694690591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0ffcf0 0x7f84ec100170 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 --2- 172.21.15.49:0/694690591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0feaf0 0x7f84ec0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 -- 172.21.15.49:0/694690591 >> 172.21.15.49:0/694690591 conn(0x7f84ec0fa280 msgr2=0x7f84ec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 -- 172.21.15.49:0/694690591 shutdown_connections 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.839+0000 7f84f15a8640 1 -- 172.21.15.49:0/694690591 wait complete. 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84f15a8640 1 Processor -- start 2024-09-19T09:02:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84f15a8640 1 -- start start 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84f15a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0feaf0 0x7f84ec1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84f15a8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0ffcf0 0x7f84ec197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84f15a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec1983d0 con 0x7f84ec0feaf0 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84f15a8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec198540 con 0x7f84ec0ffcf0 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0feaf0 0x7f84ec1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0feaf0 0x7f84ec1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45448/0 (socket says 172.21.15.49:45448) 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84eaffd640 1 -- 172.21.15.49:0/2850145473 learned_addr learned my addr 172.21.15.49:0/2850145473 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.840+0000 7f84ea7fc640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0ffcf0 0x7f84ec197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84eaffd640 1 -- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0ffcf0 msgr2=0x7f84ec197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84eaffd640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0ffcf0 0x7f84ec197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84eaffd640 1 -- 172.21.15.49:0/2850145473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009560 con 0x7f84ec0feaf0 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84eaffd640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0feaf0 0x7f84ec1978c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00d900 tx=0x7f84dc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84d3fff640 1 -- 172.21.15.49:0/2850145473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84dc009c00 con 0x7f84ec0feaf0 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84d3fff640 1 -- 172.21.15.49:0/2850145473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84dc009d60 con 0x7f84ec0feaf0 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec19cfe0 con 0x7f84ec0feaf0 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.841+0000 7f84d3fff640 1 -- 172.21.15.49:0/2850145473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84dc00f660 con 0x7f84ec0feaf0 2024-09-19T09:02:18.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.842+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec19d450 con 0x7f84ec0feaf0 2024-09-19T09:02:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.843+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec0feef0 con 0x7f84ec0feaf0 2024-09-19T09:02:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.843+0000 7f84d3fff640 1 -- 172.21.15.49:0/2850145473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f84dc010460 con 0x7f84ec0feaf0 2024-09-19T09:02:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.843+0000 7f84d3fff640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f84d406d8a0 0x7f84d406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.843+0000 7f84d3fff640 1 -- 172.21.15.49:0/2850145473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f84dc08cc70 con 0x7f84ec0feaf0 2024-09-19T09:02:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.844+0000 7f84ea7fc640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f84d406d8a0 0x7f84d406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.844+0000 7f84ea7fc640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f84d406d8a0 0x7f84d406fd60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84e0000c00 tx=0x7f84e00314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:18.848+0000 7f84d3fff640 1 -- 172.21.15.49:0/2850145473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f84dc0561f0 con 0x7f84ec0feaf0 2024-09-19T09:02:19.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:18 smithi049 ceph-mon[28158]: pgmap v16: 65 pgs: 65 active+clean; 145 MiB data, 646 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 229 op/s 2024-09-19T09:02:19.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:18 smithi049 ceph-mon[28158]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:19.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.236+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84ec107970 con 0x7f84ec0feaf0 2024-09-19T09:02:19.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.237+0000 7f84d3fff640 1 -- 172.21.15.49:0/2850145473 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f84dc017360 con 0x7f84ec0feaf0 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:19.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:02:19.239 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:02:19.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:19.239 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:02:19.239 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 13, 2024-09-19T09:02:19.239 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:02:19.239 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:02:19.239 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:02:19.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f84d406d8a0 msgr2=0x7f84d406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f84d406d8a0 0x7f84d406fd60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84e0000c00 tx=0x7f84e00314e0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0feaf0 msgr2=0x7f84ec1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0feaf0 0x7f84ec1978c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00d900 tx=0x7f84dc00ddc0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 shutdown_connections 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f84d406d8a0 0x7f84d406fd60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84ec0ffcf0 0x7f84ec197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 --2- 172.21.15.49:0/2850145473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84ec0feaf0 0x7f84ec1978c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 >> 172.21.15.49:0/2850145473 conn(0x7f84ec0fa280 msgr2=0x7f84ec067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:19.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 shutdown_connections 2024-09-19T09:02:19.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.240+0000 7f84f15a8640 1 -- 172.21.15.49:0/2850145473 wait complete. 2024-09-19T09:02:19.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:18 smithi102 ceph-mon[35280]: pgmap v16: 65 pgs: 65 active+clean; 145 MiB data, 646 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 229 op/s 2024-09-19T09:02:19.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:18 smithi102 ceph-mon[35280]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 -- 172.21.15.49:0/241530277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c0100d90 msgr2=0x7f72c0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 --2- 172.21.15.49:0/241530277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c0100d90 0x7f72c0101210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009880 tx=0x7f72b002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 -- 172.21.15.49:0/241530277 shutdown_connections 2024-09-19T09:02:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 --2- 172.21.15.49:0/241530277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c0100d90 0x7f72c0101210 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 --2- 172.21.15.49:0/241530277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c00ffb90 0x7f72c00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 -- 172.21.15.49:0/241530277 >> 172.21.15.49:0/241530277 conn(0x7f72c00fb320 msgr2=0x7f72c00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 -- 172.21.15.49:0/241530277 shutdown_connections 2024-09-19T09:02:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.339+0000 7f72c72b6640 1 -- 172.21.15.49:0/241530277 wait complete. 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.340+0000 7f72c72b6640 1 Processor -- start 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.340+0000 7f72c72b6640 1 -- start start 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.340+0000 7f72c72b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c00ffb90 0x7f72c0195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.340+0000 7f72c72b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0100d90 0x7f72c0195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c72b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0196150 con 0x7f72c00ffb90 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c72b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01962c0 con 0x7f72c0100d90 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c5052640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c00ffb90 0x7f72c0195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c5052640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c00ffb90 0x7f72c0195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45466/0 (socket says 172.21.15.49:45466) 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c5052640 1 -- 172.21.15.49:0/4282971485 learned_addr learned my addr 172.21.15.49:0/4282971485 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c4851640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0100d90 0x7f72c0195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c4851640 1 -- 172.21.15.49:0/4282971485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c00ffb90 msgr2=0x7f72c0195640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c4851640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c00ffb90 0x7f72c0195640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c4851640 1 -- 172.21.15.49:0/4282971485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009560 con 0x7f72c0100d90 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.341+0000 7f72c4851640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0100d90 0x7f72c0195b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72b002a9c0 tx=0x7f72b00055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.342+0000 7f72b67fc640 1 -- 172.21.15.49:0/4282971485 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0004aa0 con 0x7f72c0100d90 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.342+0000 7f72b67fc640 1 -- 172.21.15.49:0/4282971485 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72b0005d50 con 0x7f72c0100d90 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.342+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c019acb0 con 0x7f72c0100d90 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.342+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c019b220 con 0x7f72c0100d90 2024-09-19T09:02:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.342+0000 7f72b67fc640 1 -- 172.21.15.49:0/4282971485 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b00039b0 con 0x7f72c0100d90 2024-09-19T09:02:19.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.343+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c018f730 con 0x7f72c0100d90 2024-09-19T09:02:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.344+0000 7f72b67fc640 1 -- 172.21.15.49:0/4282971485 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f72b0003be0 con 0x7f72c0100d90 2024-09-19T09:02:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.344+0000 7f72b67fc640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f72ac06d8e0 0x7f72ac06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.344+0000 7f72b67fc640 1 -- 172.21.15.49:0/4282971485 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f72b00ae430 con 0x7f72c0100d90 2024-09-19T09:02:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.345+0000 7f72c5052640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f72ac06d8e0 0x7f72ac06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.345+0000 7f72c5052640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f72ac06d8e0 0x7f72ac06fda0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0058c0 tx=0x7f72bc005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:19.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.349+0000 7f72b67fc640 1 -- 172.21.15.49:0/4282971485 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f72b00779c0 con 0x7f72c0100d90 2024-09-19T09:02:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.645+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72c0108a50 con 0x7f72c0100d90 2024-09-19T09:02:19.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.646+0000 7f72b67fc640 1 -- 172.21.15.49:0/4282971485 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f72b007b080 con 0x7f72c0100d90 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:02:19.647 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:02:19.648 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:02:19.649 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:02:19.650 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:02:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:02:19.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f72ac06d8e0 msgr2=0x7f72ac06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f72ac06d8e0 0x7f72ac06fda0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0058c0 tx=0x7f72bc005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0100d90 msgr2=0x7f72c0195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0100d90 0x7f72c0195b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72b002a9c0 tx=0x7f72b00055a0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 shutdown_connections 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f72ac06d8e0 0x7f72ac06fda0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0100d90 0x7f72c0195b80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 --2- 172.21.15.49:0/4282971485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72c00ffb90 0x7f72c0195640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 >> 172.21.15.49:0/4282971485 conn(0x7f72c00fb320 msgr2=0x7f72c0104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 shutdown_connections 2024-09-19T09:02:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.648+0000 7f72c72b6640 1 -- 172.21.15.49:0/4282971485 wait complete. 2024-09-19T09:02:19.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 -- 172.21.15.49:0/3154955041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc1085c0 msgr2=0x7f04cc108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/3154955041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc1085c0 0x7f04cc108a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009880 tx=0x7f04c002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 -- 172.21.15.49:0/3154955041 shutdown_connections 2024-09-19T09:02:19.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/3154955041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc1085c0 0x7f04cc108a40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/3154955041 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04cc0714a0 0x7f04cc0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 -- 172.21.15.49:0/3154955041 >> 172.21.15.49:0/3154955041 conn(0x7f04cc06cfa0 msgr2=0x7f04cc06f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:19.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 -- 172.21.15.49:0/3154955041 shutdown_connections 2024-09-19T09:02:19.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.748+0000 7f04d1d1b640 1 -- 172.21.15.49:0/3154955041 wait complete. 2024-09-19T09:02:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.749+0000 7f04d1d1b640 1 Processor -- start 2024-09-19T09:02:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.749+0000 7f04d1d1b640 1 -- start start 2024-09-19T09:02:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.749+0000 7f04d1d1b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc0714a0 0x7f04cc10b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04d1d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04cc1085c0 0x7f04cc1099a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04d1d1b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc109ee0 con 0x7f04cc0714a0 2024-09-19T09:02:19.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04d1d1b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc10a050 con 0x7f04cc1085c0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc0714a0 0x7f04cc10b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc0714a0 0x7f04cc10b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45492/0 (socket says 172.21.15.49:45492) 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04cb7fe640 1 -- 172.21.15.49:0/377880054 learned_addr learned my addr 172.21.15.49:0/377880054 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04caffd640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04cc1085c0 0x7f04cc1099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04cb7fe640 1 -- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04cc1085c0 msgr2=0x7f04cc1099a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04cb7fe640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04cc1085c0 0x7f04cc1099a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04cb7fe640 1 -- 172.21.15.49:0/377880054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009560 con 0x7f04cc0714a0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.750+0000 7f04cb7fe640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc0714a0 0x7f04cc10b350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e940 tx=0x7f04bc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.751+0000 7f04c8ff9640 1 -- 172.21.15.49:0/377880054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04bc009700 con 0x7f04cc0714a0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.751+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc10a330 con 0x7f04cc0714a0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.751+0000 7f04c8ff9640 1 -- 172.21.15.49:0/377880054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04bc00cc90 con 0x7f04cc0714a0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.751+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc1a5ee0 con 0x7f04cc0714a0 2024-09-19T09:02:19.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.751+0000 7f04c8ff9640 1 -- 172.21.15.49:0/377880054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04bc010430 con 0x7f04cc0714a0 2024-09-19T09:02:19.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.752+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b8005250 con 0x7f04cc0714a0 2024-09-19T09:02:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.753+0000 7f04c8ff9640 1 -- 172.21.15.49:0/377880054 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f04bc004020 con 0x7f04cc0714a0 2024-09-19T09:02:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.754+0000 7f04c8ff9640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f04b406d8a0 0x7f04b406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.754+0000 7f04c8ff9640 1 -- 172.21.15.49:0/377880054 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f04bc014070 con 0x7f04cc0714a0 2024-09-19T09:02:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.754+0000 7f04caffd640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f04b406d8a0 0x7f04b406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.754+0000 7f04caffd640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f04b406d8a0 0x7f04b406fd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009230 tx=0x7f04c00314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.759+0000 7f04c8ff9640 1 -- 172.21.15.49:0/377880054 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f04bc056e00 con 0x7f04cc0714a0 2024-09-19T09:02:19.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.988+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04b8000bc0 con 0x7f04b406d8a0 2024-09-19T09:02:19.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:19 smithi049 ceph-mon[28158]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:19.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:19 smithi049 ceph-mon[28158]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:19.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:19 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2850145473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:02:19.990 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:19 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/4282971485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:02:19.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.989+0000 7f04c8ff9640 1 -- 172.21.15.49:0/377880054 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f04b8000bc0 con 0x7f04b406d8a0 2024-09-19T09:02:19.990 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:02:19.990 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:02:19.991 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:02:19.991 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:02:19.991 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-09-19T09:02:19.991 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/23 daemons upgraded", 2024-09-19T09:02:19.991 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-09-19T09:02:19.991 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:02:19.991 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:02:19.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f04b406d8a0 msgr2=0x7f04b406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f04b406d8a0 0x7f04b406fd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009230 tx=0x7f04c00314e0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc0714a0 msgr2=0x7f04cc10b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:19.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc0714a0 0x7f04cc10b350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00e940 tx=0x7f04bc00ee00 comp rx=0 tx=0).stop 2024-09-19T09:02:19.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 shutdown_connections 2024-09-19T09:02:19.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f04b406d8a0 0x7f04b406fd60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04cc1085c0 0x7f04cc1099a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 --2- 172.21.15.49:0/377880054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f04cc0714a0 0x7f04cc10b350 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:19.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 >> 172.21.15.49:0/377880054 conn(0x7f04cc06cfa0 msgr2=0x7f04cc107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:19.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 shutdown_connections 2024-09-19T09:02:19.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:19.992+0000 7f04d1d1b640 1 -- 172.21.15.49:0/377880054 wait complete. 2024-09-19T09:02:20.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 -- 172.21.15.49:0/3689626567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440feaf0 msgr2=0x7f95440feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 --2- 172.21.15.49:0/3689626567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440feaf0 0x7f95440feef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9534009880 tx=0x7f953402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 -- 172.21.15.49:0/3689626567 shutdown_connections 2024-09-19T09:02:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 --2- 172.21.15.49:0/3689626567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95440ffcf0 0x7f9544100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 --2- 172.21.15.49:0/3689626567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440feaf0 0x7f95440feef0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 -- 172.21.15.49:0/3689626567 >> 172.21.15.49:0/3689626567 conn(0x7f95440fa280 msgr2=0x7f95440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 -- 172.21.15.49:0/3689626567 shutdown_connections 2024-09-19T09:02:20.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 -- 172.21.15.49:0/3689626567 wait complete. 2024-09-19T09:02:20.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 Processor -- start 2024-09-19T09:02:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.097+0000 7f954a350640 1 -- start start 2024-09-19T09:02:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f954a350640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95440feaf0 0x7f95440687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f954a350640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440ffcf0 0x7f954419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f954a350640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954419a9b0 con 0x7f95440ffcf0 2024-09-19T09:02:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f954a350640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954419ab20 con 0x7f95440feaf0 2024-09-19T09:02:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f95437fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440ffcf0 0x7f954419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:20.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f95437fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440ffcf0 0x7f954419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45510/0 (socket says 172.21.15.49:45510) 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f95437fe640 1 -- 172.21.15.49:0/3704833956 learned_addr learned my addr 172.21.15.49:0/3704833956 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f9543fff640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95440feaf0 0x7f95440687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f95437fe640 1 -- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95440feaf0 msgr2=0x7f95440687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f95437fe640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95440feaf0 0x7f95440687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.098+0000 7f95437fe640 1 -- 172.21.15.49:0/3704833956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9534009560 con 0x7f95440ffcf0 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.099+0000 7f95437fe640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440ffcf0 0x7f954419a3e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f953800e970 tx=0x7f953800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.099+0000 7f95417fa640 1 -- 172.21.15.49:0/3704833956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953800cc90 con 0x7f95440ffcf0 2024-09-19T09:02:20.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.099+0000 7f95417fa640 1 -- 172.21.15.49:0/3704833956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f953800cdf0 con 0x7f95440ffcf0 2024-09-19T09:02:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.099+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954419ae00 con 0x7f95440ffcf0 2024-09-19T09:02:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.099+0000 7f95417fa640 1 -- 172.21.15.49:0/3704833956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9538010430 con 0x7f95440ffcf0 2024-09-19T09:02:20.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.099+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954419b320 con 0x7f95440ffcf0 2024-09-19T09:02:20.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.100+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95440feef0 con 0x7f95440ffcf0 2024-09-19T09:02:20.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.101+0000 7f95417fa640 1 -- 172.21.15.49:0/3704833956 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f95380106f0 con 0x7f95440ffcf0 2024-09-19T09:02:20.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.101+0000 7f95417fa640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f952c06d8a0 0x7f952c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:20.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.101+0000 7f95417fa640 1 -- 172.21.15.49:0/3704833956 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9538014070 con 0x7f95440ffcf0 2024-09-19T09:02:20.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.101+0000 7f9543fff640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f952c06d8a0 0x7f952c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:20.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.102+0000 7f9543fff640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f952c06d8a0 0x7f952c06fd60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9544068d10 tx=0x7f95340314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:20.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.106+0000 7f95417fa640 1 -- 172.21.15.49:0/3704833956 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f9538056f10 con 0x7f95440ffcf0 2024-09-19T09:02:20.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:19 smithi102 ceph-mon[35280]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:20.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:19 smithi102 ceph-mon[35280]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:20.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:19 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2850145473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:02:20.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:19 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/4282971485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:02:20.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.465+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f954418e690 con 0x7f95440ffcf0 2024-09-19T09:02:20.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.466+0000 7f95417fa640 1 -- 172.21.15.49:0/3704833956 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f953805a5d0 con 0x7f95440ffcf0 2024-09-19T09:02:20.466 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:02:20.467 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:02:20.467 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f952c06d8a0 msgr2=0x7f952c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f952c06d8a0 0x7f952c06fd60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9544068d10 tx=0x7f95340314e0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440ffcf0 msgr2=0x7f954419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440ffcf0 0x7f954419a3e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f953800e970 tx=0x7f953800ed70 comp rx=0 tx=0).stop 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 shutdown_connections 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f952c06d8a0 0x7f952c06fd60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95440ffcf0 0x7f954419a3e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 --2- 172.21.15.49:0/3704833956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95440feaf0 0x7f95440687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 >> 172.21.15.49:0/3704833956 conn(0x7f95440fa280 msgr2=0x7f95441033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:20.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 shutdown_connections 2024-09-19T09:02:20.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:20.468+0000 7f954a350640 1 -- 172.21.15.49:0/3704833956 wait complete. 2024-09-19T09:02:21.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:20 smithi102 ceph-mon[35280]: pgmap v17: 65 pgs: 65 active+clean; 167 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 381 op/s 2024-09-19T09:02:21.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:20 smithi102 ceph-mon[35280]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:21.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:20 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3704833956' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:02:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:20 smithi049 ceph-mon[28158]: pgmap v17: 65 pgs: 65 active+clean; 167 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 381 op/s 2024-09-19T09:02:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:20 smithi049 ceph-mon[28158]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:21.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:20 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3704833956' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:02:23.105 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:22 smithi049 ceph-mon[28158]: pgmap v18: 65 pgs: 65 active+clean; 167 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 276 op/s 2024-09-19T09:02:23.105 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:22 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:23.158 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:22 smithi102 ceph-mon[35280]: pgmap v18: 65 pgs: 65 active+clean; 167 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 276 op/s 2024-09-19T09:02:23.158 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:22 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:24.027 INFO:tasks.workunit.client.1.smithi102.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T09:02:24.032 INFO:tasks.workunit.client.1.smithi102.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:02:24.032 INFO:tasks.workunit.client.1.smithi102.stderr:+ make 2024-09-19T09:02:24.699 INFO:tasks.workunit.client.1.smithi102.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T09:02:25.154 INFO:tasks.workunit.client.1.smithi102.stderr:++ readlink -f fsstress 2024-09-19T09:02:25.156 INFO:tasks.workunit.client.1.smithi102.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T09:02:25.156 INFO:tasks.workunit.client.1.smithi102.stderr:+ popd 2024-09-19T09:02:25.157 INFO:tasks.workunit.client.1.smithi102.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:02:25.157 INFO:tasks.workunit.client.1.smithi102.stderr:+ popd 2024-09-19T09:02:25.158 INFO:tasks.workunit.client.1.smithi102.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-19T09:02:25.158 INFO:tasks.workunit.client.1.smithi102.stderr:++ mktemp -d -p . 2024-09-19T09:02:25.180 INFO:tasks.workunit.client.1.smithi102.stderr:+ T=./tmp.veGdobeYPQ 2024-09-19T09:02:25.180 INFO:tasks.workunit.client.1.smithi102.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.veGdobeYPQ -l 1 -n 1000 -p 10 -v 2024-09-19T09:02:25.183 INFO:tasks.workunit.client.1.smithi102.stdout:seed = 1726560867 2024-09-19T09:02:25.187 INFO:tasks.workunit.client.1.smithi102.stdout:0/0: readlink - no filename 2024-09-19T09:02:25.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/0: truncate - no filename 2024-09-19T09:02:25.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/1: chown . 610 1 2024-09-19T09:02:25.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/2: write - no filename 2024-09-19T09:02:25.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/3: rmdir - no directory 2024-09-19T09:02:25.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/4: read - no filename 2024-09-19T09:02:25.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/5: chown . 29 1 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:1/6: rename - no filename 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:1/7: dwrite - no filename 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:1/8: rename - no filename 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:1/9: chown . 332983896 1 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:1/10: fdatasync - no filename 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:1/11: chown . 885146 1 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:0/1: symlink l0 0 2024-09-19T09:02:25.190 INFO:tasks.workunit.client.1.smithi102.stdout:0/2: read - no filename 2024-09-19T09:02:25.191 INFO:tasks.workunit.client.1.smithi102.stdout:0/3: write - no filename 2024-09-19T09:02:25.191 INFO:tasks.workunit.client.1.smithi102.stdout:0/4: write - no filename 2024-09-19T09:02:25.191 INFO:tasks.workunit.client.1.smithi102.stdout:0/5: dread - no filename 2024-09-19T09:02:25.191 INFO:tasks.workunit.client.1.smithi102.stdout:2/0: stat - no entries 2024-09-19T09:02:25.192 INFO:tasks.workunit.client.1.smithi102.stdout:1/12: creat f0 x:0 0 0 2024-09-19T09:02:25.192 INFO:tasks.workunit.client.1.smithi102.stdout:3/0: stat - no entries 2024-09-19T09:02:25.192 INFO:tasks.workunit.client.1.smithi102.stdout:3/1: dwrite - no filename 2024-09-19T09:02:25.192 INFO:tasks.workunit.client.1.smithi102.stdout:3/2: write - no filename 2024-09-19T09:02:25.192 INFO:tasks.workunit.client.1.smithi102.stdout:0/6: creat f1 x:0 0 0 2024-09-19T09:02:25.192 INFO:tasks.workunit.client.1.smithi102.stdout:1/13: chown f0 1969746563 1 2024-09-19T09:02:25.193 INFO:tasks.workunit.client.1.smithi102.stdout:4/0: truncate - no filename 2024-09-19T09:02:25.193 INFO:tasks.workunit.client.1.smithi102.stdout:4/1: unlink - no file 2024-09-19T09:02:25.193 INFO:tasks.workunit.client.1.smithi102.stdout:4/2: write - no filename 2024-09-19T09:02:25.194 INFO:tasks.workunit.client.1.smithi102.stdout:2/1: creat f0 x:0 0 0 2024-09-19T09:02:25.194 INFO:tasks.workunit.client.1.smithi102.stdout:0/7: creat f2 x:0 0 0 2024-09-19T09:02:25.194 INFO:tasks.workunit.client.1.smithi102.stdout:1/14: symlink l1 0 2024-09-19T09:02:25.195 INFO:tasks.workunit.client.1.smithi102.stdout:2/2: write f0 [340884,92415] 0 2024-09-19T09:02:25.195 INFO:tasks.workunit.client.1.smithi102.stdout:3/3: mknod c0 0 2024-09-19T09:02:25.195 INFO:tasks.workunit.client.1.smithi102.stdout:3/4: dread - no filename 2024-09-19T09:02:25.195 INFO:tasks.workunit.client.1.smithi102.stdout:2/3: chown f0 7463 1 2024-09-19T09:02:25.198 INFO:tasks.workunit.client.1.smithi102.stdout:0/8: mkdir d3 0 2024-09-19T09:02:25.198 INFO:tasks.workunit.client.1.smithi102.stdout:5/0: truncate - no filename 2024-09-19T09:02:25.199 INFO:tasks.workunit.client.1.smithi102.stdout:2/4: dread f0 [0,4194304] 0 2024-09-19T09:02:25.200 INFO:tasks.workunit.client.1.smithi102.stdout:4/3: symlink l0 0 2024-09-19T09:02:25.200 INFO:tasks.workunit.client.1.smithi102.stdout:4/4: dwrite - no filename 2024-09-19T09:02:25.200 INFO:tasks.workunit.client.1.smithi102.stdout:4/5: dwrite - no filename 2024-09-19T09:02:25.201 INFO:tasks.workunit.client.1.smithi102.stdout:4/6: chown l0 30 1 2024-09-19T09:02:25.201 INFO:tasks.workunit.client.1.smithi102.stdout:6/0: write - no filename 2024-09-19T09:02:25.202 INFO:tasks.workunit.client.1.smithi102.stdout:4/7: stat l0 0 2024-09-19T09:02:25.202 INFO:tasks.workunit.client.1.smithi102.stdout:4/8: write - no filename 2024-09-19T09:02:25.202 INFO:tasks.workunit.client.1.smithi102.stdout:6/1: chown . 1 1 2024-09-19T09:02:25.202 INFO:tasks.workunit.client.1.smithi102.stdout:6/2: dread - no filename 2024-09-19T09:02:25.202 INFO:tasks.workunit.client.1.smithi102.stdout:6/3: rmdir - no directory 2024-09-19T09:02:25.202 INFO:tasks.workunit.client.1.smithi102.stdout:6/4: dread - no filename 2024-09-19T09:02:25.203 INFO:tasks.workunit.client.1.smithi102.stdout:6/5: dread - no filename 2024-09-19T09:02:25.203 INFO:tasks.workunit.client.1.smithi102.stdout:6/6: rmdir - no directory 2024-09-19T09:02:25.203 INFO:tasks.workunit.client.1.smithi102.stdout:6/7: write - no filename 2024-09-19T09:02:25.203 INFO:tasks.workunit.client.1.smithi102.stdout:5/1: mknod c0 0 2024-09-19T09:02:25.203 INFO:tasks.workunit.client.1.smithi102.stdout:0/9: symlink d3/l4 0 2024-09-19T09:02:25.205 INFO:tasks.workunit.client.1.smithi102.stdout:1/15: dwrite f0 [0,4194304] 0 2024-09-19T09:02:25.206 INFO:tasks.workunit.client.1.smithi102.stdout:4/9: rename l0 to l1 0 2024-09-19T09:02:25.206 INFO:tasks.workunit.client.1.smithi102.stdout:4/10: fsync - no filename 2024-09-19T09:02:25.206 INFO:tasks.workunit.client.1.smithi102.stdout:4/11: dwrite - no filename 2024-09-19T09:02:25.207 INFO:tasks.workunit.client.1.smithi102.stdout:5/2: mknod c1 0 2024-09-19T09:02:25.209 INFO:tasks.workunit.client.1.smithi102.stdout:6/8: mkdir d0 0 2024-09-19T09:02:25.209 INFO:tasks.workunit.client.1.smithi102.stdout:6/9: dwrite - no filename 2024-09-19T09:02:25.212 INFO:tasks.workunit.client.1.smithi102.stdout:8/0: fsync - no filename 2024-09-19T09:02:25.212 INFO:tasks.workunit.client.1.smithi102.stdout:8/1: unlink - no file 2024-09-19T09:02:25.212 INFO:tasks.workunit.client.1.smithi102.stdout:8/2: chown . 473 1 2024-09-19T09:02:25.212 INFO:tasks.workunit.client.1.smithi102.stdout:8/3: write - no filename 2024-09-19T09:02:25.212 INFO:tasks.workunit.client.1.smithi102.stdout:8/4: truncate - no filename 2024-09-19T09:02:25.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/16: mknod c2 0 2024-09-19T09:02:25.214 INFO:tasks.workunit.client.1.smithi102.stdout:4/12: creat f2 x:0 0 0 2024-09-19T09:02:25.215 INFO:tasks.workunit.client.1.smithi102.stdout:5/3: symlink l2 0 2024-09-19T09:02:25.215 INFO:tasks.workunit.client.1.smithi102.stdout:5/4: dwrite - no filename 2024-09-19T09:02:25.216 INFO:tasks.workunit.client.1.smithi102.stdout:0/10: dwrite f2 [0,4194304] 0 2024-09-19T09:02:25.222 INFO:tasks.workunit.client.1.smithi102.stdout:7/0: creat f0 x:0 0 0 2024-09-19T09:02:25.224 INFO:tasks.workunit.client.1.smithi102.stdout:4/13: symlink l3 0 2024-09-19T09:02:25.225 INFO:tasks.workunit.client.1.smithi102.stdout:5/5: rename c1 to c3 0 2024-09-19T09:02:25.225 INFO:tasks.workunit.client.1.smithi102.stdout:5/6: stat c0 0 2024-09-19T09:02:25.227 INFO:tasks.workunit.client.1.smithi102.stdout:1/17: dwrite f0 [0,4194304] 0 2024-09-19T09:02:25.228 INFO:tasks.workunit.client.1.smithi102.stdout:8/5: mkdir d0 0 2024-09-19T09:02:25.229 INFO:tasks.workunit.client.1.smithi102.stdout:1/18: write f0 [780435,31898] 0 2024-09-19T09:02:25.230 INFO:tasks.workunit.client.1.smithi102.stdout:7/1: mkdir d1 0 2024-09-19T09:02:25.230 INFO:tasks.workunit.client.1.smithi102.stdout:0/11: dwrite f1 [0,4194304] 0 2024-09-19T09:02:25.230 INFO:tasks.workunit.client.1.smithi102.stdout:8/6: rename d0 to d0/d1 22 2024-09-19T09:02:25.230 INFO:tasks.workunit.client.1.smithi102.stdout:8/7: dread - no filename 2024-09-19T09:02:25.231 INFO:tasks.workunit.client.1.smithi102.stdout:8/8: write - no filename 2024-09-19T09:02:25.231 INFO:tasks.workunit.client.1.smithi102.stdout:8/9: truncate - no filename 2024-09-19T09:02:25.231 INFO:tasks.workunit.client.1.smithi102.stdout:8/10: link - no file 2024-09-19T09:02:25.232 INFO:tasks.workunit.client.1.smithi102.stdout:7/2: dread - f0 zero size 2024-09-19T09:02:25.232 INFO:tasks.workunit.client.1.smithi102.stdout:7/3: readlink - no filename 2024-09-19T09:02:25.232 INFO:tasks.workunit.client.1.smithi102.stdout:8/11: stat d0 0 2024-09-19T09:02:25.232 INFO:tasks.workunit.client.1.smithi102.stdout:8/12: fdatasync - no filename 2024-09-19T09:02:25.232 INFO:tasks.workunit.client.1.smithi102.stdout:8/13: write - no filename 2024-09-19T09:02:25.233 INFO:tasks.workunit.client.1.smithi102.stdout:8/14: rename d0 to d0/d2 22 2024-09-19T09:02:25.233 INFO:tasks.workunit.client.1.smithi102.stdout:8/15: fdatasync - no filename 2024-09-19T09:02:25.234 INFO:tasks.workunit.client.1.smithi102.stdout:8/16: rename d0 to d0/d3 22 2024-09-19T09:02:25.234 INFO:tasks.workunit.client.1.smithi102.stdout:8/17: read - no filename 2024-09-19T09:02:25.234 INFO:tasks.workunit.client.1.smithi102.stdout:8/18: read - no filename 2024-09-19T09:02:25.235 INFO:tasks.workunit.client.1.smithi102.stdout:6/10: rmdir d0 0 2024-09-19T09:02:25.238 INFO:tasks.workunit.client.1.smithi102.stdout:0/12: dread f1 [0,4194304] 0 2024-09-19T09:02:25.242 INFO:tasks.workunit.client.1.smithi102.stdout:9/0: creat f0 x:0 0 0 2024-09-19T09:02:25.249 INFO:tasks.workunit.client.1.smithi102.stdout:6/11: mkdir d1 0 2024-09-19T09:02:25.250 INFO:tasks.workunit.client.1.smithi102.stdout:6/12: rename d1 to d1/d2 22 2024-09-19T09:02:25.250 INFO:tasks.workunit.client.1.smithi102.stdout:6/13: dwrite - no filename 2024-09-19T09:02:25.250 INFO:tasks.workunit.client.1.smithi102.stdout:0/13: rmdir d3 39 2024-09-19T09:02:25.250 INFO:tasks.workunit.client.1.smithi102.stdout:6/14: chown d1 41 1 2024-09-19T09:02:25.250 INFO:tasks.workunit.client.1.smithi102.stdout:0/14: chown f1 0 1 2024-09-19T09:02:25.250 INFO:tasks.workunit.client.1.smithi102.stdout:6/15: chown d1 671 1 2024-09-19T09:02:25.250 INFO:tasks.workunit.client.1.smithi102.stdout:6/16: read - no filename 2024-09-19T09:02:25.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:24 smithi102 ceph-mon[35280]: pgmap v19: 65 pgs: 65 active+clean; 186 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 403 op/s 2024-09-19T09:02:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:24 smithi049 ceph-mon[28158]: pgmap v19: 65 pgs: 65 active+clean; 186 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.0 MiB/s wr, 403 op/s 2024-09-19T09:02:25.401 INFO:tasks.workunit.client.1.smithi102.stdout:9/1: mkdir d1 0 2024-09-19T09:02:25.401 INFO:tasks.workunit.client.1.smithi102.stdout:7/4: mkdir d1/d2 0 2024-09-19T09:02:25.402 INFO:tasks.workunit.client.1.smithi102.stdout:9/2: write f0 [392157,127804] 0 2024-09-19T09:02:25.403 INFO:tasks.workunit.client.1.smithi102.stdout:8/19: creat d0/f4 x:0 0 0 2024-09-19T09:02:25.422 INFO:tasks.workunit.client.1.smithi102.stdout:8/20: creat d0/f5 x:0 0 0 2024-09-19T09:02:25.423 INFO:tasks.workunit.client.1.smithi102.stdout:6/17: creat d1/f3 x:0 0 0 2024-09-19T09:02:25.423 INFO:tasks.workunit.client.1.smithi102.stdout:6/18: chown d1 531943 1 2024-09-19T09:02:25.426 INFO:tasks.workunit.client.1.smithi102.stdout:8/21: creat d0/f6 x:0 0 0 2024-09-19T09:02:25.428 INFO:tasks.workunit.client.1.smithi102.stdout:8/22: write d0/f4 [635685,76755] 0 2024-09-19T09:02:25.431 INFO:tasks.workunit.client.1.smithi102.stdout:6/19: dwrite d1/f3 [0,4194304] 0 2024-09-19T09:02:25.433 INFO:tasks.workunit.client.1.smithi102.stdout:6/20: write d1/f3 [944445,33509] 0 2024-09-19T09:02:25.437 INFO:tasks.workunit.client.1.smithi102.stdout:8/23: dwrite d0/f4 [0,4194304] 0 2024-09-19T09:02:25.441 INFO:tasks.workunit.client.1.smithi102.stdout:8/24: creat d0/f7 x:0 0 0 2024-09-19T09:02:25.463 INFO:tasks.workunit.client.1.smithi102.stdout:6/21: fdatasync d1/f3 0 2024-09-19T09:02:25.463 INFO:tasks.workunit.client.1.smithi102.stdout:6/22: read d1/f3 [3147188,24647] 0 2024-09-19T09:02:25.466 INFO:tasks.workunit.client.1.smithi102.stdout:6/23: unlink d1/f3 0 2024-09-19T09:02:25.466 INFO:tasks.workunit.client.1.smithi102.stdout:6/24: rename d1 to d1/d4 22 2024-09-19T09:02:25.477 INFO:tasks.workunit.client.1.smithi102.stdout:1/19: fsync f0 0 2024-09-19T09:02:25.478 INFO:tasks.workunit.client.1.smithi102.stdout:1/20: write f0 [2014474,77025] 0 2024-09-19T09:02:25.479 INFO:tasks.workunit.client.1.smithi102.stdout:3/5: getdents . 0 2024-09-19T09:02:25.480 INFO:tasks.workunit.client.1.smithi102.stdout:1/21: rename c2 to c3 0 2024-09-19T09:02:25.481 INFO:tasks.workunit.client.1.smithi102.stdout:3/6: mknod c1 0 2024-09-19T09:02:25.481 INFO:tasks.workunit.client.1.smithi102.stdout:3/7: dread - no filename 2024-09-19T09:02:25.481 INFO:tasks.workunit.client.1.smithi102.stdout:3/8: truncate - no filename 2024-09-19T09:02:25.481 INFO:tasks.workunit.client.1.smithi102.stdout:3/9: truncate - no filename 2024-09-19T09:02:25.483 INFO:tasks.workunit.client.1.smithi102.stdout:1/22: creat f4 x:0 0 0 2024-09-19T09:02:25.484 INFO:tasks.workunit.client.1.smithi102.stdout:3/10: mkdir d2 0 2024-09-19T09:02:25.485 INFO:tasks.workunit.client.1.smithi102.stdout:0/15: mknod d3/c5 0 2024-09-19T09:02:25.486 INFO:tasks.workunit.client.1.smithi102.stdout:1/23: symlink l5 0 2024-09-19T09:02:25.489 INFO:tasks.workunit.client.1.smithi102.stdout:3/11: symlink d2/l3 0 2024-09-19T09:02:25.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/14: readlink l1 0 2024-09-19T09:02:25.492 INFO:tasks.workunit.client.1.smithi102.stdout:3/12: symlink d2/l4 0 2024-09-19T09:02:25.493 INFO:tasks.workunit.client.1.smithi102.stdout:3/13: fdatasync - no filename 2024-09-19T09:02:25.493 INFO:tasks.workunit.client.1.smithi102.stdout:1/24: dwrite f4 [0,4194304] 0 2024-09-19T09:02:25.493 INFO:tasks.workunit.client.1.smithi102.stdout:2/5: truncate f0 386737 0 2024-09-19T09:02:25.496 INFO:tasks.workunit.client.1.smithi102.stdout:4/15: unlink l3 0 2024-09-19T09:02:25.497 INFO:tasks.workunit.client.1.smithi102.stdout:3/14: mkdir d2/d5 0 2024-09-19T09:02:25.498 INFO:tasks.workunit.client.1.smithi102.stdout:3/15: dwrite - no filename 2024-09-19T09:02:25.498 INFO:tasks.workunit.client.1.smithi102.stdout:3/16: dread - no filename 2024-09-19T09:02:25.498 INFO:tasks.workunit.client.1.smithi102.stdout:3/17: dread - no filename 2024-09-19T09:02:25.498 INFO:tasks.workunit.client.1.smithi102.stdout:3/18: dread - no filename 2024-09-19T09:02:25.499 INFO:tasks.workunit.client.1.smithi102.stdout:1/25: dread f0 [0,4194304] 0 2024-09-19T09:02:25.500 INFO:tasks.workunit.client.1.smithi102.stdout:1/26: read f4 [1557194,67795] 0 2024-09-19T09:02:25.502 INFO:tasks.workunit.client.1.smithi102.stdout:3/19: unlink c1 0 2024-09-19T09:02:25.502 INFO:tasks.workunit.client.1.smithi102.stdout:3/20: write - no filename 2024-09-19T09:02:25.502 INFO:tasks.workunit.client.1.smithi102.stdout:3/21: write - no filename 2024-09-19T09:02:25.504 INFO:tasks.workunit.client.1.smithi102.stdout:7/5: fsync f0 0 2024-09-19T09:02:25.506 INFO:tasks.workunit.client.1.smithi102.stdout:1/27: creat f6 x:0 0 0 2024-09-19T09:02:25.507 INFO:tasks.workunit.client.1.smithi102.stdout:1/28: write f6 [594594,58813] 0 2024-09-19T09:02:25.508 INFO:tasks.workunit.client.1.smithi102.stdout:3/22: rmdir d2 39 2024-09-19T09:02:25.511 INFO:tasks.workunit.client.1.smithi102.stdout:7/6: mkdir d1/d3 0 2024-09-19T09:02:25.511 INFO:tasks.workunit.client.1.smithi102.stdout:7/7: fdatasync f0 0 2024-09-19T09:02:25.511 INFO:tasks.workunit.client.1.smithi102.stdout:7/8: read - f0 zero size 2024-09-19T09:02:25.512 INFO:tasks.workunit.client.1.smithi102.stdout:1/29: mknod c7 0 2024-09-19T09:02:25.516 INFO:tasks.workunit.client.1.smithi102.stdout:7/9: unlink f0 0 2024-09-19T09:02:25.516 INFO:tasks.workunit.client.1.smithi102.stdout:7/10: dwrite - no filename 2024-09-19T09:02:25.517 INFO:tasks.workunit.client.1.smithi102.stdout:7/11: stat d1/d2 0 2024-09-19T09:02:25.518 INFO:tasks.workunit.client.1.smithi102.stdout:5/7: link c3 c4 0 2024-09-19T09:02:25.520 INFO:tasks.workunit.client.1.smithi102.stdout:0/16: dwrite f1 [4194304,4194304] 0 2024-09-19T09:02:25.523 INFO:tasks.workunit.client.1.smithi102.stdout:7/12: rename d1/d2 to d1/d4 0 2024-09-19T09:02:25.523 INFO:tasks.workunit.client.1.smithi102.stdout:1/30: dwrite f6 [0,4194304] 0 2024-09-19T09:02:25.525 INFO:tasks.workunit.client.1.smithi102.stdout:1/31: chown c7 2837 1 2024-09-19T09:02:25.527 INFO:tasks.workunit.client.1.smithi102.stdout:5/8: chown c3 2 1 2024-09-19T09:02:25.529 INFO:tasks.workunit.client.1.smithi102.stdout:7/13: creat d1/f5 x:0 0 0 2024-09-19T09:02:25.530 INFO:tasks.workunit.client.1.smithi102.stdout:9/3: truncate f0 110831 0 2024-09-19T09:02:25.533 INFO:tasks.workunit.client.1.smithi102.stdout:5/9: mkdir d5 0 2024-09-19T09:02:25.533 INFO:tasks.workunit.client.1.smithi102.stdout:5/10: write - no filename 2024-09-19T09:02:25.534 INFO:tasks.workunit.client.1.smithi102.stdout:5/11: chown d5 576992342 1 2024-09-19T09:02:25.534 INFO:tasks.workunit.client.1.smithi102.stdout:5/12: dwrite - no filename 2024-09-19T09:02:25.534 INFO:tasks.workunit.client.1.smithi102.stdout:5/13: fsync - no filename 2024-09-19T09:02:25.534 INFO:tasks.workunit.client.1.smithi102.stdout:0/17: dwrite f2 [0,4194304] 0 2024-09-19T09:02:25.540 INFO:tasks.workunit.client.1.smithi102.stdout:7/14: link d1/f5 d1/d4/f6 0 2024-09-19T09:02:25.541 INFO:tasks.workunit.client.1.smithi102.stdout:1/32: dwrite f0 [0,4194304] 0 2024-09-19T09:02:25.544 INFO:tasks.workunit.client.1.smithi102.stdout:8/25: write d0/f4 [4853703,10672] 0 2024-09-19T09:02:25.544 INFO:tasks.workunit.client.1.smithi102.stdout:5/14: link c4 d5/c6 0 2024-09-19T09:02:25.544 INFO:tasks.workunit.client.1.smithi102.stdout:5/15: write - no filename 2024-09-19T09:02:25.545 INFO:tasks.workunit.client.1.smithi102.stdout:1/33: symlink l8 0 2024-09-19T09:02:25.548 INFO:tasks.workunit.client.1.smithi102.stdout:7/15: creat d1/f7 x:0 0 0 2024-09-19T09:02:25.548 INFO:tasks.workunit.client.1.smithi102.stdout:0/18: dwrite f1 [8388608,4194304] 0 2024-09-19T09:02:25.549 INFO:tasks.workunit.client.1.smithi102.stdout:1/34: creat f9 x:0 0 0 2024-09-19T09:02:25.549 INFO:tasks.workunit.client.1.smithi102.stdout:1/35: stat l5 0 2024-09-19T09:02:25.551 INFO:tasks.workunit.client.1.smithi102.stdout:1/36: read - f9 zero size 2024-09-19T09:02:25.551 INFO:tasks.workunit.client.1.smithi102.stdout:5/16: mkdir d5/d7 0 2024-09-19T09:02:25.551 INFO:tasks.workunit.client.1.smithi102.stdout:5/17: dwrite - no filename 2024-09-19T09:02:25.551 INFO:tasks.workunit.client.1.smithi102.stdout:5/18: dread - no filename 2024-09-19T09:02:25.554 INFO:tasks.workunit.client.1.smithi102.stdout:1/37: mknod ca 0 2024-09-19T09:02:25.555 INFO:tasks.workunit.client.1.smithi102.stdout:1/38: stat l5 0 2024-09-19T09:02:25.556 INFO:tasks.workunit.client.1.smithi102.stdout:7/16: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:02:25.558 INFO:tasks.workunit.client.1.smithi102.stdout:5/19: rename c0 to d5/c8 0 2024-09-19T09:02:25.558 INFO:tasks.workunit.client.1.smithi102.stdout:5/20: readlink l2 0 2024-09-19T09:02:25.558 INFO:tasks.workunit.client.1.smithi102.stdout:5/21: dread - no filename 2024-09-19T09:02:25.559 INFO:tasks.workunit.client.1.smithi102.stdout:5/22: chown d5/d7 578444 1 2024-09-19T09:02:25.559 INFO:tasks.workunit.client.1.smithi102.stdout:5/23: dwrite - no filename 2024-09-19T09:02:25.559 INFO:tasks.workunit.client.1.smithi102.stdout:5/24: dread - no filename 2024-09-19T09:02:25.564 INFO:tasks.workunit.client.1.smithi102.stdout:1/39: creat fb x:0 0 0 2024-09-19T09:02:25.565 INFO:tasks.workunit.client.1.smithi102.stdout:7/17: mknod d1/c8 0 2024-09-19T09:02:25.566 INFO:tasks.workunit.client.1.smithi102.stdout:7/18: stat d1/d4 0 2024-09-19T09:02:25.566 INFO:tasks.workunit.client.1.smithi102.stdout:8/26: getdents d0 0 2024-09-19T09:02:25.567 INFO:tasks.workunit.client.1.smithi102.stdout:8/27: write d0/f4 [4654626,21210] 0 2024-09-19T09:02:25.738 INFO:tasks.workunit.client.1.smithi102.stdout:0/19: fsync f1 0 2024-09-19T09:02:25.738 INFO:tasks.workunit.client.1.smithi102.stdout:0/20: chown d3/l4 11126626 1 2024-09-19T09:02:25.739 INFO:tasks.workunit.client.1.smithi102.stdout:0/21: write f1 [5377301,42211] 0 2024-09-19T09:02:25.770 INFO:tasks.workunit.client.1.smithi102.stdout:1/40: write f4 [694874,59815] 0 2024-09-19T09:02:25.778 INFO:tasks.workunit.client.1.smithi102.stdout:1/41: dwrite f9 [0,4194304] 0 2024-09-19T09:02:25.778 INFO:tasks.workunit.client.1.smithi102.stdout:3/23: symlink d2/d5/l6 0 2024-09-19T09:02:25.779 INFO:tasks.workunit.client.1.smithi102.stdout:3/24: dread - no filename 2024-09-19T09:02:25.782 INFO:tasks.workunit.client.1.smithi102.stdout:0/22: symlink d3/l6 0 2024-09-19T09:02:25.783 INFO:tasks.workunit.client.1.smithi102.stdout:0/23: chown d3/c5 7792 1 2024-09-19T09:02:25.783 INFO:tasks.workunit.client.1.smithi102.stdout:0/24: chown d3/l4 88 1 2024-09-19T09:02:25.783 INFO:tasks.workunit.client.1.smithi102.stdout:0/25: write f2 [1984840,21103] 0 2024-09-19T09:02:25.786 INFO:tasks.workunit.client.1.smithi102.stdout:5/25: creat d5/d7/f9 x:0 0 0 2024-09-19T09:02:25.791 INFO:tasks.workunit.client.1.smithi102.stdout:0/26: dwrite f1 [4194304,4194304] 0 2024-09-19T09:02:25.795 INFO:tasks.workunit.client.1.smithi102.stdout:1/42: creat fc x:0 0 0 2024-09-19T09:02:25.795 INFO:tasks.workunit.client.1.smithi102.stdout:1/43: chown fc 1 1 2024-09-19T09:02:25.797 INFO:tasks.workunit.client.1.smithi102.stdout:3/25: creat d2/d5/f7 x:0 0 0 2024-09-19T09:02:25.798 INFO:tasks.workunit.client.1.smithi102.stdout:8/28: link d0/f4 d0/f8 0 2024-09-19T09:02:25.800 INFO:tasks.workunit.client.1.smithi102.stdout:0/27: dwrite f2 [0,4194304] 0 2024-09-19T09:02:25.809 INFO:tasks.workunit.client.1.smithi102.stdout:1/44: mkdir dd 0 2024-09-19T09:02:25.809 INFO:tasks.workunit.client.1.smithi102.stdout:1/45: fsync f9 0 2024-09-19T09:02:25.812 INFO:tasks.workunit.client.1.smithi102.stdout:3/26: unlink d2/d5/l6 0 2024-09-19T09:02:25.815 INFO:tasks.workunit.client.1.smithi102.stdout:1/46: dwrite f0 [0,4194304] 0 2024-09-19T09:02:25.816 INFO:tasks.workunit.client.1.smithi102.stdout:0/28: unlink l0 0 2024-09-19T09:02:25.817 INFO:tasks.workunit.client.1.smithi102.stdout:7/19: rmdir d1 39 2024-09-19T09:02:25.820 INFO:tasks.workunit.client.1.smithi102.stdout:3/27: symlink d2/l8 0 2024-09-19T09:02:25.822 INFO:tasks.workunit.client.1.smithi102.stdout:5/26: rename d5/c8 to d5/d7/ca 0 2024-09-19T09:02:25.824 INFO:tasks.workunit.client.1.smithi102.stdout:2/6: link f0 f1 0 2024-09-19T09:02:25.825 INFO:tasks.workunit.client.1.smithi102.stdout:0/29: creat d3/f7 x:0 0 0 2024-09-19T09:02:25.826 INFO:tasks.workunit.client.1.smithi102.stdout:3/28: truncate d2/d5/f7 357161 0 2024-09-19T09:02:25.827 INFO:tasks.workunit.client.1.smithi102.stdout:5/27: creat d5/fb x:0 0 0 2024-09-19T09:02:25.828 INFO:tasks.workunit.client.1.smithi102.stdout:8/29: dwrite d0/f4 [4194304,4194304] 0 2024-09-19T09:02:25.828 INFO:tasks.workunit.client.1.smithi102.stdout:8/30: readlink - no filename 2024-09-19T09:02:25.831 INFO:tasks.workunit.client.1.smithi102.stdout:1/47: dwrite fc [0,4194304] 0 2024-09-19T09:02:25.831 INFO:tasks.workunit.client.1.smithi102.stdout:5/28: write d5/d7/f9 [127126,39221] 0 2024-09-19T09:02:25.834 INFO:tasks.workunit.client.1.smithi102.stdout:0/30: mkdir d3/d8 0 2024-09-19T09:02:25.834 INFO:tasks.workunit.client.1.smithi102.stdout:0/31: read f1 [1479650,59912] 0 2024-09-19T09:02:25.835 INFO:tasks.workunit.client.1.smithi102.stdout:3/29: creat d2/f9 x:0 0 0 2024-09-19T09:02:25.838 INFO:tasks.workunit.client.1.smithi102.stdout:1/48: dread f6 [0,4194304] 0 2024-09-19T09:02:25.838 INFO:tasks.workunit.client.1.smithi102.stdout:9/4: truncate f0 93956 0 2024-09-19T09:02:25.839 INFO:tasks.workunit.client.1.smithi102.stdout:1/49: write f6 [95933,92321] 0 2024-09-19T09:02:25.839 INFO:tasks.workunit.client.1.smithi102.stdout:1/50: chown l5 5156 1 2024-09-19T09:02:25.840 INFO:tasks.workunit.client.1.smithi102.stdout:8/31: symlink d0/l9 0 2024-09-19T09:02:25.840 INFO:tasks.workunit.client.1.smithi102.stdout:1/51: readlink l8 0 2024-09-19T09:02:25.840 INFO:tasks.workunit.client.1.smithi102.stdout:8/32: chown d0/f5 671 1 2024-09-19T09:02:25.853 INFO:tasks.workunit.client.1.smithi102.stdout:1/52: rename l1 to dd/le 0 2024-09-19T09:02:25.855 INFO:tasks.workunit.client.1.smithi102.stdout:8/33: rename d0/l9 to d0/la 0 2024-09-19T09:02:25.856 INFO:tasks.workunit.client.1.smithi102.stdout:8/34: write d0/f4 [1898897,113496] 0 2024-09-19T09:02:25.864 INFO:tasks.workunit.client.1.smithi102.stdout:1/53: creat dd/ff x:0 0 0 2024-09-19T09:02:25.867 INFO:tasks.workunit.client.1.smithi102.stdout:8/35: mkdir d0/db 0 2024-09-19T09:02:25.868 INFO:tasks.workunit.client.1.smithi102.stdout:0/32: link d3/l4 d3/d8/l9 0 2024-09-19T09:02:25.869 INFO:tasks.workunit.client.1.smithi102.stdout:5/29: chown d5/d7/ca 247060 1 2024-09-19T09:02:25.870 INFO:tasks.workunit.client.1.smithi102.stdout:1/54: creat dd/f10 x:0 0 0 2024-09-19T09:02:25.871 INFO:tasks.workunit.client.1.smithi102.stdout:1/55: write f4 [3807910,72645] 0 2024-09-19T09:02:25.871 INFO:tasks.workunit.client.1.smithi102.stdout:3/30: rmdir d2 39 2024-09-19T09:02:25.872 INFO:tasks.workunit.client.1.smithi102.stdout:1/56: write f4 [5116361,79614] 0 2024-09-19T09:02:25.874 INFO:tasks.workunit.client.1.smithi102.stdout:0/33: unlink f1 0 2024-09-19T09:02:25.875 INFO:tasks.workunit.client.1.smithi102.stdout:9/5: write f0 [207102,84486] 0 2024-09-19T09:02:25.877 INFO:tasks.workunit.client.1.smithi102.stdout:5/30: mknod d5/d7/cc 0 2024-09-19T09:02:25.877 INFO:tasks.workunit.client.1.smithi102.stdout:9/6: write f0 [923908,27928] 0 2024-09-19T09:02:25.879 INFO:tasks.workunit.client.1.smithi102.stdout:2/7: dwrite f0 [0,4194304] 0 2024-09-19T09:02:25.882 INFO:tasks.workunit.client.1.smithi102.stdout:9/7: dread f0 [0,4194304] 0 2024-09-19T09:02:25.882 INFO:tasks.workunit.client.1.smithi102.stdout:3/31: dread d2/d5/f7 [0,4194304] 0 2024-09-19T09:02:25.883 INFO:tasks.workunit.client.1.smithi102.stdout:1/57: creat dd/f11 x:0 0 0 2024-09-19T09:02:25.903 INFO:tasks.workunit.client.1.smithi102.stdout:3/32: creat d2/d5/fa x:0 0 0 2024-09-19T09:02:25.905 INFO:tasks.workunit.client.1.smithi102.stdout:0/34: chown d3/l4 7602731 1 2024-09-19T09:02:25.905 INFO:tasks.workunit.client.1.smithi102.stdout:0/35: stat d3/c5 0 2024-09-19T09:02:25.907 INFO:tasks.workunit.client.1.smithi102.stdout:8/36: rename d0/la to d0/db/lc 0 2024-09-19T09:02:25.909 INFO:tasks.workunit.client.1.smithi102.stdout:5/31: rmdir d5/d7 39 2024-09-19T09:02:25.912 INFO:tasks.workunit.client.1.smithi102.stdout:0/36: dwrite d3/f7 [0,4194304] 0 2024-09-19T09:02:25.916 INFO:tasks.workunit.client.1.smithi102.stdout:9/8: unlink f0 0 2024-09-19T09:02:25.917 INFO:tasks.workunit.client.1.smithi102.stdout:9/9: chown d1 10344860 1 2024-09-19T09:02:25.918 INFO:tasks.workunit.client.1.smithi102.stdout:3/33: write d2/d5/f7 [670029,13042] 0 2024-09-19T09:02:25.919 INFO:tasks.workunit.client.1.smithi102.stdout:3/34: write d2/f9 [555688,99000] 0 2024-09-19T09:02:25.921 INFO:tasks.workunit.client.1.smithi102.stdout:1/58: link dd/f10 dd/f12 0 2024-09-19T09:02:25.924 INFO:tasks.workunit.client.1.smithi102.stdout:8/37: unlink d0/f4 0 2024-09-19T09:02:25.925 INFO:tasks.workunit.client.1.smithi102.stdout:8/38: truncate d0/f6 730996 0 2024-09-19T09:02:25.928 INFO:tasks.workunit.client.1.smithi102.stdout:0/37: rename d3/c5 to d3/ca 0 2024-09-19T09:02:25.929 INFO:tasks.workunit.client.1.smithi102.stdout:0/38: fdatasync f2 0 2024-09-19T09:02:25.929 INFO:tasks.workunit.client.1.smithi102.stdout:0/39: stat d3 0 2024-09-19T09:02:25.933 INFO:tasks.workunit.client.1.smithi102.stdout:1/59: mkdir dd/d13 0 2024-09-19T09:02:25.938 INFO:tasks.workunit.client.1.smithi102.stdout:2/8: truncate f0 42728 0 2024-09-19T09:02:25.938 INFO:tasks.workunit.client.1.smithi102.stdout:5/32: mknod d5/cd 0 2024-09-19T09:02:25.943 INFO:tasks.workunit.client.1.smithi102.stdout:9/10: mkdir d1/d2 0 2024-09-19T09:02:25.943 INFO:tasks.workunit.client.1.smithi102.stdout:9/11: dwrite - no filename 2024-09-19T09:02:25.943 INFO:tasks.workunit.client.1.smithi102.stdout:9/12: unlink - no file 2024-09-19T09:02:25.944 INFO:tasks.workunit.client.1.smithi102.stdout:1/60: unlink fb 0 2024-09-19T09:02:25.945 INFO:tasks.workunit.client.1.smithi102.stdout:1/61: chown f0 108834 1 2024-09-19T09:02:25.947 INFO:tasks.workunit.client.1.smithi102.stdout:2/9: creat f2 x:0 0 0 2024-09-19T09:02:25.953 INFO:tasks.workunit.client.1.smithi102.stdout:1/62: dread - dd/f10 zero size 2024-09-19T09:02:25.956 INFO:tasks.workunit.client.1.smithi102.stdout:1/63: dread f0 [0,4194304] 0 2024-09-19T09:02:25.962 INFO:tasks.workunit.client.1.smithi102.stdout:9/13: mkdir d1/d2/d3 0 2024-09-19T09:02:25.963 INFO:tasks.workunit.client.1.smithi102.stdout:9/14: readlink - no filename 2024-09-19T09:02:25.963 INFO:tasks.workunit.client.1.smithi102.stdout:9/15: unlink - no file 2024-09-19T09:02:25.963 INFO:tasks.workunit.client.1.smithi102.stdout:9/16: stat d1/d2/d3 0 2024-09-19T09:02:25.964 INFO:tasks.workunit.client.1.smithi102.stdout:0/40: rename d3/ca to d3/d8/cb 0 2024-09-19T09:02:25.967 INFO:tasks.workunit.client.1.smithi102.stdout:8/39: getdents d0/db 0 2024-09-19T09:02:25.967 INFO:tasks.workunit.client.1.smithi102.stdout:0/41: dread f2 [0,4194304] 0 2024-09-19T09:02:25.969 INFO:tasks.workunit.client.1.smithi102.stdout:1/64: mkdir dd/d14 0 2024-09-19T09:02:25.971 INFO:tasks.workunit.client.1.smithi102.stdout:5/33: creat d5/fe x:0 0 0 2024-09-19T09:02:25.973 INFO:tasks.workunit.client.1.smithi102.stdout:9/17: mknod d1/d2/c4 0 2024-09-19T09:02:25.973 INFO:tasks.workunit.client.1.smithi102.stdout:9/18: readlink - no filename 2024-09-19T09:02:25.980 INFO:tasks.workunit.client.1.smithi102.stdout:0/42: rename d3/l6 to d3/lc 0 2024-09-19T09:02:25.983 INFO:tasks.workunit.client.1.smithi102.stdout:0/43: dread d3/f7 [0,4194304] 0 2024-09-19T09:02:25.983 INFO:tasks.workunit.client.1.smithi102.stdout:0/44: fsync f2 0 2024-09-19T09:02:25.989 INFO:tasks.workunit.client.1.smithi102.stdout:0/45: dwrite f2 [0,4194304] 0 2024-09-19T09:02:25.995 INFO:tasks.workunit.client.1.smithi102.stdout:5/34: rename d5/fb to d5/d7/ff 0 2024-09-19T09:02:25.996 INFO:tasks.workunit.client.1.smithi102.stdout:5/35: stat l2 0 2024-09-19T09:02:25.997 INFO:tasks.workunit.client.1.smithi102.stdout:9/19: creat d1/d2/d3/f5 x:0 0 0 2024-09-19T09:02:25.998 INFO:tasks.workunit.client.1.smithi102.stdout:5/36: truncate d5/d7/f9 518477 0 2024-09-19T09:02:25.999 INFO:tasks.workunit.client.1.smithi102.stdout:5/37: write d5/fe [19791,77883] 0 2024-09-19T09:02:26.002 INFO:tasks.workunit.client.1.smithi102.stdout:1/65: dwrite dd/f10 [0,4194304] 0 2024-09-19T09:02:26.004 INFO:tasks.workunit.client.1.smithi102.stdout:0/46: dread d3/f7 [0,4194304] 0 2024-09-19T09:02:26.132 INFO:tasks.workunit.client.1.smithi102.stdout:9/20: creat d1/f6 x:0 0 0 2024-09-19T09:02:26.133 INFO:tasks.workunit.client.1.smithi102.stdout:9/21: dread - d1/f6 zero size 2024-09-19T09:02:26.133 INFO:tasks.workunit.client.1.smithi102.stdout:8/40: creat d0/fd x:0 0 0 2024-09-19T09:02:26.134 INFO:tasks.workunit.client.1.smithi102.stdout:2/10: truncate f1 762278 0 2024-09-19T09:02:26.159 INFO:tasks.workunit.client.1.smithi102.stdout:1/66: symlink dd/l15 0 2024-09-19T09:02:26.161 INFO:tasks.workunit.client.1.smithi102.stdout:0/47: mkdir d3/dd 0 2024-09-19T09:02:26.161 INFO:tasks.workunit.client.1.smithi102.stdout:0/48: write f2 [1252770,112235] 0 2024-09-19T09:02:26.164 INFO:tasks.workunit.client.1.smithi102.stdout:9/22: symlink d1/d2/d3/l7 0 2024-09-19T09:02:26.416 INFO:tasks.workunit.client.1.smithi102.stdout:0/49: mkdir d3/d8/de 0 2024-09-19T09:02:26.421 INFO:tasks.workunit.client.1.smithi102.stdout:2/11: rename f1 to f3 0 2024-09-19T09:02:26.422 INFO:tasks.workunit.client.1.smithi102.stdout:8/41: symlink d0/le 0 2024-09-19T09:02:26.423 INFO:tasks.workunit.client.1.smithi102.stdout:8/42: write d0/fd [433542,82201] 0 2024-09-19T09:02:26.423 INFO:tasks.workunit.client.1.smithi102.stdout:5/38: getdents d5 0 2024-09-19T09:02:26.423 INFO:tasks.workunit.client.1.smithi102.stdout:5/39: dread - d5/d7/ff zero size 2024-09-19T09:02:26.425 INFO:tasks.workunit.client.1.smithi102.stdout:5/40: write d5/d7/f9 [64806,97152] 0 2024-09-19T09:02:26.428 INFO:tasks.workunit.client.1.smithi102.stdout:5/41: symlink d5/d7/l10 0 2024-09-19T09:02:26.430 INFO:tasks.workunit.client.1.smithi102.stdout:8/43: symlink d0/lf 0 2024-09-19T09:02:26.430 INFO:tasks.workunit.client.1.smithi102.stdout:8/44: fsync d0/fd 0 2024-09-19T09:02:26.436 INFO:tasks.workunit.client.1.smithi102.stdout:5/42: dwrite d5/d7/ff [0,4194304] 0 2024-09-19T09:02:26.436 INFO:tasks.workunit.client.1.smithi102.stdout:8/45: mkdir d0/d10 0 2024-09-19T09:02:26.439 INFO:tasks.workunit.client.1.smithi102.stdout:5/43: symlink d5/l11 0 2024-09-19T09:02:26.439 INFO:tasks.workunit.client.1.smithi102.stdout:8/46: dread d0/f6 [0,4194304] 0 2024-09-19T09:02:26.440 INFO:tasks.workunit.client.1.smithi102.stdout:8/47: readlink d0/lf 0 2024-09-19T09:02:26.450 INFO:tasks.workunit.client.1.smithi102.stdout:8/48: dwrite d0/f6 [0,4194304] 0 2024-09-19T09:02:26.454 INFO:tasks.workunit.client.1.smithi102.stdout:8/49: mknod d0/d10/c11 0 2024-09-19T09:02:26.454 INFO:tasks.workunit.client.1.smithi102.stdout:8/50: fsync d0/fd 0 2024-09-19T09:02:26.458 INFO:tasks.workunit.client.1.smithi102.stdout:8/51: creat d0/db/f12 x:0 0 0 2024-09-19T09:02:26.611 INFO:tasks.workunit.client.1.smithi102.stdout:0/50: truncate f2 82107 0 2024-09-19T09:02:26.611 INFO:tasks.workunit.client.1.smithi102.stdout:1/67: dwrite f0 [0,4194304] 0 2024-09-19T09:02:26.612 INFO:tasks.workunit.client.1.smithi102.stdout:0/51: readlink d3/l4 0 2024-09-19T09:02:26.613 INFO:tasks.workunit.client.1.smithi102.stdout:1/68: fdatasync f6 0 2024-09-19T09:02:26.614 INFO:tasks.workunit.client.1.smithi102.stdout:1/69: chown dd/d13 0 1 2024-09-19T09:02:26.615 INFO:tasks.workunit.client.1.smithi102.stdout:2/12: dread f3 [0,4194304] 0 2024-09-19T09:02:26.615 INFO:tasks.workunit.client.1.smithi102.stdout:0/52: creat d3/dd/ff x:0 0 0 2024-09-19T09:02:26.616 INFO:tasks.workunit.client.1.smithi102.stdout:2/13: chown f0 78429 1 2024-09-19T09:02:26.616 INFO:tasks.workunit.client.1.smithi102.stdout:2/14: chown f0 295048746 1 2024-09-19T09:02:26.617 INFO:tasks.workunit.client.1.smithi102.stdout:1/70: creat dd/f16 x:0 0 0 2024-09-19T09:02:26.618 INFO:tasks.workunit.client.1.smithi102.stdout:2/15: dread f3 [0,4194304] 0 2024-09-19T09:02:26.618 INFO:tasks.workunit.client.1.smithi102.stdout:1/71: dread - dd/ff zero size 2024-09-19T09:02:26.622 INFO:tasks.workunit.client.1.smithi102.stdout:2/16: truncate f3 698722 0 2024-09-19T09:02:26.622 INFO:tasks.workunit.client.1.smithi102.stdout:8/52: write d0/f6 [4974110,40541] 0 2024-09-19T09:02:26.625 INFO:tasks.workunit.client.1.smithi102.stdout:5/44: dread d5/d7/f9 [0,4194304] 0 2024-09-19T09:02:26.626 INFO:tasks.workunit.client.1.smithi102.stdout:2/17: mknod c4 0 2024-09-19T09:02:26.627 INFO:tasks.workunit.client.1.smithi102.stdout:2/18: dread - f2 zero size 2024-09-19T09:02:26.629 INFO:tasks.workunit.client.1.smithi102.stdout:1/72: symlink dd/d13/l17 0 2024-09-19T09:02:26.631 INFO:tasks.workunit.client.1.smithi102.stdout:2/19: symlink l5 0 2024-09-19T09:02:26.631 INFO:tasks.workunit.client.1.smithi102.stdout:2/20: readlink l5 0 2024-09-19T09:02:26.632 INFO:tasks.workunit.client.1.smithi102.stdout:5/45: dwrite d5/d7/f9 [0,4194304] 0 2024-09-19T09:02:26.633 INFO:tasks.workunit.client.1.smithi102.stdout:5/46: write d5/d7/f9 [2633919,42151] 0 2024-09-19T09:02:26.634 INFO:tasks.workunit.client.1.smithi102.stdout:5/47: readlink d5/d7/l10 0 2024-09-19T09:02:26.637 INFO:tasks.workunit.client.1.smithi102.stdout:1/73: dwrite fc [0,4194304] 0 2024-09-19T09:02:26.644 INFO:tasks.workunit.client.1.smithi102.stdout:5/48: mknod d5/c12 0 2024-09-19T09:02:26.648 INFO:tasks.workunit.client.1.smithi102.stdout:1/74: mkdir dd/d14/d18 0 2024-09-19T09:02:26.651 INFO:tasks.workunit.client.1.smithi102.stdout:1/75: symlink dd/d13/l19 0 2024-09-19T09:02:26.651 INFO:tasks.workunit.client.1.smithi102.stdout:1/76: dread - dd/f16 zero size 2024-09-19T09:02:26.653 INFO:tasks.workunit.client.1.smithi102.stdout:5/49: mknod d5/d7/c13 0 2024-09-19T09:02:26.654 INFO:tasks.workunit.client.1.smithi102.stdout:5/50: chown d5/l11 1730 1 2024-09-19T09:02:26.657 INFO:tasks.workunit.client.1.smithi102.stdout:5/51: creat d5/d7/f14 x:0 0 0 2024-09-19T09:02:26.657 INFO:tasks.workunit.client.1.smithi102.stdout:1/77: dwrite f4 [4194304,4194304] 0 2024-09-19T09:02:26.658 INFO:tasks.workunit.client.1.smithi102.stdout:5/52: write d5/d7/f14 [143333,92040] 0 2024-09-19T09:02:26.661 INFO:tasks.workunit.client.1.smithi102.stdout:1/78: mknod dd/d14/d18/c1a 0 2024-09-19T09:02:26.663 INFO:tasks.workunit.client.1.smithi102.stdout:1/79: creat dd/f1b x:0 0 0 2024-09-19T09:02:26.668 INFO:tasks.workunit.client.1.smithi102.stdout:1/80: truncate f9 3112231 0 2024-09-19T09:02:26.669 INFO:tasks.workunit.client.1.smithi102.stdout:0/53: getdents d3/dd 0 2024-09-19T09:02:26.670 INFO:tasks.workunit.client.1.smithi102.stdout:1/81: rmdir dd/d14/d18 39 2024-09-19T09:02:26.672 INFO:tasks.workunit.client.1.smithi102.stdout:0/54: mkdir d3/dd/d10 0 2024-09-19T09:02:26.672 INFO:tasks.workunit.client.1.smithi102.stdout:2/21: truncate f0 1496576 0 2024-09-19T09:02:26.672 INFO:tasks.workunit.client.1.smithi102.stdout:0/55: dread - d3/dd/ff zero size 2024-09-19T09:02:26.676 INFO:tasks.workunit.client.1.smithi102.stdout:1/82: chown c3 175563410 1 2024-09-19T09:02:26.677 INFO:tasks.workunit.client.1.smithi102.stdout:0/56: dread d3/f7 [0,4194304] 0 2024-09-19T09:02:26.677 INFO:tasks.workunit.client.1.smithi102.stdout:1/83: symlink dd/d13/l1c 0 2024-09-19T09:02:26.677 INFO:tasks.workunit.client.1.smithi102.stdout:2/22: stat f3 0 2024-09-19T09:02:26.677 INFO:tasks.workunit.client.1.smithi102.stdout:0/57: rename d3/dd/d10 to d3/dd/d10/d11 22 2024-09-19T09:02:26.679 INFO:tasks.workunit.client.1.smithi102.stdout:8/53: truncate d0/f6 4349166 0 2024-09-19T09:02:26.680 INFO:tasks.workunit.client.1.smithi102.stdout:8/54: chown d0/db/lc 1633 1 2024-09-19T09:02:26.681 INFO:tasks.workunit.client.1.smithi102.stdout:1/84: dwrite f6 [0,4194304] 0 2024-09-19T09:02:26.682 INFO:tasks.workunit.client.1.smithi102.stdout:8/55: truncate d0/f5 578682 0 2024-09-19T09:02:26.682 INFO:tasks.workunit.client.1.smithi102.stdout:8/56: readlink d0/db/lc 0 2024-09-19T09:02:26.682 INFO:tasks.workunit.client.1.smithi102.stdout:1/85: rmdir dd/d13 39 2024-09-19T09:02:26.685 INFO:tasks.workunit.client.1.smithi102.stdout:8/57: fdatasync d0/f7 0 2024-09-19T09:02:26.691 INFO:tasks.workunit.client.1.smithi102.stdout:1/86: creat dd/f1d x:0 0 0 2024-09-19T09:02:26.691 INFO:tasks.workunit.client.1.smithi102.stdout:1/87: chown c7 1654968 1 2024-09-19T09:02:26.697 INFO:tasks.workunit.client.1.smithi102.stdout:0/58: write d3/f7 [4701797,19593] 0 2024-09-19T09:02:26.702 INFO:tasks.workunit.client.1.smithi102.stdout:0/59: getdents d3/d8 0 2024-09-19T09:02:26.703 INFO:tasks.workunit.client.1.smithi102.stdout:8/58: dwrite d0/f6 [0,4194304] 0 2024-09-19T09:02:26.710 INFO:tasks.workunit.client.1.smithi102.stdout:0/60: write f2 [321450,26695] 0 2024-09-19T09:02:26.711 INFO:tasks.workunit.client.1.smithi102.stdout:0/61: chown d3/d8/l9 0 1 2024-09-19T09:02:26.715 INFO:tasks.workunit.client.1.smithi102.stdout:0/62: mknod d3/dd/d10/c12 0 2024-09-19T09:02:26.716 INFO:tasks.workunit.client.1.smithi102.stdout:0/63: truncate f2 822066 0 2024-09-19T09:02:26.717 INFO:tasks.workunit.client.1.smithi102.stdout:0/64: mknod d3/d8/de/c13 0 2024-09-19T09:02:26.719 INFO:tasks.workunit.client.1.smithi102.stdout:0/65: rmdir d3/dd/d10 39 2024-09-19T09:02:26.726 INFO:tasks.workunit.client.1.smithi102.stdout:0/66: getdents d3/dd/d10 0 2024-09-19T09:02:26.728 INFO:tasks.workunit.client.1.smithi102.stdout:0/67: creat d3/f14 x:0 0 0 2024-09-19T09:02:26.729 INFO:tasks.workunit.client.1.smithi102.stdout:0/68: write d3/f14 [921144,39905] 0 2024-09-19T09:02:26.730 INFO:tasks.workunit.client.1.smithi102.stdout:0/69: mkdir d3/dd/d10/d15 0 2024-09-19T09:02:26.731 INFO:tasks.workunit.client.1.smithi102.stdout:0/70: fdatasync f2 0 2024-09-19T09:02:26.736 INFO:tasks.workunit.client.1.smithi102.stdout:0/71: dwrite f2 [0,4194304] 0 2024-09-19T09:02:26.736 INFO:tasks.workunit.client.1.smithi102.stdout:0/72: stat d3/f7 0 2024-09-19T09:02:26.742 INFO:tasks.workunit.client.1.smithi102.stdout:0/73: link d3/d8/l9 d3/d8/de/l16 0 2024-09-19T09:02:26.747 INFO:tasks.workunit.client.1.smithi102.stdout:0/74: dwrite f2 [0,4194304] 0 2024-09-19T09:02:26.755 INFO:tasks.workunit.client.1.smithi102.stdout:0/75: dwrite d3/f14 [0,4194304] 0 2024-09-19T09:02:26.759 INFO:tasks.workunit.client.1.smithi102.stdout:0/76: rename d3/lc to d3/l17 0 2024-09-19T09:02:26.769 INFO:tasks.workunit.client.1.smithi102.stdout:0/77: fsync f2 0 2024-09-19T09:02:26.770 INFO:tasks.workunit.client.1.smithi102.stdout:0/78: write d3/f7 [5291750,69668] 0 2024-09-19T09:02:26.771 INFO:tasks.workunit.client.1.smithi102.stdout:0/79: truncate d3/dd/ff 394861 0 2024-09-19T09:02:26.775 INFO:tasks.workunit.client.1.smithi102.stdout:0/80: mkdir d3/dd/d10/d15/d18 0 2024-09-19T09:02:26.780 INFO:tasks.workunit.client.1.smithi102.stdout:0/81: dwrite d3/f14 [0,4194304] 0 2024-09-19T09:02:26.784 INFO:tasks.workunit.client.1.smithi102.stdout:0/82: dread d3/f14 [0,4194304] 0 2024-09-19T09:02:26.785 INFO:tasks.workunit.client.1.smithi102.stdout:0/83: chown d3/d8/de 383820 1 2024-09-19T09:02:26.785 INFO:tasks.workunit.client.1.smithi102.stdout:0/84: chown d3/d8/cb 36796 1 2024-09-19T09:02:26.788 INFO:tasks.workunit.client.1.smithi102.stdout:0/85: dread f2 [0,4194304] 0 2024-09-19T09:02:26.789 INFO:tasks.workunit.client.1.smithi102.stdout:0/86: fsync f2 0 2024-09-19T09:02:26.790 INFO:tasks.workunit.client.1.smithi102.stdout:0/87: dread d3/dd/ff [0,4194304] 0 2024-09-19T09:02:26.793 INFO:tasks.workunit.client.1.smithi102.stdout:0/88: mkdir d3/dd/d10/d15/d19 0 2024-09-19T09:02:26.795 INFO:tasks.workunit.client.1.smithi102.stdout:0/89: dread d3/f14 [0,4194304] 0 2024-09-19T09:02:26.796 INFO:tasks.workunit.client.1.smithi102.stdout:0/90: write f2 [1952070,93128] 0 2024-09-19T09:02:26.800 INFO:tasks.workunit.client.1.smithi102.stdout:0/91: mkdir d3/dd/d1a 0 2024-09-19T09:02:26.800 INFO:tasks.workunit.client.1.smithi102.stdout:0/92: chown d3/dd/d10/d15/d18 1115640 1 2024-09-19T09:02:26.805 INFO:tasks.workunit.client.1.smithi102.stdout:0/93: dwrite f2 [0,4194304] 0 2024-09-19T09:02:26.807 INFO:tasks.workunit.client.1.smithi102.stdout:0/94: chown d3/d8/de/l16 0 1 2024-09-19T09:02:26.814 INFO:tasks.workunit.client.1.smithi102.stdout:0/95: dwrite d3/dd/ff [0,4194304] 0 2024-09-19T09:02:26.819 INFO:tasks.workunit.client.1.smithi102.stdout:0/96: dread f2 [0,4194304] 0 2024-09-19T09:02:26.828 INFO:tasks.workunit.client.1.smithi102.stdout:0/97: dwrite d3/f14 [0,4194304] 0 2024-09-19T09:02:26.834 INFO:tasks.workunit.client.1.smithi102.stdout:0/98: creat d3/dd/d1a/f1b x:0 0 0 2024-09-19T09:02:26.837 INFO:tasks.workunit.client.1.smithi102.stdout:0/99: dread d3/dd/ff [0,4194304] 0 2024-09-19T09:02:26.837 INFO:tasks.workunit.client.1.smithi102.stdout:0/100: chown d3/dd 586897841 1 2024-09-19T09:02:26.838 INFO:tasks.workunit.client.1.smithi102.stdout:0/101: readlink d3/d8/l9 0 2024-09-19T09:02:26.840 INFO:tasks.workunit.client.1.smithi102.stdout:0/102: dread f2 [0,4194304] 0 2024-09-19T09:02:27.185 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:26 smithi102 ceph-mon[35280]: pgmap v20: 65 pgs: 65 active+clean; 186 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-09-19T09:02:27.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:26 smithi049 ceph-mon[28158]: pgmap v20: 65 pgs: 65 active+clean; 186 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-09-19T09:02:28.066 INFO:tasks.workunit.client.1.smithi102.stdout:6/25: sync 2024-09-19T09:02:28.076 INFO:tasks.workunit.client.1.smithi102.stdout:6/26: mkdir d1/d5 0 2024-09-19T09:02:28.076 INFO:tasks.workunit.client.1.smithi102.stdout:6/27: write - no filename 2024-09-19T09:02:28.077 INFO:tasks.workunit.client.1.smithi102.stdout:6/28: dwrite - no filename 2024-09-19T09:02:28.077 INFO:tasks.workunit.client.1.smithi102.stdout:6/29: fsync - no filename 2024-09-19T09:02:28.077 INFO:tasks.workunit.client.1.smithi102.stdout:6/30: truncate - no filename 2024-09-19T09:02:28.077 INFO:tasks.workunit.client.1.smithi102.stdout:6/31: chown d1 1 1 2024-09-19T09:02:28.077 INFO:tasks.workunit.client.1.smithi102.stdout:6/32: truncate - no filename 2024-09-19T09:02:28.080 INFO:tasks.workunit.client.1.smithi102.stdout:6/33: creat d1/d5/f6 x:0 0 0 2024-09-19T09:02:28.083 INFO:tasks.workunit.client.1.smithi102.stdout:6/34: creat d1/d5/f7 x:0 0 0 2024-09-19T09:02:28.083 INFO:tasks.workunit.client.1.smithi102.stdout:6/35: fdatasync d1/d5/f7 0 2024-09-19T09:02:28.086 INFO:tasks.workunit.client.1.smithi102.stdout:6/36: creat d1/f8 x:0 0 0 2024-09-19T09:02:28.089 INFO:tasks.workunit.client.1.smithi102.stdout:6/37: mknod d1/c9 0 2024-09-19T09:02:28.104 INFO:tasks.workunit.client.1.smithi102.stdout:1/88: sync 2024-09-19T09:02:28.104 INFO:tasks.workunit.client.1.smithi102.stdout:9/23: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:0/103: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:5/53: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:2/23: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:3/35: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:7/20: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:4/16: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:8/59: sync 2024-09-19T09:02:28.105 INFO:tasks.workunit.client.1.smithi102.stdout:4/17: dread - f2 zero size 2024-09-19T09:02:28.106 INFO:tasks.workunit.client.1.smithi102.stdout:3/36: write d2/f9 [186342,119420] 0 2024-09-19T09:02:28.106 INFO:tasks.workunit.client.1.smithi102.stdout:4/18: dread - f2 zero size 2024-09-19T09:02:28.107 INFO:tasks.workunit.client.1.smithi102.stdout:5/54: chown d5/fe 0 1 2024-09-19T09:02:28.108 INFO:tasks.workunit.client.1.smithi102.stdout:2/24: creat f6 x:0 0 0 2024-09-19T09:02:28.109 INFO:tasks.workunit.client.1.smithi102.stdout:2/25: fdatasync f6 0 2024-09-19T09:02:28.110 INFO:tasks.workunit.client.1.smithi102.stdout:9/24: mkdir d1/d8 0 2024-09-19T09:02:28.111 INFO:tasks.workunit.client.1.smithi102.stdout:9/25: dread - d1/f6 zero size 2024-09-19T09:02:28.115 INFO:tasks.workunit.client.1.smithi102.stdout:2/26: dwrite f2 [0,4194304] 0 2024-09-19T09:02:28.115 INFO:tasks.workunit.client.1.smithi102.stdout:0/104: rename d3/dd/d10/c12 to d3/c1c 0 2024-09-19T09:02:28.116 INFO:tasks.workunit.client.1.smithi102.stdout:0/105: readlink d3/d8/de/l16 0 2024-09-19T09:02:28.118 INFO:tasks.workunit.client.1.smithi102.stdout:8/60: write d0/fd [895709,14953] 0 2024-09-19T09:02:28.120 INFO:tasks.workunit.client.1.smithi102.stdout:4/19: symlink l4 0 2024-09-19T09:02:28.120 INFO:tasks.workunit.client.1.smithi102.stdout:4/20: dread - f2 zero size 2024-09-19T09:02:28.120 INFO:tasks.workunit.client.1.smithi102.stdout:0/106: dread d3/f14 [0,4194304] 0 2024-09-19T09:02:28.122 INFO:tasks.workunit.client.1.smithi102.stdout:3/37: dread d2/f9 [0,4194304] 0 2024-09-19T09:02:28.125 INFO:tasks.workunit.client.1.smithi102.stdout:9/26: creat d1/d2/d3/f9 x:0 0 0 2024-09-19T09:02:28.128 INFO:tasks.workunit.client.1.smithi102.stdout:1/89: symlink dd/d14/d18/l1e 0 2024-09-19T09:02:28.129 INFO:tasks.workunit.client.1.smithi102.stdout:0/107: dwrite d3/dd/d1a/f1b [0,4194304] 0 2024-09-19T09:02:28.135 INFO:tasks.workunit.client.1.smithi102.stdout:7/21: creat d1/d3/f9 x:0 0 0 2024-09-19T09:02:28.136 INFO:tasks.workunit.client.1.smithi102.stdout:1/90: dwrite dd/f16 [0,4194304] 0 2024-09-19T09:02:28.141 INFO:tasks.workunit.client.1.smithi102.stdout:8/61: read d0/f8 [4772739,38603] 0 2024-09-19T09:02:28.141 INFO:tasks.workunit.client.1.smithi102.stdout:1/91: dread dd/f12 [0,4194304] 0 2024-09-19T09:02:28.142 INFO:tasks.workunit.client.1.smithi102.stdout:4/21: symlink l5 0 2024-09-19T09:02:28.147 INFO:tasks.workunit.client.1.smithi102.stdout:9/27: creat d1/d2/d3/fa x:0 0 0 2024-09-19T09:02:28.148 INFO:tasks.workunit.client.1.smithi102.stdout:9/28: chown d1/f6 4452704 1 2024-09-19T09:02:28.150 INFO:tasks.workunit.client.1.smithi102.stdout:1/92: dwrite dd/f1b [0,4194304] 0 2024-09-19T09:02:28.151 INFO:tasks.workunit.client.1.smithi102.stdout:1/93: read f0 [3029216,78390] 0 2024-09-19T09:02:28.152 INFO:tasks.workunit.client.1.smithi102.stdout:1/94: chown dd/f12 6 1 2024-09-19T09:02:28.160 INFO:tasks.workunit.client.1.smithi102.stdout:8/62: rename d0/f8 to d0/db/f13 0 2024-09-19T09:02:28.161 INFO:tasks.workunit.client.1.smithi102.stdout:1/95: dwrite dd/f1d [0,4194304] 0 2024-09-19T09:02:28.162 INFO:tasks.workunit.client.1.smithi102.stdout:5/55: creat d5/f15 x:0 0 0 2024-09-19T09:02:28.163 INFO:tasks.workunit.client.1.smithi102.stdout:1/96: read dd/f1d [2899413,77867] 0 2024-09-19T09:02:28.163 INFO:tasks.workunit.client.1.smithi102.stdout:8/63: dread d0/f5 [0,4194304] 0 2024-09-19T09:02:28.164 INFO:tasks.workunit.client.1.smithi102.stdout:8/64: readlink d0/db/lc 0 2024-09-19T09:02:28.165 INFO:tasks.workunit.client.1.smithi102.stdout:4/22: rename f2 to f6 0 2024-09-19T09:02:28.178 INFO:tasks.workunit.client.1.smithi102.stdout:8/65: write d0/fd [1836711,63181] 0 2024-09-19T09:02:28.180 INFO:tasks.workunit.client.1.smithi102.stdout:9/29: rename d1/d2/c4 to d1/d8/cb 0 2024-09-19T09:02:28.180 INFO:tasks.workunit.client.1.smithi102.stdout:5/56: dread d5/d7/f9 [0,4194304] 0 2024-09-19T09:02:28.180 INFO:tasks.workunit.client.1.smithi102.stdout:1/97: fdatasync dd/f12 0 2024-09-19T09:02:28.181 INFO:tasks.workunit.client.1.smithi102.stdout:9/30: write d1/d2/d3/fa [982508,103155] 0 2024-09-19T09:02:28.183 INFO:tasks.workunit.client.1.smithi102.stdout:9/31: write d1/d2/d3/f5 [997887,78907] 0 2024-09-19T09:02:28.188 INFO:tasks.workunit.client.1.smithi102.stdout:5/57: dwrite d5/fe [0,4194304] 0 2024-09-19T09:02:28.189 INFO:tasks.workunit.client.1.smithi102.stdout:5/58: stat d5/d7/cc 0 2024-09-19T09:02:28.189 INFO:tasks.workunit.client.1.smithi102.stdout:5/59: readlink d5/l11 0 2024-09-19T09:02:28.190 INFO:tasks.workunit.client.1.smithi102.stdout:5/60: chown l2 94780573 1 2024-09-19T09:02:28.264 INFO:tasks.workunit.client.1.smithi102.stdout:4/23: sync 2024-09-19T09:02:28.264 INFO:tasks.workunit.client.1.smithi102.stdout:4/24: stat f6 0 2024-09-19T09:02:28.483 INFO:tasks.workunit.client.1.smithi102.stdout:8/66: mknod d0/d10/c14 0 2024-09-19T09:02:28.487 INFO:tasks.workunit.client.1.smithi102.stdout:1/98: unlink l5 0 2024-09-19T09:02:28.487 INFO:tasks.workunit.client.1.smithi102.stdout:1/99: read - dd/f11 zero size 2024-09-19T09:02:28.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/32: rmdir d1/d2 39 2024-09-19T09:02:28.490 INFO:tasks.workunit.client.1.smithi102.stdout:4/25: creat f7 x:0 0 0 2024-09-19T09:02:28.491 INFO:tasks.workunit.client.1.smithi102.stdout:3/38: getdents d2/d5 0 2024-09-19T09:02:28.492 INFO:tasks.workunit.client.1.smithi102.stdout:3/39: readlink d2/l4 0 2024-09-19T09:02:28.492 INFO:tasks.workunit.client.1.smithi102.stdout:8/67: creat d0/db/f15 x:0 0 0 2024-09-19T09:02:28.493 INFO:tasks.workunit.client.1.smithi102.stdout:8/68: readlink d0/db/lc 0 2024-09-19T09:02:28.494 INFO:tasks.workunit.client.1.smithi102.stdout:9/33: stat d1/d2/d3/f5 0 2024-09-19T09:02:28.495 INFO:tasks.workunit.client.1.smithi102.stdout:1/100: creat dd/d14/d18/f1f x:0 0 0 2024-09-19T09:02:28.496 INFO:tasks.workunit.client.1.smithi102.stdout:3/40: read d2/f9 [646013,64716] 0 2024-09-19T09:02:28.497 INFO:tasks.workunit.client.1.smithi102.stdout:5/61: dwrite d5/d7/f9 [0,4194304] 0 2024-09-19T09:02:28.500 INFO:tasks.workunit.client.1.smithi102.stdout:9/34: symlink d1/d8/lc 0 2024-09-19T09:02:28.500 INFO:tasks.workunit.client.1.smithi102.stdout:4/26: dwrite f7 [0,4194304] 0 2024-09-19T09:02:28.503 INFO:tasks.workunit.client.1.smithi102.stdout:3/41: mkdir d2/d5/db 0 2024-09-19T09:02:28.504 INFO:tasks.workunit.client.1.smithi102.stdout:1/101: symlink dd/d14/l20 0 2024-09-19T09:02:28.506 INFO:tasks.workunit.client.1.smithi102.stdout:9/35: symlink d1/d8/ld 0 2024-09-19T09:02:28.510 INFO:tasks.workunit.client.1.smithi102.stdout:5/62: dwrite d5/d7/ff [0,4194304] 0 2024-09-19T09:02:28.511 INFO:tasks.workunit.client.1.smithi102.stdout:5/63: dread - d5/f15 zero size 2024-09-19T09:02:28.512 INFO:tasks.workunit.client.1.smithi102.stdout:5/64: write d5/fe [1737932,130607] 0 2024-09-19T09:02:28.512 INFO:tasks.workunit.client.1.smithi102.stdout:9/36: unlink d1/d8/ld 0 2024-09-19T09:02:28.513 INFO:tasks.workunit.client.1.smithi102.stdout:9/37: dread - d1/f6 zero size 2024-09-19T09:02:28.513 INFO:tasks.workunit.client.1.smithi102.stdout:3/42: mknod d2/d5/db/cc 0 2024-09-19T09:02:28.513 INFO:tasks.workunit.client.1.smithi102.stdout:5/65: chown d5/d7/ca 353 1 2024-09-19T09:02:28.514 INFO:tasks.workunit.client.1.smithi102.stdout:6/38: rmdir d1 39 2024-09-19T09:02:28.514 INFO:tasks.workunit.client.1.smithi102.stdout:9/38: write d1/d2/d3/f9 [771101,118209] 0 2024-09-19T09:02:28.515 INFO:tasks.workunit.client.1.smithi102.stdout:1/102: mknod dd/d13/c21 0 2024-09-19T09:02:28.520 INFO:tasks.workunit.client.1.smithi102.stdout:3/43: mkdir d2/d5/db/dd 0 2024-09-19T09:02:28.525 INFO:tasks.workunit.client.1.smithi102.stdout:5/66: dwrite d5/d7/f14 [0,4194304] 0 2024-09-19T09:02:28.525 INFO:tasks.workunit.client.1.smithi102.stdout:3/44: truncate d2/d5/f7 1058450 0 2024-09-19T09:02:28.526 INFO:tasks.workunit.client.1.smithi102.stdout:9/39: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:02:28.527 INFO:tasks.workunit.client.1.smithi102.stdout:6/39: unlink d1/c9 0 2024-09-19T09:02:28.528 INFO:tasks.workunit.client.1.smithi102.stdout:6/40: fdatasync d1/d5/f6 0 2024-09-19T09:02:28.530 INFO:tasks.workunit.client.1.smithi102.stdout:3/45: mknod d2/ce 0 2024-09-19T09:02:28.531 INFO:tasks.workunit.client.1.smithi102.stdout:5/67: rename d5/d7/f9 to d5/d7/f16 0 2024-09-19T09:02:28.533 INFO:tasks.workunit.client.1.smithi102.stdout:5/68: write d5/d7/ff [4945870,123968] 0 2024-09-19T09:02:28.533 INFO:tasks.workunit.client.1.smithi102.stdout:9/40: dread d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:28.537 INFO:tasks.workunit.client.1.smithi102.stdout:6/41: creat d1/d5/fa x:0 0 0 2024-09-19T09:02:28.542 INFO:tasks.workunit.client.1.smithi102.stdout:5/69: dwrite d5/d7/f14 [0,4194304] 0 2024-09-19T09:02:28.542 INFO:tasks.workunit.client.1.smithi102.stdout:3/46: fsync d2/f9 0 2024-09-19T09:02:28.543 INFO:tasks.workunit.client.1.smithi102.stdout:1/103: link dd/d14/l20 dd/d14/l22 0 2024-09-19T09:02:28.543 INFO:tasks.workunit.client.1.smithi102.stdout:3/47: fdatasync d2/f9 0 2024-09-19T09:02:28.545 INFO:tasks.workunit.client.1.smithi102.stdout:3/48: fdatasync d2/f9 0 2024-09-19T09:02:28.547 INFO:tasks.workunit.client.1.smithi102.stdout:3/49: fdatasync d2/d5/fa 0 2024-09-19T09:02:28.548 INFO:tasks.workunit.client.1.smithi102.stdout:6/42: dwrite d1/d5/f6 [0,4194304] 0 2024-09-19T09:02:28.553 INFO:tasks.workunit.client.1.smithi102.stdout:5/70: unlink d5/d7/cc 0 2024-09-19T09:02:28.556 INFO:tasks.workunit.client.1.smithi102.stdout:1/104: symlink dd/d14/d18/l23 0 2024-09-19T09:02:28.562 INFO:tasks.workunit.client.1.smithi102.stdout:6/43: mkdir d1/d5/db 0 2024-09-19T09:02:28.563 INFO:tasks.workunit.client.1.smithi102.stdout:6/44: write d1/d5/fa [957069,4386] 0 2024-09-19T09:02:28.568 INFO:tasks.workunit.client.1.smithi102.stdout:6/45: unlink d1/d5/f6 0 2024-09-19T09:02:28.570 INFO:tasks.workunit.client.1.smithi102.stdout:3/50: rmdir d2/d5/db/dd 0 2024-09-19T09:02:28.574 INFO:tasks.workunit.client.1.smithi102.stdout:6/46: getdents d1/d5/db 0 2024-09-19T09:02:28.575 INFO:tasks.workunit.client.1.smithi102.stdout:1/105: link f9 dd/d14/d18/f24 0 2024-09-19T09:02:28.576 INFO:tasks.workunit.client.1.smithi102.stdout:3/51: dwrite d2/d5/fa [0,4194304] 0 2024-09-19T09:02:28.581 INFO:tasks.workunit.client.1.smithi102.stdout:3/52: creat d2/ff x:0 0 0 2024-09-19T09:02:28.586 INFO:tasks.workunit.client.1.smithi102.stdout:3/53: write d2/ff [616930,8690] 0 2024-09-19T09:02:28.586 INFO:tasks.workunit.client.1.smithi102.stdout:1/106: creat dd/f25 x:0 0 0 2024-09-19T09:02:28.591 INFO:tasks.workunit.client.1.smithi102.stdout:6/47: dwrite d1/f8 [0,4194304] 0 2024-09-19T09:02:28.593 INFO:tasks.workunit.client.1.smithi102.stdout:5/71: fsync d5/f15 0 2024-09-19T09:02:28.593 INFO:tasks.workunit.client.1.smithi102.stdout:1/107: write f6 [2030941,95086] 0 2024-09-19T09:02:28.599 INFO:tasks.workunit.client.1.smithi102.stdout:4/27: sync 2024-09-19T09:02:28.599 INFO:tasks.workunit.client.1.smithi102.stdout:0/108: dwrite d3/dd/ff [0,4194304] 0 2024-09-19T09:02:28.600 INFO:tasks.workunit.client.1.smithi102.stdout:2/27: dwrite f0 [0,4194304] 0 2024-09-19T09:02:28.602 INFO:tasks.workunit.client.1.smithi102.stdout:8/69: stat d0/db/f13 0 2024-09-19T09:02:28.603 INFO:tasks.workunit.client.1.smithi102.stdout:7/22: dwrite d1/d4/f6 [0,4194304] 0 2024-09-19T09:02:28.603 INFO:tasks.workunit.client.1.smithi102.stdout:7/23: readlink - no filename 2024-09-19T09:02:28.603 INFO:tasks.workunit.client.1.smithi102.stdout:0/109: chown d3/d8/de/l16 425 1 2024-09-19T09:02:28.610 INFO:tasks.workunit.client.1.smithi102.stdout:7/24: dwrite d1/d3/f9 [0,4194304] 0 2024-09-19T09:02:28.612 INFO:tasks.workunit.client.1.smithi102.stdout:3/54: mknod d2/d5/c10 0 2024-09-19T09:02:28.622 INFO:tasks.workunit.client.1.smithi102.stdout:2/28: mkdir d7 0 2024-09-19T09:02:28.622 INFO:tasks.workunit.client.1.smithi102.stdout:3/55: dwrite d2/d5/fa [0,4194304] 0 2024-09-19T09:02:28.626 INFO:tasks.workunit.client.1.smithi102.stdout:0/110: symlink d3/d8/de/l1d 0 2024-09-19T09:02:28.629 INFO:tasks.workunit.client.1.smithi102.stdout:0/111: chown d3/dd/d1a 1 1 2024-09-19T09:02:28.632 INFO:tasks.workunit.client.1.smithi102.stdout:5/72: dwrite d5/d7/f16 [0,4194304] 0 2024-09-19T09:02:28.633 INFO:tasks.workunit.client.1.smithi102.stdout:4/28: dwrite f6 [0,4194304] 0 2024-09-19T09:02:28.637 INFO:tasks.workunit.client.1.smithi102.stdout:2/29: mknod d7/c8 0 2024-09-19T09:02:28.638 INFO:tasks.workunit.client.1.smithi102.stdout:8/70: creat d0/f16 x:0 0 0 2024-09-19T09:02:28.639 INFO:tasks.workunit.client.1.smithi102.stdout:2/30: fdatasync f2 0 2024-09-19T09:02:28.639 INFO:tasks.workunit.client.1.smithi102.stdout:0/112: mknod d3/d8/c1e 0 2024-09-19T09:02:28.640 INFO:tasks.workunit.client.1.smithi102.stdout:0/113: fsync d3/f7 0 2024-09-19T09:02:28.641 INFO:tasks.workunit.client.1.smithi102.stdout:8/71: truncate d0/db/f12 357345 0 2024-09-19T09:02:28.641 INFO:tasks.workunit.client.1.smithi102.stdout:5/73: mkdir d5/d7/d17 0 2024-09-19T09:02:28.643 INFO:tasks.workunit.client.1.smithi102.stdout:0/114: chown d3/d8/de/l1d 138 1 2024-09-19T09:02:28.643 INFO:tasks.workunit.client.1.smithi102.stdout:2/31: chown f3 11 1 2024-09-19T09:02:28.643 INFO:tasks.workunit.client.1.smithi102.stdout:4/29: rename l4 to l8 0 2024-09-19T09:02:28.644 INFO:tasks.workunit.client.1.smithi102.stdout:2/32: fdatasync f0 0 2024-09-19T09:02:28.645 INFO:tasks.workunit.client.1.smithi102.stdout:4/30: write f7 [582391,43680] 0 2024-09-19T09:02:28.646 INFO:tasks.workunit.client.1.smithi102.stdout:8/72: mknod d0/db/c17 0 2024-09-19T09:02:28.649 INFO:tasks.workunit.client.1.smithi102.stdout:3/56: link d2/ce d2/d5/c11 0 2024-09-19T09:02:28.655 INFO:tasks.workunit.client.1.smithi102.stdout:8/73: symlink d0/d10/l18 0 2024-09-19T09:02:28.657 INFO:tasks.workunit.client.1.smithi102.stdout:3/57: symlink d2/d5/l12 0 2024-09-19T09:02:28.660 INFO:tasks.workunit.client.1.smithi102.stdout:5/74: rmdir d5/d7/d17 0 2024-09-19T09:02:28.662 INFO:tasks.workunit.client.1.smithi102.stdout:0/115: creat d3/dd/f1f x:0 0 0 2024-09-19T09:02:28.663 INFO:tasks.workunit.client.1.smithi102.stdout:3/58: creat d2/d5/db/f13 x:0 0 0 2024-09-19T09:02:28.664 INFO:tasks.workunit.client.1.smithi102.stdout:5/75: symlink d5/d7/l18 0 2024-09-19T09:02:28.665 INFO:tasks.workunit.client.1.smithi102.stdout:5/76: stat d5/d7/c13 0 2024-09-19T09:02:28.665 INFO:tasks.workunit.client.1.smithi102.stdout:0/116: symlink d3/l20 0 2024-09-19T09:02:28.666 INFO:tasks.workunit.client.1.smithi102.stdout:3/59: mkdir d2/d5/db/d14 0 2024-09-19T09:02:28.669 INFO:tasks.workunit.client.1.smithi102.stdout:3/60: mknod d2/d5/db/c15 0 2024-09-19T09:02:28.672 INFO:tasks.workunit.client.1.smithi102.stdout:3/61: dread d2/ff [0,4194304] 0 2024-09-19T09:02:28.672 INFO:tasks.workunit.client.1.smithi102.stdout:0/117: creat d3/dd/f21 x:0 0 0 2024-09-19T09:02:28.677 INFO:tasks.workunit.client.1.smithi102.stdout:3/62: rmdir d2/d5/db/d14 0 2024-09-19T09:02:28.679 INFO:tasks.workunit.client.1.smithi102.stdout:3/63: creat d2/d5/db/f16 x:0 0 0 2024-09-19T09:02:28.685 INFO:tasks.workunit.client.1.smithi102.stdout:3/64: dwrite d2/d5/db/f16 [0,4194304] 0 2024-09-19T09:02:28.688 INFO:tasks.workunit.client.1.smithi102.stdout:3/65: creat d2/d5/db/f17 x:0 0 0 2024-09-19T09:02:28.690 INFO:tasks.workunit.client.1.smithi102.stdout:3/66: creat d2/f18 x:0 0 0 2024-09-19T09:02:28.697 INFO:tasks.workunit.client.1.smithi102.stdout:3/67: dwrite d2/d5/f7 [0,4194304] 0 2024-09-19T09:02:28.698 INFO:tasks.workunit.client.1.smithi102.stdout:3/68: fdatasync d2/d5/fa 0 2024-09-19T09:02:28.702 INFO:tasks.workunit.client.1.smithi102.stdout:3/69: unlink d2/l3 0 2024-09-19T09:02:28.708 INFO:tasks.workunit.client.1.smithi102.stdout:3/70: dwrite d2/d5/db/f16 [0,4194304] 0 2024-09-19T09:02:28.709 INFO:tasks.workunit.client.1.smithi102.stdout:3/71: write d2/d5/f7 [2986613,30210] 0 2024-09-19T09:02:28.710 INFO:tasks.workunit.client.1.smithi102.stdout:3/72: chown d2/d5/fa 411085 1 2024-09-19T09:02:28.719 INFO:tasks.workunit.client.1.smithi102.stdout:3/73: dwrite d2/ff [0,4194304] 0 2024-09-19T09:02:28.719 INFO:tasks.workunit.client.1.smithi102.stdout:3/74: read d2/d5/f7 [516623,84562] 0 2024-09-19T09:02:28.723 INFO:tasks.workunit.client.1.smithi102.stdout:3/75: mkdir d2/d19 0 2024-09-19T09:02:28.809 INFO:tasks.workunit.client.1.smithi102.stdout:0/118: sync 2024-09-19T09:02:28.812 INFO:tasks.workunit.client.1.smithi102.stdout:0/119: mkdir d3/dd/d10/d15/d22 0 2024-09-19T09:02:28.818 INFO:tasks.workunit.client.1.smithi102.stdout:0/120: dwrite d3/f7 [4194304,4194304] 0 2024-09-19T09:02:28.822 INFO:tasks.workunit.client.1.smithi102.stdout:0/121: creat d3/dd/d10/d15/f23 x:0 0 0 2024-09-19T09:02:28.827 INFO:tasks.workunit.client.1.smithi102.stdout:0/122: creat d3/dd/d10/d15/d22/f24 x:0 0 0 2024-09-19T09:02:28.833 INFO:tasks.workunit.client.1.smithi102.stdout:5/77: dwrite d5/fe [4194304,4194304] 0 2024-09-19T09:02:28.833 INFO:tasks.workunit.client.1.smithi102.stdout:5/78: fsync d5/f15 0 2024-09-19T09:02:28.834 INFO:tasks.workunit.client.1.smithi102.stdout:5/79: chown d5/d7/c13 295918 1 2024-09-19T09:02:28.835 INFO:tasks.workunit.client.1.smithi102.stdout:5/80: write d5/d7/f14 [2705618,117468] 0 2024-09-19T09:02:28.836 INFO:tasks.workunit.client.1.smithi102.stdout:5/81: write d5/d7/f14 [3856993,39375] 0 2024-09-19T09:02:28.837 INFO:tasks.workunit.client.1.smithi102.stdout:5/82: fsync d5/d7/ff 0 2024-09-19T09:02:28.845 INFO:tasks.workunit.client.1.smithi102.stdout:5/83: creat d5/d7/f19 x:0 0 0 2024-09-19T09:02:28.848 INFO:tasks.workunit.client.1.smithi102.stdout:9/41: truncate d1/f6 739553 0 2024-09-19T09:02:28.850 INFO:tasks.workunit.client.1.smithi102.stdout:9/42: write d1/d2/d3/f9 [1641559,47611] 0 2024-09-19T09:02:28.852 INFO:tasks.workunit.client.1.smithi102.stdout:6/48: rmdir d1 39 2024-09-19T09:02:28.853 INFO:tasks.workunit.client.1.smithi102.stdout:5/84: dwrite d5/d7/f19 [0,4194304] 0 2024-09-19T09:02:28.855 INFO:tasks.workunit.client.1.smithi102.stdout:1/108: rmdir dd/d14/d18 39 2024-09-19T09:02:28.856 INFO:tasks.workunit.client.1.smithi102.stdout:1/109: dread - dd/f11 zero size 2024-09-19T09:02:28.858 INFO:tasks.workunit.client.1.smithi102.stdout:6/49: chown d1/d5/f7 52233070 1 2024-09-19T09:02:28.861 INFO:tasks.workunit.client.1.smithi102.stdout:5/85: mkdir d5/d7/d1a 0 2024-09-19T09:02:28.865 INFO:tasks.workunit.client.1.smithi102.stdout:6/50: creat d1/fc x:0 0 0 2024-09-19T09:02:28.865 INFO:tasks.workunit.client.1.smithi102.stdout:3/76: sync 2024-09-19T09:02:28.869 INFO:tasks.workunit.client.1.smithi102.stdout:3/77: creat d2/d5/db/f1a x:0 0 0 2024-09-19T09:02:28.872 INFO:tasks.workunit.client.1.smithi102.stdout:1/110: rename dd/f1b to dd/d14/f26 0 2024-09-19T09:02:28.872 INFO:tasks.workunit.client.1.smithi102.stdout:7/25: truncate d1/d3/f9 3408854 0 2024-09-19T09:02:28.874 INFO:tasks.workunit.client.1.smithi102.stdout:6/51: dwrite d1/fc [0,4194304] 0 2024-09-19T09:02:28.876 INFO:tasks.workunit.client.1.smithi102.stdout:6/52: fdatasync d1/d5/f7 0 2024-09-19T09:02:28.877 INFO:tasks.workunit.client.1.smithi102.stdout:3/78: creat d2/d5/db/f1b x:0 0 0 2024-09-19T09:02:28.878 INFO:tasks.workunit.client.1.smithi102.stdout:2/33: truncate f2 1229429 0 2024-09-19T09:02:28.879 INFO:tasks.workunit.client.1.smithi102.stdout:4/31: dwrite f6 [4194304,4194304] 0 2024-09-19T09:02:28.886 INFO:tasks.workunit.client.1.smithi102.stdout:1/111: chown dd/d14/d18/l23 1021 1 2024-09-19T09:02:28.886 INFO:tasks.workunit.client.1.smithi102.stdout:3/79: dread d2/ff [0,4194304] 0 2024-09-19T09:02:28.886 INFO:tasks.workunit.client.1.smithi102.stdout:7/26: symlink d1/la 0 2024-09-19T09:02:28.886 INFO:tasks.workunit.client.1.smithi102.stdout:6/53: dwrite d1/d5/f7 [0,4194304] 0 2024-09-19T09:02:28.892 INFO:tasks.workunit.client.1.smithi102.stdout:4/32: symlink l9 0 2024-09-19T09:02:28.894 INFO:tasks.workunit.client.1.smithi102.stdout:4/33: write f6 [2881064,17096] 0 2024-09-19T09:02:28.895 INFO:tasks.workunit.client.1.smithi102.stdout:2/34: rename f6 to d7/f9 0 2024-09-19T09:02:28.896 INFO:tasks.workunit.client.1.smithi102.stdout:8/74: write d0/db/f13 [5603457,105915] 0 2024-09-19T09:02:28.897 INFO:tasks.workunit.client.1.smithi102.stdout:6/54: dread d1/d5/f7 [0,4194304] 0 2024-09-19T09:02:28.898 INFO:tasks.workunit.client.1.smithi102.stdout:2/35: chown d7/c8 25827 1 2024-09-19T09:02:28.899 INFO:tasks.workunit.client.1.smithi102.stdout:3/80: dwrite d2/d5/db/f16 [0,4194304] 0 2024-09-19T09:02:28.899 INFO:tasks.workunit.client.1.smithi102.stdout:0/123: getdents d3 0 2024-09-19T09:02:28.900 INFO:tasks.workunit.client.1.smithi102.stdout:8/75: write d0/fd [2712772,96059] 0 2024-09-19T09:02:28.902 INFO:tasks.workunit.client.1.smithi102.stdout:0/124: read f2 [3638489,117442] 0 2024-09-19T09:02:28.904 INFO:tasks.workunit.client.1.smithi102.stdout:8/76: write d0/fd [2258654,37194] 0 2024-09-19T09:02:28.909 INFO:tasks.workunit.client.1.smithi102.stdout:4/34: dwrite f6 [0,4194304] 0 2024-09-19T09:02:28.916 INFO:tasks.workunit.client.1.smithi102.stdout:3/81: dwrite d2/d5/db/f1a [0,4194304] 0 2024-09-19T09:02:28.920 INFO:tasks.workunit.client.1.smithi102.stdout:4/35: dwrite f6 [0,4194304] 0 2024-09-19T09:02:28.921 INFO:tasks.workunit.client.1.smithi102.stdout:4/36: chown f6 1 1 2024-09-19T09:02:28.922 INFO:tasks.workunit.client.1.smithi102.stdout:0/125: symlink d3/dd/d1a/l25 0 2024-09-19T09:02:28.925 INFO:tasks.workunit.client.1.smithi102.stdout:8/77: mkdir d0/db/d19 0 2024-09-19T09:02:28.931 INFO:tasks.workunit.client.1.smithi102.stdout:1/112: creat dd/d14/f27 x:0 0 0 2024-09-19T09:02:28.931 INFO:tasks.workunit.client.1.smithi102.stdout:8/78: dread d0/f6 [0,4194304] 0 2024-09-19T09:02:28.935 INFO:tasks.workunit.client.1.smithi102.stdout:4/37: unlink f7 0 2024-09-19T09:02:28.938 INFO:tasks.workunit.client.1.smithi102.stdout:4/38: dread f6 [4194304,4194304] 0 2024-09-19T09:02:28.939 INFO:tasks.workunit.client.1.smithi102.stdout:4/39: read f6 [5786729,93124] 0 2024-09-19T09:02:28.943 INFO:tasks.workunit.client.1.smithi102.stdout:8/79: unlink d0/le 0 2024-09-19T09:02:28.944 INFO:tasks.workunit.client.1.smithi102.stdout:8/80: write d0/fd [873782,73318] 0 2024-09-19T09:02:28.944 INFO:tasks.workunit.client.1.smithi102.stdout:3/82: mkdir d2/d19/d1c 0 2024-09-19T09:02:28.946 INFO:tasks.workunit.client.1.smithi102.stdout:3/83: chown d2/d5/db/cc 3 1 2024-09-19T09:02:28.946 INFO:tasks.workunit.client.1.smithi102.stdout:3/84: chown d2/d19/d1c 65501 1 2024-09-19T09:02:28.946 INFO:tasks.workunit.client.1.smithi102.stdout:7/27: getdents d1/d3 0 2024-09-19T09:02:28.951 INFO:tasks.workunit.client.1.smithi102.stdout:0/126: creat d3/dd/d10/d15/d19/f26 x:0 0 0 2024-09-19T09:02:28.954 INFO:tasks.workunit.client.1.smithi102.stdout:3/85: dwrite d2/d5/db/f1b [0,4194304] 0 2024-09-19T09:02:28.956 INFO:tasks.workunit.client.1.smithi102.stdout:1/113: symlink dd/d14/l28 0 2024-09-19T09:02:28.958 INFO:tasks.workunit.client.1.smithi102.stdout:8/81: rmdir d0/d10 39 2024-09-19T09:02:28.959 INFO:tasks.workunit.client.1.smithi102.stdout:8/82: stat d0/db/d19 0 2024-09-19T09:02:28.961 INFO:tasks.workunit.client.1.smithi102.stdout:7/28: symlink d1/lb 0 2024-09-19T09:02:28.966 INFO:tasks.workunit.client.1.smithi102.stdout:8/83: dwrite d0/f16 [0,4194304] 0 2024-09-19T09:02:28.969 INFO:tasks.workunit.client.1.smithi102.stdout:0/127: unlink d3/dd/d10/d15/f23 0 2024-09-19T09:02:28.969 INFO:tasks.workunit.client.1.smithi102.stdout:7/29: dread d1/f7 [0,4194304] 0 2024-09-19T09:02:28.969 INFO:tasks.workunit.client.1.smithi102.stdout:0/128: stat d3/d8/de/c13 0 2024-09-19T09:02:28.972 INFO:tasks.workunit.client.1.smithi102.stdout:3/86: unlink d2/d5/db/f13 0 2024-09-19T09:02:28.972 INFO:tasks.workunit.client.1.smithi102.stdout:7/30: dread d1/f5 [0,4194304] 0 2024-09-19T09:02:28.973 INFO:tasks.workunit.client.1.smithi102.stdout:3/87: chown d2/d5/db/c15 16960110 1 2024-09-19T09:02:28.974 INFO:tasks.workunit.client.1.smithi102.stdout:3/88: readlink d2/d5/l12 0 2024-09-19T09:02:28.974 INFO:tasks.workunit.client.1.smithi102.stdout:7/31: write d1/f7 [5009620,96501] 0 2024-09-19T09:02:28.980 INFO:tasks.workunit.client.1.smithi102.stdout:3/89: dread d2/d5/db/f1b [0,4194304] 0 2024-09-19T09:02:28.982 INFO:tasks.workunit.client.1.smithi102.stdout:7/32: dwrite d1/f5 [0,4194304] 0 2024-09-19T09:02:28.984 INFO:tasks.workunit.client.1.smithi102.stdout:7/33: read d1/f7 [4865862,46395] 0 2024-09-19T09:02:28.988 INFO:tasks.workunit.client.1.smithi102.stdout:7/34: dread d1/f7 [0,4194304] 0 2024-09-19T09:02:28.994 INFO:tasks.workunit.client.1.smithi102.stdout:2/36: sync 2024-09-19T09:02:28.997 INFO:tasks.workunit.client.1.smithi102.stdout:3/90: creat d2/f1d x:0 0 0 2024-09-19T09:02:29.000 INFO:tasks.workunit.client.1.smithi102.stdout:8/84: symlink d0/d10/l1a 0 2024-09-19T09:02:29.000 INFO:tasks.workunit.client.1.smithi102.stdout:3/91: dread d2/d5/db/f16 [0,4194304] 0 2024-09-19T09:02:29.008 INFO:tasks.workunit.client.1.smithi102.stdout:8/85: fsync d0/f6 0 2024-09-19T09:02:29.010 INFO:tasks.workunit.client.1.smithi102.stdout:3/92: mkdir d2/d1e 0 2024-09-19T09:02:29.011 INFO:tasks.workunit.client.1.smithi102.stdout:0/129: link d3/d8/cb d3/dd/d1a/c27 0 2024-09-19T09:02:29.012 INFO:tasks.workunit.client.1.smithi102.stdout:5/86: getdents d5/d7 0 2024-09-19T09:02:29.013 INFO:tasks.workunit.client.1.smithi102.stdout:0/130: write d3/dd/d10/d15/d19/f26 [779880,26505] 0 2024-09-19T09:02:29.014 INFO:tasks.workunit.client.1.smithi102.stdout:9/43: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:29.018 INFO:tasks.workunit.client.1.smithi102.stdout:5/87: mkdir d5/d7/d1b 0 2024-09-19T09:02:29.019 INFO:tasks.workunit.client.1.smithi102.stdout:5/88: readlink l2 0 2024-09-19T09:02:29.021 INFO:tasks.workunit.client.1.smithi102.stdout:3/93: mkdir d2/d19/d1c/d1f 0 2024-09-19T09:02:29.024 INFO:tasks.workunit.client.1.smithi102.stdout:9/44: dwrite d1/d2/d3/f9 [0,4194304] 0 2024-09-19T09:02:29.025 INFO:tasks.workunit.client.1.smithi102.stdout:0/131: symlink d3/dd/d10/d15/d19/l28 0 2024-09-19T09:02:29.028 INFO:tasks.workunit.client.1.smithi102.stdout:0/132: write d3/dd/f1f [104223,107768] 0 2024-09-19T09:02:29.028 INFO:tasks.workunit.client.1.smithi102.stdout:5/89: dwrite d5/d7/f19 [0,4194304] 0 2024-09-19T09:02:29.036 INFO:tasks.workunit.client.1.smithi102.stdout:3/94: dread d2/d5/f7 [0,4194304] 0 2024-09-19T09:02:29.036 INFO:tasks.workunit.client.1.smithi102.stdout:0/133: dwrite d3/dd/ff [0,4194304] 0 2024-09-19T09:02:29.037 INFO:tasks.workunit.client.1.smithi102.stdout:3/95: stat d2/d19/d1c 0 2024-09-19T09:02:29.041 INFO:tasks.workunit.client.1.smithi102.stdout:5/90: creat d5/d7/d1b/f1c x:0 0 0 2024-09-19T09:02:29.044 INFO:tasks.workunit.client.1.smithi102.stdout:6/55: write d1/d5/f7 [4328781,97228] 0 2024-09-19T09:02:29.044 INFO:tasks.workunit.client.1.smithi102.stdout:6/56: stat d1/d5/fa 0 2024-09-19T09:02:29.046 INFO:tasks.workunit.client.1.smithi102.stdout:0/134: rmdir d3 39 2024-09-19T09:02:29.049 INFO:tasks.workunit.client.1.smithi102.stdout:6/57: dread d1/f8 [0,4194304] 0 2024-09-19T09:02:29.052 INFO:tasks.workunit.client.1.smithi102.stdout:5/91: creat d5/d7/f1d x:0 0 0 2024-09-19T09:02:29.054 INFO:tasks.workunit.client.1.smithi102.stdout:5/92: write d5/d7/d1b/f1c [272192,124453] 0 2024-09-19T09:02:29.060 INFO:tasks.workunit.client.1.smithi102.stdout:3/96: link d2/d5/db/c15 d2/d5/c20 0 2024-09-19T09:02:29.060 INFO:tasks.workunit.client.1.smithi102.stdout:0/135: dread d3/f14 [0,4194304] 0 2024-09-19T09:02:29.061 INFO:tasks.workunit.client.1.smithi102.stdout:5/93: dwrite d5/d7/d1b/f1c [0,4194304] 0 2024-09-19T09:02:29.061 INFO:tasks.workunit.client.1.smithi102.stdout:0/136: fsync d3/dd/ff 0 2024-09-19T09:02:29.068 INFO:tasks.workunit.client.1.smithi102.stdout:3/97: symlink d2/d1e/l21 0 2024-09-19T09:02:29.069 INFO:tasks.workunit.client.1.smithi102.stdout:5/94: getdents d5/d7/d1a 0 2024-09-19T09:02:29.070 INFO:tasks.workunit.client.1.smithi102.stdout:5/95: chown d5/d7/c13 3484 1 2024-09-19T09:02:29.070 INFO:tasks.workunit.client.1.smithi102.stdout:5/96: write d5/fe [2414881,63863] 0 2024-09-19T09:02:29.072 INFO:tasks.workunit.client.1.smithi102.stdout:0/137: rename d3/d8/cb to d3/d8/c29 0 2024-09-19T09:02:29.074 INFO:tasks.workunit.client.1.smithi102.stdout:3/98: creat d2/d19/d1c/f22 x:0 0 0 2024-09-19T09:02:29.078 INFO:tasks.workunit.client.1.smithi102.stdout:5/97: dwrite d5/d7/d1b/f1c [0,4194304] 0 2024-09-19T09:02:29.080 INFO:tasks.workunit.client.1.smithi102.stdout:0/138: mkdir d3/dd/d10/d15/d22/d2a 0 2024-09-19T09:02:29.081 INFO:tasks.workunit.client.1.smithi102.stdout:0/139: chown d3/d8 2567 1 2024-09-19T09:02:29.084 INFO:tasks.workunit.client.1.smithi102.stdout:3/99: dwrite d2/d5/db/f17 [0,4194304] 0 2024-09-19T09:02:29.086 INFO:tasks.workunit.client.1.smithi102.stdout:3/100: chown d2/d19/d1c/d1f 130413967 1 2024-09-19T09:02:29.092 INFO:tasks.workunit.client.1.smithi102.stdout:0/140: dwrite d3/dd/d10/d15/d19/f26 [0,4194304] 0 2024-09-19T09:02:29.093 INFO:tasks.workunit.client.1.smithi102.stdout:0/141: read d3/dd/ff [3240962,108234] 0 2024-09-19T09:02:29.119 INFO:tasks.workunit.client.1.smithi102.stdout:7/35: sync 2024-09-19T09:02:29.163 INFO:tasks.workunit.client.1.smithi102.stdout:3/101: symlink d2/l23 0 2024-09-19T09:02:29.164 INFO:tasks.workunit.client.1.smithi102.stdout:3/102: chown d2/d1e/l21 9596475 1 2024-09-19T09:02:29.164 INFO:tasks.workunit.client.1.smithi102.stdout:3/103: chown d2/l4 15530 1 2024-09-19T09:02:29.164 INFO:tasks.workunit.client.1.smithi102.stdout:3/104: readlink d2/d1e/l21 0 2024-09-19T09:02:29.165 INFO:tasks.workunit.client.1.smithi102.stdout:3/105: dread - d2/f1d zero size 2024-09-19T09:02:29.167 INFO:tasks.workunit.client.1.smithi102.stdout:7/36: creat d1/d4/fc x:0 0 0 2024-09-19T09:02:29.170 INFO:tasks.workunit.client.1.smithi102.stdout:4/40: truncate f6 383333 0 2024-09-19T09:02:29.170 INFO:tasks.workunit.client.1.smithi102.stdout:4/41: chown l5 6239749 1 2024-09-19T09:02:29.171 INFO:tasks.workunit.client.1.smithi102.stdout:3/106: read d2/d5/db/f1b [3449688,74405] 0 2024-09-19T09:02:29.173 INFO:tasks.workunit.client.1.smithi102.stdout:7/37: write d1/f5 [2256925,42447] 0 2024-09-19T09:02:29.173 INFO:tasks.workunit.client.1.smithi102.stdout:1/114: write f0 [1760350,109003] 0 2024-09-19T09:02:29.173 INFO:tasks.workunit.client.1.smithi102.stdout:1/115: fdatasync dd/ff 0 2024-09-19T09:02:29.174 INFO:tasks.workunit.client.1.smithi102.stdout:0/142: rmdir d3/dd/d10/d15/d18 0 2024-09-19T09:02:29.183 INFO:tasks.workunit.client.1.smithi102.stdout:8/86: sync 2024-09-19T09:02:29.183 INFO:tasks.workunit.client.1.smithi102.stdout:2/37: sync 2024-09-19T09:02:29.191 INFO:tasks.workunit.client.1.smithi102.stdout:7/38: symlink d1/d4/ld 0 2024-09-19T09:02:29.192 INFO:tasks.workunit.client.1.smithi102.stdout:0/143: mkdir d3/dd/d1a/d2b 0 2024-09-19T09:02:29.194 INFO:tasks.workunit.client.1.smithi102.stdout:1/116: dwrite dd/d14/d18/f1f [0,4194304] 0 2024-09-19T09:02:29.194 INFO:tasks.workunit.client.1.smithi102.stdout:1/117: truncate dd/f12 4232454 0 2024-09-19T09:02:29.226 INFO:tasks.workunit.client.1.smithi102.stdout:5/98: fsync d5/d7/f1d 0 2024-09-19T09:02:29.227 INFO:tasks.workunit.client.1.smithi102.stdout:5/99: write d5/d7/f1d [336713,62086] 0 2024-09-19T09:02:29.239 INFO:tasks.workunit.client.1.smithi102.stdout:6/58: sync 2024-09-19T09:02:29.240 INFO:tasks.workunit.client.1.smithi102.stdout:6/59: chown d1/d5/fa 0 1 2024-09-19T09:02:29.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:28 smithi102 ceph-mon[35280]: pgmap v21: 65 pgs: 65 active+clean; 186 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-09-19T09:02:29.281 INFO:tasks.workunit.client.1.smithi102.stdout:3/107: write d2/d5/db/f17 [4600143,57165] 0 2024-09-19T09:02:29.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:28 smithi049 ceph-mon[28158]: pgmap v21: 65 pgs: 65 active+clean; 186 MiB data, 800 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-09-19T09:02:29.441 INFO:tasks.workunit.client.1.smithi102.stdout:2/38: stat f2 0 2024-09-19T09:02:29.441 INFO:tasks.workunit.client.1.smithi102.stdout:2/39: dread - d7/f9 zero size 2024-09-19T09:02:29.442 INFO:tasks.workunit.client.1.smithi102.stdout:7/39: mknod d1/d4/ce 0 2024-09-19T09:02:29.443 INFO:tasks.workunit.client.1.smithi102.stdout:0/144: rename d3/dd/d1a/d2b to d3/dd/d10/d15/d2c 0 2024-09-19T09:02:29.444 INFO:tasks.workunit.client.1.smithi102.stdout:3/108: rename d2/d1e to d2/d1e/d24 22 2024-09-19T09:02:29.444 INFO:tasks.workunit.client.1.smithi102.stdout:1/118: creat dd/d14/d18/f29 x:0 0 0 2024-09-19T09:02:29.445 INFO:tasks.workunit.client.1.smithi102.stdout:2/40: dread f3 [0,4194304] 0 2024-09-19T09:02:29.447 INFO:tasks.workunit.client.1.smithi102.stdout:5/100: creat d5/d7/f1e x:0 0 0 2024-09-19T09:02:29.447 INFO:tasks.workunit.client.1.smithi102.stdout:5/101: chown d5/d7/d1b 174152 1 2024-09-19T09:02:29.452 INFO:tasks.workunit.client.1.smithi102.stdout:6/60: creat d1/d5/db/fd x:0 0 0 2024-09-19T09:02:29.452 INFO:tasks.workunit.client.1.smithi102.stdout:4/42: dwrite f6 [0,4194304] 0 2024-09-19T09:02:29.453 INFO:tasks.workunit.client.1.smithi102.stdout:6/61: write d1/fc [4234416,64986] 0 2024-09-19T09:02:29.454 INFO:tasks.workunit.client.1.smithi102.stdout:8/87: creat d0/f1b x:0 0 0 2024-09-19T09:02:29.455 INFO:tasks.workunit.client.1.smithi102.stdout:8/88: stat d0/db/f12 0 2024-09-19T09:02:29.455 INFO:tasks.workunit.client.1.smithi102.stdout:5/102: rename d5/d7/f1d to d5/d7/f1f 0 2024-09-19T09:02:29.458 INFO:tasks.workunit.client.1.smithi102.stdout:2/41: truncate f0 773231 0 2024-09-19T09:02:29.460 INFO:tasks.workunit.client.1.smithi102.stdout:4/43: rename l9 to la 0 2024-09-19T09:02:29.461 INFO:tasks.workunit.client.1.smithi102.stdout:6/62: creat d1/fe x:0 0 0 2024-09-19T09:02:29.461 INFO:tasks.workunit.client.1.smithi102.stdout:8/89: dread d0/f16 [0,4194304] 0 2024-09-19T09:02:29.464 INFO:tasks.workunit.client.1.smithi102.stdout:2/42: symlink d7/la 0 2024-09-19T09:02:29.465 INFO:tasks.workunit.client.1.smithi102.stdout:4/44: symlink lb 0 2024-09-19T09:02:29.465 INFO:tasks.workunit.client.1.smithi102.stdout:0/145: getdents d3/d8/de 0 2024-09-19T09:02:29.468 INFO:tasks.workunit.client.1.smithi102.stdout:1/119: getdents dd/d14 0 2024-09-19T09:02:29.469 INFO:tasks.workunit.client.1.smithi102.stdout:5/103: symlink d5/d7/d1a/l20 0 2024-09-19T09:02:29.470 INFO:tasks.workunit.client.1.smithi102.stdout:5/104: fsync d5/fe 0 2024-09-19T09:02:29.471 INFO:tasks.workunit.client.1.smithi102.stdout:0/146: mknod d3/dd/d10/d15/d19/c2d 0 2024-09-19T09:02:29.472 INFO:tasks.workunit.client.1.smithi102.stdout:8/90: mknod d0/c1c 0 2024-09-19T09:02:29.473 INFO:tasks.workunit.client.1.smithi102.stdout:4/45: dwrite f6 [0,4194304] 0 2024-09-19T09:02:29.474 INFO:tasks.workunit.client.1.smithi102.stdout:8/91: write d0/f7 [952945,96940] 0 2024-09-19T09:02:29.478 INFO:tasks.workunit.client.1.smithi102.stdout:8/92: dread - d0/f1b zero size 2024-09-19T09:02:29.484 INFO:tasks.workunit.client.1.smithi102.stdout:1/120: dwrite dd/f1d [0,4194304] 0 2024-09-19T09:02:29.485 INFO:tasks.workunit.client.1.smithi102.stdout:0/147: dwrite d3/dd/d1a/f1b [0,4194304] 0 2024-09-19T09:02:29.486 INFO:tasks.workunit.client.1.smithi102.stdout:4/46: dread f6 [0,4194304] 0 2024-09-19T09:02:29.486 INFO:tasks.workunit.client.1.smithi102.stdout:1/121: chown dd/f25 18315 1 2024-09-19T09:02:29.487 INFO:tasks.workunit.client.1.smithi102.stdout:8/93: mkdir d0/db/d1d 0 2024-09-19T09:02:29.488 INFO:tasks.workunit.client.1.smithi102.stdout:1/122: write dd/f25 [739005,103209] 0 2024-09-19T09:02:29.490 INFO:tasks.workunit.client.1.smithi102.stdout:0/148: write d3/dd/d10/d15/d22/f24 [331565,89822] 0 2024-09-19T09:02:29.491 INFO:tasks.workunit.client.1.smithi102.stdout:0/149: chown d3/d8 50 1 2024-09-19T09:02:29.492 INFO:tasks.workunit.client.1.smithi102.stdout:1/123: chown f4 91090 1 2024-09-19T09:02:29.494 INFO:tasks.workunit.client.1.smithi102.stdout:4/47: dread f6 [0,4194304] 0 2024-09-19T09:02:29.497 INFO:tasks.workunit.client.1.smithi102.stdout:1/124: creat dd/d14/f2a x:0 0 0 2024-09-19T09:02:29.497 INFO:tasks.workunit.client.1.smithi102.stdout:0/150: rename d3/dd/d10/d15/d19/c2d to d3/dd/d10/d15/d2c/c2e 0 2024-09-19T09:02:29.500 INFO:tasks.workunit.client.1.smithi102.stdout:8/94: dread d0/fd [0,4194304] 0 2024-09-19T09:02:29.500 INFO:tasks.workunit.client.1.smithi102.stdout:0/151: readlink d3/dd/d1a/l25 0 2024-09-19T09:02:29.501 INFO:tasks.workunit.client.1.smithi102.stdout:4/48: dread f6 [0,4194304] 0 2024-09-19T09:02:29.502 INFO:tasks.workunit.client.1.smithi102.stdout:4/49: stat lb 0 2024-09-19T09:02:29.502 INFO:tasks.workunit.client.1.smithi102.stdout:0/152: readlink d3/dd/d10/d15/d19/l28 0 2024-09-19T09:02:29.504 INFO:tasks.workunit.client.1.smithi102.stdout:1/125: dread f4 [0,4194304] 0 2024-09-19T09:02:29.505 INFO:tasks.workunit.client.1.smithi102.stdout:1/126: fdatasync dd/f16 0 2024-09-19T09:02:29.506 INFO:tasks.workunit.client.1.smithi102.stdout:0/153: dread d3/dd/d10/d15/d22/f24 [0,4194304] 0 2024-09-19T09:02:29.507 INFO:tasks.workunit.client.1.smithi102.stdout:8/95: dread d0/db/f13 [0,4194304] 0 2024-09-19T09:02:29.508 INFO:tasks.workunit.client.1.smithi102.stdout:0/154: write d3/dd/ff [3468164,54925] 0 2024-09-19T09:02:29.509 INFO:tasks.workunit.client.1.smithi102.stdout:8/96: dread d0/f5 [0,4194304] 0 2024-09-19T09:02:29.513 INFO:tasks.workunit.client.1.smithi102.stdout:8/97: rename d0/f6 to d0/db/d1d/f1e 0 2024-09-19T09:02:29.516 INFO:tasks.workunit.client.1.smithi102.stdout:8/98: dread d0/db/d1d/f1e [0,4194304] 0 2024-09-19T09:02:29.517 INFO:tasks.workunit.client.1.smithi102.stdout:8/99: chown d0/db 109864485 1 2024-09-19T09:02:29.518 INFO:tasks.workunit.client.1.smithi102.stdout:8/100: unlink d0/d10/c14 0 2024-09-19T09:02:29.518 INFO:tasks.workunit.client.1.smithi102.stdout:8/101: chown d0/d10/c11 7315 1 2024-09-19T09:02:29.520 INFO:tasks.workunit.client.1.smithi102.stdout:9/45: dread d1/f6 [0,4194304] 0 2024-09-19T09:02:29.521 INFO:tasks.workunit.client.1.smithi102.stdout:9/46: stat d1/d2 0 2024-09-19T09:02:29.523 INFO:tasks.workunit.client.1.smithi102.stdout:7/40: truncate d1/d3/f9 2508090 0 2024-09-19T09:02:29.524 INFO:tasks.workunit.client.1.smithi102.stdout:7/41: readlink d1/la 0 2024-09-19T09:02:29.526 INFO:tasks.workunit.client.1.smithi102.stdout:9/47: dread d1/d2/d3/fa [0,4194304] 0 2024-09-19T09:02:29.527 INFO:tasks.workunit.client.1.smithi102.stdout:4/50: chown la 467630897 1 2024-09-19T09:02:29.527 INFO:tasks.workunit.client.1.smithi102.stdout:7/42: mkdir d1/d4/df 0 2024-09-19T09:02:29.528 INFO:tasks.workunit.client.1.smithi102.stdout:3/109: dwrite d2/d5/f7 [4194304,4194304] 0 2024-09-19T09:02:29.529 INFO:tasks.workunit.client.1.smithi102.stdout:4/51: write f6 [218349,92769] 0 2024-09-19T09:02:29.533 INFO:tasks.workunit.client.1.smithi102.stdout:9/48: write d1/d2/d3/fa [11561,78318] 0 2024-09-19T09:02:29.535 INFO:tasks.workunit.client.1.smithi102.stdout:5/105: getdents d5/d7/d1a 0 2024-09-19T09:02:29.542 INFO:tasks.workunit.client.1.smithi102.stdout:9/49: truncate d1/d2/d3/fa 1387149 0 2024-09-19T09:02:29.543 INFO:tasks.workunit.client.1.smithi102.stdout:3/110: dread d2/d5/db/f17 [0,4194304] 0 2024-09-19T09:02:29.543 INFO:tasks.workunit.client.1.smithi102.stdout:7/43: dwrite d1/d4/fc [0,4194304] 0 2024-09-19T09:02:29.544 INFO:tasks.workunit.client.1.smithi102.stdout:4/52: dread f6 [0,4194304] 0 2024-09-19T09:02:29.546 INFO:tasks.workunit.client.1.smithi102.stdout:7/44: chown d1/d4/df 168 1 2024-09-19T09:02:29.548 INFO:tasks.workunit.client.1.smithi102.stdout:6/63: dwrite d1/f8 [0,4194304] 0 2024-09-19T09:02:29.548 INFO:tasks.workunit.client.1.smithi102.stdout:5/106: rename d5/c6 to d5/c21 0 2024-09-19T09:02:29.551 INFO:tasks.workunit.client.1.smithi102.stdout:2/43: dwrite f2 [0,4194304] 0 2024-09-19T09:02:29.553 INFO:tasks.workunit.client.1.smithi102.stdout:5/107: write d5/d7/f16 [183831,101727] 0 2024-09-19T09:02:29.555 INFO:tasks.workunit.client.1.smithi102.stdout:3/111: creat d2/d5/db/f25 x:0 0 0 2024-09-19T09:02:29.557 INFO:tasks.workunit.client.1.smithi102.stdout:3/112: chown d2/d5 247 1 2024-09-19T09:02:29.557 INFO:tasks.workunit.client.1.smithi102.stdout:7/45: mknod d1/d4/c10 0 2024-09-19T09:02:29.559 INFO:tasks.workunit.client.1.smithi102.stdout:8/102: truncate d0/db/f12 223024 0 2024-09-19T09:02:29.560 INFO:tasks.workunit.client.1.smithi102.stdout:7/46: chown d1/la 75 1 2024-09-19T09:02:29.563 INFO:tasks.workunit.client.1.smithi102.stdout:4/53: dread f6 [0,4194304] 0 2024-09-19T09:02:29.563 INFO:tasks.workunit.client.1.smithi102.stdout:6/64: dread d1/f8 [0,4194304] 0 2024-09-19T09:02:29.565 INFO:tasks.workunit.client.1.smithi102.stdout:9/50: dwrite d1/d2/d3/fa [0,4194304] 0 2024-09-19T09:02:29.565 INFO:tasks.workunit.client.1.smithi102.stdout:7/47: fsync d1/d4/fc 0 2024-09-19T09:02:29.566 INFO:tasks.workunit.client.1.smithi102.stdout:2/44: write d7/f9 [411977,50671] 0 2024-09-19T09:02:29.566 INFO:tasks.workunit.client.1.smithi102.stdout:6/65: chown d1/d5/db 1 1 2024-09-19T09:02:29.567 INFO:tasks.workunit.client.1.smithi102.stdout:7/48: chown d1/d3 604693 1 2024-09-19T09:02:29.568 INFO:tasks.workunit.client.1.smithi102.stdout:2/45: rename d7 to d7/db 22 2024-09-19T09:02:29.568 INFO:tasks.workunit.client.1.smithi102.stdout:6/66: chown d1/d5/db 25 1 2024-09-19T09:02:29.569 INFO:tasks.workunit.client.1.smithi102.stdout:5/108: dread d5/d7/f19 [0,4194304] 0 2024-09-19T09:02:29.570 INFO:tasks.workunit.client.1.smithi102.stdout:9/51: dread d1/f6 [0,4194304] 0 2024-09-19T09:02:29.570 INFO:tasks.workunit.client.1.smithi102.stdout:3/113: mkdir d2/d5/db/d26 0 2024-09-19T09:02:29.571 INFO:tasks.workunit.client.1.smithi102.stdout:5/109: dread - d5/d7/f1e zero size 2024-09-19T09:02:29.574 INFO:tasks.workunit.client.1.smithi102.stdout:9/52: truncate d1/d2/d3/fa 5212095 0 2024-09-19T09:02:29.575 INFO:tasks.workunit.client.1.smithi102.stdout:9/53: read d1/f6 [110899,18157] 0 2024-09-19T09:02:29.576 INFO:tasks.workunit.client.1.smithi102.stdout:4/54: creat fc x:0 0 0 2024-09-19T09:02:29.580 INFO:tasks.workunit.client.1.smithi102.stdout:2/46: creat d7/fc x:0 0 0 2024-09-19T09:02:29.580 INFO:tasks.workunit.client.1.smithi102.stdout:2/47: truncate f2 4252247 0 2024-09-19T09:02:29.582 INFO:tasks.workunit.client.1.smithi102.stdout:2/48: truncate d7/fc 1033994 0 2024-09-19T09:02:29.582 INFO:tasks.workunit.client.1.smithi102.stdout:8/103: fsync d0/db/f12 0 2024-09-19T09:02:29.585 INFO:tasks.workunit.client.1.smithi102.stdout:5/110: mkdir d5/d7/d1a/d22 0 2024-09-19T09:02:29.586 INFO:tasks.workunit.client.1.smithi102.stdout:5/111: chown d5/d7/f1f 2530 1 2024-09-19T09:02:29.587 INFO:tasks.workunit.client.1.smithi102.stdout:8/104: dread d0/fd [0,4194304] 0 2024-09-19T09:02:29.587 INFO:tasks.workunit.client.1.smithi102.stdout:5/112: chown d5/d7/f1f 131847422 1 2024-09-19T09:02:29.588 INFO:tasks.workunit.client.1.smithi102.stdout:1/127: write dd/d14/d18/f24 [2577636,112254] 0 2024-09-19T09:02:29.588 INFO:tasks.workunit.client.1.smithi102.stdout:8/105: read d0/f7 [869331,123994] 0 2024-09-19T09:02:29.589 INFO:tasks.workunit.client.1.smithi102.stdout:4/55: creat fd x:0 0 0 2024-09-19T09:02:29.596 INFO:tasks.workunit.client.1.smithi102.stdout:3/114: mknod d2/d5/db/d26/c27 0 2024-09-19T09:02:29.599 INFO:tasks.workunit.client.1.smithi102.stdout:9/54: mkdir d1/de 0 2024-09-19T09:02:29.600 INFO:tasks.workunit.client.1.smithi102.stdout:3/115: dread d2/d5/db/f1b [0,4194304] 0 2024-09-19T09:02:29.601 INFO:tasks.workunit.client.1.smithi102.stdout:6/67: truncate d1/d5/fa 589853 0 2024-09-19T09:02:29.601 INFO:tasks.workunit.client.1.smithi102.stdout:3/116: chown d2/d5/fa 402 1 2024-09-19T09:02:29.602 INFO:tasks.workunit.client.1.smithi102.stdout:4/56: creat fe x:0 0 0 2024-09-19T09:02:29.603 INFO:tasks.workunit.client.1.smithi102.stdout:4/57: dread - fc zero size 2024-09-19T09:02:29.603 INFO:tasks.workunit.client.1.smithi102.stdout:3/117: dread d2/f9 [0,4194304] 0 2024-09-19T09:02:29.603 INFO:tasks.workunit.client.1.smithi102.stdout:7/49: link d1/d4/ce d1/d4/df/c11 0 2024-09-19T09:02:29.605 INFO:tasks.workunit.client.1.smithi102.stdout:9/55: dread d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:29.606 INFO:tasks.workunit.client.1.smithi102.stdout:8/106: dread d0/f16 [0,4194304] 0 2024-09-19T09:02:29.607 INFO:tasks.workunit.client.1.smithi102.stdout:5/113: mkdir d5/d23 0 2024-09-19T09:02:29.613 INFO:tasks.workunit.client.1.smithi102.stdout:6/68: creat d1/ff x:0 0 0 2024-09-19T09:02:29.615 INFO:tasks.workunit.client.1.smithi102.stdout:3/118: fdatasync d2/ff 0 2024-09-19T09:02:29.615 INFO:tasks.workunit.client.1.smithi102.stdout:2/49: write f0 [875053,84437] 0 2024-09-19T09:02:29.616 INFO:tasks.workunit.client.1.smithi102.stdout:7/50: unlink d1/lb 0 2024-09-19T09:02:29.619 INFO:tasks.workunit.client.1.smithi102.stdout:2/50: dread f2 [0,4194304] 0 2024-09-19T09:02:29.620 INFO:tasks.workunit.client.1.smithi102.stdout:8/107: fsync d0/f7 0 2024-09-19T09:02:29.623 INFO:tasks.workunit.client.1.smithi102.stdout:5/114: rename d5/d7/f14 to d5/d23/f24 0 2024-09-19T09:02:29.623 INFO:tasks.workunit.client.1.smithi102.stdout:5/115: readlink d5/d7/d1a/l20 0 2024-09-19T09:02:29.627 INFO:tasks.workunit.client.1.smithi102.stdout:6/69: creat d1/d5/db/f10 x:0 0 0 2024-09-19T09:02:29.629 INFO:tasks.workunit.client.1.smithi102.stdout:3/119: creat d2/d19/f28 x:0 0 0 2024-09-19T09:02:29.631 INFO:tasks.workunit.client.1.smithi102.stdout:2/51: symlink d7/ld 0 2024-09-19T09:02:29.632 INFO:tasks.workunit.client.1.smithi102.stdout:2/52: fdatasync f3 0 2024-09-19T09:02:29.632 INFO:tasks.workunit.client.1.smithi102.stdout:1/128: getdents dd/d13 0 2024-09-19T09:02:29.634 INFO:tasks.workunit.client.1.smithi102.stdout:7/51: dread d1/d3/f9 [0,4194304] 0 2024-09-19T09:02:29.635 INFO:tasks.workunit.client.1.smithi102.stdout:7/52: chown d1/f5 1776896705 1 2024-09-19T09:02:29.637 INFO:tasks.workunit.client.1.smithi102.stdout:6/70: mknod d1/d5/db/c11 0 2024-09-19T09:02:29.640 INFO:tasks.workunit.client.1.smithi102.stdout:5/116: dwrite d5/d7/f19 [0,4194304] 0 2024-09-19T09:02:29.641 INFO:tasks.workunit.client.1.smithi102.stdout:2/53: symlink d7/le 0 2024-09-19T09:02:29.642 INFO:tasks.workunit.client.1.smithi102.stdout:5/117: chown d5/d7/f19 13 1 2024-09-19T09:02:29.645 INFO:tasks.workunit.client.1.smithi102.stdout:3/120: write d2/d5/db/f1b [2346466,95157] 0 2024-09-19T09:02:29.647 INFO:tasks.workunit.client.1.smithi102.stdout:2/54: creat d7/ff x:0 0 0 2024-09-19T09:02:29.647 INFO:tasks.workunit.client.1.smithi102.stdout:6/71: dwrite d1/ff [0,4194304] 0 2024-09-19T09:02:29.648 INFO:tasks.workunit.client.1.smithi102.stdout:7/53: symlink d1/d4/df/l12 0 2024-09-19T09:02:29.648 INFO:tasks.workunit.client.1.smithi102.stdout:2/55: dread - d7/ff zero size 2024-09-19T09:02:29.649 INFO:tasks.workunit.client.1.smithi102.stdout:8/108: getdents d0/db/d1d 0 2024-09-19T09:02:29.652 INFO:tasks.workunit.client.1.smithi102.stdout:5/118: truncate d5/d7/ff 1176388 0 2024-09-19T09:02:29.652 INFO:tasks.workunit.client.1.smithi102.stdout:6/72: fsync d1/d5/db/fd 0 2024-09-19T09:02:29.656 INFO:tasks.workunit.client.1.smithi102.stdout:5/119: unlink d5/d7/ca 0 2024-09-19T09:02:29.656 INFO:tasks.workunit.client.1.smithi102.stdout:7/54: dread d1/d3/f9 [0,4194304] 0 2024-09-19T09:02:29.657 INFO:tasks.workunit.client.1.smithi102.stdout:6/73: mknod d1/d5/db/c12 0 2024-09-19T09:02:29.659 INFO:tasks.workunit.client.1.smithi102.stdout:5/120: rmdir d5/d7/d1a 39 2024-09-19T09:02:29.659 INFO:tasks.workunit.client.1.smithi102.stdout:3/121: dwrite d2/d19/f28 [0,4194304] 0 2024-09-19T09:02:29.660 INFO:tasks.workunit.client.1.smithi102.stdout:8/109: dread d0/f16 [0,4194304] 0 2024-09-19T09:02:29.662 INFO:tasks.workunit.client.1.smithi102.stdout:5/121: fsync d5/d7/f19 0 2024-09-19T09:02:29.674 INFO:tasks.workunit.client.1.smithi102.stdout:6/74: dwrite d1/fe [0,4194304] 0 2024-09-19T09:02:29.675 INFO:tasks.workunit.client.1.smithi102.stdout:7/55: dwrite d1/d4/fc [0,4194304] 0 2024-09-19T09:02:29.675 INFO:tasks.workunit.client.1.smithi102.stdout:5/122: mknod d5/c25 0 2024-09-19T09:02:29.678 INFO:tasks.workunit.client.1.smithi102.stdout:3/122: dwrite d2/d19/d1c/f22 [0,4194304] 0 2024-09-19T09:02:29.680 INFO:tasks.workunit.client.1.smithi102.stdout:7/56: fsync d1/d4/f6 0 2024-09-19T09:02:29.686 INFO:tasks.workunit.client.1.smithi102.stdout:5/123: rename d5/d7/f1e to d5/d23/f26 0 2024-09-19T09:02:29.690 INFO:tasks.workunit.client.1.smithi102.stdout:8/110: dwrite d0/f16 [4194304,4194304] 0 2024-09-19T09:02:29.691 INFO:tasks.workunit.client.1.smithi102.stdout:8/111: read d0/fd [661134,86162] 0 2024-09-19T09:02:29.692 INFO:tasks.workunit.client.1.smithi102.stdout:7/57: rename d1/la to d1/d4/l13 0 2024-09-19T09:02:29.692 INFO:tasks.workunit.client.1.smithi102.stdout:6/75: getdents d1 0 2024-09-19T09:02:29.695 INFO:tasks.workunit.client.1.smithi102.stdout:8/112: symlink d0/d10/l1f 0 2024-09-19T09:02:29.700 INFO:tasks.workunit.client.1.smithi102.stdout:5/124: truncate d5/fe 7950663 0 2024-09-19T09:02:29.700 INFO:tasks.workunit.client.1.smithi102.stdout:3/123: getdents d2/d5/db/d26 0 2024-09-19T09:02:29.701 INFO:tasks.workunit.client.1.smithi102.stdout:7/58: dread d1/d4/f6 [0,4194304] 0 2024-09-19T09:02:29.701 INFO:tasks.workunit.client.1.smithi102.stdout:5/125: mknod d5/d7/d1b/c27 0 2024-09-19T09:02:29.704 INFO:tasks.workunit.client.1.smithi102.stdout:7/59: write d1/f5 [3488235,31180] 0 2024-09-19T09:02:29.704 INFO:tasks.workunit.client.1.smithi102.stdout:6/76: dwrite d1/d5/f7 [4194304,4194304] 0 2024-09-19T09:02:29.708 INFO:tasks.workunit.client.1.smithi102.stdout:6/77: symlink d1/l13 0 2024-09-19T09:02:29.708 INFO:tasks.workunit.client.1.smithi102.stdout:0/155: sync 2024-09-19T09:02:29.709 INFO:tasks.workunit.client.1.smithi102.stdout:8/113: dwrite d0/fd [0,4194304] 0 2024-09-19T09:02:29.712 INFO:tasks.workunit.client.1.smithi102.stdout:0/156: chown d3/dd/d10/d15/d22/d2a 2704380 1 2024-09-19T09:02:29.713 INFO:tasks.workunit.client.1.smithi102.stdout:0/157: chown d3/dd/d1a 2149477 1 2024-09-19T09:02:29.713 INFO:tasks.workunit.client.1.smithi102.stdout:5/126: link d5/l11 d5/d7/d1a/d22/l28 0 2024-09-19T09:02:29.715 INFO:tasks.workunit.client.1.smithi102.stdout:8/114: mknod d0/d10/c20 0 2024-09-19T09:02:29.717 INFO:tasks.workunit.client.1.smithi102.stdout:0/158: creat d3/dd/d10/d15/d22/f2f x:0 0 0 2024-09-19T09:02:29.717 INFO:tasks.workunit.client.1.smithi102.stdout:8/115: chown d0/db/lc 1 1 2024-09-19T09:02:29.719 INFO:tasks.workunit.client.1.smithi102.stdout:7/60: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:02:29.722 INFO:tasks.workunit.client.1.smithi102.stdout:5/127: creat d5/d7/f29 x:0 0 0 2024-09-19T09:02:29.722 INFO:tasks.workunit.client.1.smithi102.stdout:5/128: dread - d5/d7/f29 zero size 2024-09-19T09:02:29.723 INFO:tasks.workunit.client.1.smithi102.stdout:8/116: rename d0/db/d19 to d0/d10/d21 0 2024-09-19T09:02:29.723 INFO:tasks.workunit.client.1.smithi102.stdout:5/129: chown d5 36589 1 2024-09-19T09:02:29.724 INFO:tasks.workunit.client.1.smithi102.stdout:5/130: readlink d5/d7/l10 0 2024-09-19T09:02:29.725 INFO:tasks.workunit.client.1.smithi102.stdout:0/159: mknod d3/dd/c30 0 2024-09-19T09:02:29.726 INFO:tasks.workunit.client.1.smithi102.stdout:7/61: creat d1/f14 x:0 0 0 2024-09-19T09:02:29.729 INFO:tasks.workunit.client.1.smithi102.stdout:8/117: creat d0/db/d1d/f22 x:0 0 0 2024-09-19T09:02:29.730 INFO:tasks.workunit.client.1.smithi102.stdout:5/131: creat d5/d7/d1a/f2a x:0 0 0 2024-09-19T09:02:29.732 INFO:tasks.workunit.client.1.smithi102.stdout:0/160: rename d3/dd/d10/d15/d22/f24 to d3/d8/f31 0 2024-09-19T09:02:29.735 INFO:tasks.workunit.client.1.smithi102.stdout:8/118: mkdir d0/d10/d23 0 2024-09-19T09:02:29.735 INFO:tasks.workunit.client.1.smithi102.stdout:0/161: dread f2 [0,4194304] 0 2024-09-19T09:02:29.738 INFO:tasks.workunit.client.1.smithi102.stdout:0/162: read d3/f7 [3331250,10666] 0 2024-09-19T09:02:29.738 INFO:tasks.workunit.client.1.smithi102.stdout:6/78: truncate d1/fc 400494 0 2024-09-19T09:02:29.742 INFO:tasks.workunit.client.1.smithi102.stdout:5/132: link d5/d7/d1b/f1c d5/d7/d1a/d22/f2b 0 2024-09-19T09:02:29.742 INFO:tasks.workunit.client.1.smithi102.stdout:0/163: dread d3/dd/ff [0,4194304] 0 2024-09-19T09:02:29.742 INFO:tasks.workunit.client.1.smithi102.stdout:8/119: creat d0/d10/d21/f24 x:0 0 0 2024-09-19T09:02:29.742 INFO:tasks.workunit.client.1.smithi102.stdout:5/133: readlink d5/d7/l18 0 2024-09-19T09:02:29.743 INFO:tasks.workunit.client.1.smithi102.stdout:8/120: stat d0/db/c17 0 2024-09-19T09:02:29.744 INFO:tasks.workunit.client.1.smithi102.stdout:7/62: link d1/d4/df/c11 d1/d4/c15 0 2024-09-19T09:02:29.749 INFO:tasks.workunit.client.1.smithi102.stdout:8/121: dwrite d0/fd [0,4194304] 0 2024-09-19T09:02:29.750 INFO:tasks.workunit.client.1.smithi102.stdout:7/63: dread d1/f7 [0,4194304] 0 2024-09-19T09:02:29.751 INFO:tasks.workunit.client.1.smithi102.stdout:7/64: fdatasync d1/d4/fc 0 2024-09-19T09:02:29.755 INFO:tasks.workunit.client.1.smithi102.stdout:5/134: rename d5/c21 to d5/d7/d1a/d22/c2c 0 2024-09-19T09:02:29.765 INFO:tasks.workunit.client.1.smithi102.stdout:5/135: creat d5/d7/d1b/f2d x:0 0 0 2024-09-19T09:02:29.765 INFO:tasks.workunit.client.1.smithi102.stdout:0/164: write d3/f14 [2128391,59934] 0 2024-09-19T09:02:29.768 INFO:tasks.workunit.client.1.smithi102.stdout:5/136: mknod d5/d7/d1a/c2e 0 2024-09-19T09:02:29.769 INFO:tasks.workunit.client.1.smithi102.stdout:0/165: mkdir d3/dd/d1a/d32 0 2024-09-19T09:02:29.771 INFO:tasks.workunit.client.1.smithi102.stdout:5/137: symlink d5/d23/l2f 0 2024-09-19T09:02:29.773 INFO:tasks.workunit.client.1.smithi102.stdout:0/166: fsync d3/dd/ff 0 2024-09-19T09:02:29.775 INFO:tasks.workunit.client.1.smithi102.stdout:6/79: write d1/fc [26281,41306] 0 2024-09-19T09:02:29.781 INFO:tasks.workunit.client.1.smithi102.stdout:5/138: getdents d5/d7/d1a/d22 0 2024-09-19T09:02:29.782 INFO:tasks.workunit.client.1.smithi102.stdout:7/65: truncate d1/d4/f6 1704907 0 2024-09-19T09:02:29.783 INFO:tasks.workunit.client.1.smithi102.stdout:0/167: dwrite d3/dd/d10/d15/d22/f2f [0,4194304] 0 2024-09-19T09:02:29.783 INFO:tasks.workunit.client.1.smithi102.stdout:8/122: dwrite d0/f5 [0,4194304] 0 2024-09-19T09:02:29.784 INFO:tasks.workunit.client.1.smithi102.stdout:7/66: write d1/f14 [527998,110876] 0 2024-09-19T09:02:29.785 INFO:tasks.workunit.client.1.smithi102.stdout:8/123: fdatasync d0/f1b 0 2024-09-19T09:02:29.789 INFO:tasks.workunit.client.1.smithi102.stdout:0/168: symlink d3/dd/d10/l33 0 2024-09-19T09:02:29.789 INFO:tasks.workunit.client.1.smithi102.stdout:7/67: symlink d1/d3/l16 0 2024-09-19T09:02:29.790 INFO:tasks.workunit.client.1.smithi102.stdout:0/169: chown d3/dd/d1a/l25 13 1 2024-09-19T09:02:29.791 INFO:tasks.workunit.client.1.smithi102.stdout:8/124: creat d0/d10/d21/f25 x:0 0 0 2024-09-19T09:02:29.793 INFO:tasks.workunit.client.1.smithi102.stdout:5/139: symlink d5/l30 0 2024-09-19T09:02:29.793 INFO:tasks.workunit.client.1.smithi102.stdout:7/68: truncate d1/f7 4622481 0 2024-09-19T09:02:29.794 INFO:tasks.workunit.client.1.smithi102.stdout:0/170: symlink d3/d8/de/l34 0 2024-09-19T09:02:29.797 INFO:tasks.workunit.client.1.smithi102.stdout:6/80: truncate d1/d5/f7 1276536 0 2024-09-19T09:02:29.799 INFO:tasks.workunit.client.1.smithi102.stdout:5/140: mknod d5/d7/d1a/d22/c31 0 2024-09-19T09:02:29.799 INFO:tasks.workunit.client.1.smithi102.stdout:5/141: stat l2 0 2024-09-19T09:02:29.800 INFO:tasks.workunit.client.1.smithi102.stdout:8/125: mknod d0/d10/d23/c26 0 2024-09-19T09:02:29.801 INFO:tasks.workunit.client.1.smithi102.stdout:0/171: dwrite d3/dd/d10/d15/d22/f2f [0,4194304] 0 2024-09-19T09:02:29.803 INFO:tasks.workunit.client.1.smithi102.stdout:5/142: creat d5/d7/d1a/d22/f32 x:0 0 0 2024-09-19T09:02:29.804 INFO:tasks.workunit.client.1.smithi102.stdout:5/143: read d5/d7/d1b/f1c [242600,129065] 0 2024-09-19T09:02:29.806 INFO:tasks.workunit.client.1.smithi102.stdout:8/126: truncate d0/f7 1717541 0 2024-09-19T09:02:29.809 INFO:tasks.workunit.client.1.smithi102.stdout:7/69: link d1/d4/ce d1/c17 0 2024-09-19T09:02:29.816 INFO:tasks.workunit.client.1.smithi102.stdout:8/127: dwrite d0/f1b [0,4194304] 0 2024-09-19T09:02:29.818 INFO:tasks.workunit.client.1.smithi102.stdout:5/144: dwrite d5/d7/f1f [0,4194304] 0 2024-09-19T09:02:29.820 INFO:tasks.workunit.client.1.smithi102.stdout:5/145: truncate d5/d23/f26 27628 0 2024-09-19T09:02:29.825 INFO:tasks.workunit.client.1.smithi102.stdout:6/81: dread d1/d5/f7 [0,4194304] 0 2024-09-19T09:02:29.826 INFO:tasks.workunit.client.1.smithi102.stdout:6/82: write d1/d5/db/fd [673607,58281] 0 2024-09-19T09:02:29.831 INFO:tasks.workunit.client.1.smithi102.stdout:8/128: rename d0/d10/d23/c26 to d0/c27 0 2024-09-19T09:02:29.836 INFO:tasks.workunit.client.1.smithi102.stdout:5/146: rename d5/d7/f16 to d5/d7/d1b/f33 0 2024-09-19T09:02:29.836 INFO:tasks.workunit.client.1.smithi102.stdout:0/172: dwrite d3/dd/ff [0,4194304] 0 2024-09-19T09:02:29.838 INFO:tasks.workunit.client.1.smithi102.stdout:0/173: write d3/dd/d10/d15/d19/f26 [3409076,36070] 0 2024-09-19T09:02:29.840 INFO:tasks.workunit.client.1.smithi102.stdout:4/58: sync 2024-09-19T09:02:29.840 INFO:tasks.workunit.client.1.smithi102.stdout:8/129: rename d0/f1b to d0/d10/f28 0 2024-09-19T09:02:29.841 INFO:tasks.workunit.client.1.smithi102.stdout:8/130: stat d0/lf 0 2024-09-19T09:02:29.841 INFO:tasks.workunit.client.1.smithi102.stdout:4/59: chown la 16598319 1 2024-09-19T09:02:29.841 INFO:tasks.workunit.client.1.smithi102.stdout:4/60: rmdir - no directory 2024-09-19T09:02:29.853 INFO:tasks.workunit.client.1.smithi102.stdout:7/70: dwrite d1/d3/f9 [0,4194304] 0 2024-09-19T09:02:29.854 INFO:tasks.workunit.client.1.smithi102.stdout:4/61: mknod cf 0 2024-09-19T09:02:29.854 INFO:tasks.workunit.client.1.smithi102.stdout:4/62: dread - fd zero size 2024-09-19T09:02:29.856 INFO:tasks.workunit.client.1.smithi102.stdout:0/174: mknod d3/dd/c35 0 2024-09-19T09:02:29.859 INFO:tasks.workunit.client.1.smithi102.stdout:7/71: mknod d1/d4/c18 0 2024-09-19T09:02:29.859 INFO:tasks.workunit.client.1.smithi102.stdout:7/72: read d1/d3/f9 [2665237,128167] 0 2024-09-19T09:02:29.868 INFO:tasks.workunit.client.1.smithi102.stdout:6/83: write d1/d5/fa [421583,74352] 0 2024-09-19T09:02:29.869 INFO:tasks.workunit.client.1.smithi102.stdout:6/84: chown d1/fc 2852 1 2024-09-19T09:02:29.873 INFO:tasks.workunit.client.1.smithi102.stdout:5/147: getdents d5/d7/d1b 0 2024-09-19T09:02:29.875 INFO:tasks.workunit.client.1.smithi102.stdout:0/175: link d3/dd/d10/d15/d19/f26 d3/dd/d10/d15/f36 0 2024-09-19T09:02:29.876 INFO:tasks.workunit.client.1.smithi102.stdout:6/85: mknod d1/d5/c14 0 2024-09-19T09:02:29.877 INFO:tasks.workunit.client.1.smithi102.stdout:5/148: dwrite d5/d7/f1f [0,4194304] 0 2024-09-19T09:02:29.884 INFO:tasks.workunit.client.1.smithi102.stdout:6/86: dread d1/d5/fa [0,4194304] 0 2024-09-19T09:02:29.884 INFO:tasks.workunit.client.1.smithi102.stdout:5/149: dread d5/d7/d1b/f1c [0,4194304] 0 2024-09-19T09:02:29.885 INFO:tasks.workunit.client.1.smithi102.stdout:0/176: mkdir d3/dd/d10/d15/d22/d37 0 2024-09-19T09:02:29.888 INFO:tasks.workunit.client.1.smithi102.stdout:8/131: dwrite d0/f7 [0,4194304] 0 2024-09-19T09:02:29.888 INFO:tasks.workunit.client.1.smithi102.stdout:0/177: write d3/dd/d1a/f1b [2822260,59937] 0 2024-09-19T09:02:29.890 INFO:tasks.workunit.client.1.smithi102.stdout:8/132: chown d0/db/f13 2715 1 2024-09-19T09:02:29.891 INFO:tasks.workunit.client.1.smithi102.stdout:8/133: chown d0/d10/d21 25387878 1 2024-09-19T09:02:29.892 INFO:tasks.workunit.client.1.smithi102.stdout:4/63: getdents . 0 2024-09-19T09:02:29.892 INFO:tasks.workunit.client.1.smithi102.stdout:4/64: rmdir - no directory 2024-09-19T09:02:29.894 INFO:tasks.workunit.client.1.smithi102.stdout:6/87: mknod d1/d5/db/c15 0 2024-09-19T09:02:29.894 INFO:tasks.workunit.client.1.smithi102.stdout:4/65: chown cf 2185 1 2024-09-19T09:02:29.895 INFO:tasks.workunit.client.1.smithi102.stdout:5/150: dwrite d5/d7/d1b/f2d [0,4194304] 0 2024-09-19T09:02:29.896 INFO:tasks.workunit.client.1.smithi102.stdout:0/178: dread d3/dd/d1a/f1b [0,4194304] 0 2024-09-19T09:02:29.898 INFO:tasks.workunit.client.1.smithi102.stdout:0/179: write d3/dd/d1a/f1b [882818,24935] 0 2024-09-19T09:02:29.903 INFO:tasks.workunit.client.1.smithi102.stdout:7/73: getdents d1/d4 0 2024-09-19T09:02:29.903 INFO:tasks.workunit.client.1.smithi102.stdout:7/74: write d1/f14 [1267957,89064] 0 2024-09-19T09:02:29.909 INFO:tasks.workunit.client.1.smithi102.stdout:8/134: unlink d0/d10/l1f 0 2024-09-19T09:02:29.911 INFO:tasks.workunit.client.1.smithi102.stdout:4/66: mknod c10 0 2024-09-19T09:02:29.916 INFO:tasks.workunit.client.1.smithi102.stdout:0/180: creat d3/dd/d10/f38 x:0 0 0 2024-09-19T09:02:29.916 INFO:tasks.workunit.client.1.smithi102.stdout:9/56: sync 2024-09-19T09:02:29.919 INFO:tasks.workunit.client.1.smithi102.stdout:7/75: creat d1/f19 x:0 0 0 2024-09-19T09:02:29.920 INFO:tasks.workunit.client.1.smithi102.stdout:5/151: dwrite d5/d23/f26 [0,4194304] 0 2024-09-19T09:02:29.923 INFO:tasks.workunit.client.1.smithi102.stdout:4/67: unlink l1 0 2024-09-19T09:02:29.927 INFO:tasks.workunit.client.1.smithi102.stdout:9/57: rename d1/d2/d3/f9 to d1/d2/ff 0 2024-09-19T09:02:29.927 INFO:tasks.workunit.client.1.smithi102.stdout:4/68: truncate fe 734215 0 2024-09-19T09:02:29.928 INFO:tasks.workunit.client.1.smithi102.stdout:0/181: dwrite d3/dd/f1f [0,4194304] 0 2024-09-19T09:02:29.928 INFO:tasks.workunit.client.1.smithi102.stdout:7/76: creat d1/d4/f1a x:0 0 0 2024-09-19T09:02:29.929 INFO:tasks.workunit.client.1.smithi102.stdout:5/152: mkdir d5/d7/d1a/d22/d34 0 2024-09-19T09:02:29.930 INFO:tasks.workunit.client.1.smithi102.stdout:4/69: chown l5 309576 1 2024-09-19T09:02:29.930 INFO:tasks.workunit.client.1.smithi102.stdout:0/182: chown d3/d8 956 1 2024-09-19T09:02:29.930 INFO:tasks.workunit.client.1.smithi102.stdout:6/88: link d1/d5/c14 d1/d5/db/c16 0 2024-09-19T09:02:29.931 INFO:tasks.workunit.client.1.smithi102.stdout:5/153: chown d5/d23/l2f 7855894 1 2024-09-19T09:02:29.932 INFO:tasks.workunit.client.1.smithi102.stdout:7/77: write d1/f19 [1034221,80708] 0 2024-09-19T09:02:29.934 INFO:tasks.workunit.client.1.smithi102.stdout:8/135: dwrite d0/db/d1d/f1e [4194304,4194304] 0 2024-09-19T09:02:29.934 INFO:tasks.workunit.client.1.smithi102.stdout:6/89: fdatasync d1/d5/db/f10 0 2024-09-19T09:02:29.934 INFO:tasks.workunit.client.1.smithi102.stdout:4/70: unlink l8 0 2024-09-19T09:02:29.936 INFO:tasks.workunit.client.1.smithi102.stdout:4/71: write fd [684829,30787] 0 2024-09-19T09:02:29.936 INFO:tasks.workunit.client.1.smithi102.stdout:8/136: dread - d0/d10/d21/f25 zero size 2024-09-19T09:02:29.939 INFO:tasks.workunit.client.1.smithi102.stdout:9/58: symlink d1/de/l10 0 2024-09-19T09:02:29.940 INFO:tasks.workunit.client.1.smithi102.stdout:8/137: chown d0/db/d1d/f22 0 1 2024-09-19T09:02:29.942 INFO:tasks.workunit.client.1.smithi102.stdout:8/138: dread - d0/db/f15 zero size 2024-09-19T09:02:29.943 INFO:tasks.workunit.client.1.smithi102.stdout:5/154: dwrite d5/f15 [0,4194304] 0 2024-09-19T09:02:29.944 INFO:tasks.workunit.client.1.smithi102.stdout:4/72: creat f11 x:0 0 0 2024-09-19T09:02:29.944 INFO:tasks.workunit.client.1.smithi102.stdout:8/139: chown d0/d10/d21/f25 18 1 2024-09-19T09:02:29.945 INFO:tasks.workunit.client.1.smithi102.stdout:7/78: dread d1/d4/f6 [0,4194304] 0 2024-09-19T09:02:29.945 INFO:tasks.workunit.client.1.smithi102.stdout:5/155: fdatasync d5/d7/f1f 0 2024-09-19T09:02:29.946 INFO:tasks.workunit.client.1.smithi102.stdout:8/140: write d0/d10/d21/f25 [362855,111578] 0 2024-09-19T09:02:29.947 INFO:tasks.workunit.client.1.smithi102.stdout:8/141: readlink d0/d10/l1a 0 2024-09-19T09:02:29.949 INFO:tasks.workunit.client.1.smithi102.stdout:0/183: mkdir d3/dd/d10/d15/d22/d37/d39 0 2024-09-19T09:02:29.951 INFO:tasks.workunit.client.1.smithi102.stdout:9/59: symlink d1/de/l11 0 2024-09-19T09:02:29.952 INFO:tasks.workunit.client.1.smithi102.stdout:1/129: sync 2024-09-19T09:02:29.952 INFO:tasks.workunit.client.1.smithi102.stdout:2/56: sync 2024-09-19T09:02:29.952 INFO:tasks.workunit.client.1.smithi102.stdout:3/124: sync 2024-09-19T09:02:29.954 INFO:tasks.workunit.client.1.smithi102.stdout:4/73: creat f12 x:0 0 0 2024-09-19T09:02:29.954 INFO:tasks.workunit.client.1.smithi102.stdout:3/125: read - d2/d5/db/f25 zero size 2024-09-19T09:02:29.955 INFO:tasks.workunit.client.1.smithi102.stdout:4/74: write fe [859659,85644] 0 2024-09-19T09:02:29.956 INFO:tasks.workunit.client.1.smithi102.stdout:2/57: dread d7/f9 [0,4194304] 0 2024-09-19T09:02:29.956 INFO:tasks.workunit.client.1.smithi102.stdout:4/75: chown f12 7 1 2024-09-19T09:02:29.957 INFO:tasks.workunit.client.1.smithi102.stdout:7/79: creat d1/d4/f1b x:0 0 0 2024-09-19T09:02:29.958 INFO:tasks.workunit.client.1.smithi102.stdout:9/60: dread d1/d2/ff [0,4194304] 0 2024-09-19T09:02:29.961 INFO:tasks.workunit.client.1.smithi102.stdout:6/90: rename d1/d5/db/c16 to d1/d5/db/c17 0 2024-09-19T09:02:29.963 INFO:tasks.workunit.client.1.smithi102.stdout:8/142: mkdir d0/db/d29 0 2024-09-19T09:02:29.965 INFO:tasks.workunit.client.1.smithi102.stdout:8/143: fdatasync d0/db/d1d/f1e 0 2024-09-19T09:02:29.966 INFO:tasks.workunit.client.1.smithi102.stdout:5/156: dwrite d5/d23/f26 [4194304,4194304] 0 2024-09-19T09:02:29.966 INFO:tasks.workunit.client.1.smithi102.stdout:2/58: dwrite d7/ff [0,4194304] 0 2024-09-19T09:02:29.971 INFO:tasks.workunit.client.1.smithi102.stdout:7/80: rmdir d1/d3 39 2024-09-19T09:02:29.972 INFO:tasks.workunit.client.1.smithi102.stdout:8/144: dread d0/db/d1d/f1e [0,4194304] 0 2024-09-19T09:02:29.973 INFO:tasks.workunit.client.1.smithi102.stdout:9/61: creat d1/d2/d3/f12 x:0 0 0 2024-09-19T09:02:29.973 INFO:tasks.workunit.client.1.smithi102.stdout:9/62: chown d1/de 84679542 1 2024-09-19T09:02:29.974 INFO:tasks.workunit.client.1.smithi102.stdout:9/63: write d1/d2/d3/f12 [360970,110302] 0 2024-09-19T09:02:29.979 INFO:tasks.workunit.client.1.smithi102.stdout:9/64: dread d1/d2/ff [0,4194304] 0 2024-09-19T09:02:29.983 INFO:tasks.workunit.client.1.smithi102.stdout:2/59: creat d7/f10 x:0 0 0 2024-09-19T09:02:29.986 INFO:tasks.workunit.client.1.smithi102.stdout:4/76: link fc f13 0 2024-09-19T09:02:29.989 INFO:tasks.workunit.client.1.smithi102.stdout:9/65: write d1/d2/d3/f5 [3185750,116129] 0 2024-09-19T09:02:29.990 INFO:tasks.workunit.client.1.smithi102.stdout:6/91: rename d1/d5 to d1/d18 0 2024-09-19T09:02:29.991 INFO:tasks.workunit.client.1.smithi102.stdout:2/60: dwrite f3 [0,4194304] 0 2024-09-19T09:02:29.992 INFO:tasks.workunit.client.1.smithi102.stdout:1/130: rename dd/d14/d18/f24 to dd/d14/f2b 0 2024-09-19T09:02:29.996 INFO:tasks.workunit.client.1.smithi102.stdout:7/81: creat d1/d3/f1c x:0 0 0 2024-09-19T09:02:29.996 INFO:tasks.workunit.client.1.smithi102.stdout:0/184: write d3/dd/d10/d15/d19/f26 [1136709,7822] 0 2024-09-19T09:02:29.997 INFO:tasks.workunit.client.1.smithi102.stdout:4/77: dwrite fe [0,4194304] 0 2024-09-19T09:02:30.018 INFO:tasks.workunit.client.1.smithi102.stdout:5/157: creat d5/d7/f35 x:0 0 0 2024-09-19T09:02:30.022 INFO:tasks.workunit.client.1.smithi102.stdout:9/66: creat d1/d2/d3/f13 x:0 0 0 2024-09-19T09:02:30.023 INFO:tasks.workunit.client.1.smithi102.stdout:0/185: dread d3/d8/f31 [0,4194304] 0 2024-09-19T09:02:30.024 INFO:tasks.workunit.client.1.smithi102.stdout:7/82: dread d1/f19 [0,4194304] 0 2024-09-19T09:02:30.025 INFO:tasks.workunit.client.1.smithi102.stdout:3/126: rename c0 to d2/c29 0 2024-09-19T09:02:30.027 INFO:tasks.workunit.client.1.smithi102.stdout:2/61: dwrite d7/fc [0,4194304] 0 2024-09-19T09:02:30.028 INFO:tasks.workunit.client.1.smithi102.stdout:3/127: write d2/d5/f7 [9330418,90946] 0 2024-09-19T09:02:30.028 INFO:tasks.workunit.client.1.smithi102.stdout:5/158: rmdir d5/d23 39 2024-09-19T09:02:30.030 INFO:tasks.workunit.client.1.smithi102.stdout:9/67: mknod d1/d2/c14 0 2024-09-19T09:02:30.031 INFO:tasks.workunit.client.1.smithi102.stdout:4/78: dwrite fe [0,4194304] 0 2024-09-19T09:02:30.033 INFO:tasks.workunit.client.1.smithi102.stdout:5/159: write d5/d7/d1b/f2d [1380737,103483] 0 2024-09-19T09:02:30.033 INFO:tasks.workunit.client.1.smithi102.stdout:5/160: chown d5 12256 1 2024-09-19T09:02:30.038 INFO:tasks.workunit.client.1.smithi102.stdout:2/62: mkdir d7/d11 0 2024-09-19T09:02:30.041 INFO:tasks.workunit.client.1.smithi102.stdout:3/128: rmdir d2/d1e 39 2024-09-19T09:02:30.042 INFO:tasks.workunit.client.1.smithi102.stdout:3/129: stat d2/d5/db/d26/c27 0 2024-09-19T09:02:30.045 INFO:tasks.workunit.client.1.smithi102.stdout:9/68: fdatasync d1/f6 0 2024-09-19T09:02:30.046 INFO:tasks.workunit.client.1.smithi102.stdout:9/69: write d1/d2/d3/f12 [876159,124807] 0 2024-09-19T09:02:30.046 INFO:tasks.workunit.client.1.smithi102.stdout:9/70: readlink d1/d8/lc 0 2024-09-19T09:02:30.048 INFO:tasks.workunit.client.1.smithi102.stdout:9/71: truncate d1/d2/d3/f13 588869 0 2024-09-19T09:02:30.048 INFO:tasks.workunit.client.1.smithi102.stdout:8/145: rename d0/c27 to d0/d10/c2a 0 2024-09-19T09:02:30.049 INFO:tasks.workunit.client.1.smithi102.stdout:4/79: fdatasync fe 0 2024-09-19T09:02:30.050 INFO:tasks.workunit.client.1.smithi102.stdout:9/72: write d1/d2/d3/f5 [1764577,32356] 0 2024-09-19T09:02:30.050 INFO:tasks.workunit.client.1.smithi102.stdout:4/80: truncate f11 17776 0 2024-09-19T09:02:30.051 INFO:tasks.workunit.client.1.smithi102.stdout:0/186: getdents d3/dd/d1a/d32 0 2024-09-19T09:02:30.054 INFO:tasks.workunit.client.1.smithi102.stdout:1/131: getdents dd 0 2024-09-19T09:02:30.054 INFO:tasks.workunit.client.1.smithi102.stdout:1/132: read - dd/ff zero size 2024-09-19T09:02:30.055 INFO:tasks.workunit.client.1.smithi102.stdout:3/130: unlink d2/d5/db/d26/c27 0 2024-09-19T09:02:30.060 INFO:tasks.workunit.client.1.smithi102.stdout:1/133: dwrite dd/f25 [0,4194304] 0 2024-09-19T09:02:30.063 INFO:tasks.workunit.client.1.smithi102.stdout:3/131: dwrite d2/d5/db/f1a [0,4194304] 0 2024-09-19T09:02:30.064 INFO:tasks.workunit.client.1.smithi102.stdout:5/161: rename d5/c25 to d5/d7/d1a/c36 0 2024-09-19T09:02:30.068 INFO:tasks.workunit.client.1.smithi102.stdout:4/81: mkdir d14 0 2024-09-19T09:02:30.071 INFO:tasks.workunit.client.1.smithi102.stdout:3/132: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:02:30.073 INFO:tasks.workunit.client.1.smithi102.stdout:3/133: write d2/d19/d1c/f22 [1893154,566] 0 2024-09-19T09:02:30.075 INFO:tasks.workunit.client.1.smithi102.stdout:3/134: write d2/d5/db/f1b [3727007,101470] 0 2024-09-19T09:02:30.086 INFO:tasks.workunit.client.1.smithi102.stdout:2/63: dwrite f2 [4194304,4194304] 0 2024-09-19T09:02:30.087 INFO:tasks.workunit.client.1.smithi102.stdout:7/83: getdents d1 0 2024-09-19T09:02:30.089 INFO:tasks.workunit.client.1.smithi102.stdout:4/82: rename f11 to d14/f15 0 2024-09-19T09:02:30.090 INFO:tasks.workunit.client.1.smithi102.stdout:4/83: chown cf 247322 1 2024-09-19T09:02:30.091 INFO:tasks.workunit.client.1.smithi102.stdout:0/187: getdents d3/dd/d1a/d32 0 2024-09-19T09:02:30.096 INFO:tasks.workunit.client.1.smithi102.stdout:6/92: sync 2024-09-19T09:02:30.101 INFO:tasks.workunit.client.1.smithi102.stdout:6/93: dwrite d1/fc [0,4194304] 0 2024-09-19T09:02:30.103 INFO:tasks.workunit.client.1.smithi102.stdout:8/146: unlink d0/d10/c2a 0 2024-09-19T09:02:30.109 INFO:tasks.workunit.client.1.smithi102.stdout:2/64: mkdir d7/d12 0 2024-09-19T09:02:30.109 INFO:tasks.workunit.client.1.smithi102.stdout:2/65: truncate f0 4544654 0 2024-09-19T09:02:30.113 INFO:tasks.workunit.client.1.smithi102.stdout:9/73: truncate d1/d2/d3/f5 3331600 0 2024-09-19T09:02:30.113 INFO:tasks.workunit.client.1.smithi102.stdout:9/74: stat d1/f6 0 2024-09-19T09:02:30.119 INFO:tasks.workunit.client.1.smithi102.stdout:7/84: rename d1/d4/ld to d1/d3/l1d 0 2024-09-19T09:02:30.120 INFO:tasks.workunit.client.1.smithi102.stdout:4/84: mkdir d14/d16 0 2024-09-19T09:02:30.126 INFO:tasks.workunit.client.1.smithi102.stdout:3/135: symlink d2/d1e/l2a 0 2024-09-19T09:02:30.127 INFO:tasks.workunit.client.1.smithi102.stdout:3/136: truncate d2/d5/db/f25 84355 0 2024-09-19T09:02:30.128 INFO:tasks.workunit.client.1.smithi102.stdout:3/137: stat d2/d5/l12 0 2024-09-19T09:02:30.128 INFO:tasks.workunit.client.1.smithi102.stdout:3/138: stat d2/l4 0 2024-09-19T09:02:30.129 INFO:tasks.workunit.client.1.smithi102.stdout:6/94: creat d1/d18/db/f19 x:0 0 0 2024-09-19T09:02:30.130 INFO:tasks.workunit.client.1.smithi102.stdout:5/162: dwrite d5/fe [4194304,4194304] 0 2024-09-19T09:02:30.131 INFO:tasks.workunit.client.1.smithi102.stdout:5/163: dread - d5/d7/d1a/d22/f32 zero size 2024-09-19T09:02:30.131 INFO:tasks.workunit.client.1.smithi102.stdout:8/147: symlink d0/d10/d23/l2b 0 2024-09-19T09:02:30.132 INFO:tasks.workunit.client.1.smithi102.stdout:5/164: write d5/d7/f29 [71517,78329] 0 2024-09-19T09:02:30.133 INFO:tasks.workunit.client.1.smithi102.stdout:3/139: dread d2/d19/d1c/f22 [0,4194304] 0 2024-09-19T09:02:30.134 INFO:tasks.workunit.client.1.smithi102.stdout:3/140: write d2/f1d [96586,86634] 0 2024-09-19T09:02:30.134 INFO:tasks.workunit.client.1.smithi102.stdout:1/134: creat dd/d14/f2c x:0 0 0 2024-09-19T09:02:30.138 INFO:tasks.workunit.client.1.smithi102.stdout:5/165: dwrite d5/fe [4194304,4194304] 0 2024-09-19T09:02:30.139 INFO:tasks.workunit.client.1.smithi102.stdout:5/166: chown d5/d7/d1a/d22 187002 1 2024-09-19T09:02:30.145 INFO:tasks.workunit.client.1.smithi102.stdout:4/85: dwrite d14/f15 [0,4194304] 0 2024-09-19T09:02:30.148 INFO:tasks.workunit.client.1.smithi102.stdout:1/135: write dd/d14/f27 [578868,102321] 0 2024-09-19T09:02:30.149 INFO:tasks.workunit.client.1.smithi102.stdout:3/141: symlink d2/d5/l2b 0 2024-09-19T09:02:30.150 INFO:tasks.workunit.client.1.smithi102.stdout:3/142: dread - d2/f18 zero size 2024-09-19T09:02:30.152 INFO:tasks.workunit.client.1.smithi102.stdout:4/86: dread d14/f15 [0,4194304] 0 2024-09-19T09:02:30.152 INFO:tasks.workunit.client.1.smithi102.stdout:2/66: symlink d7/d12/l13 0 2024-09-19T09:02:30.152 INFO:tasks.workunit.client.1.smithi102.stdout:4/87: write fe [2070417,102135] 0 2024-09-19T09:02:30.158 INFO:tasks.workunit.client.1.smithi102.stdout:5/167: fsync d5/d7/d1b/f1c 0 2024-09-19T09:02:30.158 INFO:tasks.workunit.client.1.smithi102.stdout:0/188: link d3/dd/d1a/l25 d3/dd/d10/d15/l3a 0 2024-09-19T09:02:30.159 INFO:tasks.workunit.client.1.smithi102.stdout:5/168: read d5/d7/d1b/f1c [1305231,61131] 0 2024-09-19T09:02:30.165 INFO:tasks.workunit.client.1.smithi102.stdout:0/189: dread d3/dd/f1f [0,4194304] 0 2024-09-19T09:02:30.166 INFO:tasks.workunit.client.1.smithi102.stdout:7/85: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:02:30.167 INFO:tasks.workunit.client.1.smithi102.stdout:7/86: fdatasync d1/d3/f1c 0 2024-09-19T09:02:30.170 INFO:tasks.workunit.client.1.smithi102.stdout:1/136: write dd/d14/d18/f29 [608513,127592] 0 2024-09-19T09:02:30.173 INFO:tasks.workunit.client.1.smithi102.stdout:2/67: unlink d7/ld 0 2024-09-19T09:02:30.173 INFO:tasks.workunit.client.1.smithi102.stdout:2/68: chown c4 47097399 1 2024-09-19T09:02:30.182 INFO:tasks.workunit.client.1.smithi102.stdout:5/169: rename d5/d7/d1a/d22 to d5/d7/d1a/d37 0 2024-09-19T09:02:30.182 INFO:tasks.workunit.client.1.smithi102.stdout:5/170: stat l2 0 2024-09-19T09:02:30.183 INFO:tasks.workunit.client.1.smithi102.stdout:5/171: chown d5/d7/d1a/d37/f32 8229 1 2024-09-19T09:02:30.186 INFO:tasks.workunit.client.1.smithi102.stdout:0/190: creat d3/dd/d10/d15/d2c/f3b x:0 0 0 2024-09-19T09:02:30.187 INFO:tasks.workunit.client.1.smithi102.stdout:7/87: rmdir d1 39 2024-09-19T09:02:30.187 INFO:tasks.workunit.client.1.smithi102.stdout:9/75: read d1/d2/d3/f5 [556248,80279] 0 2024-09-19T09:02:30.189 INFO:tasks.workunit.client.1.smithi102.stdout:3/143: unlink d2/d5/db/c15 0 2024-09-19T09:02:30.190 INFO:tasks.workunit.client.1.smithi102.stdout:1/137: mkdir dd/d13/d2d 0 2024-09-19T09:02:30.190 INFO:tasks.workunit.client.1.smithi102.stdout:4/88: getdents d14/d16 0 2024-09-19T09:02:30.195 INFO:tasks.workunit.client.1.smithi102.stdout:8/148: getdents d0 0 2024-09-19T09:02:30.197 INFO:tasks.workunit.client.1.smithi102.stdout:3/144: creat d2/d19/f2c x:0 0 0 2024-09-19T09:02:30.197 INFO:tasks.workunit.client.1.smithi102.stdout:2/69: symlink d7/d11/l14 0 2024-09-19T09:02:30.197 INFO:tasks.workunit.client.1.smithi102.stdout:1/138: fdatasync dd/d14/f27 0 2024-09-19T09:02:30.198 INFO:tasks.workunit.client.1.smithi102.stdout:9/76: write d1/d2/ff [3554573,72634] 0 2024-09-19T09:02:30.199 INFO:tasks.workunit.client.1.smithi102.stdout:8/149: mknod d0/c2c 0 2024-09-19T09:02:30.199 INFO:tasks.workunit.client.1.smithi102.stdout:2/70: chown d7/la 1 1 2024-09-19T09:02:30.201 INFO:tasks.workunit.client.1.smithi102.stdout:1/139: chown dd/d14/d18/l23 707961 1 2024-09-19T09:02:30.201 INFO:tasks.workunit.client.1.smithi102.stdout:4/89: getdents d14/d16 0 2024-09-19T09:02:30.202 INFO:tasks.workunit.client.1.smithi102.stdout:4/90: fdatasync f12 0 2024-09-19T09:02:30.204 INFO:tasks.workunit.client.1.smithi102.stdout:3/145: truncate d2/d5/db/f25 436772 0 2024-09-19T09:02:30.204 INFO:tasks.workunit.client.1.smithi102.stdout:6/95: sync 2024-09-19T09:02:30.205 INFO:tasks.workunit.client.1.smithi102.stdout:9/77: unlink d1/de/l10 0 2024-09-19T09:02:30.205 INFO:tasks.workunit.client.1.smithi102.stdout:7/88: dread d1/f14 [0,4194304] 0 2024-09-19T09:02:30.206 INFO:tasks.workunit.client.1.smithi102.stdout:3/146: fdatasync d2/f1d 0 2024-09-19T09:02:30.207 INFO:tasks.workunit.client.1.smithi102.stdout:2/71: rename l5 to d7/d11/l15 0 2024-09-19T09:02:30.207 INFO:tasks.workunit.client.1.smithi102.stdout:0/191: dwrite d3/dd/f1f [0,4194304] 0 2024-09-19T09:02:30.209 INFO:tasks.workunit.client.1.smithi102.stdout:5/172: getdents d5/d7/d1a 0 2024-09-19T09:02:30.212 INFO:tasks.workunit.client.1.smithi102.stdout:7/89: creat d1/f1e x:0 0 0 2024-09-19T09:02:30.212 INFO:tasks.workunit.client.1.smithi102.stdout:5/173: read d5/d7/d1b/f33 [209729,104674] 0 2024-09-19T09:02:30.212 INFO:tasks.workunit.client.1.smithi102.stdout:1/140: symlink dd/d13/d2d/l2e 0 2024-09-19T09:02:30.213 INFO:tasks.workunit.client.1.smithi102.stdout:3/147: dread d2/d19/f28 [0,4194304] 0 2024-09-19T09:02:30.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/141: write dd/f10 [123823,120564] 0 2024-09-19T09:02:30.221 INFO:tasks.workunit.client.1.smithi102.stdout:4/91: mkdir d14/d16/d17 0 2024-09-19T09:02:30.222 INFO:tasks.workunit.client.1.smithi102.stdout:4/92: truncate f13 255189 0 2024-09-19T09:02:30.222 INFO:tasks.workunit.client.1.smithi102.stdout:0/192: mkdir d3/d8/de/d3c 0 2024-09-19T09:02:30.230 INFO:tasks.workunit.client.1.smithi102.stdout:9/78: rename d1/d8/cb to d1/d2/d3/c15 0 2024-09-19T09:02:30.236 INFO:tasks.workunit.client.1.smithi102.stdout:4/93: symlink d14/l18 0 2024-09-19T09:02:30.238 INFO:tasks.workunit.client.1.smithi102.stdout:0/193: mkdir d3/dd/d10/d15/d22/d37/d3d 0 2024-09-19T09:02:30.242 INFO:tasks.workunit.client.1.smithi102.stdout:5/174: truncate d5/d7/f1f 2921024 0 2024-09-19T09:02:30.245 INFO:tasks.workunit.client.1.smithi102.stdout:1/142: truncate dd/d14/f27 456694 0 2024-09-19T09:02:30.247 INFO:tasks.workunit.client.1.smithi102.stdout:9/79: symlink d1/d2/d3/l16 0 2024-09-19T09:02:30.250 INFO:tasks.workunit.client.1.smithi102.stdout:6/96: link d1/d18/fa d1/d18/db/f1a 0 2024-09-19T09:02:30.251 INFO:tasks.workunit.client.1.smithi102.stdout:6/97: chown d1/ff 23 1 2024-09-19T09:02:30.251 INFO:tasks.workunit.client.1.smithi102.stdout:2/72: link d7/c8 d7/c16 0 2024-09-19T09:02:30.254 INFO:tasks.workunit.client.1.smithi102.stdout:0/194: mkdir d3/dd/d10/d15/d3e 0 2024-09-19T09:02:30.255 INFO:tasks.workunit.client.1.smithi102.stdout:2/73: dread d7/fc [0,4194304] 0 2024-09-19T09:02:30.256 INFO:tasks.workunit.client.1.smithi102.stdout:8/150: creat d0/d10/f2d x:0 0 0 2024-09-19T09:02:30.258 INFO:tasks.workunit.client.1.smithi102.stdout:3/148: creat d2/f2d x:0 0 0 2024-09-19T09:02:30.261 INFO:tasks.workunit.client.1.smithi102.stdout:5/175: mknod d5/d7/d1b/c38 0 2024-09-19T09:02:30.265 INFO:tasks.workunit.client.1.smithi102.stdout:7/90: mknod d1/d4/c1f 0 2024-09-19T09:02:30.271 INFO:tasks.workunit.client.1.smithi102.stdout:2/74: unlink d7/le 0 2024-09-19T09:02:30.271 INFO:tasks.workunit.client.1.smithi102.stdout:6/98: dwrite d1/f8 [0,4194304] 0 2024-09-19T09:02:30.275 INFO:tasks.workunit.client.1.smithi102.stdout:4/94: dwrite d14/f15 [0,4194304] 0 2024-09-19T09:02:30.275 INFO:tasks.workunit.client.1.smithi102.stdout:1/143: symlink dd/d14/l2f 0 2024-09-19T09:02:30.279 INFO:tasks.workunit.client.1.smithi102.stdout:4/95: dread fe [0,4194304] 0 2024-09-19T09:02:30.285 INFO:tasks.workunit.client.1.smithi102.stdout:2/75: read d7/f9 [383979,105676] 0 2024-09-19T09:02:30.285 INFO:tasks.workunit.client.1.smithi102.stdout:6/99: creat d1/f1b x:0 0 0 2024-09-19T09:02:30.286 INFO:tasks.workunit.client.1.smithi102.stdout:2/76: write f3 [1073130,52743] 0 2024-09-19T09:02:30.286 INFO:tasks.workunit.client.1.smithi102.stdout:8/151: fdatasync d0/db/f13 0 2024-09-19T09:02:30.292 INFO:tasks.workunit.client.1.smithi102.stdout:0/195: truncate d3/dd/ff 2544 0 2024-09-19T09:02:30.294 INFO:tasks.workunit.client.1.smithi102.stdout:7/91: unlink d1/d3/l16 0 2024-09-19T09:02:30.295 INFO:tasks.workunit.client.1.smithi102.stdout:5/176: dwrite d5/d7/d1b/f1c [0,4194304] 0 2024-09-19T09:02:30.297 INFO:tasks.workunit.client.1.smithi102.stdout:3/149: unlink d2/d5/c10 0 2024-09-19T09:02:30.299 INFO:tasks.workunit.client.1.smithi102.stdout:2/77: rename f0 to d7/d12/f17 0 2024-09-19T09:02:30.300 INFO:tasks.workunit.client.1.smithi102.stdout:8/152: creat d0/d10/d21/f2e x:0 0 0 2024-09-19T09:02:30.301 INFO:tasks.workunit.client.1.smithi102.stdout:8/153: readlink d0/d10/l18 0 2024-09-19T09:02:30.303 INFO:tasks.workunit.client.1.smithi102.stdout:1/144: mknod dd/d14/c30 0 2024-09-19T09:02:30.304 INFO:tasks.workunit.client.1.smithi102.stdout:1/145: chown f9 7391636 1 2024-09-19T09:02:30.310 INFO:tasks.workunit.client.1.smithi102.stdout:9/80: getdents d1 0 2024-09-19T09:02:30.310 INFO:tasks.workunit.client.1.smithi102.stdout:6/100: write d1/fc [4954140,95541] 0 2024-09-19T09:02:30.311 INFO:tasks.workunit.client.1.smithi102.stdout:7/92: mkdir d1/d3/d20 0 2024-09-19T09:02:30.315 INFO:tasks.workunit.client.1.smithi102.stdout:5/177: mkdir d5/d7/d1a/d37/d39 0 2024-09-19T09:02:30.315 INFO:tasks.workunit.client.1.smithi102.stdout:9/81: dread d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:30.318 INFO:tasks.workunit.client.1.smithi102.stdout:7/93: dwrite d1/f1e [0,4194304] 0 2024-09-19T09:02:30.321 INFO:tasks.workunit.client.1.smithi102.stdout:1/146: dread dd/d14/f2b [0,4194304] 0 2024-09-19T09:02:30.321 INFO:tasks.workunit.client.1.smithi102.stdout:0/196: rename d3/d8/f31 to d3/dd/d10/d15/d3e/f3f 0 2024-09-19T09:02:30.322 INFO:tasks.workunit.client.1.smithi102.stdout:4/96: truncate d14/f15 2147759 0 2024-09-19T09:02:30.323 INFO:tasks.workunit.client.1.smithi102.stdout:4/97: chown f6 1862 1 2024-09-19T09:02:30.324 INFO:tasks.workunit.client.1.smithi102.stdout:6/101: creat d1/f1c x:0 0 0 2024-09-19T09:02:30.327 INFO:tasks.workunit.client.1.smithi102.stdout:5/178: mknod d5/d7/d1b/c3a 0 2024-09-19T09:02:30.327 INFO:tasks.workunit.client.1.smithi102.stdout:9/82: dwrite d1/d2/d3/fa [0,4194304] 0 2024-09-19T09:02:30.329 INFO:tasks.workunit.client.1.smithi102.stdout:3/150: write d2/d19/d1c/f22 [2446469,85468] 0 2024-09-19T09:02:30.332 INFO:tasks.workunit.client.1.smithi102.stdout:2/78: rename d7/la to d7/d11/l18 0 2024-09-19T09:02:30.334 INFO:tasks.workunit.client.1.smithi102.stdout:2/79: chown d7/f9 119308 1 2024-09-19T09:02:30.334 INFO:tasks.workunit.client.1.smithi102.stdout:9/83: dread d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:30.334 INFO:tasks.workunit.client.1.smithi102.stdout:8/154: mknod d0/c2f 0 2024-09-19T09:02:30.338 INFO:tasks.workunit.client.1.smithi102.stdout:4/98: symlink d14/l19 0 2024-09-19T09:02:30.339 INFO:tasks.workunit.client.1.smithi102.stdout:1/147: dread dd/f12 [0,4194304] 0 2024-09-19T09:02:30.340 INFO:tasks.workunit.client.1.smithi102.stdout:1/148: write dd/d14/f2c [172869,108778] 0 2024-09-19T09:02:30.347 INFO:tasks.workunit.client.1.smithi102.stdout:6/102: rename d1/fe to d1/d18/f1d 0 2024-09-19T09:02:30.347 INFO:tasks.workunit.client.1.smithi102.stdout:2/80: rmdir d7/d11 39 2024-09-19T09:02:30.348 INFO:tasks.workunit.client.1.smithi102.stdout:6/103: chown d1/d18/db/c12 170329117 1 2024-09-19T09:02:30.351 INFO:tasks.workunit.client.1.smithi102.stdout:1/149: mkdir dd/d13/d31 0 2024-09-19T09:02:30.353 INFO:tasks.workunit.client.1.smithi102.stdout:7/94: getdents d1 0 2024-09-19T09:02:30.356 INFO:tasks.workunit.client.1.smithi102.stdout:7/95: dread d1/f5 [0,4194304] 0 2024-09-19T09:02:30.357 INFO:tasks.workunit.client.1.smithi102.stdout:7/96: chown d1/d4/c18 3050172 1 2024-09-19T09:02:30.357 INFO:tasks.workunit.client.1.smithi102.stdout:8/155: symlink d0/l30 0 2024-09-19T09:02:30.359 INFO:tasks.workunit.client.1.smithi102.stdout:5/179: dread d5/d23/f24 [0,4194304] 0 2024-09-19T09:02:30.361 INFO:tasks.workunit.client.1.smithi102.stdout:6/104: unlink d1/f8 0 2024-09-19T09:02:30.362 INFO:tasks.workunit.client.1.smithi102.stdout:7/97: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:02:30.364 INFO:tasks.workunit.client.1.smithi102.stdout:0/197: link d3/d8/de/l34 d3/dd/d1a/l40 0 2024-09-19T09:02:30.366 INFO:tasks.workunit.client.1.smithi102.stdout:3/151: write d2/d5/db/f16 [3913106,33401] 0 2024-09-19T09:02:30.366 INFO:tasks.workunit.client.1.smithi102.stdout:0/198: write d3/dd/d10/d15/d22/f2f [3522786,1257] 0 2024-09-19T09:02:30.368 INFO:tasks.workunit.client.1.smithi102.stdout:3/152: write d2/d5/db/f25 [83159,94407] 0 2024-09-19T09:02:30.369 INFO:tasks.workunit.client.1.smithi102.stdout:3/153: write d2/f18 [298207,76620] 0 2024-09-19T09:02:30.369 INFO:tasks.workunit.client.1.smithi102.stdout:2/81: symlink d7/l19 0 2024-09-19T09:02:30.370 INFO:tasks.workunit.client.1.smithi102.stdout:9/84: truncate d1/d2/d3/f5 2245089 0 2024-09-19T09:02:30.372 INFO:tasks.workunit.client.1.smithi102.stdout:4/99: fsync f13 0 2024-09-19T09:02:30.375 INFO:tasks.workunit.client.1.smithi102.stdout:8/156: write d0/db/d1d/f22 [145578,81857] 0 2024-09-19T09:02:30.376 INFO:tasks.workunit.client.1.smithi102.stdout:6/105: unlink d1/d18/fa 0 2024-09-19T09:02:30.378 INFO:tasks.workunit.client.1.smithi102.stdout:7/98: readlink d1/d3/l1d 0 2024-09-19T09:02:30.380 INFO:tasks.workunit.client.1.smithi102.stdout:6/106: chown d1/d18/db/c15 111 1 2024-09-19T09:02:30.380 INFO:tasks.workunit.client.1.smithi102.stdout:4/100: dread fd [0,4194304] 0 2024-09-19T09:02:30.381 INFO:tasks.workunit.client.1.smithi102.stdout:2/82: dwrite d7/ff [0,4194304] 0 2024-09-19T09:02:30.382 INFO:tasks.workunit.client.1.smithi102.stdout:3/154: dwrite d2/d5/db/f16 [0,4194304] 0 2024-09-19T09:02:30.384 INFO:tasks.workunit.client.1.smithi102.stdout:5/180: dread d5/d7/f1f [0,4194304] 0 2024-09-19T09:02:30.389 INFO:tasks.workunit.client.1.smithi102.stdout:2/83: chown d7/f10 7 1 2024-09-19T09:02:30.391 INFO:tasks.workunit.client.1.smithi102.stdout:6/107: write d1/d18/db/f10 [375855,33938] 0 2024-09-19T09:02:30.394 INFO:tasks.workunit.client.1.smithi102.stdout:8/157: dwrite d0/db/d1d/f22 [0,4194304] 0 2024-09-19T09:02:30.397 INFO:tasks.workunit.client.1.smithi102.stdout:7/99: creat d1/d4/f21 x:0 0 0 2024-09-19T09:02:30.397 INFO:tasks.workunit.client.1.smithi102.stdout:1/150: truncate dd/d14/d18/f1f 3207452 0 2024-09-19T09:02:30.399 INFO:tasks.workunit.client.1.smithi102.stdout:0/199: dwrite f2 [0,4194304] 0 2024-09-19T09:02:30.401 INFO:tasks.workunit.client.1.smithi102.stdout:4/101: symlink d14/l1a 0 2024-09-19T09:02:30.401 INFO:tasks.workunit.client.1.smithi102.stdout:5/181: dwrite d5/fe [0,4194304] 0 2024-09-19T09:02:30.402 INFO:tasks.workunit.client.1.smithi102.stdout:0/200: fdatasync d3/dd/d10/d15/f36 0 2024-09-19T09:02:30.403 INFO:tasks.workunit.client.1.smithi102.stdout:9/85: write d1/f6 [849394,54670] 0 2024-09-19T09:02:30.403 INFO:tasks.workunit.client.1.smithi102.stdout:0/201: truncate d3/f14 4407019 0 2024-09-19T09:02:30.411 INFO:tasks.workunit.client.1.smithi102.stdout:7/100: unlink d1/f7 0 2024-09-19T09:02:30.415 INFO:tasks.workunit.client.1.smithi102.stdout:4/102: symlink d14/l1b 0 2024-09-19T09:02:30.415 INFO:tasks.workunit.client.1.smithi102.stdout:8/158: dread d0/d10/d21/f25 [0,4194304] 0 2024-09-19T09:02:30.415 INFO:tasks.workunit.client.1.smithi102.stdout:5/182: mkdir d5/d23/d3b 0 2024-09-19T09:02:30.416 INFO:tasks.workunit.client.1.smithi102.stdout:9/86: symlink d1/d2/l17 0 2024-09-19T09:02:30.417 INFO:tasks.workunit.client.1.smithi102.stdout:2/84: mkdir d7/d1a 0 2024-09-19T09:02:30.421 INFO:tasks.workunit.client.1.smithi102.stdout:6/108: link d1/d18/db/c15 d1/d18/db/c1e 0 2024-09-19T09:02:30.423 INFO:tasks.workunit.client.1.smithi102.stdout:9/87: dwrite d1/d2/d3/f12 [0,4194304] 0 2024-09-19T09:02:30.424 INFO:tasks.workunit.client.1.smithi102.stdout:2/85: symlink d7/d1a/l1b 0 2024-09-19T09:02:30.424 INFO:tasks.workunit.client.1.smithi102.stdout:9/88: read d1/d2/d3/f13 [141309,101989] 0 2024-09-19T09:02:30.425 INFO:tasks.workunit.client.1.smithi102.stdout:4/103: getdents d14/d16 0 2024-09-19T09:02:30.426 INFO:tasks.workunit.client.1.smithi102.stdout:4/104: write f12 [745197,48512] 0 2024-09-19T09:02:30.427 INFO:tasks.workunit.client.1.smithi102.stdout:2/86: creat d7/d11/f1c x:0 0 0 2024-09-19T09:02:30.428 INFO:tasks.workunit.client.1.smithi102.stdout:3/155: dread d2/d5/fa [0,4194304] 0 2024-09-19T09:02:30.429 INFO:tasks.workunit.client.1.smithi102.stdout:4/105: rmdir d14/d16 39 2024-09-19T09:02:30.430 INFO:tasks.workunit.client.1.smithi102.stdout:3/156: chown d2/d19/f2c 760045479 1 2024-09-19T09:02:30.430 INFO:tasks.workunit.client.1.smithi102.stdout:4/106: chown d14/l19 28985 1 2024-09-19T09:02:30.434 INFO:tasks.workunit.client.1.smithi102.stdout:3/157: creat d2/d5/db/f2e x:0 0 0 2024-09-19T09:02:30.434 INFO:tasks.workunit.client.1.smithi102.stdout:4/107: rmdir d14/d16 39 2024-09-19T09:02:30.438 INFO:tasks.workunit.client.1.smithi102.stdout:4/108: fsync fc 0 2024-09-19T09:02:30.440 INFO:tasks.workunit.client.1.smithi102.stdout:2/87: dwrite d7/ff [0,4194304] 0 2024-09-19T09:02:30.441 INFO:tasks.workunit.client.1.smithi102.stdout:9/89: dwrite d1/d2/d3/f13 [0,4194304] 0 2024-09-19T09:02:30.443 INFO:tasks.workunit.client.1.smithi102.stdout:3/158: dread d2/f18 [0,4194304] 0 2024-09-19T09:02:30.443 INFO:tasks.workunit.client.1.smithi102.stdout:3/159: readlink d2/l23 0 2024-09-19T09:02:30.447 INFO:tasks.workunit.client.1.smithi102.stdout:9/90: mknod d1/d2/d3/c18 0 2024-09-19T09:02:30.447 INFO:tasks.workunit.client.1.smithi102.stdout:3/160: mkdir d2/d19/d1c/d2f 0 2024-09-19T09:02:30.454 INFO:tasks.workunit.client.1.smithi102.stdout:3/161: mknod d2/d19/d1c/d2f/c30 0 2024-09-19T09:02:30.455 INFO:tasks.workunit.client.1.smithi102.stdout:9/91: dwrite d1/d2/d3/f12 [0,4194304] 0 2024-09-19T09:02:30.455 INFO:tasks.workunit.client.1.smithi102.stdout:3/162: chown d2/d19/d1c/d2f/c30 161604154 1 2024-09-19T09:02:30.457 INFO:tasks.workunit.client.1.smithi102.stdout:9/92: creat d1/de/f19 x:0 0 0 2024-09-19T09:02:30.458 INFO:tasks.workunit.client.1.smithi102.stdout:7/101: stat d1/d4/f1a 0 2024-09-19T09:02:30.460 INFO:tasks.workunit.client.1.smithi102.stdout:9/93: rmdir d1/d2 39 2024-09-19T09:02:30.460 INFO:tasks.workunit.client.1.smithi102.stdout:4/109: fdatasync f12 0 2024-09-19T09:02:30.467 INFO:tasks.workunit.client.1.smithi102.stdout:5/183: write d5/d7/ff [590172,98703] 0 2024-09-19T09:02:30.468 INFO:tasks.workunit.client.1.smithi102.stdout:5/184: write d5/d23/f26 [2608124,10354] 0 2024-09-19T09:02:30.473 INFO:tasks.workunit.client.1.smithi102.stdout:5/185: rmdir d5/d7/d1a/d37 39 2024-09-19T09:02:30.474 INFO:tasks.workunit.client.1.smithi102.stdout:4/110: link d14/f15 d14/d16/d17/f1c 0 2024-09-19T09:02:30.476 INFO:tasks.workunit.client.1.smithi102.stdout:6/109: creat d1/d18/db/f1f x:0 0 0 2024-09-19T09:02:30.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/94: getdents d1 0 2024-09-19T09:02:30.480 INFO:tasks.workunit.client.1.smithi102.stdout:9/95: chown d1/d2/ff 1 1 2024-09-19T09:02:30.481 INFO:tasks.workunit.client.1.smithi102.stdout:3/163: truncate d2/d5/db/f1a 2639453 0 2024-09-19T09:02:30.482 INFO:tasks.workunit.client.1.smithi102.stdout:2/88: dwrite d7/fc [0,4194304] 0 2024-09-19T09:02:30.482 INFO:tasks.workunit.client.1.smithi102.stdout:9/96: read d1/d2/d3/f12 [1523729,54370] 0 2024-09-19T09:02:30.482 INFO:tasks.workunit.client.1.smithi102.stdout:6/110: mknod d1/d18/db/c20 0 2024-09-19T09:02:30.483 INFO:tasks.workunit.client.1.smithi102.stdout:9/97: chown d1/d2/d3/f12 2 1 2024-09-19T09:02:30.484 INFO:tasks.workunit.client.1.smithi102.stdout:4/111: getdents d14 0 2024-09-19T09:02:30.484 INFO:tasks.workunit.client.1.smithi102.stdout:6/111: read d1/ff [702969,11695] 0 2024-09-19T09:02:30.485 INFO:tasks.workunit.client.1.smithi102.stdout:7/102: truncate d1/f1e 3382238 0 2024-09-19T09:02:30.486 INFO:tasks.workunit.client.1.smithi102.stdout:2/89: rmdir d7/d12 39 2024-09-19T09:02:30.491 INFO:tasks.workunit.client.1.smithi102.stdout:4/112: write f6 [2663065,63104] 0 2024-09-19T09:02:30.492 INFO:tasks.workunit.client.1.smithi102.stdout:6/112: symlink d1/d18/l21 0 2024-09-19T09:02:30.493 INFO:tasks.workunit.client.1.smithi102.stdout:2/90: creat d7/d11/f1d x:0 0 0 2024-09-19T09:02:30.494 INFO:tasks.workunit.client.1.smithi102.stdout:6/113: fsync d1/fc 0 2024-09-19T09:02:30.495 INFO:tasks.workunit.client.1.smithi102.stdout:9/98: dwrite d1/d2/d3/fa [4194304,4194304] 0 2024-09-19T09:02:30.499 INFO:tasks.workunit.client.1.smithi102.stdout:3/164: getdents d2/d1e 0 2024-09-19T09:02:30.502 INFO:tasks.workunit.client.1.smithi102.stdout:4/113: mkdir d14/d16/d1d 0 2024-09-19T09:02:30.503 INFO:tasks.workunit.client.1.smithi102.stdout:7/103: mknod d1/d3/d20/c22 0 2024-09-19T09:02:30.504 INFO:tasks.workunit.client.1.smithi102.stdout:2/91: creat d7/d11/f1e x:0 0 0 2024-09-19T09:02:30.507 INFO:tasks.workunit.client.1.smithi102.stdout:9/99: symlink d1/de/l1a 0 2024-09-19T09:02:30.509 INFO:tasks.workunit.client.1.smithi102.stdout:3/165: rename d2/d5/db/f16 to d2/d19/d1c/f31 0 2024-09-19T09:02:30.510 INFO:tasks.workunit.client.1.smithi102.stdout:4/114: creat d14/d16/f1e x:0 0 0 2024-09-19T09:02:30.511 INFO:tasks.workunit.client.1.smithi102.stdout:2/92: dwrite d7/d11/f1e [0,4194304] 0 2024-09-19T09:02:30.513 INFO:tasks.workunit.client.1.smithi102.stdout:2/93: chown d7/d11/f1c 3 1 2024-09-19T09:02:30.515 INFO:tasks.workunit.client.1.smithi102.stdout:3/166: mkdir d2/d19/d1c/d2f/d32 0 2024-09-19T09:02:30.517 INFO:tasks.workunit.client.1.smithi102.stdout:3/167: write d2/d19/f2c [471798,21761] 0 2024-09-19T09:02:30.518 INFO:tasks.workunit.client.1.smithi102.stdout:4/115: rename f6 to d14/d16/d17/f1f 0 2024-09-19T09:02:30.519 INFO:tasks.workunit.client.1.smithi102.stdout:4/116: dread - d14/d16/f1e zero size 2024-09-19T09:02:30.520 INFO:tasks.workunit.client.1.smithi102.stdout:2/94: dwrite d7/d11/f1e [0,4194304] 0 2024-09-19T09:02:30.525 INFO:tasks.workunit.client.1.smithi102.stdout:6/114: getdents d1 0 2024-09-19T09:02:30.532 INFO:tasks.workunit.client.1.smithi102.stdout:2/95: mknod d7/d1a/c1f 0 2024-09-19T09:02:30.535 INFO:tasks.workunit.client.1.smithi102.stdout:7/104: link d1/c8 d1/d3/d20/c23 0 2024-09-19T09:02:30.536 INFO:tasks.workunit.client.1.smithi102.stdout:2/96: creat d7/d1a/f20 x:0 0 0 2024-09-19T09:02:30.536 INFO:tasks.workunit.client.1.smithi102.stdout:7/105: stat d1/d3/d20 0 2024-09-19T09:02:30.536 INFO:tasks.workunit.client.1.smithi102.stdout:6/115: mkdir d1/d18/db/d22 0 2024-09-19T09:02:30.538 INFO:tasks.workunit.client.1.smithi102.stdout:3/168: rename d2/d19/d1c/f22 to d2/f33 0 2024-09-19T09:02:30.539 INFO:tasks.workunit.client.1.smithi102.stdout:7/106: symlink d1/d3/l24 0 2024-09-19T09:02:30.539 INFO:tasks.workunit.client.1.smithi102.stdout:3/169: write d2/d19/f2c [60881,2617] 0 2024-09-19T09:02:30.541 INFO:tasks.workunit.client.1.smithi102.stdout:6/116: creat d1/d18/f23 x:0 0 0 2024-09-19T09:02:30.541 INFO:tasks.workunit.client.1.smithi102.stdout:4/117: dread d14/d16/d17/f1f [0,4194304] 0 2024-09-19T09:02:30.542 INFO:tasks.workunit.client.1.smithi102.stdout:3/170: chown d2/d5/db/f1a 90003 1 2024-09-19T09:02:30.543 INFO:tasks.workunit.client.1.smithi102.stdout:7/107: mkdir d1/d4/df/d25 0 2024-09-19T09:02:30.543 INFO:tasks.workunit.client.1.smithi102.stdout:3/171: chown d2/d5/fa 653420557 1 2024-09-19T09:02:30.543 INFO:tasks.workunit.client.1.smithi102.stdout:3/172: fsync d2/f9 0 2024-09-19T09:02:30.544 INFO:tasks.workunit.client.1.smithi102.stdout:3/173: stat d2/d19/f2c 0 2024-09-19T09:02:30.545 INFO:tasks.workunit.client.1.smithi102.stdout:3/174: write d2/d5/db/f2e [369287,37596] 0 2024-09-19T09:02:30.547 INFO:tasks.workunit.client.1.smithi102.stdout:4/118: creat d14/d16/d1d/f20 x:0 0 0 2024-09-19T09:02:30.548 INFO:tasks.workunit.client.1.smithi102.stdout:4/119: stat d14/d16/f1e 0 2024-09-19T09:02:30.551 INFO:tasks.workunit.client.1.smithi102.stdout:4/120: symlink d14/d16/d17/l21 0 2024-09-19T09:02:30.552 INFO:tasks.workunit.client.1.smithi102.stdout:4/121: write d14/d16/f1e [215749,1238] 0 2024-09-19T09:02:30.556 INFO:tasks.workunit.client.1.smithi102.stdout:4/122: dread f12 [0,4194304] 0 2024-09-19T09:02:30.557 INFO:tasks.workunit.client.1.smithi102.stdout:4/123: dread f13 [0,4194304] 0 2024-09-19T09:02:30.561 INFO:tasks.workunit.client.1.smithi102.stdout:7/108: write d1/f5 [1935093,110542] 0 2024-09-19T09:02:30.563 INFO:tasks.workunit.client.1.smithi102.stdout:4/124: rmdir d14/d16 39 2024-09-19T09:02:30.563 INFO:tasks.workunit.client.1.smithi102.stdout:6/117: dwrite d1/d18/db/f1a [0,4194304] 0 2024-09-19T09:02:30.567 INFO:tasks.workunit.client.1.smithi102.stdout:7/109: creat d1/d4/df/d25/f26 x:0 0 0 2024-09-19T09:02:30.567 INFO:tasks.workunit.client.1.smithi102.stdout:6/118: creat d1/d18/f24 x:0 0 0 2024-09-19T09:02:30.570 INFO:tasks.workunit.client.1.smithi102.stdout:6/119: creat d1/d18/f25 x:0 0 0 2024-09-19T09:02:30.570 INFO:tasks.workunit.client.1.smithi102.stdout:4/125: mknod d14/d16/d17/c22 0 2024-09-19T09:02:30.570 INFO:tasks.workunit.client.1.smithi102.stdout:4/126: read f13 [38202,77607] 0 2024-09-19T09:02:30.572 INFO:tasks.workunit.client.1.smithi102.stdout:7/110: rename d1/d3/l1d to d1/d4/df/l27 0 2024-09-19T09:02:30.573 INFO:tasks.workunit.client.1.smithi102.stdout:6/120: mkdir d1/d26 0 2024-09-19T09:02:30.574 INFO:tasks.workunit.client.1.smithi102.stdout:7/111: dread - d1/d4/df/d25/f26 zero size 2024-09-19T09:02:30.574 INFO:tasks.workunit.client.1.smithi102.stdout:6/121: fsync d1/f1b 0 2024-09-19T09:02:30.576 INFO:tasks.workunit.client.1.smithi102.stdout:7/112: dread - d1/d4/df/d25/f26 zero size 2024-09-19T09:02:30.578 INFO:tasks.workunit.client.1.smithi102.stdout:4/127: dwrite f13 [0,4194304] 0 2024-09-19T09:02:30.578 INFO:tasks.workunit.client.1.smithi102.stdout:7/113: dread - d1/d4/f1a zero size 2024-09-19T09:02:30.578 INFO:tasks.workunit.client.1.smithi102.stdout:4/128: readlink lb 0 2024-09-19T09:02:30.579 INFO:tasks.workunit.client.1.smithi102.stdout:7/114: dread - d1/d4/f1a zero size 2024-09-19T09:02:30.583 INFO:tasks.workunit.client.1.smithi102.stdout:4/129: mknod d14/c23 0 2024-09-19T09:02:30.587 INFO:tasks.workunit.client.1.smithi102.stdout:7/115: unlink d1/f19 0 2024-09-19T09:02:30.589 INFO:tasks.workunit.client.1.smithi102.stdout:6/122: link d1/d18/db/c12 d1/d18/db/c27 0 2024-09-19T09:02:30.594 INFO:tasks.workunit.client.1.smithi102.stdout:6/123: read d1/d18/db/f10 [343104,112611] 0 2024-09-19T09:02:30.598 INFO:tasks.workunit.client.1.smithi102.stdout:1/151: sync 2024-09-19T09:02:30.599 INFO:tasks.workunit.client.1.smithi102.stdout:1/152: stat dd/f25 0 2024-09-19T09:02:30.599 INFO:tasks.workunit.client.1.smithi102.stdout:6/124: chown d1/d18/c14 474241532 1 2024-09-19T09:02:30.599 INFO:tasks.workunit.client.1.smithi102.stdout:4/130: write fe [786411,11692] 0 2024-09-19T09:02:30.601 INFO:tasks.workunit.client.1.smithi102.stdout:7/116: write d1/f1e [1989005,74178] 0 2024-09-19T09:02:30.602 INFO:tasks.workunit.client.1.smithi102.stdout:4/131: chown d14/l1a 4847 1 2024-09-19T09:02:30.603 INFO:tasks.workunit.client.1.smithi102.stdout:6/125: mknod d1/d26/c28 0 2024-09-19T09:02:30.605 INFO:tasks.workunit.client.1.smithi102.stdout:4/132: mkdir d14/d16/d17/d24 0 2024-09-19T09:02:30.606 INFO:tasks.workunit.client.1.smithi102.stdout:6/126: dread d1/d18/db/f1a [0,4194304] 0 2024-09-19T09:02:30.607 INFO:tasks.workunit.client.1.smithi102.stdout:1/153: getdents dd 0 2024-09-19T09:02:30.608 INFO:tasks.workunit.client.1.smithi102.stdout:4/133: write d14/d16/d17/f1f [1435746,64865] 0 2024-09-19T09:02:30.611 INFO:tasks.workunit.client.1.smithi102.stdout:4/134: mkdir d14/d16/d17/d25 0 2024-09-19T09:02:30.611 INFO:tasks.workunit.client.1.smithi102.stdout:7/117: link d1/d4/c10 d1/d4/c28 0 2024-09-19T09:02:30.614 INFO:tasks.workunit.client.1.smithi102.stdout:7/118: mknod d1/d4/c29 0 2024-09-19T09:02:30.616 INFO:tasks.workunit.client.1.smithi102.stdout:7/119: chown d1/d4/f1b 15 1 2024-09-19T09:02:30.616 INFO:tasks.workunit.client.1.smithi102.stdout:1/154: rename dd/d13/l17 to dd/d14/l32 0 2024-09-19T09:02:30.617 INFO:tasks.workunit.client.1.smithi102.stdout:4/135: fdatasync d14/f15 0 2024-09-19T09:02:30.622 INFO:tasks.workunit.client.1.smithi102.stdout:4/136: creat d14/d16/f26 x:0 0 0 2024-09-19T09:02:30.623 INFO:tasks.workunit.client.1.smithi102.stdout:1/155: fdatasync dd/d14/f26 0 2024-09-19T09:02:30.623 INFO:tasks.workunit.client.1.smithi102.stdout:1/156: write dd/f16 [1416564,125591] 0 2024-09-19T09:02:30.624 INFO:tasks.workunit.client.1.smithi102.stdout:7/120: creat d1/f2a x:0 0 0 2024-09-19T09:02:30.626 INFO:tasks.workunit.client.1.smithi102.stdout:4/137: symlink d14/d16/d1d/l27 0 2024-09-19T09:02:30.627 INFO:tasks.workunit.client.1.smithi102.stdout:1/157: write f4 [5759471,38064] 0 2024-09-19T09:02:30.629 INFO:tasks.workunit.client.1.smithi102.stdout:1/158: fsync f4 0 2024-09-19T09:02:30.632 INFO:tasks.workunit.client.1.smithi102.stdout:1/159: mknod dd/d13/d2d/c33 0 2024-09-19T09:02:30.633 INFO:tasks.workunit.client.1.smithi102.stdout:4/138: dwrite d14/d16/d17/f1f [0,4194304] 0 2024-09-19T09:02:30.633 INFO:tasks.workunit.client.1.smithi102.stdout:7/121: dread d1/d3/f9 [0,4194304] 0 2024-09-19T09:02:30.634 INFO:tasks.workunit.client.1.smithi102.stdout:4/139: write d14/d16/f26 [358017,90352] 0 2024-09-19T09:02:30.637 INFO:tasks.workunit.client.1.smithi102.stdout:1/160: rename c3 to dd/d13/d2d/c34 0 2024-09-19T09:02:30.639 INFO:tasks.workunit.client.1.smithi102.stdout:7/122: symlink d1/l2b 0 2024-09-19T09:02:30.639 INFO:tasks.workunit.client.1.smithi102.stdout:7/123: stat d1/d3 0 2024-09-19T09:02:30.640 INFO:tasks.workunit.client.1.smithi102.stdout:1/161: rmdir dd/d14/d18 39 2024-09-19T09:02:30.642 INFO:tasks.workunit.client.1.smithi102.stdout:4/140: dread d14/d16/d17/f1f [0,4194304] 0 2024-09-19T09:02:30.643 INFO:tasks.workunit.client.1.smithi102.stdout:1/162: truncate dd/f11 524196 0 2024-09-19T09:02:30.644 INFO:tasks.workunit.client.1.smithi102.stdout:7/124: getdents d1/d4 0 2024-09-19T09:02:30.646 INFO:tasks.workunit.client.1.smithi102.stdout:7/125: chown d1/d3/d20/c23 229929 1 2024-09-19T09:02:30.648 INFO:tasks.workunit.client.1.smithi102.stdout:4/141: dwrite fc [0,4194304] 0 2024-09-19T09:02:30.648 INFO:tasks.workunit.client.1.smithi102.stdout:7/126: creat d1/d3/d20/f2c x:0 0 0 2024-09-19T09:02:30.650 INFO:tasks.workunit.client.1.smithi102.stdout:7/127: mkdir d1/d2d 0 2024-09-19T09:02:30.651 INFO:tasks.workunit.client.1.smithi102.stdout:4/142: creat d14/d16/d17/d24/f28 x:0 0 0 2024-09-19T09:02:30.652 INFO:tasks.workunit.client.1.smithi102.stdout:7/128: read - d1/d4/f1b zero size 2024-09-19T09:02:30.656 INFO:tasks.workunit.client.1.smithi102.stdout:4/143: rename d14/d16/d17/l21 to d14/d16/d17/d25/l29 0 2024-09-19T09:02:30.658 INFO:tasks.workunit.client.1.smithi102.stdout:4/144: creat d14/d16/f2a x:0 0 0 2024-09-19T09:02:30.658 INFO:tasks.workunit.client.1.smithi102.stdout:4/145: dread - d14/d16/d1d/f20 zero size 2024-09-19T09:02:30.662 INFO:tasks.workunit.client.1.smithi102.stdout:1/163: truncate f0 2290474 0 2024-09-19T09:02:30.664 INFO:tasks.workunit.client.1.smithi102.stdout:1/164: stat dd/d14/l32 0 2024-09-19T09:02:30.664 INFO:tasks.workunit.client.1.smithi102.stdout:1/165: readlink l8 0 2024-09-19T09:02:30.671 INFO:tasks.workunit.client.1.smithi102.stdout:1/166: dwrite dd/d14/d18/f29 [0,4194304] 0 2024-09-19T09:02:30.672 INFO:tasks.workunit.client.1.smithi102.stdout:1/167: write dd/f10 [1904646,107253] 0 2024-09-19T09:02:30.673 INFO:tasks.workunit.client.1.smithi102.stdout:1/168: chown dd/d14/f26 6216425 1 2024-09-19T09:02:30.673 INFO:tasks.workunit.client.1.smithi102.stdout:1/169: fdatasync f4 0 2024-09-19T09:02:30.680 INFO:tasks.workunit.client.1.smithi102.stdout:1/170: dwrite dd/f16 [4194304,4194304] 0 2024-09-19T09:02:30.683 INFO:tasks.workunit.client.1.smithi102.stdout:1/171: truncate dd/d14/d18/f29 4609374 0 2024-09-19T09:02:30.690 INFO:tasks.workunit.client.1.smithi102.stdout:1/172: dwrite dd/d14/f2b [0,4194304] 0 2024-09-19T09:02:30.696 INFO:tasks.workunit.client.1.smithi102.stdout:1/173: rename dd/d13/d31 to dd/d14/d35 0 2024-09-19T09:02:30.697 INFO:tasks.workunit.client.1.smithi102.stdout:1/174: read dd/f11 [121293,5738] 0 2024-09-19T09:02:30.716 INFO:tasks.workunit.client.1.smithi102.stdout:1/175: write f0 [379357,115276] 0 2024-09-19T09:02:30.718 INFO:tasks.workunit.client.1.smithi102.stdout:1/176: creat dd/d13/f36 x:0 0 0 2024-09-19T09:02:30.720 INFO:tasks.workunit.client.1.smithi102.stdout:1/177: creat dd/d14/d18/f37 x:0 0 0 2024-09-19T09:02:30.724 INFO:tasks.workunit.client.1.smithi102.stdout:1/178: dread f9 [0,4194304] 0 2024-09-19T09:02:30.765 INFO:tasks.workunit.client.1.smithi102.stdout:1/179: truncate f6 1400681 0 2024-09-19T09:02:30.765 INFO:tasks.workunit.client.1.smithi102.stdout:1/180: readlink dd/d14/l20 0 2024-09-19T09:02:30.765 INFO:tasks.workunit.client.1.smithi102.stdout:1/181: symlink dd/d13/d2d/l38 0 2024-09-19T09:02:30.767 INFO:tasks.workunit.client.1.smithi102.stdout:1/182: creat dd/d13/d2d/f39 x:0 0 0 2024-09-19T09:02:30.787 INFO:tasks.workunit.client.1.smithi102.stdout:1/183: link f6 dd/d14/f3a 0 2024-09-19T09:02:30.791 INFO:tasks.workunit.client.1.smithi102.stdout:1/184: mkdir dd/d13/d3b 0 2024-09-19T09:02:30.792 INFO:tasks.workunit.client.1.smithi102.stdout:1/185: creat dd/d13/d2d/f3c x:0 0 0 2024-09-19T09:02:30.792 INFO:tasks.workunit.client.1.smithi102.stdout:1/186: dread - dd/d14/f2a zero size 2024-09-19T09:02:30.795 INFO:tasks.workunit.client.1.smithi102.stdout:1/187: rename dd/l15 to dd/d14/l3d 0 2024-09-19T09:02:30.798 INFO:tasks.workunit.client.1.smithi102.stdout:1/188: mknod dd/d14/c3e 0 2024-09-19T09:02:30.799 INFO:tasks.workunit.client.1.smithi102.stdout:1/189: creat dd/d14/d18/f3f x:0 0 0 2024-09-19T09:02:30.805 INFO:tasks.workunit.client.1.smithi102.stdout:1/190: dwrite dd/d13/f36 [0,4194304] 0 2024-09-19T09:02:30.809 INFO:tasks.workunit.client.1.smithi102.stdout:1/191: link dd/d14/d18/f37 dd/d14/d18/f40 0 2024-09-19T09:02:30.812 INFO:tasks.workunit.client.1.smithi102.stdout:1/192: creat dd/d13/d3b/f41 x:0 0 0 2024-09-19T09:02:30.814 INFO:tasks.workunit.client.1.smithi102.stdout:0/202: sync 2024-09-19T09:02:30.814 INFO:tasks.workunit.client.1.smithi102.stdout:8/159: sync 2024-09-19T09:02:30.814 INFO:tasks.workunit.client.1.smithi102.stdout:5/186: sync 2024-09-19T09:02:30.815 INFO:tasks.workunit.client.1.smithi102.stdout:8/160: write d0/d10/f2d [701385,44468] 0 2024-09-19T09:02:30.816 INFO:tasks.workunit.client.1.smithi102.stdout:5/187: write d5/d7/f29 [1103419,128589] 0 2024-09-19T09:02:30.822 INFO:tasks.workunit.client.1.smithi102.stdout:5/188: creat d5/d7/d1a/d37/d39/f3c x:0 0 0 2024-09-19T09:02:30.825 INFO:tasks.workunit.client.1.smithi102.stdout:8/161: dwrite d0/d10/d21/f24 [0,4194304] 0 2024-09-19T09:02:30.829 INFO:tasks.workunit.client.1.smithi102.stdout:8/162: creat d0/db/d1d/f31 x:0 0 0 2024-09-19T09:02:30.832 INFO:tasks.workunit.client.1.smithi102.stdout:5/189: symlink d5/l3d 0 2024-09-19T09:02:30.833 INFO:tasks.workunit.client.1.smithi102.stdout:1/193: dread fc [0,4194304] 0 2024-09-19T09:02:30.833 INFO:tasks.workunit.client.1.smithi102.stdout:5/190: chown d5/d7/l10 108 1 2024-09-19T09:02:30.834 INFO:tasks.workunit.client.1.smithi102.stdout:0/203: dwrite d3/f7 [4194304,4194304] 0 2024-09-19T09:02:30.836 INFO:tasks.workunit.client.1.smithi102.stdout:1/194: symlink dd/d13/d2d/l42 0 2024-09-19T09:02:30.837 INFO:tasks.workunit.client.1.smithi102.stdout:1/195: chown dd/d14/c30 12242392 1 2024-09-19T09:02:30.837 INFO:tasks.workunit.client.1.smithi102.stdout:5/191: rmdir d5/d7/d1a/d37 39 2024-09-19T09:02:30.840 INFO:tasks.workunit.client.1.smithi102.stdout:0/204: symlink d3/dd/d10/d15/d19/l41 0 2024-09-19T09:02:30.845 INFO:tasks.workunit.client.1.smithi102.stdout:1/196: dwrite dd/f16 [4194304,4194304] 0 2024-09-19T09:02:30.846 INFO:tasks.workunit.client.1.smithi102.stdout:5/192: dwrite d5/d7/d1a/f2a [0,4194304] 0 2024-09-19T09:02:30.855 INFO:tasks.workunit.client.1.smithi102.stdout:8/163: dread d0/d10/f28 [0,4194304] 0 2024-09-19T09:02:30.856 INFO:tasks.workunit.client.1.smithi102.stdout:5/193: dwrite d5/d7/d1a/f2a [0,4194304] 0 2024-09-19T09:02:30.860 INFO:tasks.workunit.client.1.smithi102.stdout:1/197: unlink dd/d14/f3a 0 2024-09-19T09:02:30.868 INFO:tasks.workunit.client.1.smithi102.stdout:1/198: mkdir dd/d13/d2d/d43 0 2024-09-19T09:02:30.870 INFO:tasks.workunit.client.1.smithi102.stdout:5/194: dwrite d5/d7/d1a/d37/f2b [0,4194304] 0 2024-09-19T09:02:30.877 INFO:tasks.workunit.client.1.smithi102.stdout:1/199: dread dd/d14/f27 [0,4194304] 0 2024-09-19T09:02:30.877 INFO:tasks.workunit.client.1.smithi102.stdout:9/100: sync 2024-09-19T09:02:30.879 INFO:tasks.workunit.client.1.smithi102.stdout:5/195: unlink d5/c12 0 2024-09-19T09:02:30.883 INFO:tasks.workunit.client.1.smithi102.stdout:8/164: getdents d0/db 0 2024-09-19T09:02:30.888 INFO:tasks.workunit.client.1.smithi102.stdout:9/101: mknod d1/d2/d3/c1b 0 2024-09-19T09:02:30.891 INFO:tasks.workunit.client.1.smithi102.stdout:1/200: symlink dd/d13/d2d/d43/l44 0 2024-09-19T09:02:30.893 INFO:tasks.workunit.client.1.smithi102.stdout:9/102: rename d1/de to d1/d8/d1c 0 2024-09-19T09:02:30.896 INFO:tasks.workunit.client.1.smithi102.stdout:5/196: mknod d5/d7/d1a/c3e 0 2024-09-19T09:02:30.897 INFO:tasks.workunit.client.1.smithi102.stdout:5/197: write d5/d7/d1a/d37/d39/f3c [707333,76989] 0 2024-09-19T09:02:30.898 INFO:tasks.workunit.client.1.smithi102.stdout:1/201: mknod dd/d13/d3b/c45 0 2024-09-19T09:02:30.899 INFO:tasks.workunit.client.1.smithi102.stdout:1/202: write f0 [1230331,51385] 0 2024-09-19T09:02:30.899 INFO:tasks.workunit.client.1.smithi102.stdout:1/203: chown dd/d14/f2b 1 1 2024-09-19T09:02:30.900 INFO:tasks.workunit.client.1.smithi102.stdout:1/204: readlink dd/d14/d18/l23 0 2024-09-19T09:02:30.910 INFO:tasks.workunit.client.1.smithi102.stdout:1/205: rename c7 to dd/d13/d3b/c46 0 2024-09-19T09:02:30.911 INFO:tasks.workunit.client.1.smithi102.stdout:8/165: getdents d0/d10/d23 0 2024-09-19T09:02:30.918 INFO:tasks.workunit.client.1.smithi102.stdout:9/103: dread d1/d2/d3/f13 [0,4194304] 0 2024-09-19T09:02:30.923 INFO:tasks.workunit.client.1.smithi102.stdout:5/198: truncate d5/d7/d1b/f33 2040077 0 2024-09-19T09:02:30.923 INFO:tasks.workunit.client.1.smithi102.stdout:9/104: mkdir d1/d2/d3/d1d 0 2024-09-19T09:02:30.924 INFO:tasks.workunit.client.1.smithi102.stdout:5/199: write d5/d7/d1a/d37/f32 [236793,91760] 0 2024-09-19T09:02:30.925 INFO:tasks.workunit.client.1.smithi102.stdout:8/166: write d0/d10/d21/f25 [29745,66736] 0 2024-09-19T09:02:30.927 INFO:tasks.workunit.client.1.smithi102.stdout:9/105: chown d1/d8/lc 59 1 2024-09-19T09:02:30.927 INFO:tasks.workunit.client.1.smithi102.stdout:5/200: rmdir d5/d7/d1b 39 2024-09-19T09:02:30.928 INFO:tasks.workunit.client.1.smithi102.stdout:1/206: dread dd/d14/d18/f1f [0,4194304] 0 2024-09-19T09:02:30.929 INFO:tasks.workunit.client.1.smithi102.stdout:5/201: fdatasync d5/d7/d1a/d37/f32 0 2024-09-19T09:02:30.930 INFO:tasks.workunit.client.1.smithi102.stdout:9/106: mknod d1/d8/c1e 0 2024-09-19T09:02:30.930 INFO:tasks.workunit.client.1.smithi102.stdout:1/207: write dd/d13/f36 [651453,27732] 0 2024-09-19T09:02:30.933 INFO:tasks.workunit.client.1.smithi102.stdout:8/167: dwrite d0/d10/d21/f24 [0,4194304] 0 2024-09-19T09:02:30.936 INFO:tasks.workunit.client.1.smithi102.stdout:1/208: dread fc [0,4194304] 0 2024-09-19T09:02:30.936 INFO:tasks.workunit.client.1.smithi102.stdout:9/107: symlink d1/d2/d3/l1f 0 2024-09-19T09:02:30.937 INFO:tasks.workunit.client.1.smithi102.stdout:8/168: rmdir d0 39 2024-09-19T09:02:30.942 INFO:tasks.workunit.client.1.smithi102.stdout:5/202: dwrite d5/d7/d1b/f2d [4194304,4194304] 0 2024-09-19T09:02:30.946 INFO:tasks.workunit.client.1.smithi102.stdout:8/169: write d0/d10/f28 [3289334,22748] 0 2024-09-19T09:02:30.946 INFO:tasks.workunit.client.1.smithi102.stdout:5/203: symlink d5/d7/d1b/l3f 0 2024-09-19T09:02:30.947 INFO:tasks.workunit.client.1.smithi102.stdout:3/175: sync 2024-09-19T09:02:30.948 INFO:tasks.workunit.client.1.smithi102.stdout:9/108: creat d1/d2/d3/d1d/f20 x:0 0 0 2024-09-19T09:02:30.950 INFO:tasks.workunit.client.1.smithi102.stdout:8/170: symlink d0/db/l32 0 2024-09-19T09:02:30.950 INFO:tasks.workunit.client.1.smithi102.stdout:2/97: sync 2024-09-19T09:02:30.951 INFO:tasks.workunit.client.1.smithi102.stdout:8/171: write d0/db/d1d/f31 [780393,119904] 0 2024-09-19T09:02:30.951 INFO:tasks.workunit.client.1.smithi102.stdout:2/98: write d7/d1a/f20 [797134,118400] 0 2024-09-19T09:02:30.953 INFO:tasks.workunit.client.1.smithi102.stdout:9/109: creat d1/d8/d1c/f21 x:0 0 0 2024-09-19T09:02:30.954 INFO:tasks.workunit.client.1.smithi102.stdout:1/209: getdents dd 0 2024-09-19T09:02:30.958 INFO:tasks.workunit.client.1.smithi102.stdout:3/176: creat d2/f34 x:0 0 0 2024-09-19T09:02:30.959 INFO:tasks.workunit.client.1.smithi102.stdout:9/110: dwrite d1/d2/d3/fa [0,4194304] 0 2024-09-19T09:02:30.960 INFO:tasks.workunit.client.1.smithi102.stdout:2/99: unlink d7/d11/l15 0 2024-09-19T09:02:30.960 INFO:tasks.workunit.client.1.smithi102.stdout:9/111: dread - d1/d2/d3/d1d/f20 zero size 2024-09-19T09:02:30.963 INFO:tasks.workunit.client.1.smithi102.stdout:3/177: rename d2/d19/d1c/d2f/d32 to d2/d19/d35 0 2024-09-19T09:02:30.970 INFO:tasks.workunit.client.1.smithi102.stdout:9/112: creat d1/d2/f22 x:0 0 0 2024-09-19T09:02:30.972 INFO:tasks.workunit.client.1.smithi102.stdout:3/178: write d2/f18 [709072,11812] 0 2024-09-19T09:02:30.974 INFO:tasks.workunit.client.1.smithi102.stdout:1/210: link dd/d14/d18/f1f dd/d13/f47 0 2024-09-19T09:02:30.977 INFO:tasks.workunit.client.1.smithi102.stdout:5/204: fdatasync d5/d7/d1b/f33 0 2024-09-19T09:02:30.979 INFO:tasks.workunit.client.1.smithi102.stdout:3/179: mkdir d2/d19/d35/d36 0 2024-09-19T09:02:30.981 INFO:tasks.workunit.client.1.smithi102.stdout:9/113: rename d1/d2/d3/c15 to d1/d8/d1c/c23 0 2024-09-19T09:02:30.983 INFO:tasks.workunit.client.1.smithi102.stdout:9/114: write d1/d8/d1c/f21 [117254,47347] 0 2024-09-19T09:02:30.984 INFO:tasks.workunit.client.1.smithi102.stdout:5/205: dwrite d5/d7/d1a/d37/f2b [0,4194304] 0 2024-09-19T09:02:30.986 INFO:tasks.workunit.client.1.smithi102.stdout:5/206: write d5/d23/f26 [4054142,31398] 0 2024-09-19T09:02:30.987 INFO:tasks.workunit.client.1.smithi102.stdout:2/100: write f3 [4837881,63695] 0 2024-09-19T09:02:30.989 INFO:tasks.workunit.client.1.smithi102.stdout:3/180: dwrite d2/d19/f2c [0,4194304] 0 2024-09-19T09:02:30.989 INFO:tasks.workunit.client.1.smithi102.stdout:5/207: stat d5/d7/d1a/c36 0 2024-09-19T09:02:30.993 INFO:tasks.workunit.client.1.smithi102.stdout:3/181: creat d2/d19/d1c/f37 x:0 0 0 2024-09-19T09:02:30.994 INFO:tasks.workunit.client.1.smithi102.stdout:3/182: write d2/f34 [847204,40177] 0 2024-09-19T09:02:30.995 INFO:tasks.workunit.client.1.smithi102.stdout:5/208: creat d5/d7/d1a/d37/d39/f40 x:0 0 0 2024-09-19T09:02:30.996 INFO:tasks.workunit.client.1.smithi102.stdout:5/209: write d5/d7/ff [563261,22560] 0 2024-09-19T09:02:30.999 INFO:tasks.workunit.client.1.smithi102.stdout:3/183: dread d2/d19/f2c [0,4194304] 0 2024-09-19T09:02:31.002 INFO:tasks.workunit.client.1.smithi102.stdout:9/115: rmdir d1/d8/d1c 39 2024-09-19T09:02:31.003 INFO:tasks.workunit.client.1.smithi102.stdout:5/210: creat d5/d7/d1b/f41 x:0 0 0 2024-09-19T09:02:31.007 INFO:tasks.workunit.client.1.smithi102.stdout:9/116: write d1/d8/d1c/f21 [485338,57194] 0 2024-09-19T09:02:31.008 INFO:tasks.workunit.client.1.smithi102.stdout:5/211: readlink d5/l11 0 2024-09-19T09:02:31.010 INFO:tasks.workunit.client.1.smithi102.stdout:3/184: dwrite d2/d19/f2c [0,4194304] 0 2024-09-19T09:02:31.013 INFO:tasks.workunit.client.1.smithi102.stdout:5/212: unlink d5/d7/d1a/f2a 0 2024-09-19T09:02:31.014 INFO:tasks.workunit.client.1.smithi102.stdout:5/213: dread - d5/d7/d1b/f41 zero size 2024-09-19T09:02:31.015 INFO:tasks.workunit.client.1.smithi102.stdout:9/117: dread d1/d2/d3/f12 [0,4194304] 0 2024-09-19T09:02:31.015 INFO:tasks.workunit.client.1.smithi102.stdout:3/185: dread d2/d19/f2c [0,4194304] 0 2024-09-19T09:02:31.015 INFO:tasks.workunit.client.1.smithi102.stdout:9/118: fsync d1/d2/d3/fa 0 2024-09-19T09:02:31.016 INFO:tasks.workunit.client.1.smithi102.stdout:3/186: write d2/f34 [120350,42631] 0 2024-09-19T09:02:31.020 INFO:tasks.workunit.client.1.smithi102.stdout:6/127: sync 2024-09-19T09:02:31.020 INFO:tasks.workunit.client.1.smithi102.stdout:0/205: sync 2024-09-19T09:02:31.020 INFO:tasks.workunit.client.1.smithi102.stdout:7/129: sync 2024-09-19T09:02:31.020 INFO:tasks.workunit.client.1.smithi102.stdout:4/146: sync 2024-09-19T09:02:31.021 INFO:tasks.workunit.client.1.smithi102.stdout:7/130: stat d1/d3 0 2024-09-19T09:02:31.022 INFO:tasks.workunit.client.1.smithi102.stdout:0/206: read d3/f7 [5618702,83771] 0 2024-09-19T09:02:31.022 INFO:tasks.workunit.client.1.smithi102.stdout:4/147: write fc [3348314,103255] 0 2024-09-19T09:02:31.022 INFO:tasks.workunit.client.1.smithi102.stdout:6/128: truncate d1/f1c 482607 0 2024-09-19T09:02:31.022 INFO:tasks.workunit.client.1.smithi102.stdout:3/187: creat d2/d1e/f38 x:0 0 0 2024-09-19T09:02:31.025 INFO:tasks.workunit.client.1.smithi102.stdout:9/119: dwrite d1/d2/f22 [0,4194304] 0 2024-09-19T09:02:31.026 INFO:tasks.workunit.client.1.smithi102.stdout:6/129: dread d1/f1c [0,4194304] 0 2024-09-19T09:02:31.027 INFO:tasks.workunit.client.1.smithi102.stdout:9/120: dread - d1/d8/d1c/f19 zero size 2024-09-19T09:02:31.027 INFO:tasks.workunit.client.1.smithi102.stdout:6/130: chown d1/ff 1808863 1 2024-09-19T09:02:31.029 INFO:tasks.workunit.client.1.smithi102.stdout:3/188: chown d2/d5/f7 319434729 1 2024-09-19T09:02:31.031 INFO:tasks.workunit.client.1.smithi102.stdout:7/131: creat d1/d4/df/d25/f2e x:0 0 0 2024-09-19T09:02:31.032 INFO:tasks.workunit.client.1.smithi102.stdout:7/132: write d1/d4/df/d25/f2e [762328,80311] 0 2024-09-19T09:02:31.032 INFO:tasks.workunit.client.1.smithi102.stdout:9/121: dread d1/d8/d1c/f21 [0,4194304] 0 2024-09-19T09:02:31.033 INFO:tasks.workunit.client.1.smithi102.stdout:7/133: chown d1/d4/c1f 1 1 2024-09-19T09:02:31.034 INFO:tasks.workunit.client.1.smithi102.stdout:7/134: dread - d1/d4/f1a zero size 2024-09-19T09:02:31.034 INFO:tasks.workunit.client.1.smithi102.stdout:4/148: mkdir d14/d16/d17/d25/d2b 0 2024-09-19T09:02:31.035 INFO:tasks.workunit.client.1.smithi102.stdout:5/214: rmdir d5/d7 39 2024-09-19T09:02:31.038 INFO:tasks.workunit.client.1.smithi102.stdout:6/131: write d1/d18/db/fd [258442,100051] 0 2024-09-19T09:02:31.041 INFO:tasks.workunit.client.1.smithi102.stdout:3/189: mkdir d2/d19/d1c/d2f/d39 0 2024-09-19T09:02:31.043 INFO:tasks.workunit.client.1.smithi102.stdout:0/207: rename d3/dd/d1a/c27 to d3/dd/d1a/c42 0 2024-09-19T09:02:31.043 INFO:tasks.workunit.client.1.smithi102.stdout:0/208: chown d3/dd/d10/d15/d22/d37 53354037 1 2024-09-19T09:02:31.044 INFO:tasks.workunit.client.1.smithi102.stdout:0/209: chown d3/dd/d1a/l40 405 1 2024-09-19T09:02:31.044 INFO:tasks.workunit.client.1.smithi102.stdout:9/122: fsync d1/d2/d3/f12 0 2024-09-19T09:02:31.047 INFO:tasks.workunit.client.1.smithi102.stdout:7/135: dread d1/f14 [0,4194304] 0 2024-09-19T09:02:31.048 INFO:tasks.workunit.client.1.smithi102.stdout:7/136: read - d1/d4/f1b zero size 2024-09-19T09:02:31.049 INFO:tasks.workunit.client.1.smithi102.stdout:7/137: write d1/d3/f1c [222175,52914] 0 2024-09-19T09:02:31.050 INFO:tasks.workunit.client.1.smithi102.stdout:5/215: chown d5/d7/d1b/f1c 163 1 2024-09-19T09:02:31.052 INFO:tasks.workunit.client.1.smithi102.stdout:6/132: symlink d1/d18/l29 0 2024-09-19T09:02:31.052 INFO:tasks.workunit.client.1.smithi102.stdout:6/133: fsync d1/f1b 0 2024-09-19T09:02:31.055 INFO:tasks.workunit.client.1.smithi102.stdout:3/190: chown d2/d5/c11 0 1 2024-09-19T09:02:31.057 INFO:tasks.workunit.client.1.smithi102.stdout:0/210: dread d3/dd/d10/d15/f36 [0,4194304] 0 2024-09-19T09:02:31.058 INFO:tasks.workunit.client.1.smithi102.stdout:9/123: rmdir d1/d2/d3 39 2024-09-19T09:02:31.058 INFO:tasks.workunit.client.1.smithi102.stdout:9/124: stat d1/d2/l17 0 2024-09-19T09:02:31.060 INFO:tasks.workunit.client.1.smithi102.stdout:4/149: symlink d14/d16/d17/d25/d2b/l2c 0 2024-09-19T09:02:31.062 INFO:tasks.workunit.client.1.smithi102.stdout:7/138: write d1/f14 [1797416,8142] 0 2024-09-19T09:02:31.067 INFO:tasks.workunit.client.1.smithi102.stdout:6/134: mknod d1/d26/c2a 0 2024-09-19T09:02:31.067 INFO:tasks.workunit.client.1.smithi102.stdout:7/139: dwrite d1/d3/f1c [0,4194304] 0 2024-09-19T09:02:31.068 INFO:tasks.workunit.client.1.smithi102.stdout:3/191: creat d2/d5/db/d26/f3a x:0 0 0 2024-09-19T09:02:31.068 INFO:tasks.workunit.client.1.smithi102.stdout:7/140: dread - d1/d4/f21 zero size 2024-09-19T09:02:31.069 INFO:tasks.workunit.client.1.smithi102.stdout:0/211: rmdir d3/dd/d10/d15/d3e 39 2024-09-19T09:02:31.073 INFO:tasks.workunit.client.1.smithi102.stdout:8/172: sync 2024-09-19T09:02:31.073 INFO:tasks.workunit.client.1.smithi102.stdout:4/150: symlink d14/d16/l2d 0 2024-09-19T09:02:31.074 INFO:tasks.workunit.client.1.smithi102.stdout:8/173: dread - d0/d10/d21/f2e zero size 2024-09-19T09:02:31.075 INFO:tasks.workunit.client.1.smithi102.stdout:8/174: fdatasync d0/d10/d21/f2e 0 2024-09-19T09:02:31.075 INFO:tasks.workunit.client.1.smithi102.stdout:7/141: dwrite d1/d4/fc [0,4194304] 0 2024-09-19T09:02:31.076 INFO:tasks.workunit.client.1.smithi102.stdout:8/175: write d0/d10/f2d [707396,80930] 0 2024-09-19T09:02:31.077 INFO:tasks.workunit.client.1.smithi102.stdout:8/176: chown d0/c2c 3 1 2024-09-19T09:02:31.079 INFO:tasks.workunit.client.1.smithi102.stdout:8/177: write d0/fd [760555,60328] 0 2024-09-19T09:02:31.079 INFO:tasks.workunit.client.1.smithi102.stdout:3/192: creat d2/d1e/f3b x:0 0 0 2024-09-19T09:02:31.080 INFO:tasks.workunit.client.1.smithi102.stdout:8/178: chown d0/d10/d23 4932739 1 2024-09-19T09:02:31.080 INFO:tasks.workunit.client.1.smithi102.stdout:5/216: write d5/d7/f1f [1328455,59824] 0 2024-09-19T09:02:31.081 INFO:tasks.workunit.client.1.smithi102.stdout:0/212: creat d3/d8/f43 x:0 0 0 2024-09-19T09:02:31.084 INFO:tasks.workunit.client.1.smithi102.stdout:0/213: write d3/d8/f43 [476311,105775] 0 2024-09-19T09:02:31.085 INFO:tasks.workunit.client.1.smithi102.stdout:3/193: dread d2/f34 [0,4194304] 0 2024-09-19T09:02:31.085 INFO:tasks.workunit.client.1.smithi102.stdout:6/135: symlink d1/d18/db/l2b 0 2024-09-19T09:02:31.086 INFO:tasks.workunit.client.1.smithi102.stdout:0/214: fsync d3/dd/d10/d15/f36 0 2024-09-19T09:02:31.088 INFO:tasks.workunit.client.1.smithi102.stdout:0/215: fdatasync d3/dd/d10/f38 0 2024-09-19T09:02:31.089 INFO:tasks.workunit.client.1.smithi102.stdout:5/217: fsync d5/d23/f24 0 2024-09-19T09:02:31.091 INFO:tasks.workunit.client.1.smithi102.stdout:8/179: dwrite d0/db/d1d/f22 [0,4194304] 0 2024-09-19T09:02:31.091 INFO:tasks.workunit.client.1.smithi102.stdout:3/194: dread d2/d5/db/f25 [0,4194304] 0 2024-09-19T09:02:31.092 INFO:tasks.workunit.client.1.smithi102.stdout:7/142: mkdir d1/d2f 0 2024-09-19T09:02:31.092 INFO:tasks.workunit.client.1.smithi102.stdout:8/180: chown d0/db/d1d/f31 471308206 1 2024-09-19T09:02:31.093 INFO:tasks.workunit.client.1.smithi102.stdout:7/143: chown d1/d4/c29 449 1 2024-09-19T09:02:31.097 INFO:tasks.workunit.client.1.smithi102.stdout:3/195: creat d2/d5/db/f3c x:0 0 0 2024-09-19T09:02:31.098 INFO:tasks.workunit.client.1.smithi102.stdout:7/144: dread d1/d4/f6 [0,4194304] 0 2024-09-19T09:02:31.098 INFO:tasks.workunit.client.1.smithi102.stdout:7/145: read d1/d4/f6 [933519,73731] 0 2024-09-19T09:02:31.102 INFO:tasks.workunit.client.1.smithi102.stdout:0/216: fsync d3/dd/ff 0 2024-09-19T09:02:31.103 INFO:tasks.workunit.client.1.smithi102.stdout:5/218: mkdir d5/d7/d1a/d42 0 2024-09-19T09:02:31.106 INFO:tasks.workunit.client.1.smithi102.stdout:3/196: creat d2/d1e/f3d x:0 0 0 2024-09-19T09:02:31.107 INFO:tasks.workunit.client.1.smithi102.stdout:7/146: symlink d1/d4/df/d25/l30 0 2024-09-19T09:02:31.109 INFO:tasks.workunit.client.1.smithi102.stdout:0/217: dwrite d3/dd/d10/f38 [0,4194304] 0 2024-09-19T09:02:31.109 INFO:tasks.workunit.client.1.smithi102.stdout:0/218: stat d3/d8/c1e 0 2024-09-19T09:02:31.122 INFO:tasks.workunit.client.1.smithi102.stdout:7/147: symlink d1/l31 0 2024-09-19T09:02:31.123 INFO:tasks.workunit.client.1.smithi102.stdout:7/148: stat d1/d2d 0 2024-09-19T09:02:31.123 INFO:tasks.workunit.client.1.smithi102.stdout:0/219: mkdir d3/dd/d10/d15/d22/d37/d39/d44 0 2024-09-19T09:02:31.125 INFO:tasks.workunit.client.1.smithi102.stdout:4/151: truncate fe 3557946 0 2024-09-19T09:02:31.126 INFO:tasks.workunit.client.1.smithi102.stdout:0/220: chown d3/dd/d10/d15/d19/l41 1 1 2024-09-19T09:02:31.131 INFO:tasks.workunit.client.1.smithi102.stdout:5/219: getdents d5/d7/d1a 0 2024-09-19T09:02:31.132 INFO:tasks.workunit.client.1.smithi102.stdout:0/221: mkdir d3/dd/d10/d15/d3e/d45 0 2024-09-19T09:02:31.134 INFO:tasks.workunit.client.1.smithi102.stdout:9/125: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:31.136 INFO:tasks.workunit.client.1.smithi102.stdout:5/220: fsync d5/d23/f26 0 2024-09-19T09:02:31.137 INFO:tasks.workunit.client.1.smithi102.stdout:8/181: truncate d0/d10/d21/f24 2210078 0 2024-09-19T09:02:31.138 INFO:tasks.workunit.client.1.smithi102.stdout:3/197: truncate d2/f33 3556643 0 2024-09-19T09:02:31.139 INFO:tasks.workunit.client.1.smithi102.stdout:1/211: sync 2024-09-19T09:02:31.140 INFO:tasks.workunit.client.1.smithi102.stdout:2/101: sync 2024-09-19T09:02:31.145 INFO:tasks.workunit.client.1.smithi102.stdout:5/221: dread - d5/d7/f35 zero size 2024-09-19T09:02:31.148 INFO:tasks.workunit.client.1.smithi102.stdout:2/102: unlink d7/d11/f1d 0 2024-09-19T09:02:31.150 INFO:tasks.workunit.client.1.smithi102.stdout:7/149: dwrite d1/d3/d20/f2c [0,4194304] 0 2024-09-19T09:02:31.150 INFO:tasks.workunit.client.1.smithi102.stdout:8/182: unlink d0/lf 0 2024-09-19T09:02:31.151 INFO:tasks.workunit.client.1.smithi102.stdout:6/136: dwrite d1/d18/db/f10 [0,4194304] 0 2024-09-19T09:02:31.151 INFO:tasks.workunit.client.1.smithi102.stdout:4/152: dwrite fc [0,4194304] 0 2024-09-19T09:02:31.159 INFO:tasks.workunit.client.1.smithi102.stdout:1/212: truncate dd/d13/d2d/f3c 885006 0 2024-09-19T09:02:31.159 INFO:tasks.workunit.client.1.smithi102.stdout:6/137: chown d1/d18/db/d22 7994 1 2024-09-19T09:02:31.163 INFO:tasks.workunit.client.1.smithi102.stdout:7/150: write d1/f1e [2770405,63187] 0 2024-09-19T09:02:31.166 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:30 smithi049 ceph-mon[28158]: pgmap v22: 65 pgs: 65 active+clean; 277 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 426 op/s 2024-09-19T09:02:31.166 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:30 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:31.166 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:30 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:31.166 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:30 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:02:31.166 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:30 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:31.168 INFO:tasks.workunit.client.1.smithi102.stdout:1/213: chown dd/d14/l3d 1704 1 2024-09-19T09:02:31.173 INFO:tasks.workunit.client.1.smithi102.stdout:7/151: stat d1/d3/d20/c23 0 2024-09-19T09:02:31.174 INFO:tasks.workunit.client.1.smithi102.stdout:2/103: link d7/d11/l14 d7/l21 0 2024-09-19T09:02:31.174 INFO:tasks.workunit.client.1.smithi102.stdout:0/222: dwrite d3/f14 [0,4194304] 0 2024-09-19T09:02:31.175 INFO:tasks.workunit.client.1.smithi102.stdout:3/198: dwrite d2/d1e/f3d [0,4194304] 0 2024-09-19T09:02:31.176 INFO:tasks.workunit.client.1.smithi102.stdout:9/126: dwrite d1/d8/d1c/f19 [0,4194304] 0 2024-09-19T09:02:31.182 INFO:tasks.workunit.client.1.smithi102.stdout:5/222: dwrite d5/d7/d1a/d37/f32 [0,4194304] 0 2024-09-19T09:02:31.183 INFO:tasks.workunit.client.1.smithi102.stdout:7/152: dread - d1/d4/f21 zero size 2024-09-19T09:02:31.183 INFO:tasks.workunit.client.1.smithi102.stdout:4/153: getdents d14/d16/d17/d25 0 2024-09-19T09:02:31.184 INFO:tasks.workunit.client.1.smithi102.stdout:9/127: fdatasync d1/d2/f22 0 2024-09-19T09:02:31.189 INFO:tasks.workunit.client.1.smithi102.stdout:8/183: dwrite d0/d10/d21/f25 [0,4194304] 0 2024-09-19T09:02:31.190 INFO:tasks.workunit.client.1.smithi102.stdout:5/223: stat d5/d7/d1a/l20 0 2024-09-19T09:02:31.191 INFO:tasks.workunit.client.1.smithi102.stdout:0/223: truncate d3/dd/d10/d15/d2c/f3b 1026193 0 2024-09-19T09:02:31.191 INFO:tasks.workunit.client.1.smithi102.stdout:9/128: rmdir d1/d8 39 2024-09-19T09:02:31.192 INFO:tasks.workunit.client.1.smithi102.stdout:2/104: link d7/f9 d7/d1a/f22 0 2024-09-19T09:02:31.193 INFO:tasks.workunit.client.1.smithi102.stdout:6/138: dread d1/d18/db/f1a [0,4194304] 0 2024-09-19T09:02:31.195 INFO:tasks.workunit.client.1.smithi102.stdout:3/199: getdents d2/d19 0 2024-09-19T09:02:31.195 INFO:tasks.workunit.client.1.smithi102.stdout:4/154: truncate d14/d16/d17/d24/f28 189831 0 2024-09-19T09:02:31.196 INFO:tasks.workunit.client.1.smithi102.stdout:0/224: fdatasync d3/dd/d10/d15/d19/f26 0 2024-09-19T09:02:31.199 INFO:tasks.workunit.client.1.smithi102.stdout:2/105: read d7/ff [3620363,128491] 0 2024-09-19T09:02:31.200 INFO:tasks.workunit.client.1.smithi102.stdout:5/224: chown d5/d7/d1a/d37/l28 1011 1 2024-09-19T09:02:31.201 INFO:tasks.workunit.client.1.smithi102.stdout:8/184: dread d0/d10/f2d [0,4194304] 0 2024-09-19T09:02:31.202 INFO:tasks.workunit.client.1.smithi102.stdout:1/214: dread dd/d13/f47 [0,4194304] 0 2024-09-19T09:02:31.203 INFO:tasks.workunit.client.1.smithi102.stdout:4/155: dread - d14/d16/f2a zero size 2024-09-19T09:02:31.205 INFO:tasks.workunit.client.1.smithi102.stdout:2/106: write d7/d11/f1e [4972807,107683] 0 2024-09-19T09:02:31.207 INFO:tasks.workunit.client.1.smithi102.stdout:3/200: mknod d2/d19/d1c/d1f/c3e 0 2024-09-19T09:02:31.207 INFO:tasks.workunit.client.1.smithi102.stdout:0/225: truncate d3/f7 2410589 0 2024-09-19T09:02:31.207 INFO:tasks.workunit.client.1.smithi102.stdout:4/156: chown d14/d16/d17/d25/d2b 180 1 2024-09-19T09:02:31.211 INFO:tasks.workunit.client.1.smithi102.stdout:7/153: dwrite d1/f2a [0,4194304] 0 2024-09-19T09:02:31.211 INFO:tasks.workunit.client.1.smithi102.stdout:3/201: readlink d2/d1e/l21 0 2024-09-19T09:02:31.213 INFO:tasks.workunit.client.1.smithi102.stdout:7/154: write d1/d4/df/d25/f26 [946366,69880] 0 2024-09-19T09:02:31.214 INFO:tasks.workunit.client.1.smithi102.stdout:4/157: mkdir d14/d16/d17/d2e 0 2024-09-19T09:02:31.215 INFO:tasks.workunit.client.1.smithi102.stdout:7/155: dread - d1/d4/f1b zero size 2024-09-19T09:02:31.215 INFO:tasks.workunit.client.1.smithi102.stdout:1/215: dwrite dd/f1d [0,4194304] 0 2024-09-19T09:02:31.216 INFO:tasks.workunit.client.1.smithi102.stdout:2/107: mknod d7/c23 0 2024-09-19T09:02:31.216 INFO:tasks.workunit.client.1.smithi102.stdout:3/202: dread d2/d5/db/f2e [0,4194304] 0 2024-09-19T09:02:31.217 INFO:tasks.workunit.client.1.smithi102.stdout:4/158: truncate d14/d16/f26 1316943 0 2024-09-19T09:02:31.219 INFO:tasks.workunit.client.1.smithi102.stdout:0/226: creat d3/dd/d10/d15/d19/f46 x:0 0 0 2024-09-19T09:02:31.224 INFO:tasks.workunit.client.1.smithi102.stdout:2/108: creat d7/d11/f24 x:0 0 0 2024-09-19T09:02:31.224 INFO:tasks.workunit.client.1.smithi102.stdout:4/159: dread d14/d16/d17/f1c [0,4194304] 0 2024-09-19T09:02:31.225 INFO:tasks.workunit.client.1.smithi102.stdout:3/203: symlink d2/d19/d35/l3f 0 2024-09-19T09:02:31.227 INFO:tasks.workunit.client.1.smithi102.stdout:3/204: chown d2/d1e/l21 237 1 2024-09-19T09:02:31.227 INFO:tasks.workunit.client.1.smithi102.stdout:0/227: dread d3/dd/d10/d15/d3e/f3f [0,4194304] 0 2024-09-19T09:02:31.227 INFO:tasks.workunit.client.1.smithi102.stdout:1/216: dwrite dd/d14/f2a [0,4194304] 0 2024-09-19T09:02:31.232 INFO:tasks.workunit.client.1.smithi102.stdout:2/109: mknod d7/d11/c25 0 2024-09-19T09:02:31.234 INFO:tasks.workunit.client.1.smithi102.stdout:4/160: mkdir d14/d16/d17/d25/d2f 0 2024-09-19T09:02:31.236 INFO:tasks.workunit.client.1.smithi102.stdout:0/228: mknod d3/c47 0 2024-09-19T09:02:31.239 INFO:tasks.workunit.client.1.smithi102.stdout:9/129: truncate d1/f6 219688 0 2024-09-19T09:02:31.241 INFO:tasks.workunit.client.1.smithi102.stdout:3/205: dwrite d2/f18 [0,4194304] 0 2024-09-19T09:02:31.244 INFO:tasks.workunit.client.1.smithi102.stdout:0/229: dread d3/dd/d10/d15/f36 [0,4194304] 0 2024-09-19T09:02:31.246 INFO:tasks.workunit.client.1.smithi102.stdout:9/130: write d1/d2/d3/fa [4213240,125722] 0 2024-09-19T09:02:31.249 INFO:tasks.workunit.client.1.smithi102.stdout:4/161: rename d14/d16/d1d/l27 to d14/d16/d17/d2e/l30 0 2024-09-19T09:02:31.255 INFO:tasks.workunit.client.1.smithi102.stdout:8/185: dwrite d0/d10/d21/f24 [0,4194304] 0 2024-09-19T09:02:31.262 INFO:tasks.workunit.client.1.smithi102.stdout:4/162: creat d14/d16/d17/d25/d2b/f31 x:0 0 0 2024-09-19T09:02:31.262 INFO:tasks.workunit.client.1.smithi102.stdout:3/206: mknod d2/d5/c40 0 2024-09-19T09:02:31.262 INFO:tasks.workunit.client.1.smithi102.stdout:4/163: dread f12 [0,4194304] 0 2024-09-19T09:02:31.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:30 smithi102 ceph-mon[35280]: pgmap v22: 65 pgs: 65 active+clean; 277 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 426 op/s 2024-09-19T09:02:31.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:30 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:31.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:30 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:31.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:30 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:02:31.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:30 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:31.263 INFO:tasks.workunit.client.1.smithi102.stdout:9/131: symlink d1/d8/d1c/l24 0 2024-09-19T09:02:31.267 INFO:tasks.workunit.client.1.smithi102.stdout:0/230: getdents d3/dd/d10/d15/d19 0 2024-09-19T09:02:31.267 INFO:tasks.workunit.client.1.smithi102.stdout:3/207: dwrite d2/d5/f7 [8388608,4194304] 0 2024-09-19T09:02:31.270 INFO:tasks.workunit.client.1.smithi102.stdout:1/217: write dd/d14/f27 [743282,47341] 0 2024-09-19T09:02:31.271 INFO:tasks.workunit.client.1.smithi102.stdout:4/164: creat d14/f32 x:0 0 0 2024-09-19T09:02:31.272 INFO:tasks.workunit.client.1.smithi102.stdout:7/156: dwrite d1/f5 [0,4194304] 0 2024-09-19T09:02:31.275 INFO:tasks.workunit.client.1.smithi102.stdout:0/231: dread f2 [0,4194304] 0 2024-09-19T09:02:31.278 INFO:tasks.workunit.client.1.smithi102.stdout:8/186: getdents d0/d10 0 2024-09-19T09:02:31.283 INFO:tasks.workunit.client.1.smithi102.stdout:1/218: dwrite dd/d14/d18/f29 [0,4194304] 0 2024-09-19T09:02:31.284 INFO:tasks.workunit.client.1.smithi102.stdout:7/157: dwrite d1/f5 [0,4194304] 0 2024-09-19T09:02:31.285 INFO:tasks.workunit.client.1.smithi102.stdout:9/132: creat d1/d2/f25 x:0 0 0 2024-09-19T09:02:31.286 INFO:tasks.workunit.client.1.smithi102.stdout:8/187: dread d0/d10/d21/f25 [0,4194304] 0 2024-09-19T09:02:31.286 INFO:tasks.workunit.client.1.smithi102.stdout:9/133: rename d1/d8 to d1/d8/d1c/d26 22 2024-09-19T09:02:31.287 INFO:tasks.workunit.client.1.smithi102.stdout:9/134: chown d1/d8 7908 1 2024-09-19T09:02:31.290 INFO:tasks.workunit.client.1.smithi102.stdout:2/110: truncate d7/d12/f17 3476611 0 2024-09-19T09:02:31.292 INFO:tasks.workunit.client.1.smithi102.stdout:0/232: write d3/dd/d10/d15/d3e/f3f [1316442,86398] 0 2024-09-19T09:02:31.302 INFO:tasks.workunit.client.1.smithi102.stdout:9/135: mknod d1/d8/d1c/c27 0 2024-09-19T09:02:31.302 INFO:tasks.workunit.client.1.smithi102.stdout:1/219: creat dd/d14/d35/f48 x:0 0 0 2024-09-19T09:02:31.302 INFO:tasks.workunit.client.1.smithi102.stdout:8/188: rename d0/d10/f28 to d0/db/d1d/f33 0 2024-09-19T09:02:31.309 INFO:tasks.workunit.client.1.smithi102.stdout:2/111: chown d7/d12/f17 36398182 1 2024-09-19T09:02:31.313 INFO:tasks.workunit.client.1.smithi102.stdout:1/220: rename dd/d13/d2d/d43 to dd/d14/d35/d49 0 2024-09-19T09:02:31.313 INFO:tasks.workunit.client.1.smithi102.stdout:1/221: fdatasync dd/f25 0 2024-09-19T09:02:31.315 INFO:tasks.workunit.client.1.smithi102.stdout:3/208: getdents d2/d5 0 2024-09-19T09:02:31.317 INFO:tasks.workunit.client.1.smithi102.stdout:2/112: stat d7/d1a/f22 0 2024-09-19T09:02:31.319 INFO:tasks.workunit.client.1.smithi102.stdout:3/209: truncate d2/d5/db/f3c 457436 0 2024-09-19T09:02:31.320 INFO:tasks.workunit.client.1.smithi102.stdout:0/233: rmdir d3/d8/de/d3c 0 2024-09-19T09:02:31.322 INFO:tasks.workunit.client.1.smithi102.stdout:0/234: chown d3/d8/de/l16 33006 1 2024-09-19T09:02:31.323 INFO:tasks.workunit.client.1.smithi102.stdout:1/222: dwrite dd/d14/d18/f3f [0,4194304] 0 2024-09-19T09:02:31.323 INFO:tasks.workunit.client.1.smithi102.stdout:9/136: link d1/d2/d3/f13 d1/d8/d1c/f28 0 2024-09-19T09:02:31.325 INFO:tasks.workunit.client.1.smithi102.stdout:9/137: fsync d1/d2/f25 0 2024-09-19T09:02:31.325 INFO:tasks.workunit.client.1.smithi102.stdout:8/189: dread d0/f7 [0,4194304] 0 2024-09-19T09:02:31.326 INFO:tasks.workunit.client.1.smithi102.stdout:8/190: chown d0/c2f 213559 1 2024-09-19T09:02:31.327 INFO:tasks.workunit.client.1.smithi102.stdout:8/191: fdatasync d0/db/f13 0 2024-09-19T09:02:31.327 INFO:tasks.workunit.client.1.smithi102.stdout:2/113: rename d7/d11/f24 to d7/d1a/f26 0 2024-09-19T09:02:31.335 INFO:tasks.workunit.client.1.smithi102.stdout:8/192: fdatasync d0/f16 0 2024-09-19T09:02:31.337 INFO:tasks.workunit.client.1.smithi102.stdout:2/114: rename d7/d1a/f22 to d7/d11/f27 0 2024-09-19T09:02:31.337 INFO:tasks.workunit.client.1.smithi102.stdout:3/210: dread d2/d5/db/f1b [0,4194304] 0 2024-09-19T09:02:31.338 INFO:tasks.workunit.client.1.smithi102.stdout:3/211: write d2/d19/d1c/f37 [751668,56765] 0 2024-09-19T09:02:31.339 INFO:tasks.workunit.client.1.smithi102.stdout:3/212: chown d2/d5/db/f1b 338790 1 2024-09-19T09:02:31.339 INFO:tasks.workunit.client.1.smithi102.stdout:9/138: mknod d1/d2/c29 0 2024-09-19T09:02:31.340 INFO:tasks.workunit.client.1.smithi102.stdout:3/213: write d2/d5/db/d26/f3a [55786,42918] 0 2024-09-19T09:02:31.346 INFO:tasks.workunit.client.1.smithi102.stdout:3/214: unlink d2/d5/db/f1b 0 2024-09-19T09:02:31.347 INFO:tasks.workunit.client.1.smithi102.stdout:9/139: dread d1/d2/d3/f13 [0,4194304] 0 2024-09-19T09:02:31.348 INFO:tasks.workunit.client.1.smithi102.stdout:3/215: truncate d2/d5/db/d26/f3a 638037 0 2024-09-19T09:02:31.349 INFO:tasks.workunit.client.1.smithi102.stdout:0/235: write d3/dd/d1a/f1b [1365834,53212] 0 2024-09-19T09:02:31.349 INFO:tasks.workunit.client.1.smithi102.stdout:0/236: chown d3/l20 35 1 2024-09-19T09:02:31.352 INFO:tasks.workunit.client.1.smithi102.stdout:9/140: mknod d1/c2a 0 2024-09-19T09:02:31.354 INFO:tasks.workunit.client.1.smithi102.stdout:9/141: write d1/d2/f25 [526796,53011] 0 2024-09-19T09:02:31.355 INFO:tasks.workunit.client.1.smithi102.stdout:3/216: dwrite d2/d5/db/f17 [0,4194304] 0 2024-09-19T09:02:31.357 INFO:tasks.workunit.client.1.smithi102.stdout:0/237: creat d3/dd/d10/d15/d22/d37/d3d/f48 x:0 0 0 2024-09-19T09:02:31.358 INFO:tasks.workunit.client.1.smithi102.stdout:0/238: stat d3/dd/d10/d15/d22/d37 0 2024-09-19T09:02:31.360 INFO:tasks.workunit.client.1.smithi102.stdout:3/217: unlink d2/d19/f2c 0 2024-09-19T09:02:31.364 INFO:tasks.workunit.client.1.smithi102.stdout:9/142: creat d1/d8/f2b x:0 0 0 2024-09-19T09:02:31.366 INFO:tasks.workunit.client.1.smithi102.stdout:0/239: dwrite d3/dd/d10/d15/d2c/f3b [0,4194304] 0 2024-09-19T09:02:31.368 INFO:tasks.workunit.client.1.smithi102.stdout:9/143: fsync d1/d8/d1c/f19 0 2024-09-19T09:02:31.369 INFO:tasks.workunit.client.1.smithi102.stdout:3/218: dread d2/f18 [0,4194304] 0 2024-09-19T09:02:31.376 INFO:tasks.workunit.client.1.smithi102.stdout:3/219: read d2/d19/f28 [531913,91542] 0 2024-09-19T09:02:31.378 INFO:tasks.workunit.client.1.smithi102.stdout:2/115: dwrite d7/d11/f27 [0,4194304] 0 2024-09-19T09:02:31.378 INFO:tasks.workunit.client.1.smithi102.stdout:0/240: symlink d3/dd/d10/d15/d22/d37/l49 0 2024-09-19T09:02:31.378 INFO:tasks.workunit.client.1.smithi102.stdout:3/220: chown d2/l23 8 1 2024-09-19T09:02:31.378 INFO:tasks.workunit.client.1.smithi102.stdout:2/116: fdatasync d7/f10 0 2024-09-19T09:02:31.379 INFO:tasks.workunit.client.1.smithi102.stdout:3/221: chown d2/d1e/f3d 34600270 1 2024-09-19T09:02:31.388 INFO:tasks.workunit.client.1.smithi102.stdout:3/222: getdents d2 0 2024-09-19T09:02:31.390 INFO:tasks.workunit.client.1.smithi102.stdout:3/223: creat d2/d19/d35/f41 x:0 0 0 2024-09-19T09:02:31.390 INFO:tasks.workunit.client.1.smithi102.stdout:3/224: dread - d2/f2d zero size 2024-09-19T09:02:31.391 INFO:tasks.workunit.client.1.smithi102.stdout:3/225: readlink d2/d5/l2b 0 2024-09-19T09:02:31.392 INFO:tasks.workunit.client.1.smithi102.stdout:0/241: write d3/dd/ff [39747,26104] 0 2024-09-19T09:02:31.392 INFO:tasks.workunit.client.1.smithi102.stdout:6/139: sync 2024-09-19T09:02:31.396 INFO:tasks.workunit.client.1.smithi102.stdout:0/242: mkdir d3/dd/d10/d15/d22/d4a 0 2024-09-19T09:02:31.397 INFO:tasks.workunit.client.1.smithi102.stdout:6/140: creat d1/f2c x:0 0 0 2024-09-19T09:02:31.398 INFO:tasks.workunit.client.1.smithi102.stdout:2/117: dwrite d7/d12/f17 [0,4194304] 0 2024-09-19T09:02:31.400 INFO:tasks.workunit.client.1.smithi102.stdout:3/226: rmdir d2/d19/d35 39 2024-09-19T09:02:31.401 INFO:tasks.workunit.client.1.smithi102.stdout:0/243: truncate d3/f7 2505030 0 2024-09-19T09:02:31.403 INFO:tasks.workunit.client.1.smithi102.stdout:2/118: mknod d7/d11/c28 0 2024-09-19T09:02:31.405 INFO:tasks.workunit.client.1.smithi102.stdout:6/141: symlink d1/d18/db/l2d 0 2024-09-19T09:02:31.405 INFO:tasks.workunit.client.1.smithi102.stdout:0/244: mknod d3/dd/d10/d15/d19/c4b 0 2024-09-19T09:02:31.409 INFO:tasks.workunit.client.1.smithi102.stdout:6/142: dread d1/d18/db/fd [0,4194304] 0 2024-09-19T09:02:31.412 INFO:tasks.workunit.client.1.smithi102.stdout:0/245: dwrite d3/dd/d1a/f1b [0,4194304] 0 2024-09-19T09:02:31.418 INFO:tasks.workunit.client.1.smithi102.stdout:6/143: dwrite d1/d18/db/f1f [0,4194304] 0 2024-09-19T09:02:31.419 INFO:tasks.workunit.client.1.smithi102.stdout:2/119: truncate d7/d12/f17 1052300 0 2024-09-19T09:02:31.421 INFO:tasks.workunit.client.1.smithi102.stdout:2/120: chown d7/c16 31 1 2024-09-19T09:02:31.421 INFO:tasks.workunit.client.1.smithi102.stdout:3/227: dwrite d2/f34 [0,4194304] 0 2024-09-19T09:02:31.422 INFO:tasks.workunit.client.1.smithi102.stdout:2/121: dread - d7/d1a/f26 zero size 2024-09-19T09:02:31.422 INFO:tasks.workunit.client.1.smithi102.stdout:0/246: dread d3/dd/d1a/f1b [0,4194304] 0 2024-09-19T09:02:31.423 INFO:tasks.workunit.client.1.smithi102.stdout:2/122: write d7/f10 [69213,92944] 0 2024-09-19T09:02:31.429 INFO:tasks.workunit.client.1.smithi102.stdout:2/123: rename d7/l19 to d7/d11/l29 0 2024-09-19T09:02:31.430 INFO:tasks.workunit.client.1.smithi102.stdout:3/228: dread d2/d5/f7 [8388608,4194304] 0 2024-09-19T09:02:31.433 INFO:tasks.workunit.client.1.smithi102.stdout:6/144: dwrite d1/d18/db/fd [0,4194304] 0 2024-09-19T09:02:31.439 INFO:tasks.workunit.client.1.smithi102.stdout:3/229: dread d2/f1d [0,4194304] 0 2024-09-19T09:02:31.440 INFO:tasks.workunit.client.1.smithi102.stdout:6/145: dread d1/d18/db/fd [0,4194304] 0 2024-09-19T09:02:31.440 INFO:tasks.workunit.client.1.smithi102.stdout:3/230: dread d2/f1d [0,4194304] 0 2024-09-19T09:02:31.441 INFO:tasks.workunit.client.1.smithi102.stdout:3/231: rename d2/d5 to d2/d5/db/d26/d42 22 2024-09-19T09:02:31.452 INFO:tasks.workunit.client.1.smithi102.stdout:0/247: getdents d3/dd/d10/d15/d2c 0 2024-09-19T09:02:31.454 INFO:tasks.workunit.client.1.smithi102.stdout:2/124: creat d7/d1a/f2a x:0 0 0 2024-09-19T09:02:31.455 INFO:tasks.workunit.client.1.smithi102.stdout:6/146: mkdir d1/d26/d2e 0 2024-09-19T09:02:31.456 INFO:tasks.workunit.client.1.smithi102.stdout:2/125: dread d7/f10 [0,4194304] 0 2024-09-19T09:02:31.457 INFO:tasks.workunit.client.1.smithi102.stdout:6/147: chown d1/d18/db/c15 0 1 2024-09-19T09:02:31.458 INFO:tasks.workunit.client.1.smithi102.stdout:2/126: mkdir d7/d1a/d2b 0 2024-09-19T09:02:31.458 INFO:tasks.workunit.client.1.smithi102.stdout:3/232: getdents d2/d19/d35/d36 0 2024-09-19T09:02:31.459 INFO:tasks.workunit.client.1.smithi102.stdout:6/148: mkdir d1/d18/d2f 0 2024-09-19T09:02:31.459 INFO:tasks.workunit.client.1.smithi102.stdout:2/127: symlink d7/d12/l2c 0 2024-09-19T09:02:31.460 INFO:tasks.workunit.client.1.smithi102.stdout:3/233: creat d2/d5/db/f43 x:0 0 0 2024-09-19T09:02:31.460 INFO:tasks.workunit.client.1.smithi102.stdout:2/128: chown d7/d12/f17 5 1 2024-09-19T09:02:31.462 INFO:tasks.workunit.client.1.smithi102.stdout:3/234: unlink d2/d5/fa 0 2024-09-19T09:02:31.463 INFO:tasks.workunit.client.1.smithi102.stdout:2/129: chown d7/l21 5720928 1 2024-09-19T09:02:31.464 INFO:tasks.workunit.client.1.smithi102.stdout:2/130: chown c4 5658201 1 2024-09-19T09:02:31.466 INFO:tasks.workunit.client.1.smithi102.stdout:6/149: dwrite d1/d18/f25 [0,4194304] 0 2024-09-19T09:02:31.466 INFO:tasks.workunit.client.1.smithi102.stdout:3/235: creat d2/d5/db/f44 x:0 0 0 2024-09-19T09:02:31.473 INFO:tasks.workunit.client.1.smithi102.stdout:2/131: creat d7/d1a/d2b/f2d x:0 0 0 2024-09-19T09:02:31.473 INFO:tasks.workunit.client.1.smithi102.stdout:6/150: dwrite d1/d18/f25 [0,4194304] 0 2024-09-19T09:02:31.474 INFO:tasks.workunit.client.1.smithi102.stdout:6/151: chown d1/d18/l21 432 1 2024-09-19T09:02:31.478 INFO:tasks.workunit.client.1.smithi102.stdout:3/236: dwrite d2/f18 [4194304,4194304] 0 2024-09-19T09:02:31.485 INFO:tasks.workunit.client.1.smithi102.stdout:2/132: dwrite d7/ff [0,4194304] 0 2024-09-19T09:02:31.486 INFO:tasks.workunit.client.1.smithi102.stdout:6/152: creat d1/d18/db/f30 x:0 0 0 2024-09-19T09:02:31.492 INFO:tasks.workunit.client.1.smithi102.stdout:2/133: dread d7/d1a/f20 [0,4194304] 0 2024-09-19T09:02:31.494 INFO:tasks.workunit.client.1.smithi102.stdout:6/153: creat d1/d18/db/f31 x:0 0 0 2024-09-19T09:02:31.494 INFO:tasks.workunit.client.1.smithi102.stdout:6/154: write d1/f2c [940834,7536] 0 2024-09-19T09:02:31.495 INFO:tasks.workunit.client.1.smithi102.stdout:2/134: symlink d7/d12/l2e 0 2024-09-19T09:02:31.496 INFO:tasks.workunit.client.1.smithi102.stdout:2/135: readlink d7/d1a/l1b 0 2024-09-19T09:02:31.498 INFO:tasks.workunit.client.1.smithi102.stdout:6/155: creat d1/d18/f32 x:0 0 0 2024-09-19T09:02:31.498 INFO:tasks.workunit.client.1.smithi102.stdout:6/156: write d1/d18/f24 [334031,102113] 0 2024-09-19T09:02:31.499 INFO:tasks.workunit.client.1.smithi102.stdout:2/136: creat d7/d12/f2f x:0 0 0 2024-09-19T09:02:31.500 INFO:tasks.workunit.client.1.smithi102.stdout:2/137: stat d7/f10 0 2024-09-19T09:02:31.501 INFO:tasks.workunit.client.1.smithi102.stdout:3/237: write d2/f33 [4366397,66094] 0 2024-09-19T09:02:31.502 INFO:tasks.workunit.client.1.smithi102.stdout:3/238: write d2/d1e/f3d [3094478,16736] 0 2024-09-19T09:02:31.504 INFO:tasks.workunit.client.1.smithi102.stdout:3/239: fsync d2/f9 0 2024-09-19T09:02:31.505 INFO:tasks.workunit.client.1.smithi102.stdout:3/240: read - d2/f2d zero size 2024-09-19T09:02:31.508 INFO:tasks.workunit.client.1.smithi102.stdout:6/157: dwrite d1/d18/db/f19 [0,4194304] 0 2024-09-19T09:02:31.509 INFO:tasks.workunit.client.1.smithi102.stdout:3/241: mknod d2/d19/d35/c45 0 2024-09-19T09:02:31.511 INFO:tasks.workunit.client.1.smithi102.stdout:6/158: creat d1/d18/d2f/f33 x:0 0 0 2024-09-19T09:02:31.512 INFO:tasks.workunit.client.1.smithi102.stdout:3/242: creat d2/d1e/f46 x:0 0 0 2024-09-19T09:02:31.514 INFO:tasks.workunit.client.1.smithi102.stdout:6/159: creat d1/d18/d2f/f34 x:0 0 0 2024-09-19T09:02:31.514 INFO:tasks.workunit.client.1.smithi102.stdout:6/160: chown d1/f1c 642792 1 2024-09-19T09:02:31.515 INFO:tasks.workunit.client.1.smithi102.stdout:5/225: sync 2024-09-19T09:02:31.517 INFO:tasks.workunit.client.1.smithi102.stdout:3/243: rename d2/d5 to d2/d19/d47 0 2024-09-19T09:02:31.518 INFO:tasks.workunit.client.1.smithi102.stdout:6/161: mkdir d1/d18/d2f/d35 0 2024-09-19T09:02:31.521 INFO:tasks.workunit.client.1.smithi102.stdout:6/162: unlink d1/f1c 0 2024-09-19T09:02:31.522 INFO:tasks.workunit.client.1.smithi102.stdout:5/226: mknod d5/c43 0 2024-09-19T09:02:31.523 INFO:tasks.workunit.client.1.smithi102.stdout:5/227: fdatasync d5/d7/d1a/d37/f32 0 2024-09-19T09:02:31.524 INFO:tasks.workunit.client.1.smithi102.stdout:6/163: mknod d1/d18/d2f/d35/c36 0 2024-09-19T09:02:31.524 INFO:tasks.workunit.client.1.smithi102.stdout:6/164: write d1/d18/f25 [3111939,19642] 0 2024-09-19T09:02:31.530 INFO:tasks.workunit.client.1.smithi102.stdout:6/165: mkdir d1/d18/d37 0 2024-09-19T09:02:31.530 INFO:tasks.workunit.client.1.smithi102.stdout:5/228: rmdir d5 39 2024-09-19T09:02:31.586 INFO:tasks.workunit.client.1.smithi102.stdout:6/166: write d1/d18/db/f1a [2946295,46598] 0 2024-09-19T09:02:31.587 INFO:tasks.workunit.client.1.smithi102.stdout:3/244: creat d2/d19/d35/f48 x:0 0 0 2024-09-19T09:02:31.588 INFO:tasks.workunit.client.1.smithi102.stdout:5/229: creat d5/d7/d1a/d42/f44 x:0 0 0 2024-09-19T09:02:31.590 INFO:tasks.workunit.client.1.smithi102.stdout:6/167: symlink d1/d18/db/d22/l38 0 2024-09-19T09:02:31.590 INFO:tasks.workunit.client.1.smithi102.stdout:5/230: read d5/d7/d1a/d37/d39/f3c [776631,129136] 0 2024-09-19T09:02:31.591 INFO:tasks.workunit.client.1.smithi102.stdout:5/231: chown d5/d7/d1a/c2e 196 1 2024-09-19T09:02:31.592 INFO:tasks.workunit.client.1.smithi102.stdout:3/245: read d2/ff [849921,75979] 0 2024-09-19T09:02:31.593 INFO:tasks.workunit.client.1.smithi102.stdout:5/232: creat d5/d7/d1a/d37/f45 x:0 0 0 2024-09-19T09:02:31.594 INFO:tasks.workunit.client.1.smithi102.stdout:3/246: stat d2/f1d 0 2024-09-19T09:02:31.594 INFO:tasks.workunit.client.1.smithi102.stdout:5/233: dread - d5/d7/f35 zero size 2024-09-19T09:02:31.596 INFO:tasks.workunit.client.1.smithi102.stdout:6/168: dwrite d1/d18/f25 [4194304,4194304] 0 2024-09-19T09:02:31.597 INFO:tasks.workunit.client.1.smithi102.stdout:5/234: creat d5/d7/d1b/f46 x:0 0 0 2024-09-19T09:02:31.599 INFO:tasks.workunit.client.1.smithi102.stdout:6/169: creat d1/d18/d2f/d35/f39 x:0 0 0 2024-09-19T09:02:31.600 INFO:tasks.workunit.client.1.smithi102.stdout:3/247: getdents d2/d19/d1c/d2f 0 2024-09-19T09:02:31.600 INFO:tasks.workunit.client.1.smithi102.stdout:6/170: chown d1/d18/db/c1e 5293655 1 2024-09-19T09:02:31.601 INFO:tasks.workunit.client.1.smithi102.stdout:6/171: write d1/fc [5417987,84924] 0 2024-09-19T09:02:31.604 INFO:tasks.workunit.client.1.smithi102.stdout:6/172: mkdir d1/d3a 0 2024-09-19T09:02:31.607 INFO:tasks.workunit.client.1.smithi102.stdout:3/248: rmdir d2/d19/d35/d36 0 2024-09-19T09:02:31.610 INFO:tasks.workunit.client.1.smithi102.stdout:3/249: mknod d2/d19/d47/db/d26/c49 0 2024-09-19T09:02:31.616 INFO:tasks.workunit.client.1.smithi102.stdout:5/235: truncate d5/f15 2756705 0 2024-09-19T09:02:31.619 INFO:tasks.workunit.client.1.smithi102.stdout:5/236: rename d5/l11 to d5/d7/d1a/d37/l47 0 2024-09-19T09:02:31.621 INFO:tasks.workunit.client.1.smithi102.stdout:6/173: truncate d1/fc 1369163 0 2024-09-19T09:02:31.622 INFO:tasks.workunit.client.1.smithi102.stdout:3/250: truncate d2/d19/d47/db/f17 106834 0 2024-09-19T09:02:31.623 INFO:tasks.workunit.client.1.smithi102.stdout:6/174: mkdir d1/d18/d2f/d3b 0 2024-09-19T09:02:31.625 INFO:tasks.workunit.client.1.smithi102.stdout:5/237: dwrite d5/d7/f35 [0,4194304] 0 2024-09-19T09:02:31.627 INFO:tasks.workunit.client.1.smithi102.stdout:7/158: sync 2024-09-19T09:02:31.627 INFO:tasks.workunit.client.1.smithi102.stdout:4/165: sync 2024-09-19T09:02:31.627 INFO:tasks.workunit.client.1.smithi102.stdout:1/223: sync 2024-09-19T09:02:31.628 INFO:tasks.workunit.client.1.smithi102.stdout:5/238: mkdir d5/d48 0 2024-09-19T09:02:31.630 INFO:tasks.workunit.client.1.smithi102.stdout:4/166: read d14/d16/f26 [740876,114040] 0 2024-09-19T09:02:31.631 INFO:tasks.workunit.client.1.smithi102.stdout:3/251: dwrite d2/f9 [0,4194304] 0 2024-09-19T09:02:31.631 INFO:tasks.workunit.client.1.smithi102.stdout:7/159: chown d1/d4/df/l27 51514 1 2024-09-19T09:02:31.632 INFO:tasks.workunit.client.1.smithi102.stdout:7/160: dread - d1/d4/f21 zero size 2024-09-19T09:02:31.633 INFO:tasks.workunit.client.1.smithi102.stdout:3/252: stat d2/d19/d47/db/f25 0 2024-09-19T09:02:31.633 INFO:tasks.workunit.client.1.smithi102.stdout:7/161: fdatasync d1/f1e 0 2024-09-19T09:02:31.634 INFO:tasks.workunit.client.1.smithi102.stdout:4/167: dread d14/d16/f1e [0,4194304] 0 2024-09-19T09:02:31.635 INFO:tasks.workunit.client.1.smithi102.stdout:1/224: creat dd/d14/d35/f4a x:0 0 0 2024-09-19T09:02:31.642 INFO:tasks.workunit.client.1.smithi102.stdout:6/175: rmdir d1/d18/d2f 39 2024-09-19T09:02:31.645 INFO:tasks.workunit.client.1.smithi102.stdout:6/176: write d1/d18/db/f1a [4472309,122172] 0 2024-09-19T09:02:31.645 INFO:tasks.workunit.client.1.smithi102.stdout:3/253: symlink d2/d19/d35/l4a 0 2024-09-19T09:02:31.649 INFO:tasks.workunit.client.1.smithi102.stdout:1/225: symlink dd/d13/d3b/l4b 0 2024-09-19T09:02:31.651 INFO:tasks.workunit.client.1.smithi102.stdout:5/239: creat d5/d7/d1a/d37/d34/f49 x:0 0 0 2024-09-19T09:02:31.653 INFO:tasks.workunit.client.1.smithi102.stdout:3/254: dread - d2/d1e/f38 zero size 2024-09-19T09:02:31.654 INFO:tasks.workunit.client.1.smithi102.stdout:7/162: symlink d1/d2f/l32 0 2024-09-19T09:02:31.654 INFO:tasks.workunit.client.1.smithi102.stdout:7/163: dread - d1/d4/f1a zero size 2024-09-19T09:02:31.656 INFO:tasks.workunit.client.1.smithi102.stdout:4/168: link d14/d16/f1e d14/d16/d17/d25/f33 0 2024-09-19T09:02:31.657 INFO:tasks.workunit.client.1.smithi102.stdout:1/226: rename dd/d14/d18/l23 to dd/l4c 0 2024-09-19T09:02:31.658 INFO:tasks.workunit.client.1.smithi102.stdout:6/177: symlink d1/d18/db/l3c 0 2024-09-19T09:02:31.659 INFO:tasks.workunit.client.1.smithi102.stdout:3/255: creat d2/d19/d35/f4b x:0 0 0 2024-09-19T09:02:31.659 INFO:tasks.workunit.client.1.smithi102.stdout:7/164: chown d1/d4/c28 12705 1 2024-09-19T09:02:31.661 INFO:tasks.workunit.client.1.smithi102.stdout:4/169: write d14/d16/d17/d25/f33 [821949,42052] 0 2024-09-19T09:02:31.661 INFO:tasks.workunit.client.1.smithi102.stdout:5/240: dread d5/d7/d1b/f33 [0,4194304] 0 2024-09-19T09:02:31.661 INFO:tasks.workunit.client.1.smithi102.stdout:7/165: write d1/f5 [3181642,99020] 0 2024-09-19T09:02:31.662 INFO:tasks.workunit.client.1.smithi102.stdout:7/166: chown d1/d3/d20 824187069 1 2024-09-19T09:02:31.662 INFO:tasks.workunit.client.1.smithi102.stdout:1/227: rename dd/d13/d3b/c45 to dd/d13/d2d/c4d 0 2024-09-19T09:02:31.662 INFO:tasks.workunit.client.1.smithi102.stdout:5/241: chown d5/d7/d1a/d37/d34 349 1 2024-09-19T09:02:31.663 INFO:tasks.workunit.client.1.smithi102.stdout:5/242: fdatasync d5/d7/f1f 0 2024-09-19T09:02:31.664 INFO:tasks.workunit.client.1.smithi102.stdout:7/167: write d1/d4/fc [1885836,69861] 0 2024-09-19T09:02:31.664 INFO:tasks.workunit.client.1.smithi102.stdout:3/256: chown d2/c29 53919429 1 2024-09-19T09:02:31.666 INFO:tasks.workunit.client.1.smithi102.stdout:8/193: sync 2024-09-19T09:02:31.666 INFO:tasks.workunit.client.1.smithi102.stdout:0/248: sync 2024-09-19T09:02:31.666 INFO:tasks.workunit.client.1.smithi102.stdout:2/138: sync 2024-09-19T09:02:31.666 INFO:tasks.workunit.client.1.smithi102.stdout:9/144: sync 2024-09-19T09:02:31.667 INFO:tasks.workunit.client.1.smithi102.stdout:6/178: getdents d1/d3a 0 2024-09-19T09:02:31.671 INFO:tasks.workunit.client.1.smithi102.stdout:6/179: dread d1/d18/f25 [4194304,4194304] 0 2024-09-19T09:02:31.671 INFO:tasks.workunit.client.1.smithi102.stdout:7/168: symlink d1/d3/l33 0 2024-09-19T09:02:31.672 INFO:tasks.workunit.client.1.smithi102.stdout:6/180: fsync d1/d18/db/f10 0 2024-09-19T09:02:31.673 INFO:tasks.workunit.client.1.smithi102.stdout:6/181: chown d1/d18/l21 1373881043 1 2024-09-19T09:02:31.673 INFO:tasks.workunit.client.1.smithi102.stdout:3/257: mkdir d2/d1e/d4c 0 2024-09-19T09:02:31.674 INFO:tasks.workunit.client.1.smithi102.stdout:6/182: write d1/d18/db/f1a [3898412,11289] 0 2024-09-19T09:02:31.675 INFO:tasks.workunit.client.1.smithi102.stdout:2/139: mknod d7/d12/c30 0 2024-09-19T09:02:31.680 INFO:tasks.workunit.client.1.smithi102.stdout:3/258: dwrite d2/d19/d35/f4b [0,4194304] 0 2024-09-19T09:02:31.681 INFO:tasks.workunit.client.1.smithi102.stdout:3/259: chown d2/d19/d35/f48 8374 1 2024-09-19T09:02:31.682 INFO:tasks.workunit.client.1.smithi102.stdout:9/145: dread d1/d2/ff [0,4194304] 0 2024-09-19T09:02:31.682 INFO:tasks.workunit.client.1.smithi102.stdout:1/228: unlink dd/d13/d3b/c46 0 2024-09-19T09:02:31.682 INFO:tasks.workunit.client.1.smithi102.stdout:9/146: read d1/d8/d1c/f28 [3073978,11034] 0 2024-09-19T09:02:31.683 INFO:tasks.workunit.client.1.smithi102.stdout:1/229: write f4 [7855669,76308] 0 2024-09-19T09:02:31.685 INFO:tasks.workunit.client.1.smithi102.stdout:7/169: mkdir d1/d3/d34 0 2024-09-19T09:02:31.686 INFO:tasks.workunit.client.1.smithi102.stdout:7/170: fsync d1/d3/d20/f2c 0 2024-09-19T09:02:31.686 INFO:tasks.workunit.client.1.smithi102.stdout:5/243: unlink d5/d7/d1a/d37/l28 0 2024-09-19T09:02:31.687 INFO:tasks.workunit.client.1.smithi102.stdout:9/147: dread d1/d2/f22 [0,4194304] 0 2024-09-19T09:02:31.687 INFO:tasks.workunit.client.1.smithi102.stdout:5/244: dread - d5/d7/d1a/d37/d34/f49 zero size 2024-09-19T09:02:31.690 INFO:tasks.workunit.client.1.smithi102.stdout:6/183: write d1/fc [650475,111349] 0 2024-09-19T09:02:31.691 INFO:tasks.workunit.client.1.smithi102.stdout:2/140: mkdir d7/d1a/d2b/d31 0 2024-09-19T09:02:31.696 INFO:tasks.workunit.client.1.smithi102.stdout:4/170: rename d14/d16/d17/d24 to d14/d34 0 2024-09-19T09:02:31.698 INFO:tasks.workunit.client.1.smithi102.stdout:4/171: fdatasync d14/d16/d17/d25/f33 0 2024-09-19T09:02:31.698 INFO:tasks.workunit.client.1.smithi102.stdout:4/172: write d14/d16/d1d/f20 [321209,71211] 0 2024-09-19T09:02:31.698 INFO:tasks.workunit.client.1.smithi102.stdout:4/173: rename d14/d16/d1d to d14/d16/d1d/d35 22 2024-09-19T09:02:31.698 INFO:tasks.workunit.client.1.smithi102.stdout:8/194: truncate d0/f16 1391496 0 2024-09-19T09:02:31.702 INFO:tasks.workunit.client.1.smithi102.stdout:0/249: link d3/dd/ff d3/dd/d10/d15/d22/d37/d39/d44/f4c 0 2024-09-19T09:02:31.705 INFO:tasks.workunit.client.1.smithi102.stdout:1/230: unlink dd/d14/l2f 0 2024-09-19T09:02:31.707 INFO:tasks.workunit.client.1.smithi102.stdout:7/171: creat d1/d3/d20/f35 x:0 0 0 2024-09-19T09:02:31.708 INFO:tasks.workunit.client.1.smithi102.stdout:0/250: dwrite d3/dd/d10/f38 [0,4194304] 0 2024-09-19T09:02:31.708 INFO:tasks.workunit.client.1.smithi102.stdout:9/148: creat d1/d2/d3/f2c x:0 0 0 2024-09-19T09:02:31.709 INFO:tasks.workunit.client.1.smithi102.stdout:9/149: stat d1/d8/f2b 0 2024-09-19T09:02:31.709 INFO:tasks.workunit.client.1.smithi102.stdout:0/251: write d3/dd/d10/d15/d3e/f3f [2375827,110257] 0 2024-09-19T09:02:31.710 INFO:tasks.workunit.client.1.smithi102.stdout:0/252: stat d3/dd/d10/d15/d19/f26 0 2024-09-19T09:02:31.713 INFO:tasks.workunit.client.1.smithi102.stdout:2/141: fdatasync d7/d1a/f26 0 2024-09-19T09:02:31.720 INFO:tasks.workunit.client.1.smithi102.stdout:8/195: rename d0/db/f12 to d0/db/d1d/f34 0 2024-09-19T09:02:31.724 INFO:tasks.workunit.client.1.smithi102.stdout:7/172: mknod d1/d4/df/c36 0 2024-09-19T09:02:31.724 INFO:tasks.workunit.client.1.smithi102.stdout:5/245: creat d5/d48/f4a x:0 0 0 2024-09-19T09:02:31.727 INFO:tasks.workunit.client.1.smithi102.stdout:5/246: fsync d5/d7/d1a/d42/f44 0 2024-09-19T09:02:31.727 INFO:tasks.workunit.client.1.smithi102.stdout:5/247: write d5/d7/d1a/d37/f45 [382987,110305] 0 2024-09-19T09:02:31.727 INFO:tasks.workunit.client.1.smithi102.stdout:5/248: fsync d5/d23/f24 0 2024-09-19T09:02:31.727 INFO:tasks.workunit.client.1.smithi102.stdout:6/184: mknod d1/d18/d37/c3d 0 2024-09-19T09:02:31.732 INFO:tasks.workunit.client.1.smithi102.stdout:3/260: getdents d2 0 2024-09-19T09:02:31.733 INFO:tasks.workunit.client.1.smithi102.stdout:9/150: mknod d1/c2d 0 2024-09-19T09:02:31.735 INFO:tasks.workunit.client.1.smithi102.stdout:4/174: dwrite d14/f15 [0,4194304] 0 2024-09-19T09:02:31.736 INFO:tasks.workunit.client.1.smithi102.stdout:4/175: chown d14/d16/d1d/f20 7525 1 2024-09-19T09:02:31.736 INFO:tasks.workunit.client.1.smithi102.stdout:4/176: chown d14/d16/d1d 881541379 1 2024-09-19T09:02:31.737 INFO:tasks.workunit.client.1.smithi102.stdout:4/177: chown la 6 1 2024-09-19T09:02:31.739 INFO:tasks.workunit.client.1.smithi102.stdout:9/151: dwrite d1/d2/f22 [0,4194304] 0 2024-09-19T09:02:31.741 INFO:tasks.workunit.client.1.smithi102.stdout:9/152: fsync d1/d2/f25 0 2024-09-19T09:02:31.799 INFO:tasks.workunit.client.1.smithi102.stdout:1/231: sync 2024-09-19T09:02:31.799 INFO:tasks.workunit.client.1.smithi102.stdout:2/142: sync 2024-09-19T09:02:31.803 INFO:tasks.workunit.client.1.smithi102.stdout:0/253: fsync d3/f7 0 2024-09-19T09:02:31.805 INFO:tasks.workunit.client.1.smithi102.stdout:7/173: creat d1/d2d/f37 x:0 0 0 2024-09-19T09:02:31.805 INFO:tasks.workunit.client.1.smithi102.stdout:3/261: creat d2/d1e/f4d x:0 0 0 2024-09-19T09:02:31.806 INFO:tasks.workunit.client.1.smithi102.stdout:3/262: stat d2/d19/d1c/d2f/c30 0 2024-09-19T09:02:31.807 INFO:tasks.workunit.client.1.smithi102.stdout:4/178: rmdir d14/d16/d17 39 2024-09-19T09:02:31.809 INFO:tasks.workunit.client.1.smithi102.stdout:4/179: write d14/d16/f2a [269112,120718] 0 2024-09-19T09:02:31.810 INFO:tasks.workunit.client.1.smithi102.stdout:7/174: dread d1/d4/fc [0,4194304] 0 2024-09-19T09:02:31.810 INFO:tasks.workunit.client.1.smithi102.stdout:4/180: write d14/d16/f2a [702249,19451] 0 2024-09-19T09:02:31.811 INFO:tasks.workunit.client.1.smithi102.stdout:2/143: mknod d7/d11/c32 0 2024-09-19T09:02:31.811 INFO:tasks.workunit.client.1.smithi102.stdout:1/232: truncate dd/f11 1267565 0 2024-09-19T09:02:31.814 INFO:tasks.workunit.client.1.smithi102.stdout:6/185: write d1/d18/f25 [7466501,91655] 0 2024-09-19T09:02:31.814 INFO:tasks.workunit.client.1.smithi102.stdout:0/254: mknod d3/dd/d10/c4d 0 2024-09-19T09:02:31.816 INFO:tasks.workunit.client.1.smithi102.stdout:8/196: truncate d0/d10/f2d 166225 0 2024-09-19T09:02:31.819 INFO:tasks.workunit.client.1.smithi102.stdout:5/249: write d5/f15 [2442798,15763] 0 2024-09-19T09:02:31.824 INFO:tasks.workunit.client.1.smithi102.stdout:3/263: symlink d2/d19/l4e 0 2024-09-19T09:02:31.825 INFO:tasks.workunit.client.1.smithi102.stdout:9/153: creat d1/d8/f2e x:0 0 0 2024-09-19T09:02:31.827 INFO:tasks.workunit.client.1.smithi102.stdout:5/250: dwrite d5/d7/ff [0,4194304] 0 2024-09-19T09:02:31.829 INFO:tasks.workunit.client.1.smithi102.stdout:8/197: dread d0/db/d1d/f33 [0,4194304] 0 2024-09-19T09:02:31.829 INFO:tasks.workunit.client.1.smithi102.stdout:0/255: symlink d3/dd/d10/d15/d22/d37/d39/d44/l4e 0 2024-09-19T09:02:31.835 INFO:tasks.workunit.client.1.smithi102.stdout:4/181: dwrite d14/d16/d17/f1f [0,4194304] 0 2024-09-19T09:02:31.835 INFO:tasks.workunit.client.1.smithi102.stdout:4/182: stat f13 0 2024-09-19T09:02:31.835 INFO:tasks.workunit.client.1.smithi102.stdout:5/251: dwrite d5/d7/f19 [0,4194304] 0 2024-09-19T09:02:31.837 INFO:tasks.workunit.client.1.smithi102.stdout:6/186: write d1/d18/f7 [1423026,15080] 0 2024-09-19T09:02:31.844 INFO:tasks.workunit.client.1.smithi102.stdout:0/256: chown d3/d8/c29 26 1 2024-09-19T09:02:31.846 INFO:tasks.workunit.client.1.smithi102.stdout:7/175: getdents d1/d2f 0 2024-09-19T09:02:31.847 INFO:tasks.workunit.client.1.smithi102.stdout:5/252: dread d5/d7/d1a/d37/f32 [0,4194304] 0 2024-09-19T09:02:31.847 INFO:tasks.workunit.client.1.smithi102.stdout:3/264: mkdir d2/d19/d1c/d2f/d39/d4f 0 2024-09-19T09:02:31.849 INFO:tasks.workunit.client.1.smithi102.stdout:7/176: write d1/f14 [2805033,129203] 0 2024-09-19T09:02:31.850 INFO:tasks.workunit.client.1.smithi102.stdout:2/144: getdents d7/d1a 0 2024-09-19T09:02:31.854 INFO:tasks.workunit.client.1.smithi102.stdout:4/183: fdatasync fe 0 2024-09-19T09:02:31.855 INFO:tasks.workunit.client.1.smithi102.stdout:6/187: dwrite d1/d18/f24 [0,4194304] 0 2024-09-19T09:02:31.857 INFO:tasks.workunit.client.1.smithi102.stdout:4/184: fsync d14/d16/d17/d25/d2b/f31 0 2024-09-19T09:02:31.859 INFO:tasks.workunit.client.1.smithi102.stdout:5/253: mkdir d5/d7/d1a/d42/d4b 0 2024-09-19T09:02:31.860 INFO:tasks.workunit.client.1.smithi102.stdout:4/185: write d14/f32 [871261,51144] 0 2024-09-19T09:02:31.860 INFO:tasks.workunit.client.1.smithi102.stdout:7/177: dread d1/f2a [0,4194304] 0 2024-09-19T09:02:31.860 INFO:tasks.workunit.client.1.smithi102.stdout:2/145: dread d7/f9 [0,4194304] 0 2024-09-19T09:02:31.861 INFO:tasks.workunit.client.1.smithi102.stdout:4/186: read f13 [3162666,67129] 0 2024-09-19T09:02:31.861 INFO:tasks.workunit.client.1.smithi102.stdout:5/254: read d5/d7/d1b/f33 [1310015,35801] 0 2024-09-19T09:02:31.862 INFO:tasks.workunit.client.1.smithi102.stdout:2/146: write d7/fc [905425,86373] 0 2024-09-19T09:02:31.863 INFO:tasks.workunit.client.1.smithi102.stdout:5/255: chown d5/d7/l18 4794 1 2024-09-19T09:02:31.864 INFO:tasks.workunit.client.1.smithi102.stdout:2/147: write d7/ff [3961247,123738] 0 2024-09-19T09:02:31.868 INFO:tasks.workunit.client.1.smithi102.stdout:3/265: rename d2/d1e/l21 to d2/d19/l50 0 2024-09-19T09:02:31.868 INFO:tasks.workunit.client.1.smithi102.stdout:9/154: write d1/d2/d3/f13 [1171251,55531] 0 2024-09-19T09:02:31.872 INFO:tasks.workunit.client.1.smithi102.stdout:6/188: dwrite d1/d18/d2f/d35/f39 [0,4194304] 0 2024-09-19T09:02:31.874 INFO:tasks.workunit.client.1.smithi102.stdout:8/198: truncate d0/db/d1d/f31 605950 0 2024-09-19T09:02:31.876 INFO:tasks.workunit.client.1.smithi102.stdout:3/266: symlink d2/d19/d47/db/l51 0 2024-09-19T09:02:31.878 INFO:tasks.workunit.client.1.smithi102.stdout:7/178: rename d1/d4/c15 to d1/d4/df/d25/c38 0 2024-09-19T09:02:31.879 INFO:tasks.workunit.client.1.smithi102.stdout:7/179: dread - d1/d4/f1a zero size 2024-09-19T09:02:31.882 INFO:tasks.workunit.client.1.smithi102.stdout:0/257: dread d3/dd/d10/d15/d22/f2f [0,4194304] 0 2024-09-19T09:02:31.887 INFO:tasks.workunit.client.1.smithi102.stdout:5/256: rename d5/d48 to d5/d7/d1a/d37/d39/d4c 0 2024-09-19T09:02:31.892 INFO:tasks.workunit.client.1.smithi102.stdout:3/267: mknod d2/d19/d1c/d2f/d39/d4f/c52 0 2024-09-19T09:02:31.896 INFO:tasks.workunit.client.1.smithi102.stdout:6/189: rename d1/d26/c2a to d1/d18/d2f/d3b/c3e 0 2024-09-19T09:02:31.897 INFO:tasks.workunit.client.1.smithi102.stdout:9/155: getdents d1/d2/d3 0 2024-09-19T09:02:31.897 INFO:tasks.workunit.client.1.smithi102.stdout:2/148: dread d7/fc [0,4194304] 0 2024-09-19T09:02:31.898 INFO:tasks.workunit.client.1.smithi102.stdout:9/156: dread - d1/d2/d3/d1d/f20 zero size 2024-09-19T09:02:31.898 INFO:tasks.workunit.client.1.smithi102.stdout:5/257: mkdir d5/d7/d1a/d37/d34/d4d 0 2024-09-19T09:02:31.899 INFO:tasks.workunit.client.1.smithi102.stdout:5/258: read d5/d7/d1a/d37/f45 [444013,51890] 0 2024-09-19T09:02:31.900 INFO:tasks.workunit.client.1.smithi102.stdout:7/180: symlink d1/l39 0 2024-09-19T09:02:31.901 INFO:tasks.workunit.client.1.smithi102.stdout:7/181: write d1/d3/d20/f2c [390839,109104] 0 2024-09-19T09:02:31.903 INFO:tasks.workunit.client.1.smithi102.stdout:3/268: dread d2/d19/d47/db/f1a [0,4194304] 0 2024-09-19T09:02:31.906 INFO:tasks.workunit.client.1.smithi102.stdout:6/190: rmdir d1/d26 39 2024-09-19T09:02:31.906 INFO:tasks.workunit.client.1.smithi102.stdout:6/191: dread - d1/f1b zero size 2024-09-19T09:02:31.910 INFO:tasks.workunit.client.1.smithi102.stdout:2/149: write d7/fc [2125246,96008] 0 2024-09-19T09:02:31.910 INFO:tasks.workunit.client.1.smithi102.stdout:7/182: dwrite d1/d4/f1b [0,4194304] 0 2024-09-19T09:02:31.910 INFO:tasks.workunit.client.1.smithi102.stdout:9/157: fdatasync d1/d2/ff 0 2024-09-19T09:02:31.913 INFO:tasks.workunit.client.1.smithi102.stdout:5/259: creat d5/d7/d1a/d37/d34/f4e x:0 0 0 2024-09-19T09:02:31.914 INFO:tasks.workunit.client.1.smithi102.stdout:1/233: sync 2024-09-19T09:02:31.914 INFO:tasks.workunit.client.1.smithi102.stdout:0/258: link d3/dd/d10/d15/d22/d37/d39/d44/f4c d3/dd/d1a/d32/f4f 0 2024-09-19T09:02:31.916 INFO:tasks.workunit.client.1.smithi102.stdout:1/234: truncate dd/d14/f2c 748079 0 2024-09-19T09:02:31.917 INFO:tasks.workunit.client.1.smithi102.stdout:3/269: mkdir d2/d19/d1c/d2f/d39/d53 0 2024-09-19T09:02:31.920 INFO:tasks.workunit.client.1.smithi102.stdout:6/192: mknod d1/d18/d2f/c3f 0 2024-09-19T09:02:31.922 INFO:tasks.workunit.client.1.smithi102.stdout:2/150: creat d7/d1a/d2b/f33 x:0 0 0 2024-09-19T09:02:31.924 INFO:tasks.workunit.client.1.smithi102.stdout:8/199: dwrite d0/d10/f2d [0,4194304] 0 2024-09-19T09:02:31.934 INFO:tasks.workunit.client.1.smithi102.stdout:4/187: sync 2024-09-19T09:02:31.938 INFO:tasks.workunit.client.1.smithi102.stdout:6/193: unlink d1/d18/f32 0 2024-09-19T09:02:31.938 INFO:tasks.workunit.client.1.smithi102.stdout:6/194: stat d1/d18/db/f19 0 2024-09-19T09:02:31.941 INFO:tasks.workunit.client.1.smithi102.stdout:3/270: dread d2/d19/d47/db/f25 [0,4194304] 0 2024-09-19T09:02:31.943 INFO:tasks.workunit.client.1.smithi102.stdout:2/151: symlink d7/d1a/l34 0 2024-09-19T09:02:31.945 INFO:tasks.workunit.client.1.smithi102.stdout:6/195: dwrite d1/d18/d2f/f33 [0,4194304] 0 2024-09-19T09:02:31.947 INFO:tasks.workunit.client.1.smithi102.stdout:6/196: write d1/d18/f7 [540927,102312] 0 2024-09-19T09:02:31.949 INFO:tasks.workunit.client.1.smithi102.stdout:8/200: unlink d0/db/c17 0 2024-09-19T09:02:31.951 INFO:tasks.workunit.client.1.smithi102.stdout:5/260: link d5/d7/d1b/f2d d5/d7/d1a/d42/d4b/f4f 0 2024-09-19T09:02:31.955 INFO:tasks.workunit.client.1.smithi102.stdout:0/259: link d3/dd/d10/d15/d22/f2f d3/dd/d10/d15/d3e/f50 0 2024-09-19T09:02:31.958 INFO:tasks.workunit.client.1.smithi102.stdout:6/197: fsync d1/d18/d2f/f33 0 2024-09-19T09:02:31.959 INFO:tasks.workunit.client.1.smithi102.stdout:9/158: creat d1/f2f x:0 0 0 2024-09-19T09:02:31.962 INFO:tasks.workunit.client.1.smithi102.stdout:3/271: rmdir d2/d19/d1c/d2f/d39 39 2024-09-19T09:02:31.964 INFO:tasks.workunit.client.1.smithi102.stdout:2/152: creat d7/d1a/d2b/f35 x:0 0 0 2024-09-19T09:02:31.966 INFO:tasks.workunit.client.1.smithi102.stdout:7/183: truncate d1/d4/f1b 583475 0 2024-09-19T09:02:31.975 INFO:tasks.workunit.client.1.smithi102.stdout:1/235: rename dd/d13/f47 to dd/d14/f4e 0 2024-09-19T09:02:31.979 INFO:tasks.workunit.client.1.smithi102.stdout:6/198: creat d1/d18/d2f/d35/f40 x:0 0 0 2024-09-19T09:02:31.982 INFO:tasks.workunit.client.1.smithi102.stdout:9/159: creat d1/d2/d3/d1d/f30 x:0 0 0 2024-09-19T09:02:31.984 INFO:tasks.workunit.client.1.smithi102.stdout:3/272: mkdir d2/d1e/d54 0 2024-09-19T09:02:31.989 INFO:tasks.workunit.client.1.smithi102.stdout:9/160: dwrite d1/f2f [0,4194304] 0 2024-09-19T09:02:31.989 INFO:tasks.workunit.client.1.smithi102.stdout:7/184: fdatasync d1/d4/f1b 0 2024-09-19T09:02:31.990 INFO:tasks.workunit.client.1.smithi102.stdout:5/261: getdents d5/d7/d1a/d37/d34/d4d 0 2024-09-19T09:02:31.992 INFO:tasks.workunit.client.1.smithi102.stdout:7/185: dread d1/f5 [0,4194304] 0 2024-09-19T09:02:31.992 INFO:tasks.workunit.client.1.smithi102.stdout:5/262: write d5/d7/f29 [2010424,88146] 0 2024-09-19T09:02:31.992 INFO:tasks.workunit.client.1.smithi102.stdout:7/186: read d1/d4/f1b [378483,31258] 0 2024-09-19T09:02:31.994 INFO:tasks.workunit.client.1.smithi102.stdout:4/188: rename d14/d16/f2a to d14/d16/d17/d25/d2f/f36 0 2024-09-19T09:02:31.994 INFO:tasks.workunit.client.1.smithi102.stdout:4/189: readlink la 0 2024-09-19T09:02:31.996 INFO:tasks.workunit.client.1.smithi102.stdout:1/236: write dd/d14/f2b [4268835,85877] 0 2024-09-19T09:02:31.996 INFO:tasks.workunit.client.1.smithi102.stdout:4/190: read d14/d16/d17/d25/f33 [814196,82789] 0 2024-09-19T09:02:31.997 INFO:tasks.workunit.client.1.smithi102.stdout:0/260: truncate d3/dd/d1a/d32/f4f 422656 0 2024-09-19T09:02:32.000 INFO:tasks.workunit.client.1.smithi102.stdout:3/273: chown d2/d19/d1c/d2f/d39/d4f 3215 1 2024-09-19T09:02:32.005 INFO:tasks.workunit.client.1.smithi102.stdout:9/161: creat d1/d2/d3/f31 x:0 0 0 2024-09-19T09:02:32.007 INFO:tasks.workunit.client.1.smithi102.stdout:8/201: creat d0/f35 x:0 0 0 2024-09-19T09:02:32.013 INFO:tasks.workunit.client.1.smithi102.stdout:7/187: creat d1/d3/f3a x:0 0 0 2024-09-19T09:02:32.014 INFO:tasks.workunit.client.1.smithi102.stdout:2/153: truncate f3 198154 0 2024-09-19T09:02:32.014 INFO:tasks.workunit.client.1.smithi102.stdout:2/154: chown c4 150 1 2024-09-19T09:02:32.015 INFO:tasks.workunit.client.1.smithi102.stdout:4/191: mkdir d14/d16/d17/d2e/d37 0 2024-09-19T09:02:32.016 INFO:tasks.workunit.client.1.smithi102.stdout:4/192: write d14/f32 [779439,20962] 0 2024-09-19T09:02:32.016 INFO:tasks.workunit.client.1.smithi102.stdout:0/261: rmdir d3/dd/d1a/d32 39 2024-09-19T09:02:32.021 INFO:tasks.workunit.client.1.smithi102.stdout:7/188: write d1/f2a [4134904,45285] 0 2024-09-19T09:02:32.022 INFO:tasks.workunit.client.1.smithi102.stdout:7/189: fdatasync d1/d4/f1b 0 2024-09-19T09:02:32.023 INFO:tasks.workunit.client.1.smithi102.stdout:2/155: symlink d7/d1a/d2b/l36 0 2024-09-19T09:02:32.031 INFO:tasks.workunit.client.1.smithi102.stdout:9/162: rename d1/f6 to d1/d2/d3/d1d/f32 0 2024-09-19T09:02:32.033 INFO:tasks.workunit.client.1.smithi102.stdout:8/202: truncate d0/db/d1d/f1e 6782775 0 2024-09-19T09:02:32.036 INFO:tasks.workunit.client.1.smithi102.stdout:7/190: symlink d1/d4/df/d25/l3b 0 2024-09-19T09:02:32.037 INFO:tasks.workunit.client.1.smithi102.stdout:9/163: dwrite d1/d2/d3/d1d/f20 [0,4194304] 0 2024-09-19T09:02:32.037 INFO:tasks.workunit.client.1.smithi102.stdout:2/156: mkdir d7/d12/d37 0 2024-09-19T09:02:32.039 INFO:tasks.workunit.client.1.smithi102.stdout:6/199: getdents d1/d18/db/d22 0 2024-09-19T09:02:32.040 INFO:tasks.workunit.client.1.smithi102.stdout:6/200: chown d1/d18/db/f30 5086352 1 2024-09-19T09:02:32.044 INFO:tasks.workunit.client.1.smithi102.stdout:5/263: getdents d5/d7/d1a/d42/d4b 0 2024-09-19T09:02:32.046 INFO:tasks.workunit.client.1.smithi102.stdout:2/157: dwrite d7/d12/f2f [0,4194304] 0 2024-09-19T09:02:32.047 INFO:tasks.workunit.client.1.smithi102.stdout:7/191: chown d1/c17 99674752 1 2024-09-19T09:02:32.049 INFO:tasks.workunit.client.1.smithi102.stdout:1/237: write f6 [1547255,924] 0 2024-09-19T09:02:32.051 INFO:tasks.workunit.client.1.smithi102.stdout:3/274: getdents d2 0 2024-09-19T09:02:32.055 INFO:tasks.workunit.client.1.smithi102.stdout:6/201: mkdir d1/d18/d2f/d35/d41 0 2024-09-19T09:02:32.056 INFO:tasks.workunit.client.1.smithi102.stdout:5/264: mkdir d5/d7/d1a/d37/d50 0 2024-09-19T09:02:32.060 INFO:tasks.workunit.client.1.smithi102.stdout:7/192: symlink d1/d4/l3c 0 2024-09-19T09:02:32.062 INFO:tasks.workunit.client.1.smithi102.stdout:4/193: getdents d14/d16/d1d 0 2024-09-19T09:02:32.063 INFO:tasks.workunit.client.1.smithi102.stdout:1/238: creat dd/f4f x:0 0 0 2024-09-19T09:02:32.068 INFO:tasks.workunit.client.1.smithi102.stdout:5/265: rmdir d5/d7/d1a/d37/d34 39 2024-09-19T09:02:32.072 INFO:tasks.workunit.client.1.smithi102.stdout:7/193: creat d1/d4/f3d x:0 0 0 2024-09-19T09:02:32.073 INFO:tasks.workunit.client.1.smithi102.stdout:4/194: creat d14/d16/d17/d25/d2f/f38 x:0 0 0 2024-09-19T09:02:32.075 INFO:tasks.workunit.client.1.smithi102.stdout:0/262: dwrite d3/dd/d10/d15/d22/d37/d39/d44/f4c [0,4194304] 0 2024-09-19T09:02:32.075 INFO:tasks.workunit.client.1.smithi102.stdout:4/195: chown f13 5097 1 2024-09-19T09:02:32.076 INFO:tasks.workunit.client.1.smithi102.stdout:6/202: dwrite d1/d18/db/fd [0,4194304] 0 2024-09-19T09:02:32.076 INFO:tasks.workunit.client.1.smithi102.stdout:1/239: read dd/f11 [280544,91246] 0 2024-09-19T09:02:32.080 INFO:tasks.workunit.client.1.smithi102.stdout:8/203: dread d0/db/d1d/f1e [0,4194304] 0 2024-09-19T09:02:32.080 INFO:tasks.workunit.client.1.smithi102.stdout:2/158: dread d7/d12/f17 [0,4194304] 0 2024-09-19T09:02:32.080 INFO:tasks.workunit.client.1.smithi102.stdout:9/164: link d1/d2/d3/c1b d1/c33 0 2024-09-19T09:02:32.083 INFO:tasks.workunit.client.1.smithi102.stdout:5/266: creat d5/d7/d1b/f51 x:0 0 0 2024-09-19T09:02:32.085 INFO:tasks.workunit.client.1.smithi102.stdout:0/263: chown d3/dd/d10/d15/d22/d37/d3d 952 1 2024-09-19T09:02:32.085 INFO:tasks.workunit.client.1.smithi102.stdout:1/240: dread - dd/d13/d2d/f39 zero size 2024-09-19T09:02:32.087 INFO:tasks.workunit.client.1.smithi102.stdout:3/275: creat d2/d19/d1c/d2f/f55 x:0 0 0 2024-09-19T09:02:32.090 INFO:tasks.workunit.client.1.smithi102.stdout:8/204: write d0/db/f13 [9037289,108544] 0 2024-09-19T09:02:32.091 INFO:tasks.workunit.client.1.smithi102.stdout:7/194: dwrite d1/d3/f3a [0,4194304] 0 2024-09-19T09:02:32.091 INFO:tasks.workunit.client.1.smithi102.stdout:9/165: unlink d1/d2/l17 0 2024-09-19T09:02:32.093 INFO:tasks.workunit.client.1.smithi102.stdout:3/276: rmdir d2 39 2024-09-19T09:02:32.095 INFO:tasks.workunit.client.1.smithi102.stdout:0/264: dread - d3/dd/d10/d15/d19/f46 zero size 2024-09-19T09:02:32.096 INFO:tasks.workunit.client.1.smithi102.stdout:9/166: fdatasync d1/d2/f22 0 2024-09-19T09:02:32.098 INFO:tasks.workunit.client.1.smithi102.stdout:4/196: dwrite d14/d16/d17/f1f [0,4194304] 0 2024-09-19T09:02:32.104 INFO:tasks.workunit.client.1.smithi102.stdout:6/203: dwrite d1/d18/db/f1a [0,4194304] 0 2024-09-19T09:02:32.105 INFO:tasks.workunit.client.1.smithi102.stdout:0/265: chown d3/dd/d10/d15/d22/d37/d3d 85067 1 2024-09-19T09:02:32.105 INFO:tasks.workunit.client.1.smithi102.stdout:5/267: link d5/f15 d5/d7/d1a/d37/d50/f52 0 2024-09-19T09:02:32.108 INFO:tasks.workunit.client.1.smithi102.stdout:9/167: mkdir d1/d2/d3/d34 0 2024-09-19T09:02:32.110 INFO:tasks.workunit.client.1.smithi102.stdout:5/268: stat d5/d23/d3b 0 2024-09-19T09:02:32.110 INFO:tasks.workunit.client.1.smithi102.stdout:7/195: symlink d1/l3e 0 2024-09-19T09:02:32.113 INFO:tasks.workunit.client.1.smithi102.stdout:2/159: dread d7/d12/f2f [0,4194304] 0 2024-09-19T09:02:32.117 INFO:tasks.workunit.client.1.smithi102.stdout:5/269: read d5/d7/f35 [4084121,79110] 0 2024-09-19T09:02:32.119 INFO:tasks.workunit.client.1.smithi102.stdout:9/168: write d1/d8/f2e [48007,35483] 0 2024-09-19T09:02:32.124 INFO:tasks.workunit.client.1.smithi102.stdout:2/160: creat d7/d12/f38 x:0 0 0 2024-09-19T09:02:32.124 INFO:tasks.workunit.client.1.smithi102.stdout:4/197: dwrite f12 [0,4194304] 0 2024-09-19T09:02:32.125 INFO:tasks.workunit.client.1.smithi102.stdout:8/205: dwrite d0/fd [0,4194304] 0 2024-09-19T09:02:32.129 INFO:tasks.workunit.client.1.smithi102.stdout:3/277: dwrite d2/f33 [0,4194304] 0 2024-09-19T09:02:32.131 INFO:tasks.workunit.client.1.smithi102.stdout:8/206: fsync d0/f35 0 2024-09-19T09:02:32.131 INFO:tasks.workunit.client.1.smithi102.stdout:1/241: dread dd/f1d [0,4194304] 0 2024-09-19T09:02:32.131 INFO:tasks.workunit.client.1.smithi102.stdout:9/169: creat d1/d2/d3/d1d/f35 x:0 0 0 2024-09-19T09:02:32.132 INFO:tasks.workunit.client.1.smithi102.stdout:2/161: readlink d7/d12/l13 0 2024-09-19T09:02:32.133 INFO:tasks.workunit.client.1.smithi102.stdout:6/204: dread d1/fc [0,4194304] 0 2024-09-19T09:02:32.133 INFO:tasks.workunit.client.1.smithi102.stdout:5/270: rename c3 to d5/d7/d1b/c53 0 2024-09-19T09:02:32.134 INFO:tasks.workunit.client.1.smithi102.stdout:1/242: chown dd/f25 3886154 1 2024-09-19T09:02:32.135 INFO:tasks.workunit.client.1.smithi102.stdout:2/162: dread - d7/d1a/f26 zero size 2024-09-19T09:02:32.135 INFO:tasks.workunit.client.1.smithi102.stdout:0/266: dwrite d3/dd/ff [0,4194304] 0 2024-09-19T09:02:32.139 INFO:tasks.workunit.client.1.smithi102.stdout:3/278: write d2/d19/d47/db/f44 [272989,125704] 0 2024-09-19T09:02:32.139 INFO:tasks.workunit.client.1.smithi102.stdout:0/267: fdatasync d3/dd/f1f 0 2024-09-19T09:02:32.140 INFO:tasks.workunit.client.1.smithi102.stdout:8/207: rename d0/db/d1d/f1e to d0/db/d29/f36 0 2024-09-19T09:02:32.144 INFO:tasks.workunit.client.1.smithi102.stdout:1/243: chown dd/d14/l32 41 1 2024-09-19T09:02:32.149 INFO:tasks.workunit.client.1.smithi102.stdout:3/279: chown d2/d19/d35/l4a 7842977 1 2024-09-19T09:02:32.151 INFO:tasks.workunit.client.1.smithi102.stdout:5/271: truncate d5/d7/d1a/d37/d34/f4e 973061 0 2024-09-19T09:02:32.152 INFO:tasks.workunit.client.1.smithi102.stdout:6/205: dwrite d1/d18/db/f10 [0,4194304] 0 2024-09-19T09:02:32.155 INFO:tasks.workunit.client.1.smithi102.stdout:9/170: dwrite d1/d2/d3/d1d/f30 [0,4194304] 0 2024-09-19T09:02:32.155 INFO:tasks.workunit.client.1.smithi102.stdout:3/280: write d2/d19/d47/db/f43 [254967,59688] 0 2024-09-19T09:02:32.157 INFO:tasks.workunit.client.1.smithi102.stdout:5/272: dread - d5/d7/d1b/f46 zero size 2024-09-19T09:02:32.162 INFO:tasks.workunit.client.1.smithi102.stdout:2/163: dwrite d7/d11/f27 [4194304,4194304] 0 2024-09-19T09:02:32.163 INFO:tasks.workunit.client.1.smithi102.stdout:5/273: read - d5/d7/d1a/d42/f44 zero size 2024-09-19T09:02:32.164 INFO:tasks.workunit.client.1.smithi102.stdout:3/281: write d2/d19/d47/db/f43 [826464,6106] 0 2024-09-19T09:02:32.166 INFO:tasks.workunit.client.1.smithi102.stdout:1/244: dwrite dd/d14/f27 [0,4194304] 0 2024-09-19T09:02:32.168 INFO:tasks.workunit.client.1.smithi102.stdout:1/245: chown dd/f12 1393329 1 2024-09-19T09:02:32.170 INFO:tasks.workunit.client.1.smithi102.stdout:1/246: dread - dd/d14/d18/f40 zero size 2024-09-19T09:02:32.171 INFO:tasks.workunit.client.1.smithi102.stdout:1/247: write f6 [314986,31678] 0 2024-09-19T09:02:32.172 INFO:tasks.workunit.client.1.smithi102.stdout:2/164: dwrite d7/d1a/d2b/f33 [0,4194304] 0 2024-09-19T09:02:32.173 INFO:tasks.workunit.client.1.smithi102.stdout:1/248: write dd/d14/d35/f48 [781357,51724] 0 2024-09-19T09:02:32.225 INFO:tasks.workunit.client.1.smithi102.stdout:8/208: creat d0/d10/f37 x:0 0 0 2024-09-19T09:02:32.229 INFO:tasks.workunit.client.1.smithi102.stdout:6/206: creat d1/d18/db/d22/f42 x:0 0 0 2024-09-19T09:02:32.237 INFO:tasks.workunit.client.1.smithi102.stdout:1/249: creat dd/d13/f50 x:0 0 0 2024-09-19T09:02:32.238 INFO:tasks.workunit.client.1.smithi102.stdout:3/282: dread d2/d19/d47/db/f2e [0,4194304] 0 2024-09-19T09:02:32.239 INFO:tasks.workunit.client.1.smithi102.stdout:8/209: unlink d0/db/f13 0 2024-09-19T09:02:32.240 INFO:tasks.workunit.client.1.smithi102.stdout:9/171: mkdir d1/d2/d3/d34/d36 0 2024-09-19T09:02:32.240 INFO:tasks.workunit.client.1.smithi102.stdout:8/210: write d0/d10/d21/f24 [329416,8995] 0 2024-09-19T09:02:32.241 INFO:tasks.workunit.client.1.smithi102.stdout:9/172: chown d1/d2/d3/c18 92493593 1 2024-09-19T09:02:32.243 INFO:tasks.workunit.client.1.smithi102.stdout:0/268: dread f2 [0,4194304] 0 2024-09-19T09:02:32.243 INFO:tasks.workunit.client.1.smithi102.stdout:4/198: write fd [1763619,46321] 0 2024-09-19T09:02:32.246 INFO:tasks.workunit.client.1.smithi102.stdout:3/283: mknod d2/d19/d1c/d2f/d39/d4f/c56 0 2024-09-19T09:02:32.247 INFO:tasks.workunit.client.1.smithi102.stdout:3/284: write d2/d19/d47/db/f3c [27817,91147] 0 2024-09-19T09:02:32.252 INFO:tasks.workunit.client.1.smithi102.stdout:8/211: write d0/db/d1d/f33 [1948075,118310] 0 2024-09-19T09:02:32.253 INFO:tasks.workunit.client.1.smithi102.stdout:8/212: chown d0/d10/d23/l2b 13 1 2024-09-19T09:02:32.254 INFO:tasks.workunit.client.1.smithi102.stdout:4/199: mknod d14/d16/d17/c39 0 2024-09-19T09:02:32.256 INFO:tasks.workunit.client.1.smithi102.stdout:5/274: write d5/d7/d1a/d37/d39/f3c [878022,38185] 0 2024-09-19T09:02:32.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:31 smithi102 ceph-mon[35280]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:02:32.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:31 smithi102 ceph-mon[35280]: Upgrade: Need to upgrade myself (mgr.smithi102.csalqv) 2024-09-19T09:02:32.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:31 smithi102 ceph-mon[35280]: Upgrade: Need to upgrade myself (mgr.smithi102.csalqv) 2024-09-19T09:02:32.259 INFO:tasks.workunit.client.1.smithi102.stdout:6/207: link d1/d18/d2f/f34 d1/f43 0 2024-09-19T09:02:32.264 INFO:tasks.workunit.client.1.smithi102.stdout:8/213: rename d0/d10/l18 to d0/db/d1d/l38 0 2024-09-19T09:02:32.266 INFO:tasks.workunit.client.1.smithi102.stdout:8/214: write d0/d10/d21/f24 [4668608,4198] 0 2024-09-19T09:02:32.267 INFO:tasks.workunit.client.1.smithi102.stdout:4/200: symlink d14/d16/d17/d25/d2f/l3a 0 2024-09-19T09:02:32.269 INFO:tasks.workunit.client.1.smithi102.stdout:3/285: link d2/d19/d35/f41 d2/d19/d1c/d2f/d39/d53/f57 0 2024-09-19T09:02:32.270 INFO:tasks.workunit.client.1.smithi102.stdout:5/275: fdatasync d5/d7/d1a/d37/d50/f52 0 2024-09-19T09:02:32.272 INFO:tasks.workunit.client.1.smithi102.stdout:9/173: creat d1/d2/f37 x:0 0 0 2024-09-19T09:02:32.274 INFO:tasks.workunit.client.1.smithi102.stdout:9/174: chown d1/d2/d3/l1f 45394 1 2024-09-19T09:02:32.275 INFO:tasks.workunit.client.1.smithi102.stdout:1/250: dwrite dd/d14/d18/f40 [0,4194304] 0 2024-09-19T09:02:32.275 INFO:tasks.workunit.client.1.smithi102.stdout:5/276: truncate d5/d7/d1a/d37/d39/d4c/f4a 394228 0 2024-09-19T09:02:32.275 INFO:tasks.workunit.client.1.smithi102.stdout:0/269: creat d3/dd/d1a/f51 x:0 0 0 2024-09-19T09:02:32.278 INFO:tasks.workunit.client.1.smithi102.stdout:3/286: symlink d2/d19/d47/db/l58 0 2024-09-19T09:02:32.282 INFO:tasks.workunit.client.1.smithi102.stdout:4/201: mknod d14/c3b 0 2024-09-19T09:02:32.284 INFO:tasks.workunit.client.1.smithi102.stdout:0/270: dwrite d3/dd/d10/d15/d2c/f3b [0,4194304] 0 2024-09-19T09:02:32.284 INFO:tasks.workunit.client.1.smithi102.stdout:5/277: rename d5/l3d to d5/d7/d1a/d37/d34/l54 0 2024-09-19T09:02:32.288 INFO:tasks.workunit.client.1.smithi102.stdout:3/287: creat d2/d19/d1c/f59 x:0 0 0 2024-09-19T09:02:32.289 INFO:tasks.workunit.client.1.smithi102.stdout:8/215: chown d0/db/d1d/l38 192592 1 2024-09-19T09:02:32.291 INFO:tasks.workunit.client.1.smithi102.stdout:4/202: symlink d14/d16/d17/d25/d2b/l3c 0 2024-09-19T09:02:32.292 INFO:tasks.workunit.client.1.smithi102.stdout:4/203: write d14/d16/d17/d25/d2b/f31 [326551,22775] 0 2024-09-19T09:02:32.293 INFO:tasks.workunit.client.1.smithi102.stdout:0/271: creat d3/dd/d10/d15/d22/d37/f52 x:0 0 0 2024-09-19T09:02:32.294 INFO:tasks.workunit.client.1.smithi102.stdout:6/208: link d1/d18/db/c17 d1/d18/d37/c44 0 2024-09-19T09:02:32.296 INFO:tasks.workunit.client.1.smithi102.stdout:5/278: rename d5/d7/d1b/f2d to d5/d7/d1a/d37/d39/d4c/f55 0 2024-09-19T09:02:32.297 INFO:tasks.workunit.client.1.smithi102.stdout:5/279: chown d5/d7/l10 0 1 2024-09-19T09:02:32.300 INFO:tasks.workunit.client.1.smithi102.stdout:1/251: link dd/d14/c3e dd/c51 0 2024-09-19T09:02:32.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:31 smithi049 ceph-mon[28158]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:02:32.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:31 smithi049 ceph-mon[28158]: Upgrade: Need to upgrade myself (mgr.smithi102.csalqv) 2024-09-19T09:02:32.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:31 smithi049 ceph-mon[28158]: Upgrade: Need to upgrade myself (mgr.smithi102.csalqv) 2024-09-19T09:02:32.303 INFO:tasks.workunit.client.1.smithi102.stdout:4/204: creat d14/d16/d17/d25/f3d x:0 0 0 2024-09-19T09:02:32.306 INFO:tasks.workunit.client.1.smithi102.stdout:0/272: rename d3/d8/de/l16 to d3/dd/d10/d15/d22/d2a/l53 0 2024-09-19T09:02:32.308 INFO:tasks.workunit.client.1.smithi102.stdout:9/175: getdents d1/d2/d3/d34 0 2024-09-19T09:02:32.310 INFO:tasks.workunit.client.1.smithi102.stdout:3/288: mkdir d2/d19/d1c/d2f/d5a 0 2024-09-19T09:02:32.310 INFO:tasks.workunit.client.1.smithi102.stdout:2/165: sync 2024-09-19T09:02:32.310 INFO:tasks.workunit.client.1.smithi102.stdout:7/196: sync 2024-09-19T09:02:32.310 INFO:tasks.workunit.client.1.smithi102.stdout:8/216: truncate d0/db/d1d/f31 1037896 0 2024-09-19T09:02:32.311 INFO:tasks.workunit.client.1.smithi102.stdout:8/217: fsync d0/fd 0 2024-09-19T09:02:32.311 INFO:tasks.workunit.client.1.smithi102.stdout:3/289: chown d2/d19/d35/l4a 79513301 1 2024-09-19T09:02:32.311 INFO:tasks.workunit.client.1.smithi102.stdout:2/166: write d7/d1a/f26 [482041,52964] 0 2024-09-19T09:02:32.313 INFO:tasks.workunit.client.1.smithi102.stdout:6/209: rename d1/d18/db/d22 to d1/d26/d2e/d45 0 2024-09-19T09:02:32.315 INFO:tasks.workunit.client.1.smithi102.stdout:2/167: write d7/d1a/d2b/f33 [4663594,115320] 0 2024-09-19T09:02:32.316 INFO:tasks.workunit.client.1.smithi102.stdout:6/210: write d1/d18/db/f30 [68907,98161] 0 2024-09-19T09:02:32.317 INFO:tasks.workunit.client.1.smithi102.stdout:4/205: getdents d14/d16/d17/d2e/d37 0 2024-09-19T09:02:32.319 INFO:tasks.workunit.client.1.smithi102.stdout:2/168: write d7/d1a/d2b/f33 [885957,57021] 0 2024-09-19T09:02:32.320 INFO:tasks.workunit.client.1.smithi102.stdout:7/197: dwrite d1/d4/df/d25/f26 [0,4194304] 0 2024-09-19T09:02:32.324 INFO:tasks.workunit.client.1.smithi102.stdout:6/211: dread d1/d18/f25 [4194304,4194304] 0 2024-09-19T09:02:32.326 INFO:tasks.workunit.client.1.smithi102.stdout:9/176: truncate d1/d8/d1c/f19 1199308 0 2024-09-19T09:02:32.328 INFO:tasks.workunit.client.1.smithi102.stdout:8/218: dread d0/f16 [0,4194304] 0 2024-09-19T09:02:32.331 INFO:tasks.workunit.client.1.smithi102.stdout:0/273: rename d3/dd/d10/d15/d3e/d45 to d3/dd/d10/d15/d22/d37/d39/d44/d54 0 2024-09-19T09:02:32.335 INFO:tasks.workunit.client.1.smithi102.stdout:2/169: unlink d7/c16 0 2024-09-19T09:02:32.335 INFO:tasks.workunit.client.1.smithi102.stdout:2/170: stat d7/l21 0 2024-09-19T09:02:32.337 INFO:tasks.workunit.client.1.smithi102.stdout:3/290: symlink d2/d19/d1c/d2f/d5a/l5b 0 2024-09-19T09:02:32.341 INFO:tasks.workunit.client.1.smithi102.stdout:6/212: symlink d1/d26/d2e/l46 0 2024-09-19T09:02:32.342 INFO:tasks.workunit.client.1.smithi102.stdout:9/177: creat d1/d2/d3/f38 x:0 0 0 2024-09-19T09:02:32.345 INFO:tasks.workunit.client.1.smithi102.stdout:8/219: mkdir d0/d10/d21/d39 0 2024-09-19T09:02:32.352 INFO:tasks.workunit.client.1.smithi102.stdout:4/206: creat d14/d16/d17/d2e/d37/f3e x:0 0 0 2024-09-19T09:02:32.353 INFO:tasks.workunit.client.1.smithi102.stdout:7/198: symlink d1/l3f 0 2024-09-19T09:02:32.354 INFO:tasks.workunit.client.1.smithi102.stdout:6/213: mkdir d1/d26/d2e/d45/d47 0 2024-09-19T09:02:32.358 INFO:tasks.workunit.client.1.smithi102.stdout:8/220: mkdir d0/d10/d3a 0 2024-09-19T09:02:32.359 INFO:tasks.workunit.client.1.smithi102.stdout:2/171: creat d7/d1a/d2b/d31/f39 x:0 0 0 2024-09-19T09:02:32.360 INFO:tasks.workunit.client.1.smithi102.stdout:4/207: symlink d14/d16/d17/d25/d2f/l3f 0 2024-09-19T09:02:32.363 INFO:tasks.workunit.client.1.smithi102.stdout:0/274: dwrite d3/dd/d10/d15/d3e/f50 [0,4194304] 0 2024-09-19T09:02:32.365 INFO:tasks.workunit.client.1.smithi102.stdout:4/208: creat d14/d16/d17/d25/f40 x:0 0 0 2024-09-19T09:02:32.366 INFO:tasks.workunit.client.1.smithi102.stdout:4/209: stat d14/d16/d17/d2e/d37 0 2024-09-19T09:02:32.367 INFO:tasks.workunit.client.1.smithi102.stdout:9/178: rename d1/d8/d1c/c27 to d1/d2/c39 0 2024-09-19T09:02:32.367 INFO:tasks.workunit.client.1.smithi102.stdout:4/210: readlink d14/d16/d17/d25/l29 0 2024-09-19T09:02:32.370 INFO:tasks.workunit.client.1.smithi102.stdout:3/291: getdents d2/d19/d35 0 2024-09-19T09:02:32.371 INFO:tasks.workunit.client.1.smithi102.stdout:3/292: stat d2/f34 0 2024-09-19T09:02:32.372 INFO:tasks.workunit.client.1.smithi102.stdout:0/275: mknod d3/dd/d10/d15/d3e/c55 0 2024-09-19T09:02:32.373 INFO:tasks.workunit.client.1.smithi102.stdout:2/172: creat d7/d12/d37/f3a x:0 0 0 2024-09-19T09:02:32.376 INFO:tasks.workunit.client.1.smithi102.stdout:2/173: write d7/d1a/d2b/f33 [1685197,25903] 0 2024-09-19T09:02:32.377 INFO:tasks.workunit.client.1.smithi102.stdout:4/211: dwrite d14/d16/d17/d25/f33 [0,4194304] 0 2024-09-19T09:02:32.377 INFO:tasks.workunit.client.1.smithi102.stdout:3/293: creat d2/d19/d35/f5c x:0 0 0 2024-09-19T09:02:32.377 INFO:tasks.workunit.client.1.smithi102.stdout:4/212: stat d14/d16/d17/c22 0 2024-09-19T09:02:32.379 INFO:tasks.workunit.client.1.smithi102.stdout:3/294: write d2/d19/d1c/d2f/f55 [241676,110093] 0 2024-09-19T09:02:32.379 INFO:tasks.workunit.client.1.smithi102.stdout:4/213: dread - d14/d16/d17/d25/f40 zero size 2024-09-19T09:02:32.381 INFO:tasks.workunit.client.1.smithi102.stdout:3/295: write d2/f34 [2975688,40449] 0 2024-09-19T09:02:32.381 INFO:tasks.workunit.client.1.smithi102.stdout:0/276: creat d3/dd/d10/d15/d2c/f56 x:0 0 0 2024-09-19T09:02:32.382 INFO:tasks.workunit.client.1.smithi102.stdout:7/199: truncate d1/d3/f3a 1015317 0 2024-09-19T09:02:32.383 INFO:tasks.workunit.client.1.smithi102.stdout:6/214: truncate d1/d18/d2f/d35/f39 3468965 0 2024-09-19T09:02:32.383 INFO:tasks.workunit.client.1.smithi102.stdout:0/277: chown d3/dd/d10/f38 8846 1 2024-09-19T09:02:32.385 INFO:tasks.workunit.client.1.smithi102.stdout:6/215: write d1/d18/db/f30 [918599,50883] 0 2024-09-19T09:02:32.387 INFO:tasks.workunit.client.1.smithi102.stdout:4/214: creat d14/d16/d17/d25/f41 x:0 0 0 2024-09-19T09:02:32.388 INFO:tasks.workunit.client.1.smithi102.stdout:8/221: truncate d0/d10/f2d 4098245 0 2024-09-19T09:02:32.389 INFO:tasks.workunit.client.1.smithi102.stdout:4/215: fsync d14/d16/d17/f1c 0 2024-09-19T09:02:32.390 INFO:tasks.workunit.client.1.smithi102.stdout:9/179: rename d1/d8/d1c/l1a to d1/d2/l3a 0 2024-09-19T09:02:32.392 INFO:tasks.workunit.client.1.smithi102.stdout:3/296: dwrite d2/f2d [0,4194304] 0 2024-09-19T09:02:32.393 INFO:tasks.workunit.client.1.smithi102.stdout:7/200: symlink d1/d3/d34/l40 0 2024-09-19T09:02:32.395 INFO:tasks.workunit.client.1.smithi102.stdout:7/201: fdatasync d1/d4/f1a 0 2024-09-19T09:02:32.400 INFO:tasks.workunit.client.1.smithi102.stdout:8/222: creat d0/db/f3b x:0 0 0 2024-09-19T09:02:32.401 INFO:tasks.workunit.client.1.smithi102.stdout:6/216: dwrite d1/d18/db/f30 [0,4194304] 0 2024-09-19T09:02:32.401 INFO:tasks.workunit.client.1.smithi102.stdout:8/223: dread - d0/d10/d21/f2e zero size 2024-09-19T09:02:32.401 INFO:tasks.workunit.client.1.smithi102.stdout:8/224: chown d0/d10/d21/f25 15 1 2024-09-19T09:02:32.402 INFO:tasks.workunit.client.1.smithi102.stdout:9/180: symlink d1/d2/d3/d1d/l3b 0 2024-09-19T09:02:32.403 INFO:tasks.workunit.client.1.smithi102.stdout:3/297: creat d2/d19/d47/db/d26/f5d x:0 0 0 2024-09-19T09:02:32.405 INFO:tasks.workunit.client.1.smithi102.stdout:3/298: dread - d2/d19/d1c/f59 zero size 2024-09-19T09:02:32.405 INFO:tasks.workunit.client.1.smithi102.stdout:7/202: unlink d1/d4/fc 0 2024-09-19T09:02:32.406 INFO:tasks.workunit.client.1.smithi102.stdout:3/299: write d2/d19/d35/f5c [607669,36926] 0 2024-09-19T09:02:32.407 INFO:tasks.workunit.client.1.smithi102.stdout:6/217: symlink d1/d18/d2f/d35/l48 0 2024-09-19T09:02:32.408 INFO:tasks.workunit.client.1.smithi102.stdout:7/203: read d1/d4/df/d25/f2e [382572,49364] 0 2024-09-19T09:02:32.409 INFO:tasks.workunit.client.1.smithi102.stdout:7/204: write d1/d4/f21 [555051,15058] 0 2024-09-19T09:02:32.410 INFO:tasks.workunit.client.1.smithi102.stdout:8/225: creat d0/d10/d23/f3c x:0 0 0 2024-09-19T09:02:32.412 INFO:tasks.workunit.client.1.smithi102.stdout:9/181: rename d1/d8/f2b to d1/d2/d3/f3c 0 2024-09-19T09:02:32.414 INFO:tasks.workunit.client.1.smithi102.stdout:3/300: symlink d2/d19/d35/l5e 0 2024-09-19T09:02:32.414 INFO:tasks.workunit.client.1.smithi102.stdout:8/226: dread d0/db/d29/f36 [0,4194304] 0 2024-09-19T09:02:32.421 INFO:tasks.workunit.client.1.smithi102.stdout:9/182: symlink d1/d2/d3/l3d 0 2024-09-19T09:02:32.421 INFO:tasks.workunit.client.1.smithi102.stdout:9/183: write d1/d2/d3/f31 [479861,121737] 0 2024-09-19T09:02:32.423 INFO:tasks.workunit.client.1.smithi102.stdout:3/301: mkdir d2/d19/d1c/d1f/d5f 0 2024-09-19T09:02:32.425 INFO:tasks.workunit.client.1.smithi102.stdout:6/218: creat d1/d26/d2e/d45/d47/f49 x:0 0 0 2024-09-19T09:02:32.425 INFO:tasks.workunit.client.1.smithi102.stdout:6/219: write d1/d18/db/f1f [2490035,38605] 0 2024-09-19T09:02:32.426 INFO:tasks.workunit.client.1.smithi102.stdout:4/216: link d14/l19 d14/d16/d17/d25/d2f/l42 0 2024-09-19T09:02:32.426 INFO:tasks.workunit.client.1.smithi102.stdout:6/220: dread - d1/d18/d2f/d35/f40 zero size 2024-09-19T09:02:32.431 INFO:tasks.workunit.client.1.smithi102.stdout:8/227: rename d0/f5 to d0/d10/d21/d39/f3d 0 2024-09-19T09:02:32.432 INFO:tasks.workunit.client.1.smithi102.stdout:4/217: dwrite f12 [0,4194304] 0 2024-09-19T09:02:32.435 INFO:tasks.workunit.client.1.smithi102.stdout:6/221: mknod d1/d18/d2f/c4a 0 2024-09-19T09:02:32.443 INFO:tasks.workunit.client.1.smithi102.stdout:3/302: rename d2/d19/d1c/f59 to d2/d19/d1c/d1f/f60 0 2024-09-19T09:02:32.443 INFO:tasks.workunit.client.1.smithi102.stdout:4/218: stat d14/l18 0 2024-09-19T09:02:32.444 INFO:tasks.workunit.client.1.smithi102.stdout:3/303: chown d2/d19/d1c/f37 675 1 2024-09-19T09:02:32.445 INFO:tasks.workunit.client.1.smithi102.stdout:8/228: mknod d0/d10/d23/c3e 0 2024-09-19T09:02:32.445 INFO:tasks.workunit.client.1.smithi102.stdout:8/229: chown d0/f7 69 1 2024-09-19T09:02:32.447 INFO:tasks.workunit.client.1.smithi102.stdout:7/205: truncate d1/d4/df/d25/f26 2426229 0 2024-09-19T09:02:32.447 INFO:tasks.workunit.client.1.smithi102.stdout:9/184: rmdir d1/d2/d3/d34/d36 0 2024-09-19T09:02:32.448 INFO:tasks.workunit.client.1.smithi102.stdout:7/206: write d1/d4/f1a [754118,99503] 0 2024-09-19T09:02:32.450 INFO:tasks.workunit.client.1.smithi102.stdout:4/219: fsync fe 0 2024-09-19T09:02:32.452 INFO:tasks.workunit.client.1.smithi102.stdout:8/230: creat d0/d10/d21/d39/f3f x:0 0 0 2024-09-19T09:02:32.453 INFO:tasks.workunit.client.1.smithi102.stdout:8/231: dread - d0/d10/d21/f2e zero size 2024-09-19T09:02:32.453 INFO:tasks.workunit.client.1.smithi102.stdout:9/185: creat d1/d8/d1c/f3e x:0 0 0 2024-09-19T09:02:32.454 INFO:tasks.workunit.client.1.smithi102.stdout:8/232: write d0/db/f3b [231552,115606] 0 2024-09-19T09:02:32.455 INFO:tasks.workunit.client.1.smithi102.stdout:7/207: creat d1/d2f/f41 x:0 0 0 2024-09-19T09:02:32.460 INFO:tasks.workunit.client.1.smithi102.stdout:6/222: write d1/d18/f25 [3929503,72617] 0 2024-09-19T09:02:32.461 INFO:tasks.workunit.client.1.smithi102.stdout:9/186: dwrite d1/d2/d3/d1d/f35 [0,4194304] 0 2024-09-19T09:02:32.461 INFO:tasks.workunit.client.1.smithi102.stdout:7/208: rename d1/d4/df/d25/l3b to d1/d4/df/d25/l42 0 2024-09-19T09:02:32.466 INFO:tasks.workunit.client.1.smithi102.stdout:7/209: creat d1/d2d/f43 x:0 0 0 2024-09-19T09:02:32.467 INFO:tasks.workunit.client.1.smithi102.stdout:3/304: write d2/d19/d47/db/f1a [855033,78409] 0 2024-09-19T09:02:32.468 INFO:tasks.workunit.client.1.smithi102.stdout:7/210: fdatasync d1/d3/d20/f2c 0 2024-09-19T09:02:32.469 INFO:tasks.workunit.client.1.smithi102.stdout:8/233: link d0/db/d1d/l38 d0/d10/d21/d39/l40 0 2024-09-19T09:02:32.470 INFO:tasks.workunit.client.1.smithi102.stdout:7/211: fdatasync d1/d4/f21 0 2024-09-19T09:02:32.473 INFO:tasks.workunit.client.1.smithi102.stdout:4/220: dwrite fe [4194304,4194304] 0 2024-09-19T09:02:32.480 INFO:tasks.workunit.client.1.smithi102.stdout:4/221: chown d14/d16/d17/d25/d2f/l42 1693600830 1 2024-09-19T09:02:32.481 INFO:tasks.workunit.client.1.smithi102.stdout:9/187: truncate d1/d8/d1c/f28 807330 0 2024-09-19T09:02:32.483 INFO:tasks.workunit.client.1.smithi102.stdout:9/188: write d1/d2/f22 [70779,107263] 0 2024-09-19T09:02:32.484 INFO:tasks.workunit.client.1.smithi102.stdout:7/212: link d1/d2d/f43 d1/d3/d20/f44 0 2024-09-19T09:02:32.487 INFO:tasks.workunit.client.1.smithi102.stdout:4/222: dwrite d14/f32 [0,4194304] 0 2024-09-19T09:02:32.489 INFO:tasks.workunit.client.1.smithi102.stdout:9/189: symlink d1/d2/l3f 0 2024-09-19T09:02:32.490 INFO:tasks.workunit.client.1.smithi102.stdout:9/190: chown d1/d8/lc 4 1 2024-09-19T09:02:32.491 INFO:tasks.workunit.client.1.smithi102.stdout:4/223: creat d14/d16/d1d/f43 x:0 0 0 2024-09-19T09:02:32.492 INFO:tasks.workunit.client.1.smithi102.stdout:3/305: truncate d2/f9 2838555 0 2024-09-19T09:02:32.493 INFO:tasks.workunit.client.1.smithi102.stdout:9/191: write d1/d2/ff [1817173,81365] 0 2024-09-19T09:02:32.494 INFO:tasks.workunit.client.1.smithi102.stdout:3/306: dread - d2/d1e/f38 zero size 2024-09-19T09:02:32.495 INFO:tasks.workunit.client.1.smithi102.stdout:4/224: creat d14/d16/d1d/f44 x:0 0 0 2024-09-19T09:02:32.496 INFO:tasks.workunit.client.1.smithi102.stdout:9/192: dread - d1/d2/d3/f2c zero size 2024-09-19T09:02:32.497 INFO:tasks.workunit.client.1.smithi102.stdout:8/234: dwrite d0/d10/d21/f25 [4194304,4194304] 0 2024-09-19T09:02:32.497 INFO:tasks.workunit.client.1.smithi102.stdout:4/225: write d14/d16/f1e [4031675,53509] 0 2024-09-19T09:02:32.499 INFO:tasks.workunit.client.1.smithi102.stdout:3/307: creat d2/d19/d47/db/d26/f61 x:0 0 0 2024-09-19T09:02:32.502 INFO:tasks.workunit.client.1.smithi102.stdout:7/213: write d1/d4/df/d25/f2e [1551793,87478] 0 2024-09-19T09:02:32.504 INFO:tasks.workunit.client.1.smithi102.stdout:4/226: truncate d14/d16/d1d/f43 1037931 0 2024-09-19T09:02:32.511 INFO:tasks.workunit.client.1.smithi102.stdout:8/235: dwrite d0/f35 [0,4194304] 0 2024-09-19T09:02:32.512 INFO:tasks.workunit.client.1.smithi102.stdout:9/193: dwrite d1/d8/d1c/f3e [0,4194304] 0 2024-09-19T09:02:32.513 INFO:tasks.workunit.client.1.smithi102.stdout:9/194: stat d1/d2/d3/d1d/f20 0 2024-09-19T09:02:32.513 INFO:tasks.workunit.client.1.smithi102.stdout:4/227: rename d14/d16/d17/c39 to d14/d16/d17/d2e/c45 0 2024-09-19T09:02:32.515 INFO:tasks.workunit.client.1.smithi102.stdout:8/236: rmdir d0/d10/d21/d39 39 2024-09-19T09:02:32.520 INFO:tasks.workunit.client.1.smithi102.stdout:4/228: creat d14/d16/d17/f46 x:0 0 0 2024-09-19T09:02:32.521 INFO:tasks.workunit.client.1.smithi102.stdout:7/214: dwrite d1/d4/f6 [0,4194304] 0 2024-09-19T09:02:32.528 INFO:tasks.workunit.client.1.smithi102.stdout:9/195: creat d1/f40 x:0 0 0 2024-09-19T09:02:32.531 INFO:tasks.workunit.client.1.smithi102.stdout:4/229: dwrite d14/d16/d17/d25/f41 [0,4194304] 0 2024-09-19T09:02:32.534 INFO:tasks.workunit.client.1.smithi102.stdout:7/215: getdents d1/d3/d20 0 2024-09-19T09:02:32.535 INFO:tasks.workunit.client.1.smithi102.stdout:8/237: dwrite d0/d10/d21/d39/f3d [4194304,4194304] 0 2024-09-19T09:02:32.540 INFO:tasks.workunit.client.1.smithi102.stdout:4/230: rename d14/f32 to d14/d16/d17/d2e/f47 0 2024-09-19T09:02:32.547 INFO:tasks.workunit.client.1.smithi102.stdout:4/231: write d14/d16/d17/d2e/f47 [817845,106930] 0 2024-09-19T09:02:32.549 INFO:tasks.workunit.client.1.smithi102.stdout:4/232: stat d14/d16 0 2024-09-19T09:02:32.551 INFO:tasks.workunit.client.1.smithi102.stdout:7/216: dwrite d1/d4/f21 [0,4194304] 0 2024-09-19T09:02:32.551 INFO:tasks.workunit.client.1.smithi102.stdout:8/238: dwrite d0/d10/d21/d39/f3f [0,4194304] 0 2024-09-19T09:02:32.556 INFO:tasks.workunit.client.1.smithi102.stdout:8/239: chown d0/d10/f2d 15 1 2024-09-19T09:02:32.559 INFO:tasks.workunit.client.1.smithi102.stdout:3/308: dread d2/d19/d1c/f31 [0,4194304] 0 2024-09-19T09:02:32.559 INFO:tasks.workunit.client.1.smithi102.stdout:8/240: chown d0/d10/c11 7672870 1 2024-09-19T09:02:32.560 INFO:tasks.workunit.client.1.smithi102.stdout:9/196: dwrite d1/d2/d3/d1d/f32 [0,4194304] 0 2024-09-19T09:02:32.560 INFO:tasks.workunit.client.1.smithi102.stdout:7/217: rename d1/d4/df to d1/d4/d45 0 2024-09-19T09:02:32.562 INFO:tasks.workunit.client.1.smithi102.stdout:9/197: chown d1/d8/d1c/f21 1017638623 1 2024-09-19T09:02:32.563 INFO:tasks.workunit.client.1.smithi102.stdout:3/309: mknod d2/d19/d47/db/d26/c62 0 2024-09-19T09:02:32.565 INFO:tasks.workunit.client.1.smithi102.stdout:9/198: truncate d1/d2/ff 4302074 0 2024-09-19T09:02:32.566 INFO:tasks.workunit.client.1.smithi102.stdout:8/241: creat d0/d10/d3a/f41 x:0 0 0 2024-09-19T09:02:32.567 INFO:tasks.workunit.client.1.smithi102.stdout:3/310: write d2/d1e/f46 [172153,47391] 0 2024-09-19T09:02:32.570 INFO:tasks.workunit.client.1.smithi102.stdout:9/199: chown d1/d2/ff 9 1 2024-09-19T09:02:32.573 INFO:tasks.workunit.client.1.smithi102.stdout:7/218: dwrite d1/d3/d20/f2c [4194304,4194304] 0 2024-09-19T09:02:32.574 INFO:tasks.workunit.client.1.smithi102.stdout:8/242: getdents d0/db 0 2024-09-19T09:02:32.581 INFO:tasks.workunit.client.1.smithi102.stdout:8/243: rename d0/db/d1d/f22 to d0/f42 0 2024-09-19T09:02:32.581 INFO:tasks.workunit.client.1.smithi102.stdout:9/200: dwrite d1/d2/d3/d1d/f20 [4194304,4194304] 0 2024-09-19T09:02:32.582 INFO:tasks.workunit.client.1.smithi102.stdout:9/201: chown d1/f40 1010996151 1 2024-09-19T09:02:32.584 INFO:tasks.workunit.client.1.smithi102.stdout:7/219: dwrite d1/d3/d20/f35 [0,4194304] 0 2024-09-19T09:02:32.590 INFO:tasks.workunit.client.1.smithi102.stdout:4/233: write d14/d16/d17/d25/f40 [3462,113114] 0 2024-09-19T09:02:32.591 INFO:tasks.workunit.client.1.smithi102.stdout:5/280: sync 2024-09-19T09:02:32.592 INFO:tasks.workunit.client.1.smithi102.stdout:1/252: sync 2024-09-19T09:02:32.593 INFO:tasks.workunit.client.1.smithi102.stdout:1/253: stat dd/d14/l20 0 2024-09-19T09:02:32.597 INFO:tasks.workunit.client.1.smithi102.stdout:4/234: unlink d14/d16/d17/d2e/c45 0 2024-09-19T09:02:32.598 INFO:tasks.workunit.client.1.smithi102.stdout:4/235: readlink d14/d16/l2d 0 2024-09-19T09:02:32.600 INFO:tasks.workunit.client.1.smithi102.stdout:4/236: rmdir d14/d16/d17/d2e/d37 39 2024-09-19T09:02:32.605 INFO:tasks.workunit.client.1.smithi102.stdout:4/237: mkdir d14/d16/d1d/d48 0 2024-09-19T09:02:32.605 INFO:tasks.workunit.client.1.smithi102.stdout:3/311: write d2/ff [2299910,128436] 0 2024-09-19T09:02:32.605 INFO:tasks.workunit.client.1.smithi102.stdout:4/238: truncate d14/d16/d17/f46 155903 0 2024-09-19T09:02:32.607 INFO:tasks.workunit.client.1.smithi102.stdout:3/312: mkdir d2/d19/d47/db/d26/d63 0 2024-09-19T09:02:32.609 INFO:tasks.workunit.client.1.smithi102.stdout:4/239: getdents d14/d16/d17/d25/d2b 0 2024-09-19T09:02:32.610 INFO:tasks.workunit.client.1.smithi102.stdout:4/240: readlink d14/d16/l2d 0 2024-09-19T09:02:32.611 INFO:tasks.workunit.client.1.smithi102.stdout:4/241: readlink d14/l19 0 2024-09-19T09:02:32.615 INFO:tasks.workunit.client.1.smithi102.stdout:3/313: dwrite d2/d19/d47/db/d26/f5d [0,4194304] 0 2024-09-19T09:02:32.617 INFO:tasks.workunit.client.1.smithi102.stdout:7/220: write d1/d3/f3a [1509536,98027] 0 2024-09-19T09:02:32.620 INFO:tasks.workunit.client.1.smithi102.stdout:5/281: dread d5/d7/f1f [0,4194304] 0 2024-09-19T09:02:32.622 INFO:tasks.workunit.client.1.smithi102.stdout:7/221: chown d1/d3/f9 25183 1 2024-09-19T09:02:32.622 INFO:tasks.workunit.client.1.smithi102.stdout:3/314: mkdir d2/d19/d1c/d2f/d39/d64 0 2024-09-19T09:02:32.624 INFO:tasks.workunit.client.1.smithi102.stdout:5/282: dread - d5/d7/d1a/d42/f44 zero size 2024-09-19T09:02:32.625 INFO:tasks.workunit.client.1.smithi102.stdout:4/242: dwrite d14/d34/f28 [0,4194304] 0 2024-09-19T09:02:32.625 INFO:tasks.workunit.client.1.smithi102.stdout:7/222: mknod d1/d4/c46 0 2024-09-19T09:02:32.626 INFO:tasks.workunit.client.1.smithi102.stdout:9/202: dwrite d1/d8/d1c/f28 [0,4194304] 0 2024-09-19T09:02:32.627 INFO:tasks.workunit.client.1.smithi102.stdout:7/223: write d1/d3/d20/f35 [3985754,95969] 0 2024-09-19T09:02:32.630 INFO:tasks.workunit.client.1.smithi102.stdout:4/243: rename c10 to d14/d16/d17/c49 0 2024-09-19T09:02:32.632 INFO:tasks.workunit.client.1.smithi102.stdout:3/315: dread d2/d19/d47/db/f17 [0,4194304] 0 2024-09-19T09:02:32.635 INFO:tasks.workunit.client.1.smithi102.stdout:4/244: readlink d14/l1b 0 2024-09-19T09:02:32.636 INFO:tasks.workunit.client.1.smithi102.stdout:7/224: dread d1/d4/d45/d25/f26 [0,4194304] 0 2024-09-19T09:02:32.638 INFO:tasks.workunit.client.1.smithi102.stdout:3/316: symlink d2/l65 0 2024-09-19T09:02:32.642 INFO:tasks.workunit.client.1.smithi102.stdout:4/245: dwrite fe [0,4194304] 0 2024-09-19T09:02:32.643 INFO:tasks.workunit.client.1.smithi102.stdout:4/246: stat l5 0 2024-09-19T09:02:32.644 INFO:tasks.workunit.client.1.smithi102.stdout:7/225: fsync d1/d3/f9 0 2024-09-19T09:02:32.644 INFO:tasks.workunit.client.1.smithi102.stdout:4/247: write f12 [2391227,63460] 0 2024-09-19T09:02:32.644 INFO:tasks.workunit.client.1.smithi102.stdout:3/317: rmdir d2/d19/d47/db 39 2024-09-19T09:02:32.647 INFO:tasks.workunit.client.1.smithi102.stdout:7/226: mknod d1/d4/d45/d25/c47 0 2024-09-19T09:02:32.648 INFO:tasks.workunit.client.1.smithi102.stdout:3/318: creat d2/d1e/d54/f66 x:0 0 0 2024-09-19T09:02:32.648 INFO:tasks.workunit.client.1.smithi102.stdout:7/227: write d1/d3/f9 [702779,122937] 0 2024-09-19T09:02:32.650 INFO:tasks.workunit.client.1.smithi102.stdout:4/248: rename fc to d14/d16/d17/d2e/d37/f4a 0 2024-09-19T09:02:32.653 INFO:tasks.workunit.client.1.smithi102.stdout:9/203: dread d1/d2/ff [0,4194304] 0 2024-09-19T09:02:32.654 INFO:tasks.workunit.client.1.smithi102.stdout:9/204: dread - d1/d2/d3/f38 zero size 2024-09-19T09:02:32.654 INFO:tasks.workunit.client.1.smithi102.stdout:7/228: rename d1/d4/l3c to d1/d3/d20/l48 0 2024-09-19T09:02:32.655 INFO:tasks.workunit.client.1.smithi102.stdout:9/205: write d1/d2/d3/d1d/f32 [5107090,60433] 0 2024-09-19T09:02:32.655 INFO:tasks.workunit.client.1.smithi102.stdout:3/319: symlink d2/d19/l67 0 2024-09-19T09:02:32.656 INFO:tasks.workunit.client.1.smithi102.stdout:7/229: truncate d1/d4/f1b 1398988 0 2024-09-19T09:02:32.658 INFO:tasks.workunit.client.1.smithi102.stdout:4/249: creat d14/d16/d17/d25/f4b x:0 0 0 2024-09-19T09:02:32.659 INFO:tasks.workunit.client.1.smithi102.stdout:9/206: creat d1/d2/d3/f41 x:0 0 0 2024-09-19T09:02:32.661 INFO:tasks.workunit.client.1.smithi102.stdout:3/320: mkdir d2/d19/d47/db/d26/d68 0 2024-09-19T09:02:32.663 INFO:tasks.workunit.client.1.smithi102.stdout:3/321: write d2/d19/d47/db/f1a [1398303,95198] 0 2024-09-19T09:02:32.663 INFO:tasks.workunit.client.1.smithi102.stdout:7/230: dwrite d1/d3/d20/f35 [0,4194304] 0 2024-09-19T09:02:32.664 INFO:tasks.workunit.client.1.smithi102.stdout:3/322: readlink d2/l4 0 2024-09-19T09:02:32.664 INFO:tasks.workunit.client.1.smithi102.stdout:4/250: mknod d14/d16/d17/d2e/c4c 0 2024-09-19T09:02:32.665 INFO:tasks.workunit.client.1.smithi102.stdout:3/323: chown d2/d19/d1c/d2f/f55 408946053 1 2024-09-19T09:02:32.665 INFO:tasks.workunit.client.1.smithi102.stdout:9/207: symlink d1/d2/l42 0 2024-09-19T09:02:32.670 INFO:tasks.workunit.client.1.smithi102.stdout:7/231: dwrite d1/f5 [0,4194304] 0 2024-09-19T09:02:32.670 INFO:tasks.workunit.client.1.smithi102.stdout:4/251: rmdir d14/d16/d17/d25/d2b 39 2024-09-19T09:02:32.675 INFO:tasks.workunit.client.1.smithi102.stdout:9/208: truncate d1/d8/d1c/f21 991379 0 2024-09-19T09:02:32.676 INFO:tasks.workunit.client.1.smithi102.stdout:9/209: fdatasync d1/d2/f22 0 2024-09-19T09:02:32.678 INFO:tasks.workunit.client.1.smithi102.stdout:7/232: dwrite d1/d4/f21 [4194304,4194304] 0 2024-09-19T09:02:32.679 INFO:tasks.workunit.client.1.smithi102.stdout:3/324: symlink d2/d19/d47/db/d26/d63/l69 0 2024-09-19T09:02:32.684 INFO:tasks.workunit.client.1.smithi102.stdout:4/252: rmdir d14/d16 39 2024-09-19T09:02:32.688 INFO:tasks.workunit.client.1.smithi102.stdout:3/325: rename d2/d19/d47/db/d26/d63/l69 to d2/d19/d1c/d2f/d39/d64/l6a 0 2024-09-19T09:02:32.688 INFO:tasks.workunit.client.1.smithi102.stdout:7/233: dwrite d1/f1e [0,4194304] 0 2024-09-19T09:02:32.689 INFO:tasks.workunit.client.1.smithi102.stdout:4/253: creat d14/d34/f4d x:0 0 0 2024-09-19T09:02:32.689 INFO:tasks.workunit.client.1.smithi102.stdout:4/254: chown fe 8836 1 2024-09-19T09:02:32.691 INFO:tasks.workunit.client.1.smithi102.stdout:7/234: symlink d1/d2d/l49 0 2024-09-19T09:02:32.695 INFO:tasks.workunit.client.1.smithi102.stdout:3/326: rmdir d2/d1e/d4c 0 2024-09-19T09:02:32.700 INFO:tasks.workunit.client.1.smithi102.stdout:4/255: creat d14/d16/d17/d2e/f4e x:0 0 0 2024-09-19T09:02:32.703 INFO:tasks.workunit.client.1.smithi102.stdout:7/235: dread d1/f14 [0,4194304] 0 2024-09-19T09:02:32.708 INFO:tasks.workunit.client.1.smithi102.stdout:3/327: dwrite d2/d19/d1c/d1f/f60 [0,4194304] 0 2024-09-19T09:02:32.709 INFO:tasks.workunit.client.1.smithi102.stdout:4/256: link d14/d16/d17/c22 d14/d16/d17/d2e/c4f 0 2024-09-19T09:02:32.709 INFO:tasks.workunit.client.1.smithi102.stdout:9/210: dwrite d1/d2/d3/f12 [0,4194304] 0 2024-09-19T09:02:32.710 INFO:tasks.workunit.client.1.smithi102.stdout:4/257: fdatasync fd 0 2024-09-19T09:02:32.713 INFO:tasks.workunit.client.1.smithi102.stdout:9/211: read d1/d2/f25 [86648,4948] 0 2024-09-19T09:02:32.714 INFO:tasks.workunit.client.1.smithi102.stdout:2/174: sync 2024-09-19T09:02:32.715 INFO:tasks.workunit.client.1.smithi102.stdout:7/236: dwrite d1/f5 [0,4194304] 0 2024-09-19T09:02:32.716 INFO:tasks.workunit.client.1.smithi102.stdout:2/175: dread - d7/d1a/d2b/f2d zero size 2024-09-19T09:02:32.716 INFO:tasks.workunit.client.1.smithi102.stdout:4/258: creat d14/d16/d1d/f50 x:0 0 0 2024-09-19T09:02:32.717 INFO:tasks.workunit.client.1.smithi102.stdout:4/259: read d14/d16/d1d/f43 [711259,119986] 0 2024-09-19T09:02:32.723 INFO:tasks.workunit.client.1.smithi102.stdout:7/237: dwrite d1/d4/d45/d25/f2e [0,4194304] 0 2024-09-19T09:02:32.724 INFO:tasks.workunit.client.1.smithi102.stdout:2/176: rename d7/d12/f38 to d7/d12/f3b 0 2024-09-19T09:02:32.726 INFO:tasks.workunit.client.1.smithi102.stdout:4/260: chown d14/d16/d17/c49 0 1 2024-09-19T09:02:32.728 INFO:tasks.workunit.client.1.smithi102.stdout:4/261: dread - d14/d16/d1d/f44 zero size 2024-09-19T09:02:32.729 INFO:tasks.workunit.client.1.smithi102.stdout:2/177: creat d7/d1a/d2b/d31/f3c x:0 0 0 2024-09-19T09:02:32.730 INFO:tasks.workunit.client.1.smithi102.stdout:2/178: readlink d7/d12/l2e 0 2024-09-19T09:02:32.731 INFO:tasks.workunit.client.1.smithi102.stdout:7/238: dread d1/f5 [0,4194304] 0 2024-09-19T09:02:32.732 INFO:tasks.workunit.client.1.smithi102.stdout:9/212: getdents d1/d2/d3 0 2024-09-19T09:02:32.733 INFO:tasks.workunit.client.1.smithi102.stdout:7/239: write d1/f1e [2714133,31813] 0 2024-09-19T09:02:32.735 INFO:tasks.workunit.client.1.smithi102.stdout:4/262: mknod d14/d16/d17/d2e/c51 0 2024-09-19T09:02:32.740 INFO:tasks.workunit.client.1.smithi102.stdout:7/240: rename d1/d4/f1b to d1/d2f/f4a 0 2024-09-19T09:02:32.744 INFO:tasks.workunit.client.1.smithi102.stdout:4/263: symlink d14/d16/d17/d25/l52 0 2024-09-19T09:02:32.745 INFO:tasks.workunit.client.1.smithi102.stdout:4/264: write d14/d16/d17/d25/f3d [397848,4986] 0 2024-09-19T09:02:32.746 INFO:tasks.workunit.client.1.smithi102.stdout:7/241: creat d1/d4/d45/d25/f4b x:0 0 0 2024-09-19T09:02:32.747 INFO:tasks.workunit.client.1.smithi102.stdout:4/265: truncate d14/d34/f4d 763603 0 2024-09-19T09:02:32.748 INFO:tasks.workunit.client.1.smithi102.stdout:4/266: chown d14/d16/d1d 60 1 2024-09-19T09:02:32.749 INFO:tasks.workunit.client.1.smithi102.stdout:9/213: getdents d1/d8/d1c 0 2024-09-19T09:02:32.751 INFO:tasks.workunit.client.1.smithi102.stdout:2/179: write d7/f10 [753637,69688] 0 2024-09-19T09:02:32.752 INFO:tasks.workunit.client.1.smithi102.stdout:9/214: dread d1/d8/f2e [0,4194304] 0 2024-09-19T09:02:32.753 INFO:tasks.workunit.client.1.smithi102.stdout:4/267: truncate d14/d16/d17/d25/d2f/f38 128783 0 2024-09-19T09:02:32.755 INFO:tasks.workunit.client.1.smithi102.stdout:7/242: dwrite d1/d4/f1a [0,4194304] 0 2024-09-19T09:02:32.758 INFO:tasks.workunit.client.1.smithi102.stdout:9/215: unlink d1/d2/l3a 0 2024-09-19T09:02:32.758 INFO:tasks.workunit.client.1.smithi102.stdout:9/216: chown d1/d8/d1c 9349472 1 2024-09-19T09:02:32.760 INFO:tasks.workunit.client.1.smithi102.stdout:2/180: dwrite d7/ff [4194304,4194304] 0 2024-09-19T09:02:32.760 INFO:tasks.workunit.client.1.smithi102.stdout:4/268: rename d14/d16/d17/d25/f40 to d14/d16/d1d/f53 0 2024-09-19T09:02:32.761 INFO:tasks.workunit.client.1.smithi102.stdout:7/243: creat d1/d3/d20/f4c x:0 0 0 2024-09-19T09:02:32.766 INFO:tasks.workunit.client.1.smithi102.stdout:9/217: dread d1/d2/d3/d1d/f32 [0,4194304] 0 2024-09-19T09:02:32.767 INFO:tasks.workunit.client.1.smithi102.stdout:9/218: dread - d1/d2/d3/f3c zero size 2024-09-19T09:02:32.768 INFO:tasks.workunit.client.1.smithi102.stdout:7/244: unlink d1/d4/d45/d25/f26 0 2024-09-19T09:02:32.769 INFO:tasks.workunit.client.1.smithi102.stdout:9/219: chown d1/d8/d1c/l24 16065453 1 2024-09-19T09:02:32.771 INFO:tasks.workunit.client.1.smithi102.stdout:7/245: unlink d1/d4/l13 0 2024-09-19T09:02:32.771 INFO:tasks.workunit.client.1.smithi102.stdout:4/269: getdents d14/d16 0 2024-09-19T09:02:32.772 INFO:tasks.workunit.client.1.smithi102.stdout:7/246: dread - d1/d4/f3d zero size 2024-09-19T09:02:32.772 INFO:tasks.workunit.client.1.smithi102.stdout:7/247: chown d1/d4/ce 74226 1 2024-09-19T09:02:32.773 INFO:tasks.workunit.client.1.smithi102.stdout:4/270: write d14/d16/d17/d25/d2f/f38 [268392,105086] 0 2024-09-19T09:02:32.773 INFO:tasks.workunit.client.1.smithi102.stdout:9/220: creat d1/d2/f43 x:0 0 0 2024-09-19T09:02:32.780 INFO:tasks.workunit.client.1.smithi102.stdout:2/181: dread d7/fc [0,4194304] 0 2024-09-19T09:02:32.783 INFO:tasks.workunit.client.1.smithi102.stdout:2/182: mkdir d7/d1a/d3d 0 2024-09-19T09:02:32.783 INFO:tasks.workunit.client.1.smithi102.stdout:9/221: dwrite d1/d2/d3/f13 [4194304,4194304] 0 2024-09-19T09:02:32.785 INFO:tasks.workunit.client.1.smithi102.stdout:4/271: dwrite d14/d16/d17/d25/d2f/f36 [0,4194304] 0 2024-09-19T09:02:32.787 INFO:tasks.workunit.client.1.smithi102.stdout:2/183: creat d7/d1a/d2b/d31/f3e x:0 0 0 2024-09-19T09:02:32.793 INFO:tasks.workunit.client.1.smithi102.stdout:4/272: dread d14/d16/f26 [0,4194304] 0 2024-09-19T09:02:32.793 INFO:tasks.workunit.client.1.smithi102.stdout:9/222: getdents d1/d2/d3/d34 0 2024-09-19T09:02:32.797 INFO:tasks.workunit.client.1.smithi102.stdout:9/223: unlink d1/d2/c14 0 2024-09-19T09:02:32.797 INFO:tasks.workunit.client.1.smithi102.stdout:7/248: dwrite d1/d2d/f43 [0,4194304] 0 2024-09-19T09:02:32.801 INFO:tasks.workunit.client.1.smithi102.stdout:7/249: symlink d1/d3/d20/l4d 0 2024-09-19T09:02:32.802 INFO:tasks.workunit.client.1.smithi102.stdout:9/224: creat d1/d8/f44 x:0 0 0 2024-09-19T09:02:32.808 INFO:tasks.workunit.client.1.smithi102.stdout:7/250: dwrite d1/d3/f3a [0,4194304] 0 2024-09-19T09:02:32.808 INFO:tasks.workunit.client.1.smithi102.stdout:9/225: creat d1/f45 x:0 0 0 2024-09-19T09:02:32.811 INFO:tasks.workunit.client.1.smithi102.stdout:7/251: creat d1/d4/d45/d25/f4e x:0 0 0 2024-09-19T09:02:32.812 INFO:tasks.workunit.client.1.smithi102.stdout:9/226: creat d1/d2/d3/d34/f46 x:0 0 0 2024-09-19T09:02:32.813 INFO:tasks.workunit.client.1.smithi102.stdout:9/227: fsync d1/d2/d3/f13 0 2024-09-19T09:02:32.815 INFO:tasks.workunit.client.1.smithi102.stdout:9/228: chown d1/d8/d1c/c23 65170 1 2024-09-19T09:02:32.815 INFO:tasks.workunit.client.1.smithi102.stdout:4/273: dwrite d14/d16/d17/d2e/d37/f4a [4194304,4194304] 0 2024-09-19T09:02:32.815 INFO:tasks.workunit.client.1.smithi102.stdout:7/252: mkdir d1/d3/d34/d4f 0 2024-09-19T09:02:32.815 INFO:tasks.workunit.client.1.smithi102.stdout:9/229: readlink d1/d2/l3f 0 2024-09-19T09:02:32.818 INFO:tasks.workunit.client.1.smithi102.stdout:4/274: symlink d14/d16/d1d/l54 0 2024-09-19T09:02:32.820 INFO:tasks.workunit.client.1.smithi102.stdout:4/275: chown d14/d16/d17/d2e/c4c 5 1 2024-09-19T09:02:32.821 INFO:tasks.workunit.client.1.smithi102.stdout:9/230: mknod d1/d2/d3/d34/c47 0 2024-09-19T09:02:32.822 INFO:tasks.workunit.client.1.smithi102.stdout:9/231: rename d1/d2/d3 to d1/d2/d3/d48 22 2024-09-19T09:02:32.823 INFO:tasks.workunit.client.1.smithi102.stdout:9/232: stat d1/d2/d3/d1d/f20 0 2024-09-19T09:02:32.826 INFO:tasks.workunit.client.1.smithi102.stdout:4/276: creat d14/d34/f55 x:0 0 0 2024-09-19T09:02:32.827 INFO:tasks.workunit.client.1.smithi102.stdout:9/233: dread d1/d2/d3/f31 [0,4194304] 0 2024-09-19T09:02:32.829 INFO:tasks.workunit.client.1.smithi102.stdout:9/234: write d1/d2/d3/d1d/f20 [4983918,68460] 0 2024-09-19T09:02:32.829 INFO:tasks.workunit.client.1.smithi102.stdout:9/235: readlink d1/d2/d3/l3d 0 2024-09-19T09:02:32.831 INFO:tasks.workunit.client.1.smithi102.stdout:9/236: fsync d1/d8/d1c/f21 0 2024-09-19T09:02:32.836 INFO:tasks.workunit.client.1.smithi102.stdout:9/237: getdents d1/d2 0 2024-09-19T09:02:32.839 INFO:tasks.workunit.client.1.smithi102.stdout:7/253: dread d1/d3/f1c [0,4194304] 0 2024-09-19T09:02:32.840 INFO:tasks.workunit.client.1.smithi102.stdout:4/277: truncate d14/d16/d17/f1f 1891581 0 2024-09-19T09:02:32.841 INFO:tasks.workunit.client.1.smithi102.stdout:4/278: write fe [3542392,74315] 0 2024-09-19T09:02:32.841 INFO:tasks.workunit.client.1.smithi102.stdout:7/254: rmdir d1/d2d 39 2024-09-19T09:02:32.842 INFO:tasks.workunit.client.1.smithi102.stdout:4/279: write d14/d16/f1e [2285752,18292] 0 2024-09-19T09:02:32.850 INFO:tasks.workunit.client.1.smithi102.stdout:7/255: dwrite d1/d3/f3a [0,4194304] 0 2024-09-19T09:02:32.852 INFO:tasks.workunit.client.1.smithi102.stdout:4/280: dwrite d14/d16/d17/d25/d2f/f36 [0,4194304] 0 2024-09-19T09:02:32.856 INFO:tasks.workunit.client.1.smithi102.stdout:7/256: dread d1/d4/f1a [0,4194304] 0 2024-09-19T09:02:32.856 INFO:tasks.workunit.client.1.smithi102.stdout:4/281: mknod d14/d16/c56 0 2024-09-19T09:02:32.863 INFO:tasks.workunit.client.1.smithi102.stdout:7/257: fdatasync d1/d4/f6 0 2024-09-19T09:02:32.863 INFO:tasks.workunit.client.1.smithi102.stdout:7/258: chown d1/d3/d20/l4d 402 1 2024-09-19T09:02:32.864 INFO:tasks.workunit.client.1.smithi102.stdout:7/259: fdatasync d1/d4/d45/d25/f2e 0 2024-09-19T09:02:32.878 INFO:tasks.workunit.client.1.smithi102.stdout:0/278: sync 2024-09-19T09:02:32.879 INFO:tasks.workunit.client.1.smithi102.stdout:0/279: write d3/dd/d10/d15/d19/f46 [612344,62416] 0 2024-09-19T09:02:32.881 INFO:tasks.workunit.client.1.smithi102.stdout:0/280: fsync d3/dd/d10/d15/d19/f46 0 2024-09-19T09:02:32.885 INFO:tasks.workunit.client.1.smithi102.stdout:0/281: rename d3/dd/d10/d15/d2c/c2e to d3/dd/d10/d15/d3e/c57 0 2024-09-19T09:02:32.886 INFO:tasks.workunit.client.1.smithi102.stdout:4/282: symlink d14/d16/d1d/d48/l57 0 2024-09-19T09:02:32.887 INFO:tasks.workunit.client.1.smithi102.stdout:7/260: truncate d1/d2f/f4a 831373 0 2024-09-19T09:02:32.888 INFO:tasks.workunit.client.1.smithi102.stdout:0/282: creat d3/d8/f58 x:0 0 0 2024-09-19T09:02:32.888 INFO:tasks.workunit.client.1.smithi102.stdout:0/283: chown d3/f14 7296045 1 2024-09-19T09:02:32.890 INFO:tasks.workunit.client.1.smithi102.stdout:7/261: creat d1/d3/d34/d4f/f50 x:0 0 0 2024-09-19T09:02:32.890 INFO:tasks.workunit.client.1.smithi102.stdout:7/262: dread - d1/d2f/f41 zero size 2024-09-19T09:02:32.891 INFO:tasks.workunit.client.1.smithi102.stdout:4/283: mkdir d14/d16/d17/d2e/d37/d58 0 2024-09-19T09:02:32.892 INFO:tasks.workunit.client.1.smithi102.stdout:7/263: write d1/d3/d34/d4f/f50 [360097,44673] 0 2024-09-19T09:02:32.892 INFO:tasks.workunit.client.1.smithi102.stdout:0/284: creat d3/dd/d10/d15/d2c/f59 x:0 0 0 2024-09-19T09:02:32.895 INFO:tasks.workunit.client.1.smithi102.stdout:4/284: mknod d14/d16/d17/d25/d2b/c59 0 2024-09-19T09:02:32.896 INFO:tasks.workunit.client.1.smithi102.stdout:0/285: mknod d3/dd/d10/d15/d22/d37/d39/d44/d54/c5a 0 2024-09-19T09:02:32.897 INFO:tasks.workunit.client.1.smithi102.stdout:4/285: mkdir d14/d34/d5a 0 2024-09-19T09:02:32.897 INFO:tasks.workunit.client.1.smithi102.stdout:0/286: write d3/f14 [62926,47887] 0 2024-09-19T09:02:32.899 INFO:tasks.workunit.client.1.smithi102.stdout:7/264: dwrite d1/d3/d20/f4c [0,4194304] 0 2024-09-19T09:02:32.903 INFO:tasks.workunit.client.1.smithi102.stdout:4/286: dread d14/d16/d17/d25/d2f/f38 [0,4194304] 0 2024-09-19T09:02:32.903 INFO:tasks.workunit.client.1.smithi102.stdout:0/287: mkdir d3/dd/d5b 0 2024-09-19T09:02:32.911 INFO:tasks.workunit.client.1.smithi102.stdout:7/265: mknod d1/c51 0 2024-09-19T09:02:32.913 INFO:tasks.workunit.client.1.smithi102.stdout:4/287: mknod d14/d16/d17/d2e/d37/d58/c5b 0 2024-09-19T09:02:32.918 INFO:tasks.workunit.client.1.smithi102.stdout:4/288: dwrite d14/d16/d17/d25/f4b [0,4194304] 0 2024-09-19T09:02:32.939 INFO:tasks.workunit.client.1.smithi102.stdout:0/288: rmdir d3/dd/d10/d15/d22/d37 39 2024-09-19T09:02:32.942 INFO:tasks.workunit.client.1.smithi102.stdout:0/289: symlink d3/d8/de/l5c 0 2024-09-19T09:02:32.944 INFO:tasks.workunit.client.1.smithi102.stdout:0/290: rmdir d3/dd/d10/d15/d19 39 2024-09-19T09:02:32.949 INFO:tasks.workunit.client.1.smithi102.stdout:0/291: mknod d3/dd/d10/d15/d22/d37/d39/d44/d54/c5d 0 2024-09-19T09:02:32.949 INFO:tasks.workunit.client.1.smithi102.stdout:0/292: dread - d3/dd/f21 zero size 2024-09-19T09:02:32.952 INFO:tasks.workunit.client.1.smithi102.stdout:0/293: creat d3/dd/d10/d15/d3e/f5e x:0 0 0 2024-09-19T09:02:32.953 INFO:tasks.workunit.client.1.smithi102.stdout:0/294: fdatasync d3/dd/d10/d15/d22/d37/f52 0 2024-09-19T09:02:32.956 INFO:tasks.workunit.client.1.smithi102.stdout:0/295: dread d3/dd/d10/d15/d22/f2f [0,4194304] 0 2024-09-19T09:02:32.959 INFO:tasks.workunit.client.1.smithi102.stdout:0/296: symlink d3/dd/d10/d15/d22/d37/l5f 0 2024-09-19T09:02:32.966 INFO:tasks.workunit.client.1.smithi102.stdout:4/289: write d14/d16/d17/f1f [1801695,68790] 0 2024-09-19T09:02:32.967 INFO:tasks.workunit.client.1.smithi102.stdout:0/297: truncate d3/dd/d10/d15/d19/f46 41181 0 2024-09-19T09:02:32.968 INFO:tasks.workunit.client.1.smithi102.stdout:0/298: read d3/dd/d10/d15/d2c/f3b [209884,96773] 0 2024-09-19T09:02:32.972 INFO:tasks.workunit.client.1.smithi102.stdout:4/290: mkdir d14/d34/d5a/d5c 0 2024-09-19T09:02:32.977 INFO:tasks.workunit.client.1.smithi102.stdout:4/291: dwrite d14/d16/d17/d25/f33 [0,4194304] 0 2024-09-19T09:02:32.979 INFO:tasks.workunit.client.1.smithi102.stdout:0/299: creat d3/dd/d10/d15/f60 x:0 0 0 2024-09-19T09:02:32.982 INFO:tasks.workunit.client.1.smithi102.stdout:4/292: dread d14/d16/d17/d2e/f47 [0,4194304] 0 2024-09-19T09:02:32.983 INFO:tasks.workunit.client.1.smithi102.stdout:0/300: rmdir d3/dd/d10/d15/d22/d37/d39 39 2024-09-19T09:02:32.985 INFO:tasks.workunit.client.1.smithi102.stdout:4/293: creat d14/d16/d17/d2e/d37/f5d x:0 0 0 2024-09-19T09:02:32.986 INFO:tasks.workunit.client.1.smithi102.stdout:4/294: chown d14/d16/d17/f46 166672928 1 2024-09-19T09:02:32.986 INFO:tasks.workunit.client.1.smithi102.stdout:0/301: rmdir d3/dd/d10/d15/d22/d37/d3d 39 2024-09-19T09:02:32.987 INFO:tasks.workunit.client.1.smithi102.stdout:0/302: chown d3/dd/d10/d15/d22/d2a 9566 1 2024-09-19T09:02:32.990 INFO:tasks.workunit.client.1.smithi102.stdout:0/303: chown d3/l4 12640231 1 2024-09-19T09:02:32.990 INFO:tasks.workunit.client.1.smithi102.stdout:0/304: chown d3/dd/d10/d15/d2c/f59 349 1 2024-09-19T09:02:32.991 INFO:tasks.workunit.client.1.smithi102.stdout:4/295: mkdir d14/d5e 0 2024-09-19T09:02:32.993 INFO:tasks.workunit.client.1.smithi102.stdout:4/296: dread d14/d16/d17/d25/d2f/f38 [0,4194304] 0 2024-09-19T09:02:32.994 INFO:tasks.workunit.client.1.smithi102.stdout:0/305: fsync d3/dd/d10/d15/d22/d37/d39/d44/f4c 0 2024-09-19T09:02:32.995 INFO:tasks.workunit.client.1.smithi102.stdout:4/297: unlink d14/d34/f55 0 2024-09-19T09:02:32.999 INFO:tasks.workunit.client.1.smithi102.stdout:0/306: dwrite d3/dd/ff [0,4194304] 0 2024-09-19T09:02:33.000 INFO:tasks.workunit.client.1.smithi102.stdout:4/298: unlink d14/d16/d17/d25/f41 0 2024-09-19T09:02:33.005 INFO:tasks.workunit.client.1.smithi102.stdout:4/299: rename d14/d16/d17/d2e/d37/f5d to d14/d16/d17/d25/d2f/f5f 0 2024-09-19T09:02:33.008 INFO:tasks.workunit.client.1.smithi102.stdout:0/307: dwrite d3/dd/d10/d15/d22/d37/d3d/f48 [0,4194304] 0 2024-09-19T09:02:33.015 INFO:tasks.workunit.client.1.smithi102.stdout:4/300: dwrite d14/d16/d17/d25/d2f/f36 [0,4194304] 0 2024-09-19T09:02:33.015 INFO:tasks.workunit.client.1.smithi102.stdout:0/308: rmdir d3/dd/d10/d15/d22/d37 39 2024-09-19T09:02:33.021 INFO:tasks.workunit.client.1.smithi102.stdout:0/309: write d3/dd/d10/d15/d22/d37/d39/d44/f4c [4284300,62448] 0 2024-09-19T09:02:33.023 INFO:tasks.workunit.client.1.smithi102.stdout:4/301: dwrite f12 [0,4194304] 0 2024-09-19T09:02:33.027 INFO:tasks.workunit.client.1.smithi102.stdout:0/310: mknod d3/dd/d10/d15/d19/c61 0 2024-09-19T09:02:33.027 INFO:tasks.workunit.client.1.smithi102.stdout:4/302: dread d14/d16/d17/d2e/f47 [0,4194304] 0 2024-09-19T09:02:33.028 INFO:tasks.workunit.client.1.smithi102.stdout:4/303: write d14/d16/d17/f1c [3724876,31792] 0 2024-09-19T09:02:33.035 INFO:tasks.workunit.client.1.smithi102.stdout:4/304: mkdir d14/d16/d17/d2e/d60 0 2024-09-19T09:02:33.038 INFO:tasks.workunit.client.1.smithi102.stdout:0/311: dwrite d3/dd/d1a/f1b [4194304,4194304] 0 2024-09-19T09:02:33.039 INFO:tasks.workunit.client.1.smithi102.stdout:0/312: chown d3/d8 111707 1 2024-09-19T09:02:33.039 INFO:tasks.workunit.client.1.smithi102.stdout:4/305: fdatasync d14/d16/d17/d25/d2f/f5f 0 2024-09-19T09:02:33.042 INFO:tasks.workunit.client.1.smithi102.stdout:0/313: mkdir d3/dd/d1a/d32/d62 0 2024-09-19T09:02:33.046 INFO:tasks.workunit.client.1.smithi102.stdout:4/306: creat d14/d5e/f61 x:0 0 0 2024-09-19T09:02:33.047 INFO:tasks.workunit.client.1.smithi102.stdout:4/307: chown d14/d16/d17/d2e 120182 1 2024-09-19T09:02:33.072 INFO:tasks.workunit.client.1.smithi102.stdout:6/223: sync 2024-09-19T09:02:33.081 INFO:tasks.workunit.client.1.smithi102.stdout:6/224: dread d1/ff [0,4194304] 0 2024-09-19T09:02:33.091 INFO:tasks.workunit.client.1.smithi102.stdout:6/225: mkdir d1/d26/d4b 0 2024-09-19T09:02:33.092 INFO:tasks.workunit.client.1.smithi102.stdout:4/308: dread d14/d16/f26 [0,4194304] 0 2024-09-19T09:02:33.100 INFO:tasks.workunit.client.1.smithi102.stdout:4/309: getdents d14/d16/d1d 0 2024-09-19T09:02:33.131 INFO:tasks.workunit.client.1.smithi102.stdout:1/254: sync 2024-09-19T09:02:33.131 INFO:tasks.workunit.client.1.smithi102.stdout:3/328: sync 2024-09-19T09:02:33.131 INFO:tasks.workunit.client.1.smithi102.stdout:8/244: sync 2024-09-19T09:02:33.132 INFO:tasks.workunit.client.1.smithi102.stdout:1/255: fsync dd/d14/d18/f29 0 2024-09-19T09:02:33.135 INFO:tasks.workunit.client.1.smithi102.stdout:3/329: symlink d2/d19/d1c/d2f/d39/d53/l6b 0 2024-09-19T09:02:33.136 INFO:tasks.workunit.client.1.smithi102.stdout:3/330: chown d2/d19 14683943 1 2024-09-19T09:02:33.137 INFO:tasks.workunit.client.1.smithi102.stdout:1/256: creat dd/d14/f52 x:0 0 0 2024-09-19T09:02:33.138 INFO:tasks.workunit.client.1.smithi102.stdout:3/331: creat d2/f6c x:0 0 0 2024-09-19T09:02:33.138 INFO:tasks.workunit.client.1.smithi102.stdout:3/332: rename d2/d19/d1c to d2/d19/d1c/d1f/d6d 22 2024-09-19T09:02:33.139 INFO:tasks.workunit.client.1.smithi102.stdout:3/333: stat d2/d19/d47/db/cc 0 2024-09-19T09:02:33.139 INFO:tasks.workunit.client.1.smithi102.stdout:3/334: dread - d2/d1e/f3b zero size 2024-09-19T09:02:33.139 INFO:tasks.workunit.client.1.smithi102.stdout:1/257: creat dd/d14/d35/d49/f53 x:0 0 0 2024-09-19T09:02:33.143 INFO:tasks.workunit.client.1.smithi102.stdout:3/335: unlink d2/d19/l50 0 2024-09-19T09:02:33.144 INFO:tasks.workunit.client.1.smithi102.stdout:3/336: truncate d2/d19/d1c/d2f/f55 1127637 0 2024-09-19T09:02:33.145 INFO:tasks.workunit.client.1.smithi102.stdout:1/258: mkdir dd/d14/d54 0 2024-09-19T09:02:33.164 INFO:tasks.workunit.client.1.smithi102.stdout:8/245: dwrite d0/db/d1d/f31 [0,4194304] 0 2024-09-19T09:02:33.166 INFO:tasks.workunit.client.1.smithi102.stdout:8/246: truncate d0/db/f15 691022 0 2024-09-19T09:02:33.167 INFO:tasks.workunit.client.1.smithi102.stdout:3/337: rmdir d2 39 2024-09-19T09:02:33.171 INFO:tasks.workunit.client.1.smithi102.stdout:3/338: symlink d2/d19/d1c/d2f/d39/l6e 0 2024-09-19T09:02:33.172 INFO:tasks.workunit.client.1.smithi102.stdout:1/259: write dd/d14/d18/f1f [858854,114743] 0 2024-09-19T09:02:33.174 INFO:tasks.workunit.client.1.smithi102.stdout:3/339: mkdir d2/d19/d47/db/d26/d63/d6f 0 2024-09-19T09:02:33.177 INFO:tasks.workunit.client.1.smithi102.stdout:3/340: mkdir d2/d19/d1c/d70 0 2024-09-19T09:02:33.177 INFO:tasks.workunit.client.1.smithi102.stdout:1/260: dwrite dd/d14/f26 [0,4194304] 0 2024-09-19T09:02:33.178 INFO:tasks.workunit.client.1.smithi102.stdout:1/261: chown dd/f16 0 1 2024-09-19T09:02:33.181 INFO:tasks.workunit.client.1.smithi102.stdout:1/262: symlink dd/d14/d35/d49/l55 0 2024-09-19T09:02:33.185 INFO:tasks.workunit.client.1.smithi102.stdout:3/341: dwrite d2/d19/d35/f4b [0,4194304] 0 2024-09-19T09:02:33.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/263: dread f6 [0,4194304] 0 2024-09-19T09:02:33.191 INFO:tasks.workunit.client.1.smithi102.stdout:8/247: dwrite d0/f16 [0,4194304] 0 2024-09-19T09:02:33.196 INFO:tasks.workunit.client.1.smithi102.stdout:3/342: creat d2/d19/d47/f71 x:0 0 0 2024-09-19T09:02:33.199 INFO:tasks.workunit.client.1.smithi102.stdout:8/248: dread d0/d10/d21/d39/f3d [4194304,4194304] 0 2024-09-19T09:02:33.204 INFO:tasks.workunit.client.1.smithi102.stdout:3/343: mkdir d2/d19/d1c/d2f/d39/d4f/d72 0 2024-09-19T09:02:33.205 INFO:tasks.workunit.client.1.smithi102.stdout:3/344: write d2/d19/d47/db/f1a [2490661,44174] 0 2024-09-19T09:02:33.206 INFO:tasks.workunit.client.1.smithi102.stdout:1/264: getdents dd/d13/d3b 0 2024-09-19T09:02:33.206 INFO:tasks.workunit.client.1.smithi102.stdout:1/265: chown dd/ff 206 1 2024-09-19T09:02:33.207 INFO:tasks.workunit.client.1.smithi102.stdout:1/266: write dd/f12 [3898276,19953] 0 2024-09-19T09:02:33.208 INFO:tasks.workunit.client.1.smithi102.stdout:8/249: creat d0/d10/d21/f43 x:0 0 0 2024-09-19T09:02:33.210 INFO:tasks.workunit.client.1.smithi102.stdout:3/345: creat d2/d19/f73 x:0 0 0 2024-09-19T09:02:33.211 INFO:tasks.workunit.client.1.smithi102.stdout:9/238: sync 2024-09-19T09:02:33.211 INFO:tasks.workunit.client.1.smithi102.stdout:7/266: sync 2024-09-19T09:02:33.211 INFO:tasks.workunit.client.1.smithi102.stdout:5/283: sync 2024-09-19T09:02:33.211 INFO:tasks.workunit.client.1.smithi102.stdout:2/184: sync 2024-09-19T09:02:33.211 INFO:tasks.workunit.client.1.smithi102.stdout:0/314: sync 2024-09-19T09:02:33.212 INFO:tasks.workunit.client.1.smithi102.stdout:7/267: chown d1/d2f 7 1 2024-09-19T09:02:33.217 INFO:tasks.workunit.client.1.smithi102.stdout:3/346: rename d2/c29 to d2/d19/d47/db/d26/d68/c74 0 2024-09-19T09:02:33.217 INFO:tasks.workunit.client.1.smithi102.stdout:1/267: read dd/f12 [2243637,41336] 0 2024-09-19T09:02:33.217 INFO:tasks.workunit.client.1.smithi102.stdout:8/250: link d0/db/l32 d0/db/d1d/l44 0 2024-09-19T09:02:33.217 INFO:tasks.workunit.client.1.smithi102.stdout:0/315: write d3/dd/d10/d15/d22/d37/f52 [648202,31196] 0 2024-09-19T09:02:33.217 INFO:tasks.workunit.client.1.smithi102.stdout:7/268: write d1/d4/d45/d25/f4e [291999,114685] 0 2024-09-19T09:02:33.218 INFO:tasks.workunit.client.1.smithi102.stdout:2/185: dread d7/d1a/f20 [0,4194304] 0 2024-09-19T09:02:33.218 INFO:tasks.workunit.client.1.smithi102.stdout:1/268: write dd/d13/d2d/f3c [146687,115537] 0 2024-09-19T09:02:33.218 INFO:tasks.workunit.client.1.smithi102.stdout:3/347: write d2/d19/d47/db/f44 [18206,16496] 0 2024-09-19T09:02:33.219 INFO:tasks.workunit.client.1.smithi102.stdout:7/269: readlink d1/l31 0 2024-09-19T09:02:33.221 INFO:tasks.workunit.client.1.smithi102.stdout:8/251: write d0/d10/d21/d39/f3f [4498595,45874] 0 2024-09-19T09:02:33.222 INFO:tasks.workunit.client.1.smithi102.stdout:5/284: mknod d5/d7/d1a/d37/d34/d4d/c56 0 2024-09-19T09:02:33.222 INFO:tasks.workunit.client.1.smithi102.stdout:0/316: creat d3/dd/d10/f63 x:0 0 0 2024-09-19T09:02:33.223 INFO:tasks.workunit.client.1.smithi102.stdout:2/186: read - d7/d12/f3b zero size 2024-09-19T09:02:33.223 INFO:tasks.workunit.client.1.smithi102.stdout:1/269: read fc [163289,93774] 0 2024-09-19T09:02:33.224 INFO:tasks.workunit.client.1.smithi102.stdout:3/348: truncate d2/d19/f73 478937 0 2024-09-19T09:02:33.225 INFO:tasks.workunit.client.1.smithi102.stdout:7/270: chown d1/d4/d45/l27 1068141740 1 2024-09-19T09:02:33.227 INFO:tasks.workunit.client.1.smithi102.stdout:8/252: creat d0/d10/d23/f45 x:0 0 0 2024-09-19T09:02:33.228 INFO:tasks.workunit.client.1.smithi102.stdout:9/239: dwrite d1/d2/d3/f31 [0,4194304] 0 2024-09-19T09:02:33.237 INFO:tasks.workunit.client.1.smithi102.stdout:2/187: dwrite d7/d12/f3b [0,4194304] 0 2024-09-19T09:02:33.237 INFO:tasks.workunit.client.1.smithi102.stdout:7/271: mkdir d1/d4/d45/d25/d52 0 2024-09-19T09:02:33.238 INFO:tasks.workunit.client.1.smithi102.stdout:0/317: getdents d3/dd/d5b 0 2024-09-19T09:02:33.238 INFO:tasks.workunit.client.1.smithi102.stdout:0/318: read - d3/dd/d10/f63 zero size 2024-09-19T09:02:33.240 INFO:tasks.workunit.client.1.smithi102.stdout:8/253: creat d0/d10/f46 x:0 0 0 2024-09-19T09:02:33.241 INFO:tasks.workunit.client.1.smithi102.stdout:8/254: write d0/db/d1d/f31 [4092329,64762] 0 2024-09-19T09:02:33.243 INFO:tasks.workunit.client.1.smithi102.stdout:1/270: dread dd/d14/d18/f3f [0,4194304] 0 2024-09-19T09:02:33.244 INFO:tasks.workunit.client.1.smithi102.stdout:5/285: creat d5/d7/d1a/d37/d50/f57 x:0 0 0 2024-09-19T09:02:33.244 INFO:tasks.workunit.client.1.smithi102.stdout:9/240: unlink d1/d2/f25 0 2024-09-19T09:02:33.248 INFO:tasks.workunit.client.1.smithi102.stdout:7/272: rename d1/f14 to d1/d4/f53 0 2024-09-19T09:02:33.251 INFO:tasks.workunit.client.1.smithi102.stdout:0/319: truncate f2 1505599 0 2024-09-19T09:02:33.252 INFO:tasks.workunit.client.1.smithi102.stdout:8/255: mknod d0/d10/c47 0 2024-09-19T09:02:33.254 INFO:tasks.workunit.client.1.smithi102.stdout:1/271: write dd/d14/d18/f3f [4343628,115957] 0 2024-09-19T09:02:33.257 INFO:tasks.workunit.client.1.smithi102.stdout:5/286: creat d5/d7/d1a/f58 x:0 0 0 2024-09-19T09:02:33.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:32 smithi102 ceph-mon[35280]: pgmap v23: 65 pgs: 65 active+clean; 277 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 16 MiB/s wr, 274 op/s 2024-09-19T09:02:33.265 INFO:tasks.workunit.client.1.smithi102.stdout:0/320: rename d3/dd/d1a/c42 to d3/dd/d1a/d32/c64 0 2024-09-19T09:02:33.265 INFO:tasks.workunit.client.1.smithi102.stdout:0/321: stat d3/f14 0 2024-09-19T09:02:33.265 INFO:tasks.workunit.client.1.smithi102.stdout:0/322: chown d3/dd/d1a/f51 6491616 1 2024-09-19T09:02:33.266 INFO:tasks.workunit.client.1.smithi102.stdout:1/272: rmdir dd/d14/d35/d49 39 2024-09-19T09:02:33.267 INFO:tasks.workunit.client.1.smithi102.stdout:0/323: chown d3/dd/d10/c4d 12 1 2024-09-19T09:02:33.275 INFO:tasks.workunit.client.1.smithi102.stdout:7/273: creat d1/d2d/f54 x:0 0 0 2024-09-19T09:02:33.275 INFO:tasks.workunit.client.1.smithi102.stdout:1/273: dwrite dd/d14/f26 [4194304,4194304] 0 2024-09-19T09:02:33.277 INFO:tasks.workunit.client.1.smithi102.stdout:8/256: rename d0/f16 to d0/d10/f48 0 2024-09-19T09:02:33.281 INFO:tasks.workunit.client.1.smithi102.stdout:5/287: rmdir d5/d7/d1a/d42 39 2024-09-19T09:02:33.282 INFO:tasks.workunit.client.1.smithi102.stdout:2/188: getdents d7/d1a/d2b/d31 0 2024-09-19T09:02:33.284 INFO:tasks.workunit.client.1.smithi102.stdout:9/241: creat d1/d2/d3/d1d/f49 x:0 0 0 2024-09-19T09:02:33.286 INFO:tasks.workunit.client.1.smithi102.stdout:8/257: mkdir d0/d10/d21/d39/d49 0 2024-09-19T09:02:33.288 INFO:tasks.workunit.client.1.smithi102.stdout:0/324: symlink d3/dd/d10/d15/l65 0 2024-09-19T09:02:33.291 INFO:tasks.workunit.client.1.smithi102.stdout:9/242: truncate d1/d8/d1c/f19 2239093 0 2024-09-19T09:02:33.291 INFO:tasks.workunit.client.1.smithi102.stdout:9/243: read - d1/d2/d3/d1d/f49 zero size 2024-09-19T09:02:33.293 INFO:tasks.workunit.client.1.smithi102.stdout:8/258: stat d0/db/l32 0 2024-09-19T09:02:33.293 INFO:tasks.workunit.client.1.smithi102.stdout:8/259: write d0/db/f3b [500228,108874] 0 2024-09-19T09:02:33.295 INFO:tasks.workunit.client.1.smithi102.stdout:5/288: symlink d5/d23/d3b/l59 0 2024-09-19T09:02:33.296 INFO:tasks.workunit.client.1.smithi102.stdout:1/274: dread fc [0,4194304] 0 2024-09-19T09:02:33.300 INFO:tasks.workunit.client.1.smithi102.stdout:9/244: dread - d1/d2/f43 zero size 2024-09-19T09:02:33.301 INFO:tasks.workunit.client.1.smithi102.stdout:8/260: creat d0/d10/d21/d39/f4a x:0 0 0 2024-09-19T09:02:33.301 INFO:tasks.workunit.client.1.smithi102.stdout:1/275: dwrite dd/d14/f26 [0,4194304] 0 2024-09-19T09:02:33.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:32 smithi049 ceph-mon[28158]: pgmap v23: 65 pgs: 65 active+clean; 277 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 16 MiB/s wr, 274 op/s 2024-09-19T09:02:33.302 INFO:tasks.workunit.client.1.smithi102.stdout:6/226: sync 2024-09-19T09:02:33.307 INFO:tasks.workunit.client.1.smithi102.stdout:2/189: link c4 d7/d12/c3f 0 2024-09-19T09:02:33.309 INFO:tasks.workunit.client.1.smithi102.stdout:7/274: getdents d1/d3/d34 0 2024-09-19T09:02:33.314 INFO:tasks.workunit.client.1.smithi102.stdout:5/289: symlink d5/d7/d1a/d37/d50/l5a 0 2024-09-19T09:02:33.315 INFO:tasks.workunit.client.1.smithi102.stdout:5/290: fsync d5/d23/f26 0 2024-09-19T09:02:33.316 INFO:tasks.workunit.client.1.smithi102.stdout:5/291: truncate d5/d7/d1a/f58 684392 0 2024-09-19T09:02:33.317 INFO:tasks.workunit.client.1.smithi102.stdout:1/276: creat dd/d13/f56 x:0 0 0 2024-09-19T09:02:33.317 INFO:tasks.workunit.client.1.smithi102.stdout:5/292: write d5/d7/d1b/f51 [446998,122704] 0 2024-09-19T09:02:33.318 INFO:tasks.workunit.client.1.smithi102.stdout:5/293: chown d5/d7/d1b/c3a 1831782 1 2024-09-19T09:02:33.319 INFO:tasks.workunit.client.1.smithi102.stdout:6/227: creat d1/d18/d2f/f4c x:0 0 0 2024-09-19T09:02:33.320 INFO:tasks.workunit.client.1.smithi102.stdout:2/190: creat d7/d12/f40 x:0 0 0 2024-09-19T09:02:33.320 INFO:tasks.workunit.client.1.smithi102.stdout:7/275: rmdir d1/d2d 39 2024-09-19T09:02:33.321 INFO:tasks.workunit.client.1.smithi102.stdout:5/294: write d5/d7/d1a/f58 [84600,5990] 0 2024-09-19T09:02:33.322 INFO:tasks.workunit.client.1.smithi102.stdout:0/325: getdents d3/dd/d10/d15/d2c 0 2024-09-19T09:02:33.324 INFO:tasks.workunit.client.1.smithi102.stdout:1/277: dread dd/d14/f26 [4194304,4194304] 0 2024-09-19T09:02:33.325 INFO:tasks.workunit.client.1.smithi102.stdout:0/326: write d3/dd/d10/d15/d22/d37/f52 [1118081,26933] 0 2024-09-19T09:02:33.325 INFO:tasks.workunit.client.1.smithi102.stdout:6/228: dread d1/ff [0,4194304] 0 2024-09-19T09:02:33.326 INFO:tasks.workunit.client.1.smithi102.stdout:5/295: dread d5/d7/d1a/d37/d34/f4e [0,4194304] 0 2024-09-19T09:02:33.329 INFO:tasks.workunit.client.1.smithi102.stdout:9/245: rename d1/d2/d3/d1d/f32 to d1/d2/f4a 0 2024-09-19T09:02:33.330 INFO:tasks.workunit.client.1.smithi102.stdout:7/276: fdatasync d1/d3/f1c 0 2024-09-19T09:02:33.332 INFO:tasks.workunit.client.1.smithi102.stdout:2/191: dwrite d7/d12/f17 [0,4194304] 0 2024-09-19T09:02:33.333 INFO:tasks.workunit.client.1.smithi102.stdout:2/192: stat d7/d12 0 2024-09-19T09:02:33.335 INFO:tasks.workunit.client.1.smithi102.stdout:5/296: dread - d5/d7/d1a/d42/f44 zero size 2024-09-19T09:02:33.336 INFO:tasks.workunit.client.1.smithi102.stdout:9/246: fdatasync d1/d2/d3/f12 0 2024-09-19T09:02:33.339 INFO:tasks.workunit.client.1.smithi102.stdout:2/193: dread d7/fc [0,4194304] 0 2024-09-19T09:02:33.341 INFO:tasks.workunit.client.1.smithi102.stdout:6/229: rename d1/d18/d2f to d1/d26/d2e/d45/d47/d4d 0 2024-09-19T09:02:33.343 INFO:tasks.workunit.client.1.smithi102.stdout:8/261: link d0/d10/l1a d0/l4b 0 2024-09-19T09:02:33.344 INFO:tasks.workunit.client.1.smithi102.stdout:0/327: dread d3/dd/f1f [0,4194304] 0 2024-09-19T09:02:33.345 INFO:tasks.workunit.client.1.smithi102.stdout:4/310: sync 2024-09-19T09:02:33.347 INFO:tasks.workunit.client.1.smithi102.stdout:2/194: dwrite d7/f10 [0,4194304] 0 2024-09-19T09:02:33.347 INFO:tasks.workunit.client.1.smithi102.stdout:5/297: creat d5/d7/d1a/d37/d34/f5b x:0 0 0 2024-09-19T09:02:33.347 INFO:tasks.workunit.client.1.smithi102.stdout:0/328: write d3/dd/d10/d15/d2c/f59 [234312,101089] 0 2024-09-19T09:02:33.349 INFO:tasks.workunit.client.1.smithi102.stdout:6/230: dread d1/ff [0,4194304] 0 2024-09-19T09:02:33.350 INFO:tasks.workunit.client.1.smithi102.stdout:0/329: write d3/dd/ff [4900383,107769] 0 2024-09-19T09:02:33.351 INFO:tasks.workunit.client.1.smithi102.stdout:5/298: read - d5/d7/d1a/d37/d50/f57 zero size 2024-09-19T09:02:33.352 INFO:tasks.workunit.client.1.smithi102.stdout:7/277: rename d1/l31 to d1/d4/d45/l55 0 2024-09-19T09:02:33.353 INFO:tasks.workunit.client.1.smithi102.stdout:0/330: fsync d3/dd/d10/d15/d2c/f56 0 2024-09-19T09:02:33.354 INFO:tasks.workunit.client.1.smithi102.stdout:7/278: fsync d1/d3/f9 0 2024-09-19T09:02:33.359 INFO:tasks.workunit.client.1.smithi102.stdout:6/231: creat d1/d18/d37/f4e x:0 0 0 2024-09-19T09:02:33.359 INFO:tasks.workunit.client.1.smithi102.stdout:7/279: dwrite d1/f1e [0,4194304] 0 2024-09-19T09:02:33.360 INFO:tasks.workunit.client.1.smithi102.stdout:5/299: creat d5/d23/d3b/f5c x:0 0 0 2024-09-19T09:02:33.361 INFO:tasks.workunit.client.1.smithi102.stdout:8/262: mknod d0/c4c 0 2024-09-19T09:02:33.361 INFO:tasks.workunit.client.1.smithi102.stdout:8/263: readlink d0/l30 0 2024-09-19T09:02:33.362 INFO:tasks.workunit.client.1.smithi102.stdout:1/278: getdents dd/d13 0 2024-09-19T09:02:33.363 INFO:tasks.workunit.client.1.smithi102.stdout:1/279: chown dd/d14/d18/f37 3 1 2024-09-19T09:02:33.364 INFO:tasks.workunit.client.1.smithi102.stdout:9/247: truncate d1/d2/d3/f12 3674337 0 2024-09-19T09:02:33.365 INFO:tasks.workunit.client.1.smithi102.stdout:4/311: link d14/d16/d17/f1f d14/d34/d5a/d5c/f62 0 2024-09-19T09:02:33.412 INFO:tasks.workunit.client.1.smithi102.stdout:2/195: creat d7/d1a/d3d/f41 x:0 0 0 2024-09-19T09:02:33.413 INFO:tasks.workunit.client.1.smithi102.stdout:7/280: creat d1/d2f/f56 x:0 0 0 2024-09-19T09:02:33.413 INFO:tasks.workunit.client.1.smithi102.stdout:9/248: creat d1/d2/d3/f4b x:0 0 0 2024-09-19T09:02:33.414 INFO:tasks.workunit.client.1.smithi102.stdout:0/331: symlink d3/dd/d1a/d32/d62/l66 0 2024-09-19T09:02:33.415 INFO:tasks.workunit.client.1.smithi102.stdout:2/196: chown d7/d1a/d2b/f33 5063 1 2024-09-19T09:02:33.415 INFO:tasks.workunit.client.1.smithi102.stdout:9/249: read - d1/d8/f44 zero size 2024-09-19T09:02:33.416 INFO:tasks.workunit.client.1.smithi102.stdout:5/300: truncate d5/d23/f26 357431 0 2024-09-19T09:02:33.416 INFO:tasks.workunit.client.1.smithi102.stdout:8/264: mknod d0/d10/d21/d39/d49/c4d 0 2024-09-19T09:02:33.417 INFO:tasks.workunit.client.1.smithi102.stdout:4/312: dwrite fd [0,4194304] 0 2024-09-19T09:02:33.419 INFO:tasks.workunit.client.1.smithi102.stdout:4/313: chown d14/d34 659278167 1 2024-09-19T09:02:33.420 INFO:tasks.workunit.client.1.smithi102.stdout:4/314: chown fe 11003722 1 2024-09-19T09:02:33.421 INFO:tasks.workunit.client.1.smithi102.stdout:1/280: mknod dd/d14/d35/c57 0 2024-09-19T09:02:33.425 INFO:tasks.workunit.client.1.smithi102.stdout:2/197: dread d7/ff [4194304,4194304] 0 2024-09-19T09:02:33.427 INFO:tasks.workunit.client.1.smithi102.stdout:1/281: write dd/d13/d2d/f39 [1041296,34108] 0 2024-09-19T09:02:33.430 INFO:tasks.workunit.client.1.smithi102.stdout:0/332: rmdir d3/dd/d10/d15/d22/d2a 39 2024-09-19T09:02:33.432 INFO:tasks.workunit.client.1.smithi102.stdout:1/282: readlink dd/d14/l3d 0 2024-09-19T09:02:33.432 INFO:tasks.workunit.client.1.smithi102.stdout:8/265: mknod d0/db/c4e 0 2024-09-19T09:02:33.433 INFO:tasks.workunit.client.1.smithi102.stdout:5/301: dwrite d5/d7/d1a/f58 [0,4194304] 0 2024-09-19T09:02:33.436 INFO:tasks.workunit.client.1.smithi102.stdout:5/302: fdatasync d5/d7/d1a/d37/f2b 0 2024-09-19T09:02:33.436 INFO:tasks.workunit.client.1.smithi102.stdout:7/281: dwrite d1/d2d/f54 [0,4194304] 0 2024-09-19T09:02:33.437 INFO:tasks.workunit.client.1.smithi102.stdout:8/266: stat d0/fd 0 2024-09-19T09:02:33.438 INFO:tasks.workunit.client.1.smithi102.stdout:0/333: chown d3/dd/d1a/d32/d62/l66 211 1 2024-09-19T09:02:33.440 INFO:tasks.workunit.client.1.smithi102.stdout:4/315: dwrite d14/d5e/f61 [0,4194304] 0 2024-09-19T09:02:33.440 INFO:tasks.workunit.client.1.smithi102.stdout:5/303: read d5/d7/d1a/d37/d39/d4c/f4a [168180,25459] 0 2024-09-19T09:02:33.441 INFO:tasks.workunit.client.1.smithi102.stdout:0/334: dread - d3/dd/d10/f63 zero size 2024-09-19T09:02:33.442 INFO:tasks.workunit.client.1.smithi102.stdout:4/316: chown cf 32235 1 2024-09-19T09:02:33.442 INFO:tasks.workunit.client.1.smithi102.stdout:5/304: write d5/d7/f19 [120346,115930] 0 2024-09-19T09:02:33.443 INFO:tasks.workunit.client.1.smithi102.stdout:0/335: fdatasync d3/d8/f58 0 2024-09-19T09:02:33.445 INFO:tasks.workunit.client.1.smithi102.stdout:9/250: rename d1/d2/d3/l1f to d1/d2/l4c 0 2024-09-19T09:02:33.446 INFO:tasks.workunit.client.1.smithi102.stdout:4/317: write d14/d16/d17/d25/f4b [2860829,13102] 0 2024-09-19T09:02:33.449 INFO:tasks.workunit.client.1.smithi102.stdout:4/318: truncate f12 4807076 0 2024-09-19T09:02:33.449 INFO:tasks.workunit.client.1.smithi102.stdout:9/251: write d1/f2f [182231,37923] 0 2024-09-19T09:02:33.452 INFO:tasks.workunit.client.1.smithi102.stdout:3/349: sync 2024-09-19T09:02:33.453 INFO:tasks.workunit.client.1.smithi102.stdout:0/336: dwrite d3/dd/d10/f38 [0,4194304] 0 2024-09-19T09:02:33.455 INFO:tasks.workunit.client.1.smithi102.stdout:0/337: write d3/dd/ff [188926,41421] 0 2024-09-19T09:02:33.466 INFO:tasks.workunit.client.1.smithi102.stdout:7/282: truncate d1/d2f/f4a 759084 0 2024-09-19T09:02:33.468 INFO:tasks.workunit.client.1.smithi102.stdout:9/252: truncate d1/d2/f37 275357 0 2024-09-19T09:02:33.469 INFO:tasks.workunit.client.1.smithi102.stdout:9/253: stat d1/d8/d1c/l11 0 2024-09-19T09:02:33.469 INFO:tasks.workunit.client.1.smithi102.stdout:3/350: symlink d2/d19/d1c/l75 0 2024-09-19T09:02:33.470 INFO:tasks.workunit.client.1.smithi102.stdout:3/351: chown d2/d1e/f38 249 1 2024-09-19T09:02:33.472 INFO:tasks.workunit.client.1.smithi102.stdout:1/283: creat dd/d14/d35/f58 x:0 0 0 2024-09-19T09:02:33.472 INFO:tasks.workunit.client.1.smithi102.stdout:3/352: dread - d2/d19/d47/db/d26/f61 zero size 2024-09-19T09:02:33.473 INFO:tasks.workunit.client.1.smithi102.stdout:4/319: dread fe [4194304,4194304] 0 2024-09-19T09:02:33.475 INFO:tasks.workunit.client.1.smithi102.stdout:3/353: read d2/d19/d47/db/f1a [739619,72850] 0 2024-09-19T09:02:33.476 INFO:tasks.workunit.client.1.smithi102.stdout:4/320: fdatasync d14/d16/d17/d25/f3d 0 2024-09-19T09:02:33.477 INFO:tasks.workunit.client.1.smithi102.stdout:4/321: write d14/d5e/f61 [499858,2501] 0 2024-09-19T09:02:33.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/254: mknod d1/d2/d3/d34/c4d 0 2024-09-19T09:02:33.479 INFO:tasks.workunit.client.1.smithi102.stdout:6/232: sync 2024-09-19T09:02:33.480 INFO:tasks.workunit.client.1.smithi102.stdout:1/284: dwrite dd/f16 [0,4194304] 0 2024-09-19T09:02:33.482 INFO:tasks.workunit.client.1.smithi102.stdout:6/233: truncate d1/d26/d2e/d45/d47/d4d/f34 1004663 0 2024-09-19T09:02:33.484 INFO:tasks.workunit.client.1.smithi102.stdout:2/198: rename d7/d1a/d3d/f41 to d7/f42 0 2024-09-19T09:02:33.489 INFO:tasks.workunit.client.1.smithi102.stdout:7/283: truncate d1/d3/f1c 2983677 0 2024-09-19T09:02:33.491 INFO:tasks.workunit.client.1.smithi102.stdout:8/267: getdents d0/d10/d21/d39/d49 0 2024-09-19T09:02:33.491 INFO:tasks.workunit.client.1.smithi102.stdout:8/268: readlink d0/db/l32 0 2024-09-19T09:02:33.493 INFO:tasks.workunit.client.1.smithi102.stdout:9/255: dread d1/d2/d3/d1d/f20 [0,4194304] 0 2024-09-19T09:02:33.501 INFO:tasks.workunit.client.1.smithi102.stdout:1/285: dread - dd/d14/d35/d49/f53 zero size 2024-09-19T09:02:33.502 INFO:tasks.workunit.client.1.smithi102.stdout:1/286: write f0 [880151,60876] 0 2024-09-19T09:02:33.503 INFO:tasks.workunit.client.1.smithi102.stdout:5/305: rename d5/d7/d1b/f33 to d5/d7/d1a/d37/d39/d4c/f5d 0 2024-09-19T09:02:33.504 INFO:tasks.workunit.client.1.smithi102.stdout:2/199: chown d7/d11/l18 434 1 2024-09-19T09:02:33.508 INFO:tasks.workunit.client.1.smithi102.stdout:7/284: unlink d1/c51 0 2024-09-19T09:02:33.509 INFO:tasks.workunit.client.1.smithi102.stdout:7/285: chown d1/d4/d45/c36 106637 1 2024-09-19T09:02:33.510 INFO:tasks.workunit.client.1.smithi102.stdout:3/354: getdents d2/d19/d1c/d1f/d5f 0 2024-09-19T09:02:33.511 INFO:tasks.workunit.client.1.smithi102.stdout:3/355: chown d2/d19/d1c 1 1 2024-09-19T09:02:33.513 INFO:tasks.workunit.client.1.smithi102.stdout:4/322: write d14/d16/d1d/f43 [536431,27325] 0 2024-09-19T09:02:33.514 INFO:tasks.workunit.client.1.smithi102.stdout:6/234: symlink d1/d18/db/l4f 0 2024-09-19T09:02:33.517 INFO:tasks.workunit.client.1.smithi102.stdout:5/306: symlink d5/d7/d1b/l5e 0 2024-09-19T09:02:33.517 INFO:tasks.workunit.client.1.smithi102.stdout:8/269: dwrite d0/f7 [4194304,4194304] 0 2024-09-19T09:02:33.521 INFO:tasks.workunit.client.1.smithi102.stdout:3/356: symlink d2/d19/d35/l76 0 2024-09-19T09:02:33.521 INFO:tasks.workunit.client.1.smithi102.stdout:6/235: stat d1/d26/d2e/d45/d47/d4d/d35/f40 0 2024-09-19T09:02:33.522 INFO:tasks.workunit.client.1.smithi102.stdout:4/323: creat d14/d16/d17/d25/d2b/f63 x:0 0 0 2024-09-19T09:02:33.525 INFO:tasks.workunit.client.1.smithi102.stdout:8/270: write d0/d10/d3a/f41 [1039869,117000] 0 2024-09-19T09:02:33.525 INFO:tasks.workunit.client.1.smithi102.stdout:0/338: link d3/dd/d1a/d32/c64 d3/dd/d10/d15/c67 0 2024-09-19T09:02:33.526 INFO:tasks.workunit.client.1.smithi102.stdout:7/286: truncate d1/f5 2841878 0 2024-09-19T09:02:33.527 INFO:tasks.workunit.client.1.smithi102.stdout:6/236: readlink d1/d26/d2e/l46 0 2024-09-19T09:02:33.529 INFO:tasks.workunit.client.1.smithi102.stdout:2/200: dread d7/d11/f27 [4194304,4194304] 0 2024-09-19T09:02:33.529 INFO:tasks.workunit.client.1.smithi102.stdout:5/307: creat d5/d7/d1a/d42/d4b/f5f x:0 0 0 2024-09-19T09:02:33.530 INFO:tasks.workunit.client.1.smithi102.stdout:1/287: dwrite dd/f1d [0,4194304] 0 2024-09-19T09:02:33.530 INFO:tasks.workunit.client.1.smithi102.stdout:3/357: truncate d2/d19/d35/f48 640243 0 2024-09-19T09:02:33.531 INFO:tasks.workunit.client.1.smithi102.stdout:6/237: write d1/d18/db/f19 [564576,68604] 0 2024-09-19T09:02:33.533 INFO:tasks.workunit.client.1.smithi102.stdout:3/358: write d2/d1e/f38 [715729,43561] 0 2024-09-19T09:02:33.533 INFO:tasks.workunit.client.1.smithi102.stdout:2/201: read d7/d1a/d2b/f33 [2367297,27734] 0 2024-09-19T09:02:33.534 INFO:tasks.workunit.client.1.smithi102.stdout:1/288: dread - dd/d14/d35/d49/f53 zero size 2024-09-19T09:02:33.537 INFO:tasks.workunit.client.1.smithi102.stdout:7/287: mknod d1/c57 0 2024-09-19T09:02:33.537 INFO:tasks.workunit.client.1.smithi102.stdout:1/289: write f0 [620917,82864] 0 2024-09-19T09:02:33.538 INFO:tasks.workunit.client.1.smithi102.stdout:2/202: fdatasync d7/d1a/d2b/f2d 0 2024-09-19T09:02:33.538 INFO:tasks.workunit.client.1.smithi102.stdout:3/359: dread d2/f1d [0,4194304] 0 2024-09-19T09:02:33.541 INFO:tasks.workunit.client.1.smithi102.stdout:0/339: symlink d3/dd/d10/d15/d22/d37/l68 0 2024-09-19T09:02:33.542 INFO:tasks.workunit.client.1.smithi102.stdout:2/203: write d7/d1a/d2b/f35 [654132,125236] 0 2024-09-19T09:02:33.542 INFO:tasks.workunit.client.1.smithi102.stdout:3/360: write d2/d19/d47/db/d26/f3a [143868,47105] 0 2024-09-19T09:02:33.542 INFO:tasks.workunit.client.1.smithi102.stdout:9/256: dread d1/d2/f22 [0,4194304] 0 2024-09-19T09:02:33.544 INFO:tasks.workunit.client.1.smithi102.stdout:2/204: dread - d7/d12/d37/f3a zero size 2024-09-19T09:02:33.545 INFO:tasks.workunit.client.1.smithi102.stdout:5/308: mkdir d5/d60 0 2024-09-19T09:02:33.546 INFO:tasks.workunit.client.1.smithi102.stdout:9/257: dread d1/d2/f37 [0,4194304] 0 2024-09-19T09:02:33.546 INFO:tasks.workunit.client.1.smithi102.stdout:1/290: mknod dd/c59 0 2024-09-19T09:02:33.548 INFO:tasks.workunit.client.1.smithi102.stdout:1/291: write dd/d14/f52 [15538,34911] 0 2024-09-19T09:02:33.549 INFO:tasks.workunit.client.1.smithi102.stdout:1/292: chown dd/d14/d35/f48 897257 1 2024-09-19T09:02:33.550 INFO:tasks.workunit.client.1.smithi102.stdout:2/205: creat d7/d11/f43 x:0 0 0 2024-09-19T09:02:33.551 INFO:tasks.workunit.client.1.smithi102.stdout:3/361: mkdir d2/d19/d47/db/d26/d68/d77 0 2024-09-19T09:02:33.552 INFO:tasks.workunit.client.1.smithi102.stdout:0/340: unlink d3/dd/d10/d15/d22/d37/d39/d44/f4c 0 2024-09-19T09:02:33.553 INFO:tasks.workunit.client.1.smithi102.stdout:7/288: creat d1/d4/d45/d25/d52/f58 x:0 0 0 2024-09-19T09:02:33.555 INFO:tasks.workunit.client.1.smithi102.stdout:1/293: symlink dd/d14/d35/d49/l5a 0 2024-09-19T09:02:33.556 INFO:tasks.workunit.client.1.smithi102.stdout:2/206: mkdir d7/d11/d44 0 2024-09-19T09:02:33.557 INFO:tasks.workunit.client.1.smithi102.stdout:2/207: write d7/d1a/d2b/f2d [1011719,43826] 0 2024-09-19T09:02:33.559 INFO:tasks.workunit.client.1.smithi102.stdout:5/309: fsync d5/d23/f26 0 2024-09-19T09:02:33.561 INFO:tasks.workunit.client.1.smithi102.stdout:7/289: rename d1/d3/f3a to d1/d4/f59 0 2024-09-19T09:02:33.566 INFO:tasks.workunit.client.1.smithi102.stdout:2/208: mknod d7/d1a/c45 0 2024-09-19T09:02:33.567 INFO:tasks.workunit.client.1.smithi102.stdout:2/209: write d7/f10 [1230353,109291] 0 2024-09-19T09:02:33.569 INFO:tasks.workunit.client.1.smithi102.stdout:6/238: truncate d1/d18/f25 5742836 0 2024-09-19T09:02:33.570 INFO:tasks.workunit.client.1.smithi102.stdout:6/239: write d1/d26/d2e/d45/d47/d4d/f33 [3418652,122705] 0 2024-09-19T09:02:33.571 INFO:tasks.workunit.client.1.smithi102.stdout:1/294: rename dd/d14/c30 to dd/d13/c5b 0 2024-09-19T09:02:33.572 INFO:tasks.workunit.client.1.smithi102.stdout:6/240: write d1/d18/db/f1f [5191906,119289] 0 2024-09-19T09:02:33.573 INFO:tasks.workunit.client.1.smithi102.stdout:6/241: write d1/d18/db/f31 [966466,99943] 0 2024-09-19T09:02:33.573 INFO:tasks.workunit.client.1.smithi102.stdout:7/290: creat d1/d3/d20/f5a x:0 0 0 2024-09-19T09:02:33.575 INFO:tasks.workunit.client.1.smithi102.stdout:6/242: write d1/d18/db/f10 [4901130,113806] 0 2024-09-19T09:02:33.577 INFO:tasks.workunit.client.1.smithi102.stdout:2/210: unlink d7/d11/f27 0 2024-09-19T09:02:33.580 INFO:tasks.workunit.client.1.smithi102.stdout:5/310: symlink d5/d7/d1a/l61 0 2024-09-19T09:02:33.581 INFO:tasks.workunit.client.1.smithi102.stdout:0/341: creat d3/dd/d10/d15/d22/d37/f69 x:0 0 0 2024-09-19T09:02:33.585 INFO:tasks.workunit.client.1.smithi102.stdout:1/295: write dd/f10 [4616256,72581] 0 2024-09-19T09:02:33.586 INFO:tasks.workunit.client.1.smithi102.stdout:9/258: truncate d1/d2/d3/d1d/f20 8327211 0 2024-09-19T09:02:33.587 INFO:tasks.workunit.client.1.smithi102.stdout:9/259: chown d1/d2 253876226 1 2024-09-19T09:02:33.587 INFO:tasks.workunit.client.1.smithi102.stdout:7/291: write d1/d4/f53 [1601808,85975] 0 2024-09-19T09:02:33.588 INFO:tasks.workunit.client.1.smithi102.stdout:7/292: chown d1/d4/d45/d25/c38 3205 1 2024-09-19T09:02:33.589 INFO:tasks.workunit.client.1.smithi102.stdout:3/362: truncate d2/d1e/f38 138076 0 2024-09-19T09:02:33.589 INFO:tasks.workunit.client.1.smithi102.stdout:7/293: stat d1/d3/d20/f44 0 2024-09-19T09:02:33.590 INFO:tasks.workunit.client.1.smithi102.stdout:2/211: symlink d7/d1a/l46 0 2024-09-19T09:02:33.591 INFO:tasks.workunit.client.1.smithi102.stdout:2/212: stat d7/d1a/d2b/d31/f3e 0 2024-09-19T09:02:33.593 INFO:tasks.workunit.client.1.smithi102.stdout:7/294: dread d1/d4/f59 [0,4194304] 0 2024-09-19T09:02:33.594 INFO:tasks.workunit.client.1.smithi102.stdout:0/342: creat d3/dd/d10/f6a x:0 0 0 2024-09-19T09:02:33.595 INFO:tasks.workunit.client.1.smithi102.stdout:1/296: mknod dd/c5c 0 2024-09-19T09:02:33.595 INFO:tasks.workunit.client.1.smithi102.stdout:1/297: dread - dd/d13/f56 zero size 2024-09-19T09:02:33.598 INFO:tasks.workunit.client.1.smithi102.stdout:2/213: mknod d7/d12/d37/c47 0 2024-09-19T09:02:33.599 INFO:tasks.workunit.client.1.smithi102.stdout:5/311: dread d5/d7/d1a/d37/d39/d4c/f5d [0,4194304] 0 2024-09-19T09:02:33.601 INFO:tasks.workunit.client.1.smithi102.stdout:0/343: creat d3/dd/d10/d15/d22/d37/d39/d44/f6b x:0 0 0 2024-09-19T09:02:33.602 INFO:tasks.workunit.client.1.smithi102.stdout:1/298: mkdir dd/d5d 0 2024-09-19T09:02:33.603 INFO:tasks.workunit.client.1.smithi102.stdout:9/260: symlink d1/d8/l4e 0 2024-09-19T09:02:33.603 INFO:tasks.workunit.client.1.smithi102.stdout:9/261: write d1/f2f [602866,7696] 0 2024-09-19T09:02:33.604 INFO:tasks.workunit.client.1.smithi102.stdout:3/363: symlink d2/d19/d1c/d1f/d5f/l78 0 2024-09-19T09:02:33.605 INFO:tasks.workunit.client.1.smithi102.stdout:9/262: truncate d1/d2/f22 5143268 0 2024-09-19T09:02:33.605 INFO:tasks.workunit.client.1.smithi102.stdout:3/364: dread - d2/d19/d47/f71 zero size 2024-09-19T09:02:33.606 INFO:tasks.workunit.client.1.smithi102.stdout:9/263: fdatasync d1/d2/d3/f38 0 2024-09-19T09:02:33.607 INFO:tasks.workunit.client.1.smithi102.stdout:9/264: chown d1/c2d 1 1 2024-09-19T09:02:33.608 INFO:tasks.workunit.client.1.smithi102.stdout:2/214: creat d7/d1a/d2b/d31/f48 x:0 0 0 2024-09-19T09:02:33.616 INFO:tasks.workunit.client.1.smithi102.stdout:5/312: dread d5/d7/d1a/d37/f45 [0,4194304] 0 2024-09-19T09:02:33.616 INFO:tasks.workunit.client.1.smithi102.stdout:1/299: dread dd/d14/f2a [0,4194304] 0 2024-09-19T09:02:33.617 INFO:tasks.workunit.client.1.smithi102.stdout:1/300: chown dd/d13/c21 12 1 2024-09-19T09:02:33.617 INFO:tasks.workunit.client.1.smithi102.stdout:1/301: chown dd/d13/d3b 1422876722 1 2024-09-19T09:02:33.618 INFO:tasks.workunit.client.1.smithi102.stdout:1/302: chown dd/d14/d35/d49/l44 552 1 2024-09-19T09:02:33.619 INFO:tasks.workunit.client.1.smithi102.stdout:1/303: fdatasync dd/d13/d2d/f39 0 2024-09-19T09:02:33.619 INFO:tasks.workunit.client.1.smithi102.stdout:6/243: link d1/d18/db/c11 d1/d26/d2e/d45/c50 0 2024-09-19T09:02:33.620 INFO:tasks.workunit.client.1.smithi102.stdout:6/244: write d1/d18/db/f30 [4119044,41990] 0 2024-09-19T09:02:33.620 INFO:tasks.workunit.client.1.smithi102.stdout:1/304: truncate dd/d14/d35/f4a 409928 0 2024-09-19T09:02:33.621 INFO:tasks.workunit.client.1.smithi102.stdout:3/365: creat d2/d19/d1c/d2f/d39/d53/f79 x:0 0 0 2024-09-19T09:02:33.622 INFO:tasks.workunit.client.1.smithi102.stdout:9/265: mkdir d1/d2/d3/d1d/d4f 0 2024-09-19T09:02:33.622 INFO:tasks.workunit.client.1.smithi102.stdout:8/271: sync 2024-09-19T09:02:33.622 INFO:tasks.workunit.client.1.smithi102.stdout:4/324: sync 2024-09-19T09:02:33.623 INFO:tasks.workunit.client.1.smithi102.stdout:9/266: dread - d1/f40 zero size 2024-09-19T09:02:33.630 INFO:tasks.workunit.client.1.smithi102.stdout:7/295: truncate d1/f2a 1174887 0 2024-09-19T09:02:33.632 INFO:tasks.workunit.client.1.smithi102.stdout:1/305: creat dd/d14/d18/f5e x:0 0 0 2024-09-19T09:02:33.637 INFO:tasks.workunit.client.1.smithi102.stdout:9/267: rename d1/d8/lc to d1/d2/d3/l50 0 2024-09-19T09:02:33.639 INFO:tasks.workunit.client.1.smithi102.stdout:0/344: link d3/dd/d10/f63 d3/dd/d10/d15/d22/d2a/f6c 0 2024-09-19T09:02:33.641 INFO:tasks.workunit.client.1.smithi102.stdout:5/313: mknod d5/d7/c62 0 2024-09-19T09:02:33.642 INFO:tasks.workunit.client.1.smithi102.stdout:5/314: write d5/d7/d1a/d37/d34/f49 [38544,114415] 0 2024-09-19T09:02:33.644 INFO:tasks.workunit.client.1.smithi102.stdout:6/245: creat d1/d26/d4b/f51 x:0 0 0 2024-09-19T09:02:33.645 INFO:tasks.workunit.client.1.smithi102.stdout:5/315: read d5/d7/d1a/d37/f32 [45371,129126] 0 2024-09-19T09:02:33.646 INFO:tasks.workunit.client.1.smithi102.stdout:1/306: rename dd/d5d to dd/d5f 0 2024-09-19T09:02:33.647 INFO:tasks.workunit.client.1.smithi102.stdout:8/272: mkdir d0/d4f 0 2024-09-19T09:02:33.647 INFO:tasks.workunit.client.1.smithi102.stdout:5/316: write d5/d7/ff [4030747,57895] 0 2024-09-19T09:02:33.650 INFO:tasks.workunit.client.1.smithi102.stdout:7/296: rename d1/d4/c10 to d1/d3/c5b 0 2024-09-19T09:02:33.651 INFO:tasks.workunit.client.1.smithi102.stdout:9/268: readlink d1/d2/l3f 0 2024-09-19T09:02:33.651 INFO:tasks.workunit.client.1.smithi102.stdout:8/273: read d0/fd [999882,44919] 0 2024-09-19T09:02:33.654 INFO:tasks.workunit.client.1.smithi102.stdout:6/246: mknod d1/d26/d2e/d45/d47/d4d/d3b/c52 0 2024-09-19T09:02:33.655 INFO:tasks.workunit.client.1.smithi102.stdout:6/247: chown d1/d18/d37/f4e 1435866 1 2024-09-19T09:02:33.656 INFO:tasks.workunit.client.1.smithi102.stdout:1/307: rmdir dd/d14/d18 39 2024-09-19T09:02:33.657 INFO:tasks.workunit.client.1.smithi102.stdout:2/215: getdents d7/d11 0 2024-09-19T09:02:33.658 INFO:tasks.workunit.client.1.smithi102.stdout:2/216: write d7/d12/f40 [82342,33572] 0 2024-09-19T09:02:33.660 INFO:tasks.workunit.client.1.smithi102.stdout:0/345: getdents d3/dd/d5b 0 2024-09-19T09:02:33.661 INFO:tasks.workunit.client.1.smithi102.stdout:0/346: write d3/dd/d10/d15/f60 [374704,17501] 0 2024-09-19T09:02:33.663 INFO:tasks.workunit.client.1.smithi102.stdout:9/269: rename d1/d8/d1c/l24 to d1/d2/d3/d1d/l51 0 2024-09-19T09:02:33.664 INFO:tasks.workunit.client.1.smithi102.stdout:8/274: mkdir d0/d10/d21/d39/d50 0 2024-09-19T09:02:33.666 INFO:tasks.workunit.client.1.smithi102.stdout:5/317: symlink d5/d7/d1a/d37/l63 0 2024-09-19T09:02:33.668 INFO:tasks.workunit.client.1.smithi102.stdout:7/297: mknod d1/c5c 0 2024-09-19T09:02:33.669 INFO:tasks.workunit.client.1.smithi102.stdout:6/248: mknod d1/d26/d2e/d45/d47/d4d/d35/d41/c53 0 2024-09-19T09:02:33.669 INFO:tasks.workunit.client.1.smithi102.stdout:9/270: dwrite d1/d2/f22 [0,4194304] 0 2024-09-19T09:02:33.670 INFO:tasks.workunit.client.1.smithi102.stdout:5/318: dread - d5/d7/d1a/d42/d4b/f5f zero size 2024-09-19T09:02:33.670 INFO:tasks.workunit.client.1.smithi102.stdout:0/347: symlink d3/dd/d1a/l6d 0 2024-09-19T09:02:33.675 INFO:tasks.workunit.client.1.smithi102.stdout:0/348: write d3/dd/d10/f6a [262525,8946] 0 2024-09-19T09:02:33.676 INFO:tasks.workunit.client.1.smithi102.stdout:9/271: truncate d1/d2/d3/f4b 20475 0 2024-09-19T09:02:33.676 INFO:tasks.workunit.client.1.smithi102.stdout:2/217: getdents d7/d1a/d2b 0 2024-09-19T09:02:33.677 INFO:tasks.workunit.client.1.smithi102.stdout:8/275: dwrite d0/d10/d23/f3c [0,4194304] 0 2024-09-19T09:02:33.680 INFO:tasks.workunit.client.1.smithi102.stdout:2/218: read d7/d11/f1e [3794855,75563] 0 2024-09-19T09:02:33.682 INFO:tasks.workunit.client.1.smithi102.stdout:8/276: write d0/d10/d23/f3c [3450660,130084] 0 2024-09-19T09:02:33.685 INFO:tasks.workunit.client.1.smithi102.stdout:0/349: rmdir d3/dd/d10/d15 39 2024-09-19T09:02:33.686 INFO:tasks.workunit.client.1.smithi102.stdout:0/350: dread - d3/dd/d1a/f51 zero size 2024-09-19T09:02:33.690 INFO:tasks.workunit.client.1.smithi102.stdout:5/319: rename d5/d7/d1a/d37/f32 to d5/d7/d1a/d37/d34/d4d/f64 0 2024-09-19T09:02:33.692 INFO:tasks.workunit.client.1.smithi102.stdout:6/249: getdents d1/d26/d4b 0 2024-09-19T09:02:33.694 INFO:tasks.workunit.client.1.smithi102.stdout:8/277: mknod d0/d10/d21/d39/c51 0 2024-09-19T09:02:33.696 INFO:tasks.workunit.client.1.smithi102.stdout:8/278: stat d0/d10/d3a 0 2024-09-19T09:02:33.696 INFO:tasks.workunit.client.1.smithi102.stdout:6/250: mknod d1/d26/d4b/c54 0 2024-09-19T09:02:33.699 INFO:tasks.workunit.client.1.smithi102.stdout:7/298: dread d1/d4/d45/d25/f2e [0,4194304] 0 2024-09-19T09:02:33.699 INFO:tasks.workunit.client.1.smithi102.stdout:0/351: creat d3/dd/d10/d15/d2c/f6e x:0 0 0 2024-09-19T09:02:33.700 INFO:tasks.workunit.client.1.smithi102.stdout:6/251: rmdir d1/d26/d2e/d45/d47/d4d/d35 39 2024-09-19T09:02:33.703 INFO:tasks.workunit.client.1.smithi102.stdout:9/272: dread d1/d2/d3/f13 [4194304,4194304] 0 2024-09-19T09:02:33.703 INFO:tasks.workunit.client.1.smithi102.stdout:2/219: getdents d7/d1a 0 2024-09-19T09:02:33.704 INFO:tasks.workunit.client.1.smithi102.stdout:7/299: mknod d1/d4/d45/c5d 0 2024-09-19T09:02:33.706 INFO:tasks.workunit.client.1.smithi102.stdout:6/252: creat d1/d26/d2e/d45/f55 x:0 0 0 2024-09-19T09:02:33.709 INFO:tasks.workunit.client.1.smithi102.stdout:9/273: symlink d1/d2/d3/d1d/l52 0 2024-09-19T09:02:33.713 INFO:tasks.workunit.client.1.smithi102.stdout:8/279: truncate d0/d10/f48 2391877 0 2024-09-19T09:02:33.715 INFO:tasks.workunit.client.1.smithi102.stdout:2/220: dwrite d7/d1a/d2b/d31/f3e [0,4194304] 0 2024-09-19T09:02:33.715 INFO:tasks.workunit.client.1.smithi102.stdout:0/352: truncate d3/dd/d10/d15/d3e/f3f 2276454 0 2024-09-19T09:02:33.716 INFO:tasks.workunit.client.1.smithi102.stdout:5/320: dread d5/d7/d1a/d42/d4b/f4f [4194304,4194304] 0 2024-09-19T09:02:33.716 INFO:tasks.workunit.client.1.smithi102.stdout:7/300: write d1/d4/f6 [23685,37222] 0 2024-09-19T09:02:33.720 INFO:tasks.workunit.client.1.smithi102.stdout:8/280: mknod d0/db/c52 0 2024-09-19T09:02:33.720 INFO:tasks.workunit.client.1.smithi102.stdout:9/274: mknod d1/d2/d3/d1d/d4f/c53 0 2024-09-19T09:02:33.721 INFO:tasks.workunit.client.1.smithi102.stdout:6/253: write d1/d18/f25 [5903773,60320] 0 2024-09-19T09:02:33.723 INFO:tasks.workunit.client.1.smithi102.stdout:8/281: fdatasync d0/d10/d21/d39/f3f 0 2024-09-19T09:02:33.724 INFO:tasks.workunit.client.1.smithi102.stdout:2/221: creat d7/d1a/f49 x:0 0 0 2024-09-19T09:02:33.725 INFO:tasks.workunit.client.1.smithi102.stdout:7/301: dread d1/f1e [0,4194304] 0 2024-09-19T09:02:33.726 INFO:tasks.workunit.client.1.smithi102.stdout:7/302: chown d1/d4/d45/l27 573 1 2024-09-19T09:02:33.727 INFO:tasks.workunit.client.1.smithi102.stdout:5/321: creat d5/d7/d1a/d37/d50/f65 x:0 0 0 2024-09-19T09:02:33.728 INFO:tasks.workunit.client.1.smithi102.stdout:9/275: readlink d1/d2/d3/d1d/l51 0 2024-09-19T09:02:33.728 INFO:tasks.workunit.client.1.smithi102.stdout:5/322: dread - d5/d23/d3b/f5c zero size 2024-09-19T09:02:33.729 INFO:tasks.workunit.client.1.smithi102.stdout:8/282: mknod d0/d10/d21/d39/c53 0 2024-09-19T09:02:33.730 INFO:tasks.workunit.client.1.smithi102.stdout:8/283: chown d0/d10/f46 784 1 2024-09-19T09:02:33.731 INFO:tasks.workunit.client.1.smithi102.stdout:2/222: rmdir d7/d12 39 2024-09-19T09:02:33.733 INFO:tasks.workunit.client.1.smithi102.stdout:7/303: mknod d1/d3/d20/c5e 0 2024-09-19T09:02:33.735 INFO:tasks.workunit.client.1.smithi102.stdout:6/254: mknod d1/d18/db/c56 0 2024-09-19T09:02:33.736 INFO:tasks.workunit.client.1.smithi102.stdout:6/255: write d1/d18/db/f1f [619572,119273] 0 2024-09-19T09:02:33.737 INFO:tasks.workunit.client.1.smithi102.stdout:5/323: creat d5/d7/d1a/d42/f66 x:0 0 0 2024-09-19T09:02:33.738 INFO:tasks.workunit.client.1.smithi102.stdout:6/256: write d1/d18/db/f31 [926089,36437] 0 2024-09-19T09:02:33.739 INFO:tasks.workunit.client.1.smithi102.stdout:9/276: rename d1/d2/l3f to d1/d2/d3/d34/l54 0 2024-09-19T09:02:33.740 INFO:tasks.workunit.client.1.smithi102.stdout:8/284: mknod d0/d10/c54 0 2024-09-19T09:02:33.740 INFO:tasks.workunit.client.1.smithi102.stdout:8/285: stat d0/d10/d21/d39/f3d 0 2024-09-19T09:02:33.742 INFO:tasks.workunit.client.1.smithi102.stdout:0/353: link d3/dd/d10/d15/l65 d3/dd/d10/d15/d3e/l6f 0 2024-09-19T09:02:33.743 INFO:tasks.workunit.client.1.smithi102.stdout:0/354: write d3/dd/d1a/f1b [7865013,22039] 0 2024-09-19T09:02:33.743 INFO:tasks.workunit.client.1.smithi102.stdout:7/304: symlink d1/d3/d20/l5f 0 2024-09-19T09:02:33.745 INFO:tasks.workunit.client.1.smithi102.stdout:6/257: symlink d1/d26/d2e/d45/d47/d4d/d3b/l57 0 2024-09-19T09:02:33.747 INFO:tasks.workunit.client.1.smithi102.stdout:6/258: fsync d1/d18/db/f1f 0 2024-09-19T09:02:33.748 INFO:tasks.workunit.client.1.smithi102.stdout:5/324: symlink d5/l67 0 2024-09-19T09:02:33.749 INFO:tasks.workunit.client.1.smithi102.stdout:7/305: creat d1/d4/d45/d25/f60 x:0 0 0 2024-09-19T09:02:33.750 INFO:tasks.workunit.client.1.smithi102.stdout:8/286: mknod d0/d4f/c55 0 2024-09-19T09:02:33.750 INFO:tasks.workunit.client.1.smithi102.stdout:2/223: dwrite d7/d12/f40 [0,4194304] 0 2024-09-19T09:02:33.750 INFO:tasks.workunit.client.1.smithi102.stdout:5/325: dread - d5/d7/d1a/d42/f44 zero size 2024-09-19T09:02:33.754 INFO:tasks.workunit.client.1.smithi102.stdout:0/355: mknod d3/dd/d5b/c70 0 2024-09-19T09:02:33.755 INFO:tasks.workunit.client.1.smithi102.stdout:9/277: rmdir d1/d2/d3/d34 39 2024-09-19T09:02:33.757 INFO:tasks.workunit.client.1.smithi102.stdout:7/306: dwrite d1/d2f/f56 [0,4194304] 0 2024-09-19T09:02:33.758 INFO:tasks.workunit.client.1.smithi102.stdout:2/224: symlink d7/d12/l4a 0 2024-09-19T09:02:33.760 INFO:tasks.workunit.client.1.smithi102.stdout:6/259: mkdir d1/d3a/d58 0 2024-09-19T09:02:33.763 INFO:tasks.workunit.client.1.smithi102.stdout:5/326: mknod d5/d7/c68 0 2024-09-19T09:02:33.766 INFO:tasks.workunit.client.1.smithi102.stdout:0/356: symlink d3/dd/d10/d15/d22/d37/d39/d44/l71 0 2024-09-19T09:02:33.767 INFO:tasks.workunit.client.1.smithi102.stdout:7/307: creat d1/d3/d34/d4f/f61 x:0 0 0 2024-09-19T09:02:33.768 INFO:tasks.workunit.client.1.smithi102.stdout:2/225: rename d7/d1a/d2b/d31/f39 to d7/d12/f4b 0 2024-09-19T09:02:33.770 INFO:tasks.workunit.client.1.smithi102.stdout:6/260: fdatasync d1/ff 0 2024-09-19T09:02:33.770 INFO:tasks.workunit.client.1.smithi102.stdout:8/287: dread d0/f42 [0,4194304] 0 2024-09-19T09:02:33.776 INFO:tasks.workunit.client.1.smithi102.stdout:2/226: creat d7/d1a/d2b/f4c x:0 0 0 2024-09-19T09:02:33.778 INFO:tasks.workunit.client.1.smithi102.stdout:5/327: mknod d5/d7/d1a/c69 0 2024-09-19T09:02:33.779 INFO:tasks.workunit.client.1.smithi102.stdout:5/328: dread - d5/d7/d1a/d42/d4b/f5f zero size 2024-09-19T09:02:33.780 INFO:tasks.workunit.client.1.smithi102.stdout:0/357: mkdir d3/dd/d72 0 2024-09-19T09:02:33.781 INFO:tasks.workunit.client.1.smithi102.stdout:9/278: dread d1/d8/d1c/f3e [0,4194304] 0 2024-09-19T09:02:33.781 INFO:tasks.workunit.client.1.smithi102.stdout:9/279: stat d1/d8/f44 0 2024-09-19T09:02:33.782 INFO:tasks.workunit.client.1.smithi102.stdout:6/261: rename d1/d18/l29 to d1/d26/d2e/d45/d47/d4d/d3b/l59 0 2024-09-19T09:02:33.784 INFO:tasks.workunit.client.1.smithi102.stdout:7/308: truncate d1/f2a 1762025 0 2024-09-19T09:02:33.785 INFO:tasks.workunit.client.1.smithi102.stdout:2/227: symlink d7/d1a/l4d 0 2024-09-19T09:02:33.788 INFO:tasks.workunit.client.1.smithi102.stdout:6/262: symlink d1/d26/d2e/d45/d47/d4d/d3b/l5a 0 2024-09-19T09:02:33.789 INFO:tasks.workunit.client.1.smithi102.stdout:2/228: write d7/d1a/d2b/f4c [3231,19052] 0 2024-09-19T09:02:33.790 INFO:tasks.workunit.client.1.smithi102.stdout:2/229: chown d7/d11/c28 29 1 2024-09-19T09:02:33.790 INFO:tasks.workunit.client.1.smithi102.stdout:2/230: readlink d7/d11/l14 0 2024-09-19T09:02:33.791 INFO:tasks.workunit.client.1.smithi102.stdout:0/358: fdatasync f2 0 2024-09-19T09:02:33.793 INFO:tasks.workunit.client.1.smithi102.stdout:8/288: link d0/d10/f2d d0/f56 0 2024-09-19T09:02:33.794 INFO:tasks.workunit.client.1.smithi102.stdout:0/359: read d3/dd/d10/d15/d22/d37/d3d/f48 [3287884,90562] 0 2024-09-19T09:02:33.795 INFO:tasks.workunit.client.1.smithi102.stdout:8/289: fsync d0/d10/d21/d39/f3f 0 2024-09-19T09:02:33.797 INFO:tasks.workunit.client.1.smithi102.stdout:8/290: readlink d0/l30 0 2024-09-19T09:02:33.797 INFO:tasks.workunit.client.1.smithi102.stdout:6/263: truncate d1/ff 3034233 0 2024-09-19T09:02:33.797 INFO:tasks.workunit.client.1.smithi102.stdout:2/231: dread d7/d12/f40 [0,4194304] 0 2024-09-19T09:02:33.797 INFO:tasks.workunit.client.1.smithi102.stdout:2/232: chown d7/ff 1012673795 1 2024-09-19T09:02:33.798 INFO:tasks.workunit.client.1.smithi102.stdout:5/329: getdents d5/d7/d1b 0 2024-09-19T09:02:33.801 INFO:tasks.workunit.client.1.smithi102.stdout:8/291: mknod d0/db/d1d/c57 0 2024-09-19T09:02:33.802 INFO:tasks.workunit.client.1.smithi102.stdout:0/360: dwrite d3/dd/d10/d15/d19/f26 [0,4194304] 0 2024-09-19T09:02:33.803 INFO:tasks.workunit.client.1.smithi102.stdout:6/264: creat d1/d18/d37/f5b x:0 0 0 2024-09-19T09:02:33.803 INFO:tasks.workunit.client.1.smithi102.stdout:6/265: readlink d1/d18/db/l2b 0 2024-09-19T09:02:33.806 INFO:tasks.workunit.client.1.smithi102.stdout:6/266: write d1/d26/d2e/d45/f42 [542303,56003] 0 2024-09-19T09:02:33.807 INFO:tasks.workunit.client.1.smithi102.stdout:8/292: mknod d0/db/d29/c58 0 2024-09-19T09:02:33.808 INFO:tasks.workunit.client.1.smithi102.stdout:0/361: mkdir d3/dd/d10/d15/d22/d2a/d73 0 2024-09-19T09:02:33.808 INFO:tasks.workunit.client.1.smithi102.stdout:8/293: read d0/d10/d21/d39/f3d [2966495,84921] 0 2024-09-19T09:02:33.809 INFO:tasks.workunit.client.1.smithi102.stdout:0/362: read - d3/dd/d10/f63 zero size 2024-09-19T09:02:33.809 INFO:tasks.workunit.client.1.smithi102.stdout:0/363: readlink d3/l4 0 2024-09-19T09:02:33.810 INFO:tasks.workunit.client.1.smithi102.stdout:7/309: truncate d1/d4/f53 130064 0 2024-09-19T09:02:33.815 INFO:tasks.workunit.client.1.smithi102.stdout:5/330: dread d5/d7/f29 [0,4194304] 0 2024-09-19T09:02:33.817 INFO:tasks.workunit.client.1.smithi102.stdout:7/310: dwrite d1/d4/f21 [0,4194304] 0 2024-09-19T09:02:33.819 INFO:tasks.workunit.client.1.smithi102.stdout:7/311: truncate d1/d2d/f37 593826 0 2024-09-19T09:02:33.820 INFO:tasks.workunit.client.1.smithi102.stdout:6/267: fdatasync d1/ff 0 2024-09-19T09:02:33.823 INFO:tasks.workunit.client.1.smithi102.stdout:0/364: mknod d3/dd/c74 0 2024-09-19T09:02:33.824 INFO:tasks.workunit.client.1.smithi102.stdout:6/268: mknod d1/d26/d4b/c5c 0 2024-09-19T09:02:33.825 INFO:tasks.workunit.client.1.smithi102.stdout:5/331: mknod d5/d7/d1a/c6a 0 2024-09-19T09:02:33.833 INFO:tasks.workunit.client.1.smithi102.stdout:6/269: fsync d1/d18/db/fd 0 2024-09-19T09:02:33.833 INFO:tasks.workunit.client.1.smithi102.stdout:7/312: dwrite d1/d2d/f54 [0,4194304] 0 2024-09-19T09:02:33.833 INFO:tasks.workunit.client.1.smithi102.stdout:5/332: link d5/d7/ff d5/d7/d1a/d37/d39/d4c/f6b 0 2024-09-19T09:02:33.834 INFO:tasks.workunit.client.1.smithi102.stdout:5/333: chown d5/d7/d1a 2793331 1 2024-09-19T09:02:33.836 INFO:tasks.workunit.client.1.smithi102.stdout:5/334: write d5/d7/d1a/d37/d34/f49 [377259,105951] 0 2024-09-19T09:02:33.837 INFO:tasks.workunit.client.1.smithi102.stdout:7/313: creat d1/d4/d45/f62 x:0 0 0 2024-09-19T09:02:33.838 INFO:tasks.workunit.client.1.smithi102.stdout:5/335: stat d5/d7/d1a/c6a 0 2024-09-19T09:02:33.839 INFO:tasks.workunit.client.1.smithi102.stdout:6/270: dwrite d1/d18/db/f19 [0,4194304] 0 2024-09-19T09:02:33.841 INFO:tasks.workunit.client.1.smithi102.stdout:7/314: write d1/d3/d20/f35 [1845414,70253] 0 2024-09-19T09:02:33.843 INFO:tasks.workunit.client.1.smithi102.stdout:6/271: write d1/d18/db/f19 [3394856,18542] 0 2024-09-19T09:02:33.844 INFO:tasks.workunit.client.1.smithi102.stdout:7/315: write d1/d4/f6 [3340926,43029] 0 2024-09-19T09:02:33.846 INFO:tasks.workunit.client.1.smithi102.stdout:6/272: truncate d1/ff 3114831 0 2024-09-19T09:02:33.847 INFO:tasks.workunit.client.1.smithi102.stdout:6/273: readlink d1/d18/l21 0 2024-09-19T09:02:33.853 INFO:tasks.workunit.client.1.smithi102.stdout:5/336: rename d5/d23/l2f to d5/d7/d1a/l6c 0 2024-09-19T09:02:33.854 INFO:tasks.workunit.client.1.smithi102.stdout:5/337: readlink d5/d7/d1a/l61 0 2024-09-19T09:02:33.854 INFO:tasks.workunit.client.1.smithi102.stdout:8/294: dread d0/f56 [0,4194304] 0 2024-09-19T09:02:33.855 INFO:tasks.workunit.client.1.smithi102.stdout:5/338: stat d5/d7/d1a/d37/d39/d4c/f6b 0 2024-09-19T09:02:33.855 INFO:tasks.workunit.client.1.smithi102.stdout:8/295: chown d0/db/d1d/f34 3222668 1 2024-09-19T09:02:33.857 INFO:tasks.workunit.client.1.smithi102.stdout:0/365: dread d3/dd/d10/d15/d2c/f3b [0,4194304] 0 2024-09-19T09:02:33.857 INFO:tasks.workunit.client.1.smithi102.stdout:5/339: read d5/d23/f26 [266007,21898] 0 2024-09-19T09:02:33.857 INFO:tasks.workunit.client.1.smithi102.stdout:8/296: creat d0/d10/d21/d39/f59 x:0 0 0 2024-09-19T09:02:33.858 INFO:tasks.workunit.client.1.smithi102.stdout:0/366: chown d3/dd/d5b/c70 247 1 2024-09-19T09:02:33.861 INFO:tasks.workunit.client.1.smithi102.stdout:5/340: unlink d5/d7/ff 0 2024-09-19T09:02:33.866 INFO:tasks.workunit.client.1.smithi102.stdout:5/341: rename d5/d7/f1f to d5/d7/d1a/d42/f6d 0 2024-09-19T09:02:33.872 INFO:tasks.workunit.client.1.smithi102.stdout:0/367: link d3/c47 d3/dd/d10/d15/d22/d4a/c75 0 2024-09-19T09:02:33.874 INFO:tasks.workunit.client.1.smithi102.stdout:0/368: rmdir d3/dd/d10/d15/d22/d4a 39 2024-09-19T09:02:33.875 INFO:tasks.workunit.client.1.smithi102.stdout:7/316: dwrite d1/d2f/f4a [0,4194304] 0 2024-09-19T09:02:33.876 INFO:tasks.workunit.client.1.smithi102.stdout:5/342: creat d5/f6e x:0 0 0 2024-09-19T09:02:33.880 INFO:tasks.workunit.client.1.smithi102.stdout:7/317: creat d1/d4/f63 x:0 0 0 2024-09-19T09:02:33.882 INFO:tasks.workunit.client.1.smithi102.stdout:0/369: symlink d3/dd/d1a/d32/l76 0 2024-09-19T09:02:33.882 INFO:tasks.workunit.client.1.smithi102.stdout:8/297: dwrite d0/d10/f2d [0,4194304] 0 2024-09-19T09:02:33.887 INFO:tasks.workunit.client.1.smithi102.stdout:5/343: creat d5/d7/d1b/f6f x:0 0 0 2024-09-19T09:02:33.893 INFO:tasks.workunit.client.1.smithi102.stdout:5/344: dwrite d5/f6e [0,4194304] 0 2024-09-19T09:02:33.895 INFO:tasks.workunit.client.1.smithi102.stdout:5/345: write d5/d23/d3b/f5c [878358,31337] 0 2024-09-19T09:02:33.897 INFO:tasks.workunit.client.1.smithi102.stdout:5/346: fsync d5/d7/d1a/d37/d34/f5b 0 2024-09-19T09:02:33.899 INFO:tasks.workunit.client.1.smithi102.stdout:0/370: rename d3/dd/d10/d15/d22/d2a/d73 to d3/dd/d1a/d77 0 2024-09-19T09:02:33.899 INFO:tasks.workunit.client.1.smithi102.stdout:5/347: dread d5/d7/d1a/d37/f45 [0,4194304] 0 2024-09-19T09:02:33.900 INFO:tasks.workunit.client.1.smithi102.stdout:5/348: chown d5/d7/d1a/d37/l63 12 1 2024-09-19T09:02:33.902 INFO:tasks.workunit.client.1.smithi102.stdout:0/371: readlink d3/dd/d1a/l25 0 2024-09-19T09:02:33.902 INFO:tasks.workunit.client.1.smithi102.stdout:0/372: dread - d3/dd/d10/d15/d3e/f5e zero size 2024-09-19T09:02:33.902 INFO:tasks.workunit.client.1.smithi102.stdout:5/349: chown d5/d7/d1a/c2e 88480048 1 2024-09-19T09:02:33.903 INFO:tasks.workunit.client.1.smithi102.stdout:5/350: chown d5/d7/d1a/f58 108 1 2024-09-19T09:02:33.905 INFO:tasks.workunit.client.1.smithi102.stdout:0/373: mknod d3/dd/d10/d15/d22/d37/d39/d44/c78 0 2024-09-19T09:02:33.905 INFO:tasks.workunit.client.1.smithi102.stdout:0/374: chown d3/dd/d10 1575066975 1 2024-09-19T09:02:33.908 INFO:tasks.workunit.client.1.smithi102.stdout:0/375: fsync d3/dd/d10/d15/d22/f2f 0 2024-09-19T09:02:33.910 INFO:tasks.workunit.client.1.smithi102.stdout:7/318: truncate d1/d2d/f54 1503417 0 2024-09-19T09:02:33.912 INFO:tasks.workunit.client.1.smithi102.stdout:5/351: creat d5/d7/d1a/d37/d39/d4c/f70 x:0 0 0 2024-09-19T09:02:33.915 INFO:tasks.workunit.client.1.smithi102.stdout:7/319: stat d1/d2d/f54 0 2024-09-19T09:02:33.916 INFO:tasks.workunit.client.1.smithi102.stdout:4/325: sync 2024-09-19T09:02:33.916 INFO:tasks.workunit.client.1.smithi102.stdout:3/366: sync 2024-09-19T09:02:33.916 INFO:tasks.workunit.client.1.smithi102.stdout:7/320: dread - d1/d3/d34/d4f/f61 zero size 2024-09-19T09:02:33.919 INFO:tasks.workunit.client.1.smithi102.stdout:3/367: write d2/d19/d47/f7 [13401670,41118] 0 2024-09-19T09:02:33.920 INFO:tasks.workunit.client.1.smithi102.stdout:4/326: mknod d14/d16/d1d/d48/c64 0 2024-09-19T09:02:33.920 INFO:tasks.workunit.client.1.smithi102.stdout:3/368: write d2/d19/f73 [181657,66784] 0 2024-09-19T09:02:33.921 INFO:tasks.workunit.client.1.smithi102.stdout:4/327: write d14/d16/d17/d25/d2b/f63 [368052,43878] 0 2024-09-19T09:02:33.921 INFO:tasks.workunit.client.1.smithi102.stdout:0/376: link d3/dd/d1a/l40 d3/dd/d1a/l79 0 2024-09-19T09:02:33.923 INFO:tasks.workunit.client.1.smithi102.stdout:7/321: creat d1/d3/f64 x:0 0 0 2024-09-19T09:02:33.925 INFO:tasks.workunit.client.1.smithi102.stdout:0/377: dread d3/dd/d10/d15/d19/f26 [0,4194304] 0 2024-09-19T09:02:33.926 INFO:tasks.workunit.client.1.smithi102.stdout:3/369: rename d2/d19/d47/l2b to d2/d19/d1c/d1f/d5f/l7a 0 2024-09-19T09:02:33.926 INFO:tasks.workunit.client.1.smithi102.stdout:0/378: dread - d3/dd/d1a/f51 zero size 2024-09-19T09:02:33.927 INFO:tasks.workunit.client.1.smithi102.stdout:3/370: truncate d2/f18 8442348 0 2024-09-19T09:02:33.927 INFO:tasks.workunit.client.1.smithi102.stdout:4/328: rmdir d14/d16/d1d 39 2024-09-19T09:02:33.930 INFO:tasks.workunit.client.1.smithi102.stdout:7/322: creat d1/d4/d45/d25/d52/f65 x:0 0 0 2024-09-19T09:02:33.931 INFO:tasks.workunit.client.1.smithi102.stdout:7/323: chown d1/d3/l33 22442148 1 2024-09-19T09:02:33.933 INFO:tasks.workunit.client.1.smithi102.stdout:0/379: stat d3/dd/d10/d15/d3e/c57 0 2024-09-19T09:02:33.934 INFO:tasks.workunit.client.1.smithi102.stdout:0/380: dread - d3/dd/d1a/f51 zero size 2024-09-19T09:02:33.936 INFO:tasks.workunit.client.1.smithi102.stdout:5/352: write d5/d7/d1a/d37/d39/d4c/f70 [519814,20183] 0 2024-09-19T09:02:33.936 INFO:tasks.workunit.client.1.smithi102.stdout:7/324: dread d1/d2f/f56 [0,4194304] 0 2024-09-19T09:02:33.942 INFO:tasks.workunit.client.1.smithi102.stdout:3/371: dread d2/f34 [0,4194304] 0 2024-09-19T09:02:33.942 INFO:tasks.workunit.client.1.smithi102.stdout:0/381: mkdir d3/d8/de/d7a 0 2024-09-19T09:02:33.943 INFO:tasks.workunit.client.1.smithi102.stdout:4/329: dread fe [0,4194304] 0 2024-09-19T09:02:33.943 INFO:tasks.workunit.client.1.smithi102.stdout:7/325: readlink d1/d4/d45/l55 0 2024-09-19T09:02:33.945 INFO:tasks.workunit.client.1.smithi102.stdout:5/353: creat d5/d7/d1a/d42/d4b/f71 x:0 0 0 2024-09-19T09:02:33.946 INFO:tasks.workunit.client.1.smithi102.stdout:5/354: chown d5/d7/d1a/d37/d50/f65 147 1 2024-09-19T09:02:33.956 INFO:tasks.workunit.client.1.smithi102.stdout:7/326: creat d1/d3/d34/f66 x:0 0 0 2024-09-19T09:02:33.957 INFO:tasks.workunit.client.1.smithi102.stdout:7/327: write d1/d3/d34/d4f/f61 [174771,33792] 0 2024-09-19T09:02:33.959 INFO:tasks.workunit.client.1.smithi102.stdout:5/355: dread d5/fe [0,4194304] 0 2024-09-19T09:02:33.961 INFO:tasks.workunit.client.1.smithi102.stdout:4/330: write d14/d16/d17/d2e/f4e [671251,23285] 0 2024-09-19T09:02:33.963 INFO:tasks.workunit.client.1.smithi102.stdout:3/372: symlink d2/d19/d1c/d2f/d39/d4f/d72/l7b 0 2024-09-19T09:02:33.963 INFO:tasks.workunit.client.1.smithi102.stdout:3/373: chown d2/d19/d1c/d1f/c3e 24 1 2024-09-19T09:02:33.968 INFO:tasks.workunit.client.1.smithi102.stdout:4/331: dread d14/d16/d17/d25/d2b/f31 [0,4194304] 0 2024-09-19T09:02:33.968 INFO:tasks.workunit.client.1.smithi102.stdout:5/356: mknod d5/d7/d1a/d37/d34/d4d/c72 0 2024-09-19T09:02:33.969 INFO:tasks.workunit.client.1.smithi102.stdout:4/332: read fd [3962080,108568] 0 2024-09-19T09:02:33.971 INFO:tasks.workunit.client.1.smithi102.stdout:3/374: creat d2/d19/d35/f7c x:0 0 0 2024-09-19T09:02:33.971 INFO:tasks.workunit.client.1.smithi102.stdout:0/382: write d3/dd/d10/d15/d22/d2a/f6c [282250,98683] 0 2024-09-19T09:02:33.973 INFO:tasks.workunit.client.1.smithi102.stdout:7/328: dread d1/f2a [0,4194304] 0 2024-09-19T09:02:33.974 INFO:tasks.workunit.client.1.smithi102.stdout:5/357: mkdir d5/d7/d1a/d37/d34/d73 0 2024-09-19T09:02:33.975 INFO:tasks.workunit.client.1.smithi102.stdout:4/333: unlink la 0 2024-09-19T09:02:33.976 INFO:tasks.workunit.client.1.smithi102.stdout:4/334: write d14/d16/d17/d25/f3d [691064,33988] 0 2024-09-19T09:02:33.977 INFO:tasks.workunit.client.1.smithi102.stdout:3/375: symlink d2/d19/d35/l7d 0 2024-09-19T09:02:33.978 INFO:tasks.workunit.client.1.smithi102.stdout:4/335: truncate d14/d34/d5a/d5c/f62 1965080 0 2024-09-19T09:02:33.978 INFO:tasks.workunit.client.1.smithi102.stdout:3/376: chown d2/d19/d1c/d1f/d5f 35400 1 2024-09-19T09:02:33.980 INFO:tasks.workunit.client.1.smithi102.stdout:0/383: rmdir d3/dd/d1a/d32 39 2024-09-19T09:02:33.981 INFO:tasks.workunit.client.1.smithi102.stdout:7/329: symlink d1/d2d/l67 0 2024-09-19T09:02:33.983 INFO:tasks.workunit.client.1.smithi102.stdout:7/330: read d1/f5 [270054,63939] 0 2024-09-19T09:02:33.985 INFO:tasks.workunit.client.1.smithi102.stdout:4/336: creat d14/d16/d17/d2e/d37/f65 x:0 0 0 2024-09-19T09:02:33.991 INFO:tasks.workunit.client.1.smithi102.stdout:4/337: dwrite d14/d16/d17/d25/d2b/f63 [0,4194304] 0 2024-09-19T09:02:33.999 INFO:tasks.workunit.client.1.smithi102.stdout:0/384: symlink d3/dd/d1a/l7b 0 2024-09-19T09:02:34.001 INFO:tasks.workunit.client.1.smithi102.stdout:4/338: fsync fd 0 2024-09-19T09:02:34.003 INFO:tasks.workunit.client.1.smithi102.stdout:7/331: symlink d1/l68 0 2024-09-19T09:02:34.005 INFO:tasks.workunit.client.1.smithi102.stdout:3/377: link d2/d19/d1c/d2f/d5a/l5b d2/d19/d47/db/d26/d68/l7e 0 2024-09-19T09:02:34.006 INFO:tasks.workunit.client.1.smithi102.stdout:3/378: truncate d2/d1e/f3d 4374836 0 2024-09-19T09:02:34.011 INFO:tasks.workunit.client.1.smithi102.stdout:7/332: dread d1/d4/f53 [0,4194304] 0 2024-09-19T09:02:34.012 INFO:tasks.workunit.client.1.smithi102.stdout:5/358: write d5/d7/d1a/d37/d39/d4c/f6b [3261534,103211] 0 2024-09-19T09:02:34.013 INFO:tasks.workunit.client.1.smithi102.stdout:5/359: write d5/f6e [3261179,99513] 0 2024-09-19T09:02:34.015 INFO:tasks.workunit.client.1.smithi102.stdout:9/280: sync 2024-09-19T09:02:34.015 INFO:tasks.workunit.client.1.smithi102.stdout:1/308: sync 2024-09-19T09:02:34.015 INFO:tasks.workunit.client.1.smithi102.stdout:0/385: rename d3/f7 to d3/dd/f7c 0 2024-09-19T09:02:34.017 INFO:tasks.workunit.client.1.smithi102.stdout:1/309: chown dd/d13/d3b/l4b 33304014 1 2024-09-19T09:02:34.017 INFO:tasks.workunit.client.1.smithi102.stdout:9/281: chown d1/d8/d1c/f21 1540411618 1 2024-09-19T09:02:34.031 INFO:tasks.workunit.client.1.smithi102.stdout:4/339: dread d14/d16/d17/d2e/d37/f4a [4194304,4194304] 0 2024-09-19T09:02:34.032 INFO:tasks.workunit.client.1.smithi102.stdout:7/333: truncate d1/d2f/f56 4919757 0 2024-09-19T09:02:34.033 INFO:tasks.workunit.client.1.smithi102.stdout:0/386: chown d3/dd/d1a/d32/d62 1488 1 2024-09-19T09:02:34.033 INFO:tasks.workunit.client.1.smithi102.stdout:1/310: write dd/d13/f50 [599492,107806] 0 2024-09-19T09:02:34.033 INFO:tasks.workunit.client.1.smithi102.stdout:7/334: chown d1/d4/d45/l55 191 1 2024-09-19T09:02:34.034 INFO:tasks.workunit.client.1.smithi102.stdout:4/340: chown d14/d16/d17/d25/d2b/c59 1271930702 1 2024-09-19T09:02:34.036 INFO:tasks.workunit.client.1.smithi102.stdout:5/360: creat d5/d7/d1a/f74 x:0 0 0 2024-09-19T09:02:34.037 INFO:tasks.workunit.client.1.smithi102.stdout:0/387: symlink d3/dd/d1a/d32/d62/l7d 0 2024-09-19T09:02:34.038 INFO:tasks.workunit.client.1.smithi102.stdout:7/335: unlink d1/d4/f53 0 2024-09-19T09:02:34.039 INFO:tasks.workunit.client.1.smithi102.stdout:1/311: dwrite dd/f25 [0,4194304] 0 2024-09-19T09:02:34.042 INFO:tasks.workunit.client.1.smithi102.stdout:4/341: dwrite f12 [0,4194304] 0 2024-09-19T09:02:34.043 INFO:tasks.workunit.client.1.smithi102.stdout:0/388: mkdir d3/dd/d10/d15/d19/d7e 0 2024-09-19T09:02:34.044 INFO:tasks.workunit.client.1.smithi102.stdout:4/342: write d14/d16/d17/f1c [4103949,18774] 0 2024-09-19T09:02:34.045 INFO:tasks.workunit.client.1.smithi102.stdout:1/312: rename dd/c59 to dd/c60 0 2024-09-19T09:02:34.046 INFO:tasks.workunit.client.1.smithi102.stdout:9/282: link d1/d8/c1e d1/d8/d1c/c55 0 2024-09-19T09:02:34.047 INFO:tasks.workunit.client.1.smithi102.stdout:7/336: truncate d1/d3/f1c 1144227 0 2024-09-19T09:02:34.048 INFO:tasks.workunit.client.1.smithi102.stdout:7/337: write d1/d2f/f4a [5216118,82059] 0 2024-09-19T09:02:34.050 INFO:tasks.workunit.client.1.smithi102.stdout:4/343: write d14/d16/d1d/f44 [892534,114384] 0 2024-09-19T09:02:34.051 INFO:tasks.workunit.client.1.smithi102.stdout:0/389: mkdir d3/dd/d1a/d32/d7f 0 2024-09-19T09:02:34.051 INFO:tasks.workunit.client.1.smithi102.stdout:4/344: fsync d14/d16/d1d/f43 0 2024-09-19T09:02:34.052 INFO:tasks.workunit.client.1.smithi102.stdout:0/390: stat d3/dd/d10/d15/d22/d37/l5f 0 2024-09-19T09:02:34.474 INFO:tasks.workunit.client.1.smithi102.stdout:0/391: chown d3/dd/d10/d15/f36 14909302 1 2024-09-19T09:02:34.474 INFO:tasks.workunit.client.1.smithi102.stdout:9/283: truncate d1/d2/f43 847799 0 2024-09-19T09:02:34.474 INFO:tasks.workunit.client.1.smithi102.stdout:5/361: getdents d5/d7 0 2024-09-19T09:02:34.474 INFO:tasks.workunit.client.1.smithi102.stdout:4/345: creat d14/d16/d17/f66 x:0 0 0 2024-09-19T09:02:34.474 INFO:tasks.workunit.client.1.smithi102.stdout:1/313: symlink dd/d14/l61 0 2024-09-19T09:02:34.474 INFO:tasks.workunit.client.1.smithi102.stdout:4/346: chown d14/d16/d1d/d48 21 1 2024-09-19T09:02:34.474 INFO:tasks.workunit.client.1.smithi102.stdout:4/347: readlink lb 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:1/314: chown dd/d13/f50 8 1 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:0/392: mkdir d3/dd/d10/d15/d22/d4a/d80 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:0/393: fdatasync d3/dd/d10/d15/d22/d37/d39/d44/f6b 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:5/362: mkdir d5/d7/d1a/d42/d75 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:1/315: fdatasync fc 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:4/348: creat d14/d16/d17/d25/d2b/f67 x:0 0 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:1/316: mkdir dd/d14/d35/d49/d62 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:0/394: read d3/dd/d10/d15/d19/f46 [19077,24825] 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:0/395: chown d3/dd/d10/d15/d22/d37/d39/d44/f6b 14 1 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:1/317: creat dd/d5f/f63 x:0 0 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:4/349: dwrite d14/d16/d17/d2e/d37/f3e [0,4194304] 0 2024-09-19T09:02:34.475 INFO:tasks.workunit.client.1.smithi102.stdout:9/284: dread d1/d2/d3/f12 [0,4194304] 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:1/318: symlink dd/l64 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:0/396: dread d3/dd/d10/d15/d22/d37/f52 [0,4194304] 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:1/319: chown dd/f16 106659609 1 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:4/350: readlink d14/d16/d17/d2e/l30 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:1/320: write dd/d14/f52 [415064,76500] 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:5/363: dread d5/d7/f35 [0,4194304] 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:5/364: write d5/d7/d1b/f46 [689872,28218] 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:0/397: symlink d3/dd/d10/d15/d22/d37/d3d/l81 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:1/321: rename dd/d13/d3b/f41 to dd/d13/d3b/f65 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:0/398: dwrite d3/dd/d10/f6a [0,4194304] 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:9/285: creat d1/d8/f56 x:0 0 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:0/399: truncate d3/dd/f21 241292 0 2024-09-19T09:02:34.476 INFO:tasks.workunit.client.1.smithi102.stdout:4/351: symlink d14/d16/d17/d2e/d60/l68 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:0/400: stat d3/dd/d1a/d32 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:0/401: fdatasync d3/f14 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:4/352: rmdir d14/d34 39 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:1/322: dwrite f0 [0,4194304] 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:0/402: write d3/dd/d10/f6a [221099,108535] 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:1/323: read dd/f10 [2271918,3348] 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:1/324: truncate dd/ff 220261 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:9/286: dwrite d1/d2/d3/f41 [0,4194304] 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:0/403: fdatasync d3/dd/f21 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:4/353: mknod d14/d16/d17/c69 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:9/287: write d1/d2/d3/f31 [3063298,91637] 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:1/325: mkdir dd/d66 0 2024-09-19T09:02:34.477 INFO:tasks.workunit.client.1.smithi102.stdout:4/354: dread fd [0,4194304] 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/288: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:5/365: truncate d5/d7/d1a/d37/d34/d4d/f64 1435222 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:5/366: write d5/d23/f24 [1590074,14350] 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:4/355: link d14/d16/c56 d14/d16/d17/d2e/d37/c6a 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:1/326: getdents dd/d14 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/289: getdents d1/d8/d1c 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:5/367: creat d5/d7/d1a/d42/d75/f76 x:0 0 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:1/327: rmdir dd/d13/d3b 39 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:1/328: write f0 [2097260,45444] 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/290: symlink d1/d2/d3/d1d/d4f/l57 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/291: readlink d1/d8/l4e 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:1/329: write dd/d14/f4e [3144626,8283] 0 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:2/233: sync 2024-09-19T09:02:34.478 INFO:tasks.workunit.client.1.smithi102.stdout:8/298: sync 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:6/274: sync 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:8/299: write d0/d10/f2d [2033785,100927] 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:1/330: write dd/d14/f4e [1599142,14492] 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:9/292: creat d1/f58 x:0 0 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:2/234: truncate d7/d12/f4b 982499 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:6/275: read d1/d18/db/f10 [1161349,122811] 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:0/404: dread d3/dd/d1a/d32/f4f [0,4194304] 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:4/356: truncate d14/d16/d17/d25/d2f/f36 3808964 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:5/368: dwrite d5/d7/d1a/d37/d34/f49 [0,4194304] 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:4/357: creat d14/d16/d17/d25/d2f/f6b x:0 0 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:0/405: mkdir d3/dd/d10/d15/d22/d82 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:4/358: write f12 [2980581,110683] 0 2024-09-19T09:02:34.479 INFO:tasks.workunit.client.1.smithi102.stdout:5/369: mkdir d5/d7/d1a/d42/d4b/d77 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:2/235: dwrite d7/f9 [4194304,4194304] 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:9/293: rename d1/c33 to d1/d2/d3/c59 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:2/236: dread - d7/d1a/f2a zero size 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:0/406: unlink d3/dd/d1a/d32/f4f 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:5/370: mkdir d5/d23/d3b/d78 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:4/359: symlink d14/d16/d17/d2e/d37/l6c 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:8/300: dread d0/fd [0,4194304] 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:8/301: readlink d0/d10/d23/l2b 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:9/294: dwrite d1/d2/d3/d1d/f49 [0,4194304] 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:8/302: write d0/f35 [3796675,62182] 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:4/360: creat d14/f6d x:0 0 0 2024-09-19T09:02:34.480 INFO:tasks.workunit.client.1.smithi102.stdout:0/407: dwrite d3/dd/f21 [0,4194304] 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:6/276: truncate d1/d18/db/f30 3399263 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:5/371: fdatasync d5/d7/d1a/d37/d34/d4d/f64 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:9/295: truncate d1/d2/d3/f3c 228742 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:0/408: stat d3/dd/d10/d15/d22/d4a 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:9/296: creat d1/d2/d3/d1d/d4f/f5a x:0 0 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:4/361: truncate d14/d34/f4d 904101 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:6/277: link d1/d18/db/f10 d1/d3a/f5d 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:8/303: dwrite d0/db/f15 [0,4194304] 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:5/372: getdents d5/d7/d1a/d42/d4b/d77 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:8/304: fdatasync d0/d10/f37 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:4/362: truncate d14/d16/d17/d2e/d37/f65 534732 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:9/297: symlink d1/d8/d1c/l5b 0 2024-09-19T09:02:34.481 INFO:tasks.workunit.client.1.smithi102.stdout:0/409: mkdir d3/dd/d10/d15/d22/d2a/d83 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:0/410: stat d3/f14 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:4/363: rmdir d14/d16/d17 39 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:2/237: dread d7/d12/f17 [0,4194304] 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:8/305: mkdir d0/d5a 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:4/364: creat d14/d34/f6e x:0 0 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:6/278: creat d1/d18/db/f5e x:0 0 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:9/298: creat d1/f5c x:0 0 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:5/373: dread d5/d7/d1a/d37/d50/f52 [0,4194304] 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:4/365: write d14/d16/d17/d25/f4b [1261551,975] 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:6/279: dwrite d1/d18/db/f31 [0,4194304] 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:9/299: mknod d1/d2/c5d 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:8/306: creat d0/d10/d21/f5b x:0 0 0 2024-09-19T09:02:34.482 INFO:tasks.workunit.client.1.smithi102.stdout:5/374: dwrite d5/d7/d1a/d37/d39/f3c [0,4194304] 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:3/379: sync 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:7/338: sync 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:2/238: getdents d7 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:0/411: dwrite d3/dd/d10/d15/d22/d37/d3d/f48 [0,4194304] 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:6/280: creat d1/d26/d2e/f5f x:0 0 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:2/239: mkdir d7/d1a/d2b/d4e 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:3/380: chown d2/d19/d47/db/f2e 197 1 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:7/339: mknod d1/d4/d45/d25/c69 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:5/375: mknod d5/d60/c79 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:7/340: dread - d1/d4/f3d zero size 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:9/300: truncate d1/d2/d3/f13 2386936 0 2024-09-19T09:02:34.483 INFO:tasks.workunit.client.1.smithi102.stdout:5/376: write d5/d7/d1a/d37/d50/f65 [332935,126577] 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:2/240: write d7/d12/f40 [1521076,82616] 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:7/341: chown d1/d4/c18 6 1 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:4/366: dwrite d14/d16/d17/d25/d2f/f38 [0,4194304] 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:8/307: dread d0/d10/d23/f3c [0,4194304] 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:6/281: symlink d1/d26/d2e/d45/d47/d4d/d35/l60 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:2/241: chown d7/d12 954 1 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:2/242: chown d7 5 1 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:5/377: mknod d5/d7/d1b/c7a 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:0/412: dwrite d3/dd/d10/f6a [0,4194304] 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:2/243: chown d7/d1a/d2b/f33 1852 1 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:1/331: sync 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:5/378: dread d5/d7/d1a/d37/f45 [0,4194304] 0 2024-09-19T09:02:34.484 INFO:tasks.workunit.client.1.smithi102.stdout:9/301: rmdir d1/d2/d3/d1d 39 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:8/308: unlink d0/d10/f46 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:1/332: symlink dd/d13/d2d/l67 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:2/244: rename d7/d12/f3b to d7/f4f 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:2/245: write f2 [9165706,50372] 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:3/381: write d2/d19/d47/db/f2e [1288899,62059] 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:4/367: link d14/d34/f6e d14/d16/d17/d25/d2b/f6f 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:1/333: fdatasync dd/f11 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:1/334: stat dd/d14/f2c 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:4/368: dread d14/d16/d17/d25/d2f/f38 [0,4194304] 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:6/282: rmdir d1/d3a/d58 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:7/342: link d1/d4/c1f d1/d4/d45/c6a 0 2024-09-19T09:02:34.485 INFO:tasks.workunit.client.1.smithi102.stdout:5/379: getdents d5/d7/d1a/d37/d34/d4d 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:7/343: truncate d1/d2f/f56 5838559 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:4/369: link d14/d5e/f61 d14/f70 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:4/370: fsync d14/d16/d17/f1c 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:3/382: getdents d2/d19/d47/db/d26/d63 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:3/383: stat d2/d19/d35/l76 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:7/344: creat d1/d4/d45/d25/d52/f6b x:0 0 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:4/371: creat d14/d16/d17/d2e/d60/f71 x:0 0 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:3/384: link d2/d1e/f4d d2/d19/d47/db/d26/f7f 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:2/246: mkdir d7/d50 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:9/302: write d1/d2/f37 [1280194,112676] 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:3/385: creat d2/d19/d1c/d2f/d39/d4f/f80 x:0 0 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:2/247: chown d7/d11/d44 849 1 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:7/345: getdents d1/d4/d45 0 2024-09-19T09:02:34.486 INFO:tasks.workunit.client.1.smithi102.stdout:7/346: truncate d1/d3/d34/f66 882209 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:7/347: readlink d1/d3/l24 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:7/348: read - d1/d3/f64 zero size 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:3/386: creat d2/d19/d1c/d1f/d5f/f81 x:0 0 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:2/248: dread - d7/f42 zero size 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:3/387: fsync d2/d19/d47/db/d26/f3a 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:7/349: mkdir d1/d3/d20/d6c 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:9/303: creat d1/d8/f5e x:0 0 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:0/413: dwrite d3/dd/d10/d15/d3e/f3f [0,4194304] 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:3/388: mknod d2/d19/d1c/d2f/d39/d4f/d72/c82 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:2/249: mkdir d7/d1a/d2b/d31/d51 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:7/350: symlink d1/d3/d20/d6c/l6d 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:3/389: symlink d2/d19/d1c/d2f/d5a/l83 0 2024-09-19T09:02:34.487 INFO:tasks.workunit.client.1.smithi102.stdout:3/390: readlink d2/l4 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:3/391: chown d2/d19/d35 4731 1 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:3/392: dread - d2/f6c zero size 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:3/393: chown d2/d19/d1c/d2f/d39/d4f/d72/c82 451021 1 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:2/250: unlink d7/d1a/f20 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/304: creat d1/d8/f5f x:0 0 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:1/335: mkdir dd/d68 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:1/336: chown dd/le 25020998 1 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/305: rmdir d1/d2/d3/d1d 39 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/306: link d1/d2/d3/l7 d1/d8/l60 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/307: stat d1 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:6/283: rename d1/d26/d2e/d45/d47/d4d/d35/c36 to d1/c61 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/308: mknod d1/d8/d1c/c61 0 2024-09-19T09:02:34.488 INFO:tasks.workunit.client.1.smithi102.stdout:6/284: dread - d1/d18/db/f5e zero size 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:9/309: rmdir d1 39 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:9/310: stat d1/f2f 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:5/380: rename d5/d7/d1a/d42/d4b/d77 to d5/d7b 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:9/311: creat d1/d8/d1c/f62 x:0 0 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/372: rename d14/d16/d17/d25/d2b/f6f to d14/d16/d1d/f72 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/373: creat d14/d16/d17/d2e/d37/d58/f73 x:0 0 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/374: write d14/d16/d17/d2e/d60/f71 [819549,25547] 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/375: rmdir d14/d16/d1d/d48 39 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:3/394: rename d2/d19/d1c/d2f/d39 to d2/d19/d1c/d2f/d5a/d84 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:2/251: rename d7/d1a/d2b/d31/d51 to d7/d1a/d2b/d31/d51/d52 22 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/376: rmdir d14/d5e 39 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/377: read fd [3597064,86177] 0 2024-09-19T09:02:34.489 INFO:tasks.workunit.client.1.smithi102.stdout:2/252: rename d7/d11/c25 to d7/d11/c53 0 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:2/253: read - d7/d11/f1c zero size 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:2/254: chown d7/d11 526674896 1 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:3/395: creat d2/d19/d1c/d2f/d5a/d84/d4f/f85 x:0 0 0 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:0/414: write d3/dd/d10/d15/d19/f46 [940931,80435] 0 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:3/396: read d2/d19/d47/db/f25 [433271,110943] 0 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:4/378: mknod d14/d16/d17/d25/d2f/c74 0 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:4/379: fdatasync d14/d16/d17/f46 0 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:1/337: truncate dd/d13/d2d/f3c 447571 0 2024-09-19T09:02:34.490 INFO:tasks.workunit.client.1.smithi102.stdout:2/255: mknod d7/d1a/d2b/d31/d51/c54 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:1/338: truncate dd/d13/d2d/f39 1972517 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:0/415: mkdir d3/dd/d10/d84 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:6/285: rename d1/d26/d2e/d45/d47/d4d/d3b/c3e to d1/d26/d2e/d45/d47/d4d/c62 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:6/286: dread - d1/d26/d2e/d45/f55 zero size 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:4/380: mkdir d14/d5e/d75 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:3/397: rename d2/d19/l4e to d2/d19/d47/db/d26/d63/d6f/l86 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:0/416: unlink d3/dd/d10/d15/d22/d4a/c75 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:6/287: symlink d1/d26/d2e/d45/d47/d4d/l63 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:3/398: rename d2/d19/d35/l4a to d2/d19/d47/db/d26/d68/l87 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:2/256: dwrite d7/fc [0,4194304] 0 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:3/399: dread - d2/d19/d1c/d2f/d5a/d84/d53/f57 zero size 2024-09-19T09:02:34.491 INFO:tasks.workunit.client.1.smithi102.stdout:6/288: creat d1/d26/d2e/d45/d47/f64 x:0 0 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:1/339: link dd/d13/d3b/l4b dd/d14/d35/d49/l69 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:0/417: symlink d3/dd/d1a/l85 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/381: dread d14/f15 [0,4194304] 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:3/400: creat d2/d19/d47/db/d26/d63/f88 x:0 0 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:1/340: creat dd/d13/d3b/f6a x:0 0 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/382: unlink d14/d16/d17/d25/f3d 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:1/341: write dd/d14/d18/f40 [3368033,93021] 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/383: dread - d14/d16/d17/d25/d2b/f67 zero size 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:0/418: dread d3/dd/d10/d15/d22/d37/d3d/f48 [0,4194304] 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/384: write d14/d16/d17/f1c [3760229,11478] 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:2/257: getdents d7/d1a/d3d 0 2024-09-19T09:02:34.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/385: chown d14/d16/d17/d2e/d37/d58 206017 1 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:3/401: dwrite d2/d19/d47/db/d26/d63/f88 [0,4194304] 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:1/342: mknod dd/c6b 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:4/386: chown d14/d16/d17/d25/l52 31 1 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:3/402: write d2/d19/d47/f71 [621686,66794] 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:3/403: fsync d2/f18 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:0/419: rename d3/d8/de/c13 to d3/dd/d5b/c86 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:0/420: chown d3/dd/d10/l33 623946 1 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:3/404: dwrite d2/d19/d47/db/f3c [0,4194304] 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:2/258: fsync d7/d12/f2f 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:1/343: mkdir dd/d14/d35/d49/d62/d6c 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:0/421: dwrite d3/dd/d10/f38 [0,4194304] 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:3/405: dwrite d2/d19/d35/f4b [0,4194304] 0 2024-09-19T09:02:34.493 INFO:tasks.workunit.client.1.smithi102.stdout:0/422: write d3/dd/f1f [3256457,98392] 0 2024-09-19T09:02:34.495 INFO:tasks.workunit.client.1.smithi102.stdout:3/406: chown d2/d19/d47/db/d26/f7f 268892329 1 2024-09-19T09:02:34.495 INFO:tasks.workunit.client.1.smithi102.stdout:0/423: write d3/dd/d10/d15/f60 [775166,46917] 0 2024-09-19T09:02:34.495 INFO:tasks.workunit.client.1.smithi102.stdout:2/259: getdents d7/d1a/d2b 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:3/407: dread d2/d19/d47/db/d26/f3a [0,4194304] 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:4/387: dread d14/d16/d17/d25/d2f/f36 [0,4194304] 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:2/260: write d7/d12/d37/f3a [362785,88479] 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:6/289: truncate d1/d26/d2e/d45/d47/d4d/f33 3316884 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:1/344: dread dd/d14/f4e [0,4194304] 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:3/408: rmdir d2/d19/d1c/d2f/d5a/d84/d64 39 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:3/409: fdatasync d2/f2d 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:1/345: write dd/d13/f50 [767386,76269] 0 2024-09-19T09:02:34.496 INFO:tasks.workunit.client.1.smithi102.stdout:2/261: creat d7/d1a/d2b/d31/d51/f55 x:0 0 0 2024-09-19T09:02:34.499 INFO:tasks.workunit.client.1.smithi102.stdout:3/410: chown d2/d19/d1c/d2f/d5a/d84/l6e 476870 1 2024-09-19T09:02:34.500 INFO:tasks.workunit.client.1.smithi102.stdout:2/262: mkdir d7/d1a/d56 0 2024-09-19T09:02:34.501 INFO:tasks.workunit.client.1.smithi102.stdout:0/424: write d3/dd/d10/d15/d22/d37/f52 [1369515,96007] 0 2024-09-19T09:02:34.501 INFO:tasks.workunit.client.1.smithi102.stdout:4/388: getdents d14/d16/d17/d2e/d60 0 2024-09-19T09:02:34.501 INFO:tasks.workunit.client.1.smithi102.stdout:6/290: dwrite d1/d18/f7 [0,4194304] 0 2024-09-19T09:02:34.503 INFO:tasks.workunit.client.1.smithi102.stdout:0/425: stat d3/dd/d10/d15/d19/d7e 0 2024-09-19T09:02:34.504 INFO:tasks.workunit.client.1.smithi102.stdout:1/346: creat dd/d14/d35/d49/f6d x:0 0 0 2024-09-19T09:02:34.504 INFO:tasks.workunit.client.1.smithi102.stdout:4/389: truncate d14/d16/d1d/f53 132691 0 2024-09-19T09:02:34.505 INFO:tasks.workunit.client.1.smithi102.stdout:3/411: chown d2/d19/d47/c20 1 1 2024-09-19T09:02:34.505 INFO:tasks.workunit.client.1.smithi102.stdout:6/291: chown d1/d26/d2e/d45 2 1 2024-09-19T09:02:34.505 INFO:tasks.workunit.client.1.smithi102.stdout:0/426: chown d3/dd/d1a/d32/d62 6 1 2024-09-19T09:02:34.506 INFO:tasks.workunit.client.1.smithi102.stdout:3/412: chown d2/l65 0 1 2024-09-19T09:02:34.508 INFO:tasks.workunit.client.1.smithi102.stdout:1/347: creat dd/d13/d3b/f6e x:0 0 0 2024-09-19T09:02:34.508 INFO:tasks.workunit.client.1.smithi102.stdout:0/427: chown d3/dd/d10/d15/d22/d2a/d83 1196 1 2024-09-19T09:02:34.509 INFO:tasks.workunit.client.1.smithi102.stdout:1/348: readlink dd/d13/d2d/l67 0 2024-09-19T09:02:34.510 INFO:tasks.workunit.client.1.smithi102.stdout:2/263: link d7/f10 d7/d12/f57 0 2024-09-19T09:02:34.511 INFO:tasks.workunit.client.1.smithi102.stdout:6/292: mkdir d1/d18/db/d65 0 2024-09-19T09:02:34.511 INFO:tasks.workunit.client.1.smithi102.stdout:0/428: write d3/dd/d10/d15/d19/f46 [1701701,47498] 0 2024-09-19T09:02:34.512 INFO:tasks.workunit.client.1.smithi102.stdout:2/264: chown d7/f10 1305222886 1 2024-09-19T09:02:34.516 INFO:tasks.workunit.client.1.smithi102.stdout:6/293: write d1/d26/d2e/d45/d47/d4d/f4c [263527,117105] 0 2024-09-19T09:02:34.517 INFO:tasks.workunit.client.1.smithi102.stdout:3/413: dwrite d2/d19/d47/db/d26/f61 [0,4194304] 0 2024-09-19T09:02:34.519 INFO:tasks.workunit.client.1.smithi102.stdout:0/429: mknod d3/dd/d1a/d32/d7f/c87 0 2024-09-19T09:02:34.521 INFO:tasks.workunit.client.1.smithi102.stdout:0/430: chown d3/dd/d5b 10744986 1 2024-09-19T09:02:34.523 INFO:tasks.workunit.client.1.smithi102.stdout:6/294: mkdir d1/d26/d2e/d45/d47/d66 0 2024-09-19T09:02:34.523 INFO:tasks.workunit.client.1.smithi102.stdout:1/349: dwrite dd/d13/d2d/f39 [0,4194304] 0 2024-09-19T09:02:34.523 INFO:tasks.workunit.client.1.smithi102.stdout:3/414: write d2/d19/d47/db/d26/f61 [494106,53282] 0 2024-09-19T09:02:34.529 INFO:tasks.workunit.client.1.smithi102.stdout:1/350: mknod dd/d14/d18/c6f 0 2024-09-19T09:02:34.533 INFO:tasks.workunit.client.1.smithi102.stdout:6/295: dread d1/d26/d2e/d45/d47/d4d/f4c [0,4194304] 0 2024-09-19T09:02:34.535 INFO:tasks.workunit.client.1.smithi102.stdout:0/431: getdents d3/dd/d10/d15/d22/d4a/d80 0 2024-09-19T09:02:34.537 INFO:tasks.workunit.client.1.smithi102.stdout:6/296: mknod d1/d26/d2e/d45/d47/d4d/d3b/c67 0 2024-09-19T09:02:34.540 INFO:tasks.workunit.client.1.smithi102.stdout:3/415: rename d2/d19/d47/db/f43 to d2/d19/d47/f89 0 2024-09-19T09:02:34.544 INFO:tasks.workunit.client.1.smithi102.stdout:1/351: dwrite dd/d14/f4e [0,4194304] 0 2024-09-19T09:02:34.544 INFO:tasks.workunit.client.1.smithi102.stdout:4/390: write d14/d34/f6e [364639,24324] 0 2024-09-19T09:02:34.545 INFO:tasks.workunit.client.1.smithi102.stdout:0/432: dwrite d3/dd/d10/f6a [0,4194304] 0 2024-09-19T09:02:34.547 INFO:tasks.workunit.client.1.smithi102.stdout:6/297: symlink d1/d26/d2e/d45/d47/d4d/l68 0 2024-09-19T09:02:34.550 INFO:tasks.workunit.client.1.smithi102.stdout:3/416: rename d2/d1e/d54/f66 to d2/d19/d1c/d70/f8a 0 2024-09-19T09:02:34.551 INFO:tasks.workunit.client.1.smithi102.stdout:1/352: read dd/d14/d35/f48 [321766,40693] 0 2024-09-19T09:02:34.552 INFO:tasks.workunit.client.1.smithi102.stdout:1/353: fdatasync dd/d14/d35/d49/f6d 0 2024-09-19T09:02:34.561 INFO:tasks.workunit.client.1.smithi102.stdout:2/265: dwrite d7/d1a/d2b/f33 [0,4194304] 0 2024-09-19T09:02:34.562 INFO:tasks.workunit.client.1.smithi102.stdout:2/266: write d7/d11/f1c [831249,67476] 0 2024-09-19T09:02:34.564 INFO:tasks.workunit.client.1.smithi102.stdout:3/417: mkdir d2/d19/d47/db/d8b 0 2024-09-19T09:02:34.565 INFO:tasks.workunit.client.1.smithi102.stdout:8/309: sync 2024-09-19T09:02:34.567 INFO:tasks.workunit.client.1.smithi102.stdout:0/433: mknod d3/dd/d10/d15/d22/d37/c88 0 2024-09-19T09:02:34.570 INFO:tasks.workunit.client.1.smithi102.stdout:2/267: fdatasync d7/d11/f1c 0 2024-09-19T09:02:34.572 INFO:tasks.workunit.client.1.smithi102.stdout:0/434: dwrite d3/dd/d10/d15/f60 [0,4194304] 0 2024-09-19T09:02:34.573 INFO:tasks.workunit.client.1.smithi102.stdout:0/435: chown d3/dd/d1a/d32/d7f/c87 273993 1 2024-09-19T09:02:34.616 INFO:tasks.workunit.client.1.smithi102.stdout:9/312: sync 2024-09-19T09:02:34.616 INFO:tasks.workunit.client.1.smithi102.stdout:5/381: sync 2024-09-19T09:02:34.616 INFO:tasks.workunit.client.1.smithi102.stdout:7/351: sync 2024-09-19T09:02:34.616 INFO:tasks.workunit.client.1.smithi102.stdout:3/418: truncate d2/d19/d35/f41 72931 0 2024-09-19T09:02:34.617 INFO:tasks.workunit.client.1.smithi102.stdout:5/382: chown d5/d7/d1a/d37/d34/d4d 2009042912 1 2024-09-19T09:02:34.621 INFO:tasks.workunit.client.1.smithi102.stdout:6/298: rmdir d1/d26/d2e/d45 39 2024-09-19T09:02:34.627 INFO:tasks.workunit.client.1.smithi102.stdout:4/391: write d14/d16/d17/f1f [692244,51118] 0 2024-09-19T09:02:34.627 INFO:tasks.workunit.client.1.smithi102.stdout:7/352: creat d1/d4/d45/d25/f6e x:0 0 0 2024-09-19T09:02:34.631 INFO:tasks.workunit.client.1.smithi102.stdout:5/383: symlink d5/d7b/l7c 0 2024-09-19T09:02:34.632 INFO:tasks.workunit.client.1.smithi102.stdout:2/268: symlink d7/d11/d44/l58 0 2024-09-19T09:02:34.633 INFO:tasks.workunit.client.1.smithi102.stdout:2/269: fsync f2 0 2024-09-19T09:02:34.633 INFO:tasks.workunit.client.1.smithi102.stdout:7/353: dwrite d1/d3/d20/f2c [0,4194304] 0 2024-09-19T09:02:34.637 INFO:tasks.workunit.client.1.smithi102.stdout:6/299: unlink d1/d18/db/fd 0 2024-09-19T09:02:34.640 INFO:tasks.workunit.client.1.smithi102.stdout:1/354: truncate dd/d14/d18/f40 2042011 0 2024-09-19T09:02:34.643 INFO:tasks.workunit.client.1.smithi102.stdout:4/392: creat d14/d16/d17/d2e/d37/f76 x:0 0 0 2024-09-19T09:02:34.646 INFO:tasks.workunit.client.1.smithi102.stdout:8/310: write d0/d10/f48 [1069948,70155] 0 2024-09-19T09:02:34.647 INFO:tasks.workunit.client.1.smithi102.stdout:5/384: mknod d5/d7/d1a/d37/d50/c7d 0 2024-09-19T09:02:34.648 INFO:tasks.workunit.client.1.smithi102.stdout:8/311: read d0/d10/f2d [3275731,78496] 0 2024-09-19T09:02:34.649 INFO:tasks.workunit.client.1.smithi102.stdout:7/354: dread d1/f1e [0,4194304] 0 2024-09-19T09:02:34.649 INFO:tasks.workunit.client.1.smithi102.stdout:3/419: write d2/d19/d47/db/f25 [989433,85109] 0 2024-09-19T09:02:34.650 INFO:tasks.workunit.client.1.smithi102.stdout:2/270: symlink d7/d1a/d2b/d31/l59 0 2024-09-19T09:02:34.651 INFO:tasks.workunit.client.1.smithi102.stdout:3/420: read - d2/d1e/f3b zero size 2024-09-19T09:02:34.654 INFO:tasks.workunit.client.1.smithi102.stdout:6/300: symlink d1/d18/d37/l69 0 2024-09-19T09:02:34.657 INFO:tasks.workunit.client.1.smithi102.stdout:0/436: dwrite d3/dd/f7c [0,4194304] 0 2024-09-19T09:02:34.658 INFO:tasks.workunit.client.1.smithi102.stdout:8/312: mknod d0/d10/d21/d39/c5c 0 2024-09-19T09:02:34.662 INFO:tasks.workunit.client.1.smithi102.stdout:8/313: write d0/fd [2540138,16035] 0 2024-09-19T09:02:34.663 INFO:tasks.workunit.client.1.smithi102.stdout:4/393: creat d14/d5e/d75/f77 x:0 0 0 2024-09-19T09:02:34.667 INFO:tasks.workunit.client.1.smithi102.stdout:9/313: link d1/d2/d3/f13 d1/d2/d3/d1d/f63 0 2024-09-19T09:02:34.667 INFO:tasks.workunit.client.1.smithi102.stdout:1/355: dwrite dd/d13/d3b/f65 [0,4194304] 0 2024-09-19T09:02:34.667 INFO:tasks.workunit.client.1.smithi102.stdout:0/437: mknod d3/dd/d10/d15/d22/d37/d39/d44/d54/c89 0 2024-09-19T09:02:34.670 INFO:tasks.workunit.client.1.smithi102.stdout:4/394: mkdir d14/d16/d17/d25/d2b/d78 0 2024-09-19T09:02:34.670 INFO:tasks.workunit.client.1.smithi102.stdout:1/356: write dd/d13/d3b/f6a [350779,77740] 0 2024-09-19T09:02:34.671 INFO:tasks.workunit.client.1.smithi102.stdout:6/301: creat d1/d18/f6a x:0 0 0 2024-09-19T09:02:34.671 INFO:tasks.workunit.client.1.smithi102.stdout:5/385: dwrite d5/d7/d1a/d42/f6d [0,4194304] 0 2024-09-19T09:02:34.674 INFO:tasks.workunit.client.1.smithi102.stdout:8/314: link d0/db/lc d0/d4f/l5d 0 2024-09-19T09:02:34.677 INFO:tasks.workunit.client.1.smithi102.stdout:0/438: truncate d3/dd/d10/d15/d22/d37/f69 440154 0 2024-09-19T09:02:34.687 INFO:tasks.workunit.client.1.smithi102.stdout:9/314: creat d1/f64 x:0 0 0 2024-09-19T09:02:34.688 INFO:tasks.workunit.client.1.smithi102.stdout:1/357: mknod dd/d68/c70 0 2024-09-19T09:02:34.688 INFO:tasks.workunit.client.1.smithi102.stdout:8/315: dread d0/db/f3b [0,4194304] 0 2024-09-19T09:02:34.690 INFO:tasks.workunit.client.1.smithi102.stdout:4/395: mkdir d14/d34/d5a/d5c/d79 0 2024-09-19T09:02:34.691 INFO:tasks.workunit.client.1.smithi102.stdout:8/316: write d0/d10/d21/d39/f3f [4400214,34404] 0 2024-09-19T09:02:34.691 INFO:tasks.workunit.client.1.smithi102.stdout:5/386: getdents d5/d7/d1a/d37/d34/d4d 0 2024-09-19T09:02:34.693 INFO:tasks.workunit.client.1.smithi102.stdout:5/387: chown d5/d7/d1a/d37/d50/c7d 312757568 1 2024-09-19T09:02:34.694 INFO:tasks.workunit.client.1.smithi102.stdout:9/315: dwrite d1/d8/f44 [0,4194304] 0 2024-09-19T09:02:34.697 INFO:tasks.workunit.client.1.smithi102.stdout:8/317: readlink d0/db/lc 0 2024-09-19T09:02:34.697 INFO:tasks.workunit.client.1.smithi102.stdout:2/271: truncate d7/d1a/d2b/d31/f3e 439256 0 2024-09-19T09:02:34.698 INFO:tasks.workunit.client.1.smithi102.stdout:3/421: write d2/d19/d35/f41 [134397,101954] 0 2024-09-19T09:02:34.701 INFO:tasks.workunit.client.1.smithi102.stdout:1/358: symlink dd/d14/d54/l71 0 2024-09-19T09:02:34.708 INFO:tasks.workunit.client.1.smithi102.stdout:0/439: getdents d3/dd/d1a 0 2024-09-19T09:02:34.708 INFO:tasks.workunit.client.1.smithi102.stdout:8/318: mknod d0/d10/d3a/c5e 0 2024-09-19T09:02:34.710 INFO:tasks.workunit.client.1.smithi102.stdout:1/359: symlink dd/d68/l72 0 2024-09-19T09:02:34.712 INFO:tasks.workunit.client.1.smithi102.stdout:6/302: dwrite d1/f43 [0,4194304] 0 2024-09-19T09:02:34.713 INFO:tasks.workunit.client.1.smithi102.stdout:2/272: symlink d7/d1a/d56/l5a 0 2024-09-19T09:02:34.717 INFO:tasks.workunit.client.1.smithi102.stdout:0/440: symlink d3/dd/d10/d15/d22/d4a/l8a 0 2024-09-19T09:02:34.722 INFO:tasks.workunit.client.1.smithi102.stdout:8/319: dwrite d0/d10/d21/f43 [0,4194304] 0 2024-09-19T09:02:34.722 INFO:tasks.workunit.client.1.smithi102.stdout:5/388: creat d5/d7/d1a/f7e x:0 0 0 2024-09-19T09:02:34.723 INFO:tasks.workunit.client.1.smithi102.stdout:4/396: dread d14/d16/d17/d25/f4b [0,4194304] 0 2024-09-19T09:02:34.723 INFO:tasks.workunit.client.1.smithi102.stdout:1/360: dwrite dd/d14/d18/f1f [0,4194304] 0 2024-09-19T09:02:34.727 INFO:tasks.workunit.client.1.smithi102.stdout:2/273: mknod d7/d1a/d3d/c5b 0 2024-09-19T09:02:34.727 INFO:tasks.workunit.client.1.smithi102.stdout:0/441: rmdir d3/dd/d10/d15 39 2024-09-19T09:02:34.729 INFO:tasks.workunit.client.1.smithi102.stdout:5/389: rmdir d5 39 2024-09-19T09:02:34.730 INFO:tasks.workunit.client.1.smithi102.stdout:9/316: getdents d1/d2/d3 0 2024-09-19T09:02:34.730 INFO:tasks.workunit.client.1.smithi102.stdout:6/303: fsync d1/d26/d2e/d45/d47/d4d/f4c 0 2024-09-19T09:02:34.732 INFO:tasks.workunit.client.1.smithi102.stdout:8/320: rename d0/d10/d21/d39/f4a to d0/d4f/f5f 0 2024-09-19T09:02:34.732 INFO:tasks.workunit.client.1.smithi102.stdout:9/317: read - d1/d8/f5f zero size 2024-09-19T09:02:34.735 INFO:tasks.workunit.client.1.smithi102.stdout:0/442: mkdir d3/d8/d8b 0 2024-09-19T09:02:34.736 INFO:tasks.workunit.client.1.smithi102.stdout:2/274: dread f2 [8388608,4194304] 0 2024-09-19T09:02:34.737 INFO:tasks.workunit.client.1.smithi102.stdout:5/390: chown d5/d7/d1a/d42/f6d 558574061 1 2024-09-19T09:02:34.737 INFO:tasks.workunit.client.1.smithi102.stdout:4/397: write d14/d5e/d75/f77 [1627,85619] 0 2024-09-19T09:02:34.737 INFO:tasks.workunit.client.1.smithi102.stdout:2/275: read f3 [382173,63545] 0 2024-09-19T09:02:34.738 INFO:tasks.workunit.client.1.smithi102.stdout:1/361: rename dd/d13/d2d/l42 to dd/d14/d35/d49/l73 0 2024-09-19T09:02:34.739 INFO:tasks.workunit.client.1.smithi102.stdout:4/398: dread d14/d16/d17/d2e/d37/f65 [0,4194304] 0 2024-09-19T09:02:34.743 INFO:tasks.workunit.client.1.smithi102.stdout:4/399: dread d14/d16/d1d/f20 [0,4194304] 0 2024-09-19T09:02:34.745 INFO:tasks.workunit.client.1.smithi102.stdout:8/321: unlink d0/d4f/f5f 0 2024-09-19T09:02:34.746 INFO:tasks.workunit.client.1.smithi102.stdout:2/276: creat d7/d1a/d56/f5c x:0 0 0 2024-09-19T09:02:34.748 INFO:tasks.workunit.client.1.smithi102.stdout:5/391: dread d5/f6e [0,4194304] 0 2024-09-19T09:02:34.749 INFO:tasks.workunit.client.1.smithi102.stdout:5/392: write d5/d7/d1a/d37/f2b [328558,23133] 0 2024-09-19T09:02:34.751 INFO:tasks.workunit.client.1.smithi102.stdout:9/318: rename d1/d2/d3/d1d/f35 to d1/d2/d3/d34/f65 0 2024-09-19T09:02:34.751 INFO:tasks.workunit.client.1.smithi102.stdout:1/362: rename dd/l64 to dd/l74 0 2024-09-19T09:02:34.752 INFO:tasks.workunit.client.1.smithi102.stdout:4/400: rmdir d14/d5e 39 2024-09-19T09:02:34.752 INFO:tasks.workunit.client.1.smithi102.stdout:1/363: truncate dd/d14/f2c 1786131 0 2024-09-19T09:02:34.754 INFO:tasks.workunit.client.1.smithi102.stdout:0/443: fdatasync d3/dd/d10/d15/d19/f26 0 2024-09-19T09:02:34.804 INFO:tasks.workunit.client.1.smithi102.stdout:5/393: dread d5/d7/d1b/f51 [0,4194304] 0 2024-09-19T09:02:34.804 INFO:tasks.workunit.client.1.smithi102.stdout:4/401: read d14/d16/d17/d2e/d60/f71 [565365,58356] 0 2024-09-19T09:02:34.805 INFO:tasks.workunit.client.1.smithi102.stdout:8/322: symlink d0/d4f/l60 0 2024-09-19T09:02:34.805 INFO:tasks.workunit.client.1.smithi102.stdout:6/304: truncate d1/d18/f1d 555823 0 2024-09-19T09:02:34.806 INFO:tasks.workunit.client.1.smithi102.stdout:9/319: creat d1/d2/d3/d1d/f66 x:0 0 0 2024-09-19T09:02:34.807 INFO:tasks.workunit.client.1.smithi102.stdout:4/402: write f12 [5459487,111361] 0 2024-09-19T09:02:34.807 INFO:tasks.workunit.client.1.smithi102.stdout:0/444: write d3/dd/d10/d15/d2c/f6e [962789,6139] 0 2024-09-19T09:02:34.808 INFO:tasks.workunit.client.1.smithi102.stdout:9/320: write d1/f5c [675975,2941] 0 2024-09-19T09:02:34.809 INFO:tasks.workunit.client.1.smithi102.stdout:8/323: write d0/db/d29/f36 [151728,78098] 0 2024-09-19T09:02:34.810 INFO:tasks.workunit.client.1.smithi102.stdout:0/445: dread - d3/dd/d10/d15/d2c/f56 zero size 2024-09-19T09:02:34.811 INFO:tasks.workunit.client.1.smithi102.stdout:8/324: write d0/d10/d21/f24 [2619961,29054] 0 2024-09-19T09:02:34.812 INFO:tasks.workunit.client.1.smithi102.stdout:8/325: chown d0/f35 83 1 2024-09-19T09:02:34.813 INFO:tasks.workunit.client.1.smithi102.stdout:1/364: link dd/d14/f2a dd/d14/f75 0 2024-09-19T09:02:34.814 INFO:tasks.workunit.client.1.smithi102.stdout:4/403: dread d14/d16/d1d/f20 [0,4194304] 0 2024-09-19T09:02:34.816 INFO:tasks.workunit.client.1.smithi102.stdout:0/446: rmdir d3/dd/d1a 39 2024-09-19T09:02:34.821 INFO:tasks.workunit.client.1.smithi102.stdout:6/305: fsync d1/d26/d2e/d45/d47/d4d/d35/f39 0 2024-09-19T09:02:34.821 INFO:tasks.workunit.client.1.smithi102.stdout:0/447: fdatasync d3/f14 0 2024-09-19T09:02:34.821 INFO:tasks.workunit.client.1.smithi102.stdout:8/326: write d0/d10/d21/d39/f3d [1416630,47395] 0 2024-09-19T09:02:34.821 INFO:tasks.workunit.client.1.smithi102.stdout:4/404: creat d14/d16/d17/f7a x:0 0 0 2024-09-19T09:02:34.822 INFO:tasks.workunit.client.1.smithi102.stdout:5/394: dwrite d5/d7/d1a/d37/d39/d4c/f55 [4194304,4194304] 0 2024-09-19T09:02:34.826 INFO:tasks.workunit.client.1.smithi102.stdout:5/395: chown d5/d23/f26 8 1 2024-09-19T09:02:34.827 INFO:tasks.workunit.client.1.smithi102.stdout:0/448: creat d3/dd/d1a/d77/f8c x:0 0 0 2024-09-19T09:02:34.828 INFO:tasks.workunit.client.1.smithi102.stdout:4/405: unlink d14/d16/d17/c69 0 2024-09-19T09:02:34.829 INFO:tasks.workunit.client.1.smithi102.stdout:1/365: dwrite f6 [0,4194304] 0 2024-09-19T09:02:34.835 INFO:tasks.workunit.client.1.smithi102.stdout:0/449: rename d3/dd/d10/d15/d22/d2a/d83 to d3/dd/d10/d15/d19/d8d 0 2024-09-19T09:02:34.837 INFO:tasks.workunit.client.1.smithi102.stdout:4/406: creat d14/d34/d5a/d5c/f7b x:0 0 0 2024-09-19T09:02:34.838 INFO:tasks.workunit.client.1.smithi102.stdout:1/366: mknod dd/d66/c76 0 2024-09-19T09:02:34.839 INFO:tasks.workunit.client.1.smithi102.stdout:8/327: getdents d0/db/d1d 0 2024-09-19T09:02:34.842 INFO:tasks.workunit.client.1.smithi102.stdout:9/321: write d1/d8/d1c/f21 [746087,25435] 0 2024-09-19T09:02:34.842 INFO:tasks.workunit.client.1.smithi102.stdout:1/367: fdatasync dd/f10 0 2024-09-19T09:02:34.843 INFO:tasks.workunit.client.1.smithi102.stdout:9/322: read d1/d2/f37 [605546,77125] 0 2024-09-19T09:02:34.846 INFO:tasks.workunit.client.1.smithi102.stdout:6/306: dread d1/d18/db/f10 [0,4194304] 0 2024-09-19T09:02:34.847 INFO:tasks.workunit.client.1.smithi102.stdout:6/307: write d1/d26/d2e/f5f [790128,91427] 0 2024-09-19T09:02:34.865 INFO:tasks.workunit.client.1.smithi102.stdout:3/422: sync 2024-09-19T09:02:34.870 INFO:tasks.workunit.client.1.smithi102.stdout:0/450: mkdir d3/dd/d10/d8e 0 2024-09-19T09:02:34.872 INFO:tasks.workunit.client.1.smithi102.stdout:3/423: dwrite d2/d19/d1c/d2f/d5a/d84/d53/f79 [0,4194304] 0 2024-09-19T09:02:34.880 INFO:tasks.workunit.client.1.smithi102.stdout:0/451: dwrite d3/dd/d10/d15/d2c/f59 [0,4194304] 0 2024-09-19T09:02:34.880 INFO:tasks.workunit.client.1.smithi102.stdout:9/323: mknod d1/d2/d3/c67 0 2024-09-19T09:02:34.886 INFO:tasks.workunit.client.1.smithi102.stdout:3/424: creat d2/d1e/f8c x:0 0 0 2024-09-19T09:02:34.888 INFO:tasks.workunit.client.1.smithi102.stdout:4/407: truncate fe 5756762 0 2024-09-19T09:02:34.893 INFO:tasks.workunit.client.1.smithi102.stdout:0/452: symlink d3/dd/d10/d15/d22/d2a/l8f 0 2024-09-19T09:02:34.894 INFO:tasks.workunit.client.1.smithi102.stdout:0/453: write d3/dd/d10/f38 [2565968,111670] 0 2024-09-19T09:02:34.895 INFO:tasks.workunit.client.1.smithi102.stdout:3/425: creat d2/d19/d47/db/d26/d68/f8d x:0 0 0 2024-09-19T09:02:34.896 INFO:tasks.workunit.client.1.smithi102.stdout:0/454: write d3/dd/d10/d15/d3e/f5e [938052,11389] 0 2024-09-19T09:02:34.900 INFO:tasks.workunit.client.1.smithi102.stdout:1/368: creat dd/d14/d35/d49/d62/d6c/f77 x:0 0 0 2024-09-19T09:02:34.903 INFO:tasks.workunit.client.1.smithi102.stdout:3/426: creat d2/d19/d47/db/d26/d63/d6f/f8e x:0 0 0 2024-09-19T09:02:34.904 INFO:tasks.workunit.client.1.smithi102.stdout:0/455: rmdir d3/dd/d10/d15/d22/d37/d39/d44 39 2024-09-19T09:02:34.905 INFO:tasks.workunit.client.1.smithi102.stdout:9/324: mknod d1/d2/d3/d1d/d4f/c68 0 2024-09-19T09:02:34.907 INFO:tasks.workunit.client.1.smithi102.stdout:1/369: dwrite dd/f1d [4194304,4194304] 0 2024-09-19T09:02:34.909 INFO:tasks.workunit.client.1.smithi102.stdout:0/456: mkdir d3/dd/d10/d15/d22/d37/d3d/d90 0 2024-09-19T09:02:34.911 INFO:tasks.workunit.client.1.smithi102.stdout:9/325: readlink d1/d2/l42 0 2024-09-19T09:02:34.912 INFO:tasks.workunit.client.1.smithi102.stdout:9/326: chown d1/d2/d3/d1d/f66 4404 1 2024-09-19T09:02:34.914 INFO:tasks.workunit.client.1.smithi102.stdout:3/427: rename d2/d19/d1c/d2f/d5a/d84/d4f/d72/c82 to d2/d19/d1c/d1f/d5f/c8f 0 2024-09-19T09:02:34.915 INFO:tasks.workunit.client.1.smithi102.stdout:3/428: write d2/d1e/f8c [237684,6940] 0 2024-09-19T09:02:34.917 INFO:tasks.workunit.client.1.smithi102.stdout:1/370: mkdir dd/d13/d2d/d78 0 2024-09-19T09:02:34.918 INFO:tasks.workunit.client.1.smithi102.stdout:0/457: fdatasync d3/dd/d10/d15/f36 0 2024-09-19T09:02:34.919 INFO:tasks.workunit.client.1.smithi102.stdout:9/327: truncate d1/d8/d1c/f19 305466 0 2024-09-19T09:02:34.920 INFO:tasks.workunit.client.1.smithi102.stdout:1/371: truncate dd/d13/d3b/f6e 474954 0 2024-09-19T09:02:34.923 INFO:tasks.workunit.client.1.smithi102.stdout:3/429: dwrite d2/d1e/f3b [0,4194304] 0 2024-09-19T09:02:34.927 INFO:tasks.workunit.client.1.smithi102.stdout:1/372: write dd/d14/d18/f3f [2611917,107593] 0 2024-09-19T09:02:34.930 INFO:tasks.workunit.client.1.smithi102.stdout:1/373: read dd/f10 [1774530,107784] 0 2024-09-19T09:02:34.930 INFO:tasks.workunit.client.1.smithi102.stdout:9/328: dwrite d1/f58 [0,4194304] 0 2024-09-19T09:02:34.935 INFO:tasks.workunit.client.1.smithi102.stdout:3/430: rename d2/d19/d47/db/d26/d68 to d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90 0 2024-09-19T09:02:34.941 INFO:tasks.workunit.client.1.smithi102.stdout:0/458: getdents d3/dd/d10/d15/d22/d2a 0 2024-09-19T09:02:34.943 INFO:tasks.workunit.client.1.smithi102.stdout:3/431: dwrite d2/d19/d47/db/f44 [0,4194304] 0 2024-09-19T09:02:34.945 INFO:tasks.workunit.client.1.smithi102.stdout:9/329: mknod d1/d2/c69 0 2024-09-19T09:02:34.946 INFO:tasks.workunit.client.1.smithi102.stdout:9/330: dread - d1/f64 zero size 2024-09-19T09:02:34.949 INFO:tasks.workunit.client.1.smithi102.stdout:0/459: dwrite d3/f14 [0,4194304] 0 2024-09-19T09:02:34.955 INFO:tasks.workunit.client.1.smithi102.stdout:3/432: rename d2/d19/d47/db/f1a to d2/d19/d1c/d2f/d5a/d84/f91 0 2024-09-19T09:02:34.958 INFO:tasks.workunit.client.1.smithi102.stdout:1/374: dread dd/d13/f36 [0,4194304] 0 2024-09-19T09:02:34.960 INFO:tasks.workunit.client.1.smithi102.stdout:3/433: write d2/d19/d47/db/d26/f5d [3832125,111746] 0 2024-09-19T09:02:34.960 INFO:tasks.workunit.client.1.smithi102.stdout:7/355: sync 2024-09-19T09:02:34.962 INFO:tasks.workunit.client.1.smithi102.stdout:3/434: mknod d2/c92 0 2024-09-19T09:02:34.962 INFO:tasks.workunit.client.1.smithi102.stdout:7/356: fsync d1/d3/d20/f44 0 2024-09-19T09:02:34.964 INFO:tasks.workunit.client.1.smithi102.stdout:0/460: dwrite d3/f14 [4194304,4194304] 0 2024-09-19T09:02:34.966 INFO:tasks.workunit.client.1.smithi102.stdout:1/375: rename dd/d14/d18/f5e to dd/d13/d2d/f79 0 2024-09-19T09:02:34.967 INFO:tasks.workunit.client.1.smithi102.stdout:7/357: chown d1/d4/c1f 84874 1 2024-09-19T09:02:34.968 INFO:tasks.workunit.client.1.smithi102.stdout:3/435: rmdir d2/d19/d1c/d2f/d5a/d84 39 2024-09-19T09:02:34.968 INFO:tasks.workunit.client.1.smithi102.stdout:7/358: chown d1/d3/l33 1 1 2024-09-19T09:02:34.969 INFO:tasks.workunit.client.1.smithi102.stdout:7/359: stat d1/d2d/l49 0 2024-09-19T09:02:34.970 INFO:tasks.workunit.client.1.smithi102.stdout:0/461: mknod d3/dd/d10/d8e/c91 0 2024-09-19T09:02:34.970 INFO:tasks.workunit.client.1.smithi102.stdout:9/331: dread d1/d2/d3/f31 [0,4194304] 0 2024-09-19T09:02:34.973 INFO:tasks.workunit.client.1.smithi102.stdout:0/462: mknod d3/dd/d5b/c92 0 2024-09-19T09:02:34.973 INFO:tasks.workunit.client.1.smithi102.stdout:3/436: rmdir d2/d19/d1c/d2f/d5a/d84/d53 39 2024-09-19T09:02:34.975 INFO:tasks.workunit.client.1.smithi102.stdout:9/332: creat d1/d2/d3/d1d/f6a x:0 0 0 2024-09-19T09:02:34.977 INFO:tasks.workunit.client.1.smithi102.stdout:0/463: rename d3/dd/d10/d8e/c91 to d3/d8/de/c93 0 2024-09-19T09:02:34.978 INFO:tasks.workunit.client.1.smithi102.stdout:0/464: chown d3/dd/f1f 103847454 1 2024-09-19T09:02:34.978 INFO:tasks.workunit.client.1.smithi102.stdout:3/437: creat d2/d1e/f93 x:0 0 0 2024-09-19T09:02:34.979 INFO:tasks.workunit.client.1.smithi102.stdout:3/438: write d2/d19/d1c/f37 [55,56130] 0 2024-09-19T09:02:34.985 INFO:tasks.workunit.client.1.smithi102.stdout:7/360: getdents d1/d3 0 2024-09-19T09:02:34.985 INFO:tasks.workunit.client.1.smithi102.stdout:3/439: dwrite d2/d19/d47/db/f3c [0,4194304] 0 2024-09-19T09:02:34.986 INFO:tasks.workunit.client.1.smithi102.stdout:0/465: mknod d3/dd/d10/d15/d22/d37/d3d/d90/c94 0 2024-09-19T09:02:34.987 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: Upgrade: Updating mgr.smithi049.qdvksw 2024-09-19T09:02:34.988 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:34.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:02:34.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:02:34.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:02:34.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:34.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: Deploying daemon mgr.smithi049.qdvksw on smithi049 2024-09-19T09:02:34.989 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:34 smithi049 ceph-mon[28158]: pgmap v24: 65 pgs: 65 active+clean; 816 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 101 MiB/s wr, 434 op/s 2024-09-19T09:02:34.990 INFO:tasks.workunit.client.1.smithi102.stdout:7/361: truncate d1/d4/d45/d25/d52/f65 1012805 0 2024-09-19T09:02:34.990 INFO:tasks.workunit.client.1.smithi102.stdout:0/466: write d3/dd/d10/d15/d3e/f5e [564039,113622] 0 2024-09-19T09:02:34.990 INFO:tasks.workunit.client.1.smithi102.stdout:3/440: truncate d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f8d 1042895 0 2024-09-19T09:02:34.990 INFO:tasks.workunit.client.1.smithi102.stdout:7/362: mkdir d1/d2f/d6f 0 2024-09-19T09:02:34.995 INFO:tasks.workunit.client.1.smithi102.stdout:7/363: rename d1/c17 to d1/d4/d45/d25/d52/c70 0 2024-09-19T09:02:34.995 INFO:tasks.workunit.client.1.smithi102.stdout:7/364: dread - d1/d4/d45/d25/d52/f6b zero size 2024-09-19T09:02:34.998 INFO:tasks.workunit.client.1.smithi102.stdout:3/441: rename d2/d19/d1c/d1f/f60 to d2/d19/d47/db/d8b/f94 0 2024-09-19T09:02:34.998 INFO:tasks.workunit.client.1.smithi102.stdout:3/442: stat d2/d19/d35/f41 0 2024-09-19T09:02:35.003 INFO:tasks.workunit.client.1.smithi102.stdout:0/467: rename d3/dd/d10/d15/d22/d37/d39/d44/l71 to d3/dd/d72/l95 0 2024-09-19T09:02:35.003 INFO:tasks.workunit.client.1.smithi102.stdout:3/443: read d2/d1e/f38 [862,20418] 0 2024-09-19T09:02:35.004 INFO:tasks.workunit.client.1.smithi102.stdout:0/468: write d3/dd/d10/d15/d2c/f59 [645566,103179] 0 2024-09-19T09:02:35.005 INFO:tasks.workunit.client.1.smithi102.stdout:3/444: truncate d2/d19/d35/f7c 406036 0 2024-09-19T09:02:35.005 INFO:tasks.workunit.client.1.smithi102.stdout:3/445: fsync d2/d19/d47/db/f44 0 2024-09-19T09:02:35.006 INFO:tasks.workunit.client.1.smithi102.stdout:0/469: creat d3/dd/d1a/f96 x:0 0 0 2024-09-19T09:02:35.006 INFO:tasks.workunit.client.1.smithi102.stdout:3/446: write d2/d19/d47/db/f44 [1847964,22858] 0 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: Upgrade: Updating mgr.smithi049.qdvksw 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: Deploying daemon mgr.smithi049.qdvksw on smithi049 2024-09-19T09:02:35.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:34 smithi102 ceph-mon[35280]: pgmap v24: 65 pgs: 65 active+clean; 816 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 101 MiB/s wr, 434 op/s 2024-09-19T09:02:35.010 INFO:tasks.workunit.client.1.smithi102.stdout:3/447: symlink d2/d19/d1c/d2f/d5a/d84/d64/l95 0 2024-09-19T09:02:35.015 INFO:tasks.workunit.client.1.smithi102.stdout:3/448: dwrite d2/d1e/f93 [0,4194304] 0 2024-09-19T09:02:35.023 INFO:tasks.workunit.client.1.smithi102.stdout:3/449: dwrite d2/d19/d47/f71 [0,4194304] 0 2024-09-19T09:02:35.025 INFO:tasks.workunit.client.1.smithi102.stdout:3/450: rmdir d2/d19/d47 39 2024-09-19T09:02:35.033 INFO:tasks.workunit.client.1.smithi102.stdout:3/451: dwrite d2/d19/d1c/d2f/d5a/d84/d53/f79 [4194304,4194304] 0 2024-09-19T09:02:35.081 INFO:tasks.workunit.client.1.smithi102.stdout:2/277: sync 2024-09-19T09:02:35.083 INFO:tasks.workunit.client.1.smithi102.stdout:2/278: creat d7/d12/f5d x:0 0 0 2024-09-19T09:02:35.083 INFO:tasks.workunit.client.1.smithi102.stdout:2/279: read - d7/d1a/d2b/d31/f3c zero size 2024-09-19T09:02:35.086 INFO:tasks.workunit.client.1.smithi102.stdout:2/280: getdents d7/d11 0 2024-09-19T09:02:35.087 INFO:tasks.workunit.client.1.smithi102.stdout:2/281: chown d7/d1a/d2b 335 1 2024-09-19T09:02:35.089 INFO:tasks.workunit.client.1.smithi102.stdout:2/282: mknod d7/d1a/d2b/d4e/c5e 0 2024-09-19T09:02:35.102 INFO:tasks.workunit.client.1.smithi102.stdout:7/365: rename d1/d4/d45/d25/d52/c70 to d1/d3/c71 0 2024-09-19T09:02:35.102 INFO:tasks.workunit.client.1.smithi102.stdout:7/366: readlink d1/d3/d20/l4d 0 2024-09-19T09:02:35.104 INFO:tasks.workunit.client.1.smithi102.stdout:7/367: mkdir d1/d3/d72 0 2024-09-19T09:02:35.105 INFO:tasks.workunit.client.1.smithi102.stdout:7/368: readlink d1/l68 0 2024-09-19T09:02:35.111 INFO:tasks.workunit.client.1.smithi102.stdout:7/369: link d1/d4/d45/c5d d1/d3/c73 0 2024-09-19T09:02:35.114 INFO:tasks.workunit.client.1.smithi102.stdout:7/370: mkdir d1/d3/d34/d74 0 2024-09-19T09:02:35.118 INFO:tasks.workunit.client.1.smithi102.stdout:0/470: creat d3/dd/d1a/d32/d62/f97 x:0 0 0 2024-09-19T09:02:35.120 INFO:tasks.workunit.client.1.smithi102.stdout:7/371: dwrite d1/d3/d34/d4f/f50 [0,4194304] 0 2024-09-19T09:02:35.120 INFO:tasks.workunit.client.1.smithi102.stdout:0/471: chown d3/dd/d10/d15/d19/c61 11977438 1 2024-09-19T09:02:35.125 INFO:tasks.workunit.client.1.smithi102.stdout:3/452: truncate d2/d19/d47/f7 12033155 0 2024-09-19T09:02:35.126 INFO:tasks.workunit.client.1.smithi102.stdout:2/283: truncate d7/f9 6500896 0 2024-09-19T09:02:35.128 INFO:tasks.workunit.client.1.smithi102.stdout:3/453: write d2/d19/d1c/d70/f8a [602658,74692] 0 2024-09-19T09:02:35.128 INFO:tasks.workunit.client.1.smithi102.stdout:0/472: dwrite d3/dd/d10/d15/d3e/f5e [0,4194304] 0 2024-09-19T09:02:35.128 INFO:tasks.workunit.client.1.smithi102.stdout:7/372: rmdir d1/d2f/d6f 0 2024-09-19T09:02:35.130 INFO:tasks.workunit.client.1.smithi102.stdout:2/284: creat d7/d1a/d2b/d31/d51/f5f x:0 0 0 2024-09-19T09:02:35.131 INFO:tasks.workunit.client.1.smithi102.stdout:0/473: mkdir d3/dd/d72/d98 0 2024-09-19T09:02:35.132 INFO:tasks.workunit.client.1.smithi102.stdout:3/454: mkdir d2/d19/d47/db/d26/d63/d6f/d96 0 2024-09-19T09:02:35.133 INFO:tasks.workunit.client.1.smithi102.stdout:2/285: mknod d7/c60 0 2024-09-19T09:02:35.134 INFO:tasks.workunit.client.1.smithi102.stdout:0/474: mkdir d3/dd/d1a/d32/d7f/d99 0 2024-09-19T09:02:35.137 INFO:tasks.workunit.client.1.smithi102.stdout:7/373: dwrite d1/d4/f63 [0,4194304] 0 2024-09-19T09:02:35.137 INFO:tasks.workunit.client.1.smithi102.stdout:3/455: rename d2/d1e/f3b to d2/d1e/d54/f97 0 2024-09-19T09:02:35.140 INFO:tasks.workunit.client.1.smithi102.stdout:2/286: mknod d7/d1a/d56/c61 0 2024-09-19T09:02:35.146 INFO:tasks.workunit.client.1.smithi102.stdout:7/374: rename d1/d4/d45/d25/f6e to d1/d3/d72/f75 0 2024-09-19T09:02:35.151 INFO:tasks.workunit.client.1.smithi102.stdout:7/375: mknod d1/d4/d45/d25/c76 0 2024-09-19T09:02:35.153 INFO:tasks.workunit.client.1.smithi102.stdout:0/475: creat d3/dd/d10/d15/d22/d37/f9a x:0 0 0 2024-09-19T09:02:35.155 INFO:tasks.workunit.client.1.smithi102.stdout:2/287: dwrite f3 [4194304,4194304] 0 2024-09-19T09:02:35.157 INFO:tasks.workunit.client.1.smithi102.stdout:7/376: rename d1/d4/f59 to d1/d4/d45/d25/f77 0 2024-09-19T09:02:35.162 INFO:tasks.workunit.client.1.smithi102.stdout:2/288: dread d7/d1a/d2b/f35 [0,4194304] 0 2024-09-19T09:02:35.165 INFO:tasks.workunit.client.1.smithi102.stdout:5/396: sync 2024-09-19T09:02:35.166 INFO:tasks.workunit.client.1.smithi102.stdout:0/476: dwrite d3/dd/d10/d15/d22/d37/d39/d44/f6b [0,4194304] 0 2024-09-19T09:02:35.167 INFO:tasks.workunit.client.1.smithi102.stdout:2/289: symlink d7/d1a/d2b/d31/l62 0 2024-09-19T09:02:35.168 INFO:tasks.workunit.client.1.smithi102.stdout:5/397: chown d5/d7/d1a/d37/l63 829630 1 2024-09-19T09:02:35.170 INFO:tasks.workunit.client.1.smithi102.stdout:7/377: dwrite d1/d3/d20/f44 [4194304,4194304] 0 2024-09-19T09:02:35.172 INFO:tasks.workunit.client.1.smithi102.stdout:5/398: truncate d5/d7/d1a/d42/f66 232841 0 2024-09-19T09:02:35.174 INFO:tasks.workunit.client.1.smithi102.stdout:2/290: write d7/d1a/d2b/f35 [614613,75901] 0 2024-09-19T09:02:35.176 INFO:tasks.workunit.client.1.smithi102.stdout:3/456: write d2/d1e/f4d [183096,98327] 0 2024-09-19T09:02:35.181 INFO:tasks.workunit.client.1.smithi102.stdout:3/457: chown d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90 2008747 1 2024-09-19T09:02:35.182 INFO:tasks.workunit.client.1.smithi102.stdout:2/291: symlink d7/d1a/l63 0 2024-09-19T09:02:35.182 INFO:tasks.workunit.client.1.smithi102.stdout:0/477: dwrite d3/dd/d10/d15/d22/d2a/f6c [0,4194304] 0 2024-09-19T09:02:35.185 INFO:tasks.workunit.client.1.smithi102.stdout:7/378: getdents d1/d4/d45/d25/d52 0 2024-09-19T09:02:35.186 INFO:tasks.workunit.client.1.smithi102.stdout:0/478: write d3/f14 [6957653,70118] 0 2024-09-19T09:02:35.186 INFO:tasks.workunit.client.1.smithi102.stdout:5/399: dwrite d5/d7/d1a/d37/d39/d4c/f70 [0,4194304] 0 2024-09-19T09:02:35.193 INFO:tasks.workunit.client.1.smithi102.stdout:0/479: write d3/dd/d1a/d32/d62/f97 [801113,34294] 0 2024-09-19T09:02:35.198 INFO:tasks.workunit.client.1.smithi102.stdout:5/400: dread d5/d7/d1a/d37/d39/d4c/f4a [0,4194304] 0 2024-09-19T09:02:35.199 INFO:tasks.workunit.client.1.smithi102.stdout:2/292: dwrite d7/d12/f5d [0,4194304] 0 2024-09-19T09:02:35.200 INFO:tasks.workunit.client.1.smithi102.stdout:2/293: stat d7/d11 0 2024-09-19T09:02:35.204 INFO:tasks.workunit.client.1.smithi102.stdout:2/294: mkdir d7/d50/d64 0 2024-09-19T09:02:35.207 INFO:tasks.workunit.client.1.smithi102.stdout:0/480: dwrite d3/dd/d10/d15/d22/d37/d3d/f48 [0,4194304] 0 2024-09-19T09:02:35.217 INFO:tasks.workunit.client.1.smithi102.stdout:8/328: sync 2024-09-19T09:02:35.217 INFO:tasks.workunit.client.1.smithi102.stdout:9/333: sync 2024-09-19T09:02:35.217 INFO:tasks.workunit.client.1.smithi102.stdout:1/376: sync 2024-09-19T09:02:35.217 INFO:tasks.workunit.client.1.smithi102.stdout:4/408: sync 2024-09-19T09:02:35.217 INFO:tasks.workunit.client.1.smithi102.stdout:6/308: sync 2024-09-19T09:02:35.217 INFO:tasks.workunit.client.1.smithi102.stdout:5/401: dwrite d5/d7/d1a/d37/d39/f3c [0,4194304] 0 2024-09-19T09:02:35.218 INFO:tasks.workunit.client.1.smithi102.stdout:0/481: chown d3/dd/ff 141748763 1 2024-09-19T09:02:35.220 INFO:tasks.workunit.client.1.smithi102.stdout:1/377: chown dd/d5f/f63 64109 1 2024-09-19T09:02:35.223 INFO:tasks.workunit.client.1.smithi102.stdout:8/329: symlink d0/d5a/l61 0 2024-09-19T09:02:35.225 INFO:tasks.workunit.client.1.smithi102.stdout:5/402: fsync d5/d7/d1a/d37/f45 0 2024-09-19T09:02:35.226 INFO:tasks.workunit.client.1.smithi102.stdout:0/482: rmdir d3/dd/d10/d15/d22/d2a 39 2024-09-19T09:02:35.227 INFO:tasks.workunit.client.1.smithi102.stdout:3/458: dwrite d2/d19/d1c/d2f/d5a/d84/f91 [0,4194304] 0 2024-09-19T09:02:35.228 INFO:tasks.workunit.client.1.smithi102.stdout:1/378: fdatasync dd/d13/f36 0 2024-09-19T09:02:35.228 INFO:tasks.workunit.client.1.smithi102.stdout:4/409: unlink d14/d16/d17/d2e/d37/c6a 0 2024-09-19T09:02:35.229 INFO:tasks.workunit.client.1.smithi102.stdout:7/379: dread d1/d2f/f4a [0,4194304] 0 2024-09-19T09:02:35.231 INFO:tasks.workunit.client.1.smithi102.stdout:9/334: rename d1/d2/d3/d34/f65 to d1/d2/d3/d34/f6b 0 2024-09-19T09:02:35.232 INFO:tasks.workunit.client.1.smithi102.stdout:3/459: rmdir d2 39 2024-09-19T09:02:35.233 INFO:tasks.workunit.client.1.smithi102.stdout:2/295: dwrite d7/d11/f1e [0,4194304] 0 2024-09-19T09:02:35.237 INFO:tasks.workunit.client.1.smithi102.stdout:0/483: creat d3/dd/d10/d15/d2c/f9b x:0 0 0 2024-09-19T09:02:35.240 INFO:tasks.workunit.client.1.smithi102.stdout:8/330: dwrite d0/d10/d21/d39/f59 [0,4194304] 0 2024-09-19T09:02:35.241 INFO:tasks.workunit.client.1.smithi102.stdout:7/380: write d1/f1e [3283345,55369] 0 2024-09-19T09:02:35.247 INFO:tasks.workunit.client.1.smithi102.stdout:2/296: dwrite d7/d1a/d2b/d31/f48 [0,4194304] 0 2024-09-19T09:02:35.249 INFO:tasks.workunit.client.1.smithi102.stdout:2/297: truncate d7/d1a/d2b/d31/f48 4820951 0 2024-09-19T09:02:35.335 INFO:tasks.workunit.client.1.smithi102.stdout:6/309: sync 2024-09-19T09:02:35.343 INFO:tasks.workunit.client.1.smithi102.stdout:4/410: mkdir d14/d16/d17/d25/d7c 0 2024-09-19T09:02:35.344 INFO:tasks.workunit.client.1.smithi102.stdout:4/411: fdatasync d14/d16/d1d/f43 0 2024-09-19T09:02:35.348 INFO:tasks.workunit.client.1.smithi102.stdout:8/331: unlink d0/d10/d23/f45 0 2024-09-19T09:02:35.349 INFO:tasks.workunit.client.1.smithi102.stdout:3/460: mknod d2/d19/d47/db/d26/d63/c98 0 2024-09-19T09:02:35.351 INFO:tasks.workunit.client.1.smithi102.stdout:0/484: write d3/dd/ff [2096768,108215] 0 2024-09-19T09:02:35.353 INFO:tasks.workunit.client.1.smithi102.stdout:1/379: dwrite dd/d14/d18/f40 [0,4194304] 0 2024-09-19T09:02:35.355 INFO:tasks.workunit.client.1.smithi102.stdout:5/403: dread d5/d7/d1a/f58 [0,4194304] 0 2024-09-19T09:02:35.356 INFO:tasks.workunit.client.1.smithi102.stdout:4/412: rename l5 to d14/d34/d5a/l7d 0 2024-09-19T09:02:35.358 INFO:tasks.workunit.client.1.smithi102.stdout:8/332: symlink d0/db/d29/l62 0 2024-09-19T09:02:35.358 INFO:tasks.workunit.client.1.smithi102.stdout:1/380: write dd/d14/d18/f29 [1088251,21571] 0 2024-09-19T09:02:35.360 INFO:tasks.workunit.client.1.smithi102.stdout:2/298: creat d7/d50/d64/f65 x:0 0 0 2024-09-19T09:02:35.363 INFO:tasks.workunit.client.1.smithi102.stdout:9/335: dread d1/d2/ff [0,4194304] 0 2024-09-19T09:02:35.363 INFO:tasks.workunit.client.1.smithi102.stdout:3/461: readlink d2/d19/d47/db/d26/d63/d6f/l86 0 2024-09-19T09:02:35.364 INFO:tasks.workunit.client.1.smithi102.stdout:8/333: fsync d0/d10/d21/d39/f59 0 2024-09-19T09:02:35.365 INFO:tasks.workunit.client.1.smithi102.stdout:6/310: creat d1/d26/d2e/f6b x:0 0 0 2024-09-19T09:02:35.366 INFO:tasks.workunit.client.1.smithi102.stdout:4/413: mknod d14/d34/c7e 0 2024-09-19T09:02:35.369 INFO:tasks.workunit.client.1.smithi102.stdout:7/381: dwrite d1/d3/d72/f75 [0,4194304] 0 2024-09-19T09:02:35.371 INFO:tasks.workunit.client.1.smithi102.stdout:8/334: chown d0/d5a/l61 1828 1 2024-09-19T09:02:35.372 INFO:tasks.workunit.client.1.smithi102.stdout:4/414: fsync d14/d34/d5a/d5c/f7b 0 2024-09-19T09:02:35.375 INFO:tasks.workunit.client.1.smithi102.stdout:2/299: rename d7/d12/l13 to d7/d1a/d2b/d4e/l66 0 2024-09-19T09:02:35.375 INFO:tasks.workunit.client.1.smithi102.stdout:7/382: chown d1/d3/d34/d4f/f61 482 1 2024-09-19T09:02:35.375 INFO:tasks.workunit.client.1.smithi102.stdout:0/485: dread d3/dd/d10/d15/d22/d37/d39/d44/f6b [0,4194304] 0 2024-09-19T09:02:35.379 INFO:tasks.workunit.client.1.smithi102.stdout:4/415: dread - d14/d16/d17/d25/d2b/f67 zero size 2024-09-19T09:02:35.379 INFO:tasks.workunit.client.1.smithi102.stdout:1/381: dwrite dd/d14/d35/f58 [0,4194304] 0 2024-09-19T09:02:35.379 INFO:tasks.workunit.client.1.smithi102.stdout:5/404: dwrite d5/d7/f29 [0,4194304] 0 2024-09-19T09:02:35.382 INFO:tasks.workunit.client.1.smithi102.stdout:3/462: rename d2/d19/d47/db/d26/c49 to d2/d19/d47/db/d26/d63/d6f/c99 0 2024-09-19T09:02:35.382 INFO:tasks.workunit.client.1.smithi102.stdout:0/486: write d3/dd/f7c [2686835,101083] 0 2024-09-19T09:02:35.388 INFO:tasks.workunit.client.1.smithi102.stdout:2/300: creat d7/d1a/d2b/d4e/f67 x:0 0 0 2024-09-19T09:02:35.388 INFO:tasks.workunit.client.1.smithi102.stdout:4/416: chown d14/d34/f28 398474152 1 2024-09-19T09:02:35.390 INFO:tasks.workunit.client.1.smithi102.stdout:1/382: mkdir dd/d7a 0 2024-09-19T09:02:35.391 INFO:tasks.workunit.client.1.smithi102.stdout:5/405: mkdir d5/d7/d1a/d37/d34/d7f 0 2024-09-19T09:02:35.393 INFO:tasks.workunit.client.1.smithi102.stdout:8/335: dwrite d0/f35 [0,4194304] 0 2024-09-19T09:02:35.400 INFO:tasks.workunit.client.1.smithi102.stdout:2/301: dread d7/d12/f4b [0,4194304] 0 2024-09-19T09:02:35.403 INFO:tasks.workunit.client.1.smithi102.stdout:5/406: write d5/d7/d1a/d42/d4b/f71 [561185,18991] 0 2024-09-19T09:02:35.404 INFO:tasks.workunit.client.1.smithi102.stdout:7/383: dwrite d1/d4/d45/d25/d52/f65 [0,4194304] 0 2024-09-19T09:02:35.406 INFO:tasks.workunit.client.1.smithi102.stdout:0/487: dwrite d3/dd/d1a/f96 [0,4194304] 0 2024-09-19T09:02:35.408 INFO:tasks.workunit.client.1.smithi102.stdout:3/463: link d2/d19/d35/f41 d2/d19/d1c/d2f/d5a/d84/f9a 0 2024-09-19T09:02:35.409 INFO:tasks.workunit.client.1.smithi102.stdout:9/336: truncate d1/d2/d3/f31 3057965 0 2024-09-19T09:02:35.411 INFO:tasks.workunit.client.1.smithi102.stdout:7/384: creat d1/d3/f78 x:0 0 0 2024-09-19T09:02:35.413 INFO:tasks.workunit.client.1.smithi102.stdout:2/302: rename d7/d12/f2f to d7/d11/f68 0 2024-09-19T09:02:35.416 INFO:tasks.workunit.client.1.smithi102.stdout:7/385: readlink d1/d3/d20/l4d 0 2024-09-19T09:02:35.416 INFO:tasks.workunit.client.1.smithi102.stdout:5/407: dread d5/d7/d1a/d37/d39/d4c/f4a [0,4194304] 0 2024-09-19T09:02:35.419 INFO:tasks.workunit.client.1.smithi102.stdout:3/464: rmdir d2/d19/d1c/d2f 39 2024-09-19T09:02:35.419 INFO:tasks.workunit.client.1.smithi102.stdout:2/303: truncate d7/fc 4334856 0 2024-09-19T09:02:35.420 INFO:tasks.workunit.client.1.smithi102.stdout:8/336: dwrite d0/fd [4194304,4194304] 0 2024-09-19T09:02:35.424 INFO:tasks.workunit.client.1.smithi102.stdout:7/386: stat d1/d4/c28 0 2024-09-19T09:02:35.427 INFO:tasks.workunit.client.1.smithi102.stdout:6/311: dwrite d1/d26/d2e/d45/d47/d4d/f33 [0,4194304] 0 2024-09-19T09:02:35.429 INFO:tasks.workunit.client.1.smithi102.stdout:4/417: dread fd [0,4194304] 0 2024-09-19T09:02:35.430 INFO:tasks.workunit.client.1.smithi102.stdout:6/312: dread - d1/d18/f6a zero size 2024-09-19T09:02:35.431 INFO:tasks.workunit.client.1.smithi102.stdout:1/383: dwrite dd/d14/f2a [0,4194304] 0 2024-09-19T09:02:35.431 INFO:tasks.workunit.client.1.smithi102.stdout:8/337: mkdir d0/d10/d21/d39/d50/d63 0 2024-09-19T09:02:35.432 INFO:tasks.workunit.client.1.smithi102.stdout:7/387: rename d1/l3f to d1/d3/d72/l79 0 2024-09-19T09:02:35.435 INFO:tasks.workunit.client.1.smithi102.stdout:3/465: dread d2/f1d [0,4194304] 0 2024-09-19T09:02:35.438 INFO:tasks.workunit.client.1.smithi102.stdout:6/313: chown d1/d18/db/c17 213 1 2024-09-19T09:02:35.438 INFO:tasks.workunit.client.1.smithi102.stdout:1/384: dread - dd/d14/d35/d49/d62/d6c/f77 zero size 2024-09-19T09:02:35.438 INFO:tasks.workunit.client.1.smithi102.stdout:7/388: fdatasync d1/d3/d20/f5a 0 2024-09-19T09:02:35.439 INFO:tasks.workunit.client.1.smithi102.stdout:5/408: dwrite d5/d7/d1a/d42/d4b/f5f [0,4194304] 0 2024-09-19T09:02:35.445 INFO:tasks.workunit.client.1.smithi102.stdout:1/385: mknod dd/c7b 0 2024-09-19T09:02:35.445 INFO:tasks.workunit.client.1.smithi102.stdout:7/389: fsync d1/f2a 0 2024-09-19T09:02:35.449 INFO:tasks.workunit.client.1.smithi102.stdout:5/409: rmdir d5/d23 39 2024-09-19T09:02:35.450 INFO:tasks.workunit.client.1.smithi102.stdout:7/390: chown d1/d4/d45/l12 75981036 1 2024-09-19T09:02:35.454 INFO:tasks.workunit.client.1.smithi102.stdout:4/418: dwrite d14/d16/d1d/f43 [0,4194304] 0 2024-09-19T09:02:35.455 INFO:tasks.workunit.client.1.smithi102.stdout:8/338: dwrite d0/f35 [4194304,4194304] 0 2024-09-19T09:02:35.458 INFO:tasks.workunit.client.1.smithi102.stdout:6/314: dread d1/f43 [0,4194304] 0 2024-09-19T09:02:35.458 INFO:tasks.workunit.client.1.smithi102.stdout:9/337: write d1/d8/d1c/f19 [1244421,25876] 0 2024-09-19T09:02:35.458 INFO:tasks.workunit.client.1.smithi102.stdout:0/488: truncate d3/d8/f43 394756 0 2024-09-19T09:02:35.463 INFO:tasks.workunit.client.1.smithi102.stdout:5/410: symlink d5/d7/d1a/d42/l80 0 2024-09-19T09:02:35.465 INFO:tasks.workunit.client.1.smithi102.stdout:6/315: write d1/f43 [770396,79121] 0 2024-09-19T09:02:35.465 INFO:tasks.workunit.client.1.smithi102.stdout:1/386: dwrite f0 [0,4194304] 0 2024-09-19T09:02:35.465 INFO:tasks.workunit.client.1.smithi102.stdout:5/411: fdatasync d5/d23/f24 0 2024-09-19T09:02:35.466 INFO:tasks.workunit.client.1.smithi102.stdout:7/391: truncate d1/d4/d45/d25/f4b 2135 0 2024-09-19T09:02:35.471 INFO:tasks.workunit.client.1.smithi102.stdout:9/338: unlink d1/d8/f5e 0 2024-09-19T09:02:35.473 INFO:tasks.workunit.client.1.smithi102.stdout:1/387: creat dd/d5f/f7c x:0 0 0 2024-09-19T09:02:35.474 INFO:tasks.workunit.client.1.smithi102.stdout:4/419: dread d14/d16/d1d/f53 [0,4194304] 0 2024-09-19T09:02:35.474 INFO:tasks.workunit.client.1.smithi102.stdout:7/392: dread d1/d2f/f4a [0,4194304] 0 2024-09-19T09:02:35.475 INFO:tasks.workunit.client.1.smithi102.stdout:1/388: write dd/d13/d2d/f39 [2380962,75595] 0 2024-09-19T09:02:35.476 INFO:tasks.workunit.client.1.smithi102.stdout:6/316: symlink d1/d26/d2e/d45/d47/d4d/d3b/l6c 0 2024-09-19T09:02:35.477 INFO:tasks.workunit.client.1.smithi102.stdout:1/389: fdatasync dd/ff 0 2024-09-19T09:02:35.477 INFO:tasks.workunit.client.1.smithi102.stdout:0/489: symlink d3/dd/d10/d84/l9c 0 2024-09-19T09:02:35.478 INFO:tasks.workunit.client.1.smithi102.stdout:6/317: truncate d1/f1b 116192 0 2024-09-19T09:02:35.480 INFO:tasks.workunit.client.1.smithi102.stdout:8/339: rename d0/d10/d23 to d0/d64 0 2024-09-19T09:02:35.483 INFO:tasks.workunit.client.1.smithi102.stdout:5/412: dwrite d5/f6e [0,4194304] 0 2024-09-19T09:02:35.483 INFO:tasks.workunit.client.1.smithi102.stdout:3/466: dread d2/f18 [0,4194304] 0 2024-09-19T09:02:35.484 INFO:tasks.workunit.client.1.smithi102.stdout:0/490: mkdir d3/d8/d9d 0 2024-09-19T09:02:35.485 INFO:tasks.workunit.client.1.smithi102.stdout:6/318: mkdir d1/d18/db/d6d 0 2024-09-19T09:02:35.487 INFO:tasks.workunit.client.1.smithi102.stdout:5/413: write d5/d7/d1a/d37/d39/f3c [627159,61022] 0 2024-09-19T09:02:35.488 INFO:tasks.workunit.client.1.smithi102.stdout:6/319: write d1/d18/db/f5e [99392,18623] 0 2024-09-19T09:02:35.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/420: rename fd to d14/d16/d17/d25/f7f 0 2024-09-19T09:02:35.492 INFO:tasks.workunit.client.1.smithi102.stdout:3/467: creat d2/d19/d47/db/d26/d63/f9b x:0 0 0 2024-09-19T09:02:35.493 INFO:tasks.workunit.client.1.smithi102.stdout:7/393: getdents d1 0 2024-09-19T09:02:35.493 INFO:tasks.workunit.client.1.smithi102.stdout:0/491: mknod d3/dd/d10/d15/d22/d37/c9e 0 2024-09-19T09:02:35.494 INFO:tasks.workunit.client.1.smithi102.stdout:6/320: chown d1/d18/db/f10 513 1 2024-09-19T09:02:35.495 INFO:tasks.workunit.client.1.smithi102.stdout:5/414: mkdir d5/d7/d1a/d37/d39/d81 0 2024-09-19T09:02:35.498 INFO:tasks.workunit.client.1.smithi102.stdout:3/468: dread d2/d19/d47/db/d26/f7f [0,4194304] 0 2024-09-19T09:02:35.500 INFO:tasks.workunit.client.1.smithi102.stdout:7/394: symlink d1/d3/d20/d6c/l7a 0 2024-09-19T09:02:35.501 INFO:tasks.workunit.client.1.smithi102.stdout:0/492: write d3/dd/d10/d15/d22/d37/f69 [1243639,46023] 0 2024-09-19T09:02:35.503 INFO:tasks.workunit.client.1.smithi102.stdout:3/469: mknod d2/d19/d35/c9c 0 2024-09-19T09:02:35.505 INFO:tasks.workunit.client.1.smithi102.stdout:6/321: chown d1/d26/d2e/d45/d47/d4d/d35/l48 114 1 2024-09-19T09:02:35.505 INFO:tasks.workunit.client.1.smithi102.stdout:7/395: write d1/d2d/f43 [6824529,113894] 0 2024-09-19T09:02:35.506 INFO:tasks.workunit.client.1.smithi102.stdout:4/421: dwrite d14/d34/f6e [0,4194304] 0 2024-09-19T09:02:35.513 INFO:tasks.workunit.client.1.smithi102.stdout:7/396: creat d1/d2d/f7b x:0 0 0 2024-09-19T09:02:35.515 INFO:tasks.workunit.client.1.smithi102.stdout:3/470: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9d x:0 0 0 2024-09-19T09:02:35.517 INFO:tasks.workunit.client.1.smithi102.stdout:0/493: creat d3/dd/d10/f9f x:0 0 0 2024-09-19T09:02:35.520 INFO:tasks.workunit.client.1.smithi102.stdout:8/340: dread d0/d10/d21/f24 [0,4194304] 0 2024-09-19T09:02:35.520 INFO:tasks.workunit.client.1.smithi102.stdout:4/422: mkdir d14/d16/d17/d25/d7c/d80 0 2024-09-19T09:02:35.520 INFO:tasks.workunit.client.1.smithi102.stdout:7/397: read d1/d4/d45/d25/f2e [903787,48076] 0 2024-09-19T09:02:35.521 INFO:tasks.workunit.client.1.smithi102.stdout:1/390: dread dd/d14/d18/f1f [0,4194304] 0 2024-09-19T09:02:35.522 INFO:tasks.workunit.client.1.smithi102.stdout:2/304: sync 2024-09-19T09:02:35.524 INFO:tasks.workunit.client.1.smithi102.stdout:6/322: dwrite d1/d18/db/f31 [0,4194304] 0 2024-09-19T09:02:35.524 INFO:tasks.workunit.client.1.smithi102.stdout:9/339: dwrite d1/d2/d3/f12 [0,4194304] 0 2024-09-19T09:02:35.526 INFO:tasks.workunit.client.1.smithi102.stdout:0/494: fsync d3/dd/d10/d15/d19/f26 0 2024-09-19T09:02:35.533 INFO:tasks.workunit.client.1.smithi102.stdout:9/340: write d1/d8/d1c/f3e [807251,59488] 0 2024-09-19T09:02:35.538 INFO:tasks.workunit.client.1.smithi102.stdout:8/341: link d0/d10/d21/f24 d0/d4f/f65 0 2024-09-19T09:02:35.538 INFO:tasks.workunit.client.1.smithi102.stdout:5/415: truncate d5/d7/d1a/d37/d39/d4c/f55 7567123 0 2024-09-19T09:02:35.538 INFO:tasks.workunit.client.1.smithi102.stdout:9/341: rename d1/d2 to d1/d2/d3/d34/d6c 22 2024-09-19T09:02:35.539 INFO:tasks.workunit.client.1.smithi102.stdout:6/323: symlink d1/d26/d2e/d45/d47/d4d/d35/l6e 0 2024-09-19T09:02:35.540 INFO:tasks.workunit.client.1.smithi102.stdout:7/398: dwrite d1/d3/d20/f4c [0,4194304] 0 2024-09-19T09:02:35.542 INFO:tasks.workunit.client.1.smithi102.stdout:0/495: dread d3/dd/d1a/d32/d62/f97 [0,4194304] 0 2024-09-19T09:02:35.543 INFO:tasks.workunit.client.1.smithi102.stdout:1/391: dwrite dd/d13/f36 [0,4194304] 0 2024-09-19T09:02:35.545 INFO:tasks.workunit.client.1.smithi102.stdout:5/416: creat d5/d23/f82 x:0 0 0 2024-09-19T09:02:35.547 INFO:tasks.workunit.client.1.smithi102.stdout:1/392: write dd/d5f/f7c [403811,88711] 0 2024-09-19T09:02:35.548 INFO:tasks.workunit.client.1.smithi102.stdout:9/342: chown d1/d2/d3/d1d/d4f/f5a 25 1 2024-09-19T09:02:35.549 INFO:tasks.workunit.client.1.smithi102.stdout:8/342: link d0/f35 d0/d10/d3a/f66 0 2024-09-19T09:02:35.551 INFO:tasks.workunit.client.1.smithi102.stdout:7/399: creat d1/d4/d45/f7c x:0 0 0 2024-09-19T09:02:35.551 INFO:tasks.workunit.client.1.smithi102.stdout:9/343: chown d1/c2a 4 1 2024-09-19T09:02:35.552 INFO:tasks.workunit.client.1.smithi102.stdout:4/423: dwrite d14/d16/f26 [0,4194304] 0 2024-09-19T09:02:35.552 INFO:tasks.workunit.client.1.smithi102.stdout:5/417: unlink d5/d7/c62 0 2024-09-19T09:02:35.554 INFO:tasks.workunit.client.1.smithi102.stdout:8/343: mknod d0/d64/c67 0 2024-09-19T09:02:35.558 INFO:tasks.workunit.client.1.smithi102.stdout:9/344: rmdir d1/d2 39 2024-09-19T09:02:35.558 INFO:tasks.workunit.client.1.smithi102.stdout:0/496: mknod d3/dd/d10/d15/d22/d37/ca0 0 2024-09-19T09:02:35.560 INFO:tasks.workunit.client.1.smithi102.stdout:4/424: stat d14/d16/d17/c22 0 2024-09-19T09:02:35.560 INFO:tasks.workunit.client.1.smithi102.stdout:9/345: fdatasync d1/f2f 0 2024-09-19T09:02:35.561 INFO:tasks.workunit.client.1.smithi102.stdout:2/305: dread d7/f10 [0,4194304] 0 2024-09-19T09:02:35.561 INFO:tasks.workunit.client.1.smithi102.stdout:8/344: dread d0/d4f/f65 [0,4194304] 0 2024-09-19T09:02:35.565 INFO:tasks.workunit.client.1.smithi102.stdout:7/400: rename d1/d4/d45/f7c to d1/d4/d45/d25/f7d 0 2024-09-19T09:02:35.567 INFO:tasks.workunit.client.1.smithi102.stdout:6/324: dread d1/d26/d2e/f5f [0,4194304] 0 2024-09-19T09:02:35.569 INFO:tasks.workunit.client.1.smithi102.stdout:8/345: symlink d0/db/l68 0 2024-09-19T09:02:35.570 INFO:tasks.workunit.client.1.smithi102.stdout:6/325: read d1/d3a/f5d [1626319,50073] 0 2024-09-19T09:02:35.571 INFO:tasks.workunit.client.1.smithi102.stdout:8/346: write d0/f7 [879849,105474] 0 2024-09-19T09:02:35.572 INFO:tasks.workunit.client.1.smithi102.stdout:0/497: dwrite d3/dd/d10/d15/d22/d37/d3d/f48 [0,4194304] 0 2024-09-19T09:02:35.573 INFO:tasks.workunit.client.1.smithi102.stdout:2/306: creat d7/d1a/d2b/f69 x:0 0 0 2024-09-19T09:02:35.578 INFO:tasks.workunit.client.1.smithi102.stdout:7/401: mknod d1/d3/d34/d4f/c7e 0 2024-09-19T09:02:35.578 INFO:tasks.workunit.client.1.smithi102.stdout:7/402: readlink d1/d2d/l49 0 2024-09-19T09:02:35.580 INFO:tasks.workunit.client.1.smithi102.stdout:5/418: chown d5/d7/d1a/d42/f6d 0 1 2024-09-19T09:02:35.581 INFO:tasks.workunit.client.1.smithi102.stdout:8/347: rmdir d0/db 39 2024-09-19T09:02:35.581 INFO:tasks.workunit.client.1.smithi102.stdout:5/419: read d5/d7/d1a/d37/f45 [405898,119336] 0 2024-09-19T09:02:35.582 INFO:tasks.workunit.client.1.smithi102.stdout:6/326: rmdir d1/d26/d2e/d45/d47/d4d/d35/d41 39 2024-09-19T09:02:35.583 INFO:tasks.workunit.client.1.smithi102.stdout:2/307: creat d7/d12/f6a x:0 0 0 2024-09-19T09:02:35.585 INFO:tasks.workunit.client.1.smithi102.stdout:4/425: rename d14/d5e to d14/d34/d5a/d5c/d81 0 2024-09-19T09:02:35.586 INFO:tasks.workunit.client.1.smithi102.stdout:7/403: mkdir d1/d4/d45/d25/d52/d7f 0 2024-09-19T09:02:35.591 INFO:tasks.workunit.client.1.smithi102.stdout:0/498: dwrite d3/dd/d10/d15/d22/d2a/f6c [0,4194304] 0 2024-09-19T09:02:35.592 INFO:tasks.workunit.client.1.smithi102.stdout:2/308: mkdir d7/d1a/d2b/d31/d51/d6b 0 2024-09-19T09:02:35.593 INFO:tasks.workunit.client.1.smithi102.stdout:9/346: getdents d1/d8/d1c 0 2024-09-19T09:02:35.595 INFO:tasks.workunit.client.1.smithi102.stdout:7/404: rmdir d1/d2f 39 2024-09-19T09:02:35.597 INFO:tasks.workunit.client.1.smithi102.stdout:8/348: unlink d0/db/c52 0 2024-09-19T09:02:35.598 INFO:tasks.workunit.client.1.smithi102.stdout:4/426: dwrite d14/d16/d1d/f43 [0,4194304] 0 2024-09-19T09:02:35.604 INFO:tasks.workunit.client.1.smithi102.stdout:8/349: chown d0/c4c 1 1 2024-09-19T09:02:35.604 INFO:tasks.workunit.client.1.smithi102.stdout:5/420: dwrite d5/fe [4194304,4194304] 0 2024-09-19T09:02:35.604 INFO:tasks.workunit.client.1.smithi102.stdout:9/347: truncate d1/d2/d3/d1d/f30 5112344 0 2024-09-19T09:02:35.606 INFO:tasks.workunit.client.1.smithi102.stdout:6/327: dread d1/d18/db/f1a [0,4194304] 0 2024-09-19T09:02:35.609 INFO:tasks.workunit.client.1.smithi102.stdout:4/427: unlink d14/d34/f4d 0 2024-09-19T09:02:35.610 INFO:tasks.workunit.client.1.smithi102.stdout:4/428: chown d14/d16/d17/d2e/d37 804 1 2024-09-19T09:02:35.615 INFO:tasks.workunit.client.1.smithi102.stdout:5/421: mknod d5/d60/c83 0 2024-09-19T09:02:35.616 INFO:tasks.workunit.client.1.smithi102.stdout:9/348: mkdir d1/d2/d3/d1d/d4f/d6d 0 2024-09-19T09:02:35.618 INFO:tasks.workunit.client.1.smithi102.stdout:5/422: dread d5/d7/d1a/d42/f66 [0,4194304] 0 2024-09-19T09:02:35.619 INFO:tasks.workunit.client.1.smithi102.stdout:7/405: dread d1/d4/f63 [0,4194304] 0 2024-09-19T09:02:35.619 INFO:tasks.workunit.client.1.smithi102.stdout:0/499: mkdir d3/dd/d10/d15/d22/d37/da1 0 2024-09-19T09:02:35.621 INFO:tasks.workunit.client.1.smithi102.stdout:2/309: write d7/f9 [4292379,53370] 0 2024-09-19T09:02:35.625 INFO:tasks.workunit.client.1.smithi102.stdout:4/429: rmdir d14/d16/d17 39 2024-09-19T09:02:35.632 INFO:tasks.workunit.client.1.smithi102.stdout:8/350: dwrite d0/f56 [4194304,4194304] 0 2024-09-19T09:02:35.632 INFO:tasks.workunit.client.1.smithi102.stdout:6/328: creat d1/d18/db/d6d/f6f x:0 0 0 2024-09-19T09:02:35.633 INFO:tasks.workunit.client.1.smithi102.stdout:3/471: sync 2024-09-19T09:02:35.634 INFO:tasks.workunit.client.1.smithi102.stdout:6/329: fdatasync d1/f1b 0 2024-09-19T09:02:35.634 INFO:tasks.workunit.client.1.smithi102.stdout:4/430: dwrite d14/d34/d5a/d5c/f7b [0,4194304] 0 2024-09-19T09:02:35.636 INFO:tasks.workunit.client.1.smithi102.stdout:3/472: dread - d2/d19/d1c/d2f/d5a/d84/d4f/f80 zero size 2024-09-19T09:02:35.637 INFO:tasks.workunit.client.1.smithi102.stdout:9/349: symlink d1/d2/l6e 0 2024-09-19T09:02:35.643 INFO:tasks.workunit.client.1.smithi102.stdout:0/500: mkdir d3/dd/d10/d15/da2 0 2024-09-19T09:02:35.648 INFO:tasks.workunit.client.1.smithi102.stdout:7/406: mknod d1/d3/d20/c80 0 2024-09-19T09:02:35.653 INFO:tasks.workunit.client.1.smithi102.stdout:8/351: rmdir d0/d10/d21 39 2024-09-19T09:02:35.655 INFO:tasks.workunit.client.1.smithi102.stdout:4/431: fdatasync d14/f70 0 2024-09-19T09:02:35.657 INFO:tasks.workunit.client.1.smithi102.stdout:6/330: rmdir d1/d26/d2e/d45/d47/d4d/d35 39 2024-09-19T09:02:35.658 INFO:tasks.workunit.client.1.smithi102.stdout:3/473: fsync d2/d19/d35/f41 0 2024-09-19T09:02:35.659 INFO:tasks.workunit.client.1.smithi102.stdout:9/350: fdatasync d1/d2/d3/fa 0 2024-09-19T09:02:35.660 INFO:tasks.workunit.client.1.smithi102.stdout:3/474: dread - d2/d19/d1c/d2f/d5a/d84/d4f/f80 zero size 2024-09-19T09:02:35.660 INFO:tasks.workunit.client.1.smithi102.stdout:9/351: fdatasync d1/d2/d3/f12 0 2024-09-19T09:02:35.661 INFO:tasks.workunit.client.1.smithi102.stdout:5/423: creat d5/d7/d1a/d37/f84 x:0 0 0 2024-09-19T09:02:35.663 INFO:tasks.workunit.client.1.smithi102.stdout:5/424: write d5/fe [8123524,82437] 0 2024-09-19T09:02:35.663 INFO:tasks.workunit.client.1.smithi102.stdout:2/310: link d7/d1a/l63 d7/d11/d44/l6c 0 2024-09-19T09:02:35.670 INFO:tasks.workunit.client.1.smithi102.stdout:2/311: dwrite f3 [0,4194304] 0 2024-09-19T09:02:35.672 INFO:tasks.workunit.client.1.smithi102.stdout:8/352: dwrite d0/d10/d21/d39/f59 [0,4194304] 0 2024-09-19T09:02:35.675 INFO:tasks.workunit.client.1.smithi102.stdout:8/353: write d0/d10/d21/f43 [2411938,42169] 0 2024-09-19T09:02:35.688 INFO:tasks.workunit.client.1.smithi102.stdout:6/331: mkdir d1/d26/d2e/d70 0 2024-09-19T09:02:35.689 INFO:tasks.workunit.client.1.smithi102.stdout:3/475: creat d2/d19/d47/db/d26/d63/d6f/d96/f9e x:0 0 0 2024-09-19T09:02:35.689 INFO:tasks.workunit.client.1.smithi102.stdout:8/354: rename d0/d10/d21/d39/d49 to d0/db/d1d/d69 0 2024-09-19T09:02:35.691 INFO:tasks.workunit.client.1.smithi102.stdout:8/355: write d0/d10/d21/f2e [533263,35641] 0 2024-09-19T09:02:35.695 INFO:tasks.workunit.client.1.smithi102.stdout:2/312: link d7/d1a/d2b/d31/l62 d7/d1a/d2b/d31/d51/d6b/l6d 0 2024-09-19T09:02:35.695 INFO:tasks.workunit.client.1.smithi102.stdout:3/476: chown d2/d19/d1c/d2f/d5a/d84/d64/l6a 62 1 2024-09-19T09:02:35.697 INFO:tasks.workunit.client.1.smithi102.stdout:4/432: link d14/d16/d17/d2e/d37/f3e d14/d16/d1d/f82 0 2024-09-19T09:02:35.699 INFO:tasks.workunit.client.1.smithi102.stdout:3/477: stat d2/d19/d47/db/f17 0 2024-09-19T09:02:35.700 INFO:tasks.workunit.client.1.smithi102.stdout:6/332: dwrite d1/d26/d2e/d45/d47/d4d/f34 [0,4194304] 0 2024-09-19T09:02:35.700 INFO:tasks.workunit.client.1.smithi102.stdout:1/393: sync 2024-09-19T09:02:35.701 INFO:tasks.workunit.client.1.smithi102.stdout:9/352: write d1/d2/d3/f31 [3357775,10878] 0 2024-09-19T09:02:35.702 INFO:tasks.workunit.client.1.smithi102.stdout:4/433: chown d14/d16/d1d/d48 15029506 1 2024-09-19T09:02:35.703 INFO:tasks.workunit.client.1.smithi102.stdout:1/394: chown dd/d13/d2d/l38 44755 1 2024-09-19T09:02:35.704 INFO:tasks.workunit.client.1.smithi102.stdout:8/356: dwrite d0/db/f15 [4194304,4194304] 0 2024-09-19T09:02:35.705 INFO:tasks.workunit.client.1.smithi102.stdout:7/407: write d1/d2f/f56 [6113453,30486] 0 2024-09-19T09:02:35.705 INFO:tasks.workunit.client.1.smithi102.stdout:6/333: rmdir d1/d26/d2e/d45/d47 39 2024-09-19T09:02:35.706 INFO:tasks.workunit.client.1.smithi102.stdout:9/353: dread - d1/d2/d3/d34/f46 zero size 2024-09-19T09:02:35.706 INFO:tasks.workunit.client.1.smithi102.stdout:5/425: write d5/d7/d1b/f51 [1108969,75021] 0 2024-09-19T09:02:35.707 INFO:tasks.workunit.client.1.smithi102.stdout:1/395: write dd/f25 [1125861,102102] 0 2024-09-19T09:02:35.710 INFO:tasks.workunit.client.1.smithi102.stdout:9/354: dread - d1/d8/d1c/f62 zero size 2024-09-19T09:02:35.714 INFO:tasks.workunit.client.1.smithi102.stdout:8/357: readlink d0/d10/d21/d39/l40 0 2024-09-19T09:02:35.718 INFO:tasks.workunit.client.1.smithi102.stdout:2/313: dread d7/fc [0,4194304] 0 2024-09-19T09:02:35.718 INFO:tasks.workunit.client.1.smithi102.stdout:0/501: sync 2024-09-19T09:02:35.718 INFO:tasks.workunit.client.1.smithi102.stdout:2/314: chown d7/d1a/d2b/d31 5 1 2024-09-19T09:02:35.718 INFO:tasks.workunit.client.1.smithi102.stdout:1/396: mkdir dd/d14/d35/d49/d7d 0 2024-09-19T09:02:35.720 INFO:tasks.workunit.client.1.smithi102.stdout:0/502: read d3/dd/d10/f38 [1378040,54194] 0 2024-09-19T09:02:35.723 INFO:tasks.workunit.client.1.smithi102.stdout:8/358: dwrite d0/d10/d21/f43 [0,4194304] 0 2024-09-19T09:02:35.726 INFO:tasks.workunit.client.1.smithi102.stdout:0/503: dread d3/dd/d10/f63 [0,4194304] 0 2024-09-19T09:02:35.726 INFO:tasks.workunit.client.1.smithi102.stdout:3/478: link d2/d19/d47/db/d26/f61 d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9f 0 2024-09-19T09:02:35.728 INFO:tasks.workunit.client.1.smithi102.stdout:1/397: mknod dd/d14/d35/d49/d62/c7e 0 2024-09-19T09:02:35.732 INFO:tasks.workunit.client.1.smithi102.stdout:7/408: link d1/d4/d45/f62 d1/d4/d45/d25/f81 0 2024-09-19T09:02:35.732 INFO:tasks.workunit.client.1.smithi102.stdout:7/409: stat d1/d3/d20/c22 0 2024-09-19T09:02:35.733 INFO:tasks.workunit.client.1.smithi102.stdout:1/398: dwrite dd/d13/f36 [0,4194304] 0 2024-09-19T09:02:35.736 INFO:tasks.workunit.client.1.smithi102.stdout:4/434: truncate d14/d16/d1d/f72 2967726 0 2024-09-19T09:02:35.740 INFO:tasks.workunit.client.1.smithi102.stdout:8/359: symlink d0/d4f/l6a 0 2024-09-19T09:02:35.745 INFO:tasks.workunit.client.1.smithi102.stdout:0/504: creat d3/dd/d1a/d32/d62/fa3 x:0 0 0 2024-09-19T09:02:35.750 INFO:tasks.workunit.client.1.smithi102.stdout:5/426: truncate d5/d23/d3b/f5c 493251 0 2024-09-19T09:02:35.751 INFO:tasks.workunit.client.1.smithi102.stdout:3/479: dwrite d2/d19/d47/db/d8b/f94 [4194304,4194304] 0 2024-09-19T09:02:35.757 INFO:tasks.workunit.client.1.smithi102.stdout:6/334: symlink d1/d26/d2e/d45/d47/d4d/d35/l71 0 2024-09-19T09:02:35.758 INFO:tasks.workunit.client.1.smithi102.stdout:8/360: mknod d0/db/c6b 0 2024-09-19T09:02:35.762 INFO:tasks.workunit.client.1.smithi102.stdout:5/427: creat d5/d60/f85 x:0 0 0 2024-09-19T09:02:35.762 INFO:tasks.workunit.client.1.smithi102.stdout:2/315: truncate d7/d1a/d2b/f2d 839926 0 2024-09-19T09:02:35.763 INFO:tasks.workunit.client.1.smithi102.stdout:5/428: chown d5/fe 42105197 1 2024-09-19T09:02:35.764 INFO:tasks.workunit.client.1.smithi102.stdout:3/480: write d2/d19/d47/f89 [1304885,25921] 0 2024-09-19T09:02:35.765 INFO:tasks.workunit.client.1.smithi102.stdout:1/399: rename dd/d14/d54 to dd/d14/d35/d49/d7d/d7f 0 2024-09-19T09:02:35.766 INFO:tasks.workunit.client.1.smithi102.stdout:4/435: mknod d14/d16/d17/d2e/c83 0 2024-09-19T09:02:35.767 INFO:tasks.workunit.client.1.smithi102.stdout:7/410: link d1/d3/f1c d1/d2f/f82 0 2024-09-19T09:02:35.770 INFO:tasks.workunit.client.1.smithi102.stdout:1/400: truncate dd/d14/f52 1505437 0 2024-09-19T09:02:35.771 INFO:tasks.workunit.client.1.smithi102.stdout:1/401: write dd/d14/f75 [4832255,119155] 0 2024-09-19T09:02:35.771 INFO:tasks.workunit.client.1.smithi102.stdout:0/505: rename d3/dd/d10/d15/d22/d37/d3d/l81 to d3/d8/la4 0 2024-09-19T09:02:35.772 INFO:tasks.workunit.client.1.smithi102.stdout:0/506: stat d3/d8 0 2024-09-19T09:02:35.774 INFO:tasks.workunit.client.1.smithi102.stdout:4/436: creat d14/d34/d5a/d5c/f84 x:0 0 0 2024-09-19T09:02:35.775 INFO:tasks.workunit.client.1.smithi102.stdout:4/437: write d14/d16/d17/d2e/d37/f76 [550011,111363] 0 2024-09-19T09:02:35.782 INFO:tasks.workunit.client.1.smithi102.stdout:6/335: creat d1/d26/d2e/d45/d47/d4d/f72 x:0 0 0 2024-09-19T09:02:35.783 INFO:tasks.workunit.client.1.smithi102.stdout:2/316: rename d7/d12/d37/c47 to d7/d1a/d56/c6e 0 2024-09-19T09:02:35.787 INFO:tasks.workunit.client.1.smithi102.stdout:4/438: creat d14/d16/d17/d25/d2b/f85 x:0 0 0 2024-09-19T09:02:35.787 INFO:tasks.workunit.client.1.smithi102.stdout:7/411: truncate d1/d3/f1c 864791 0 2024-09-19T09:02:35.787 INFO:tasks.workunit.client.1.smithi102.stdout:6/336: dread d1/fc [0,4194304] 0 2024-09-19T09:02:35.788 INFO:tasks.workunit.client.1.smithi102.stdout:8/361: truncate d0/d10/d21/f43 1884734 0 2024-09-19T09:02:35.788 INFO:tasks.workunit.client.1.smithi102.stdout:6/337: chown d1/d18/f23 13912409 1 2024-09-19T09:02:35.789 INFO:tasks.workunit.client.1.smithi102.stdout:8/362: read - d0/d10/d21/f5b zero size 2024-09-19T09:02:35.790 INFO:tasks.workunit.client.1.smithi102.stdout:3/481: rename d2/d19/d1c/f37 to d2/d19/d47/db/d26/d63/fa0 0 2024-09-19T09:02:35.791 INFO:tasks.workunit.client.1.smithi102.stdout:2/317: mknod d7/d1a/d2b/c6f 0 2024-09-19T09:02:35.793 INFO:tasks.workunit.client.1.smithi102.stdout:4/439: unlink d14/d16/d17/c49 0 2024-09-19T09:02:35.794 INFO:tasks.workunit.client.1.smithi102.stdout:3/482: fdatasync d2/d19/d47/db/d26/d63/f88 0 2024-09-19T09:02:35.795 INFO:tasks.workunit.client.1.smithi102.stdout:1/402: creat dd/d14/d35/f80 x:0 0 0 2024-09-19T09:02:35.796 INFO:tasks.workunit.client.1.smithi102.stdout:5/429: rename d5/d7/d1a/d37/d50/f65 to d5/d7/d1a/d37/d34/f86 0 2024-09-19T09:02:35.798 INFO:tasks.workunit.client.1.smithi102.stdout:7/412: dwrite d1/d3/d20/f5a [0,4194304] 0 2024-09-19T09:02:35.799 INFO:tasks.workunit.client.1.smithi102.stdout:0/507: creat d3/dd/d10/d15/d22/d37/d39/fa5 x:0 0 0 2024-09-19T09:02:35.800 INFO:tasks.workunit.client.1.smithi102.stdout:6/338: creat d1/d26/d2e/d45/d47/d66/f73 x:0 0 0 2024-09-19T09:02:35.801 INFO:tasks.workunit.client.1.smithi102.stdout:4/440: unlink d14/d34/d5a/d5c/f62 0 2024-09-19T09:02:35.803 INFO:tasks.workunit.client.1.smithi102.stdout:9/355: sync 2024-09-19T09:02:35.804 INFO:tasks.workunit.client.1.smithi102.stdout:7/413: symlink d1/d4/l83 0 2024-09-19T09:02:35.805 INFO:tasks.workunit.client.1.smithi102.stdout:6/339: dread - d1/d26/d2e/f6b zero size 2024-09-19T09:02:35.806 INFO:tasks.workunit.client.1.smithi102.stdout:5/430: creat d5/d7/d1a/d37/d39/f87 x:0 0 0 2024-09-19T09:02:35.808 INFO:tasks.workunit.client.1.smithi102.stdout:2/318: dread d7/f10 [0,4194304] 0 2024-09-19T09:02:35.810 INFO:tasks.workunit.client.1.smithi102.stdout:2/319: truncate f3 8760870 0 2024-09-19T09:02:35.811 INFO:tasks.workunit.client.1.smithi102.stdout:8/363: dread d0/f7 [0,4194304] 0 2024-09-19T09:02:35.812 INFO:tasks.workunit.client.1.smithi102.stdout:7/414: symlink d1/d4/l84 0 2024-09-19T09:02:35.813 INFO:tasks.workunit.client.1.smithi102.stdout:5/431: write d5/d7/d1b/f41 [1009890,32313] 0 2024-09-19T09:02:35.815 INFO:tasks.workunit.client.1.smithi102.stdout:9/356: mkdir d1/d2/d3/d6f 0 2024-09-19T09:02:35.815 INFO:tasks.workunit.client.1.smithi102.stdout:1/403: dwrite dd/d5f/f7c [0,4194304] 0 2024-09-19T09:02:35.821 INFO:tasks.workunit.client.1.smithi102.stdout:7/415: read d1/d2f/f56 [3721519,50587] 0 2024-09-19T09:02:35.824 INFO:tasks.workunit.client.1.smithi102.stdout:6/340: dread d1/d26/d2e/d45/d47/d4d/f33 [0,4194304] 0 2024-09-19T09:02:35.829 INFO:tasks.workunit.client.1.smithi102.stdout:5/432: chown d5/d7/d1a/c36 55301835 1 2024-09-19T09:02:35.832 INFO:tasks.workunit.client.1.smithi102.stdout:2/320: dwrite d7/f9 [4194304,4194304] 0 2024-09-19T09:02:35.832 INFO:tasks.workunit.client.1.smithi102.stdout:8/364: dwrite d0/f56 [0,4194304] 0 2024-09-19T09:02:35.832 INFO:tasks.workunit.client.1.smithi102.stdout:3/483: truncate d2/d19/d1c/d2f/f55 419012 0 2024-09-19T09:02:35.832 INFO:tasks.workunit.client.1.smithi102.stdout:0/508: dread d3/dd/d10/d15/f36 [0,4194304] 0 2024-09-19T09:02:35.832 INFO:tasks.workunit.client.1.smithi102.stdout:6/341: readlink d1/d26/d2e/d45/d47/d4d/d35/l71 0 2024-09-19T09:02:35.832 INFO:tasks.workunit.client.1.smithi102.stdout:9/357: mknod d1/d2/d3/d1d/d4f/c70 0 2024-09-19T09:02:35.837 INFO:tasks.workunit.client.1.smithi102.stdout:9/358: readlink d1/d2/d3/d1d/l3b 0 2024-09-19T09:02:35.838 INFO:tasks.workunit.client.1.smithi102.stdout:5/433: truncate d5/d7/d1a/d37/d39/f87 282602 0 2024-09-19T09:02:35.845 INFO:tasks.workunit.client.1.smithi102.stdout:6/342: mknod d1/d26/d2e/d45/d47/d4d/c74 0 2024-09-19T09:02:35.845 INFO:tasks.workunit.client.1.smithi102.stdout:2/321: creat d7/d1a/d2b/d31/d51/d6b/f70 x:0 0 0 2024-09-19T09:02:35.845 INFO:tasks.workunit.client.1.smithi102.stdout:9/359: mknod d1/d2/d3/c71 0 2024-09-19T09:02:35.846 INFO:tasks.workunit.client.1.smithi102.stdout:6/343: fsync d1/f43 0 2024-09-19T09:02:35.846 INFO:tasks.workunit.client.1.smithi102.stdout:0/509: dread d3/dd/d10/d15/d22/d37/d39/d44/f6b [0,4194304] 0 2024-09-19T09:02:35.863 INFO:tasks.workunit.client.1.smithi102.stdout:5/434: creat d5/d7/d1a/f88 x:0 0 0 2024-09-19T09:02:35.863 INFO:tasks.workunit.client.1.smithi102.stdout:3/484: dread d2/d19/d47/db/f3c [0,4194304] 0 2024-09-19T09:02:35.866 INFO:tasks.workunit.client.1.smithi102.stdout:3/485: chown d2/d19/f73 25 1 2024-09-19T09:02:35.866 INFO:tasks.workunit.client.1.smithi102.stdout:2/322: creat d7/d1a/f71 x:0 0 0 2024-09-19T09:02:35.867 INFO:tasks.workunit.client.1.smithi102.stdout:6/344: creat d1/d26/d2e/d45/d47/f75 x:0 0 0 2024-09-19T09:02:35.867 INFO:tasks.workunit.client.1.smithi102.stdout:6/345: chown d1/d26/c28 137287 1 2024-09-19T09:02:35.869 INFO:tasks.workunit.client.1.smithi102.stdout:3/486: creat d2/d19/d47/db/fa1 x:0 0 0 2024-09-19T09:02:35.870 INFO:tasks.workunit.client.1.smithi102.stdout:1/404: truncate f0 4054993 0 2024-09-19T09:02:35.870 INFO:tasks.workunit.client.1.smithi102.stdout:1/405: chown dd/d14/d18 2889 1 2024-09-19T09:02:35.872 INFO:tasks.workunit.client.1.smithi102.stdout:1/406: chown dd/d14/d18/c6f 2050772 1 2024-09-19T09:02:35.873 INFO:tasks.workunit.client.1.smithi102.stdout:1/407: stat dd/d68/l72 0 2024-09-19T09:02:35.876 INFO:tasks.workunit.client.1.smithi102.stdout:5/435: mkdir d5/d7/d1a/d37/d39/d4c/d89 0 2024-09-19T09:02:35.877 INFO:tasks.workunit.client.1.smithi102.stdout:3/487: chown d2/d19/d1c/d2f/d5a/l5b 0 1 2024-09-19T09:02:35.880 INFO:tasks.workunit.client.1.smithi102.stdout:8/365: truncate d0/f42 1399349 0 2024-09-19T09:02:35.881 INFO:tasks.workunit.client.1.smithi102.stdout:9/360: creat d1/d2/f72 x:0 0 0 2024-09-19T09:02:35.882 INFO:tasks.workunit.client.1.smithi102.stdout:7/416: dwrite d1/d2d/f54 [0,4194304] 0 2024-09-19T09:02:35.884 INFO:tasks.workunit.client.1.smithi102.stdout:6/346: dread d1/d18/f7 [0,4194304] 0 2024-09-19T09:02:35.885 INFO:tasks.workunit.client.1.smithi102.stdout:5/436: mknod d5/d23/c8a 0 2024-09-19T09:02:35.886 INFO:tasks.workunit.client.1.smithi102.stdout:1/408: dread fc [0,4194304] 0 2024-09-19T09:02:35.895 INFO:tasks.workunit.client.1.smithi102.stdout:7/417: symlink d1/d2d/l85 0 2024-09-19T09:02:35.896 INFO:tasks.workunit.client.1.smithi102.stdout:7/418: dread - d1/d2d/f7b zero size 2024-09-19T09:02:35.897 INFO:tasks.workunit.client.1.smithi102.stdout:7/419: fsync d1/d2d/f7b 0 2024-09-19T09:02:35.897 INFO:tasks.workunit.client.1.smithi102.stdout:6/347: mknod d1/d26/d2e/d45/d47/d4d/d3b/c76 0 2024-09-19T09:02:35.899 INFO:tasks.workunit.client.1.smithi102.stdout:6/348: stat d1/d26/d2e/d45/l38 0 2024-09-19T09:02:35.899 INFO:tasks.workunit.client.1.smithi102.stdout:2/323: dwrite d7/fc [0,4194304] 0 2024-09-19T09:02:35.900 INFO:tasks.workunit.client.1.smithi102.stdout:5/437: unlink d5/d7/d1a/d37/d34/f86 0 2024-09-19T09:02:35.901 INFO:tasks.workunit.client.1.smithi102.stdout:1/409: unlink dd/d14/d35/d49/f53 0 2024-09-19T09:02:35.911 INFO:tasks.workunit.client.1.smithi102.stdout:5/438: creat d5/d7/d1a/d37/d39/f8b x:0 0 0 2024-09-19T09:02:35.912 INFO:tasks.workunit.client.1.smithi102.stdout:5/439: dread - d5/d7/d1a/d42/f44 zero size 2024-09-19T09:02:35.912 INFO:tasks.workunit.client.1.smithi102.stdout:1/410: chown dd/d13/c5b 0 1 2024-09-19T09:02:35.913 INFO:tasks.workunit.client.1.smithi102.stdout:1/411: stat dd/d68/l72 0 2024-09-19T09:02:35.915 INFO:tasks.workunit.client.1.smithi102.stdout:3/488: rename d2/d19/d1c/d1f/d5f/l78 to d2/d19/d1c/d2f/d5a/d84/la2 0 2024-09-19T09:02:35.917 INFO:tasks.workunit.client.1.smithi102.stdout:7/420: symlink d1/d4/d45/d25/d52/d7f/l86 0 2024-09-19T09:02:35.918 INFO:tasks.workunit.client.1.smithi102.stdout:6/349: truncate d1/d18/db/f30 2144929 0 2024-09-19T09:02:35.919 INFO:tasks.workunit.client.1.smithi102.stdout:6/350: dread - d1/d26/d2e/d45/d47/f49 zero size 2024-09-19T09:02:35.920 INFO:tasks.workunit.client.1.smithi102.stdout:6/351: fdatasync d1/f2c 0 2024-09-19T09:02:35.929 INFO:tasks.workunit.client.1.smithi102.stdout:3/489: dread d2/d19/d1c/d2f/d5a/d84/f91 [0,4194304] 0 2024-09-19T09:02:35.932 INFO:tasks.workunit.client.1.smithi102.stdout:9/361: link d1/d8/c1e d1/d2/d3/c73 0 2024-09-19T09:02:35.936 INFO:tasks.workunit.client.1.smithi102.stdout:6/352: mknod d1/d26/d2e/d45/c77 0 2024-09-19T09:02:35.939 INFO:tasks.workunit.client.1.smithi102.stdout:6/353: truncate d1/d26/d2e/d45/d47/d66/f73 688668 0 2024-09-19T09:02:35.941 INFO:tasks.workunit.client.1.smithi102.stdout:5/440: dwrite d5/d7/d1a/d37/f45 [0,4194304] 0 2024-09-19T09:02:35.944 INFO:tasks.workunit.client.1.smithi102.stdout:8/366: rename d0/db/d1d/f33 to d0/d10/d21/f6c 0 2024-09-19T09:02:35.947 INFO:tasks.workunit.client.1.smithi102.stdout:6/354: dwrite d1/d18/db/f5e [0,4194304] 0 2024-09-19T09:02:35.952 INFO:tasks.workunit.client.1.smithi102.stdout:1/412: link dd/d13/d2d/c4d dd/d14/d18/c81 0 2024-09-19T09:02:35.953 INFO:tasks.workunit.client.1.smithi102.stdout:1/413: stat dd/d14/d18/c1a 0 2024-09-19T09:02:35.956 INFO:tasks.workunit.client.1.smithi102.stdout:5/441: chown d5/d23/d3b/f5c 1390 1 2024-09-19T09:02:35.960 INFO:tasks.workunit.client.1.smithi102.stdout:4/441: sync 2024-09-19T09:02:35.962 INFO:tasks.workunit.client.1.smithi102.stdout:4/442: write f12 [1177059,102300] 0 2024-09-19T09:02:35.962 INFO:tasks.workunit.client.1.smithi102.stdout:1/414: dwrite dd/d13/d3b/f6a [0,4194304] 0 2024-09-19T09:02:35.963 INFO:tasks.workunit.client.1.smithi102.stdout:6/355: write d1/d18/db/f10 [229469,65832] 0 2024-09-19T09:02:35.965 INFO:tasks.workunit.client.1.smithi102.stdout:6/356: chown d1/d18/db 349141 1 2024-09-19T09:02:35.966 INFO:tasks.workunit.client.1.smithi102.stdout:9/362: dread d1/d2/d3/f41 [0,4194304] 0 2024-09-19T09:02:35.966 INFO:tasks.workunit.client.1.smithi102.stdout:3/490: truncate d2/d19/d47/db/f25 16859 0 2024-09-19T09:02:35.968 INFO:tasks.workunit.client.1.smithi102.stdout:6/357: chown d1/d26/d2e/d45/d47/d4d/l63 7 1 2024-09-19T09:02:35.969 INFO:tasks.workunit.client.1.smithi102.stdout:8/367: dread d0/db/d1d/f31 [0,4194304] 0 2024-09-19T09:02:35.970 INFO:tasks.workunit.client.1.smithi102.stdout:5/442: creat d5/d23/d3b/f8c x:0 0 0 2024-09-19T09:02:35.973 INFO:tasks.workunit.client.1.smithi102.stdout:1/415: dwrite dd/d14/d18/f29 [0,4194304] 0 2024-09-19T09:02:35.975 INFO:tasks.workunit.client.1.smithi102.stdout:3/491: dwrite d2/d1e/f93 [0,4194304] 0 2024-09-19T09:02:35.981 INFO:tasks.workunit.client.1.smithi102.stdout:6/358: chown d1/d26/d2e/d45/d47/d4d/d3b/l59 39363 1 2024-09-19T09:02:35.985 INFO:tasks.workunit.client.1.smithi102.stdout:1/416: mkdir dd/d13/d3b/d82 0 2024-09-19T09:02:35.988 INFO:tasks.workunit.client.1.smithi102.stdout:9/363: fsync d1/d2/d3/d1d/f20 0 2024-09-19T09:02:35.994 INFO:tasks.workunit.client.1.smithi102.stdout:8/368: mknod d0/d10/d21/c6d 0 2024-09-19T09:02:35.996 INFO:tasks.workunit.client.1.smithi102.stdout:4/443: creat d14/d16/d1d/f86 x:0 0 0 2024-09-19T09:02:35.997 INFO:tasks.workunit.client.1.smithi102.stdout:1/417: symlink dd/d68/l83 0 2024-09-19T09:02:36.002 INFO:tasks.workunit.client.1.smithi102.stdout:4/444: creat d14/d34/d5a/d5c/f87 x:0 0 0 2024-09-19T09:02:36.002 INFO:tasks.workunit.client.1.smithi102.stdout:4/445: readlink d14/l1b 0 2024-09-19T09:02:36.003 INFO:tasks.workunit.client.1.smithi102.stdout:4/446: chown d14/f15 15 1 2024-09-19T09:02:36.003 INFO:tasks.workunit.client.1.smithi102.stdout:4/447: chown f12 73 1 2024-09-19T09:02:36.005 INFO:tasks.workunit.client.1.smithi102.stdout:3/492: rename d2/d19/d47/db/f17 to d2/d19/d1c/d2f/d5a/d84/fa3 0 2024-09-19T09:02:36.006 INFO:tasks.workunit.client.1.smithi102.stdout:9/364: dread d1/d2/ff [0,4194304] 0 2024-09-19T09:02:36.007 INFO:tasks.workunit.client.1.smithi102.stdout:6/359: creat d1/d18/f78 x:0 0 0 2024-09-19T09:02:36.008 INFO:tasks.workunit.client.1.smithi102.stdout:4/448: fsync d14/d16/d17/d25/f7f 0 2024-09-19T09:02:36.010 INFO:tasks.workunit.client.1.smithi102.stdout:8/369: rename d0/c4c to d0/db/d29/c6e 0 2024-09-19T09:02:36.013 INFO:tasks.workunit.client.1.smithi102.stdout:1/418: rename dd/d14/f52 to dd/d14/d35/d49/d7d/d7f/f84 0 2024-09-19T09:02:36.014 INFO:tasks.workunit.client.1.smithi102.stdout:8/370: mknod d0/d5a/c6f 0 2024-09-19T09:02:36.015 INFO:tasks.workunit.client.1.smithi102.stdout:1/419: dread dd/d13/d3b/f6e [0,4194304] 0 2024-09-19T09:02:36.016 INFO:tasks.workunit.client.1.smithi102.stdout:1/420: write dd/d13/f36 [2306694,102530] 0 2024-09-19T09:02:36.016 INFO:tasks.workunit.client.1.smithi102.stdout:6/360: mkdir d1/d26/d2e/d45/d47/d4d/d35/d79 0 2024-09-19T09:02:36.018 INFO:tasks.workunit.client.1.smithi102.stdout:6/361: stat d1/d18/d37/f5b 0 2024-09-19T09:02:36.019 INFO:tasks.workunit.client.1.smithi102.stdout:3/493: rename d2/d19/d35/f48 to d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/fa4 0 2024-09-19T09:02:36.022 INFO:tasks.workunit.client.1.smithi102.stdout:9/365: dwrite d1/d2/d3/f3c [0,4194304] 0 2024-09-19T09:02:36.025 INFO:tasks.workunit.client.1.smithi102.stdout:1/421: unlink dd/d14/d18/f29 0 2024-09-19T09:02:36.025 INFO:tasks.workunit.client.1.smithi102.stdout:1/422: fdatasync f9 0 2024-09-19T09:02:36.031 INFO:tasks.workunit.client.1.smithi102.stdout:4/449: rename d14/d16/d17/d2e/c4f to d14/d16/d17/d25/d7c/c88 0 2024-09-19T09:02:36.034 INFO:tasks.workunit.client.1.smithi102.stdout:4/450: dread d14/d34/d5a/d5c/d81/d75/f77 [0,4194304] 0 2024-09-19T09:02:36.035 INFO:tasks.workunit.client.1.smithi102.stdout:3/494: creat d2/d19/d47/db/fa5 x:0 0 0 2024-09-19T09:02:36.036 INFO:tasks.workunit.client.1.smithi102.stdout:8/371: symlink d0/l70 0 2024-09-19T09:02:36.040 INFO:tasks.workunit.client.1.smithi102.stdout:4/451: dwrite d14/d16/d17/d25/d2f/f6b [0,4194304] 0 2024-09-19T09:02:36.041 INFO:tasks.workunit.client.1.smithi102.stdout:4/452: write d14/f6d [473577,108622] 0 2024-09-19T09:02:36.066 INFO:tasks.workunit.client.1.smithi102.stdout:0/510: sync 2024-09-19T09:02:36.083 INFO:tasks.workunit.client.1.smithi102.stdout:1/423: mknod dd/c85 0 2024-09-19T09:02:36.084 INFO:tasks.workunit.client.1.smithi102.stdout:6/362: rename d1/d26/d2e/f6b to d1/d26/d4b/f7a 0 2024-09-19T09:02:36.087 INFO:tasks.workunit.client.1.smithi102.stdout:3/495: chown d2/d19/d47/db/f25 10401 1 2024-09-19T09:02:36.087 INFO:tasks.workunit.client.1.smithi102.stdout:3/496: write d2/f2d [1602872,122826] 0 2024-09-19T09:02:36.096 INFO:tasks.workunit.client.1.smithi102.stdout:1/424: rename dd/c6b to dd/d14/d35/d49/d7d/c86 0 2024-09-19T09:02:36.101 INFO:tasks.workunit.client.1.smithi102.stdout:8/372: unlink d0/l4b 0 2024-09-19T09:02:36.103 INFO:tasks.workunit.client.1.smithi102.stdout:3/497: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/fa6 x:0 0 0 2024-09-19T09:02:36.104 INFO:tasks.workunit.client.1.smithi102.stdout:9/366: creat d1/f74 x:0 0 0 2024-09-19T09:02:36.108 INFO:tasks.workunit.client.1.smithi102.stdout:6/363: rmdir d1/d26/d2e 39 2024-09-19T09:02:36.110 INFO:tasks.workunit.client.1.smithi102.stdout:1/425: unlink dd/c7b 0 2024-09-19T09:02:36.110 INFO:tasks.workunit.client.1.smithi102.stdout:1/426: write dd/d14/d35/f4a [8087,106671] 0 2024-09-19T09:02:36.111 INFO:tasks.workunit.client.1.smithi102.stdout:3/498: symlink d2/d1e/d54/la7 0 2024-09-19T09:02:36.113 INFO:tasks.workunit.client.1.smithi102.stdout:9/367: rename d1/d2/l42 to d1/d2/d3/d1d/d4f/l75 0 2024-09-19T09:02:36.115 INFO:tasks.workunit.client.1.smithi102.stdout:0/511: creat d3/dd/d1a/fa6 x:0 0 0 2024-09-19T09:02:36.116 INFO:tasks.workunit.client.1.smithi102.stdout:3/499: dwrite d2/d19/d47/db/f44 [0,4194304] 0 2024-09-19T09:02:36.129 INFO:tasks.workunit.client.1.smithi102.stdout:0/512: rename d3/dd/d1a/d32/d62/fa3 to d3/dd/d72/fa7 0 2024-09-19T09:02:36.130 INFO:tasks.workunit.client.1.smithi102.stdout:3/500: fdatasync d2/d19/d1c/d2f/d5a/d84/fa3 0 2024-09-19T09:02:36.131 INFO:tasks.workunit.client.1.smithi102.stdout:4/453: truncate d14/f15 1918993 0 2024-09-19T09:02:36.132 INFO:tasks.workunit.client.1.smithi102.stdout:0/513: mknod d3/dd/d10/d15/d19/d8d/ca8 0 2024-09-19T09:02:36.134 INFO:tasks.workunit.client.1.smithi102.stdout:1/427: dread dd/d14/f2b [0,4194304] 0 2024-09-19T09:02:36.134 INFO:tasks.workunit.client.1.smithi102.stdout:3/501: unlink d2/d19/d35/f4b 0 2024-09-19T09:02:36.135 INFO:tasks.workunit.client.1.smithi102.stdout:0/514: fdatasync d3/dd/d10/d15/d22/d37/d39/fa5 0 2024-09-19T09:02:36.135 INFO:tasks.workunit.client.1.smithi102.stdout:6/364: getdents d1/d26/d2e/d45/d47/d4d/d35 0 2024-09-19T09:02:36.139 INFO:tasks.workunit.client.1.smithi102.stdout:4/454: rename d14/d16/d17/d25/d2b to d14/d16/d17/d2e/d37/d58/d89 0 2024-09-19T09:02:36.140 INFO:tasks.workunit.client.1.smithi102.stdout:4/455: stat d14/d34/f28 0 2024-09-19T09:02:36.141 INFO:tasks.workunit.client.1.smithi102.stdout:0/515: dread d3/dd/d10/d15/d22/d37/f52 [0,4194304] 0 2024-09-19T09:02:36.141 INFO:tasks.workunit.client.1.smithi102.stdout:4/456: truncate d14/d16/d17/d25/d2f/f5f 1025855 0 2024-09-19T09:02:36.142 INFO:tasks.workunit.client.1.smithi102.stdout:1/428: symlink dd/d13/d2d/d78/l87 0 2024-09-19T09:02:36.143 INFO:tasks.workunit.client.1.smithi102.stdout:4/457: chown d14/d16/d17/d2e/d37/d58/d89/d78 31802650 1 2024-09-19T09:02:36.143 INFO:tasks.workunit.client.1.smithi102.stdout:1/429: chown dd/d14/d35/d49/d7d/d7f 118 1 2024-09-19T09:02:36.143 INFO:tasks.workunit.client.1.smithi102.stdout:4/458: dread - d14/d16/d17/f66 zero size 2024-09-19T09:02:36.148 INFO:tasks.workunit.client.1.smithi102.stdout:3/502: rename d2/d19/d47/c11 to d2/d19/d1c/d2f/d5a/d84/ca8 0 2024-09-19T09:02:36.150 INFO:tasks.workunit.client.1.smithi102.stdout:3/503: chown d2/d19/d47/db/d26/d63/c98 116 1 2024-09-19T09:02:36.152 INFO:tasks.workunit.client.1.smithi102.stdout:9/368: dwrite d1/d8/d1c/f28 [0,4194304] 0 2024-09-19T09:02:36.154 INFO:tasks.workunit.client.1.smithi102.stdout:0/516: link d3/dd/d10/d15/d22/d37/d3d/d90/c94 d3/dd/d10/d15/d3e/ca9 0 2024-09-19T09:02:36.155 INFO:tasks.workunit.client.1.smithi102.stdout:2/324: sync 2024-09-19T09:02:36.155 INFO:tasks.workunit.client.1.smithi102.stdout:7/421: sync 2024-09-19T09:02:36.155 INFO:tasks.workunit.client.1.smithi102.stdout:5/443: sync 2024-09-19T09:02:36.156 INFO:tasks.workunit.client.1.smithi102.stdout:2/325: dread - d7/d11/f43 zero size 2024-09-19T09:02:36.157 INFO:tasks.workunit.client.1.smithi102.stdout:7/422: chown d1/d3/d20/c80 2 1 2024-09-19T09:02:36.157 INFO:tasks.workunit.client.1.smithi102.stdout:4/459: creat d14/d16/d17/d25/f8a x:0 0 0 2024-09-19T09:02:36.157 INFO:tasks.workunit.client.1.smithi102.stdout:2/326: write d7/d11/f1e [1061257,46125] 0 2024-09-19T09:02:36.158 INFO:tasks.workunit.client.1.smithi102.stdout:7/423: truncate d1/d3/f78 577165 0 2024-09-19T09:02:36.162 INFO:tasks.workunit.client.1.smithi102.stdout:9/369: write d1/d2/d3/d34/f46 [625595,57771] 0 2024-09-19T09:02:36.166 INFO:tasks.workunit.client.1.smithi102.stdout:6/365: rename d1/d26/d2e/d45/f42 to d1/f7b 0 2024-09-19T09:02:36.168 INFO:tasks.workunit.client.1.smithi102.stdout:5/444: unlink d5/d7/d1a/d37/d34/d4d/c56 0 2024-09-19T09:02:36.170 INFO:tasks.workunit.client.1.smithi102.stdout:0/517: dwrite d3/dd/d1a/d77/f8c [0,4194304] 0 2024-09-19T09:02:36.170 INFO:tasks.workunit.client.1.smithi102.stdout:1/430: dwrite dd/d14/d35/f48 [0,4194304] 0 2024-09-19T09:02:36.177 INFO:tasks.workunit.client.1.smithi102.stdout:4/460: fdatasync d14/d16/d1d/f82 0 2024-09-19T09:02:36.179 INFO:tasks.workunit.client.1.smithi102.stdout:8/373: sync 2024-09-19T09:02:36.181 INFO:tasks.workunit.client.1.smithi102.stdout:5/445: stat d5/d7/d1a/c3e 0 2024-09-19T09:02:36.181 INFO:tasks.workunit.client.1.smithi102.stdout:0/518: fdatasync d3/dd/d10/d15/d22/d37/f52 0 2024-09-19T09:02:36.181 INFO:tasks.workunit.client.1.smithi102.stdout:9/370: truncate d1/d2/d3/f5 4270915 0 2024-09-19T09:02:36.183 INFO:tasks.workunit.client.1.smithi102.stdout:7/424: truncate d1/d3/f1c 1798933 0 2024-09-19T09:02:36.184 INFO:tasks.workunit.client.1.smithi102.stdout:3/504: rename d2/d19/d1c/d2f/d5a/d84/la2 to d2/d19/d1c/d2f/d5a/d84/la9 0 2024-09-19T09:02:36.184 INFO:tasks.workunit.client.1.smithi102.stdout:8/374: creat d0/d5a/f71 x:0 0 0 2024-09-19T09:02:36.186 INFO:tasks.workunit.client.1.smithi102.stdout:5/446: chown d5/d7/d1a/d37/d39/f87 13 1 2024-09-19T09:02:36.187 INFO:tasks.workunit.client.1.smithi102.stdout:4/461: truncate d14/d16/d17/d25/f7f 3917560 0 2024-09-19T09:02:36.188 INFO:tasks.workunit.client.1.smithi102.stdout:9/371: write d1/d2/d3/f31 [3418647,112746] 0 2024-09-19T09:02:36.188 INFO:tasks.workunit.client.1.smithi102.stdout:0/519: mknod d3/dd/caa 0 2024-09-19T09:02:36.190 INFO:tasks.workunit.client.1.smithi102.stdout:7/425: rmdir d1/d3/d34 39 2024-09-19T09:02:36.191 INFO:tasks.workunit.client.1.smithi102.stdout:2/327: dwrite d7/f10 [0,4194304] 0 2024-09-19T09:02:36.194 INFO:tasks.workunit.client.1.smithi102.stdout:3/505: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/faa x:0 0 0 2024-09-19T09:02:36.196 INFO:tasks.workunit.client.1.smithi102.stdout:8/375: rename d0/db/d29/f36 to d0/db/d29/f72 0 2024-09-19T09:02:36.198 INFO:tasks.workunit.client.1.smithi102.stdout:7/426: read d1/f2a [222179,76269] 0 2024-09-19T09:02:36.199 INFO:tasks.workunit.client.1.smithi102.stdout:0/520: mkdir d3/dd/d10/d15/d22/d37/d39/d44/dab 0 2024-09-19T09:02:36.199 INFO:tasks.workunit.client.1.smithi102.stdout:1/431: dread f4 [4194304,4194304] 0 2024-09-19T09:02:36.200 INFO:tasks.workunit.client.1.smithi102.stdout:7/427: chown d1/d3/d20/d6c/l6d 26529376 1 2024-09-19T09:02:36.201 INFO:tasks.workunit.client.1.smithi102.stdout:9/372: rename d1/d2/f22 to d1/d2/d3/d1d/f76 0 2024-09-19T09:02:36.204 INFO:tasks.workunit.client.1.smithi102.stdout:5/447: mkdir d5/d8d 0 2024-09-19T09:02:36.206 INFO:tasks.workunit.client.1.smithi102.stdout:3/506: rmdir d2/d19/d1c/d2f/d5a/d84/d53 39 2024-09-19T09:02:36.206 INFO:tasks.workunit.client.1.smithi102.stdout:1/432: dread dd/d14/d35/f48 [0,4194304] 0 2024-09-19T09:02:36.207 INFO:tasks.workunit.client.1.smithi102.stdout:6/366: dwrite d1/d26/d2e/d45/d47/d4d/d35/f39 [0,4194304] 0 2024-09-19T09:02:36.208 INFO:tasks.workunit.client.1.smithi102.stdout:5/448: write d5/d7/d1b/f6f [271857,103087] 0 2024-09-19T09:02:36.211 INFO:tasks.workunit.client.1.smithi102.stdout:0/521: unlink d3/dd/d1a/f96 0 2024-09-19T09:02:36.218 INFO:tasks.workunit.client.1.smithi102.stdout:7/428: creat d1/d4/d45/d25/f87 x:0 0 0 2024-09-19T09:02:36.218 INFO:tasks.workunit.client.1.smithi102.stdout:9/373: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:36.218 INFO:tasks.workunit.client.1.smithi102.stdout:4/462: creat d14/d16/d17/d2e/d37/d58/d89/d78/f8b x:0 0 0 2024-09-19T09:02:36.219 INFO:tasks.workunit.client.1.smithi102.stdout:3/507: write d2/d1e/f4d [278505,1614] 0 2024-09-19T09:02:36.220 INFO:tasks.workunit.client.1.smithi102.stdout:1/433: symlink dd/d13/d2d/d78/l88 0 2024-09-19T09:02:36.221 INFO:tasks.workunit.client.1.smithi102.stdout:5/449: mknod d5/d7/d1a/d42/c8e 0 2024-09-19T09:02:36.224 INFO:tasks.workunit.client.1.smithi102.stdout:0/522: dread d3/dd/d10/d15/d2c/f6e [0,4194304] 0 2024-09-19T09:02:36.226 INFO:tasks.workunit.client.1.smithi102.stdout:7/429: symlink d1/d2d/l88 0 2024-09-19T09:02:36.228 INFO:tasks.workunit.client.1.smithi102.stdout:7/430: fsync d1/d4/d45/d25/d52/f58 0 2024-09-19T09:02:36.228 INFO:tasks.workunit.client.1.smithi102.stdout:6/367: dwrite d1/d18/f7 [0,4194304] 0 2024-09-19T09:02:36.229 INFO:tasks.workunit.client.1.smithi102.stdout:7/431: dread - d1/d2d/f7b zero size 2024-09-19T09:02:36.230 INFO:tasks.workunit.client.1.smithi102.stdout:6/368: readlink d1/d18/l21 0 2024-09-19T09:02:36.232 INFO:tasks.workunit.client.1.smithi102.stdout:7/432: truncate d1/d4/f3d 179091 0 2024-09-19T09:02:36.234 INFO:tasks.workunit.client.1.smithi102.stdout:0/523: dwrite d3/dd/d10/d15/d22/d37/f69 [0,4194304] 0 2024-09-19T09:02:36.256 INFO:tasks.workunit.client.1.smithi102.stdout:0/524: dread d3/f14 [4194304,4194304] 0 2024-09-19T09:02:36.281 INFO:tasks.workunit.client.1.smithi102.stdout:2/328: sync 2024-09-19T09:02:36.282 INFO:tasks.workunit.client.1.smithi102.stdout:2/329: stat d7/f9 0 2024-09-19T09:02:36.282 INFO:tasks.workunit.client.1.smithi102.stdout:2/330: stat d7/d1a/d2b/d31 0 2024-09-19T09:02:36.305 INFO:tasks.workunit.client.1.smithi102.stdout:1/434: mknod dd/d66/c89 0 2024-09-19T09:02:36.306 INFO:tasks.workunit.client.1.smithi102.stdout:3/508: symlink d2/d19/d47/db/d26/lab 0 2024-09-19T09:02:36.314 INFO:tasks.workunit.client.1.smithi102.stdout:2/331: dread d7/d11/f1c [0,4194304] 0 2024-09-19T09:02:36.345 INFO:tasks.workunit.client.1.smithi102.stdout:8/376: link d0/d10/c11 d0/d10/d21/c73 0 2024-09-19T09:02:36.348 INFO:tasks.workunit.client.1.smithi102.stdout:6/369: creat d1/d3a/f7c x:0 0 0 2024-09-19T09:02:36.352 INFO:tasks.workunit.client.1.smithi102.stdout:0/525: rename d3/dd/d10/d15/d22/d37/d39/d44/c78 to d3/dd/d1a/d77/cac 0 2024-09-19T09:02:36.353 INFO:tasks.workunit.client.1.smithi102.stdout:0/526: chown d3/dd/d10/d15/da2 6 1 2024-09-19T09:02:36.356 INFO:tasks.workunit.client.1.smithi102.stdout:1/435: rmdir dd/d5f 39 2024-09-19T09:02:36.357 INFO:tasks.workunit.client.1.smithi102.stdout:0/527: truncate d3/dd/d10/d15/d2c/f9b 62740 0 2024-09-19T09:02:36.358 INFO:tasks.workunit.client.1.smithi102.stdout:0/528: stat d3/dd/d10/d15/d2c/f3b 0 2024-09-19T09:02:36.359 INFO:tasks.workunit.client.1.smithi102.stdout:5/450: mkdir d5/d7/d1a/d8f 0 2024-09-19T09:02:36.361 INFO:tasks.workunit.client.1.smithi102.stdout:3/509: creat d2/d1e/fac x:0 0 0 2024-09-19T09:02:36.362 INFO:tasks.workunit.client.1.smithi102.stdout:3/510: readlink d2/d19/d1c/d2f/d5a/d84/d4f/d72/l7b 0 2024-09-19T09:02:36.363 INFO:tasks.workunit.client.1.smithi102.stdout:3/511: chown d2/d19/d1c/d2f/d5a/d84/d64 2265 1 2024-09-19T09:02:36.364 INFO:tasks.workunit.client.1.smithi102.stdout:8/377: rename d0/d10/d21/d39/f3f to d0/d4f/f74 0 2024-09-19T09:02:36.366 INFO:tasks.workunit.client.1.smithi102.stdout:1/436: fdatasync dd/d14/f2c 0 2024-09-19T09:02:36.368 INFO:tasks.workunit.client.1.smithi102.stdout:5/451: symlink d5/d23/l90 0 2024-09-19T09:02:36.372 INFO:tasks.workunit.client.1.smithi102.stdout:8/378: fdatasync d0/d10/d3a/f66 0 2024-09-19T09:02:36.374 INFO:tasks.workunit.client.1.smithi102.stdout:0/529: mknod d3/d8/de/d7a/cad 0 2024-09-19T09:02:36.374 INFO:tasks.workunit.client.1.smithi102.stdout:8/379: fsync d0/d10/d21/f5b 0 2024-09-19T09:02:36.374 INFO:tasks.workunit.client.1.smithi102.stdout:2/332: dwrite d7/f4f [0,4194304] 0 2024-09-19T09:02:36.375 INFO:tasks.workunit.client.1.smithi102.stdout:0/530: chown d3/dd/d5b/c92 178 1 2024-09-19T09:02:36.376 INFO:tasks.workunit.client.1.smithi102.stdout:1/437: unlink dd/d14/d18/c6f 0 2024-09-19T09:02:36.378 INFO:tasks.workunit.client.1.smithi102.stdout:0/531: chown d3/dd/d10/d15/d22/d37 0 1 2024-09-19T09:02:36.379 INFO:tasks.workunit.client.1.smithi102.stdout:4/463: write d14/d16/d17/d25/f7f [2704078,23705] 0 2024-09-19T09:02:36.379 INFO:tasks.workunit.client.1.smithi102.stdout:8/380: mknod d0/d10/d21/d39/d50/c75 0 2024-09-19T09:02:36.380 INFO:tasks.workunit.client.1.smithi102.stdout:9/374: truncate d1/d2/d3/f3c 63605 0 2024-09-19T09:02:36.380 INFO:tasks.workunit.client.1.smithi102.stdout:2/333: mkdir d7/d1a/d2b/d31/d51/d6b/d72 0 2024-09-19T09:02:36.381 INFO:tasks.workunit.client.1.smithi102.stdout:5/452: mkdir d5/d7/d1a/d37/d34/d7f/d91 0 2024-09-19T09:02:36.382 INFO:tasks.workunit.client.1.smithi102.stdout:7/433: getdents d1/d3/d34 0 2024-09-19T09:02:36.383 INFO:tasks.workunit.client.1.smithi102.stdout:5/453: write d5/d7/d1a/d42/d4b/f71 [1344616,25716] 0 2024-09-19T09:02:36.384 INFO:tasks.workunit.client.1.smithi102.stdout:3/512: creat d2/d19/d47/fad x:0 0 0 2024-09-19T09:02:36.385 INFO:tasks.workunit.client.1.smithi102.stdout:1/438: truncate dd/f11 1344663 0 2024-09-19T09:02:36.389 INFO:tasks.workunit.client.1.smithi102.stdout:8/381: rmdir d0/d5a 39 2024-09-19T09:02:36.390 INFO:tasks.workunit.client.1.smithi102.stdout:2/334: dwrite d7/d1a/d2b/d31/d51/f5f [0,4194304] 0 2024-09-19T09:02:36.391 INFO:tasks.workunit.client.1.smithi102.stdout:4/464: unlink d14/d16/d17/d2e/d37/d58/c5b 0 2024-09-19T09:02:36.394 INFO:tasks.workunit.client.1.smithi102.stdout:5/454: dwrite d5/d60/f85 [0,4194304] 0 2024-09-19T09:02:36.395 INFO:tasks.workunit.client.1.smithi102.stdout:7/434: creat d1/d4/d45/f89 x:0 0 0 2024-09-19T09:02:36.396 INFO:tasks.workunit.client.1.smithi102.stdout:3/513: mknod d2/d19/d47/db/cae 0 2024-09-19T09:02:36.400 INFO:tasks.workunit.client.1.smithi102.stdout:1/439: rename dd/ff to dd/d14/d35/d49/d62/d6c/f8a 0 2024-09-19T09:02:36.401 INFO:tasks.workunit.client.1.smithi102.stdout:7/435: dwrite d1/d3/d20/f4c [0,4194304] 0 2024-09-19T09:02:36.405 INFO:tasks.workunit.client.1.smithi102.stdout:8/382: creat d0/d4f/f76 x:0 0 0 2024-09-19T09:02:36.409 INFO:tasks.workunit.client.1.smithi102.stdout:5/455: creat d5/d7/d1a/d42/d75/f92 x:0 0 0 2024-09-19T09:02:36.409 INFO:tasks.workunit.client.1.smithi102.stdout:0/532: write f2 [678931,125385] 0 2024-09-19T09:02:36.410 INFO:tasks.workunit.client.1.smithi102.stdout:5/456: fsync d5/d7/d1a/d42/f44 0 2024-09-19T09:02:36.411 INFO:tasks.workunit.client.1.smithi102.stdout:3/514: creat d2/d19/d1c/d2f/d5a/d84/d64/faf x:0 0 0 2024-09-19T09:02:36.412 INFO:tasks.workunit.client.1.smithi102.stdout:3/515: fdatasync d2/d19/d1c/d70/f8a 0 2024-09-19T09:02:36.413 INFO:tasks.workunit.client.1.smithi102.stdout:9/375: creat d1/d2/d3/f77 x:0 0 0 2024-09-19T09:02:36.414 INFO:tasks.workunit.client.1.smithi102.stdout:4/465: mkdir d14/d34/d5a/d5c/d79/d8c 0 2024-09-19T09:02:36.416 INFO:tasks.workunit.client.1.smithi102.stdout:8/383: rename d0/db/d1d/l44 to d0/d10/d21/d39/l77 0 2024-09-19T09:02:36.423 INFO:tasks.workunit.client.1.smithi102.stdout:8/384: fsync d0/d10/d21/f6c 0 2024-09-19T09:02:36.424 INFO:tasks.workunit.client.1.smithi102.stdout:0/533: symlink d3/dd/d72/d98/lae 0 2024-09-19T09:02:36.425 INFO:tasks.workunit.client.1.smithi102.stdout:9/376: mkdir d1/d2/d78 0 2024-09-19T09:02:36.427 INFO:tasks.workunit.client.1.smithi102.stdout:3/516: link d2/d19/d47/db/d26/f7f d2/d19/d1c/d2f/d5a/d84/d4f/fb0 0 2024-09-19T09:02:36.428 INFO:tasks.workunit.client.1.smithi102.stdout:4/466: link d14/d16/d17/d25/f8a d14/d34/d5a/d5c/f8d 0 2024-09-19T09:02:36.430 INFO:tasks.workunit.client.1.smithi102.stdout:4/467: truncate d14/d16/d1d/f86 801545 0 2024-09-19T09:02:36.431 INFO:tasks.workunit.client.1.smithi102.stdout:9/377: rename d1/d8/f2e to d1/d2/d78/f79 0 2024-09-19T09:02:36.431 INFO:tasks.workunit.client.1.smithi102.stdout:0/534: creat d3/dd/d10/d15/d19/d7e/faf x:0 0 0 2024-09-19T09:02:36.432 INFO:tasks.workunit.client.1.smithi102.stdout:8/385: symlink d0/d10/l78 0 2024-09-19T09:02:36.434 INFO:tasks.workunit.client.1.smithi102.stdout:4/468: symlink d14/d34/l8e 0 2024-09-19T09:02:36.434 INFO:tasks.workunit.client.1.smithi102.stdout:3/517: dwrite d2/d19/d47/fad [0,4194304] 0 2024-09-19T09:02:36.438 INFO:tasks.workunit.client.1.smithi102.stdout:0/535: creat d3/dd/d10/d15/d22/d37/d3d/d90/fb0 x:0 0 0 2024-09-19T09:02:36.441 INFO:tasks.workunit.client.1.smithi102.stdout:8/386: dread d0/db/f3b [0,4194304] 0 2024-09-19T09:02:36.442 INFO:tasks.workunit.client.1.smithi102.stdout:3/518: chown d2/d19/d1c/d1f/d5f/c8f 4009815 1 2024-09-19T09:02:36.443 INFO:tasks.workunit.client.1.smithi102.stdout:9/378: dwrite d1/f74 [0,4194304] 0 2024-09-19T09:02:36.445 INFO:tasks.workunit.client.1.smithi102.stdout:0/536: unlink d3/dd/d10/d15/d2c/f6e 0 2024-09-19T09:02:36.446 INFO:tasks.workunit.client.1.smithi102.stdout:3/519: write d2/d19/d1c/d2f/d5a/d84/d4f/f80 [436206,112224] 0 2024-09-19T09:02:36.449 INFO:tasks.workunit.client.1.smithi102.stdout:8/387: truncate d0/d10/d21/f24 708623 0 2024-09-19T09:02:36.451 INFO:tasks.workunit.client.1.smithi102.stdout:4/469: rename d14/d16/d17/d2e/d37/d58/d89/l2c to d14/d16/d17/d25/l8f 0 2024-09-19T09:02:36.451 INFO:tasks.workunit.client.1.smithi102.stdout:4/470: stat d14/d16/d17/d2e/d37/d58/d89/f67 0 2024-09-19T09:02:36.453 INFO:tasks.workunit.client.1.smithi102.stdout:0/537: creat d3/dd/d10/d15/d22/d37/d39/d44/fb1 x:0 0 0 2024-09-19T09:02:36.454 INFO:tasks.workunit.client.1.smithi102.stdout:0/538: write d3/dd/f7c [3693690,23647] 0 2024-09-19T09:02:36.458 INFO:tasks.workunit.client.1.smithi102.stdout:9/379: mknod d1/c7a 0 2024-09-19T09:02:36.459 INFO:tasks.workunit.client.1.smithi102.stdout:9/380: truncate d1/d2/d3/d1d/f63 5052577 0 2024-09-19T09:02:36.460 INFO:tasks.workunit.client.1.smithi102.stdout:4/471: mknod d14/d16/d17/d2e/d60/c90 0 2024-09-19T09:02:36.461 INFO:tasks.workunit.client.1.smithi102.stdout:9/381: truncate d1/d8/d1c/f62 552597 0 2024-09-19T09:02:36.463 INFO:tasks.workunit.client.1.smithi102.stdout:8/388: read d0/f42 [382585,93690] 0 2024-09-19T09:02:36.463 INFO:tasks.workunit.client.1.smithi102.stdout:0/539: creat d3/dd/d10/d15/d22/d37/d39/d44/dab/fb2 x:0 0 0 2024-09-19T09:02:36.467 INFO:tasks.workunit.client.1.smithi102.stdout:8/389: dread d0/d10/d21/f2e [0,4194304] 0 2024-09-19T09:02:36.468 INFO:tasks.workunit.client.1.smithi102.stdout:8/390: chown d0/d10/d21/f2e 7015 1 2024-09-19T09:02:36.473 INFO:tasks.workunit.client.1.smithi102.stdout:3/520: write d2/d19/d1c/d2f/d5a/d84/d4f/fb0 [1244556,59777] 0 2024-09-19T09:02:36.474 INFO:tasks.workunit.client.1.smithi102.stdout:8/391: symlink d0/d10/d3a/l79 0 2024-09-19T09:02:36.474 INFO:tasks.workunit.client.1.smithi102.stdout:4/472: link d14/d16/d1d/f82 d14/d34/d5a/d5c/d79/d8c/f91 0 2024-09-19T09:02:36.477 INFO:tasks.workunit.client.1.smithi102.stdout:9/382: rename d1/d2/d3/d34 to d1/d2/d7b 0 2024-09-19T09:02:36.481 INFO:tasks.workunit.client.1.smithi102.stdout:8/392: unlink d0/d10/d3a/f41 0 2024-09-19T09:02:36.485 INFO:tasks.workunit.client.1.smithi102.stdout:6/370: sync 2024-09-19T09:02:36.485 INFO:tasks.workunit.client.1.smithi102.stdout:4/473: dwrite d14/d16/d1d/f86 [0,4194304] 0 2024-09-19T09:02:36.485 INFO:tasks.workunit.client.1.smithi102.stdout:0/540: dread d3/dd/d10/d15/f60 [0,4194304] 0 2024-09-19T09:02:36.487 INFO:tasks.workunit.client.1.smithi102.stdout:6/371: rmdir d1/d26/d2e/d45/d47/d4d/d35/d41 39 2024-09-19T09:02:36.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/383: creat d1/d2/d3/d1d/d4f/d6d/f7c x:0 0 0 2024-09-19T09:02:36.490 INFO:tasks.workunit.client.1.smithi102.stdout:0/541: creat d3/dd/d10/d15/d19/fb3 x:0 0 0 2024-09-19T09:02:36.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/474: mkdir d14/d16/d1d/d92 0 2024-09-19T09:02:36.495 INFO:tasks.workunit.client.1.smithi102.stdout:9/384: dread d1/d8/d1c/f21 [0,4194304] 0 2024-09-19T09:02:36.500 INFO:tasks.workunit.client.1.smithi102.stdout:8/393: dread d0/d4f/f74 [0,4194304] 0 2024-09-19T09:02:36.502 INFO:tasks.workunit.client.1.smithi102.stdout:4/475: creat d14/d16/d1d/d92/f93 x:0 0 0 2024-09-19T09:02:36.503 INFO:tasks.workunit.client.1.smithi102.stdout:9/385: chown d1/d2/d3/f4b 1622936 1 2024-09-19T09:02:36.503 INFO:tasks.workunit.client.1.smithi102.stdout:0/542: creat d3/dd/fb4 x:0 0 0 2024-09-19T09:02:36.504 INFO:tasks.workunit.client.1.smithi102.stdout:6/372: getdents d1/d3a 0 2024-09-19T09:02:36.505 INFO:tasks.workunit.client.1.smithi102.stdout:3/521: dwrite d2/d19/d1c/d2f/d5a/d84/d53/f57 [0,4194304] 0 2024-09-19T09:02:36.505 INFO:tasks.workunit.client.1.smithi102.stdout:0/543: readlink d3/d8/l9 0 2024-09-19T09:02:36.505 INFO:tasks.workunit.client.1.smithi102.stdout:4/476: readlink d14/d16/d17/d25/l52 0 2024-09-19T09:02:36.507 INFO:tasks.workunit.client.1.smithi102.stdout:9/386: write d1/d2/d3/d1d/f63 [466014,9566] 0 2024-09-19T09:02:36.508 INFO:tasks.workunit.client.1.smithi102.stdout:6/373: creat d1/d18/d37/f7d x:0 0 0 2024-09-19T09:02:36.514 INFO:tasks.workunit.client.1.smithi102.stdout:9/387: readlink d1/d2/d3/l7 0 2024-09-19T09:02:36.514 INFO:tasks.workunit.client.1.smithi102.stdout:8/394: dwrite d0/d10/f37 [0,4194304] 0 2024-09-19T09:02:36.516 INFO:tasks.workunit.client.1.smithi102.stdout:3/522: dread d2/d19/d47/f89 [0,4194304] 0 2024-09-19T09:02:36.518 INFO:tasks.workunit.client.1.smithi102.stdout:8/395: mknod d0/d10/d21/d39/d50/c7a 0 2024-09-19T09:02:36.520 INFO:tasks.workunit.client.1.smithi102.stdout:3/523: write d2/d19/d47/db/d8b/f94 [1178119,85964] 0 2024-09-19T09:02:36.521 INFO:tasks.workunit.client.1.smithi102.stdout:4/477: creat d14/d16/d17/d25/f94 x:0 0 0 2024-09-19T09:02:36.521 INFO:tasks.workunit.client.1.smithi102.stdout:0/544: truncate d3/dd/d10/d15/d22/f2f 1047806 0 2024-09-19T09:02:36.522 INFO:tasks.workunit.client.1.smithi102.stdout:6/374: creat d1/d18/f7e x:0 0 0 2024-09-19T09:02:36.522 INFO:tasks.workunit.client.1.smithi102.stdout:8/396: write d0/d4f/f76 [89092,113727] 0 2024-09-19T09:02:36.524 INFO:tasks.workunit.client.1.smithi102.stdout:8/397: chown d0/d10/d21/f6c 4 1 2024-09-19T09:02:36.524 INFO:tasks.workunit.client.1.smithi102.stdout:9/388: dread d1/d2/d78/f79 [0,4194304] 0 2024-09-19T09:02:36.527 INFO:tasks.workunit.client.1.smithi102.stdout:3/524: creat d2/d19/fb1 x:0 0 0 2024-09-19T09:02:36.527 INFO:tasks.workunit.client.1.smithi102.stdout:6/375: symlink d1/d18/l7f 0 2024-09-19T09:02:36.528 INFO:tasks.workunit.client.1.smithi102.stdout:0/545: creat d3/dd/d10/d15/d22/d4a/d80/fb5 x:0 0 0 2024-09-19T09:02:36.530 INFO:tasks.workunit.client.1.smithi102.stdout:9/389: rename d1/d2/f43 to d1/d2/d78/f7d 0 2024-09-19T09:02:36.532 INFO:tasks.workunit.client.1.smithi102.stdout:8/398: getdents d0/db/d1d/d69 0 2024-09-19T09:02:36.533 INFO:tasks.workunit.client.1.smithi102.stdout:0/546: chown d3/dd/d10/d15/d22/d37/d39/d44/dab 175663288 1 2024-09-19T09:02:36.534 INFO:tasks.workunit.client.1.smithi102.stdout:8/399: readlink d0/l30 0 2024-09-19T09:02:36.535 INFO:tasks.workunit.client.1.smithi102.stdout:6/376: rename d1/d26/d2e/d45/d47/f64 to d1/d18/db/d6d/f80 0 2024-09-19T09:02:36.536 INFO:tasks.workunit.client.1.smithi102.stdout:8/400: write d0/d4f/f76 [1243534,63772] 0 2024-09-19T09:02:36.538 INFO:tasks.workunit.client.1.smithi102.stdout:3/525: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/f85 [0,4194304] 0 2024-09-19T09:02:36.541 INFO:tasks.workunit.client.1.smithi102.stdout:3/526: write d2/d19/d47/db/d26/d63/f88 [3529658,58578] 0 2024-09-19T09:02:36.541 INFO:tasks.workunit.client.1.smithi102.stdout:3/527: readlink d2/d19/d1c/d2f/d5a/d84/l6e 0 2024-09-19T09:02:36.543 INFO:tasks.workunit.client.1.smithi102.stdout:0/547: mknod d3/dd/d10/d15/d22/d37/cb6 0 2024-09-19T09:02:36.543 INFO:tasks.workunit.client.1.smithi102.stdout:3/528: read d2/ff [3396133,64598] 0 2024-09-19T09:02:36.543 INFO:tasks.workunit.client.1.smithi102.stdout:3/529: stat d2/d19/fb1 0 2024-09-19T09:02:36.549 INFO:tasks.workunit.client.1.smithi102.stdout:9/390: link d1/d2/d3/d1d/d4f/c68 d1/d2/d3/d1d/c7e 0 2024-09-19T09:02:36.550 INFO:tasks.workunit.client.1.smithi102.stdout:0/548: dwrite d3/dd/d1a/d77/f8c [4194304,4194304] 0 2024-09-19T09:02:36.551 INFO:tasks.workunit.client.1.smithi102.stdout:9/391: readlink d1/d2/d3/l7 0 2024-09-19T09:02:36.554 INFO:tasks.workunit.client.1.smithi102.stdout:4/478: dwrite d14/d34/d5a/d5c/d79/d8c/f91 [0,4194304] 0 2024-09-19T09:02:36.556 INFO:tasks.workunit.client.1.smithi102.stdout:4/479: chown d14/d16/d17/d2e/d60/l68 2312426 1 2024-09-19T09:02:36.557 INFO:tasks.workunit.client.1.smithi102.stdout:0/549: creat d3/dd/d10/d84/fb7 x:0 0 0 2024-09-19T09:02:36.561 INFO:tasks.workunit.client.1.smithi102.stdout:0/550: mknod d3/dd/d10/cb8 0 2024-09-19T09:02:36.562 INFO:tasks.workunit.client.1.smithi102.stdout:0/551: chown d3/dd/d1a/d77 2 1 2024-09-19T09:02:36.563 INFO:tasks.workunit.client.1.smithi102.stdout:4/480: dwrite d14/d16/d17/d25/f94 [0,4194304] 0 2024-09-19T09:02:36.564 INFO:tasks.workunit.client.1.smithi102.stdout:0/552: write d3/dd/d10/d15/d22/d37/d3d/f48 [3402844,112527] 0 2024-09-19T09:02:36.568 INFO:tasks.workunit.client.1.smithi102.stdout:0/553: mknod d3/dd/d1a/d77/cb9 0 2024-09-19T09:02:36.571 INFO:tasks.workunit.client.1.smithi102.stdout:4/481: creat d14/d16/d17/d25/d7c/d80/f95 x:0 0 0 2024-09-19T09:02:36.572 INFO:tasks.workunit.client.1.smithi102.stdout:3/530: truncate d2/d1e/d54/f97 85758 0 2024-09-19T09:02:36.573 INFO:tasks.workunit.client.1.smithi102.stdout:3/531: fdatasync d2/d19/d47/db/fa5 0 2024-09-19T09:02:36.575 INFO:tasks.workunit.client.1.smithi102.stdout:4/482: symlink d14/d16/d17/d2e/d37/d58/d89/d78/l96 0 2024-09-19T09:02:36.575 INFO:tasks.workunit.client.1.smithi102.stdout:4/483: stat d14/d16/d1d/f82 0 2024-09-19T09:02:36.576 INFO:tasks.workunit.client.1.smithi102.stdout:3/532: creat d2/d19/d1c/d2f/d5a/d84/d64/fb2 x:0 0 0 2024-09-19T09:02:36.577 INFO:tasks.workunit.client.1.smithi102.stdout:3/533: chown d2/d19/d1c/d2f/d5a/d84/d4f/d72/fa6 2820 1 2024-09-19T09:02:36.578 INFO:tasks.workunit.client.1.smithi102.stdout:4/484: symlink d14/d16/d1d/d48/l97 0 2024-09-19T09:02:36.580 INFO:tasks.workunit.client.1.smithi102.stdout:4/485: unlink d14/d16/d1d/f82 0 2024-09-19T09:02:36.584 INFO:tasks.workunit.client.1.smithi102.stdout:3/534: dwrite d2/d19/d47/db/d26/d63/d6f/d96/f9e [0,4194304] 0 2024-09-19T09:02:36.585 INFO:tasks.workunit.client.1.smithi102.stdout:0/554: truncate d3/dd/d10/d15/f60 3834707 0 2024-09-19T09:02:36.586 INFO:tasks.workunit.client.1.smithi102.stdout:3/535: dread - d2/d19/d47/db/fa1 zero size 2024-09-19T09:02:36.637 INFO:tasks.workunit.client.1.smithi102.stdout:2/335: sync 2024-09-19T09:02:36.646 INFO:tasks.workunit.client.1.smithi102.stdout:4/486: write d14/d16/d1d/f20 [1269833,90311] 0 2024-09-19T09:02:36.647 INFO:tasks.workunit.client.1.smithi102.stdout:2/336: read d7/f10 [3608657,8862] 0 2024-09-19T09:02:36.648 INFO:tasks.workunit.client.1.smithi102.stdout:4/487: dread - d14/d16/d17/d2e/d37/d58/f73 zero size 2024-09-19T09:02:36.649 INFO:tasks.workunit.client.1.smithi102.stdout:3/536: creat d2/d19/d1c/d2f/d5a/d84/fb3 x:0 0 0 2024-09-19T09:02:36.649 INFO:tasks.workunit.client.1.smithi102.stdout:3/537: chown d2/d19/d1c/d2f 3034 1 2024-09-19T09:02:36.650 INFO:tasks.workunit.client.1.smithi102.stdout:3/538: chown d2/d19/d47/db/d26/f7f 0 1 2024-09-19T09:02:36.651 INFO:tasks.workunit.client.1.smithi102.stdout:4/488: symlink d14/d16/d1d/d48/l98 0 2024-09-19T09:02:36.705 INFO:tasks.workunit.client.1.smithi102.stdout:3/539: write d2/d19/d1c/f31 [4669359,106347] 0 2024-09-19T09:02:36.706 INFO:tasks.workunit.client.1.smithi102.stdout:4/489: symlink d14/d16/d17/d2e/d37/d58/d89/l99 0 2024-09-19T09:02:36.708 INFO:tasks.workunit.client.1.smithi102.stdout:2/337: getdents d7/d1a/d2b/d4e 0 2024-09-19T09:02:36.708 INFO:tasks.workunit.client.1.smithi102.stdout:4/490: dread - d14/d34/d5a/d5c/f8d zero size 2024-09-19T09:02:36.713 INFO:tasks.workunit.client.1.smithi102.stdout:3/540: dread d2/d19/d1c/d2f/d5a/d84/d4f/f85 [0,4194304] 0 2024-09-19T09:02:36.713 INFO:tasks.workunit.client.1.smithi102.stdout:2/338: unlink d7/d1a/d56/c6e 0 2024-09-19T09:02:36.714 INFO:tasks.workunit.client.1.smithi102.stdout:4/491: dwrite d14/d34/d5a/d5c/f84 [0,4194304] 0 2024-09-19T09:02:36.720 INFO:tasks.workunit.client.1.smithi102.stdout:3/541: read d2/ff [3468515,109063] 0 2024-09-19T09:02:36.720 INFO:tasks.workunit.client.1.smithi102.stdout:2/339: dread d7/f9 [4194304,4194304] 0 2024-09-19T09:02:36.725 INFO:tasks.workunit.client.1.smithi102.stdout:2/340: dwrite d7/d1a/d2b/d31/d51/d6b/f70 [0,4194304] 0 2024-09-19T09:02:36.725 INFO:tasks.workunit.client.1.smithi102.stdout:4/492: getdents d14/d34/d5a/d5c/d79 0 2024-09-19T09:02:36.730 INFO:tasks.workunit.client.1.smithi102.stdout:2/341: truncate d7/d1a/d2b/d31/f3e 414429 0 2024-09-19T09:02:36.732 INFO:tasks.workunit.client.1.smithi102.stdout:2/342: fdatasync d7/f9 0 2024-09-19T09:02:36.734 INFO:tasks.workunit.client.1.smithi102.stdout:2/343: rmdir d7/d11 39 2024-09-19T09:02:36.738 INFO:tasks.workunit.client.1.smithi102.stdout:7/436: sync 2024-09-19T09:02:36.738 INFO:tasks.workunit.client.1.smithi102.stdout:5/457: sync 2024-09-19T09:02:36.738 INFO:tasks.workunit.client.1.smithi102.stdout:6/377: sync 2024-09-19T09:02:36.738 INFO:tasks.workunit.client.1.smithi102.stdout:1/440: sync 2024-09-19T09:02:36.740 INFO:tasks.workunit.client.1.smithi102.stdout:5/458: stat d5/d7/d1b/f6f 0 2024-09-19T09:02:36.740 INFO:tasks.workunit.client.1.smithi102.stdout:2/344: dwrite d7/d1a/d2b/f4c [0,4194304] 0 2024-09-19T09:02:36.743 INFO:tasks.workunit.client.1.smithi102.stdout:6/378: write d1/fc [529200,125171] 0 2024-09-19T09:02:36.746 INFO:tasks.workunit.client.1.smithi102.stdout:1/441: creat dd/d14/d35/d49/d7d/d7f/f8b x:0 0 0 2024-09-19T09:02:36.746 INFO:tasks.workunit.client.1.smithi102.stdout:6/379: write d1/d26/d4b/f51 [480683,28313] 0 2024-09-19T09:02:36.748 INFO:tasks.workunit.client.1.smithi102.stdout:4/493: dread f13 [4194304,4194304] 0 2024-09-19T09:02:36.750 INFO:tasks.workunit.client.1.smithi102.stdout:5/459: mknod d5/d7/d1a/d37/d34/d73/c93 0 2024-09-19T09:02:36.751 INFO:tasks.workunit.client.1.smithi102.stdout:2/345: dwrite d7/d1a/d2b/d31/f48 [0,4194304] 0 2024-09-19T09:02:36.759 INFO:tasks.workunit.client.1.smithi102.stdout:2/346: dwrite d7/d12/f17 [4194304,4194304] 0 2024-09-19T09:02:36.759 INFO:tasks.workunit.client.1.smithi102.stdout:7/437: rename d1/f5 to d1/d3/f8a 0 2024-09-19T09:02:36.760 INFO:tasks.workunit.client.1.smithi102.stdout:7/438: fdatasync d1/d3/d20/f35 0 2024-09-19T09:02:36.761 INFO:tasks.workunit.client.1.smithi102.stdout:4/494: creat d14/d34/d5a/d5c/d79/d8c/f9a x:0 0 0 2024-09-19T09:02:36.762 INFO:tasks.workunit.client.1.smithi102.stdout:7/439: fsync d1/d3/d34/d4f/f61 0 2024-09-19T09:02:36.763 INFO:tasks.workunit.client.1.smithi102.stdout:6/380: creat d1/d18/db/f81 x:0 0 0 2024-09-19T09:02:36.767 INFO:tasks.workunit.client.1.smithi102.stdout:1/442: rename dd/d13/d3b/d82 to dd/d7a/d8c 0 2024-09-19T09:02:36.769 INFO:tasks.workunit.client.1.smithi102.stdout:4/495: dread d14/d16/d1d/f44 [0,4194304] 0 2024-09-19T09:02:36.770 INFO:tasks.workunit.client.1.smithi102.stdout:5/460: dread d5/d23/f24 [0,4194304] 0 2024-09-19T09:02:36.771 INFO:tasks.workunit.client.1.smithi102.stdout:2/347: creat d7/d1a/d3d/f73 x:0 0 0 2024-09-19T09:02:36.779 INFO:tasks.workunit.client.1.smithi102.stdout:1/443: creat dd/d14/d35/d49/d62/d6c/f8d x:0 0 0 2024-09-19T09:02:36.782 INFO:tasks.workunit.client.1.smithi102.stdout:5/461: symlink d5/d7/d1a/d37/d34/d4d/l94 0 2024-09-19T09:02:36.783 INFO:tasks.workunit.client.1.smithi102.stdout:5/462: fdatasync d5/d7/d1b/f1c 0 2024-09-19T09:02:36.787 INFO:tasks.workunit.client.1.smithi102.stdout:7/440: link d1/d4/d45/d25/f7d d1/d3/d72/f8b 0 2024-09-19T09:02:36.788 INFO:tasks.workunit.client.1.smithi102.stdout:5/463: dwrite d5/d7/d1b/f1c [0,4194304] 0 2024-09-19T09:02:36.790 INFO:tasks.workunit.client.1.smithi102.stdout:6/381: dread d1/d26/d2e/d45/d47/d4d/f33 [0,4194304] 0 2024-09-19T09:02:36.794 INFO:tasks.workunit.client.1.smithi102.stdout:5/464: unlink d5/d23/c8a 0 2024-09-19T09:02:36.795 INFO:tasks.workunit.client.1.smithi102.stdout:7/441: fdatasync d1/d4/d45/d25/f81 0 2024-09-19T09:02:36.799 INFO:tasks.workunit.client.1.smithi102.stdout:2/348: link d7/d1a/l4d d7/d1a/d2b/d31/l74 0 2024-09-19T09:02:36.800 INFO:tasks.workunit.client.1.smithi102.stdout:5/465: dwrite d5/fe [4194304,4194304] 0 2024-09-19T09:02:36.801 INFO:tasks.workunit.client.1.smithi102.stdout:1/444: rmdir dd/d13/d3b 39 2024-09-19T09:02:36.809 INFO:tasks.workunit.client.1.smithi102.stdout:5/466: dwrite d5/d7/d1b/f46 [0,4194304] 0 2024-09-19T09:02:36.809 INFO:tasks.workunit.client.1.smithi102.stdout:2/349: unlink d7/f4f 0 2024-09-19T09:02:36.812 INFO:tasks.workunit.client.1.smithi102.stdout:1/445: mkdir dd/d7a/d8c/d8e 0 2024-09-19T09:02:36.813 INFO:tasks.workunit.client.1.smithi102.stdout:8/401: sync 2024-09-19T09:02:36.813 INFO:tasks.workunit.client.1.smithi102.stdout:0/555: sync 2024-09-19T09:02:36.813 INFO:tasks.workunit.client.1.smithi102.stdout:9/392: sync 2024-09-19T09:02:36.815 INFO:tasks.workunit.client.1.smithi102.stdout:1/446: chown dd/d14/d35/d49/l5a 15974820 1 2024-09-19T09:02:36.815 INFO:tasks.workunit.client.1.smithi102.stdout:9/393: write d1/f58 [607177,30596] 0 2024-09-19T09:02:36.819 INFO:tasks.workunit.client.1.smithi102.stdout:1/447: write dd/d14/d18/f40 [128685,77816] 0 2024-09-19T09:02:36.819 INFO:tasks.workunit.client.1.smithi102.stdout:9/394: chown d1/f58 0 1 2024-09-19T09:02:36.822 INFO:tasks.workunit.client.1.smithi102.stdout:6/382: creat d1/d26/d2e/d45/d47/d4d/d35/f82 x:0 0 0 2024-09-19T09:02:36.823 INFO:tasks.workunit.client.1.smithi102.stdout:7/442: dread d1/d3/d20/f5a [0,4194304] 0 2024-09-19T09:02:36.823 INFO:tasks.workunit.client.1.smithi102.stdout:4/496: dwrite d14/d16/d17/d2e/d60/f71 [0,4194304] 0 2024-09-19T09:02:36.824 INFO:tasks.workunit.client.1.smithi102.stdout:4/497: chown d14/d16/d1d 7076 1 2024-09-19T09:02:36.824 INFO:tasks.workunit.client.1.smithi102.stdout:7/443: truncate d1/d4/f1a 4744506 0 2024-09-19T09:02:36.846 INFO:tasks.workunit.client.1.smithi102.stdout:3/542: sync 2024-09-19T09:02:36.851 INFO:tasks.workunit.client.1.smithi102.stdout:3/543: dwrite d2/d1e/fac [0,4194304] 0 2024-09-19T09:02:36.851 INFO:tasks.workunit.client.1.smithi102.stdout:3/544: chown d2/d19/d1c/d70/f8a 452860 1 2024-09-19T09:02:36.854 INFO:tasks.workunit.client.1.smithi102.stdout:3/545: dread d2/d19/d1c/d2f/d5a/d84/d4f/f80 [0,4194304] 0 2024-09-19T09:02:36.874 INFO:tasks.workunit.client.1.smithi102.stdout:8/402: unlink d0/d10/l78 0 2024-09-19T09:02:36.876 INFO:tasks.workunit.client.1.smithi102.stdout:5/467: mkdir d5/d8d/d95 0 2024-09-19T09:02:36.884 INFO:tasks.workunit.client.1.smithi102.stdout:2/350: creat d7/d11/d44/f75 x:0 0 0 2024-09-19T09:02:36.885 INFO:tasks.workunit.client.1.smithi102.stdout:2/351: fdatasync d7/d12/f17 0 2024-09-19T09:02:36.886 INFO:tasks.workunit.client.1.smithi102.stdout:6/383: stat d1/c61 0 2024-09-19T09:02:36.887 INFO:tasks.workunit.client.1.smithi102.stdout:6/384: readlink d1/d26/d2e/l46 0 2024-09-19T09:02:36.887 INFO:tasks.workunit.client.1.smithi102.stdout:9/395: creat d1/d2/d7b/f7f x:0 0 0 2024-09-19T09:02:36.890 INFO:tasks.workunit.client.1.smithi102.stdout:4/498: mknod d14/d16/d17/d2e/d60/c9b 0 2024-09-19T09:02:36.893 INFO:tasks.workunit.client.1.smithi102.stdout:4/499: chown d14/d34/d5a/d5c/d79 9157 1 2024-09-19T09:02:36.893 INFO:tasks.workunit.client.1.smithi102.stdout:1/448: dread dd/d14/f4e [0,4194304] 0 2024-09-19T09:02:36.897 INFO:tasks.workunit.client.1.smithi102.stdout:6/385: rmdir d1 39 2024-09-19T09:02:36.899 INFO:tasks.workunit.client.1.smithi102.stdout:7/444: symlink d1/l8c 0 2024-09-19T09:02:36.903 INFO:tasks.workunit.client.1.smithi102.stdout:1/449: chown f0 13223432 1 2024-09-19T09:02:36.903 INFO:tasks.workunit.client.1.smithi102.stdout:1/450: chown dd/d14/d18 855009 1 2024-09-19T09:02:36.904 INFO:tasks.workunit.client.1.smithi102.stdout:4/500: mknod d14/d16/d17/d2e/d37/d58/d89/d78/c9c 0 2024-09-19T09:02:36.907 INFO:tasks.workunit.client.1.smithi102.stdout:2/352: link d7/d1a/d2b/f35 d7/d11/d44/f76 0 2024-09-19T09:02:36.909 INFO:tasks.workunit.client.1.smithi102.stdout:0/556: truncate d3/dd/d10/f6a 2544947 0 2024-09-19T09:02:36.909 INFO:tasks.workunit.client.1.smithi102.stdout:3/546: dwrite d2/d19/d47/f71 [4194304,4194304] 0 2024-09-19T09:02:36.910 INFO:tasks.workunit.client.1.smithi102.stdout:7/445: creat d1/d3/d34/d4f/f8d x:0 0 0 2024-09-19T09:02:36.911 INFO:tasks.workunit.client.1.smithi102.stdout:9/396: rename d1/d2/d3/f13 to d1/d2/d3/d6f/f80 0 2024-09-19T09:02:36.912 INFO:tasks.workunit.client.1.smithi102.stdout:1/451: creat dd/d14/d35/d49/d62/d6c/f8f x:0 0 0 2024-09-19T09:02:36.912 INFO:tasks.workunit.client.1.smithi102.stdout:9/397: write d1/d8/f5f [533386,63822] 0 2024-09-19T09:02:36.914 INFO:tasks.workunit.client.1.smithi102.stdout:4/501: mkdir d14/d16/d17/d25/d7c/d80/d9d 0 2024-09-19T09:02:36.917 INFO:tasks.workunit.client.1.smithi102.stdout:2/353: creat d7/d50/d64/f77 x:0 0 0 2024-09-19T09:02:36.917 INFO:tasks.workunit.client.1.smithi102.stdout:1/452: chown dd/d13/d2d/l67 78883099 1 2024-09-19T09:02:36.918 INFO:tasks.workunit.client.1.smithi102.stdout:4/502: fsync d14/d16/d17/d2e/d37/f76 0 2024-09-19T09:02:36.919 INFO:tasks.workunit.client.1.smithi102.stdout:1/453: read - dd/d14/d35/f80 zero size 2024-09-19T09:02:36.921 INFO:tasks.workunit.client.1.smithi102.stdout:7/446: creat d1/d4/d45/d25/f8e x:0 0 0 2024-09-19T09:02:36.921 INFO:tasks.workunit.client.1.smithi102.stdout:0/557: dwrite d3/dd/d10/d15/d22/d37/d3d/f48 [4194304,4194304] 0 2024-09-19T09:02:36.922 INFO:tasks.workunit.client.1.smithi102.stdout:8/403: link d0/d4f/l5d d0/d10/d21/d39/d50/d63/l7b 0 2024-09-19T09:02:36.923 INFO:tasks.workunit.client.1.smithi102.stdout:8/404: read d0/d4f/f74 [3453307,4194] 0 2024-09-19T09:02:36.923 INFO:tasks.workunit.client.1.smithi102.stdout:7/447: dread d1/d4/d45/d25/f4b [0,4194304] 0 2024-09-19T09:02:36.924 INFO:tasks.workunit.client.1.smithi102.stdout:3/547: fsync d2/d1e/d54/f97 0 2024-09-19T09:02:36.926 INFO:tasks.workunit.client.1.smithi102.stdout:6/386: link d1/d26/d2e/d45/d47/f75 d1/d18/db/d65/f83 0 2024-09-19T09:02:36.933 INFO:tasks.workunit.client.1.smithi102.stdout:0/558: read d3/dd/d10/f63 [2056225,88388] 0 2024-09-19T09:02:36.937 INFO:tasks.workunit.client.1.smithi102.stdout:7/448: fsync d1/d4/d45/f62 0 2024-09-19T09:02:36.939 INFO:tasks.workunit.client.1.smithi102.stdout:7/449: write d1/d4/d45/d25/f8e [344031,60276] 0 2024-09-19T09:02:36.940 INFO:tasks.workunit.client.1.smithi102.stdout:9/398: dread d1/d2/d3/d1d/f20 [0,4194304] 0 2024-09-19T09:02:36.942 INFO:tasks.workunit.client.1.smithi102.stdout:7/450: truncate d1/d4/d45/d25/d52/f6b 962286 0 2024-09-19T09:02:36.944 INFO:tasks.workunit.client.1.smithi102.stdout:2/354: dread d7/f9 [0,4194304] 0 2024-09-19T09:02:36.950 INFO:tasks.workunit.client.1.smithi102.stdout:0/559: rename d3/d8 to d3/dd/d10/d15/d22/d2a/dba 0 2024-09-19T09:02:36.951 INFO:tasks.workunit.client.1.smithi102.stdout:1/454: rmdir dd/d14/d35 39 2024-09-19T09:02:36.956 INFO:tasks.workunit.client.1.smithi102.stdout:9/399: mkdir d1/d2/d3/d1d/d4f/d6d/d81 0 2024-09-19T09:02:36.961 INFO:tasks.workunit.client.1.smithi102.stdout:2/355: read d7/d1a/d2b/f2d [495553,3039] 0 2024-09-19T09:02:36.961 INFO:tasks.workunit.client.1.smithi102.stdout:8/405: creat d0/d10/f7c x:0 0 0 2024-09-19T09:02:36.963 INFO:tasks.workunit.client.1.smithi102.stdout:5/468: sync 2024-09-19T09:02:36.963 INFO:tasks.workunit.client.1.smithi102.stdout:0/560: rmdir d3/dd/d10/d15/d19/d7e 39 2024-09-19T09:02:36.966 INFO:tasks.workunit.client.1.smithi102.stdout:4/503: link d14/d34/d5a/d5c/d79/d8c/f91 d14/d34/d5a/d5c/d79/d8c/f9e 0 2024-09-19T09:02:36.969 INFO:tasks.workunit.client.1.smithi102.stdout:6/387: creat d1/d26/d2e/d45/d47/d4d/d35/d41/f84 x:0 0 0 2024-09-19T09:02:36.972 INFO:tasks.workunit.client.1.smithi102.stdout:9/400: dread d1/d2/ff [0,4194304] 0 2024-09-19T09:02:36.973 INFO:tasks.workunit.client.1.smithi102.stdout:5/469: dwrite d5/d7/d1a/d37/f84 [0,4194304] 0 2024-09-19T09:02:36.974 INFO:tasks.workunit.client.1.smithi102.stdout:8/406: creat d0/db/d1d/f7d x:0 0 0 2024-09-19T09:02:36.976 INFO:tasks.workunit.client.1.smithi102.stdout:7/451: creat d1/f8f x:0 0 0 2024-09-19T09:02:36.977 INFO:tasks.workunit.client.1.smithi102.stdout:7/452: dread - d1/d4/d45/f62 zero size 2024-09-19T09:02:36.978 INFO:tasks.workunit.client.1.smithi102.stdout:3/548: dwrite d2/d1e/d54/f97 [0,4194304] 0 2024-09-19T09:02:36.980 INFO:tasks.workunit.client.1.smithi102.stdout:9/401: read d1/d2/d3/f5 [4161553,99908] 0 2024-09-19T09:02:36.984 INFO:tasks.workunit.client.1.smithi102.stdout:3/549: dread d2/d19/d1c/d70/f8a [0,4194304] 0 2024-09-19T09:02:36.992 INFO:tasks.workunit.client.1.smithi102.stdout:5/470: rmdir d5/d7 39 2024-09-19T09:02:37.005 INFO:tasks.workunit.client.1.smithi102.stdout:5/471: fsync d5/d7/d1a/d37/f2b 0 2024-09-19T09:02:37.006 INFO:tasks.workunit.client.1.smithi102.stdout:1/455: rename dd/d14/d35/f4a to dd/f90 0 2024-09-19T09:02:37.006 INFO:tasks.workunit.client.1.smithi102.stdout:5/472: dread - d5/d7/d1a/d37/d34/f5b zero size 2024-09-19T09:02:37.008 INFO:tasks.workunit.client.1.smithi102.stdout:2/356: dwrite d7/d11/d44/f76 [0,4194304] 0 2024-09-19T09:02:37.008 INFO:tasks.workunit.client.1.smithi102.stdout:7/453: dread d1/d3/f8a [0,4194304] 0 2024-09-19T09:02:37.012 INFO:tasks.workunit.client.1.smithi102.stdout:9/402: rename d1/d2/d7b/f7f to d1/d2/d3/d1d/d4f/f82 0 2024-09-19T09:02:37.013 INFO:tasks.workunit.client.1.smithi102.stdout:5/473: write d5/d7/d1a/d37/d39/f87 [1118518,36115] 0 2024-09-19T09:02:37.016 INFO:tasks.workunit.client.1.smithi102.stdout:4/504: dwrite d14/d16/d17/d2e/d37/d58/d89/f31 [0,4194304] 0 2024-09-19T09:02:37.017 INFO:tasks.workunit.client.1.smithi102.stdout:7/454: symlink d1/d3/d72/l90 0 2024-09-19T09:02:37.018 INFO:tasks.workunit.client.1.smithi102.stdout:8/407: write d0/f35 [638445,48577] 0 2024-09-19T09:02:37.019 INFO:tasks.workunit.client.1.smithi102.stdout:9/403: truncate d1/d2/d3/f77 943656 0 2024-09-19T09:02:37.022 INFO:tasks.workunit.client.1.smithi102.stdout:3/550: rename d2/d19/d47/db/d26/d63/c98 to d2/d1e/cb4 0 2024-09-19T09:02:37.022 INFO:tasks.workunit.client.1.smithi102.stdout:1/456: dwrite dd/d14/d18/f3f [4194304,4194304] 0 2024-09-19T09:02:37.022 INFO:tasks.workunit.client.1.smithi102.stdout:6/388: truncate d1/d18/f25 1807756 0 2024-09-19T09:02:37.023 INFO:tasks.workunit.client.1.smithi102.stdout:3/551: read d2/d19/d35/f7c [315577,35037] 0 2024-09-19T09:02:37.024 INFO:tasks.workunit.client.1.smithi102.stdout:5/474: mknod d5/d7/d1a/d37/d34/d7f/c96 0 2024-09-19T09:02:37.025 INFO:tasks.workunit.client.1.smithi102.stdout:5/475: dread - d5/d7/d1a/d42/f44 zero size 2024-09-19T09:02:37.029 INFO:tasks.workunit.client.1.smithi102.stdout:4/505: write d14/d16/f1e [1078896,38459] 0 2024-09-19T09:02:37.029 INFO:tasks.workunit.client.1.smithi102.stdout:7/455: mknod d1/d4/d45/c91 0 2024-09-19T09:02:37.035 INFO:tasks.workunit.client.1.smithi102.stdout:1/457: unlink dd/d14/f75 0 2024-09-19T09:02:37.037 INFO:tasks.workunit.client.1.smithi102.stdout:5/476: dread d5/d60/f85 [0,4194304] 0 2024-09-19T09:02:37.037 INFO:tasks.workunit.client.1.smithi102.stdout:3/552: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/faa [0,4194304] 0 2024-09-19T09:02:37.038 INFO:tasks.workunit.client.1.smithi102.stdout:6/389: rmdir d1/d18/d37 39 2024-09-19T09:02:37.039 INFO:tasks.workunit.client.1.smithi102.stdout:6/390: write d1/f2c [179306,54949] 0 2024-09-19T09:02:37.040 INFO:tasks.workunit.client.1.smithi102.stdout:6/391: truncate d1/d18/f6a 741965 0 2024-09-19T09:02:37.043 INFO:tasks.workunit.client.1.smithi102.stdout:9/404: mknod d1/d8/c83 0 2024-09-19T09:02:37.044 INFO:tasks.workunit.client.1.smithi102.stdout:8/408: mknod d0/d10/d21/c7e 0 2024-09-19T09:02:37.045 INFO:tasks.workunit.client.1.smithi102.stdout:4/506: mkdir d14/d34/d9f 0 2024-09-19T09:02:37.045 INFO:tasks.workunit.client.1.smithi102.stdout:7/456: rmdir d1/d3/d20/d6c 39 2024-09-19T09:02:37.048 INFO:tasks.workunit.client.1.smithi102.stdout:4/507: dread - d14/d16/d1d/d92/f93 zero size 2024-09-19T09:02:37.051 INFO:tasks.workunit.client.1.smithi102.stdout:7/457: symlink d1/d3/d34/l92 0 2024-09-19T09:02:37.053 INFO:tasks.workunit.client.1.smithi102.stdout:8/409: dwrite d0/d10/f7c [0,4194304] 0 2024-09-19T09:02:37.054 INFO:tasks.workunit.client.1.smithi102.stdout:6/392: fdatasync d1/d18/f25 0 2024-09-19T09:02:37.056 INFO:tasks.workunit.client.1.smithi102.stdout:9/405: creat d1/d2/d3/d1d/d4f/d6d/d81/f84 x:0 0 0 2024-09-19T09:02:37.057 INFO:tasks.workunit.client.1.smithi102.stdout:6/393: truncate d1/d26/d2e/d45/d47/d4d/f4c 1288054 0 2024-09-19T09:02:37.062 INFO:tasks.workunit.client.1.smithi102.stdout:3/553: link d2/d1e/d54/f97 d2/d19/d1c/d2f/fb5 0 2024-09-19T09:02:37.062 INFO:tasks.workunit.client.1.smithi102.stdout:3/554: readlink d2/d19/d35/l5e 0 2024-09-19T09:02:37.063 INFO:tasks.workunit.client.1.smithi102.stdout:3/555: dread - d2/f6c zero size 2024-09-19T09:02:37.065 INFO:tasks.workunit.client.1.smithi102.stdout:3/556: truncate d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9d 298576 0 2024-09-19T09:02:37.066 INFO:tasks.workunit.client.1.smithi102.stdout:8/410: rename d0/d10/c54 to d0/d64/c7f 0 2024-09-19T09:02:37.067 INFO:tasks.workunit.client.1.smithi102.stdout:8/411: dread - d0/db/d1d/f7d zero size 2024-09-19T09:02:37.067 INFO:tasks.workunit.client.1.smithi102.stdout:9/406: write d1/d2/d3/f12 [2550157,15408] 0 2024-09-19T09:02:37.071 INFO:tasks.workunit.client.1.smithi102.stdout:2/357: truncate d7/d1a/d2b/d31/d51/d6b/f70 796719 0 2024-09-19T09:02:37.075 INFO:tasks.workunit.client.1.smithi102.stdout:8/412: mknod d0/d10/d21/d39/d50/c80 0 2024-09-19T09:02:37.076 INFO:tasks.workunit.client.1.smithi102.stdout:9/407: dwrite d1/d2/d3/f4b [0,4194304] 0 2024-09-19T09:02:37.078 INFO:tasks.workunit.client.1.smithi102.stdout:7/458: creat d1/d3/f93 x:0 0 0 2024-09-19T09:02:37.079 INFO:tasks.workunit.client.1.smithi102.stdout:2/358: symlink d7/d1a/d3d/l78 0 2024-09-19T09:02:37.081 INFO:tasks.workunit.client.1.smithi102.stdout:2/359: read d7/d1a/d2b/f35 [2331670,102351] 0 2024-09-19T09:02:37.082 INFO:tasks.workunit.client.1.smithi102.stdout:9/408: rename d1/d2/d3/c67 to d1/d2/d3/d1d/d4f/d6d/d81/c85 0 2024-09-19T09:02:37.084 INFO:tasks.workunit.client.1.smithi102.stdout:7/459: creat d1/d4/d45/d25/f94 x:0 0 0 2024-09-19T09:02:37.084 INFO:tasks.workunit.client.1.smithi102.stdout:3/557: dread d2/d19/d47/db/d26/f61 [0,4194304] 0 2024-09-19T09:02:37.087 INFO:tasks.workunit.client.1.smithi102.stdout:7/460: write d1/d4/d45/d25/f8e [458233,120071] 0 2024-09-19T09:02:37.088 INFO:tasks.workunit.client.1.smithi102.stdout:7/461: dread - d1/f8f zero size 2024-09-19T09:02:37.094 INFO:tasks.workunit.client.1.smithi102.stdout:8/413: dread d0/d64/f3c [0,4194304] 0 2024-09-19T09:02:37.095 INFO:tasks.workunit.client.1.smithi102.stdout:8/414: readlink d0/d10/d21/d39/l40 0 2024-09-19T09:02:37.110 INFO:tasks.workunit.client.1.smithi102.stdout:0/561: sync 2024-09-19T09:02:37.110 INFO:tasks.workunit.client.1.smithi102.stdout:0/562: chown d3/dd/d10/d15/d2c 837719640 1 2024-09-19T09:02:37.111 INFO:tasks.workunit.client.1.smithi102.stdout:0/563: dread - d3/dd/d10/d15/d22/d37/d3d/d90/fb0 zero size 2024-09-19T09:02:37.116 INFO:tasks.workunit.client.1.smithi102.stdout:0/564: dwrite d3/dd/d10/d15/d22/d2a/dba/f58 [0,4194304] 0 2024-09-19T09:02:37.121 INFO:tasks.workunit.client.1.smithi102.stdout:0/565: dwrite d3/dd/d10/d15/d22/d37/f9a [0,4194304] 0 2024-09-19T09:02:37.122 INFO:tasks.workunit.client.1.smithi102.stdout:0/566: chown f2 14661 1 2024-09-19T09:02:37.122 INFO:tasks.workunit.client.1.smithi102.stdout:0/567: readlink d3/dd/d1a/d32/l76 0 2024-09-19T09:02:37.161 INFO:tasks.workunit.client.1.smithi102.stdout:6/394: getdents d1/d26 0 2024-09-19T09:02:37.162 INFO:tasks.workunit.client.1.smithi102.stdout:6/395: fsync d1/d18/db/d6d/f6f 0 2024-09-19T09:02:37.163 INFO:tasks.workunit.client.1.smithi102.stdout:2/360: symlink d7/d1a/d2b/d31/d51/d6b/l79 0 2024-09-19T09:02:37.168 INFO:tasks.workunit.client.1.smithi102.stdout:4/508: truncate d14/d16/d17/d25/f94 7540 0 2024-09-19T09:02:37.169 INFO:tasks.workunit.client.1.smithi102.stdout:4/509: chown d14/d16/d17/d25/d7c/d80/f95 475449 1 2024-09-19T09:02:37.172 INFO:tasks.workunit.client.1.smithi102.stdout:3/558: symlink d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/lb6 0 2024-09-19T09:02:37.173 INFO:tasks.workunit.client.1.smithi102.stdout:7/462: mkdir d1/d2f/d95 0 2024-09-19T09:02:37.178 INFO:tasks.workunit.client.1.smithi102.stdout:0/568: mkdir d3/dd/d10/d15/d22/d37/d39/d44/d54/dbb 0 2024-09-19T09:02:37.180 INFO:tasks.workunit.client.1.smithi102.stdout:6/396: creat d1/d26/f85 x:0 0 0 2024-09-19T09:02:37.181 INFO:tasks.workunit.client.1.smithi102.stdout:1/458: sync 2024-09-19T09:02:37.181 INFO:tasks.workunit.client.1.smithi102.stdout:2/361: rmdir d7/d12 39 2024-09-19T09:02:37.186 INFO:tasks.workunit.client.1.smithi102.stdout:3/559: creat d2/d19/d1c/d1f/fb7 x:0 0 0 2024-09-19T09:02:37.186 INFO:tasks.workunit.client.1.smithi102.stdout:7/463: mknod d1/d4/d45/d25/d52/d7f/c96 0 2024-09-19T09:02:37.187 INFO:tasks.workunit.client.1.smithi102.stdout:1/459: dwrite f6 [4194304,4194304] 0 2024-09-19T09:02:37.189 INFO:tasks.workunit.client.1.smithi102.stdout:3/560: readlink d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/l7e 0 2024-09-19T09:02:37.191 INFO:tasks.workunit.client.1.smithi102.stdout:4/510: dread d14/d34/d5a/d5c/d79/d8c/f9e [0,4194304] 0 2024-09-19T09:02:37.195 INFO:tasks.workunit.client.1.smithi102.stdout:2/362: rename d7/d11/l18 to d7/d1a/d2b/d31/d51/d6b/l7a 0 2024-09-19T09:02:37.199 INFO:tasks.workunit.client.1.smithi102.stdout:1/460: mknod dd/d68/c91 0 2024-09-19T09:02:37.201 INFO:tasks.workunit.client.1.smithi102.stdout:3/561: mknod d2/d19/d47/db/d26/cb8 0 2024-09-19T09:02:37.201 INFO:tasks.workunit.client.1.smithi102.stdout:8/415: dwrite d0/f42 [0,4194304] 0 2024-09-19T09:02:37.202 INFO:tasks.workunit.client.1.smithi102.stdout:3/562: write d2/f6c [282968,18445] 0 2024-09-19T09:02:37.205 INFO:tasks.workunit.client.1.smithi102.stdout:9/409: getdents d1/d2/d3/d1d/d4f/d6d/d81 0 2024-09-19T09:02:37.206 INFO:tasks.workunit.client.1.smithi102.stdout:4/511: rmdir d14/d16/d17/d25/d7c/d80 39 2024-09-19T09:02:37.206 INFO:tasks.workunit.client.1.smithi102.stdout:7/464: dread d1/f1e [0,4194304] 0 2024-09-19T09:02:37.207 INFO:tasks.workunit.client.1.smithi102.stdout:9/410: write d1/f74 [1037132,83741] 0 2024-09-19T09:02:37.208 INFO:tasks.workunit.client.1.smithi102.stdout:2/363: stat d7/ff 0 2024-09-19T09:02:37.211 INFO:tasks.workunit.client.1.smithi102.stdout:0/569: rmdir d3/dd/d10/d15/d22/d37/d39/d44/d54/dbb 0 2024-09-19T09:02:37.213 INFO:tasks.workunit.client.1.smithi102.stdout:8/416: rmdir d0/d10/d21/d39 39 2024-09-19T09:02:37.214 INFO:tasks.workunit.client.1.smithi102.stdout:2/364: dwrite d7/d1a/f26 [0,4194304] 0 2024-09-19T09:02:37.222 INFO:tasks.workunit.client.1.smithi102.stdout:4/512: mkdir d14/d16/d17/d2e/d37/d58/d89/da0 0 2024-09-19T09:02:37.222 INFO:tasks.workunit.client.1.smithi102.stdout:9/411: creat d1/d2/d3/d1d/d4f/f86 x:0 0 0 2024-09-19T09:02:37.223 INFO:tasks.workunit.client.1.smithi102.stdout:9/412: write d1/f5c [585064,40925] 0 2024-09-19T09:02:37.224 INFO:tasks.workunit.client.1.smithi102.stdout:0/570: dwrite d3/dd/d10/d15/d2c/f9b [0,4194304] 0 2024-09-19T09:02:37.224 INFO:tasks.workunit.client.1.smithi102.stdout:4/513: chown d14/d16/d17/d2e/d37/d58/d89/d78/c9c 37 1 2024-09-19T09:02:37.228 INFO:tasks.workunit.client.1.smithi102.stdout:8/417: chown d0/d10/d21/d39 5302111 1 2024-09-19T09:02:37.231 INFO:tasks.workunit.client.1.smithi102.stdout:2/365: symlink d7/d1a/d2b/d31/d51/d6b/l7b 0 2024-09-19T09:02:37.233 INFO:tasks.workunit.client.1.smithi102.stdout:4/514: dwrite d14/d16/d17/d2e/d37/d58/d89/d78/f8b [0,4194304] 0 2024-09-19T09:02:37.234 INFO:tasks.workunit.client.1.smithi102.stdout:4/515: chown d14/d16/d17/d2e/c83 389242 1 2024-09-19T09:02:37.240 INFO:tasks.workunit.client.1.smithi102.stdout:1/461: rename dd/le to dd/d13/l92 0 2024-09-19T09:02:37.243 INFO:tasks.workunit.client.1.smithi102.stdout:8/418: creat d0/d4f/f81 x:0 0 0 2024-09-19T09:02:37.243 INFO:tasks.workunit.client.1.smithi102.stdout:6/397: write d1/d26/d2e/d45/d47/f75 [793631,39513] 0 2024-09-19T09:02:37.247 INFO:tasks.workunit.client.1.smithi102.stdout:0/571: mknod d3/dd/d10/d15/d22/cbc 0 2024-09-19T09:02:37.250 INFO:tasks.workunit.client.1.smithi102.stdout:2/366: rename d7/d1a/d56/c61 to d7/d1a/d2b/d4e/c7c 0 2024-09-19T09:02:37.250 INFO:tasks.workunit.client.1.smithi102.stdout:2/367: chown d7/d1a/d2b 0 1 2024-09-19T09:02:37.254 INFO:tasks.workunit.client.1.smithi102.stdout:7/465: getdents d1/d4 0 2024-09-19T09:02:37.254 INFO:tasks.workunit.client.1.smithi102.stdout:7/466: chown d1/d3/d20/f35 383765 1 2024-09-19T09:02:37.255 INFO:tasks.workunit.client.1.smithi102.stdout:7/467: write d1/d3/f64 [429948,49485] 0 2024-09-19T09:02:37.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:36 smithi102 ceph-mon[35280]: pgmap v25: 65 pgs: 65 active+clean; 816 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 99 MiB/s wr, 307 op/s 2024-09-19T09:02:37.260 INFO:tasks.workunit.client.1.smithi102.stdout:4/516: rename d14/d16/d17/d25/f33 to d14/d16/d17/d25/d7c/d80/d9d/fa1 0 2024-09-19T09:02:37.261 INFO:tasks.workunit.client.1.smithi102.stdout:2/368: symlink d7/d1a/d2b/l7d 0 2024-09-19T09:02:37.261 INFO:tasks.workunit.client.1.smithi102.stdout:7/468: dwrite d1/f8f [0,4194304] 0 2024-09-19T09:02:37.262 INFO:tasks.workunit.client.1.smithi102.stdout:1/462: write dd/f12 [709834,114052] 0 2024-09-19T09:02:37.263 INFO:tasks.workunit.client.1.smithi102.stdout:8/419: mknod d0/d5a/c82 0 2024-09-19T09:02:37.266 INFO:tasks.workunit.client.1.smithi102.stdout:6/398: mknod d1/d26/d2e/d70/c86 0 2024-09-19T09:02:37.268 INFO:tasks.workunit.client.1.smithi102.stdout:0/572: creat d3/dd/d1a/d32/d7f/d99/fbd x:0 0 0 2024-09-19T09:02:37.271 INFO:tasks.workunit.client.1.smithi102.stdout:7/469: dread d1/d3/d34/f66 [0,4194304] 0 2024-09-19T09:02:37.271 INFO:tasks.workunit.client.1.smithi102.stdout:1/463: write dd/d13/d2d/f79 [165130,47891] 0 2024-09-19T09:02:37.271 INFO:tasks.workunit.client.1.smithi102.stdout:2/369: chown d7/d12/d37/f3a 4184591 1 2024-09-19T09:02:37.271 INFO:tasks.workunit.client.1.smithi102.stdout:4/517: dwrite d14/d16/d17/f66 [0,4194304] 0 2024-09-19T09:02:37.275 INFO:tasks.workunit.client.1.smithi102.stdout:8/420: dread d0/d4f/f76 [0,4194304] 0 2024-09-19T09:02:37.275 INFO:tasks.workunit.client.1.smithi102.stdout:4/518: unlink d14/f70 0 2024-09-19T09:02:37.275 INFO:tasks.workunit.client.1.smithi102.stdout:1/464: stat dd/d13/d2d/f3c 0 2024-09-19T09:02:37.276 INFO:tasks.workunit.client.1.smithi102.stdout:8/421: dread - d0/d10/d21/f5b zero size 2024-09-19T09:02:37.276 INFO:tasks.workunit.client.1.smithi102.stdout:6/399: creat d1/d26/d2e/d45/d47/d4d/d3b/f87 x:0 0 0 2024-09-19T09:02:37.279 INFO:tasks.workunit.client.1.smithi102.stdout:0/573: creat d3/dd/d10/d15/d22/d37/d3d/fbe x:0 0 0 2024-09-19T09:02:37.283 INFO:tasks.workunit.client.1.smithi102.stdout:4/519: unlink d14/d16/d17/d2e/d37/d58/d89/l99 0 2024-09-19T09:02:37.284 INFO:tasks.workunit.client.1.smithi102.stdout:6/400: unlink d1/d18/db/l3c 0 2024-09-19T09:02:37.288 INFO:tasks.workunit.client.1.smithi102.stdout:1/465: creat dd/d5f/f93 x:0 0 0 2024-09-19T09:02:37.289 INFO:tasks.workunit.client.1.smithi102.stdout:7/470: write d1/d3/d72/f8b [566876,57465] 0 2024-09-19T09:02:37.291 INFO:tasks.workunit.client.1.smithi102.stdout:6/401: mknod d1/d26/d2e/d70/c88 0 2024-09-19T09:02:37.294 INFO:tasks.workunit.client.1.smithi102.stdout:5/477: sync 2024-09-19T09:02:37.295 INFO:tasks.workunit.client.1.smithi102.stdout:7/471: creat d1/d2d/f97 x:0 0 0 2024-09-19T09:02:37.295 INFO:tasks.workunit.client.1.smithi102.stdout:2/370: dwrite d7/d11/d44/f76 [0,4194304] 0 2024-09-19T09:02:37.297 INFO:tasks.workunit.client.1.smithi102.stdout:8/422: getdents d0/d10/d21/d39/d50 0 2024-09-19T09:02:37.297 INFO:tasks.workunit.client.1.smithi102.stdout:2/371: fsync d7/d12/d37/f3a 0 2024-09-19T09:02:37.298 INFO:tasks.workunit.client.1.smithi102.stdout:6/402: read d1/d18/f24 [582571,46124] 0 2024-09-19T09:02:37.299 INFO:tasks.workunit.client.1.smithi102.stdout:0/574: dread d3/dd/ff [0,4194304] 0 2024-09-19T09:02:37.299 INFO:tasks.workunit.client.1.smithi102.stdout:5/478: symlink d5/d23/d3b/l97 0 2024-09-19T09:02:37.300 INFO:tasks.workunit.client.1.smithi102.stdout:6/403: fsync d1/d18/db/f1f 0 2024-09-19T09:02:37.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:36 smithi049 ceph-mon[28158]: pgmap v25: 65 pgs: 65 active+clean; 816 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 99 MiB/s wr, 307 op/s 2024-09-19T09:02:37.307 INFO:tasks.workunit.client.1.smithi102.stdout:1/466: creat dd/d14/f94 x:0 0 0 2024-09-19T09:02:37.307 INFO:tasks.workunit.client.1.smithi102.stdout:7/472: dwrite d1/d2d/f7b [0,4194304] 0 2024-09-19T09:02:37.307 INFO:tasks.workunit.client.1.smithi102.stdout:8/423: chown d0/db/l32 16 1 2024-09-19T09:02:37.308 INFO:tasks.workunit.client.1.smithi102.stdout:1/467: write dd/d14/d35/d49/d7d/d7f/f8b [182009,118591] 0 2024-09-19T09:02:37.308 INFO:tasks.workunit.client.1.smithi102.stdout:1/468: readlink dd/d13/d2d/l2e 0 2024-09-19T09:02:37.312 INFO:tasks.workunit.client.1.smithi102.stdout:8/424: dread d0/d64/f3c [0,4194304] 0 2024-09-19T09:02:37.314 INFO:tasks.workunit.client.1.smithi102.stdout:5/479: read d5/d7/f19 [3994309,124065] 0 2024-09-19T09:02:37.314 INFO:tasks.workunit.client.1.smithi102.stdout:4/520: dwrite d14/d34/f6e [0,4194304] 0 2024-09-19T09:02:37.315 INFO:tasks.workunit.client.1.smithi102.stdout:0/575: mkdir d3/dd/d10/dbf 0 2024-09-19T09:02:37.316 INFO:tasks.workunit.client.1.smithi102.stdout:4/521: chown d14/d34/f6e 60111 1 2024-09-19T09:02:37.316 INFO:tasks.workunit.client.1.smithi102.stdout:8/425: stat d0/d10/d3a/f66 0 2024-09-19T09:02:37.317 INFO:tasks.workunit.client.1.smithi102.stdout:6/404: mknod d1/c89 0 2024-09-19T09:02:37.319 INFO:tasks.workunit.client.1.smithi102.stdout:7/473: mknod d1/d3/c98 0 2024-09-19T09:02:37.321 INFO:tasks.workunit.client.1.smithi102.stdout:4/522: fsync d14/d16/d17/d2e/d37/d58/d89/d78/f8b 0 2024-09-19T09:02:37.321 INFO:tasks.workunit.client.1.smithi102.stdout:1/469: readlink dd/d13/d3b/l4b 0 2024-09-19T09:02:37.322 INFO:tasks.workunit.client.1.smithi102.stdout:5/480: mknod d5/d7/d1a/d42/c98 0 2024-09-19T09:02:37.323 INFO:tasks.workunit.client.1.smithi102.stdout:8/426: mkdir d0/d10/d21/d39/d50/d63/d83 0 2024-09-19T09:02:37.325 INFO:tasks.workunit.client.1.smithi102.stdout:7/474: stat d1/d3/d34/d4f/f8d 0 2024-09-19T09:02:37.327 INFO:tasks.workunit.client.1.smithi102.stdout:8/427: dread - d0/db/d1d/f7d zero size 2024-09-19T09:02:37.328 INFO:tasks.workunit.client.1.smithi102.stdout:2/372: dwrite d7/ff [0,4194304] 0 2024-09-19T09:02:37.328 INFO:tasks.workunit.client.1.smithi102.stdout:0/576: dwrite f2 [0,4194304] 0 2024-09-19T09:02:37.329 INFO:tasks.workunit.client.1.smithi102.stdout:6/405: rename d1/d18/db/d6d to d1/d26/d2e/d45/d47/d66/d8a 0 2024-09-19T09:02:37.330 INFO:tasks.workunit.client.1.smithi102.stdout:1/470: symlink dd/d7a/d8c/d8e/l95 0 2024-09-19T09:02:37.332 INFO:tasks.workunit.client.1.smithi102.stdout:2/373: write d7/d1a/f49 [194044,73449] 0 2024-09-19T09:02:37.332 INFO:tasks.workunit.client.1.smithi102.stdout:4/523: symlink d14/d16/d17/d2e/d37/d58/la2 0 2024-09-19T09:02:37.335 INFO:tasks.workunit.client.1.smithi102.stdout:2/374: readlink d7/d1a/d2b/d31/d51/d6b/l7b 0 2024-09-19T09:02:37.336 INFO:tasks.workunit.client.1.smithi102.stdout:0/577: write d3/dd/d10/d15/d22/d37/f9a [5147602,108566] 0 2024-09-19T09:02:37.338 INFO:tasks.workunit.client.1.smithi102.stdout:5/481: rename d5/d7/d1a/d42/d4b/f71 to d5/d60/f99 0 2024-09-19T09:02:37.338 INFO:tasks.workunit.client.1.smithi102.stdout:7/475: write d1/d4/d45/d25/f77 [1192311,59618] 0 2024-09-19T09:02:37.339 INFO:tasks.workunit.client.1.smithi102.stdout:1/471: creat dd/d5f/f96 x:0 0 0 2024-09-19T09:02:37.340 INFO:tasks.workunit.client.1.smithi102.stdout:4/524: readlink d14/d16/l2d 0 2024-09-19T09:02:37.340 INFO:tasks.workunit.client.1.smithi102.stdout:6/406: creat d1/d26/d2e/d45/d47/d66/f8b x:0 0 0 2024-09-19T09:02:37.341 INFO:tasks.workunit.client.1.smithi102.stdout:1/472: readlink dd/d7a/d8c/d8e/l95 0 2024-09-19T09:02:37.342 INFO:tasks.workunit.client.1.smithi102.stdout:0/578: chown d3/dd/d10/d15/d22/d37/d39/d44/f6b 128749 1 2024-09-19T09:02:37.342 INFO:tasks.workunit.client.1.smithi102.stdout:7/476: write d1/d4/d45/d25/f8e [1053371,89579] 0 2024-09-19T09:02:37.345 INFO:tasks.workunit.client.1.smithi102.stdout:7/477: chown d1/d4/c28 8019532 1 2024-09-19T09:02:37.345 INFO:tasks.workunit.client.1.smithi102.stdout:8/428: dwrite d0/db/d29/f72 [0,4194304] 0 2024-09-19T09:02:37.346 INFO:tasks.workunit.client.1.smithi102.stdout:2/375: rmdir d7/d1a/d2b/d31/d51/d6b/d72 0 2024-09-19T09:02:37.346 INFO:tasks.workunit.client.1.smithi102.stdout:1/473: symlink dd/d14/d18/l97 0 2024-09-19T09:02:37.351 INFO:tasks.workunit.client.1.smithi102.stdout:4/525: mknod d14/d16/d17/d2e/d37/d58/d89/d78/ca3 0 2024-09-19T09:02:37.354 INFO:tasks.workunit.client.1.smithi102.stdout:7/478: dwrite d1/d4/d45/d25/d52/f58 [0,4194304] 0 2024-09-19T09:02:37.355 INFO:tasks.workunit.client.1.smithi102.stdout:2/376: symlink d7/d1a/d56/l7e 0 2024-09-19T09:02:37.355 INFO:tasks.workunit.client.1.smithi102.stdout:5/482: write d5/f15 [1274002,67200] 0 2024-09-19T09:02:37.356 INFO:tasks.workunit.client.1.smithi102.stdout:3/563: sync 2024-09-19T09:02:37.357 INFO:tasks.workunit.client.1.smithi102.stdout:0/579: mkdir d3/dd/d10/d15/d22/d2a/dba/d8b/dc0 0 2024-09-19T09:02:37.357 INFO:tasks.workunit.client.1.smithi102.stdout:1/474: write dd/d14/d18/f1f [1516492,41834] 0 2024-09-19T09:02:37.359 INFO:tasks.workunit.client.1.smithi102.stdout:5/483: dread - d5/d7/d1a/d42/d75/f76 zero size 2024-09-19T09:02:37.359 INFO:tasks.workunit.client.1.smithi102.stdout:4/526: mknod d14/d16/d1d/d92/ca4 0 2024-09-19T09:02:37.360 INFO:tasks.workunit.client.1.smithi102.stdout:3/564: chown d2/d19/d47/db/d26/d63/d6f/d96/f9e 178 1 2024-09-19T09:02:37.362 INFO:tasks.workunit.client.1.smithi102.stdout:2/377: mkdir d7/d50/d64/d7f 0 2024-09-19T09:02:37.362 INFO:tasks.workunit.client.1.smithi102.stdout:7/479: dwrite d1/d3/d20/f4c [0,4194304] 0 2024-09-19T09:02:37.363 INFO:tasks.workunit.client.1.smithi102.stdout:2/378: chown d7/d12/l2e 84075 1 2024-09-19T09:02:37.363 INFO:tasks.workunit.client.1.smithi102.stdout:5/484: truncate d5/d7/d1a/d37/d39/f8b 144727 0 2024-09-19T09:02:37.366 INFO:tasks.workunit.client.1.smithi102.stdout:1/475: rename dd/f90 to dd/d7a/d8c/d8e/f98 0 2024-09-19T09:02:37.378 INFO:tasks.workunit.client.1.smithi102.stdout:7/480: rmdir d1/d2d 39 2024-09-19T09:02:37.380 INFO:tasks.workunit.client.1.smithi102.stdout:6/407: write d1/d18/f1d [672845,10114] 0 2024-09-19T09:02:37.382 INFO:tasks.workunit.client.1.smithi102.stdout:2/379: chown d7/d1a/d2b/d31/l74 45455 1 2024-09-19T09:02:37.385 INFO:tasks.workunit.client.1.smithi102.stdout:1/476: mkdir dd/d14/d35/d49/d62/d6c/d99 0 2024-09-19T09:02:37.386 INFO:tasks.workunit.client.1.smithi102.stdout:8/429: getdents d0/d10/d21/d39/d50/d63 0 2024-09-19T09:02:37.388 INFO:tasks.workunit.client.1.smithi102.stdout:3/565: fdatasync d2/d19/d47/f7 0 2024-09-19T09:02:37.388 INFO:tasks.workunit.client.1.smithi102.stdout:3/566: fsync d2/d1e/f4d 0 2024-09-19T09:02:37.390 INFO:tasks.workunit.client.1.smithi102.stdout:7/481: stat d1/d3/d20/d6c/l7a 0 2024-09-19T09:02:37.390 INFO:tasks.workunit.client.1.smithi102.stdout:6/408: readlink d1/d26/d2e/d45/d47/d4d/d35/l71 0 2024-09-19T09:02:37.392 INFO:tasks.workunit.client.1.smithi102.stdout:2/380: unlink d7/d1a/d2b/f33 0 2024-09-19T09:02:37.393 INFO:tasks.workunit.client.1.smithi102.stdout:1/477: rmdir dd/d14/d18 39 2024-09-19T09:02:37.394 INFO:tasks.workunit.client.1.smithi102.stdout:8/430: mkdir d0/db/d84 0 2024-09-19T09:02:37.399 INFO:tasks.workunit.client.1.smithi102.stdout:3/567: rmdir d2/d19/d1c/d2f/d5a/d84 39 2024-09-19T09:02:37.399 INFO:tasks.workunit.client.1.smithi102.stdout:0/580: dwrite d3/dd/d10/f63 [0,4194304] 0 2024-09-19T09:02:37.401 INFO:tasks.workunit.client.1.smithi102.stdout:7/482: symlink d1/d4/d45/d25/l99 0 2024-09-19T09:02:37.401 INFO:tasks.workunit.client.1.smithi102.stdout:0/581: dread - d3/dd/d10/d15/d22/d37/d39/fa5 zero size 2024-09-19T09:02:37.402 INFO:tasks.workunit.client.1.smithi102.stdout:5/485: write d5/d7/d1a/d42/f66 [610234,50122] 0 2024-09-19T09:02:37.402 INFO:tasks.workunit.client.1.smithi102.stdout:0/582: stat d3/f14 0 2024-09-19T09:02:37.403 INFO:tasks.workunit.client.1.smithi102.stdout:7/483: stat d1/d3/d20/f44 0 2024-09-19T09:02:37.404 INFO:tasks.workunit.client.1.smithi102.stdout:6/409: write d1/d26/d2e/d45/d47/d66/d8a/f80 [887361,43039] 0 2024-09-19T09:02:37.404 INFO:tasks.workunit.client.1.smithi102.stdout:5/486: chown d5/d7/d1a/d37/d34/d7f/d91 245803503 1 2024-09-19T09:02:37.405 INFO:tasks.workunit.client.1.smithi102.stdout:7/484: write d1/d2f/f41 [227848,9438] 0 2024-09-19T09:02:37.405 INFO:tasks.workunit.client.1.smithi102.stdout:2/381: rename d7/fc to d7/d1a/d2b/d31/f80 0 2024-09-19T09:02:37.407 INFO:tasks.workunit.client.1.smithi102.stdout:8/431: mknod d0/d4f/c85 0 2024-09-19T09:02:37.410 INFO:tasks.workunit.client.1.smithi102.stdout:4/527: getdents d14/d16/d17/d2e/d37 0 2024-09-19T09:02:37.413 INFO:tasks.workunit.client.1.smithi102.stdout:3/568: write d2/f34 [3827787,37564] 0 2024-09-19T09:02:37.413 INFO:tasks.workunit.client.1.smithi102.stdout:9/413: sync 2024-09-19T09:02:37.414 INFO:tasks.workunit.client.1.smithi102.stdout:0/583: mknod d3/dd/d10/d15/d22/d2a/dba/d8b/cc1 0 2024-09-19T09:02:37.415 INFO:tasks.workunit.client.1.smithi102.stdout:1/478: rename dd/d13/d2d/f79 to dd/d68/f9a 0 2024-09-19T09:02:37.416 INFO:tasks.workunit.client.1.smithi102.stdout:2/382: dwrite f3 [4194304,4194304] 0 2024-09-19T09:02:37.417 INFO:tasks.workunit.client.1.smithi102.stdout:6/410: symlink d1/d26/d4b/l8c 0 2024-09-19T09:02:37.419 INFO:tasks.workunit.client.1.smithi102.stdout:1/479: fsync dd/d13/d3b/f65 0 2024-09-19T09:02:37.420 INFO:tasks.workunit.client.1.smithi102.stdout:2/383: chown d7/d1a/d56 422143 1 2024-09-19T09:02:37.421 INFO:tasks.workunit.client.1.smithi102.stdout:8/432: dwrite d0/d10/f2d [0,4194304] 0 2024-09-19T09:02:37.422 INFO:tasks.workunit.client.1.smithi102.stdout:2/384: chown d7/d12/f6a 8 1 2024-09-19T09:02:37.425 INFO:tasks.workunit.client.1.smithi102.stdout:5/487: rename d5/d7/d1a/d37/d39/d4c/f70 to d5/d23/d3b/d78/f9a 0 2024-09-19T09:02:37.426 INFO:tasks.workunit.client.1.smithi102.stdout:4/528: dread d14/d16/d17/f66 [0,4194304] 0 2024-09-19T09:02:37.426 INFO:tasks.workunit.client.1.smithi102.stdout:0/584: creat d3/dd/d10/d15/d22/d2a/dba/d8b/fc2 x:0 0 0 2024-09-19T09:02:37.426 INFO:tasks.workunit.client.1.smithi102.stdout:7/485: creat d1/d3/d20/f9a x:0 0 0 2024-09-19T09:02:37.427 INFO:tasks.workunit.client.1.smithi102.stdout:9/414: symlink d1/d2/l87 0 2024-09-19T09:02:37.430 INFO:tasks.workunit.client.1.smithi102.stdout:8/433: stat d0/d64/c7f 0 2024-09-19T09:02:37.430 INFO:tasks.workunit.client.1.smithi102.stdout:9/415: write d1/f74 [1314329,70858] 0 2024-09-19T09:02:37.434 INFO:tasks.workunit.client.1.smithi102.stdout:3/569: rename d2/d19/d35/f7c to d2/d1e/d54/fb9 0 2024-09-19T09:02:37.438 INFO:tasks.workunit.client.1.smithi102.stdout:1/480: dwrite dd/d14/d35/d49/f6d [0,4194304] 0 2024-09-19T09:02:37.439 INFO:tasks.workunit.client.1.smithi102.stdout:5/488: rmdir d5/d7/d1a 39 2024-09-19T09:02:37.440 INFO:tasks.workunit.client.1.smithi102.stdout:4/529: dread d14/d34/f6e [0,4194304] 0 2024-09-19T09:02:37.440 INFO:tasks.workunit.client.1.smithi102.stdout:6/411: dwrite d1/d26/d2e/f5f [0,4194304] 0 2024-09-19T09:02:37.443 INFO:tasks.workunit.client.1.smithi102.stdout:9/416: symlink d1/d2/d78/l88 0 2024-09-19T09:02:37.444 INFO:tasks.workunit.client.1.smithi102.stdout:5/489: fsync d5/d23/d3b/f8c 0 2024-09-19T09:02:37.445 INFO:tasks.workunit.client.1.smithi102.stdout:2/385: rename d7/d1a/f26 to d7/d1a/d2b/f81 0 2024-09-19T09:02:37.449 INFO:tasks.workunit.client.1.smithi102.stdout:3/570: stat d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/fa4 0 2024-09-19T09:02:37.450 INFO:tasks.workunit.client.1.smithi102.stdout:3/571: write d2/d19/d1c/d2f/d5a/d84/d4f/fb0 [61281,19723] 0 2024-09-19T09:02:37.453 INFO:tasks.workunit.client.1.smithi102.stdout:8/434: symlink d0/d10/l86 0 2024-09-19T09:02:37.456 INFO:tasks.workunit.client.1.smithi102.stdout:6/412: mkdir d1/d26/d2e/d45/d47/d4d/d3b/d8d 0 2024-09-19T09:02:37.457 INFO:tasks.workunit.client.1.smithi102.stdout:5/490: chown d5/d7/d1a/c2e 19908741 1 2024-09-19T09:02:37.459 INFO:tasks.workunit.client.1.smithi102.stdout:0/585: rename d3/dd/d10/d15/d22/d2a/dba/d8b/fc2 to d3/dd/d10/d15/d22/d82/fc3 0 2024-09-19T09:02:37.460 INFO:tasks.workunit.client.1.smithi102.stdout:0/586: read - d3/dd/d1a/fa6 zero size 2024-09-19T09:02:37.461 INFO:tasks.workunit.client.1.smithi102.stdout:2/386: unlink d7/d11/l29 0 2024-09-19T09:02:37.477 INFO:tasks.workunit.client.1.smithi102.stdout:5/491: stat d5/d7/d1a/d42/d4b/f4f 0 2024-09-19T09:02:37.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/417: link d1/d2/d7b/f6b d1/d2/d78/f89 0 2024-09-19T09:02:37.478 INFO:tasks.workunit.client.1.smithi102.stdout:4/530: dread d14/d16/d17/d25/f4b [0,4194304] 0 2024-09-19T09:02:37.480 INFO:tasks.workunit.client.1.smithi102.stdout:2/387: creat d7/d1a/d2b/f82 x:0 0 0 2024-09-19T09:02:37.480 INFO:tasks.workunit.client.1.smithi102.stdout:5/492: fsync d5/d7/d1a/f88 0 2024-09-19T09:02:37.480 INFO:tasks.workunit.client.1.smithi102.stdout:6/413: mkdir d1/d18/db/d65/d8e 0 2024-09-19T09:02:37.480 INFO:tasks.workunit.client.1.smithi102.stdout:7/486: link d1/d2f/f82 d1/d2d/f9b 0 2024-09-19T09:02:37.487 INFO:tasks.workunit.client.1.smithi102.stdout:0/587: rename d3/dd/d10/d15/c67 to d3/dd/d72/d98/cc4 0 2024-09-19T09:02:37.488 INFO:tasks.workunit.client.1.smithi102.stdout:1/481: link dd/l4c dd/d13/d2d/l9b 0 2024-09-19T09:02:37.490 INFO:tasks.workunit.client.1.smithi102.stdout:4/531: symlink d14/d16/d17/d25/d2f/la5 0 2024-09-19T09:02:37.490 INFO:tasks.workunit.client.1.smithi102.stdout:9/418: truncate d1/d2/d3/f38 831079 0 2024-09-19T09:02:37.492 INFO:tasks.workunit.client.1.smithi102.stdout:7/487: rmdir d1/d3/d20/d6c 39 2024-09-19T09:02:37.492 INFO:tasks.workunit.client.1.smithi102.stdout:3/572: dwrite d2/d19/d47/db/f25 [0,4194304] 0 2024-09-19T09:02:37.492 INFO:tasks.workunit.client.1.smithi102.stdout:0/588: chown d3/dd/d10/d15/d22/d37/l68 1 1 2024-09-19T09:02:37.494 INFO:tasks.workunit.client.1.smithi102.stdout:7/488: chown d1/d3/d20/l5f 30 1 2024-09-19T09:02:37.495 INFO:tasks.workunit.client.1.smithi102.stdout:1/482: creat dd/d14/d35/d49/d62/d6c/f9c x:0 0 0 2024-09-19T09:02:37.496 INFO:tasks.workunit.client.1.smithi102.stdout:1/483: dread - dd/d13/f56 zero size 2024-09-19T09:02:37.497 INFO:tasks.workunit.client.1.smithi102.stdout:7/489: read d1/d4/f21 [3026867,41213] 0 2024-09-19T09:02:37.497 INFO:tasks.workunit.client.1.smithi102.stdout:9/419: fdatasync d1/d2/d3/fa 0 2024-09-19T09:02:37.499 INFO:tasks.workunit.client.1.smithi102.stdout:4/532: unlink d14/d16/d17/d2e/c4c 0 2024-09-19T09:02:37.499 INFO:tasks.workunit.client.1.smithi102.stdout:9/420: dread - d1/d8/f56 zero size 2024-09-19T09:02:37.502 INFO:tasks.workunit.client.1.smithi102.stdout:2/388: dread d7/f10 [0,4194304] 0 2024-09-19T09:02:37.503 INFO:tasks.workunit.client.1.smithi102.stdout:0/589: mkdir d3/dd/d1a/d32/d7f/dc5 0 2024-09-19T09:02:37.509 INFO:tasks.workunit.client.1.smithi102.stdout:3/573: mknod d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/cba 0 2024-09-19T09:02:37.510 INFO:tasks.workunit.client.1.smithi102.stdout:6/414: dread d1/d26/d2e/d45/d47/d4d/d35/f39 [0,4194304] 0 2024-09-19T09:02:37.512 INFO:tasks.workunit.client.1.smithi102.stdout:7/490: rename d1/d4/d45 to d1/d4/d9c 0 2024-09-19T09:02:37.515 INFO:tasks.workunit.client.1.smithi102.stdout:3/574: dwrite d2/d19/d47/db/d8b/f94 [0,4194304] 0 2024-09-19T09:02:37.517 INFO:tasks.workunit.client.1.smithi102.stdout:4/533: rename d14/d16/d17/d25 to d14/d16/d17/d2e/d37/d58/d89/da6 0 2024-09-19T09:02:37.519 INFO:tasks.workunit.client.1.smithi102.stdout:4/534: chown d14/d34/d5a/d5c/d79/d8c/f9e 54 1 2024-09-19T09:02:37.519 INFO:tasks.workunit.client.1.smithi102.stdout:1/484: dwrite dd/d68/f9a [0,4194304] 0 2024-09-19T09:02:37.524 INFO:tasks.workunit.client.1.smithi102.stdout:3/575: dwrite d2/d1e/fac [0,4194304] 0 2024-09-19T09:02:37.525 INFO:tasks.workunit.client.1.smithi102.stdout:0/590: dread d3/dd/d10/d15/d2c/f59 [0,4194304] 0 2024-09-19T09:02:37.526 INFO:tasks.workunit.client.1.smithi102.stdout:9/421: symlink d1/d2/d3/l8a 0 2024-09-19T09:02:37.526 INFO:tasks.workunit.client.1.smithi102.stdout:3/576: stat d2/d19/d1c/d2f/d5a/d84/f91 0 2024-09-19T09:02:37.534 INFO:tasks.workunit.client.1.smithi102.stdout:2/389: rename d7/d11/d44 to d7/d50/d64/d7f/d83 0 2024-09-19T09:02:37.534 INFO:tasks.workunit.client.1.smithi102.stdout:3/577: dwrite d2/d19/d47/db/d26/d63/d6f/f8e [0,4194304] 0 2024-09-19T09:02:37.536 INFO:tasks.workunit.client.1.smithi102.stdout:2/390: chown d7/d1a/d2b/d31/d51/d6b/l79 196 1 2024-09-19T09:02:37.537 INFO:tasks.workunit.client.1.smithi102.stdout:1/485: readlink dd/d14/l32 0 2024-09-19T09:02:37.540 INFO:tasks.workunit.client.1.smithi102.stdout:1/486: truncate dd/d7a/d8c/d8e/f98 1328436 0 2024-09-19T09:02:37.540 INFO:tasks.workunit.client.1.smithi102.stdout:6/415: link d1/d26/d2e/d45/d47/d4d/f4c d1/d26/d2e/d45/d47/d66/d8a/f8f 0 2024-09-19T09:02:37.541 INFO:tasks.workunit.client.1.smithi102.stdout:4/535: truncate d14/d16/d17/d2e/d37/f3e 3853679 0 2024-09-19T09:02:37.542 INFO:tasks.workunit.client.1.smithi102.stdout:0/591: creat d3/dd/d10/d15/d22/d4a/d80/fc6 x:0 0 0 2024-09-19T09:02:37.547 INFO:tasks.workunit.client.1.smithi102.stdout:2/391: stat d7/d1a/d2b/d31/d51/d6b/l6d 0 2024-09-19T09:02:37.550 INFO:tasks.workunit.client.1.smithi102.stdout:1/487: dwrite dd/d14/d35/d49/d62/d6c/f8f [0,4194304] 0 2024-09-19T09:02:37.550 INFO:tasks.workunit.client.1.smithi102.stdout:7/491: creat d1/d3/d20/f9d x:0 0 0 2024-09-19T09:02:37.551 INFO:tasks.workunit.client.1.smithi102.stdout:9/422: dread d1/f2f [0,4194304] 0 2024-09-19T09:02:37.552 INFO:tasks.workunit.client.1.smithi102.stdout:0/592: fsync d3/dd/d10/d15/d19/f26 0 2024-09-19T09:02:37.552 INFO:tasks.workunit.client.1.smithi102.stdout:7/492: truncate d1/d3/d20/f9a 36283 0 2024-09-19T09:02:37.557 INFO:tasks.workunit.client.1.smithi102.stdout:2/392: symlink d7/d1a/d2b/d31/l84 0 2024-09-19T09:02:37.558 INFO:tasks.workunit.client.1.smithi102.stdout:0/593: read d3/dd/d1a/d32/d62/f97 [11377,66669] 0 2024-09-19T09:02:37.559 INFO:tasks.workunit.client.1.smithi102.stdout:0/594: chown d3/dd/ff 26050 1 2024-09-19T09:02:37.563 INFO:tasks.workunit.client.1.smithi102.stdout:7/493: symlink d1/d2f/l9e 0 2024-09-19T09:02:37.563 INFO:tasks.workunit.client.1.smithi102.stdout:6/416: creat d1/d18/db/f90 x:0 0 0 2024-09-19T09:02:37.565 INFO:tasks.workunit.client.1.smithi102.stdout:7/494: write d1/d4/d9c/d25/d52/f58 [2789712,114245] 0 2024-09-19T09:02:37.565 INFO:tasks.workunit.client.1.smithi102.stdout:0/595: mkdir d3/dc7 0 2024-09-19T09:02:37.567 INFO:tasks.workunit.client.1.smithi102.stdout:6/417: chown d1/d26/d2e/d45/d47/d4d/l68 517204 1 2024-09-19T09:02:37.567 INFO:tasks.workunit.client.1.smithi102.stdout:0/596: chown d3/dd/d10/d15/d22/d4a/d80/fc6 204153 1 2024-09-19T09:02:37.572 INFO:tasks.workunit.client.1.smithi102.stdout:2/393: dread d7/d1a/d2b/d31/f3e [0,4194304] 0 2024-09-19T09:02:37.573 INFO:tasks.workunit.client.1.smithi102.stdout:3/578: dread d2/d19/f28 [0,4194304] 0 2024-09-19T09:02:37.575 INFO:tasks.workunit.client.1.smithi102.stdout:3/579: write d2/d19/d47/db/f44 [4748499,35126] 0 2024-09-19T09:02:37.575 INFO:tasks.workunit.client.1.smithi102.stdout:0/597: rename d3/dd/d10/d15/d19/c61 to d3/dd/d10/d15/d22/d37/da1/cc8 0 2024-09-19T09:02:37.576 INFO:tasks.workunit.client.1.smithi102.stdout:1/488: link dd/d66/c76 dd/d14/d35/c9d 0 2024-09-19T09:02:37.577 INFO:tasks.workunit.client.1.smithi102.stdout:9/423: link d1/d2/d3/c71 d1/d8/c8b 0 2024-09-19T09:02:37.578 INFO:tasks.workunit.client.1.smithi102.stdout:9/424: dread - d1/f45 zero size 2024-09-19T09:02:37.581 INFO:tasks.workunit.client.1.smithi102.stdout:7/495: dread d1/d2d/f54 [0,4194304] 0 2024-09-19T09:02:37.586 INFO:tasks.workunit.client.1.smithi102.stdout:1/489: mkdir dd/d14/d35/d49/d62/d9e 0 2024-09-19T09:02:37.587 INFO:tasks.workunit.client.1.smithi102.stdout:6/418: symlink d1/d26/d2e/d45/d47/d4d/d35/d79/l91 0 2024-09-19T09:02:37.587 INFO:tasks.workunit.client.1.smithi102.stdout:4/536: truncate d14/d16/d17/d2e/d37/f3e 2078218 0 2024-09-19T09:02:37.587 INFO:tasks.workunit.client.1.smithi102.stdout:4/537: dread - d14/d34/d5a/d5c/f87 zero size 2024-09-19T09:02:37.589 INFO:tasks.workunit.client.1.smithi102.stdout:0/598: rename d3/dd/d5b/c86 to d3/dd/d10/d15/d2c/cc9 0 2024-09-19T09:02:37.592 INFO:tasks.workunit.client.1.smithi102.stdout:1/490: symlink dd/d14/d35/d49/d62/d6c/l9f 0 2024-09-19T09:02:37.594 INFO:tasks.workunit.client.1.smithi102.stdout:9/425: dread d1/d2/d3/d6f/f80 [0,4194304] 0 2024-09-19T09:02:37.597 INFO:tasks.workunit.client.1.smithi102.stdout:7/496: link d1/d3/d20/c22 d1/d3/d34/d74/c9f 0 2024-09-19T09:02:37.598 INFO:tasks.workunit.client.1.smithi102.stdout:7/497: stat d1/d3/d72/l90 0 2024-09-19T09:02:37.598 INFO:tasks.workunit.client.1.smithi102.stdout:7/498: fsync d1/d4/d9c/d25/f87 0 2024-09-19T09:02:37.598 INFO:tasks.workunit.client.1.smithi102.stdout:6/419: creat d1/d26/d2e/d45/d47/d4d/d3b/d8d/f92 x:0 0 0 2024-09-19T09:02:37.599 INFO:tasks.workunit.client.1.smithi102.stdout:2/394: truncate d7/d1a/d2b/d31/f80 4234116 0 2024-09-19T09:02:37.603 INFO:tasks.workunit.client.1.smithi102.stdout:0/599: symlink d3/dd/lca 0 2024-09-19T09:02:37.603 INFO:tasks.workunit.client.1.smithi102.stdout:4/538: symlink d14/d16/d17/d2e/d37/d58/d89/da6/d7c/la7 0 2024-09-19T09:02:37.604 INFO:tasks.workunit.client.1.smithi102.stdout:6/420: dwrite d1/d18/f25 [0,4194304] 0 2024-09-19T09:02:37.607 INFO:tasks.workunit.client.1.smithi102.stdout:9/426: mknod d1/d2/d3/d1d/d4f/d6d/c8c 0 2024-09-19T09:02:37.607 INFO:tasks.workunit.client.1.smithi102.stdout:7/499: truncate d1/d4/f6 3153068 0 2024-09-19T09:02:37.612 INFO:tasks.workunit.client.1.smithi102.stdout:9/427: dwrite d1/d2/d3/f12 [4194304,4194304] 0 2024-09-19T09:02:37.614 INFO:tasks.workunit.client.1.smithi102.stdout:0/600: rename d3/dd/d10/d15/d2c/f56 to d3/dd/d5b/fcb 0 2024-09-19T09:02:37.614 INFO:tasks.workunit.client.1.smithi102.stdout:1/491: write dd/d14/d35/f48 [1834947,18761] 0 2024-09-19T09:02:37.618 INFO:tasks.workunit.client.1.smithi102.stdout:1/492: fdatasync dd/d13/d3b/f6a 0 2024-09-19T09:02:37.619 INFO:tasks.workunit.client.1.smithi102.stdout:1/493: dread - dd/d13/f56 zero size 2024-09-19T09:02:37.621 INFO:tasks.workunit.client.1.smithi102.stdout:9/428: dwrite d1/d8/d1c/f19 [0,4194304] 0 2024-09-19T09:02:37.624 INFO:tasks.workunit.client.1.smithi102.stdout:6/421: mknod d1/d18/db/d65/d8e/c93 0 2024-09-19T09:02:37.631 INFO:tasks.workunit.client.1.smithi102.stdout:7/500: symlink d1/d3/la0 0 2024-09-19T09:02:37.632 INFO:tasks.workunit.client.1.smithi102.stdout:1/494: mkdir dd/d7a/da0 0 2024-09-19T09:02:37.633 INFO:tasks.workunit.client.1.smithi102.stdout:9/429: mkdir d1/d2/d3/d6f/d8d 0 2024-09-19T09:02:37.634 INFO:tasks.workunit.client.1.smithi102.stdout:4/539: chown d14/d16/d17/d2e/d37/f3e 294 1 2024-09-19T09:02:37.636 INFO:tasks.workunit.client.1.smithi102.stdout:0/601: symlink d3/dd/d10/d15/da2/lcc 0 2024-09-19T09:02:37.637 INFO:tasks.workunit.client.1.smithi102.stdout:0/602: write d3/dd/d10/d15/d22/d4a/d80/fb5 [953308,100706] 0 2024-09-19T09:02:37.638 INFO:tasks.workunit.client.1.smithi102.stdout:6/422: rename d1/d26/d2e/d45/d47/d66 to d1/d26/d4b/d94 0 2024-09-19T09:02:37.639 INFO:tasks.workunit.client.1.smithi102.stdout:2/395: getdents d7/d50/d64/d7f 0 2024-09-19T09:02:37.639 INFO:tasks.workunit.client.1.smithi102.stdout:0/603: write d3/dd/d10/d15/d19/fb3 [493233,69444] 0 2024-09-19T09:02:37.640 INFO:tasks.workunit.client.1.smithi102.stdout:7/501: mknod d1/d4/d9c/d25/d52/ca1 0 2024-09-19T09:02:37.641 INFO:tasks.workunit.client.1.smithi102.stdout:1/495: mknod dd/d66/ca1 0 2024-09-19T09:02:37.642 INFO:tasks.workunit.client.1.smithi102.stdout:9/430: symlink d1/d2/d78/l8e 0 2024-09-19T09:02:37.644 INFO:tasks.workunit.client.1.smithi102.stdout:4/540: chown d14/f15 209555 1 2024-09-19T09:02:37.644 INFO:tasks.workunit.client.1.smithi102.stdout:1/496: write dd/d14/d35/d49/d62/d6c/f8d [683613,99112] 0 2024-09-19T09:02:37.645 INFO:tasks.workunit.client.1.smithi102.stdout:4/541: readlink d14/l1a 0 2024-09-19T09:02:37.646 INFO:tasks.workunit.client.1.smithi102.stdout:2/396: dwrite d7/ff [4194304,4194304] 0 2024-09-19T09:02:37.646 INFO:tasks.workunit.client.1.smithi102.stdout:4/542: chown d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80 2 1 2024-09-19T09:02:37.648 INFO:tasks.workunit.client.1.smithi102.stdout:2/397: write d7/d50/d64/d7f/d83/f75 [485336,119801] 0 2024-09-19T09:02:37.648 INFO:tasks.workunit.client.1.smithi102.stdout:4/543: chown d14/d16/d17/d2e/d37/d58 20824 1 2024-09-19T09:02:37.649 INFO:tasks.workunit.client.1.smithi102.stdout:7/502: mkdir d1/d2f/da2 0 2024-09-19T09:02:37.649 INFO:tasks.workunit.client.1.smithi102.stdout:2/398: dread - d7/d1a/d2b/d4e/f67 zero size 2024-09-19T09:02:37.650 INFO:tasks.workunit.client.1.smithi102.stdout:0/604: mkdir d3/dd/d10/d15/d22/d37/d39/d44/d54/dcd 0 2024-09-19T09:02:37.652 INFO:tasks.workunit.client.1.smithi102.stdout:7/503: write d1/d2d/f54 [3248990,24496] 0 2024-09-19T09:02:37.654 INFO:tasks.workunit.client.1.smithi102.stdout:0/605: dread - d3/dd/d1a/f51 zero size 2024-09-19T09:02:37.655 INFO:tasks.workunit.client.1.smithi102.stdout:2/399: mknod d7/d1a/d3d/c85 0 2024-09-19T09:02:37.656 INFO:tasks.workunit.client.1.smithi102.stdout:6/423: creat d1/d18/f95 x:0 0 0 2024-09-19T09:02:37.657 INFO:tasks.workunit.client.1.smithi102.stdout:2/400: read - d7/d50/d64/f65 zero size 2024-09-19T09:02:37.658 INFO:tasks.workunit.client.1.smithi102.stdout:7/504: write d1/f1e [1988692,96818] 0 2024-09-19T09:02:37.658 INFO:tasks.workunit.client.1.smithi102.stdout:1/497: creat dd/d14/d35/fa2 x:0 0 0 2024-09-19T09:02:37.659 INFO:tasks.workunit.client.1.smithi102.stdout:4/544: creat d14/d16/d17/d2e/d37/d58/d89/da6/fa8 x:0 0 0 2024-09-19T09:02:37.659 INFO:tasks.workunit.client.1.smithi102.stdout:9/431: dwrite d1/d2/ff [4194304,4194304] 0 2024-09-19T09:02:37.660 INFO:tasks.workunit.client.1.smithi102.stdout:9/432: stat d1 0 2024-09-19T09:02:37.662 INFO:tasks.workunit.client.1.smithi102.stdout:2/401: write d7/d1a/d2b/d31/f48 [5415122,55530] 0 2024-09-19T09:02:37.663 INFO:tasks.workunit.client.1.smithi102.stdout:5/493: sync 2024-09-19T09:02:37.663 INFO:tasks.workunit.client.1.smithi102.stdout:8/435: sync 2024-09-19T09:02:37.666 INFO:tasks.workunit.client.1.smithi102.stdout:9/433: unlink d1/d2/d3/f41 0 2024-09-19T09:02:37.668 INFO:tasks.workunit.client.1.smithi102.stdout:2/402: write d7/d50/d64/f65 [779815,103040] 0 2024-09-19T09:02:37.669 INFO:tasks.workunit.client.1.smithi102.stdout:1/498: unlink dd/d14/d18/l97 0 2024-09-19T09:02:37.669 INFO:tasks.workunit.client.1.smithi102.stdout:0/606: dwrite d3/dd/d10/d15/d22/d37/d39/d44/dab/fb2 [0,4194304] 0 2024-09-19T09:02:37.670 INFO:tasks.workunit.client.1.smithi102.stdout:1/499: stat dd/d14/f94 0 2024-09-19T09:02:37.671 INFO:tasks.workunit.client.1.smithi102.stdout:7/505: link d1/d2d/l85 d1/d3/d34/la3 0 2024-09-19T09:02:37.671 INFO:tasks.workunit.client.1.smithi102.stdout:2/403: write d7/d12/f6a [723832,30347] 0 2024-09-19T09:02:37.672 INFO:tasks.workunit.client.1.smithi102.stdout:1/500: write dd/d13/d3b/f6a [542802,80111] 0 2024-09-19T09:02:37.673 INFO:tasks.workunit.client.1.smithi102.stdout:0/607: truncate d3/dd/d5b/fcb 29889 0 2024-09-19T09:02:37.673 INFO:tasks.workunit.client.1.smithi102.stdout:8/436: read d0/db/d1d/f31 [1613176,102760] 0 2024-09-19T09:02:37.674 INFO:tasks.workunit.client.1.smithi102.stdout:7/506: write d1/d3/d72/f75 [4794348,106025] 0 2024-09-19T09:02:37.674 INFO:tasks.workunit.client.1.smithi102.stdout:2/404: write d7/d12/f5d [3709917,109691] 0 2024-09-19T09:02:37.683 INFO:tasks.workunit.client.1.smithi102.stdout:1/501: dwrite dd/f12 [0,4194304] 0 2024-09-19T09:02:37.684 INFO:tasks.workunit.client.1.smithi102.stdout:7/507: dwrite d1/d2f/f41 [0,4194304] 0 2024-09-19T09:02:37.684 INFO:tasks.workunit.client.1.smithi102.stdout:1/502: readlink dd/d14/d18/l1e 0 2024-09-19T09:02:37.687 INFO:tasks.workunit.client.1.smithi102.stdout:0/608: creat d3/dd/d1a/d77/fce x:0 0 0 2024-09-19T09:02:37.689 INFO:tasks.workunit.client.1.smithi102.stdout:2/405: mknod d7/d12/c86 0 2024-09-19T09:02:37.691 INFO:tasks.workunit.client.1.smithi102.stdout:0/609: chown d3/dd/d1a/d32/d62/l7d 5231 1 2024-09-19T09:02:37.694 INFO:tasks.workunit.client.1.smithi102.stdout:7/508: dread d1/d2f/f4a [4194304,4194304] 0 2024-09-19T09:02:37.694 INFO:tasks.workunit.client.1.smithi102.stdout:5/494: creat d5/d7/d1a/d37/d39/d4c/f9b x:0 0 0 2024-09-19T09:02:37.695 INFO:tasks.workunit.client.1.smithi102.stdout:1/503: rmdir dd/d7a/d8c/d8e 39 2024-09-19T09:02:37.696 INFO:tasks.workunit.client.1.smithi102.stdout:1/504: chown dd/f1d 11469173 1 2024-09-19T09:02:37.698 INFO:tasks.workunit.client.1.smithi102.stdout:2/406: rmdir d7/d11 39 2024-09-19T09:02:37.700 INFO:tasks.workunit.client.1.smithi102.stdout:4/545: link d14/d16/d17/d2e/d37/f65 d14/d34/d5a/d5c/d79/d8c/fa9 0 2024-09-19T09:02:37.701 INFO:tasks.workunit.client.1.smithi102.stdout:0/610: mkdir d3/dcf 0 2024-09-19T09:02:37.702 INFO:tasks.workunit.client.1.smithi102.stdout:9/434: write d1/d2/d3/d1d/f20 [6063858,93873] 0 2024-09-19T09:02:37.702 INFO:tasks.workunit.client.1.smithi102.stdout:5/495: dwrite d5/d7/d1a/d42/f44 [0,4194304] 0 2024-09-19T09:02:37.704 INFO:tasks.workunit.client.1.smithi102.stdout:8/437: dread d0/d10/d21/d39/f3d [0,4194304] 0 2024-09-19T09:02:37.705 INFO:tasks.workunit.client.1.smithi102.stdout:1/505: dwrite dd/d13/d3b/f65 [0,4194304] 0 2024-09-19T09:02:37.708 INFO:tasks.workunit.client.1.smithi102.stdout:5/496: write d5/d7/d1a/f74 [241490,100604] 0 2024-09-19T09:02:37.713 INFO:tasks.workunit.client.1.smithi102.stdout:0/611: fsync d3/dd/d10/d15/f36 0 2024-09-19T09:02:37.713 INFO:tasks.workunit.client.1.smithi102.stdout:9/435: readlink d1/d2/d3/l16 0 2024-09-19T09:02:37.713 INFO:tasks.workunit.client.1.smithi102.stdout:4/546: creat d14/d16/d17/d2e/d37/d58/d89/da6/d2f/faa x:0 0 0 2024-09-19T09:02:37.716 INFO:tasks.workunit.client.1.smithi102.stdout:9/436: dread d1/d2/d3/d6f/f80 [4194304,4194304] 0 2024-09-19T09:02:37.716 INFO:tasks.workunit.client.1.smithi102.stdout:4/547: readlink d14/d16/d17/d2e/d37/d58/d89/da6/l52 0 2024-09-19T09:02:37.718 INFO:tasks.workunit.client.1.smithi102.stdout:9/437: write d1/d2/d3/d1d/d4f/f5a [55771,35862] 0 2024-09-19T09:02:37.719 INFO:tasks.workunit.client.1.smithi102.stdout:0/612: creat d3/dd/d10/d15/d22/d4a/fd0 x:0 0 0 2024-09-19T09:02:37.725 INFO:tasks.workunit.client.1.smithi102.stdout:0/613: dwrite d3/dd/f7c [0,4194304] 0 2024-09-19T09:02:37.726 INFO:tasks.workunit.client.1.smithi102.stdout:8/438: getdents d0/d10 0 2024-09-19T09:02:37.728 INFO:tasks.workunit.client.1.smithi102.stdout:4/548: creat d14/d16/d1d/fab x:0 0 0 2024-09-19T09:02:37.731 INFO:tasks.workunit.client.1.smithi102.stdout:0/614: mknod d3/dd/d72/cd1 0 2024-09-19T09:02:37.732 INFO:tasks.workunit.client.1.smithi102.stdout:5/497: write d5/d7/d1a/d37/d39/f40 [527828,76752] 0 2024-09-19T09:02:37.733 INFO:tasks.workunit.client.1.smithi102.stdout:4/549: mknod d14/d16/d17/cac 0 2024-09-19T09:02:37.735 INFO:tasks.workunit.client.1.smithi102.stdout:2/407: dread f3 [0,4194304] 0 2024-09-19T09:02:37.736 INFO:tasks.workunit.client.1.smithi102.stdout:5/498: chown d5/d7/d1a/c3e 2319 1 2024-09-19T09:02:37.737 INFO:tasks.workunit.client.1.smithi102.stdout:1/506: dread dd/d5f/f7c [0,4194304] 0 2024-09-19T09:02:37.737 INFO:tasks.workunit.client.1.smithi102.stdout:4/550: unlink d14/d16/d1d/fab 0 2024-09-19T09:02:37.740 INFO:tasks.workunit.client.1.smithi102.stdout:1/507: write dd/d14/d18/f40 [4745924,137] 0 2024-09-19T09:02:37.740 INFO:tasks.workunit.client.1.smithi102.stdout:2/408: symlink d7/d12/d37/l87 0 2024-09-19T09:02:37.741 INFO:tasks.workunit.client.1.smithi102.stdout:8/439: dwrite d0/d10/d21/f25 [0,4194304] 0 2024-09-19T09:02:37.742 INFO:tasks.workunit.client.1.smithi102.stdout:5/499: mkdir d5/d7/d1a/d37/d34/d4d/d9c 0 2024-09-19T09:02:37.744 INFO:tasks.workunit.client.1.smithi102.stdout:8/440: write d0/db/d29/f72 [5866323,64307] 0 2024-09-19T09:02:37.744 INFO:tasks.workunit.client.1.smithi102.stdout:0/615: link d3/dd/f21 d3/dd/d10/d15/d22/d37/d39/d44/d54/fd2 0 2024-09-19T09:02:37.745 INFO:tasks.workunit.client.1.smithi102.stdout:4/551: unlink d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f36 0 2024-09-19T09:02:37.746 INFO:tasks.workunit.client.1.smithi102.stdout:9/438: dread d1/d2/d3/fa [4194304,4194304] 0 2024-09-19T09:02:37.748 INFO:tasks.workunit.client.1.smithi102.stdout:2/409: truncate d7/d11/f43 327640 0 2024-09-19T09:02:37.749 INFO:tasks.workunit.client.1.smithi102.stdout:4/552: write d14/d16/d1d/f86 [3307972,128589] 0 2024-09-19T09:02:37.749 INFO:tasks.workunit.client.1.smithi102.stdout:9/439: chown d1/d8/d1c/f19 53 1 2024-09-19T09:02:37.750 INFO:tasks.workunit.client.1.smithi102.stdout:0/616: mknod d3/dd/d10/d15/d3e/cd3 0 2024-09-19T09:02:37.751 INFO:tasks.workunit.client.1.smithi102.stdout:2/410: truncate d7/d1a/f49 924420 0 2024-09-19T09:02:37.752 INFO:tasks.workunit.client.1.smithi102.stdout:1/508: rename dd/d14/l22 to dd/d13/d2d/d78/la3 0 2024-09-19T09:02:37.753 INFO:tasks.workunit.client.1.smithi102.stdout:1/509: chown dd/d14/f2c 236288 1 2024-09-19T09:02:37.754 INFO:tasks.workunit.client.1.smithi102.stdout:0/617: dread - d3/dd/d10/d15/d22/d37/d39/fa5 zero size 2024-09-19T09:02:37.754 INFO:tasks.workunit.client.1.smithi102.stdout:5/500: dwrite d5/d7/d1a/f74 [0,4194304] 0 2024-09-19T09:02:37.754 INFO:tasks.workunit.client.1.smithi102.stdout:2/411: chown d7/d11/f1e 13 1 2024-09-19T09:02:37.755 INFO:tasks.workunit.client.1.smithi102.stdout:2/412: fdatasync d7/d50/d64/f65 0 2024-09-19T09:02:37.758 INFO:tasks.workunit.client.1.smithi102.stdout:1/510: mknod dd/d5f/ca4 0 2024-09-19T09:02:37.758 INFO:tasks.workunit.client.1.smithi102.stdout:5/501: mkdir d5/d7/d1a/d37/d34/d73/d9d 0 2024-09-19T09:02:37.759 INFO:tasks.workunit.client.1.smithi102.stdout:9/440: dread d1/d2/f37 [0,4194304] 0 2024-09-19T09:02:37.761 INFO:tasks.workunit.client.1.smithi102.stdout:2/413: creat d7/d12/d37/f88 x:0 0 0 2024-09-19T09:02:37.763 INFO:tasks.workunit.client.1.smithi102.stdout:0/618: dwrite d3/dd/fb4 [0,4194304] 0 2024-09-19T09:02:37.765 INFO:tasks.workunit.client.1.smithi102.stdout:5/502: rmdir d5/d8d 39 2024-09-19T09:02:37.769 INFO:tasks.workunit.client.1.smithi102.stdout:4/553: getdents d14/d16/d17/d2e/d37/d58/d89 0 2024-09-19T09:02:37.770 INFO:tasks.workunit.client.1.smithi102.stdout:9/441: rename d1/d2/l87 to d1/d2/d3/d1d/d4f/d6d/l8f 0 2024-09-19T09:02:37.771 INFO:tasks.workunit.client.1.smithi102.stdout:5/503: stat d5/d7/d1a/d37/d39/d4c/d89 0 2024-09-19T09:02:37.772 INFO:tasks.workunit.client.1.smithi102.stdout:9/442: read - d1/f45 zero size 2024-09-19T09:02:37.774 INFO:tasks.workunit.client.1.smithi102.stdout:9/443: dread - d1/d2/f72 zero size 2024-09-19T09:02:37.774 INFO:tasks.workunit.client.1.smithi102.stdout:2/414: dwrite d7/d1a/d2b/d31/d51/f55 [0,4194304] 0 2024-09-19T09:02:37.774 INFO:tasks.workunit.client.1.smithi102.stdout:0/619: dread d3/dd/f7c [0,4194304] 0 2024-09-19T09:02:37.776 INFO:tasks.workunit.client.1.smithi102.stdout:9/444: write d1/d8/d1c/f19 [2410182,89369] 0 2024-09-19T09:02:37.777 INFO:tasks.workunit.client.1.smithi102.stdout:9/445: chown d1/f2f 849178 1 2024-09-19T09:02:37.780 INFO:tasks.workunit.client.1.smithi102.stdout:5/504: creat d5/d7/d1b/f9e x:0 0 0 2024-09-19T09:02:37.788 INFO:tasks.workunit.client.1.smithi102.stdout:9/446: dread - d1/d2/d3/f2c zero size 2024-09-19T09:02:37.789 INFO:tasks.workunit.client.1.smithi102.stdout:3/580: sync 2024-09-19T09:02:37.791 INFO:tasks.workunit.client.1.smithi102.stdout:0/620: dwrite d3/dd/d10/d15/d19/d7e/faf [0,4194304] 0 2024-09-19T09:02:37.791 INFO:tasks.workunit.client.1.smithi102.stdout:8/441: truncate d0/d10/f7c 1953344 0 2024-09-19T09:02:37.792 INFO:tasks.workunit.client.1.smithi102.stdout:5/505: symlink d5/d60/l9f 0 2024-09-19T09:02:37.794 INFO:tasks.workunit.client.1.smithi102.stdout:2/415: rename d7/d1a/l63 to d7/d1a/d2b/d4e/l89 0 2024-09-19T09:02:37.795 INFO:tasks.workunit.client.1.smithi102.stdout:2/416: read - d7/d50/d64/f77 zero size 2024-09-19T09:02:37.796 INFO:tasks.workunit.client.1.smithi102.stdout:1/511: link dd/d14/d18/c81 dd/d14/d35/ca5 0 2024-09-19T09:02:37.797 INFO:tasks.workunit.client.1.smithi102.stdout:9/447: mkdir d1/d2/d3/d1d/d4f/d6d/d81/d90 0 2024-09-19T09:02:37.798 INFO:tasks.workunit.client.1.smithi102.stdout:0/621: fsync d3/dd/ff 0 2024-09-19T09:02:37.801 INFO:tasks.workunit.client.1.smithi102.stdout:0/622: truncate d3/dd/d1a/d32/d7f/d99/fbd 770555 0 2024-09-19T09:02:37.802 INFO:tasks.workunit.client.1.smithi102.stdout:5/506: unlink d5/d7/d1a/d37/d34/f5b 0 2024-09-19T09:02:37.804 INFO:tasks.workunit.client.1.smithi102.stdout:9/448: dwrite d1/d8/f44 [0,4194304] 0 2024-09-19T09:02:37.804 INFO:tasks.workunit.client.1.smithi102.stdout:2/417: creat d7/d50/f8a x:0 0 0 2024-09-19T09:02:37.805 INFO:tasks.workunit.client.1.smithi102.stdout:4/554: write d14/d16/d17/d2e/d37/f3e [2015727,79520] 0 2024-09-19T09:02:37.813 INFO:tasks.workunit.client.1.smithi102.stdout:0/623: mkdir d3/dd/d10/d15/d22/d37/d39/d44/d54/dd4 0 2024-09-19T09:02:37.817 INFO:tasks.workunit.client.1.smithi102.stdout:5/507: creat d5/d7/d1a/d42/fa0 x:0 0 0 2024-09-19T09:02:37.817 INFO:tasks.workunit.client.1.smithi102.stdout:5/508: readlink d5/l30 0 2024-09-19T09:02:37.817 INFO:tasks.workunit.client.1.smithi102.stdout:9/449: mknod d1/d2/d7b/c91 0 2024-09-19T09:02:37.819 INFO:tasks.workunit.client.1.smithi102.stdout:6/424: sync 2024-09-19T09:02:37.830 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T09:02:37.835 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:02:37.835 INFO:tasks.workunit.client.0.smithi049.stderr:+ make 2024-09-19T09:02:37.845 INFO:tasks.workunit.client.1.smithi102.stdout:1/512: mkdir dd/d7a/d8c/da6 0 2024-09-19T09:02:37.845 INFO:tasks.workunit.client.1.smithi102.stdout:5/509: dread - d5/d7/d1a/f88 zero size 2024-09-19T09:02:37.847 INFO:tasks.workunit.client.1.smithi102.stdout:3/581: truncate d2/d19/d47/fad 3593465 0 2024-09-19T09:02:37.848 INFO:tasks.workunit.client.1.smithi102.stdout:0/624: dwrite d3/dd/d10/d15/d22/d37/d3d/d90/fb0 [0,4194304] 0 2024-09-19T09:02:37.853 INFO:tasks.workunit.client.1.smithi102.stdout:8/442: dread d0/d10/d3a/f66 [4194304,4194304] 0 2024-09-19T09:02:37.854 INFO:tasks.workunit.client.1.smithi102.stdout:0/625: fdatasync d3/dd/d10/d15/d3e/f3f 0 2024-09-19T09:02:37.854 INFO:tasks.workunit.client.1.smithi102.stdout:1/513: creat dd/d13/d2d/d78/fa7 x:0 0 0 2024-09-19T09:02:37.854 INFO:tasks.workunit.client.1.smithi102.stdout:6/425: creat d1/d18/db/d65/f96 x:0 0 0 2024-09-19T09:02:37.854 INFO:tasks.workunit.client.1.smithi102.stdout:9/450: dwrite d1/d2/d3/f77 [0,4194304] 0 2024-09-19T09:02:37.855 INFO:tasks.workunit.client.1.smithi102.stdout:9/451: write d1/d2/d3/f12 [6617316,117184] 0 2024-09-19T09:02:37.856 INFO:tasks.workunit.client.1.smithi102.stdout:9/452: write d1/d2/d3/d1d/d4f/f86 [116781,42830] 0 2024-09-19T09:02:37.857 INFO:tasks.workunit.client.1.smithi102.stdout:9/453: write d1/f74 [486458,36796] 0 2024-09-19T09:02:37.859 INFO:tasks.workunit.client.1.smithi102.stdout:3/582: creat d2/d19/d1c/d2f/d5a/d84/d53/fbb x:0 0 0 2024-09-19T09:02:37.860 INFO:tasks.workunit.client.1.smithi102.stdout:3/583: dread - d2/d19/d47/db/fa1 zero size 2024-09-19T09:02:37.863 INFO:tasks.workunit.client.1.smithi102.stdout:0/626: mknod d3/dd/d10/d15/d3e/cd5 0 2024-09-19T09:02:37.865 INFO:tasks.workunit.client.1.smithi102.stdout:1/514: creat dd/d14/d35/d49/d7d/fa8 x:0 0 0 2024-09-19T09:02:37.866 INFO:tasks.workunit.client.1.smithi102.stdout:1/515: write dd/f10 [2626189,78203] 0 2024-09-19T09:02:37.866 INFO:tasks.workunit.client.1.smithi102.stdout:1/516: chown dd/d14/f2b 85393 1 2024-09-19T09:02:37.869 INFO:tasks.workunit.client.1.smithi102.stdout:9/454: creat d1/d2/d3/d1d/d4f/d6d/d81/f92 x:0 0 0 2024-09-19T09:02:37.871 INFO:tasks.workunit.client.1.smithi102.stdout:5/510: mknod d5/d8d/d95/ca1 0 2024-09-19T09:02:37.872 INFO:tasks.workunit.client.1.smithi102.stdout:6/426: mknod d1/d18/c97 0 2024-09-19T09:02:37.873 INFO:tasks.workunit.client.1.smithi102.stdout:6/427: chown d1/d18/db/l2d 199452 1 2024-09-19T09:02:37.874 INFO:tasks.workunit.client.1.smithi102.stdout:3/584: symlink d2/d19/d1c/d2f/d5a/d84/d4f/lbc 0 2024-09-19T09:02:37.876 INFO:tasks.workunit.client.1.smithi102.stdout:0/627: creat d3/dd/d1a/d32/d7f/fd6 x:0 0 0 2024-09-19T09:02:37.876 INFO:tasks.workunit.client.1.smithi102.stdout:9/455: dwrite d1/f45 [0,4194304] 0 2024-09-19T09:02:37.877 INFO:tasks.workunit.client.1.smithi102.stdout:6/428: write d1/d26/d2e/d45/d47/f75 [493669,96656] 0 2024-09-19T09:02:37.882 INFO:tasks.workunit.client.1.smithi102.stdout:5/511: dwrite d5/d7/d1a/d37/d39/f87 [0,4194304] 0 2024-09-19T09:02:37.882 INFO:tasks.workunit.client.1.smithi102.stdout:6/429: dread - d1/d26/d2e/d45/d47/d4d/d3b/f87 zero size 2024-09-19T09:02:37.883 INFO:tasks.workunit.client.1.smithi102.stdout:0/628: write d3/dd/d1a/d32/d62/f97 [102533,81963] 0 2024-09-19T09:02:37.884 INFO:tasks.workunit.client.1.smithi102.stdout:9/456: creat d1/d2/d3/d1d/d4f/d6d/d81/d90/f93 x:0 0 0 2024-09-19T09:02:37.885 INFO:tasks.workunit.client.1.smithi102.stdout:0/629: fdatasync d3/dd/d10/d15/d22/d4a/fd0 0 2024-09-19T09:02:37.892 INFO:tasks.workunit.client.1.smithi102.stdout:6/430: dwrite d1/d26/d4b/d94/f8b [0,4194304] 0 2024-09-19T09:02:37.900 INFO:tasks.workunit.client.1.smithi102.stdout:6/431: creat d1/d3a/f98 x:0 0 0 2024-09-19T09:02:37.902 INFO:tasks.workunit.client.1.smithi102.stdout:1/517: truncate dd/d14/d35/d49/d7d/d7f/f84 559868 0 2024-09-19T09:02:37.905 INFO:tasks.workunit.client.1.smithi102.stdout:5/512: symlink d5/d7/d1a/d37/d39/d81/la2 0 2024-09-19T09:02:37.906 INFO:tasks.workunit.client.1.smithi102.stdout:3/585: dread d2/f2d [0,4194304] 0 2024-09-19T09:02:37.907 INFO:tasks.workunit.client.1.smithi102.stdout:0/630: mkdir d3/dd/d10/d15/d22/d37/dd7 0 2024-09-19T09:02:37.908 INFO:tasks.workunit.client.1.smithi102.stdout:6/432: dwrite d1/d18/db/f19 [0,4194304] 0 2024-09-19T09:02:37.909 INFO:tasks.workunit.client.1.smithi102.stdout:0/631: chown d3/dd/d1a/d32/d62/l7d 3 1 2024-09-19T09:02:37.911 INFO:tasks.workunit.client.0.smithi049.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T09:02:37.917 INFO:tasks.workunit.client.1.smithi102.stdout:6/433: symlink d1/d26/d4b/d94/d8a/l99 0 2024-09-19T09:02:37.918 INFO:tasks.workunit.client.1.smithi102.stdout:9/457: getdents d1/d2/d3/d1d/d4f/d6d 0 2024-09-19T09:02:37.919 INFO:tasks.workunit.client.1.smithi102.stdout:5/513: dwrite d5/d7/d1b/f1c [4194304,4194304] 0 2024-09-19T09:02:37.920 INFO:tasks.workunit.client.1.smithi102.stdout:3/586: dwrite d2/d19/d1c/d2f/d5a/d84/fb3 [0,4194304] 0 2024-09-19T09:02:37.926 INFO:tasks.workunit.client.1.smithi102.stdout:0/632: symlink d3/dd/d10/d15/d3e/ld8 0 2024-09-19T09:02:37.929 INFO:tasks.workunit.client.1.smithi102.stdout:6/434: creat d1/d26/d2e/d70/f9a x:0 0 0 2024-09-19T09:02:37.930 INFO:tasks.workunit.client.1.smithi102.stdout:0/633: dread d3/dd/d10/d15/d22/d37/d39/d44/dab/fb2 [0,4194304] 0 2024-09-19T09:02:37.931 INFO:tasks.workunit.client.1.smithi102.stdout:1/518: dread f6 [4194304,4194304] 0 2024-09-19T09:02:37.936 INFO:tasks.workunit.client.1.smithi102.stdout:1/519: read dd/f1d [8023939,118807] 0 2024-09-19T09:02:37.936 INFO:tasks.workunit.client.1.smithi102.stdout:1/520: fdatasync fc 0 2024-09-19T09:02:37.941 INFO:tasks.workunit.client.1.smithi102.stdout:5/514: creat d5/d7/d1a/d37/d34/d73/fa3 x:0 0 0 2024-09-19T09:02:37.943 INFO:tasks.workunit.client.1.smithi102.stdout:1/521: dwrite fc [0,4194304] 0 2024-09-19T09:02:37.945 INFO:tasks.workunit.client.1.smithi102.stdout:0/634: dread d3/dd/d10/d15/d3e/f3f [0,4194304] 0 2024-09-19T09:02:37.952 INFO:tasks.workunit.client.1.smithi102.stdout:5/515: dwrite d5/d7/d1a/d37/d50/f52 [0,4194304] 0 2024-09-19T09:02:37.954 INFO:tasks.workunit.client.1.smithi102.stdout:1/522: dwrite dd/d14/d35/d49/d7d/d7f/f8b [0,4194304] 0 2024-09-19T09:02:37.959 INFO:tasks.workunit.client.1.smithi102.stdout:3/587: mknod d2/d19/d1c/cbd 0 2024-09-19T09:02:37.962 INFO:tasks.workunit.client.1.smithi102.stdout:6/435: symlink d1/d18/l9b 0 2024-09-19T09:02:37.974 INFO:tasks.workunit.client.1.smithi102.stdout:7/509: sync 2024-09-19T09:02:37.975 INFO:tasks.workunit.client.1.smithi102.stdout:1/523: creat dd/d14/d35/d49/d62/fa9 x:0 0 0 2024-09-19T09:02:37.978 INFO:tasks.workunit.client.1.smithi102.stdout:9/458: rename d1/d2/d3/l7 to d1/d2/d3/l94 0 2024-09-19T09:02:37.981 INFO:tasks.workunit.client.1.smithi102.stdout:7/510: dwrite d1/d4/d9c/d25/f8e [0,4194304] 0 2024-09-19T09:02:37.981 INFO:tasks.workunit.client.1.smithi102.stdout:3/588: dread d2/d19/d47/f71 [4194304,4194304] 0 2024-09-19T09:02:37.983 INFO:tasks.workunit.client.1.smithi102.stdout:5/516: creat d5/d7/d1a/d37/d39/d4c/d89/fa4 x:0 0 0 2024-09-19T09:02:37.984 INFO:tasks.workunit.client.1.smithi102.stdout:3/589: write d2/d19/d1c/d1f/d5f/f81 [408186,92920] 0 2024-09-19T09:02:37.990 INFO:tasks.workunit.client.1.smithi102.stdout:7/511: dwrite d1/d4/d9c/d25/f94 [0,4194304] 0 2024-09-19T09:02:37.990 INFO:tasks.workunit.client.1.smithi102.stdout:0/635: write d3/dd/d10/d15/d19/f26 [1481801,16461] 0 2024-09-19T09:02:37.991 INFO:tasks.workunit.client.1.smithi102.stdout:5/517: chown d5/d7/d1a/d37/c2c 2705206 1 2024-09-19T09:02:37.993 INFO:tasks.workunit.client.1.smithi102.stdout:5/518: chown d5/d7/d1a/c69 278833 1 2024-09-19T09:02:37.993 INFO:tasks.workunit.client.1.smithi102.stdout:1/524: creat dd/d14/d35/d49/d62/d6c/d99/faa x:0 0 0 2024-09-19T09:02:37.996 INFO:tasks.workunit.client.1.smithi102.stdout:9/459: dread d1/f58 [0,4194304] 0 2024-09-19T09:02:37.997 INFO:tasks.workunit.client.1.smithi102.stdout:9/460: chown d1/d2/d78/l8e 416833 1 2024-09-19T09:02:37.998 INFO:tasks.workunit.client.1.smithi102.stdout:9/461: write d1/d2/d3/f77 [2710342,58230] 0 2024-09-19T09:02:37.999 INFO:tasks.workunit.client.1.smithi102.stdout:9/462: fdatasync d1/d2/d3/d1d/f30 0 2024-09-19T09:02:37.999 INFO:tasks.workunit.client.1.smithi102.stdout:3/590: symlink d2/d19/d47/lbe 0 2024-09-19T09:02:38.000 INFO:tasks.workunit.client.1.smithi102.stdout:1/525: rmdir dd/d13 39 2024-09-19T09:02:38.002 INFO:tasks.workunit.client.1.smithi102.stdout:5/519: symlink d5/d7/d1a/d42/d4b/la5 0 2024-09-19T09:02:38.004 INFO:tasks.workunit.client.1.smithi102.stdout:5/520: dread - d5/d7/d1a/d37/d39/d4c/d89/fa4 zero size 2024-09-19T09:02:38.005 INFO:tasks.workunit.client.1.smithi102.stdout:3/591: dwrite d2/d19/d47/db/d26/f5d [0,4194304] 0 2024-09-19T09:02:38.006 INFO:tasks.workunit.client.1.smithi102.stdout:0/636: mknod d3/dd/d10/d15/d22/d37/dd7/cd9 0 2024-09-19T09:02:38.011 INFO:tasks.workunit.client.1.smithi102.stdout:0/637: dread d3/dd/d10/d15/d22/d4a/d80/fb5 [0,4194304] 0 2024-09-19T09:02:38.011 INFO:tasks.workunit.client.1.smithi102.stdout:9/463: write d1/f58 [1327321,22910] 0 2024-09-19T09:02:38.012 INFO:tasks.workunit.client.1.smithi102.stdout:9/464: readlink d1/d2/d78/l88 0 2024-09-19T09:02:38.016 INFO:tasks.workunit.client.1.smithi102.stdout:5/521: unlink d5/d7/d1a/d37/f84 0 2024-09-19T09:02:38.018 INFO:tasks.workunit.client.1.smithi102.stdout:9/465: dread d1/d2/d3/f77 [0,4194304] 0 2024-09-19T09:02:38.018 INFO:tasks.workunit.client.1.smithi102.stdout:3/592: fsync d2/ff 0 2024-09-19T09:02:38.018 INFO:tasks.workunit.client.1.smithi102.stdout:0/638: dwrite d3/dd/d10/d15/d22/d37/f9a [4194304,4194304] 0 2024-09-19T09:02:38.025 INFO:tasks.workunit.client.1.smithi102.stdout:7/512: truncate d1/d4/f1a 479778 0 2024-09-19T09:02:38.029 INFO:tasks.workunit.client.1.smithi102.stdout:5/522: unlink d5/d7/d1a/d37/d39/f3c 0 2024-09-19T09:02:38.032 INFO:tasks.workunit.client.1.smithi102.stdout:3/593: creat d2/d19/d47/db/d8b/fbf x:0 0 0 2024-09-19T09:02:38.034 INFO:tasks.workunit.client.1.smithi102.stdout:3/594: read d2/d19/d35/f5c [520317,14007] 0 2024-09-19T09:02:38.034 INFO:tasks.workunit.client.1.smithi102.stdout:3/595: dread - d2/d19/d47/db/d8b/fbf zero size 2024-09-19T09:02:38.035 INFO:tasks.workunit.client.1.smithi102.stdout:3/596: stat d2/d19/d35/f41 0 2024-09-19T09:02:38.036 INFO:tasks.workunit.client.1.smithi102.stdout:3/597: write d2/d19/d1c/d2f/d5a/d84/f9a [1478423,34025] 0 2024-09-19T09:02:38.037 INFO:tasks.workunit.client.1.smithi102.stdout:3/598: dread - d2/d19/d47/db/d26/d63/f9b zero size 2024-09-19T09:02:38.040 INFO:tasks.workunit.client.1.smithi102.stdout:5/523: write d5/d60/f99 [434183,46997] 0 2024-09-19T09:02:38.046 INFO:tasks.workunit.client.1.smithi102.stdout:1/526: getdents dd/d68 0 2024-09-19T09:02:38.047 INFO:tasks.workunit.client.1.smithi102.stdout:3/599: symlink d2/d19/d47/db/d26/lc0 0 2024-09-19T09:02:38.049 INFO:tasks.workunit.client.1.smithi102.stdout:5/524: symlink d5/d7/d1a/d42/d4b/la6 0 2024-09-19T09:02:38.050 INFO:tasks.workunit.client.1.smithi102.stdout:5/525: fsync d5/d7/d1a/d37/d50/f57 0 2024-09-19T09:02:38.050 INFO:tasks.workunit.client.1.smithi102.stdout:3/600: dread d2/f6c [0,4194304] 0 2024-09-19T09:02:38.052 INFO:tasks.workunit.client.1.smithi102.stdout:5/526: truncate d5/d7/d1a/d37/d39/d4c/f9b 24471 0 2024-09-19T09:02:38.053 INFO:tasks.workunit.client.1.smithi102.stdout:1/527: write dd/d5f/f7c [1171941,88236] 0 2024-09-19T09:02:38.057 INFO:tasks.workunit.client.1.smithi102.stdout:3/601: dwrite d2/d19/d47/db/d26/d63/d6f/f8e [0,4194304] 0 2024-09-19T09:02:38.067 INFO:tasks.workunit.client.1.smithi102.stdout:3/602: unlink d2/d19/d1c/f31 0 2024-09-19T09:02:38.069 INFO:tasks.workunit.client.1.smithi102.stdout:5/527: symlink d5/d7/d1a/d37/d39/d4c/la7 0 2024-09-19T09:02:38.070 INFO:tasks.workunit.client.1.smithi102.stdout:1/528: mkdir dd/d14/d35/d49/d62/d9e/dab 0 2024-09-19T09:02:38.073 INFO:tasks.workunit.client.1.smithi102.stdout:3/603: creat d2/d19/d1c/d2f/d5a/d84/d64/fc1 x:0 0 0 2024-09-19T09:02:38.074 INFO:tasks.workunit.client.1.smithi102.stdout:9/466: truncate d1/f45 3009888 0 2024-09-19T09:02:38.075 INFO:tasks.workunit.client.1.smithi102.stdout:5/528: creat d5/d7/d1b/fa8 x:0 0 0 2024-09-19T09:02:38.075 INFO:tasks.workunit.client.1.smithi102.stdout:5/529: readlink d5/d7/d1a/d37/d50/l5a 0 2024-09-19T09:02:38.076 INFO:tasks.workunit.client.1.smithi102.stdout:4/555: sync 2024-09-19T09:02:38.076 INFO:tasks.workunit.client.1.smithi102.stdout:2/418: sync 2024-09-19T09:02:38.077 INFO:tasks.workunit.client.1.smithi102.stdout:3/604: fdatasync d2/d19/d47/db/f3c 0 2024-09-19T09:02:38.078 INFO:tasks.workunit.client.1.smithi102.stdout:4/556: dread - d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80/f95 zero size 2024-09-19T09:02:38.079 INFO:tasks.workunit.client.1.smithi102.stdout:9/467: chown d1/d2/d3/l3d 28095 1 2024-09-19T09:02:38.080 INFO:tasks.workunit.client.1.smithi102.stdout:4/557: stat d14/d16/d1d/f50 0 2024-09-19T09:02:38.082 INFO:tasks.workunit.client.1.smithi102.stdout:5/530: dwrite d5/d7/d1a/d37/d39/d4c/f9b [0,4194304] 0 2024-09-19T09:02:38.089 INFO:tasks.workunit.client.1.smithi102.stdout:3/605: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/fc2 x:0 0 0 2024-09-19T09:02:38.090 INFO:tasks.workunit.client.1.smithi102.stdout:9/468: write d1/d2/d3/f77 [469586,39941] 0 2024-09-19T09:02:38.092 INFO:tasks.workunit.client.1.smithi102.stdout:4/558: stat d14/d34/d5a/d5c/d79/d8c/fa9 0 2024-09-19T09:02:38.095 INFO:tasks.workunit.client.1.smithi102.stdout:5/531: creat d5/d7/d1a/d42/fa9 x:0 0 0 2024-09-19T09:02:38.099 INFO:tasks.workunit.client.1.smithi102.stdout:3/606: mkdir d2/d19/d47/db/dc3 0 2024-09-19T09:02:38.099 INFO:tasks.workunit.client.1.smithi102.stdout:5/532: write d5/d7/d1a/d42/d75/f76 [768293,92029] 0 2024-09-19T09:02:38.099 INFO:tasks.workunit.client.1.smithi102.stdout:9/469: dwrite d1/d8/d1c/f62 [0,4194304] 0 2024-09-19T09:02:38.102 INFO:tasks.workunit.client.1.smithi102.stdout:4/559: dwrite d14/d16/d1d/f50 [0,4194304] 0 2024-09-19T09:02:38.106 INFO:tasks.workunit.client.1.smithi102.stdout:2/419: dread d7/d1a/d2b/d31/f80 [0,4194304] 0 2024-09-19T09:02:38.113 INFO:tasks.workunit.client.1.smithi102.stdout:9/470: chown d1/d8/l60 96713753 1 2024-09-19T09:02:38.116 INFO:tasks.workunit.client.1.smithi102.stdout:1/529: truncate dd/d14/d35/d49/d7d/d7f/f8b 410723 0 2024-09-19T09:02:38.123 INFO:tasks.workunit.client.1.smithi102.stdout:2/420: symlink d7/d11/l8b 0 2024-09-19T09:02:38.123 INFO:tasks.workunit.client.1.smithi102.stdout:9/471: dwrite d1/d2/f72 [0,4194304] 0 2024-09-19T09:02:38.123 INFO:tasks.workunit.client.1.smithi102.stdout:4/560: creat d14/d34/d9f/fad x:0 0 0 2024-09-19T09:02:38.124 INFO:tasks.workunit.client.1.smithi102.stdout:1/530: dwrite dd/d14/d35/d49/d7d/fa8 [0,4194304] 0 2024-09-19T09:02:38.129 INFO:tasks.workunit.client.1.smithi102.stdout:2/421: rmdir d7/d50 39 2024-09-19T09:02:38.133 INFO:tasks.workunit.client.1.smithi102.stdout:2/422: dread d7/d1a/d2b/d31/f80 [0,4194304] 0 2024-09-19T09:02:38.142 INFO:tasks.workunit.client.1.smithi102.stdout:2/423: creat d7/d1a/d2b/d31/d51/d6b/f8c x:0 0 0 2024-09-19T09:02:38.143 INFO:tasks.workunit.client.1.smithi102.stdout:4/561: symlink d14/d16/d17/d2e/d37/d58/d89/da0/lae 0 2024-09-19T09:02:38.144 INFO:tasks.workunit.client.1.smithi102.stdout:2/424: read - d7/d1a/d2b/d4e/f67 zero size 2024-09-19T09:02:38.144 INFO:tasks.workunit.client.1.smithi102.stdout:1/531: dwrite dd/d13/f56 [0,4194304] 0 2024-09-19T09:02:38.145 INFO:tasks.workunit.client.1.smithi102.stdout:9/472: creat d1/d2/f95 x:0 0 0 2024-09-19T09:02:38.151 INFO:tasks.workunit.client.1.smithi102.stdout:3/607: dwrite d2/f6c [0,4194304] 0 2024-09-19T09:02:38.152 INFO:tasks.workunit.client.1.smithi102.stdout:2/425: symlink d7/d1a/d56/l8d 0 2024-09-19T09:02:38.154 INFO:tasks.workunit.client.1.smithi102.stdout:1/532: dwrite dd/d13/f56 [0,4194304] 0 2024-09-19T09:02:38.154 INFO:tasks.workunit.client.1.smithi102.stdout:3/608: chown d2/d19/d47/f71 7368 1 2024-09-19T09:02:38.154 INFO:tasks.workunit.client.1.smithi102.stdout:1/533: chown dd/d14/d35/f48 28 1 2024-09-19T09:02:38.161 INFO:tasks.workunit.client.1.smithi102.stdout:9/473: mknod d1/d2/d3/d1d/c96 0 2024-09-19T09:02:38.166 INFO:tasks.workunit.client.1.smithi102.stdout:6/436: sync 2024-09-19T09:02:38.166 INFO:tasks.workunit.client.1.smithi102.stdout:8/443: sync 2024-09-19T09:02:38.170 INFO:tasks.workunit.client.1.smithi102.stdout:2/426: fsync d7/d1a/d2b/d31/d51/d6b/f8c 0 2024-09-19T09:02:38.171 INFO:tasks.workunit.client.1.smithi102.stdout:2/427: write d7/d1a/d2b/d31/d51/f5f [3219804,46570] 0 2024-09-19T09:02:38.172 INFO:tasks.workunit.client.1.smithi102.stdout:2/428: dread - d7/d1a/d2b/d31/d51/d6b/f8c zero size 2024-09-19T09:02:38.174 INFO:tasks.workunit.client.1.smithi102.stdout:9/474: creat d1/d2/d3/d1d/f97 x:0 0 0 2024-09-19T09:02:38.177 INFO:tasks.workunit.client.1.smithi102.stdout:6/437: fdatasync d1/d18/f24 0 2024-09-19T09:02:38.179 INFO:tasks.workunit.client.1.smithi102.stdout:1/534: mkdir dd/d14/dac 0 2024-09-19T09:02:38.180 INFO:tasks.workunit.client.1.smithi102.stdout:1/535: write dd/d14/f4e [3941293,103282] 0 2024-09-19T09:02:38.206 INFO:tasks.workunit.client.1.smithi102.stdout:6/438: creat d1/d26/d2e/d45/d47/d4d/d3b/d8d/f9c x:0 0 0 2024-09-19T09:02:38.206 INFO:tasks.workunit.client.1.smithi102.stdout:3/609: truncate d2/d19/d47/db/d26/f5d 3725229 0 2024-09-19T09:02:38.207 INFO:tasks.workunit.client.1.smithi102.stdout:1/536: mknod dd/d14/d18/cad 0 2024-09-19T09:02:38.207 INFO:tasks.workunit.client.1.smithi102.stdout:6/439: stat d1/d18/db/c20 0 2024-09-19T09:02:38.207 INFO:tasks.workunit.client.1.smithi102.stdout:2/429: write d7/d50/d64/d7f/d83/f76 [557764,77112] 0 2024-09-19T09:02:38.208 INFO:tasks.workunit.client.1.smithi102.stdout:1/537: dread - dd/d5f/f93 zero size 2024-09-19T09:02:38.209 INFO:tasks.workunit.client.1.smithi102.stdout:4/562: getdents d14/d16/d17/d2e/d37/d58/d89/da6/d2f 0 2024-09-19T09:02:38.209 INFO:tasks.workunit.client.1.smithi102.stdout:3/610: write d2/d19/d1c/d2f/d5a/d84/f9a [4849471,81102] 0 2024-09-19T09:02:38.210 INFO:tasks.workunit.client.1.smithi102.stdout:9/475: mkdir d1/d8/d98 0 2024-09-19T09:02:38.213 INFO:tasks.workunit.client.1.smithi102.stdout:9/476: chown d1/d2/d3/d1d/l51 511 1 2024-09-19T09:02:38.213 INFO:tasks.workunit.client.1.smithi102.stdout:3/611: dread - d2/d19/d1c/d2f/d5a/d84/d4f/d72/fa6 zero size 2024-09-19T09:02:38.214 INFO:tasks.workunit.client.1.smithi102.stdout:2/430: rmdir d7/d1a/d2b/d31 39 2024-09-19T09:02:38.215 INFO:tasks.workunit.client.1.smithi102.stdout:9/477: dread - d1/d2/d3/d1d/f6a zero size 2024-09-19T09:02:38.216 INFO:tasks.workunit.client.1.smithi102.stdout:2/431: dread - d7/d1a/d2b/f69 zero size 2024-09-19T09:02:38.216 INFO:tasks.workunit.client.1.smithi102.stdout:6/440: dwrite d1/d18/f6a [0,4194304] 0 2024-09-19T09:02:38.216 INFO:tasks.workunit.client.1.smithi102.stdout:4/563: mknod d14/d34/d5a/d5c/d81/d75/caf 0 2024-09-19T09:02:38.218 INFO:tasks.workunit.client.1.smithi102.stdout:1/538: rename dd/d14/d35/d49/d7d/fa8 to dd/d14/d35/d49/fae 0 2024-09-19T09:02:38.224 INFO:tasks.workunit.client.1.smithi102.stdout:5/533: sync 2024-09-19T09:02:38.224 INFO:tasks.workunit.client.1.smithi102.stdout:0/639: sync 2024-09-19T09:02:38.224 INFO:tasks.workunit.client.1.smithi102.stdout:7/513: sync 2024-09-19T09:02:38.226 INFO:tasks.workunit.client.1.smithi102.stdout:9/478: creat d1/d8/d1c/f99 x:0 0 0 2024-09-19T09:02:38.227 INFO:tasks.workunit.client.1.smithi102.stdout:3/612: dwrite d2/d19/f73 [0,4194304] 0 2024-09-19T09:02:38.228 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:37 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:38.230 INFO:tasks.workunit.client.1.smithi102.stdout:3/613: write d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/faa [110985,130662] 0 2024-09-19T09:02:38.233 INFO:tasks.workunit.client.1.smithi102.stdout:3/614: dread d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f8d [0,4194304] 0 2024-09-19T09:02:38.236 INFO:tasks.workunit.client.1.smithi102.stdout:4/564: dread d14/d34/f6e [0,4194304] 0 2024-09-19T09:02:38.249 INFO:tasks.workunit.client.1.smithi102.stdout:6/441: mknod d1/d18/db/c9d 0 2024-09-19T09:02:38.251 INFO:tasks.workunit.client.1.smithi102.stdout:9/479: rmdir d1/d2/d3 39 2024-09-19T09:02:38.254 INFO:tasks.workunit.client.1.smithi102.stdout:6/442: dwrite d1/fc [0,4194304] 0 2024-09-19T09:02:38.255 INFO:tasks.workunit.client.1.smithi102.stdout:6/443: dread - d1/d18/db/f90 zero size 2024-09-19T09:02:38.256 INFO:tasks.workunit.client.1.smithi102.stdout:6/444: stat d1/d26/d2e/d45/d47/d4d/c3f 0 2024-09-19T09:02:38.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:37 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:38.262 INFO:tasks.workunit.client.1.smithi102.stdout:1/539: getdents dd/d7a/da0 0 2024-09-19T09:02:38.262 INFO:tasks.workunit.client.1.smithi102.stdout:4/565: creat d14/d16/d1d/d48/fb0 x:0 0 0 2024-09-19T09:02:38.263 INFO:tasks.workunit.client.1.smithi102.stdout:2/432: write d7/f10 [3156973,64122] 0 2024-09-19T09:02:38.264 INFO:tasks.workunit.client.1.smithi102.stdout:7/514: symlink d1/la4 0 2024-09-19T09:02:38.265 INFO:tasks.workunit.client.1.smithi102.stdout:7/515: chown d1/d3/d20/l5f 237632532 1 2024-09-19T09:02:38.266 INFO:tasks.workunit.client.1.smithi102.stdout:5/534: mkdir d5/d7/d1a/daa 0 2024-09-19T09:02:38.268 INFO:tasks.workunit.client.1.smithi102.stdout:9/480: read d1/d2/d3/fa [4390432,76793] 0 2024-09-19T09:02:38.269 INFO:tasks.workunit.client.1.smithi102.stdout:2/433: dread d7/d12/f17 [0,4194304] 0 2024-09-19T09:02:38.271 INFO:tasks.workunit.client.1.smithi102.stdout:5/535: chown d5/d7/l18 38926 1 2024-09-19T09:02:38.271 INFO:tasks.workunit.client.1.smithi102.stdout:7/516: dread d1/d4/d9c/d25/f94 [0,4194304] 0 2024-09-19T09:02:38.275 INFO:tasks.workunit.client.1.smithi102.stdout:2/434: creat d7/d11/f8e x:0 0 0 2024-09-19T09:02:38.278 INFO:tasks.workunit.client.1.smithi102.stdout:7/517: mkdir d1/d4/d9c/d25/d52/d7f/da5 0 2024-09-19T09:02:38.279 INFO:tasks.workunit.client.1.smithi102.stdout:5/536: creat d5/d7/d1a/d37/d39/d81/fab x:0 0 0 2024-09-19T09:02:38.281 INFO:tasks.workunit.client.1.smithi102.stdout:4/566: dread d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80/d9d/fa1 [0,4194304] 0 2024-09-19T09:02:38.281 INFO:tasks.workunit.client.1.smithi102.stdout:2/435: creat d7/d1a/f8f x:0 0 0 2024-09-19T09:02:38.281 INFO:tasks.workunit.client.1.smithi102.stdout:4/567: readlink d14/l19 0 2024-09-19T09:02:38.282 INFO:tasks.workunit.client.1.smithi102.stdout:4/568: dread - d14/d16/d17/d2e/d37/d58/d89/da6/d2f/faa zero size 2024-09-19T09:02:38.284 INFO:tasks.workunit.client.1.smithi102.stdout:5/537: mknod d5/d7/d1a/d37/d50/cac 0 2024-09-19T09:02:38.285 INFO:tasks.workunit.client.1.smithi102.stdout:5/538: dread - d5/d7/d1a/d42/d75/f92 zero size 2024-09-19T09:02:38.286 INFO:tasks.workunit.client.1.smithi102.stdout:9/481: link d1/d2/d78/f89 d1/d2/d3/d1d/f9a 0 2024-09-19T09:02:38.287 INFO:tasks.workunit.client.1.smithi102.stdout:4/569: mkdir d14/d16/d1d/d92/db1 0 2024-09-19T09:02:38.288 INFO:tasks.workunit.client.1.smithi102.stdout:2/436: mknod d7/d1a/d2b/c90 0 2024-09-19T09:02:38.290 INFO:tasks.workunit.client.1.smithi102.stdout:8/444: sync 2024-09-19T09:02:38.291 INFO:tasks.workunit.client.1.smithi102.stdout:4/570: creat d14/d34/d5a/d5c/d81/d75/fb2 x:0 0 0 2024-09-19T09:02:38.291 INFO:tasks.workunit.client.1.smithi102.stdout:8/445: dread - d0/d4f/f81 zero size 2024-09-19T09:02:38.292 INFO:tasks.workunit.client.1.smithi102.stdout:0/640: truncate d3/dd/d10/d15/d22/d37/d3d/f48 3158151 0 2024-09-19T09:02:38.293 INFO:tasks.workunit.client.1.smithi102.stdout:2/437: write d7/d1a/d2b/d31/d51/f55 [4612395,115270] 0 2024-09-19T09:02:38.294 INFO:tasks.workunit.client.1.smithi102.stdout:9/482: symlink d1/d8/l9b 0 2024-09-19T09:02:38.294 INFO:tasks.workunit.client.1.smithi102.stdout:7/518: dread d1/d4/d9c/d25/f77 [0,4194304] 0 2024-09-19T09:02:38.294 INFO:tasks.workunit.client.1.smithi102.stdout:2/438: stat d7/d1a/f71 0 2024-09-19T09:02:38.295 INFO:tasks.workunit.client.1.smithi102.stdout:8/446: mkdir d0/d10/d21/d39/d87 0 2024-09-19T09:02:38.296 INFO:tasks.workunit.client.1.smithi102.stdout:1/540: truncate dd/f1d 3752280 0 2024-09-19T09:02:38.296 INFO:tasks.workunit.client.1.smithi102.stdout:8/447: chown d0/d64/c67 15617122 1 2024-09-19T09:02:38.298 INFO:tasks.workunit.client.1.smithi102.stdout:7/519: mknod d1/d4/ca6 0 2024-09-19T09:02:38.299 INFO:tasks.workunit.client.1.smithi102.stdout:7/520: write d1/d4/d9c/d25/d52/f6b [29255,125112] 0 2024-09-19T09:02:38.299 INFO:tasks.workunit.client.1.smithi102.stdout:9/483: unlink d1/d8/d1c/f19 0 2024-09-19T09:02:38.300 INFO:tasks.workunit.client.1.smithi102.stdout:9/484: chown d1/d2/d3/d1d/f20 1105 1 2024-09-19T09:02:38.300 INFO:tasks.workunit.client.1.smithi102.stdout:2/439: symlink d7/d1a/d2b/d31/d51/l91 0 2024-09-19T09:02:38.303 INFO:tasks.workunit.client.1.smithi102.stdout:8/448: unlink d0/d10/d3a/f66 0 2024-09-19T09:02:38.304 INFO:tasks.workunit.client.1.smithi102.stdout:4/571: getdents d14/d34/d5a/d5c/d79 0 2024-09-19T09:02:38.305 INFO:tasks.workunit.client.1.smithi102.stdout:4/572: write d14/d34/d5a/d5c/f84 [2261456,57569] 0 2024-09-19T09:02:38.307 INFO:tasks.workunit.client.1.smithi102.stdout:9/485: dwrite d1/d2/d3/d1d/d4f/d6d/f7c [0,4194304] 0 2024-09-19T09:02:38.312 INFO:tasks.workunit.client.1.smithi102.stdout:0/641: rmdir d3/dd/d10/d15/d22/d2a/dba/d8b/dc0 0 2024-09-19T09:02:38.317 INFO:tasks.workunit.client.1.smithi102.stdout:7/521: creat d1/d3/d34/d74/fa7 x:0 0 0 2024-09-19T09:02:38.317 INFO:tasks.workunit.client.1.smithi102.stdout:7/522: readlink d1/d2d/l67 0 2024-09-19T09:02:38.318 INFO:tasks.workunit.client.1.smithi102.stdout:4/573: write d14/d34/f6e [449828,124062] 0 2024-09-19T09:02:38.319 INFO:tasks.workunit.client.1.smithi102.stdout:7/523: write d1/d3/d34/d74/fa7 [259394,9347] 0 2024-09-19T09:02:38.321 INFO:tasks.workunit.client.1.smithi102.stdout:9/486: write d1/d2/d3/d1d/d4f/f82 [844873,124352] 0 2024-09-19T09:02:38.326 INFO:tasks.workunit.client.1.smithi102.stdout:4/574: truncate d14/d34/d5a/d5c/f87 324102 0 2024-09-19T09:02:38.327 INFO:tasks.workunit.client.1.smithi102.stdout:4/575: chown f12 164 1 2024-09-19T09:02:38.327 INFO:tasks.workunit.client.1.smithi102.stdout:1/541: rename dd/d68/l83 to dd/d13/laf 0 2024-09-19T09:02:38.328 INFO:tasks.workunit.client.1.smithi102.stdout:9/487: symlink d1/d2/d7b/l9c 0 2024-09-19T09:02:38.328 INFO:tasks.workunit.client.1.smithi102.stdout:4/576: fdatasync d14/d16/d1d/f53 0 2024-09-19T09:02:38.328 INFO:tasks.workunit.client.1.smithi102.stdout:9/488: truncate d1/d2/d3/f2c 951499 0 2024-09-19T09:02:38.328 INFO:tasks.workunit.client.1.smithi102.stdout:4/577: dread - d14/d16/d17/d2e/d37/d58/f73 zero size 2024-09-19T09:02:38.329 INFO:tasks.workunit.client.1.smithi102.stdout:0/642: rename d3/dd/d10/d15/d22/d2a/dba/de/l34 to d3/dd/d10/d15/d22/d2a/dba/d9d/lda 0 2024-09-19T09:02:38.329 INFO:tasks.workunit.client.1.smithi102.stdout:1/542: dread dd/d13/f50 [0,4194304] 0 2024-09-19T09:02:38.330 INFO:tasks.workunit.client.1.smithi102.stdout:9/489: dread d1/f58 [0,4194304] 0 2024-09-19T09:02:38.332 INFO:tasks.workunit.client.1.smithi102.stdout:0/643: dread d3/dd/fb4 [0,4194304] 0 2024-09-19T09:02:38.333 INFO:tasks.workunit.client.1.smithi102.stdout:0/644: dread - d3/dd/d10/d84/fb7 zero size 2024-09-19T09:02:38.334 INFO:tasks.workunit.client.1.smithi102.stdout:0/645: readlink d3/dd/d10/d15/d22/d37/l68 0 2024-09-19T09:02:38.334 INFO:tasks.workunit.client.1.smithi102.stdout:7/524: rename d1/d2d/f7b to d1/d4/d9c/d25/d52/fa8 0 2024-09-19T09:02:38.335 INFO:tasks.workunit.client.1.smithi102.stdout:0/646: read f2 [3350179,41939] 0 2024-09-19T09:02:38.339 INFO:tasks.workunit.client.1.smithi102.stdout:2/440: truncate d7/f10 3747044 0 2024-09-19T09:02:38.341 INFO:tasks.workunit.client.1.smithi102.stdout:4/578: dread d14/d34/d5a/d5c/f7b [0,4194304] 0 2024-09-19T09:02:38.346 INFO:tasks.workunit.client.1.smithi102.stdout:0/647: fsync d3/dd/d10/d15/d22/d37/d39/d44/dab/fb2 0 2024-09-19T09:02:38.347 INFO:tasks.workunit.client.1.smithi102.stdout:0/648: chown f2 556 1 2024-09-19T09:02:38.350 INFO:tasks.workunit.client.1.smithi102.stdout:1/543: creat dd/d7a/d8c/da6/fb0 x:0 0 0 2024-09-19T09:02:38.351 INFO:tasks.workunit.client.1.smithi102.stdout:1/544: write dd/d14/d18/f37 [2474588,44273] 0 2024-09-19T09:02:38.352 INFO:tasks.workunit.client.1.smithi102.stdout:1/545: write fc [2741809,130380] 0 2024-09-19T09:02:38.357 INFO:tasks.workunit.client.1.smithi102.stdout:7/525: mknod d1/d2f/d95/ca9 0 2024-09-19T09:02:38.363 INFO:tasks.workunit.client.1.smithi102.stdout:7/526: dwrite d1/d3/d20/f9d [0,4194304] 0 2024-09-19T09:02:38.366 INFO:tasks.workunit.client.1.smithi102.stdout:1/546: dread - dd/f4f zero size 2024-09-19T09:02:38.367 INFO:tasks.workunit.client.1.smithi102.stdout:9/490: write d1/d2/d3/f3c [250427,127186] 0 2024-09-19T09:02:38.369 INFO:tasks.workunit.client.1.smithi102.stdout:0/649: mknod d3/dd/d1a/cdb 0 2024-09-19T09:02:38.371 INFO:tasks.workunit.client.1.smithi102.stdout:7/527: read d1/d4/d9c/d25/f4b [1502,115940] 0 2024-09-19T09:02:38.372 INFO:tasks.workunit.client.1.smithi102.stdout:7/528: chown d1/d3/f64 1 1 2024-09-19T09:02:38.374 INFO:tasks.workunit.client.1.smithi102.stdout:7/529: chown d1/d4/d9c/l12 42654616 1 2024-09-19T09:02:38.375 INFO:tasks.workunit.client.1.smithi102.stdout:9/491: dwrite d1/f64 [0,4194304] 0 2024-09-19T09:02:38.380 INFO:tasks.workunit.client.1.smithi102.stdout:4/579: write d14/d34/d5a/d5c/d81/f61 [2496530,102489] 0 2024-09-19T09:02:38.380 INFO:tasks.workunit.client.1.smithi102.stdout:7/530: chown d1/d3/d72/l79 1724775 1 2024-09-19T09:02:38.383 INFO:tasks.workunit.client.1.smithi102.stdout:7/531: fdatasync d1/d3/d72/f8b 0 2024-09-19T09:02:38.384 INFO:tasks.workunit.client.1.smithi102.stdout:4/580: truncate d14/d34/d5a/d5c/f87 946159 0 2024-09-19T09:02:38.385 INFO:tasks.workunit.client.1.smithi102.stdout:9/492: dwrite d1/d2/d3/d1d/d4f/d6d/d81/d90/f93 [0,4194304] 0 2024-09-19T09:02:38.386 INFO:tasks.workunit.client.1.smithi102.stdout:4/581: chown d14/d16/d1d/f44 61465 1 2024-09-19T09:02:38.388 INFO:tasks.workunit.client.1.smithi102.stdout:4/582: write d14/d16/d17/d2e/d37/d58/f73 [252075,106325] 0 2024-09-19T09:02:38.389 INFO:tasks.workunit.client.1.smithi102.stdout:9/493: symlink d1/d2/d7b/l9d 0 2024-09-19T09:02:38.390 INFO:tasks.workunit.client.1.smithi102.stdout:7/532: dread d1/d4/d9c/d25/f77 [0,4194304] 0 2024-09-19T09:02:38.391 INFO:tasks.workunit.client.1.smithi102.stdout:1/547: dread dd/f16 [0,4194304] 0 2024-09-19T09:02:38.391 INFO:tasks.workunit.client.1.smithi102.stdout:4/583: rmdir d14/d34/d9f 39 2024-09-19T09:02:38.396 INFO:tasks.workunit.client.1.smithi102.stdout:4/584: symlink d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80/lb3 0 2024-09-19T09:02:38.397 INFO:tasks.workunit.client.1.smithi102.stdout:3/615: sync 2024-09-19T09:02:38.398 INFO:tasks.workunit.client.1.smithi102.stdout:9/494: dread d1/d2/d3/f77 [0,4194304] 0 2024-09-19T09:02:38.398 INFO:tasks.workunit.client.1.smithi102.stdout:7/533: rename d1/d3/c73 to d1/d4/d9c/d25/d52/d7f/caa 0 2024-09-19T09:02:38.404 INFO:tasks.workunit.client.1.smithi102.stdout:0/650: dread d3/dd/d10/d15/f60 [0,4194304] 0 2024-09-19T09:02:38.404 INFO:tasks.workunit.client.1.smithi102.stdout:1/548: dwrite dd/d14/d35/d49/d62/d6c/f77 [0,4194304] 0 2024-09-19T09:02:38.404 INFO:tasks.workunit.client.1.smithi102.stdout:7/534: mkdir d1/d2d/dab 0 2024-09-19T09:02:38.405 INFO:tasks.workunit.client.1.smithi102.stdout:4/585: symlink d14/d16/d17/d2e/d60/lb4 0 2024-09-19T09:02:38.407 INFO:tasks.workunit.client.1.smithi102.stdout:7/535: write d1/d2d/f43 [3004682,47022] 0 2024-09-19T09:02:38.407 INFO:tasks.workunit.client.1.smithi102.stdout:4/586: chown d14/d34/c7e 256587 1 2024-09-19T09:02:38.410 INFO:tasks.workunit.client.1.smithi102.stdout:9/495: creat d1/d2/d3/d1d/d4f/d6d/f9e x:0 0 0 2024-09-19T09:02:38.412 INFO:tasks.workunit.client.1.smithi102.stdout:9/496: write d1/d8/f56 [308946,55436] 0 2024-09-19T09:02:38.412 INFO:tasks.workunit.client.1.smithi102.stdout:3/616: rename d2/d19/d1c/d2f/d5a/d84/d64/fc1 to d2/d19/d47/db/fc4 0 2024-09-19T09:02:38.413 INFO:tasks.workunit.client.1.smithi102.stdout:7/536: dwrite d1/d2d/f97 [0,4194304] 0 2024-09-19T09:02:38.414 INFO:tasks.workunit.client.1.smithi102.stdout:1/549: creat dd/d13/d2d/d78/fb1 x:0 0 0 2024-09-19T09:02:38.415 INFO:tasks.workunit.client.1.smithi102.stdout:7/537: fdatasync d1/d4/f3d 0 2024-09-19T09:02:38.416 INFO:tasks.workunit.client.1.smithi102.stdout:4/587: creat d14/d16/d17/d2e/d37/d58/d89/da0/fb5 x:0 0 0 2024-09-19T09:02:38.417 INFO:tasks.workunit.client.1.smithi102.stdout:4/588: stat d14/d16/d17/d2e/l30 0 2024-09-19T09:02:38.417 INFO:tasks.workunit.client.1.smithi102.stdout:3/617: mkdir d2/d1e/dc5 0 2024-09-19T09:02:38.423 INFO:tasks.workunit.client.1.smithi102.stdout:9/497: rmdir d1/d2 39 2024-09-19T09:02:38.424 INFO:tasks.workunit.client.1.smithi102.stdout:9/498: readlink d1/d8/l9b 0 2024-09-19T09:02:38.424 INFO:tasks.workunit.client.1.smithi102.stdout:0/651: write d3/dd/fb4 [2110170,19081] 0 2024-09-19T09:02:38.426 INFO:tasks.workunit.client.1.smithi102.stdout:7/538: symlink d1/lac 0 2024-09-19T09:02:38.428 INFO:tasks.workunit.client.1.smithi102.stdout:3/618: truncate d2/d1e/d54/f97 3820052 0 2024-09-19T09:02:38.431 INFO:tasks.workunit.client.1.smithi102.stdout:7/539: truncate d1/f2a 95331 0 2024-09-19T09:02:38.432 INFO:tasks.workunit.client.1.smithi102.stdout:4/589: link d14/d16/d17/d2e/d37/d58/la2 d14/d16/d17/d2e/d37/d58/lb6 0 2024-09-19T09:02:38.433 INFO:tasks.workunit.client.1.smithi102.stdout:3/619: creat d2/d19/d35/fc6 x:0 0 0 2024-09-19T09:02:38.433 INFO:tasks.workunit.client.1.smithi102.stdout:0/652: dwrite d3/dd/d10/d84/fb7 [0,4194304] 0 2024-09-19T09:02:38.433 INFO:tasks.workunit.client.1.smithi102.stdout:1/550: getdents dd/d7a/d8c 0 2024-09-19T09:02:38.436 INFO:tasks.workunit.client.1.smithi102.stdout:9/499: symlink d1/d2/d3/d1d/d4f/d6d/d81/l9f 0 2024-09-19T09:02:38.439 INFO:tasks.workunit.client.1.smithi102.stdout:3/620: creat d2/d19/d1c/d1f/fc7 x:0 0 0 2024-09-19T09:02:38.440 INFO:tasks.workunit.client.1.smithi102.stdout:1/551: symlink dd/d14/d35/d49/d62/d6c/d99/lb2 0 2024-09-19T09:02:38.441 INFO:tasks.workunit.client.1.smithi102.stdout:4/590: dwrite d14/d16/d17/d2e/d37/d58/d89/da6/d2f/faa [0,4194304] 0 2024-09-19T09:02:38.448 INFO:tasks.workunit.client.1.smithi102.stdout:9/500: mkdir d1/d2/d78/da0 0 2024-09-19T09:02:38.448 INFO:tasks.workunit.client.1.smithi102.stdout:7/540: mkdir d1/d3/d20/dad 0 2024-09-19T09:02:38.451 INFO:tasks.workunit.client.1.smithi102.stdout:3/621: rename d2/d19/d47/db/cc to d2/d1e/cc8 0 2024-09-19T09:02:38.453 INFO:tasks.workunit.client.1.smithi102.stdout:1/552: unlink dd/d14/d35/d49/d62/d6c/f8f 0 2024-09-19T09:02:38.455 INFO:tasks.workunit.client.1.smithi102.stdout:0/653: dread d3/dd/d10/d15/d22/d37/d39/d44/d54/fd2 [0,4194304] 0 2024-09-19T09:02:38.456 INFO:tasks.workunit.client.1.smithi102.stdout:4/591: creat d14/d34/d5a/d5c/d79/d8c/fb7 x:0 0 0 2024-09-19T09:02:38.458 INFO:tasks.workunit.client.1.smithi102.stdout:7/541: symlink d1/d2d/lae 0 2024-09-19T09:02:38.459 INFO:tasks.workunit.client.1.smithi102.stdout:1/553: dwrite dd/d14/d35/fa2 [0,4194304] 0 2024-09-19T09:02:38.461 INFO:tasks.workunit.client.1.smithi102.stdout:3/622: mkdir d2/d19/d1c/d70/dc9 0 2024-09-19T09:02:38.470 INFO:tasks.workunit.client.1.smithi102.stdout:9/501: creat d1/fa1 x:0 0 0 2024-09-19T09:02:38.472 INFO:tasks.workunit.client.1.smithi102.stdout:0/654: rmdir d3/dd/d10/dbf 0 2024-09-19T09:02:38.473 INFO:tasks.workunit.client.1.smithi102.stdout:4/592: getdents d14/d34/d9f 0 2024-09-19T09:02:38.474 INFO:tasks.workunit.client.1.smithi102.stdout:4/593: write f12 [4935693,23570] 0 2024-09-19T09:02:38.477 INFO:tasks.workunit.client.1.smithi102.stdout:9/502: dwrite d1/d2/d3/d1d/d4f/d6d/f9e [0,4194304] 0 2024-09-19T09:02:38.478 INFO:tasks.workunit.client.1.smithi102.stdout:7/542: write d1/d4/d9c/f62 [223017,8153] 0 2024-09-19T09:02:38.479 INFO:tasks.workunit.client.1.smithi102.stdout:7/543: stat d1/d4/d9c/d25/l99 0 2024-09-19T09:02:38.481 INFO:tasks.workunit.client.1.smithi102.stdout:9/503: mkdir d1/d2/d3/d6f/d8d/da2 0 2024-09-19T09:02:38.481 INFO:tasks.workunit.client.1.smithi102.stdout:9/504: dread - d1/fa1 zero size 2024-09-19T09:02:38.482 INFO:tasks.workunit.client.1.smithi102.stdout:9/505: read d1/d2/d3/d1d/d4f/f82 [141844,18318] 0 2024-09-19T09:02:38.482 INFO:tasks.workunit.client.1.smithi102.stdout:4/594: creat d14/d16/d17/d2e/d37/d58/d89/da6/d7c/fb8 x:0 0 0 2024-09-19T09:02:38.485 INFO:tasks.workunit.client.1.smithi102.stdout:7/544: symlink d1/d3/d20/laf 0 2024-09-19T09:02:38.486 INFO:tasks.workunit.client.1.smithi102.stdout:9/506: creat d1/d2/d7b/fa3 x:0 0 0 2024-09-19T09:02:38.487 INFO:tasks.workunit.client.1.smithi102.stdout:0/655: dwrite d3/dd/d10/f38 [0,4194304] 0 2024-09-19T09:02:38.488 INFO:tasks.workunit.client.1.smithi102.stdout:9/507: rmdir d1/d2/d78 39 2024-09-19T09:02:38.491 INFO:tasks.workunit.client.1.smithi102.stdout:0/656: mknod d3/dd/d1a/d32/cdc 0 2024-09-19T09:02:38.495 INFO:tasks.workunit.client.1.smithi102.stdout:9/508: creat d1/d2/d3/d6f/fa4 x:0 0 0 2024-09-19T09:02:38.499 INFO:tasks.workunit.client.1.smithi102.stdout:0/657: unlink d3/dd/d10/d15/d22/d37/f52 0 2024-09-19T09:02:38.501 INFO:tasks.workunit.client.1.smithi102.stdout:9/509: truncate d1/d8/d1c/f21 1566211 0 2024-09-19T09:02:38.503 INFO:tasks.workunit.client.1.smithi102.stdout:7/545: link d1/d4/f6 d1/d3/d20/d6c/fb0 0 2024-09-19T09:02:38.504 INFO:tasks.workunit.client.1.smithi102.stdout:0/658: mknod d3/dd/d10/d15/d22/d37/d3d/d90/cdd 0 2024-09-19T09:02:38.506 INFO:tasks.workunit.client.1.smithi102.stdout:9/510: symlink d1/d2/la5 0 2024-09-19T09:02:38.506 INFO:tasks.workunit.client.1.smithi102.stdout:7/546: write d1/d3/d34/d74/fa7 [890438,120765] 0 2024-09-19T09:02:38.506 INFO:tasks.workunit.client.1.smithi102.stdout:4/595: dwrite d14/d16/d17/d2e/f47 [4194304,4194304] 0 2024-09-19T09:02:38.508 INFO:tasks.workunit.client.1.smithi102.stdout:9/511: write d1/d2/d3/f12 [9380762,56537] 0 2024-09-19T09:02:38.509 INFO:tasks.workunit.client.1.smithi102.stdout:4/596: truncate d14/d16/d17/d2e/d37/d58/d89/f31 4257657 0 2024-09-19T09:02:38.510 INFO:tasks.workunit.client.1.smithi102.stdout:4/597: stat d14/d34/d5a/d5c/d79/d8c/f91 0 2024-09-19T09:02:38.510 INFO:tasks.workunit.client.1.smithi102.stdout:0/659: mknod d3/dd/d1a/d32/cde 0 2024-09-19T09:02:38.513 INFO:tasks.workunit.client.1.smithi102.stdout:7/547: mkdir d1/d4/d9c/d25/db1 0 2024-09-19T09:02:38.514 INFO:tasks.workunit.client.1.smithi102.stdout:7/548: dread - d1/d4/d9c/f89 zero size 2024-09-19T09:02:38.516 INFO:tasks.workunit.client.1.smithi102.stdout:9/512: mknod d1/d2/d3/d1d/d4f/ca6 0 2024-09-19T09:02:38.517 INFO:tasks.workunit.client.1.smithi102.stdout:9/513: truncate d1/d8/d1c/f99 32803 0 2024-09-19T09:02:38.524 INFO:tasks.workunit.client.1.smithi102.stdout:9/514: write d1/d2/d78/f79 [785805,92592] 0 2024-09-19T09:02:38.524 INFO:tasks.workunit.client.0.smithi049.stderr:++ readlink -f fsstress 2024-09-19T09:02:38.529 INFO:tasks.workunit.client.0.smithi049.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T09:02:38.529 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-09-19T09:02:38.529 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:02:38.530 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-09-19T09:02:38.530 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-19T09:02:38.530 INFO:tasks.workunit.client.0.smithi049.stderr:++ mktemp -d -p . 2024-09-19T09:02:38.531 INFO:tasks.workunit.client.1.smithi102.stdout:7/549: link d1/d3/d72/f75 d1/d3/d20/fb2 0 2024-09-19T09:02:38.531 INFO:tasks.workunit.client.1.smithi102.stdout:7/550: write d1/d4/d9c/d25/f60 [113757,109235] 0 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:0/660: getdents d3/dd/d10/d15/d22/d2a/dba 0 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:5/539: sync 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:6/445: sync 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:4/598: dread d14/d16/d17/d2e/d60/f71 [0,4194304] 0 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:9/515: rename d1/d2/d3/d6f/f80 to d1/d2/d78/da0/fa7 0 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:6/446: chown d1/d26/d2e/d70 1738 1 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:9/516: read - d1/fa1 zero size 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:6/447: readlink d1/d26/d4b/l8c 0 2024-09-19T09:02:38.532 INFO:tasks.workunit.client.1.smithi102.stdout:4/599: dread - d14/d34/d5a/d5c/d79/d8c/fb7 zero size 2024-09-19T09:02:38.533 INFO:tasks.workunit.client.0.smithi049.stderr:+ T=./tmp.gq4qxHqFYF 2024-09-19T09:02:38.533 INFO:tasks.workunit.client.0.smithi049.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gq4qxHqFYF -l 1 -n 1000 -p 10 -v 2024-09-19T09:02:38.533 INFO:tasks.workunit.client.1.smithi102.stdout:6/448: readlink d1/d18/db/l2b 0 2024-09-19T09:02:38.533 INFO:tasks.workunit.client.1.smithi102.stdout:7/551: mknod d1/d4/d9c/d25/d52/d7f/cb3 0 2024-09-19T09:02:38.534 INFO:tasks.workunit.client.1.smithi102.stdout:4/600: dread d14/d16/d17/f46 [0,4194304] 0 2024-09-19T09:02:38.534 INFO:tasks.workunit.client.1.smithi102.stdout:7/552: chown d1/d4/c29 2446 1 2024-09-19T09:02:38.535 INFO:tasks.workunit.client.1.smithi102.stdout:9/517: fdatasync d1/d8/d1c/f28 0 2024-09-19T09:02:38.537 INFO:tasks.workunit.client.1.smithi102.stdout:0/661: unlink d3/dd/d10/d15/d3e/f50 0 2024-09-19T09:02:38.537 INFO:tasks.workunit.client.1.smithi102.stdout:5/540: dwrite d5/d7/d1a/d37/d39/f8b [0,4194304] 0 2024-09-19T09:02:38.539 INFO:tasks.workunit.client.0.smithi049.stdout:seed = 1726207726 2024-09-19T09:02:38.541 INFO:tasks.workunit.client.1.smithi102.stdout:7/553: mkdir d1/d3/d34/db4 0 2024-09-19T09:02:38.543 INFO:tasks.workunit.client.1.smithi102.stdout:0/662: readlink d3/dd/d10/d15/d3e/l6f 0 2024-09-19T09:02:38.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/0: rmdir - no directory 2024-09-19T09:02:38.548 INFO:tasks.workunit.client.0.smithi049.stdout:0/1: fdatasync - no filename 2024-09-19T09:02:38.554 INFO:tasks.workunit.client.0.smithi049.stdout:2/0: rename - no filename 2024-09-19T09:02:38.554 INFO:tasks.workunit.client.0.smithi049.stdout:2/1: dread - no filename 2024-09-19T09:02:38.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/2: getdents . 0 2024-09-19T09:02:38.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/3: chown . 12 1 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/4: dwrite - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/5: readlink - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/6: rmdir - no directory 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/7: dread - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/8: dread - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/9: dwrite - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/10: readlink - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/11: write - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/12: write - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/13: dread - no filename 2024-09-19T09:02:38.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/14: read - no filename 2024-09-19T09:02:38.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/15: chown . 3 1 2024-09-19T09:02:38.557 INFO:tasks.workunit.client.0.smithi049.stdout:1/0: creat f0 x:0 0 0 2024-09-19T09:02:38.557 INFO:tasks.workunit.client.0.smithi049.stdout:1/1: dread - f0 zero size 2024-09-19T09:02:38.557 INFO:tasks.workunit.client.0.smithi049.stdout:1/2: truncate f0 615088 0 2024-09-19T09:02:38.558 INFO:tasks.workunit.client.0.smithi049.stdout:1/3: dread f0 [0,4194304] 0 2024-09-19T09:02:38.558 INFO:tasks.workunit.client.0.smithi049.stdout:2/2: creat f0 x:0 0 0 2024-09-19T09:02:38.561 INFO:tasks.workunit.client.0.smithi049.stdout:0/16: symlink l0 0 2024-09-19T09:02:38.563 INFO:tasks.workunit.client.0.smithi049.stdout:4/0: creat f0 x:0 0 0 2024-09-19T09:02:38.564 INFO:tasks.workunit.client.0.smithi049.stdout:0/17: creat f1 x:0 0 0 2024-09-19T09:02:38.565 INFO:tasks.workunit.client.0.smithi049.stdout:1/4: link f0 f1 0 2024-09-19T09:02:38.567 INFO:tasks.workunit.client.0.smithi049.stdout:5/0: symlink l0 0 2024-09-19T09:02:38.567 INFO:tasks.workunit.client.0.smithi049.stdout:5/1: write - no filename 2024-09-19T09:02:38.568 INFO:tasks.workunit.client.0.smithi049.stdout:2/3: fsync f0 0 2024-09-19T09:02:38.569 INFO:tasks.workunit.client.0.smithi049.stdout:0/18: creat f2 x:0 0 0 2024-09-19T09:02:38.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/5: fdatasync f0 0 2024-09-19T09:02:38.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/4: chown f0 9 1 2024-09-19T09:02:38.572 INFO:tasks.workunit.client.0.smithi049.stdout:3/0: mknod c0 0 2024-09-19T09:02:38.572 INFO:tasks.workunit.client.0.smithi049.stdout:3/1: fdatasync - no filename 2024-09-19T09:02:38.573 INFO:tasks.workunit.client.0.smithi049.stdout:5/2: mknod c1 0 2024-09-19T09:02:38.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/0: dread - no filename 2024-09-19T09:02:38.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/1: dwrite - no filename 2024-09-19T09:02:38.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/2: link - no file 2024-09-19T09:02:38.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/3: readlink - no filename 2024-09-19T09:02:38.577 INFO:tasks.workunit.client.0.smithi049.stdout:3/2: mkdir d1 0 2024-09-19T09:02:38.577 INFO:tasks.workunit.client.0.smithi049.stdout:3/3: write - no filename 2024-09-19T09:02:38.578 INFO:tasks.workunit.client.0.smithi049.stdout:3/4: write - no filename 2024-09-19T09:02:38.578 INFO:tasks.workunit.client.0.smithi049.stdout:1/6: dread f0 [0,4194304] 0 2024-09-19T09:02:38.579 INFO:tasks.workunit.client.0.smithi049.stdout:8/0: symlink l0 0 2024-09-19T09:02:38.579 INFO:tasks.workunit.client.0.smithi049.stdout:7/0: rename - no filename 2024-09-19T09:02:38.579 INFO:tasks.workunit.client.0.smithi049.stdout:4/1: dwrite f0 [0,4194304] 0 2024-09-19T09:02:38.580 INFO:tasks.workunit.client.0.smithi049.stdout:5/3: rename c1 to c2 0 2024-09-19T09:02:38.580 INFO:tasks.workunit.client.0.smithi049.stdout:7/1: chown . 3916062 1 2024-09-19T09:02:38.580 INFO:tasks.workunit.client.0.smithi049.stdout:7/2: write - no filename 2024-09-19T09:02:38.580 INFO:tasks.workunit.client.0.smithi049.stdout:7/3: write - no filename 2024-09-19T09:02:38.585 INFO:tasks.workunit.client.0.smithi049.stdout:8/1: mkdir d1 0 2024-09-19T09:02:38.585 INFO:tasks.workunit.client.0.smithi049.stdout:8/2: dwrite - no filename 2024-09-19T09:02:38.586 INFO:tasks.workunit.client.1.smithi102.stdout:5/541: rename d5/d7/l18 to d5/d7/d1a/d37/d39/d81/lad 0 2024-09-19T09:02:38.586 INFO:tasks.workunit.client.0.smithi049.stdout:1/7: creat f2 x:0 0 0 2024-09-19T09:02:38.586 INFO:tasks.workunit.client.0.smithi049.stdout:1/8: readlink - no filename 2024-09-19T09:02:38.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/4: symlink l0 0 2024-09-19T09:02:38.589 INFO:tasks.workunit.client.0.smithi049.stdout:9/5: dwrite - no filename 2024-09-19T09:02:38.589 INFO:tasks.workunit.client.1.smithi102.stdout:6/449: dread d1/d18/f25 [0,4194304] 0 2024-09-19T09:02:38.590 INFO:tasks.workunit.client.0.smithi049.stdout:5/4: mkdir d3 0 2024-09-19T09:02:38.590 INFO:tasks.workunit.client.1.smithi102.stdout:7/554: dwrite d1/f8f [0,4194304] 0 2024-09-19T09:02:38.591 INFO:tasks.workunit.client.1.smithi102.stdout:7/555: write d1/d3/f78 [80400,69007] 0 2024-09-19T09:02:38.591 INFO:tasks.workunit.client.1.smithi102.stdout:0/663: read d3/dd/d10/d15/d22/d37/f69 [2063632,42625] 0 2024-09-19T09:02:38.593 INFO:tasks.workunit.client.1.smithi102.stdout:4/601: getdents d14/d16/d1d 0 2024-09-19T09:02:38.593 INFO:tasks.workunit.client.0.smithi049.stdout:5/5: chown l0 11013 1 2024-09-19T09:02:38.595 INFO:tasks.workunit.client.0.smithi049.stdout:3/5: symlink d1/l2 0 2024-09-19T09:02:38.595 INFO:tasks.workunit.client.0.smithi049.stdout:8/3: creat d1/f2 x:0 0 0 2024-09-19T09:02:38.597 INFO:tasks.workunit.client.1.smithi102.stdout:5/542: symlink d5/d7/d1a/d37/d39/d4c/lae 0 2024-09-19T09:02:38.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/6: unlink l0 0 2024-09-19T09:02:38.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/6: chown d3 910955 1 2024-09-19T09:02:38.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/7: write - no filename 2024-09-19T09:02:38.600 INFO:tasks.workunit.client.1.smithi102.stdout:4/602: dwrite d14/d34/d9f/fad [0,4194304] 0 2024-09-19T09:02:38.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/6: stat d1/l2 0 2024-09-19T09:02:38.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/7: dwrite - no filename 2024-09-19T09:02:38.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/8: dwrite - no filename 2024-09-19T09:02:38.601 INFO:tasks.workunit.client.1.smithi102.stdout:6/450: truncate d1/d26/d2e/d45/d47/d4d/f4c 1243639 0 2024-09-19T09:02:38.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/19: dwrite f2 [0,4194304] 0 2024-09-19T09:02:38.602 INFO:tasks.workunit.client.0.smithi049.stdout:2/5: dwrite f0 [0,4194304] 0 2024-09-19T09:02:38.604 INFO:tasks.workunit.client.1.smithi102.stdout:0/664: dread d3/dd/d10/d15/d22/d4a/d80/fb5 [0,4194304] 0 2024-09-19T09:02:38.607 INFO:tasks.workunit.client.0.smithi049.stdout:9/7: creat f1 x:0 0 0 2024-09-19T09:02:38.610 INFO:tasks.workunit.client.0.smithi049.stdout:3/9: chown d1/l2 174 1 2024-09-19T09:02:38.611 INFO:tasks.workunit.client.0.smithi049.stdout:9/8: dread - f1 zero size 2024-09-19T09:02:38.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/10: stat d1 0 2024-09-19T09:02:38.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/11: fsync - no filename 2024-09-19T09:02:38.612 INFO:tasks.workunit.client.0.smithi049.stdout:1/9: truncate f1 1379464 0 2024-09-19T09:02:38.613 INFO:tasks.workunit.client.1.smithi102.stdout:7/556: mknod d1/cb5 0 2024-09-19T09:02:38.616 INFO:tasks.workunit.client.1.smithi102.stdout:4/603: creat d14/d34/d5a/d5c/d81/d75/fb9 x:0 0 0 2024-09-19T09:02:38.616 INFO:tasks.workunit.client.0.smithi049.stdout:4/2: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:38.617 INFO:tasks.workunit.client.1.smithi102.stdout:6/451: symlink d1/d3a/l9e 0 2024-09-19T09:02:38.618 INFO:tasks.workunit.client.0.smithi049.stdout:5/8: mknod d3/c4 0 2024-09-19T09:02:38.618 INFO:tasks.workunit.client.1.smithi102.stdout:6/452: truncate d1/d18/f6a 4959985 0 2024-09-19T09:02:38.618 INFO:tasks.workunit.client.1.smithi102.stdout:6/453: dread - d1/d3a/f7c zero size 2024-09-19T09:02:38.622 INFO:tasks.workunit.client.0.smithi049.stdout:0/20: dwrite f2 [0,4194304] 0 2024-09-19T09:02:38.624 INFO:tasks.workunit.client.1.smithi102.stdout:0/665: rmdir d3/dd/d1a/d32/d7f 39 2024-09-19T09:02:38.630 INFO:tasks.workunit.client.1.smithi102.stdout:8/449: sync 2024-09-19T09:02:38.630 INFO:tasks.workunit.client.1.smithi102.stdout:1/554: sync 2024-09-19T09:02:38.630 INFO:tasks.workunit.client.1.smithi102.stdout:2/441: sync 2024-09-19T09:02:38.630 INFO:tasks.workunit.client.1.smithi102.stdout:1/555: fsync dd/f10 0 2024-09-19T09:02:38.631 INFO:tasks.workunit.client.1.smithi102.stdout:2/442: chown d7/d12/c30 386280991 1 2024-09-19T09:02:38.631 INFO:tasks.workunit.client.1.smithi102.stdout:5/543: mkdir d5/d7/d1a/d37/d39/d4c/daf 0 2024-09-19T09:02:38.633 INFO:tasks.workunit.client.0.smithi049.stdout:9/9: creat f2 x:0 0 0 2024-09-19T09:02:38.634 INFO:tasks.workunit.client.0.smithi049.stdout:9/10: write f2 [750389,31192] 0 2024-09-19T09:02:38.635 INFO:tasks.workunit.client.0.smithi049.stdout:9/11: fsync f1 0 2024-09-19T09:02:38.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/9: rmdir d3 39 2024-09-19T09:02:38.636 INFO:tasks.workunit.client.1.smithi102.stdout:1/556: dwrite dd/d5f/f7c [0,4194304] 0 2024-09-19T09:02:38.637 INFO:tasks.workunit.client.0.smithi049.stdout:8/4: link l0 d1/l3 0 2024-09-19T09:02:38.637 INFO:tasks.workunit.client.1.smithi102.stdout:4/604: write d14/d16/d17/d2e/d37/d58/d89/da6/f4b [4668346,51481] 0 2024-09-19T09:02:38.638 INFO:tasks.workunit.client.1.smithi102.stdout:6/454: unlink d1/d18/db/c9d 0 2024-09-19T09:02:38.639 INFO:tasks.workunit.client.1.smithi102.stdout:6/455: stat d1/d18/db/d65/f83 0 2024-09-19T09:02:38.640 INFO:tasks.workunit.client.0.smithi049.stdout:0/21: unlink f1 0 2024-09-19T09:02:38.643 INFO:tasks.workunit.client.0.smithi049.stdout:0/22: write f2 [1303085,127029] 0 2024-09-19T09:02:38.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/12: mkdir d3 0 2024-09-19T09:02:38.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/13: chown d3 5 1 2024-09-19T09:02:38.647 INFO:tasks.workunit.client.0.smithi049.stdout:9/14: write f1 [381987,90226] 0 2024-09-19T09:02:38.647 INFO:tasks.workunit.client.0.smithi049.stdout:8/5: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:02:38.648 INFO:tasks.workunit.client.1.smithi102.stdout:5/544: unlink d5/d7/d1a/d42/d4b/f4f 0 2024-09-19T09:02:38.650 INFO:tasks.workunit.client.1.smithi102.stdout:7/557: mknod d1/d3/d34/db4/cb6 0 2024-09-19T09:02:38.650 INFO:tasks.workunit.client.1.smithi102.stdout:7/558: chown d1/d3/l33 5 1 2024-09-19T09:02:38.654 INFO:tasks.workunit.client.1.smithi102.stdout:6/456: creat d1/d26/d2e/d45/d47/d4d/d3b/d8d/f9f x:0 0 0 2024-09-19T09:02:38.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/10: write f0 [100517,2230] 0 2024-09-19T09:02:38.657 INFO:tasks.workunit.client.0.smithi049.stdout:5/10: mkdir d3/d5 0 2024-09-19T09:02:38.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/11: fdatasync f1 0 2024-09-19T09:02:38.659 INFO:tasks.workunit.client.0.smithi049.stdout:9/15: dwrite f2 [0,4194304] 0 2024-09-19T09:02:38.660 INFO:tasks.workunit.client.0.smithi049.stdout:8/6: dread d1/f2 [0,4194304] 0 2024-09-19T09:02:38.664 INFO:tasks.workunit.client.1.smithi102.stdout:8/450: truncate d0/d10/d21/f6c 4081449 0 2024-09-19T09:02:38.667 INFO:tasks.workunit.client.1.smithi102.stdout:5/545: truncate d5/d23/d3b/f5c 494931 0 2024-09-19T09:02:38.669 INFO:tasks.workunit.client.1.smithi102.stdout:7/559: stat d1/d2d/l85 0 2024-09-19T09:02:38.670 INFO:tasks.workunit.client.0.smithi049.stdout:1/12: creat f3 x:0 0 0 2024-09-19T09:02:38.672 INFO:tasks.workunit.client.1.smithi102.stdout:2/443: link d7/d11/c28 d7/d1a/d3d/c92 0 2024-09-19T09:02:38.672 INFO:tasks.workunit.client.1.smithi102.stdout:2/444: chown d7/d11/f68 13 1 2024-09-19T09:02:38.673 INFO:tasks.workunit.client.1.smithi102.stdout:2/445: stat d7/d50/d64/f77 0 2024-09-19T09:02:38.673 INFO:tasks.workunit.client.1.smithi102.stdout:8/451: symlink d0/d10/d21/d39/l88 0 2024-09-19T09:02:38.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/11: unlink c2 0 2024-09-19T09:02:38.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/12: dread - no filename 2024-09-19T09:02:38.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/13: dread - no filename 2024-09-19T09:02:38.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/14: dwrite - no filename 2024-09-19T09:02:38.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/13: creat f4 x:0 0 0 2024-09-19T09:02:38.677 INFO:tasks.workunit.client.1.smithi102.stdout:5/546: rmdir d5/d7/d1b 39 2024-09-19T09:02:38.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/14: dread - f4 zero size 2024-09-19T09:02:38.680 INFO:tasks.workunit.client.0.smithi049.stdout:9/16: symlink d3/l4 0 2024-09-19T09:02:38.680 INFO:tasks.workunit.client.0.smithi049.stdout:8/7: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:02:38.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/23: getdents . 0 2024-09-19T09:02:38.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/15: creat d3/f6 x:0 0 0 2024-09-19T09:02:38.686 INFO:tasks.workunit.client.1.smithi102.stdout:0/666: getdents d3/dd/d1a 0 2024-09-19T09:02:38.686 INFO:tasks.workunit.client.0.smithi049.stdout:1/15: mkdir d5 0 2024-09-19T09:02:38.686 INFO:tasks.workunit.client.0.smithi049.stdout:1/16: dread - f4 zero size 2024-09-19T09:02:38.688 INFO:tasks.workunit.client.1.smithi102.stdout:2/446: mkdir d7/d12/d37/d93 0 2024-09-19T09:02:38.688 INFO:tasks.workunit.client.1.smithi102.stdout:0/667: truncate d3/dd/d1a/fa6 932162 0 2024-09-19T09:02:38.688 INFO:tasks.workunit.client.0.smithi049.stdout:1/17: write f0 [1104159,110212] 0 2024-09-19T09:02:38.689 INFO:tasks.workunit.client.0.smithi049.stdout:1/18: fsync f2 0 2024-09-19T09:02:38.689 INFO:tasks.workunit.client.0.smithi049.stdout:1/19: stat f1 0 2024-09-19T09:02:38.689 INFO:tasks.workunit.client.1.smithi102.stdout:8/452: dread d0/d10/d21/d39/f59 [0,4194304] 0 2024-09-19T09:02:38.690 INFO:tasks.workunit.client.0.smithi049.stdout:9/17: rename f2 to d3/f5 0 2024-09-19T09:02:38.690 INFO:tasks.workunit.client.0.smithi049.stdout:1/20: write f2 [744609,58771] 0 2024-09-19T09:02:38.692 INFO:tasks.workunit.client.0.smithi049.stdout:8/8: mknod d1/c4 0 2024-09-19T09:02:38.693 INFO:tasks.workunit.client.0.smithi049.stdout:8/9: chown d1/f2 1279258 1 2024-09-19T09:02:38.694 INFO:tasks.workunit.client.0.smithi049.stdout:8/10: write d1/f2 [4654572,17474] 0 2024-09-19T09:02:38.696 INFO:tasks.workunit.client.0.smithi049.stdout:0/24: creat f3 x:0 0 0 2024-09-19T09:02:38.698 INFO:tasks.workunit.client.1.smithi102.stdout:5/547: truncate d5/d7/d1a/d37/d34/f4e 299870 0 2024-09-19T09:02:38.698 INFO:tasks.workunit.client.1.smithi102.stdout:7/560: truncate d1/d4/f1a 1247535 0 2024-09-19T09:02:38.699 INFO:tasks.workunit.client.1.smithi102.stdout:7/561: chown d1/d4/d9c/d25/f60 1 1 2024-09-19T09:02:38.699 INFO:tasks.workunit.client.0.smithi049.stdout:9/18: symlink d3/l6 0 2024-09-19T09:02:38.702 INFO:tasks.workunit.client.1.smithi102.stdout:7/562: dread d1/d2d/f97 [0,4194304] 0 2024-09-19T09:02:38.702 INFO:tasks.workunit.client.1.smithi102.stdout:4/605: rename d14/d16/d17/d2e/d37/d58/d89/da6/l8f to d14/lba 0 2024-09-19T09:02:38.703 INFO:tasks.workunit.client.0.smithi049.stdout:9/19: dread f1 [0,4194304] 0 2024-09-19T09:02:38.703 INFO:tasks.workunit.client.0.smithi049.stdout:8/11: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:02:38.704 INFO:tasks.workunit.client.1.smithi102.stdout:2/447: write d7/d12/f17 [5143939,100607] 0 2024-09-19T09:02:38.706 INFO:tasks.workunit.client.0.smithi049.stdout:5/16: symlink d3/d5/l7 0 2024-09-19T09:02:38.707 INFO:tasks.workunit.client.1.smithi102.stdout:0/668: truncate d3/f14 7268887 0 2024-09-19T09:02:38.707 INFO:tasks.workunit.client.0.smithi049.stdout:5/17: dread - d3/f6 zero size 2024-09-19T09:02:38.708 INFO:tasks.workunit.client.1.smithi102.stdout:0/669: chown d3/dd/d10/d15/d3e/ld8 29105 1 2024-09-19T09:02:38.710 INFO:tasks.workunit.client.1.smithi102.stdout:8/453: creat d0/db/f89 x:0 0 0 2024-09-19T09:02:38.711 INFO:tasks.workunit.client.0.smithi049.stdout:1/21: getdents d5 0 2024-09-19T09:02:38.711 INFO:tasks.workunit.client.1.smithi102.stdout:8/454: write d0/fd [4449502,113969] 0 2024-09-19T09:02:38.712 INFO:tasks.workunit.client.0.smithi049.stdout:9/20: dwrite f1 [0,4194304] 0 2024-09-19T09:02:38.713 INFO:tasks.workunit.client.1.smithi102.stdout:3/623: sync 2024-09-19T09:02:38.713 INFO:tasks.workunit.client.1.smithi102.stdout:6/457: truncate d1/d18/db/f5e 3976809 0 2024-09-19T09:02:38.713 INFO:tasks.workunit.client.1.smithi102.stdout:3/624: chown d2/d19/d47/db/d8b 0 1 2024-09-19T09:02:38.714 INFO:tasks.workunit.client.1.smithi102.stdout:6/458: fdatasync d1/d18/db/d65/f96 0 2024-09-19T09:02:38.718 INFO:tasks.workunit.client.0.smithi049.stdout:8/12: symlink d1/l5 0 2024-09-19T09:02:38.721 INFO:tasks.workunit.client.0.smithi049.stdout:5/18: creat d3/f8 x:0 0 0 2024-09-19T09:02:38.722 INFO:tasks.workunit.client.1.smithi102.stdout:4/606: creat d14/d16/d17/d2e/d37/d58/fbb x:0 0 0 2024-09-19T09:02:38.722 INFO:tasks.workunit.client.0.smithi049.stdout:9/21: creat d3/f7 x:0 0 0 2024-09-19T09:02:38.722 INFO:tasks.workunit.client.1.smithi102.stdout:4/607: stat d14/c3b 0 2024-09-19T09:02:38.723 INFO:tasks.workunit.client.1.smithi102.stdout:2/448: write d7/f42 [142766,33156] 0 2024-09-19T09:02:38.725 INFO:tasks.workunit.client.0.smithi049.stdout:8/13: dread d1/f2 [0,4194304] 0 2024-09-19T09:02:38.725 INFO:tasks.workunit.client.1.smithi102.stdout:0/670: creat d3/dd/d10/d84/fdf x:0 0 0 2024-09-19T09:02:38.727 INFO:tasks.workunit.client.1.smithi102.stdout:9/518: sync 2024-09-19T09:02:38.727 INFO:tasks.workunit.client.1.smithi102.stdout:1/557: sync 2024-09-19T09:02:38.729 INFO:tasks.workunit.client.0.smithi049.stdout:1/22: mkdir d5/d6 0 2024-09-19T09:02:38.733 INFO:tasks.workunit.client.0.smithi049.stdout:5/19: creat d3/f9 x:0 0 0 2024-09-19T09:02:38.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/20: write d3/f6 [881568,67581] 0 2024-09-19T09:02:38.735 INFO:tasks.workunit.client.0.smithi049.stdout:9/22: rename d3/f5 to d3/f8 0 2024-09-19T09:02:38.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/14: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:02:38.736 INFO:tasks.workunit.client.0.smithi049.stdout:5/21: fdatasync d3/f6 0 2024-09-19T09:02:38.736 INFO:tasks.workunit.client.1.smithi102.stdout:5/548: symlink d5/d7/d1a/d37/d39/d4c/lb0 0 2024-09-19T09:02:38.737 INFO:tasks.workunit.client.0.smithi049.stdout:9/23: write d3/f7 [257152,16748] 0 2024-09-19T09:02:38.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/25: getdents . 0 2024-09-19T09:02:38.742 INFO:tasks.workunit.client.1.smithi102.stdout:7/563: rename d1/f2a to d1/d2d/fb7 0 2024-09-19T09:02:38.743 INFO:tasks.workunit.client.1.smithi102.stdout:6/459: dread d1/d3a/f5d [0,4194304] 0 2024-09-19T09:02:38.744 INFO:tasks.workunit.client.1.smithi102.stdout:6/460: readlink d1/d18/db/l2b 0 2024-09-19T09:02:38.745 INFO:tasks.workunit.client.1.smithi102.stdout:7/564: read d1/d4/d9c/d25/f8e [3476149,78847] 0 2024-09-19T09:02:38.746 INFO:tasks.workunit.client.0.smithi049.stdout:1/23: unlink f1 0 2024-09-19T09:02:38.746 INFO:tasks.workunit.client.1.smithi102.stdout:7/565: write d1/d4/d9c/d25/f2e [1593524,98195] 0 2024-09-19T09:02:38.746 INFO:tasks.workunit.client.1.smithi102.stdout:7/566: chown d1/d4/d9c/c36 1 1 2024-09-19T09:02:38.747 INFO:tasks.workunit.client.1.smithi102.stdout:4/608: mkdir d14/d16/d1d/d48/dbc 0 2024-09-19T09:02:38.748 INFO:tasks.workunit.client.1.smithi102.stdout:4/609: write d14/d16/d1d/f53 [417773,97339] 0 2024-09-19T09:02:38.751 INFO:tasks.workunit.client.1.smithi102.stdout:2/449: creat d7/d1a/d2b/d4e/f94 x:0 0 0 2024-09-19T09:02:38.753 INFO:tasks.workunit.client.0.smithi049.stdout:8/15: creat d1/f6 x:0 0 0 2024-09-19T09:02:38.755 INFO:tasks.workunit.client.1.smithi102.stdout:2/450: dread d7/d50/d64/d7f/d83/f75 [0,4194304] 0 2024-09-19T09:02:38.755 INFO:tasks.workunit.client.0.smithi049.stdout:1/24: dwrite f2 [0,4194304] 0 2024-09-19T09:02:38.755 INFO:tasks.workunit.client.0.smithi049.stdout:5/22: symlink d3/la 0 2024-09-19T09:02:38.757 INFO:tasks.workunit.client.1.smithi102.stdout:8/455: creat d0/d10/d21/d39/d50/d63/d83/f8a x:0 0 0 2024-09-19T09:02:38.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/23: dread - d3/f9 zero size 2024-09-19T09:02:38.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/16: dread d1/f2 [0,4194304] 0 2024-09-19T09:02:38.760 INFO:tasks.workunit.client.1.smithi102.stdout:9/519: creat d1/d2/d3/d1d/d4f/d6d/fa8 x:0 0 0 2024-09-19T09:02:38.760 INFO:tasks.workunit.client.1.smithi102.stdout:9/520: stat d1/d2/d3/f2c 0 2024-09-19T09:02:38.761 INFO:tasks.workunit.client.0.smithi049.stdout:0/26: rename f3 to f4 0 2024-09-19T09:02:38.762 INFO:tasks.workunit.client.1.smithi102.stdout:1/558: creat dd/d14/d35/d49/d62/d6c/fb3 x:0 0 0 2024-09-19T09:02:38.768 INFO:tasks.workunit.client.0.smithi049.stdout:8/17: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:02:38.772 INFO:tasks.workunit.client.1.smithi102.stdout:5/549: dwrite d5/d7/d1b/f9e [0,4194304] 0 2024-09-19T09:02:38.774 INFO:tasks.workunit.client.1.smithi102.stdout:7/567: symlink d1/d4/lb8 0 2024-09-19T09:02:38.776 INFO:tasks.workunit.client.0.smithi049.stdout:0/27: mkdir d5 0 2024-09-19T09:02:38.777 INFO:tasks.workunit.client.0.smithi049.stdout:0/28: chown l0 13306 1 2024-09-19T09:02:38.778 INFO:tasks.workunit.client.0.smithi049.stdout:0/29: truncate f2 4459585 0 2024-09-19T09:02:38.779 INFO:tasks.workunit.client.0.smithi049.stdout:8/18: dwrite d1/f6 [0,4194304] 0 2024-09-19T09:02:38.780 INFO:tasks.workunit.client.0.smithi049.stdout:0/30: dread - f4 zero size 2024-09-19T09:02:38.782 INFO:tasks.workunit.client.0.smithi049.stdout:5/24: rmdir d3 39 2024-09-19T09:02:38.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/25: link f2 d5/d6/f7 0 2024-09-19T09:02:38.787 INFO:tasks.workunit.client.1.smithi102.stdout:2/451: symlink d7/d12/d37/l95 0 2024-09-19T09:02:38.789 INFO:tasks.workunit.client.1.smithi102.stdout:8/456: symlink d0/d10/d21/d39/d50/d63/d83/l8b 0 2024-09-19T09:02:38.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/24: link d3/l6 d3/l9 0 2024-09-19T09:02:38.790 INFO:tasks.workunit.client.1.smithi102.stdout:8/457: chown d0/db/d1d/c57 762935944 1 2024-09-19T09:02:38.791 INFO:tasks.workunit.client.1.smithi102.stdout:9/521: symlink d1/d2/d3/d6f/d8d/la9 0 2024-09-19T09:02:38.791 INFO:tasks.workunit.client.1.smithi102.stdout:8/458: readlink d0/d10/d21/d39/l40 0 2024-09-19T09:02:38.793 INFO:tasks.workunit.client.1.smithi102.stdout:2/452: dread d7/d1a/d2b/d31/f80 [0,4194304] 0 2024-09-19T09:02:38.793 INFO:tasks.workunit.client.1.smithi102.stdout:8/459: chown d0/d4f/c55 1661130 1 2024-09-19T09:02:38.794 INFO:tasks.workunit.client.1.smithi102.stdout:1/559: dread dd/f11 [0,4194304] 0 2024-09-19T09:02:38.799 INFO:tasks.workunit.client.1.smithi102.stdout:9/522: dwrite d1/d2/f95 [0,4194304] 0 2024-09-19T09:02:38.801 INFO:tasks.workunit.client.1.smithi102.stdout:8/460: dwrite d0/d10/f48 [0,4194304] 0 2024-09-19T09:02:38.807 INFO:tasks.workunit.client.1.smithi102.stdout:9/523: dwrite d1/d2/f72 [0,4194304] 0 2024-09-19T09:02:38.811 INFO:tasks.workunit.client.1.smithi102.stdout:9/524: dread d1/d8/f56 [0,4194304] 0 2024-09-19T09:02:38.817 INFO:tasks.workunit.client.1.smithi102.stdout:9/525: dwrite d1/d2/d3/d6f/fa4 [0,4194304] 0 2024-09-19T09:02:39.045 INFO:tasks.workunit.client.0.smithi049.stdout:8/19: dread d1/f2 [0,4194304] 0 2024-09-19T09:02:39.047 INFO:tasks.workunit.client.0.smithi049.stdout:9/25: chown d3/l6 2178421 1 2024-09-19T09:02:39.048 INFO:tasks.workunit.client.0.smithi049.stdout:9/26: truncate d3/f7 521938 0 2024-09-19T09:02:39.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/31: symlink d5/l6 0 2024-09-19T09:02:39.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:38 smithi049 ceph-mon[28158]: pgmap v26: 65 pgs: 65 active+clean; 816 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 99 MiB/s wr, 307 op/s 2024-09-19T09:02:39.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/32: dwrite f2 [0,4194304] 0 2024-09-19T09:02:39.066 INFO:tasks.workunit.client.0.smithi049.stdout:0/33: dwrite f2 [4194304,4194304] 0 2024-09-19T09:02:39.069 INFO:tasks.workunit.client.1.smithi102.stdout:0/671: fsync d3/f14 0 2024-09-19T09:02:39.070 INFO:tasks.workunit.client.1.smithi102.stdout:1/560: fdatasync f4 0 2024-09-19T09:02:39.072 INFO:tasks.workunit.client.1.smithi102.stdout:2/453: mknod d7/d50/d64/d7f/d83/c96 0 2024-09-19T09:02:39.083 INFO:tasks.workunit.client.1.smithi102.stdout:3/625: getdents d2/d19/d1c/d1f 0 2024-09-19T09:02:39.088 INFO:tasks.workunit.client.1.smithi102.stdout:7/568: dwrite d1/d3/d34/f66 [0,4194304] 0 2024-09-19T09:02:39.097 INFO:tasks.workunit.client.1.smithi102.stdout:0/672: rmdir d3/dd/d10 39 2024-09-19T09:02:39.100 INFO:tasks.workunit.client.1.smithi102.stdout:1/561: symlink dd/d14/d35/d49/d62/d6c/d99/lb4 0 2024-09-19T09:02:39.103 INFO:tasks.workunit.client.1.smithi102.stdout:7/569: dread d1/d3/d20/f2c [4194304,4194304] 0 2024-09-19T09:02:39.105 INFO:tasks.workunit.client.1.smithi102.stdout:9/526: mknod d1/d2/d3/caa 0 2024-09-19T09:02:39.110 INFO:tasks.workunit.client.1.smithi102.stdout:5/550: rmdir d5/d7/d1a/d37/d39/d4c/daf 0 2024-09-19T09:02:39.111 INFO:tasks.workunit.client.1.smithi102.stdout:5/551: chown d5/f6e 22 1 2024-09-19T09:02:39.111 INFO:tasks.workunit.client.1.smithi102.stdout:6/461: getdents d1/d26/d2e 0 2024-09-19T09:02:39.112 INFO:tasks.workunit.client.1.smithi102.stdout:6/462: dread - d1/d26/d2e/d45/d47/d4d/d3b/f87 zero size 2024-09-19T09:02:39.113 INFO:tasks.workunit.client.1.smithi102.stdout:6/463: chown d1/d26/d2e/d45/d47/d4d/d35/d41/f84 3 1 2024-09-19T09:02:39.113 INFO:tasks.workunit.client.1.smithi102.stdout:4/610: getdents d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80/d9d 0 2024-09-19T09:02:39.115 INFO:tasks.workunit.client.1.smithi102.stdout:0/673: rmdir d3/dd/d1a/d32/d62 39 2024-09-19T09:02:39.118 INFO:tasks.workunit.client.1.smithi102.stdout:2/454: truncate d7/d12/f57 4477195 0 2024-09-19T09:02:39.119 INFO:tasks.workunit.client.1.smithi102.stdout:4/611: dwrite d14/d16/d17/d2e/d37/d58/f73 [0,4194304] 0 2024-09-19T09:02:39.121 INFO:tasks.workunit.client.1.smithi102.stdout:7/570: creat d1/d4/d9c/d25/fb9 x:0 0 0 2024-09-19T09:02:39.130 INFO:tasks.workunit.client.1.smithi102.stdout:5/552: unlink d5/d7/d1a/d37/d39/f87 0 2024-09-19T09:02:39.131 INFO:tasks.workunit.client.1.smithi102.stdout:5/553: chown d5/d7/d1a/d37/d50/f52 368149 1 2024-09-19T09:02:39.138 INFO:tasks.workunit.client.1.smithi102.stdout:3/626: truncate d2/d19/d1c/d2f/d5a/d84/d53/f57 3816149 0 2024-09-19T09:02:39.139 INFO:tasks.workunit.client.1.smithi102.stdout:1/562: creat dd/d14/dac/fb5 x:0 0 0 2024-09-19T09:02:39.140 INFO:tasks.workunit.client.1.smithi102.stdout:4/612: dread d14/d16/d1d/f43 [0,4194304] 0 2024-09-19T09:02:39.140 INFO:tasks.workunit.client.1.smithi102.stdout:2/455: creat d7/d1a/d56/f97 x:0 0 0 2024-09-19T09:02:39.140 INFO:tasks.workunit.client.1.smithi102.stdout:8/461: link d0/d4f/f65 d0/d10/d21/d39/d87/f8c 0 2024-09-19T09:02:39.141 INFO:tasks.workunit.client.1.smithi102.stdout:2/456: readlink d7/d1a/d2b/d31/d51/l91 0 2024-09-19T09:02:39.142 INFO:tasks.workunit.client.1.smithi102.stdout:7/571: symlink d1/d3/d72/lba 0 2024-09-19T09:02:39.143 INFO:tasks.workunit.client.1.smithi102.stdout:9/527: link d1/f5c d1/d2/d3/d6f/d8d/da2/fab 0 2024-09-19T09:02:39.144 INFO:tasks.workunit.client.1.smithi102.stdout:9/528: stat d1/d8/c83 0 2024-09-19T09:02:39.144 INFO:tasks.workunit.client.1.smithi102.stdout:9/529: readlink d1/d2/d3/d1d/l3b 0 2024-09-19T09:02:39.145 INFO:tasks.workunit.client.1.smithi102.stdout:9/530: write d1/d2/d3/d1d/f63 [5422396,130861] 0 2024-09-19T09:02:39.145 INFO:tasks.workunit.client.1.smithi102.stdout:5/554: symlink d5/d7/d1a/d42/d4b/lb1 0 2024-09-19T09:02:39.147 INFO:tasks.workunit.client.1.smithi102.stdout:6/464: creat d1/d18/d37/fa0 x:0 0 0 2024-09-19T09:02:39.148 INFO:tasks.workunit.client.1.smithi102.stdout:6/465: write d1/f2c [526587,40788] 0 2024-09-19T09:02:39.148 INFO:tasks.workunit.client.1.smithi102.stdout:0/674: creat d3/dd/d10/d15/d22/d37/d39/d44/fe0 x:0 0 0 2024-09-19T09:02:39.150 INFO:tasks.workunit.client.1.smithi102.stdout:6/466: write d1/d26/d2e/d70/f9a [582917,33480] 0 2024-09-19T09:02:39.151 INFO:tasks.workunit.client.1.smithi102.stdout:5/555: dwrite d5/f6e [0,4194304] 0 2024-09-19T09:02:39.161 INFO:tasks.workunit.client.1.smithi102.stdout:7/572: unlink d1/d3/d20/f4c 0 2024-09-19T09:02:39.162 INFO:tasks.workunit.client.1.smithi102.stdout:0/675: unlink d3/dd/d1a/l25 0 2024-09-19T09:02:39.162 INFO:tasks.workunit.client.1.smithi102.stdout:2/457: write d7/d11/f68 [2129003,74916] 0 2024-09-19T09:02:39.162 INFO:tasks.workunit.client.1.smithi102.stdout:3/627: link d2/d19/d47/db/d26/d63/f88 d2/d1e/fca 0 2024-09-19T09:02:39.162 INFO:tasks.workunit.client.1.smithi102.stdout:6/467: creat d1/d26/d4b/d94/fa1 x:0 0 0 2024-09-19T09:02:39.164 INFO:tasks.workunit.client.1.smithi102.stdout:4/613: mkdir d14/d16/d1d/d92/db1/dbd 0 2024-09-19T09:02:39.166 INFO:tasks.workunit.client.1.smithi102.stdout:0/676: read d3/dd/d5b/fcb [9940,60014] 0 2024-09-19T09:02:39.175 INFO:tasks.workunit.client.1.smithi102.stdout:7/573: truncate d1/d4/f3d 1064493 0 2024-09-19T09:02:39.175 INFO:tasks.workunit.client.1.smithi102.stdout:1/563: creat dd/d14/d35/fb6 x:0 0 0 2024-09-19T09:02:39.177 INFO:tasks.workunit.client.1.smithi102.stdout:5/556: unlink d5/d23/f82 0 2024-09-19T09:02:39.177 INFO:tasks.workunit.client.1.smithi102.stdout:2/458: dread d7/f42 [0,4194304] 0 2024-09-19T09:02:39.177 INFO:tasks.workunit.client.1.smithi102.stdout:6/468: mkdir d1/d26/d4b/d94/da2 0 2024-09-19T09:02:39.178 INFO:tasks.workunit.client.1.smithi102.stdout:3/628: mkdir d2/d1e/dcb 0 2024-09-19T09:02:39.179 INFO:tasks.workunit.client.1.smithi102.stdout:4/614: dread - d14/d16/d17/d2e/d37/d58/d89/da0/fb5 zero size 2024-09-19T09:02:39.179 INFO:tasks.workunit.client.1.smithi102.stdout:0/677: chown d3/dd/d10/d84/fdf 64764064 1 2024-09-19T09:02:39.179 INFO:tasks.workunit.client.1.smithi102.stdout:3/629: readlink d2/d19/d1c/d2f/d5a/d84/d64/l95 0 2024-09-19T09:02:39.184 INFO:tasks.workunit.client.1.smithi102.stdout:7/574: read d1/d2f/f82 [1473029,116500] 0 2024-09-19T09:02:39.184 INFO:tasks.workunit.client.1.smithi102.stdout:7/575: chown d1/d3/d34/d4f/f50 7 1 2024-09-19T09:02:39.185 INFO:tasks.workunit.client.1.smithi102.stdout:1/564: stat dd/d13/d2d/l9b 0 2024-09-19T09:02:39.185 INFO:tasks.workunit.client.1.smithi102.stdout:7/576: truncate d1/d3/d20/f44 8600422 0 2024-09-19T09:02:39.187 INFO:tasks.workunit.client.1.smithi102.stdout:2/459: creat d7/d1a/d56/f98 x:0 0 0 2024-09-19T09:02:39.194 INFO:tasks.workunit.client.1.smithi102.stdout:0/678: creat d3/dd/d10/d15/d22/d2a/dba/d8b/fe1 x:0 0 0 2024-09-19T09:02:39.195 INFO:tasks.workunit.client.1.smithi102.stdout:0/679: chown d3/dd/d10/d15/d22/d2a/dba/f43 3883 1 2024-09-19T09:02:39.198 INFO:tasks.workunit.client.1.smithi102.stdout:1/565: symlink dd/d14/d35/d49/d7d/d7f/lb7 0 2024-09-19T09:02:39.204 INFO:tasks.workunit.client.1.smithi102.stdout:0/680: mkdir d3/dd/d10/d15/d22/d2a/dba/d9d/de2 0 2024-09-19T09:02:39.205 INFO:tasks.workunit.client.1.smithi102.stdout:0/681: chown d3/dd/d10/d15/d22/d2a/f6c 998 1 2024-09-19T09:02:39.208 INFO:tasks.workunit.client.1.smithi102.stdout:0/682: truncate d3/dd/d10/d15/d22/d37/d39/fa5 626232 0 2024-09-19T09:02:39.209 INFO:tasks.workunit.client.1.smithi102.stdout:0/683: dread - d3/dd/d10/d15/d22/d4a/d80/fc6 zero size 2024-09-19T09:02:39.210 INFO:tasks.workunit.client.1.smithi102.stdout:4/615: creat d14/d16/d17/d2e/d37/d58/d89/da6/fbe x:0 0 0 2024-09-19T09:02:39.211 INFO:tasks.workunit.client.1.smithi102.stdout:0/684: fsync d3/dd/d10/d15/d22/d37/d39/d44/fe0 0 2024-09-19T09:02:39.212 INFO:tasks.workunit.client.1.smithi102.stdout:3/630: creat d2/d19/d47/fcc x:0 0 0 2024-09-19T09:02:39.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/566: dread dd/d13/d2d/f39 [0,4194304] 0 2024-09-19T09:02:39.213 INFO:tasks.workunit.client.1.smithi102.stdout:0/685: chown d3/dd/d10/d15/d22/cbc 12816582 1 2024-09-19T09:02:39.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/567: fdatasync dd/d14/f2c 0 2024-09-19T09:02:39.218 INFO:tasks.workunit.client.1.smithi102.stdout:3/631: dwrite d2/d1e/f4d [0,4194304] 0 2024-09-19T09:02:39.218 INFO:tasks.workunit.client.1.smithi102.stdout:8/462: write d0/d10/d21/f43 [759905,111087] 0 2024-09-19T09:02:39.220 INFO:tasks.workunit.client.1.smithi102.stdout:3/632: read d2/d19/d47/db/f3c [2798729,122935] 0 2024-09-19T09:02:39.223 INFO:tasks.workunit.client.1.smithi102.stdout:1/568: mkdir dd/d14/d35/d49/d62/d6c/d99/db8 0 2024-09-19T09:02:39.224 INFO:tasks.workunit.client.1.smithi102.stdout:1/569: write fc [3427297,46746] 0 2024-09-19T09:02:39.224 INFO:tasks.workunit.client.1.smithi102.stdout:3/633: read d2/d1e/fac [1650143,24978] 0 2024-09-19T09:02:39.231 INFO:tasks.workunit.client.1.smithi102.stdout:8/463: dwrite d0/db/f89 [0,4194304] 0 2024-09-19T09:02:39.231 INFO:tasks.workunit.client.1.smithi102.stdout:4/616: creat d14/d16/fbf x:0 0 0 2024-09-19T09:02:39.231 INFO:tasks.workunit.client.1.smithi102.stdout:8/464: chown d0/db/d1d 76548935 1 2024-09-19T09:02:39.243 INFO:tasks.workunit.client.1.smithi102.stdout:5/557: dwrite d5/d7/d1a/d37/d34/d4d/f64 [0,4194304] 0 2024-09-19T09:02:39.248 INFO:tasks.workunit.client.1.smithi102.stdout:7/577: dwrite d1/d2d/f97 [0,4194304] 0 2024-09-19T09:02:39.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:38 smithi102 ceph-mon[35280]: pgmap v26: 65 pgs: 65 active+clean; 816 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 99 MiB/s wr, 307 op/s 2024-09-19T09:02:39.287 INFO:tasks.workunit.client.1.smithi102.stdout:9/531: sync 2024-09-19T09:02:39.287 INFO:tasks.workunit.client.1.smithi102.stdout:9/532: fdatasync d1/d2/d3/d1d/f66 0 2024-09-19T09:02:39.287 INFO:tasks.workunit.client.1.smithi102.stdout:9/533: chown d1/d2/ff 962061 1 2024-09-19T09:02:39.297 INFO:tasks.workunit.client.1.smithi102.stdout:9/534: dread d1/d2/f4a [0,4194304] 0 2024-09-19T09:02:39.298 INFO:tasks.workunit.client.1.smithi102.stdout:9/535: write d1/d2/d3/f4b [5113339,67173] 0 2024-09-19T09:02:39.299 INFO:tasks.workunit.client.1.smithi102.stdout:9/536: write d1/d2/d3/d1d/f63 [6551233,88625] 0 2024-09-19T09:02:39.315 INFO:tasks.workunit.client.1.smithi102.stdout:1/570: rename dd/c85 to dd/d66/cb9 0 2024-09-19T09:02:39.324 INFO:tasks.workunit.client.1.smithi102.stdout:5/558: symlink d5/d7/d1a/d37/d39/d81/lb2 0 2024-09-19T09:02:39.330 INFO:tasks.workunit.client.1.smithi102.stdout:0/686: write d3/dd/d10/d15/d22/d2a/dba/f58 [1944231,52336] 0 2024-09-19T09:02:39.345 INFO:tasks.workunit.client.1.smithi102.stdout:4/617: rmdir d14/d16/d1d/d48/dbc 0 2024-09-19T09:02:39.345 INFO:tasks.workunit.client.1.smithi102.stdout:4/618: chown d14/d16/d1d/d92/db1/dbd 143578357 1 2024-09-19T09:02:39.363 INFO:tasks.workunit.client.1.smithi102.stdout:0/687: symlink d3/dd/d10/d15/d22/d37/d39/d44/d54/dd4/le3 0 2024-09-19T09:02:39.367 INFO:tasks.workunit.client.0.smithi049.stdout:5/25: creat d3/d5/fb x:0 0 0 2024-09-19T09:02:39.373 INFO:tasks.workunit.client.1.smithi102.stdout:0/688: link d3/dd/d1a/d32/d7f/d99/fbd d3/dd/d10/d8e/fe4 0 2024-09-19T09:02:39.374 INFO:tasks.workunit.client.0.smithi049.stdout:9/27: creat d3/fa x:0 0 0 2024-09-19T09:02:39.378 INFO:tasks.workunit.client.0.smithi049.stdout:5/26: mkdir d3/dc 0 2024-09-19T09:02:39.378 INFO:tasks.workunit.client.0.smithi049.stdout:5/27: fsync d3/f8 0 2024-09-19T09:02:39.380 INFO:tasks.workunit.client.1.smithi102.stdout:0/689: dread d3/dd/f7c [0,4194304] 0 2024-09-19T09:02:39.381 INFO:tasks.workunit.client.0.smithi049.stdout:8/20: rename d1/f6 to d1/f7 0 2024-09-19T09:02:39.394 INFO:tasks.workunit.client.0.smithi049.stdout:9/28: symlink d3/lb 0 2024-09-19T09:02:39.397 INFO:tasks.workunit.client.1.smithi102.stdout:0/690: rename d3/dd/d10/d15/d22/d2a/dba/d8b to d3/dd/d10/d15/d22/d37/d39/d44/d54/de5 0 2024-09-19T09:02:39.397 INFO:tasks.workunit.client.1.smithi102.stdout:6/469: sync 2024-09-19T09:02:39.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/29: symlink d3/lc 0 2024-09-19T09:02:39.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/30: chown d3/fa 0 1 2024-09-19T09:02:39.398 INFO:tasks.workunit.client.0.smithi049.stdout:9/31: dread - d3/fa zero size 2024-09-19T09:02:39.398 INFO:tasks.workunit.client.0.smithi049.stdout:0/34: link d5/l6 d5/l7 0 2024-09-19T09:02:39.399 INFO:tasks.workunit.client.1.smithi102.stdout:0/691: mkdir d3/dd/d10/d15/d19/d8d/de6 0 2024-09-19T09:02:39.400 INFO:tasks.workunit.client.1.smithi102.stdout:0/692: chown d3/dd/d10/d15 23632 1 2024-09-19T09:02:39.401 INFO:tasks.workunit.client.1.smithi102.stdout:0/693: write d3/dd/d10/d15/d22/d37/d3d/fbe [583470,96732] 0 2024-09-19T09:02:39.402 INFO:tasks.workunit.client.1.smithi102.stdout:6/470: mknod d1/d26/d4b/ca3 0 2024-09-19T09:02:39.403 INFO:tasks.workunit.client.0.smithi049.stdout:5/28: truncate d3/f6 344560 0 2024-09-19T09:02:39.414 INFO:tasks.workunit.client.0.smithi049.stdout:5/29: symlink d3/dc/ld 0 2024-09-19T09:02:39.441 INFO:tasks.workunit.client.1.smithi102.stdout:4/619: dwrite d14/d34/d5a/d5c/d79/d8c/fa9 [0,4194304] 0 2024-09-19T09:02:39.442 INFO:tasks.workunit.client.1.smithi102.stdout:4/620: dread - d14/d34/d5a/d5c/f8d zero size 2024-09-19T09:02:39.444 INFO:tasks.workunit.client.1.smithi102.stdout:4/621: mknod d14/d34/d9f/cc0 0 2024-09-19T09:02:39.446 INFO:tasks.workunit.client.1.smithi102.stdout:4/622: chown d14/d34/d5a/l7d 1382279 1 2024-09-19T09:02:39.448 INFO:tasks.workunit.client.1.smithi102.stdout:4/623: creat d14/d34/d5a/d5c/d79/fc1 x:0 0 0 2024-09-19T09:02:39.450 INFO:tasks.workunit.client.1.smithi102.stdout:4/624: fsync d14/d34/d5a/d5c/d81/d75/f77 0 2024-09-19T09:02:39.454 INFO:tasks.workunit.client.1.smithi102.stdout:4/625: dread d14/d16/d1d/f43 [0,4194304] 0 2024-09-19T09:02:39.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/21: fsync d1/f7 0 2024-09-19T09:02:39.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/22: mknod d1/c8 0 2024-09-19T09:02:39.459 INFO:tasks.workunit.client.0.smithi049.stdout:8/23: read d1/f2 [1512529,69571] 0 2024-09-19T09:02:39.459 INFO:tasks.workunit.client.1.smithi102.stdout:4/626: dwrite d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f6b [4194304,4194304] 0 2024-09-19T09:02:39.462 INFO:tasks.workunit.client.1.smithi102.stdout:2/460: sync 2024-09-19T09:02:39.462 INFO:tasks.workunit.client.1.smithi102.stdout:3/634: sync 2024-09-19T09:02:39.462 INFO:tasks.workunit.client.1.smithi102.stdout:2/461: stat d7/f42 0 2024-09-19T09:02:39.462 INFO:tasks.workunit.client.1.smithi102.stdout:4/627: symlink d14/d16/d1d/d92/db1/lc2 0 2024-09-19T09:02:39.463 INFO:tasks.workunit.client.1.smithi102.stdout:3/635: chown d2/d19/d1c/d2f/d5a/d84/d53/fbb 5 1 2024-09-19T09:02:39.463 INFO:tasks.workunit.client.0.smithi049.stdout:8/24: dread d1/f2 [0,4194304] 0 2024-09-19T09:02:39.464 INFO:tasks.workunit.client.1.smithi102.stdout:2/462: truncate d7/d1a/d2b/d31/f3c 649988 0 2024-09-19T09:02:39.464 INFO:tasks.workunit.client.0.smithi049.stdout:8/25: read d1/f7 [2027502,20720] 0 2024-09-19T09:02:39.465 INFO:tasks.workunit.client.1.smithi102.stdout:3/636: chown d2/d19/d35/f5c 71414 1 2024-09-19T09:02:39.466 INFO:tasks.workunit.client.0.smithi049.stdout:8/26: creat d1/f9 x:0 0 0 2024-09-19T09:02:39.467 INFO:tasks.workunit.client.1.smithi102.stdout:3/637: read d2/d19/d47/db/f25 [1422104,88065] 0 2024-09-19T09:02:39.467 INFO:tasks.workunit.client.1.smithi102.stdout:2/463: creat d7/d50/f99 x:0 0 0 2024-09-19T09:02:39.468 INFO:tasks.workunit.client.1.smithi102.stdout:3/638: readlink d2/d19/d35/l76 0 2024-09-19T09:02:39.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/27: symlink d1/la 0 2024-09-19T09:02:39.470 INFO:tasks.workunit.client.1.smithi102.stdout:3/639: symlink d2/d19/d47/db/d26/lcd 0 2024-09-19T09:02:39.472 INFO:tasks.workunit.client.0.smithi049.stdout:8/28: link d1/f7 d1/fb 0 2024-09-19T09:02:39.473 INFO:tasks.workunit.client.1.smithi102.stdout:3/640: truncate d2/d1e/fca 1538381 0 2024-09-19T09:02:39.474 INFO:tasks.workunit.client.1.smithi102.stdout:3/641: fsync d2/d19/d47/db/d26/d63/d6f/d96/f9e 0 2024-09-19T09:02:39.475 INFO:tasks.workunit.client.1.smithi102.stdout:3/642: mkdir d2/d19/d35/dce 0 2024-09-19T09:02:39.477 INFO:tasks.workunit.client.1.smithi102.stdout:3/643: write d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/fc2 [831284,18237] 0 2024-09-19T09:02:39.505 INFO:tasks.workunit.client.1.smithi102.stdout:5/559: sync 2024-09-19T09:02:39.505 INFO:tasks.workunit.client.1.smithi102.stdout:8/465: sync 2024-09-19T09:02:39.505 INFO:tasks.workunit.client.1.smithi102.stdout:9/537: sync 2024-09-19T09:02:39.505 INFO:tasks.workunit.client.1.smithi102.stdout:7/578: sync 2024-09-19T09:02:39.505 INFO:tasks.workunit.client.1.smithi102.stdout:1/571: sync 2024-09-19T09:02:39.506 INFO:tasks.workunit.client.1.smithi102.stdout:1/572: stat dd/d13/d2d/c33 0 2024-09-19T09:02:39.506 INFO:tasks.workunit.client.1.smithi102.stdout:8/466: rmdir d0/db/d29 39 2024-09-19T09:02:39.507 INFO:tasks.workunit.client.1.smithi102.stdout:1/573: fsync dd/d13/d2d/d78/fb1 0 2024-09-19T09:02:39.507 INFO:tasks.workunit.client.1.smithi102.stdout:9/538: symlink d1/lac 0 2024-09-19T09:02:39.508 INFO:tasks.workunit.client.1.smithi102.stdout:7/579: mknod d1/d4/d9c/d25/d52/cbb 0 2024-09-19T09:02:39.509 INFO:tasks.workunit.client.1.smithi102.stdout:1/574: creat dd/d14/d35/d49/fba x:0 0 0 2024-09-19T09:02:39.513 INFO:tasks.workunit.client.1.smithi102.stdout:5/560: truncate d5/d7/d1a/d37/d39/d4c/f5d 1395413 0 2024-09-19T09:02:39.514 INFO:tasks.workunit.client.1.smithi102.stdout:8/467: dwrite d0/d10/d21/f43 [0,4194304] 0 2024-09-19T09:02:39.515 INFO:tasks.workunit.client.1.smithi102.stdout:9/539: dwrite d1/d2/d3/d1d/f30 [0,4194304] 0 2024-09-19T09:02:39.516 INFO:tasks.workunit.client.1.smithi102.stdout:5/561: mknod d5/d7/d1a/d37/d39/d4c/d89/cb3 0 2024-09-19T09:02:39.521 INFO:tasks.workunit.client.1.smithi102.stdout:8/468: fdatasync d0/d10/f7c 0 2024-09-19T09:02:39.521 INFO:tasks.workunit.client.1.smithi102.stdout:1/575: link dd/d14/d35/d49/d62/d6c/d99/lb4 dd/d7a/d8c/lbb 0 2024-09-19T09:02:39.523 INFO:tasks.workunit.client.1.smithi102.stdout:1/576: dread - dd/d13/d2d/d78/fb1 zero size 2024-09-19T09:02:39.526 INFO:tasks.workunit.client.1.smithi102.stdout:9/540: dwrite d1/d2/f4a [4194304,4194304] 0 2024-09-19T09:02:39.526 INFO:tasks.workunit.client.1.smithi102.stdout:8/469: rename d0/f7 to d0/db/d1d/f8d 0 2024-09-19T09:02:39.527 INFO:tasks.workunit.client.1.smithi102.stdout:9/541: read d1/d2/f37 [251276,8717] 0 2024-09-19T09:02:39.599 INFO:tasks.workunit.client.1.smithi102.stdout:8/470: creat d0/d10/d21/d39/d87/f8e x:0 0 0 2024-09-19T09:02:39.601 INFO:tasks.workunit.client.1.smithi102.stdout:8/471: creat d0/db/d1d/d69/f8f x:0 0 0 2024-09-19T09:02:39.603 INFO:tasks.workunit.client.1.smithi102.stdout:8/472: mknod d0/d10/c90 0 2024-09-19T09:02:39.605 INFO:tasks.workunit.client.1.smithi102.stdout:8/473: creat d0/db/d84/f91 x:0 0 0 2024-09-19T09:02:39.605 INFO:tasks.workunit.client.1.smithi102.stdout:8/474: read d0/db/d1d/f34 [222050,17680] 0 2024-09-19T09:02:39.607 INFO:tasks.workunit.client.1.smithi102.stdout:8/475: unlink d0/d4f/c55 0 2024-09-19T09:02:39.612 INFO:tasks.workunit.client.1.smithi102.stdout:8/476: creat d0/d10/f92 x:0 0 0 2024-09-19T09:02:39.615 INFO:tasks.workunit.client.1.smithi102.stdout:9/542: read d1/d2/d3/fa [3438753,95430] 0 2024-09-19T09:02:39.620 INFO:tasks.workunit.client.1.smithi102.stdout:9/543: dwrite d1/d2/d3/d1d/d4f/d6d/f9e [0,4194304] 0 2024-09-19T09:02:39.622 INFO:tasks.workunit.client.1.smithi102.stdout:6/471: write d1/d18/d37/f4e [788715,69827] 0 2024-09-19T09:02:39.626 INFO:tasks.workunit.client.1.smithi102.stdout:3/644: unlink d2/d19/d47/db/f3c 0 2024-09-19T09:02:39.627 INFO:tasks.workunit.client.1.smithi102.stdout:0/694: dwrite d3/dd/d10/f6a [0,4194304] 0 2024-09-19T09:02:39.628 INFO:tasks.workunit.client.1.smithi102.stdout:6/472: mkdir d1/d26/d2e/d45/d47/d4d/d35/d41/da4 0 2024-09-19T09:02:39.629 INFO:tasks.workunit.client.0.smithi049.stdout:0/35: truncate f2 2912295 0 2024-09-19T09:02:39.630 INFO:tasks.workunit.client.1.smithi102.stdout:6/473: dread d1/f1b [0,4194304] 0 2024-09-19T09:02:39.631 INFO:tasks.workunit.client.1.smithi102.stdout:9/544: unlink d1/d8/c1e 0 2024-09-19T09:02:39.632 INFO:tasks.workunit.client.1.smithi102.stdout:6/474: readlink d1/d26/d2e/d45/d47/d4d/d3b/l5a 0 2024-09-19T09:02:39.633 INFO:tasks.workunit.client.1.smithi102.stdout:0/695: fdatasync d3/dd/f21 0 2024-09-19T09:02:39.633 INFO:tasks.workunit.client.1.smithi102.stdout:9/545: readlink d1/d8/d1c/l5b 0 2024-09-19T09:02:39.634 INFO:tasks.workunit.client.0.smithi049.stdout:0/36: symlink d5/l8 0 2024-09-19T09:02:39.636 INFO:tasks.workunit.client.1.smithi102.stdout:3/645: creat d2/d19/d47/db/d26/d63/d6f/fcf x:0 0 0 2024-09-19T09:02:39.639 INFO:tasks.workunit.client.0.smithi049.stdout:0/37: creat d5/f9 x:0 0 0 2024-09-19T09:02:39.643 INFO:tasks.workunit.client.0.smithi049.stdout:0/38: readlink d5/l7 0 2024-09-19T09:02:39.645 INFO:tasks.workunit.client.1.smithi102.stdout:6/475: dread d1/d26/d2e/d45/d47/f75 [0,4194304] 0 2024-09-19T09:02:39.646 INFO:tasks.workunit.client.1.smithi102.stdout:3/646: creat d2/d19/d1c/d2f/d5a/d84/d4f/fd0 x:0 0 0 2024-09-19T09:02:39.648 INFO:tasks.workunit.client.1.smithi102.stdout:2/464: dread d7/d50/d64/d7f/d83/f76 [0,4194304] 0 2024-09-19T09:02:39.649 INFO:tasks.workunit.client.1.smithi102.stdout:0/696: link d3/dd/d10/f6a d3/dd/d10/d15/d22/d82/fe7 0 2024-09-19T09:02:39.651 INFO:tasks.workunit.client.1.smithi102.stdout:8/477: dread d0/d4f/f74 [0,4194304] 0 2024-09-19T09:02:39.653 INFO:tasks.workunit.client.1.smithi102.stdout:3/647: rename d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/fa4 to d2/d19/d1c/d2f/d5a/d84/d4f/fd1 0 2024-09-19T09:02:39.656 INFO:tasks.workunit.client.1.smithi102.stdout:8/478: symlink d0/d64/l93 0 2024-09-19T09:02:39.656 INFO:tasks.workunit.client.1.smithi102.stdout:3/648: mknod d2/d19/d47/db/d26/d63/d6f/d96/cd2 0 2024-09-19T09:02:39.657 INFO:tasks.workunit.client.1.smithi102.stdout:6/476: dwrite d1/d18/db/f10 [4194304,4194304] 0 2024-09-19T09:02:39.658 INFO:tasks.workunit.client.1.smithi102.stdout:3/649: dread - d2/d19/d1c/d1f/fc7 zero size 2024-09-19T09:02:39.663 INFO:tasks.workunit.client.1.smithi102.stdout:3/650: dread d2/d19/d1c/d2f/d5a/d84/fa3 [0,4194304] 0 2024-09-19T09:02:39.664 INFO:tasks.workunit.client.1.smithi102.stdout:4/628: write d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f38 [103666,90521] 0 2024-09-19T09:02:39.664 INFO:tasks.workunit.client.1.smithi102.stdout:8/479: dwrite d0/db/f15 [8388608,4194304] 0 2024-09-19T09:02:39.666 INFO:tasks.workunit.client.0.smithi049.stdout:8/29: fsync d1/f7 0 2024-09-19T09:02:39.676 INFO:tasks.workunit.client.1.smithi102.stdout:4/629: creat d14/d16/fc3 x:0 0 0 2024-09-19T09:02:39.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/30: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:02:39.678 INFO:tasks.workunit.client.1.smithi102.stdout:4/630: chown d14/d34/d5a/d5c/d79/d8c/fb7 0 1 2024-09-19T09:02:39.678 INFO:tasks.workunit.client.1.smithi102.stdout:3/651: rename d2/d19/d1c/d2f/d5a/d84/d53/f57 to d2/d19/d1c/d2f/d5a/fd3 0 2024-09-19T09:02:39.680 INFO:tasks.workunit.client.1.smithi102.stdout:4/631: fsync d14/d16/d17/d2e/d37/f76 0 2024-09-19T09:02:39.681 INFO:tasks.workunit.client.0.smithi049.stdout:8/31: rmdir d1 39 2024-09-19T09:02:39.683 INFO:tasks.workunit.client.1.smithi102.stdout:7/580: dwrite d1/d3/d72/f75 [4194304,4194304] 0 2024-09-19T09:02:39.685 INFO:tasks.workunit.client.1.smithi102.stdout:5/562: truncate d5/d7/d1a/f58 4174156 0 2024-09-19T09:02:39.686 INFO:tasks.workunit.client.1.smithi102.stdout:4/632: fsync d14/d34/d5a/d5c/f8d 0 2024-09-19T09:02:39.686 INFO:tasks.workunit.client.1.smithi102.stdout:7/581: write d1/d4/d9c/d25/f81 [141135,99236] 0 2024-09-19T09:02:39.688 INFO:tasks.workunit.client.0.smithi049.stdout:8/32: unlink d1/f2 0 2024-09-19T09:02:39.689 INFO:tasks.workunit.client.0.smithi049.stdout:8/33: dread - d1/f9 zero size 2024-09-19T09:02:39.690 INFO:tasks.workunit.client.1.smithi102.stdout:5/563: write d5/d7/d1a/d37/d34/d4d/f64 [3952064,70039] 0 2024-09-19T09:02:39.690 INFO:tasks.workunit.client.1.smithi102.stdout:8/480: dread d0/d10/d21/f6c [0,4194304] 0 2024-09-19T09:02:39.691 INFO:tasks.workunit.client.1.smithi102.stdout:4/633: read d14/d16/d17/d2e/d37/d58/d89/d78/f8b [2676141,59568] 0 2024-09-19T09:02:39.696 INFO:tasks.workunit.client.0.smithi049.stdout:8/34: unlink d1/l3 0 2024-09-19T09:02:39.697 INFO:tasks.workunit.client.1.smithi102.stdout:5/564: dwrite d5/d7/d1a/d37/d39/d4c/f9b [0,4194304] 0 2024-09-19T09:02:39.697 INFO:tasks.workunit.client.0.smithi049.stdout:5/30: write d3/f6 [843171,8942] 0 2024-09-19T09:02:39.698 INFO:tasks.workunit.client.0.smithi049.stdout:5/31: dread - d3/d5/fb zero size 2024-09-19T09:02:39.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/32: chown d3/la 62 1 2024-09-19T09:02:39.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/33: readlink d3/la 0 2024-09-19T09:02:39.699 INFO:tasks.workunit.client.1.smithi102.stdout:8/481: mknod d0/d10/d21/d39/c94 0 2024-09-19T09:02:39.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/35: symlink d1/lc 0 2024-09-19T09:02:39.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/39: rename f2 to d5/fa 0 2024-09-19T09:02:39.706 INFO:tasks.workunit.client.0.smithi049.stdout:0/40: write d5/f9 [327605,87684] 0 2024-09-19T09:02:39.708 INFO:tasks.workunit.client.0.smithi049.stdout:8/36: fdatasync d1/f7 0 2024-09-19T09:02:39.710 INFO:tasks.workunit.client.1.smithi102.stdout:1/577: creat dd/d7a/d8c/fbc x:0 0 0 2024-09-19T09:02:39.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/41: unlink f4 0 2024-09-19T09:02:39.714 INFO:tasks.workunit.client.1.smithi102.stdout:8/482: creat d0/db/d84/f95 x:0 0 0 2024-09-19T09:02:39.715 INFO:tasks.workunit.client.0.smithi049.stdout:0/42: write d5/f9 [1003615,15894] 0 2024-09-19T09:02:39.715 INFO:tasks.workunit.client.1.smithi102.stdout:8/483: read d0/f56 [6247651,16672] 0 2024-09-19T09:02:39.716 INFO:tasks.workunit.client.0.smithi049.stdout:8/37: dwrite d1/fb [4194304,4194304] 0 2024-09-19T09:02:39.720 INFO:tasks.workunit.client.1.smithi102.stdout:9/546: dwrite d1/d8/d1c/f21 [0,4194304] 0 2024-09-19T09:02:39.724 INFO:tasks.workunit.client.0.smithi049.stdout:0/43: dwrite d5/f9 [0,4194304] 0 2024-09-19T09:02:39.725 INFO:tasks.workunit.client.1.smithi102.stdout:7/582: dread d1/d4/d9c/d25/f94 [0,4194304] 0 2024-09-19T09:02:39.725 INFO:tasks.workunit.client.1.smithi102.stdout:7/583: dread - d1/d3/f93 zero size 2024-09-19T09:02:39.726 INFO:tasks.workunit.client.1.smithi102.stdout:7/584: write d1/d3/d72/f75 [1485231,21592] 0 2024-09-19T09:02:39.727 INFO:tasks.workunit.client.1.smithi102.stdout:7/585: chown d1/d3/f9 1889 1 2024-09-19T09:02:39.728 INFO:tasks.workunit.client.1.smithi102.stdout:7/586: chown d1/d4/d9c/d25/d52/d7f/c96 0 1 2024-09-19T09:02:39.732 INFO:tasks.workunit.client.0.smithi049.stdout:8/38: creat d1/fd x:0 0 0 2024-09-19T09:02:39.735 INFO:tasks.workunit.client.1.smithi102.stdout:4/634: link d14/d16/d17/d2e/d37/d58/d89/da6/d7c/la7 d14/d34/d5a/lc4 0 2024-09-19T09:02:39.735 INFO:tasks.workunit.client.1.smithi102.stdout:0/697: dwrite d3/dd/d10/d15/d22/d4a/d80/fb5 [0,4194304] 0 2024-09-19T09:02:39.737 INFO:tasks.workunit.client.0.smithi049.stdout:8/39: readlink l0 0 2024-09-19T09:02:39.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/40: readlink d1/l5 0 2024-09-19T09:02:39.738 INFO:tasks.workunit.client.1.smithi102.stdout:6/477: truncate d1/d26/d4b/d94/f8b 1135239 0 2024-09-19T09:02:39.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/41: write d1/fb [245894,105114] 0 2024-09-19T09:02:39.739 INFO:tasks.workunit.client.0.smithi049.stdout:8/42: chown d1/la 1194956730 1 2024-09-19T09:02:39.741 INFO:tasks.workunit.client.1.smithi102.stdout:8/484: unlink d0/db/d1d/d69/f8f 0 2024-09-19T09:02:39.742 INFO:tasks.workunit.client.1.smithi102.stdout:6/478: dread - d1/d26/d2e/d45/d47/d4d/d3b/d8d/f92 zero size 2024-09-19T09:02:39.743 INFO:tasks.workunit.client.0.smithi049.stdout:8/43: mknod d1/ce 0 2024-09-19T09:02:39.744 INFO:tasks.workunit.client.1.smithi102.stdout:6/479: read - d1/d26/d2e/d45/d47/d4d/f72 zero size 2024-09-19T09:02:39.746 INFO:tasks.workunit.client.1.smithi102.stdout:1/578: symlink dd/d14/d35/d49/d62/d9e/dab/lbd 0 2024-09-19T09:02:39.748 INFO:tasks.workunit.client.1.smithi102.stdout:9/547: dread d1/d2/d3/d1d/d4f/d6d/d81/d90/f93 [0,4194304] 0 2024-09-19T09:02:39.753 INFO:tasks.workunit.client.1.smithi102.stdout:5/565: creat d5/d7/d1a/d37/d39/d4c/fb4 x:0 0 0 2024-09-19T09:02:39.753 INFO:tasks.workunit.client.1.smithi102.stdout:0/698: chown d3/dd/d10/d15/d2c/f59 3334 1 2024-09-19T09:02:39.753 INFO:tasks.workunit.client.1.smithi102.stdout:4/635: mknod d14/d16/d1d/d92/db1/cc5 0 2024-09-19T09:02:39.753 INFO:tasks.workunit.client.1.smithi102.stdout:4/636: chown d14/d16/d1d/f72 129431 1 2024-09-19T09:02:39.756 INFO:tasks.workunit.client.1.smithi102.stdout:3/652: read d2/d1e/fca [1182596,93386] 0 2024-09-19T09:02:39.760 INFO:tasks.workunit.client.1.smithi102.stdout:2/465: sync 2024-09-19T09:02:39.761 INFO:tasks.workunit.client.1.smithi102.stdout:6/480: mknod d1/d3a/ca5 0 2024-09-19T09:02:39.762 INFO:tasks.workunit.client.0.smithi049.stdout:8/44: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:02:39.763 INFO:tasks.workunit.client.0.smithi049.stdout:8/45: write d1/fb [8522448,69505] 0 2024-09-19T09:02:39.764 INFO:tasks.workunit.client.1.smithi102.stdout:7/587: getdents d1/d4/d9c/d25/db1 0 2024-09-19T09:02:39.766 INFO:tasks.workunit.client.1.smithi102.stdout:7/588: write d1/d4/d9c/d25/fb9 [314337,21665] 0 2024-09-19T09:02:39.767 INFO:tasks.workunit.client.1.smithi102.stdout:2/466: dwrite d7/d11/f8e [0,4194304] 0 2024-09-19T09:02:39.769 INFO:tasks.workunit.client.1.smithi102.stdout:5/566: symlink d5/d7/d1a/d42/d4b/lb5 0 2024-09-19T09:02:39.773 INFO:tasks.workunit.client.1.smithi102.stdout:0/699: write d3/dd/d10/d15/d22/d82/fe7 [18249,124913] 0 2024-09-19T09:02:39.778 INFO:tasks.workunit.client.1.smithi102.stdout:9/548: creat d1/d8/d98/fad x:0 0 0 2024-09-19T09:02:39.778 INFO:tasks.workunit.client.1.smithi102.stdout:2/467: mknod d7/d12/d37/c9a 0 2024-09-19T09:02:39.779 INFO:tasks.workunit.client.1.smithi102.stdout:9/549: fsync d1/d2/d3/d1d/f30 0 2024-09-19T09:02:39.780 INFO:tasks.workunit.client.1.smithi102.stdout:9/550: write d1/f64 [899400,84722] 0 2024-09-19T09:02:39.780 INFO:tasks.workunit.client.1.smithi102.stdout:5/567: mkdir d5/d60/db6 0 2024-09-19T09:02:39.782 INFO:tasks.workunit.client.1.smithi102.stdout:4/637: symlink d14/d16/d17/d2e/d37/d58/d89/da6/lc6 0 2024-09-19T09:02:39.783 INFO:tasks.workunit.client.1.smithi102.stdout:3/653: creat d2/d1e/dc5/fd4 x:0 0 0 2024-09-19T09:02:39.784 INFO:tasks.workunit.client.1.smithi102.stdout:8/485: creat d0/f96 x:0 0 0 2024-09-19T09:02:39.785 INFO:tasks.workunit.client.1.smithi102.stdout:1/579: creat dd/d14/fbe x:0 0 0 2024-09-19T09:02:39.787 INFO:tasks.workunit.client.1.smithi102.stdout:1/580: chown dd/d13/d3b 3 1 2024-09-19T09:02:39.787 INFO:tasks.workunit.client.1.smithi102.stdout:7/589: dwrite d1/d4/d9c/d25/d52/fa8 [0,4194304] 0 2024-09-19T09:02:39.790 INFO:tasks.workunit.client.1.smithi102.stdout:4/638: mknod d14/d34/d5a/d5c/d79/d8c/cc7 0 2024-09-19T09:02:39.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/46: fsync d1/f7 0 2024-09-19T09:02:39.793 INFO:tasks.workunit.client.1.smithi102.stdout:3/654: mknod d2/d19/d35/dce/cd5 0 2024-09-19T09:02:39.793 INFO:tasks.workunit.client.1.smithi102.stdout:1/581: symlink dd/lbf 0 2024-09-19T09:02:39.794 INFO:tasks.workunit.client.1.smithi102.stdout:0/700: dwrite d3/dd/f7c [0,4194304] 0 2024-09-19T09:02:39.797 INFO:tasks.workunit.client.1.smithi102.stdout:6/481: dread d1/d18/db/f31 [0,4194304] 0 2024-09-19T09:02:39.801 INFO:tasks.workunit.client.1.smithi102.stdout:0/701: unlink d3/dd/d10/cb8 0 2024-09-19T09:02:39.802 INFO:tasks.workunit.client.1.smithi102.stdout:2/468: getdents d7/d12/d37 0 2024-09-19T09:02:39.803 INFO:tasks.workunit.client.1.smithi102.stdout:8/486: dread d0/d4f/f76 [0,4194304] 0 2024-09-19T09:02:39.804 INFO:tasks.workunit.client.1.smithi102.stdout:9/551: dwrite d1/d2/d3/d1d/f76 [0,4194304] 0 2024-09-19T09:02:39.804 INFO:tasks.workunit.client.1.smithi102.stdout:3/655: creat d2/d19/d47/db/fd6 x:0 0 0 2024-09-19T09:02:39.805 INFO:tasks.workunit.client.1.smithi102.stdout:1/582: truncate dd/d14/d35/d49/d62/d6c/f8a 928014 0 2024-09-19T09:02:39.805 INFO:tasks.workunit.client.1.smithi102.stdout:6/482: mknod d1/d18/db/d65/d8e/ca6 0 2024-09-19T09:02:39.806 INFO:tasks.workunit.client.1.smithi102.stdout:6/483: chown d1/d3a 121832 1 2024-09-19T09:02:39.806 INFO:tasks.workunit.client.1.smithi102.stdout:3/656: chown d2/d19/d47/lbe 28645637 1 2024-09-19T09:02:39.806 INFO:tasks.workunit.client.1.smithi102.stdout:9/552: fdatasync d1/d2/d7b/fa3 0 2024-09-19T09:02:39.808 INFO:tasks.workunit.client.1.smithi102.stdout:0/702: mkdir d3/dcf/de8 0 2024-09-19T09:02:39.810 INFO:tasks.workunit.client.1.smithi102.stdout:1/583: mknod dd/d14/d18/cc0 0 2024-09-19T09:02:39.810 INFO:tasks.workunit.client.0.smithi049.stdout:0/44: write d5/fa [2847061,44096] 0 2024-09-19T09:02:39.811 INFO:tasks.workunit.client.0.smithi049.stdout:0/45: write d5/f9 [1106351,79169] 0 2024-09-19T09:02:39.812 INFO:tasks.workunit.client.1.smithi102.stdout:9/553: write d1/d2/d78/f7d [251274,59388] 0 2024-09-19T09:02:39.813 INFO:tasks.workunit.client.1.smithi102.stdout:3/657: mknod d2/d1e/d54/cd7 0 2024-09-19T09:02:39.816 INFO:tasks.workunit.client.1.smithi102.stdout:2/469: truncate d7/d12/f57 3756001 0 2024-09-19T09:02:39.817 INFO:tasks.workunit.client.0.smithi049.stdout:0/46: rename d5/l7 to d5/lb 0 2024-09-19T09:02:39.817 INFO:tasks.workunit.client.0.smithi049.stdout:0/47: chown d5/fa 825 1 2024-09-19T09:02:39.820 INFO:tasks.workunit.client.1.smithi102.stdout:8/487: rename d0/db/d1d/d69 to d0/db/d29/d97 0 2024-09-19T09:02:39.822 INFO:tasks.workunit.client.1.smithi102.stdout:9/554: creat d1/d2/d3/d6f/fae x:0 0 0 2024-09-19T09:02:39.822 INFO:tasks.workunit.client.1.smithi102.stdout:4/639: truncate d14/d34/f6e 3924622 0 2024-09-19T09:02:39.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/48: fdatasync d5/f9 0 2024-09-19T09:02:39.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/49: read d5/fa [1416426,27548] 0 2024-09-19T09:02:39.824 INFO:tasks.workunit.client.1.smithi102.stdout:2/470: unlink d7/d12/f40 0 2024-09-19T09:02:39.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/50: dread d5/fa [0,4194304] 0 2024-09-19T09:02:39.829 INFO:tasks.workunit.client.0.smithi049.stdout:0/51: dread d5/f9 [0,4194304] 0 2024-09-19T09:02:39.830 INFO:tasks.workunit.client.1.smithi102.stdout:8/488: symlink d0/db/d29/d97/l98 0 2024-09-19T09:02:39.832 INFO:tasks.workunit.client.1.smithi102.stdout:9/555: fdatasync d1/d8/f56 0 2024-09-19T09:02:39.833 INFO:tasks.workunit.client.0.smithi049.stdout:0/52: creat d5/fc x:0 0 0 2024-09-19T09:02:39.833 INFO:tasks.workunit.client.1.smithi102.stdout:1/584: dread dd/d14/f4e [0,4194304] 0 2024-09-19T09:02:39.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/53: creat d5/fd x:0 0 0 2024-09-19T09:02:39.841 INFO:tasks.workunit.client.0.smithi049.stdout:0/54: write d5/fa [1604543,73383] 0 2024-09-19T09:02:39.843 INFO:tasks.workunit.client.1.smithi102.stdout:0/703: rmdir d3/dd/d1a/d32/d7f/dc5 0 2024-09-19T09:02:39.844 INFO:tasks.workunit.client.1.smithi102.stdout:8/489: dread d0/db/d1d/f31 [0,4194304] 0 2024-09-19T09:02:39.844 INFO:tasks.workunit.client.1.smithi102.stdout:4/640: dread fe [0,4194304] 0 2024-09-19T09:02:39.844 INFO:tasks.workunit.client.1.smithi102.stdout:0/704: write d3/dd/f1f [369270,7290] 0 2024-09-19T09:02:39.845 INFO:tasks.workunit.client.0.smithi049.stdout:0/55: symlink d5/le 0 2024-09-19T09:02:39.847 INFO:tasks.workunit.client.1.smithi102.stdout:8/490: truncate d0/d10/d21/f43 4439690 0 2024-09-19T09:02:39.848 INFO:tasks.workunit.client.1.smithi102.stdout:2/471: mknod d7/d1a/d2b/c9b 0 2024-09-19T09:02:39.852 INFO:tasks.workunit.client.1.smithi102.stdout:1/585: symlink dd/d13/lc1 0 2024-09-19T09:02:39.854 INFO:tasks.workunit.client.1.smithi102.stdout:8/491: symlink d0/db/d1d/l99 0 2024-09-19T09:02:39.854 INFO:tasks.workunit.client.1.smithi102.stdout:5/568: sync 2024-09-19T09:02:39.856 INFO:tasks.workunit.client.1.smithi102.stdout:2/472: creat d7/d1a/d2b/d31/d51/d6b/f9c x:0 0 0 2024-09-19T09:02:39.857 INFO:tasks.workunit.client.1.smithi102.stdout:3/658: dwrite d2/d1e/d54/fb9 [0,4194304] 0 2024-09-19T09:02:39.858 INFO:tasks.workunit.client.1.smithi102.stdout:6/484: dwrite d1/d26/d4b/d94/f8b [0,4194304] 0 2024-09-19T09:02:39.859 INFO:tasks.workunit.client.1.smithi102.stdout:5/569: write d5/d7/d1b/f46 [578045,94256] 0 2024-09-19T09:02:39.861 INFO:tasks.workunit.client.1.smithi102.stdout:8/492: mkdir d0/d10/d3a/d9a 0 2024-09-19T09:02:39.863 INFO:tasks.workunit.client.1.smithi102.stdout:2/473: chown d7/d1a/d56/f5c 0 1 2024-09-19T09:02:39.864 INFO:tasks.workunit.client.1.smithi102.stdout:4/641: dread d14/d16/d17/d2e/d37/d58/d89/da6/f7f [0,4194304] 0 2024-09-19T09:02:39.866 INFO:tasks.workunit.client.1.smithi102.stdout:0/705: rename d3/dd/d10/f9f to d3/dd/d10/d15/d22/fe9 0 2024-09-19T09:02:39.869 INFO:tasks.workunit.client.1.smithi102.stdout:8/493: mkdir d0/d10/d9b 0 2024-09-19T09:02:39.871 INFO:tasks.workunit.client.1.smithi102.stdout:2/474: creat d7/d1a/d3d/f9d x:0 0 0 2024-09-19T09:02:39.872 INFO:tasks.workunit.client.1.smithi102.stdout:0/706: dread d3/dd/d5b/fcb [0,4194304] 0 2024-09-19T09:02:39.872 INFO:tasks.workunit.client.1.smithi102.stdout:1/586: dread dd/f16 [4194304,4194304] 0 2024-09-19T09:02:39.872 INFO:tasks.workunit.client.1.smithi102.stdout:4/642: write d14/d16/d17/d2e/d37/f76 [264919,50156] 0 2024-09-19T09:02:39.872 INFO:tasks.workunit.client.1.smithi102.stdout:9/556: dwrite d1/d2/d78/f89 [4194304,4194304] 0 2024-09-19T09:02:39.873 INFO:tasks.workunit.client.1.smithi102.stdout:5/570: rename d5/d7/d1a/d37/d34/d73/c93 to d5/d23/cb7 0 2024-09-19T09:02:39.873 INFO:tasks.workunit.client.1.smithi102.stdout:2/475: stat d7/d1a/d2b/d31/l62 0 2024-09-19T09:02:39.876 INFO:tasks.workunit.client.1.smithi102.stdout:2/476: chown d7/d12/c30 26138512 1 2024-09-19T09:02:39.878 INFO:tasks.workunit.client.1.smithi102.stdout:1/587: readlink dd/l74 0 2024-09-19T09:02:39.878 INFO:tasks.workunit.client.1.smithi102.stdout:6/485: write d1/ff [1426989,100155] 0 2024-09-19T09:02:39.880 INFO:tasks.workunit.client.1.smithi102.stdout:8/494: dwrite d0/db/f15 [4194304,4194304] 0 2024-09-19T09:02:39.881 INFO:tasks.workunit.client.1.smithi102.stdout:2/477: truncate d7/d50/d64/d7f/d83/f76 5153537 0 2024-09-19T09:02:39.881 INFO:tasks.workunit.client.1.smithi102.stdout:4/643: mknod d14/d34/d5a/d5c/d79/cc8 0 2024-09-19T09:02:39.881 INFO:tasks.workunit.client.1.smithi102.stdout:6/486: fsync d1/d18/db/f10 0 2024-09-19T09:02:39.883 INFO:tasks.workunit.client.1.smithi102.stdout:2/478: write d7/d50/f8a [132265,56240] 0 2024-09-19T09:02:39.885 INFO:tasks.workunit.client.1.smithi102.stdout:3/659: rename d2/d19/d1c/d2f/d5a/d84/la9 to d2/ld8 0 2024-09-19T09:02:39.886 INFO:tasks.workunit.client.1.smithi102.stdout:7/590: sync 2024-09-19T09:02:39.889 INFO:tasks.workunit.client.1.smithi102.stdout:8/495: dwrite d0/f42 [0,4194304] 0 2024-09-19T09:02:39.890 INFO:tasks.workunit.client.1.smithi102.stdout:0/707: link d3/dd/d10/d15/d2c/f59 d3/fea 0 2024-09-19T09:02:39.892 INFO:tasks.workunit.client.1.smithi102.stdout:5/571: mkdir d5/d7/d1a/d37/d34/d4d/d9c/db8 0 2024-09-19T09:02:39.895 INFO:tasks.workunit.client.1.smithi102.stdout:9/557: write d1/f5c [848041,43909] 0 2024-09-19T09:02:39.897 INFO:tasks.workunit.client.1.smithi102.stdout:7/591: dwrite d1/d3/d34/f66 [0,4194304] 0 2024-09-19T09:02:39.897 INFO:tasks.workunit.client.1.smithi102.stdout:3/660: mkdir d2/d19/d47/db/d8b/dd9 0 2024-09-19T09:02:39.900 INFO:tasks.workunit.client.1.smithi102.stdout:0/708: creat d3/dd/d72/feb x:0 0 0 2024-09-19T09:02:39.903 INFO:tasks.workunit.client.1.smithi102.stdout:7/592: mknod d1/d2f/cbc 0 2024-09-19T09:02:39.905 INFO:tasks.workunit.client.1.smithi102.stdout:9/558: creat d1/d2/d3/d1d/d4f/d6d/d81/d90/faf x:0 0 0 2024-09-19T09:02:39.906 INFO:tasks.workunit.client.1.smithi102.stdout:8/496: symlink d0/d10/d3a/d9a/l9c 0 2024-09-19T09:02:39.906 INFO:tasks.workunit.client.1.smithi102.stdout:7/593: write d1/d4/d9c/f62 [680995,130628] 0 2024-09-19T09:02:39.909 INFO:tasks.workunit.client.1.smithi102.stdout:4/644: write d14/d16/d17/d2e/f4e [271725,91349] 0 2024-09-19T09:02:39.909 INFO:tasks.workunit.client.1.smithi102.stdout:7/594: creat d1/d4/fbd x:0 0 0 2024-09-19T09:02:39.910 INFO:tasks.workunit.client.1.smithi102.stdout:4/645: stat d14/d16/d1d/d92/f93 0 2024-09-19T09:02:39.910 INFO:tasks.workunit.client.1.smithi102.stdout:8/497: write d0/db/d1d/f31 [3072536,77936] 0 2024-09-19T09:02:39.911 INFO:tasks.workunit.client.1.smithi102.stdout:9/559: rename d1/d2/d3/d1d/l52 to d1/d2/d3/d1d/d4f/d6d/lb0 0 2024-09-19T09:02:39.913 INFO:tasks.workunit.client.1.smithi102.stdout:7/595: mknod d1/d4/d9c/d25/d52/cbe 0 2024-09-19T09:02:39.913 INFO:tasks.workunit.client.1.smithi102.stdout:9/560: chown d1/d2/d3/d1d/f6a 3 1 2024-09-19T09:02:39.914 INFO:tasks.workunit.client.1.smithi102.stdout:9/561: chown d1/d2/d3/d6f/d8d/da2 24 1 2024-09-19T09:02:39.918 INFO:tasks.workunit.client.1.smithi102.stdout:9/562: creat d1/d2/d3/d1d/fb1 x:0 0 0 2024-09-19T09:02:39.921 INFO:tasks.workunit.client.1.smithi102.stdout:1/588: truncate dd/f25 2506120 0 2024-09-19T09:02:39.921 INFO:tasks.workunit.client.1.smithi102.stdout:5/572: dread d5/d7/f35 [0,4194304] 0 2024-09-19T09:02:39.921 INFO:tasks.workunit.client.1.smithi102.stdout:8/498: dwrite d0/d10/d21/d39/d87/f8e [0,4194304] 0 2024-09-19T09:02:39.928 INFO:tasks.workunit.client.1.smithi102.stdout:9/563: dwrite d1/d2/d3/d1d/d4f/d6d/f7c [0,4194304] 0 2024-09-19T09:02:39.930 INFO:tasks.workunit.client.1.smithi102.stdout:0/709: dread d3/dd/d10/d15/d19/d7e/faf [0,4194304] 0 2024-09-19T09:02:39.998 INFO:tasks.workunit.client.1.smithi102.stdout:2/479: sync 2024-09-19T09:02:40.048 INFO:tasks.workunit.client.1.smithi102.stdout:7/596: sync 2024-09-19T09:02:40.048 INFO:tasks.workunit.client.1.smithi102.stdout:9/564: sync 2024-09-19T09:02:40.048 INFO:tasks.workunit.client.1.smithi102.stdout:9/565: read d1/d2/f4a [4795916,14166] 0 2024-09-19T09:02:40.049 INFO:tasks.workunit.client.1.smithi102.stdout:7/597: write d1/d4/d9c/d25/d52/f58 [2890092,92962] 0 2024-09-19T09:02:40.051 INFO:tasks.workunit.client.1.smithi102.stdout:6/487: truncate d1/d18/f25 1639753 0 2024-09-19T09:02:40.051 INFO:tasks.workunit.client.1.smithi102.stdout:6/488: chown d1/d3a/f7c 160 1 2024-09-19T09:02:40.053 INFO:tasks.workunit.client.1.smithi102.stdout:6/489: write d1/d26/d2e/d45/d47/d4d/d3b/d8d/f92 [566731,68587] 0 2024-09-19T09:02:40.054 INFO:tasks.workunit.client.1.smithi102.stdout:1/589: unlink dd/d13/lc1 0 2024-09-19T09:02:40.054 INFO:tasks.workunit.client.1.smithi102.stdout:6/490: stat d1/d18/db/l4f 0 2024-09-19T09:02:40.056 INFO:tasks.workunit.client.1.smithi102.stdout:4/646: dread d14/d16/d17/f66 [0,4194304] 0 2024-09-19T09:02:40.059 INFO:tasks.workunit.client.1.smithi102.stdout:5/573: creat d5/d7/d1a/d37/d34/d73/fb9 x:0 0 0 2024-09-19T09:02:40.060 INFO:tasks.workunit.client.1.smithi102.stdout:3/661: write d2/d19/d35/f41 [3511572,51871] 0 2024-09-19T09:02:40.061 INFO:tasks.workunit.client.1.smithi102.stdout:8/499: creat d0/d10/d3a/d9a/f9d x:0 0 0 2024-09-19T09:02:40.064 INFO:tasks.workunit.client.1.smithi102.stdout:0/710: fdatasync d3/dd/d10/d8e/fe4 0 2024-09-19T09:02:40.066 INFO:tasks.workunit.client.1.smithi102.stdout:5/574: dwrite d5/d7/d1b/f1c [4194304,4194304] 0 2024-09-19T09:02:40.071 INFO:tasks.workunit.client.1.smithi102.stdout:8/500: dwrite d0/f96 [0,4194304] 0 2024-09-19T09:02:40.074 INFO:tasks.workunit.client.1.smithi102.stdout:0/711: dwrite d3/dd/d10/d15/d22/d37/f9a [0,4194304] 0 2024-09-19T09:02:40.076 INFO:tasks.workunit.client.1.smithi102.stdout:0/712: dread d3/dd/d10/d15/d22/d37/d39/fa5 [0,4194304] 0 2024-09-19T09:02:40.080 INFO:tasks.workunit.client.1.smithi102.stdout:1/590: mkdir dd/d14/dac/dc2 0 2024-09-19T09:02:40.081 INFO:tasks.workunit.client.1.smithi102.stdout:1/591: fdatasync f4 0 2024-09-19T09:02:40.085 INFO:tasks.workunit.client.1.smithi102.stdout:4/647: mkdir d14/d16/d17/d2e/d37/d58/d89/da6/d2f/dc9 0 2024-09-19T09:02:40.096 INFO:tasks.workunit.client.1.smithi102.stdout:5/575: truncate d5/d7/d1a/d37/d34/f49 933659 0 2024-09-19T09:02:40.100 INFO:tasks.workunit.client.1.smithi102.stdout:0/713: write d3/dd/d10/d8e/fe4 [1517134,34411] 0 2024-09-19T09:02:40.102 INFO:tasks.workunit.client.1.smithi102.stdout:7/598: rename d1/c8 to d1/d4/d9c/d25/cbf 0 2024-09-19T09:02:40.103 INFO:tasks.workunit.client.1.smithi102.stdout:9/566: dwrite d1/d8/d1c/f62 [0,4194304] 0 2024-09-19T09:02:40.107 INFO:tasks.workunit.client.1.smithi102.stdout:6/491: creat d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fa7 x:0 0 0 2024-09-19T09:02:40.107 INFO:tasks.workunit.client.1.smithi102.stdout:3/662: dread d2/d1e/fac [0,4194304] 0 2024-09-19T09:02:40.114 INFO:tasks.workunit.client.1.smithi102.stdout:2/480: truncate d7/d11/f68 2139824 0 2024-09-19T09:02:40.114 INFO:tasks.workunit.client.1.smithi102.stdout:2/481: chown f3 432039 1 2024-09-19T09:02:40.122 INFO:tasks.workunit.client.1.smithi102.stdout:2/482: dwrite d7/d11/f1c [0,4194304] 0 2024-09-19T09:02:40.126 INFO:tasks.workunit.client.1.smithi102.stdout:1/592: creat dd/d7a/d8c/d8e/fc3 x:0 0 0 2024-09-19T09:02:40.127 INFO:tasks.workunit.client.1.smithi102.stdout:3/663: dread d2/d19/d1c/d2f/d5a/fd3 [0,4194304] 0 2024-09-19T09:02:40.138 INFO:tasks.workunit.client.1.smithi102.stdout:5/576: truncate d5/d7/d1a/d37/d34/f4e 856556 0 2024-09-19T09:02:40.140 INFO:tasks.workunit.client.1.smithi102.stdout:2/483: unlink d7/d1a/d2b/c6f 0 2024-09-19T09:02:40.143 INFO:tasks.workunit.client.1.smithi102.stdout:8/501: rename d0/f35 to d0/d10/d21/d39/d50/d63/d83/f9e 0 2024-09-19T09:02:40.148 INFO:tasks.workunit.client.1.smithi102.stdout:3/664: mknod d2/d1e/dc5/cda 0 2024-09-19T09:02:40.149 INFO:tasks.workunit.client.1.smithi102.stdout:3/665: write d2/d1e/f4d [3959389,22704] 0 2024-09-19T09:02:40.152 INFO:tasks.workunit.client.1.smithi102.stdout:4/648: link d14/d34/d5a/d5c/d79/cc8 d14/d16/d17/d2e/d37/d58/d89/da6/d2f/dc9/cca 0 2024-09-19T09:02:40.155 INFO:tasks.workunit.client.1.smithi102.stdout:8/502: dread d0/d10/f48 [0,4194304] 0 2024-09-19T09:02:40.160 INFO:tasks.workunit.client.1.smithi102.stdout:1/593: mknod dd/d14/d35/d49/d62/d6c/d99/db8/cc4 0 2024-09-19T09:02:40.164 INFO:tasks.workunit.client.1.smithi102.stdout:3/666: write d2/d19/d35/f41 [2394900,129469] 0 2024-09-19T09:02:40.167 INFO:tasks.workunit.client.1.smithi102.stdout:3/667: dread d2/d19/d1c/d70/f8a [0,4194304] 0 2024-09-19T09:02:40.168 INFO:tasks.workunit.client.1.smithi102.stdout:6/492: truncate d1/d26/d4b/d94/f73 225312 0 2024-09-19T09:02:40.169 INFO:tasks.workunit.client.1.smithi102.stdout:2/484: mkdir d7/d12/d37/d93/d9e 0 2024-09-19T09:02:40.170 INFO:tasks.workunit.client.1.smithi102.stdout:2/485: chown d7/d12/d37/d93 267449896 1 2024-09-19T09:02:40.172 INFO:tasks.workunit.client.1.smithi102.stdout:8/503: mknod d0/db/d29/d97/c9f 0 2024-09-19T09:02:40.173 INFO:tasks.workunit.client.1.smithi102.stdout:7/599: sync 2024-09-19T09:02:40.173 INFO:tasks.workunit.client.1.smithi102.stdout:3/668: dwrite d2/d1e/dc5/fd4 [0,4194304] 0 2024-09-19T09:02:40.178 INFO:tasks.workunit.client.1.smithi102.stdout:1/594: symlink dd/d66/lc5 0 2024-09-19T09:02:40.178 INFO:tasks.workunit.client.1.smithi102.stdout:1/595: stat dd/d13/c21 0 2024-09-19T09:02:40.180 INFO:tasks.workunit.client.1.smithi102.stdout:4/649: mknod d14/d16/d17/d2e/ccb 0 2024-09-19T09:02:40.185 INFO:tasks.workunit.client.1.smithi102.stdout:0/714: rename d3/dd/d10/d15/d22/d37/d39/d44/d54/c5d to d3/dd/d1a/d32/cec 0 2024-09-19T09:02:40.189 INFO:tasks.workunit.client.1.smithi102.stdout:8/504: symlink d0/db/d84/la0 0 2024-09-19T09:02:40.190 INFO:tasks.workunit.client.1.smithi102.stdout:8/505: fsync d0/d4f/f81 0 2024-09-19T09:02:40.190 INFO:tasks.workunit.client.1.smithi102.stdout:0/715: dwrite d3/dd/ff [0,4194304] 0 2024-09-19T09:02:40.190 INFO:tasks.workunit.client.1.smithi102.stdout:8/506: fdatasync d0/db/d1d/f31 0 2024-09-19T09:02:40.191 INFO:tasks.workunit.client.1.smithi102.stdout:1/596: symlink dd/d7a/d8c/d8e/lc6 0 2024-09-19T09:02:40.192 INFO:tasks.workunit.client.1.smithi102.stdout:8/507: write d0/d10/f37 [4704861,19169] 0 2024-09-19T09:02:40.192 INFO:tasks.workunit.client.1.smithi102.stdout:5/577: getdents d5/d7/d1a/d37/d34/d7f 0 2024-09-19T09:02:40.194 INFO:tasks.workunit.client.1.smithi102.stdout:8/508: chown d0/d10/d21/d39/d50/d63 0 1 2024-09-19T09:02:40.197 INFO:tasks.workunit.client.1.smithi102.stdout:6/493: getdents d1/d26/d4b/d94/da2 0 2024-09-19T09:02:40.203 INFO:tasks.workunit.client.1.smithi102.stdout:6/494: dwrite d1/d18/f6a [0,4194304] 0 2024-09-19T09:02:40.208 INFO:tasks.workunit.client.1.smithi102.stdout:5/578: dread d5/d7/d1a/d42/f6d [0,4194304] 0 2024-09-19T09:02:40.209 INFO:tasks.workunit.client.1.smithi102.stdout:0/716: readlink d3/dd/d1a/l40 0 2024-09-19T09:02:40.212 INFO:tasks.workunit.client.1.smithi102.stdout:2/486: write d7/d1a/f2a [20246,105942] 0 2024-09-19T09:02:40.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/597: symlink dd/d13/d2d/d78/lc7 0 2024-09-19T09:02:40.218 INFO:tasks.workunit.client.1.smithi102.stdout:4/650: link d14/d34/d5a/d5c/d81/f61 d14/d16/d17/d2e/d37/d58/d89/da6/d2f/fcc 0 2024-09-19T09:02:40.227 INFO:tasks.workunit.client.1.smithi102.stdout:2/487: creat d7/d12/f9f x:0 0 0 2024-09-19T09:02:40.228 INFO:tasks.workunit.client.1.smithi102.stdout:3/669: truncate d2/d19/d1c/d2f/d5a/d84/d4f/fb0 1357891 0 2024-09-19T09:02:40.229 INFO:tasks.workunit.client.1.smithi102.stdout:1/598: symlink dd/d14/d18/lc8 0 2024-09-19T09:02:40.234 INFO:tasks.workunit.client.1.smithi102.stdout:0/717: dwrite d3/dd/d1a/d32/d62/f97 [0,4194304] 0 2024-09-19T09:02:40.235 INFO:tasks.workunit.client.1.smithi102.stdout:9/567: rename d1/d2/f95 to d1/d2/d3/fb2 0 2024-09-19T09:02:40.237 INFO:tasks.workunit.client.1.smithi102.stdout:6/495: symlink d1/d26/la8 0 2024-09-19T09:02:40.241 INFO:tasks.workunit.client.1.smithi102.stdout:3/670: symlink d2/d19/d1c/d1f/d5f/ldb 0 2024-09-19T09:02:40.252 INFO:tasks.workunit.client.1.smithi102.stdout:4/651: symlink d14/lcd 0 2024-09-19T09:02:40.252 INFO:tasks.workunit.client.1.smithi102.stdout:8/509: link d0/d10/d21/c6d d0/d10/d21/d39/d50/d63/d83/ca1 0 2024-09-19T09:02:40.253 INFO:tasks.workunit.client.1.smithi102.stdout:8/510: write d0/d5a/f71 [236127,47184] 0 2024-09-19T09:02:40.256 INFO:tasks.workunit.client.1.smithi102.stdout:7/600: rename d1/d3/d34/d4f/f61 to d1/d3/d34/d74/fc0 0 2024-09-19T09:02:40.260 INFO:tasks.workunit.client.1.smithi102.stdout:1/599: creat dd/d7a/d8c/da6/fc9 x:0 0 0 2024-09-19T09:02:40.262 INFO:tasks.workunit.client.1.smithi102.stdout:1/600: chown dd/d14/d35/d49/d62/fa9 5316879 1 2024-09-19T09:02:40.264 INFO:tasks.workunit.client.1.smithi102.stdout:6/496: dwrite d1/d26/d2e/d45/d47/d4d/f72 [0,4194304] 0 2024-09-19T09:02:40.265 INFO:tasks.workunit.client.1.smithi102.stdout:8/511: mkdir d0/d10/d21/d39/d50/da2 0 2024-09-19T09:02:40.266 INFO:tasks.workunit.client.1.smithi102.stdout:8/512: write d0/d4f/f81 [559000,76470] 0 2024-09-19T09:02:40.272 INFO:tasks.workunit.client.1.smithi102.stdout:5/579: rename d5/d7/d1a/d37/d39/d4c/la7 to d5/d7/d1a/d37/d34/d73/d9d/lba 0 2024-09-19T09:02:40.273 INFO:tasks.workunit.client.1.smithi102.stdout:5/580: chown d5/d7/d1a/d37/f2b 17 1 2024-09-19T09:02:40.280 INFO:tasks.workunit.client.1.smithi102.stdout:5/581: dwrite d5/d7/d1a/d37/f45 [0,4194304] 0 2024-09-19T09:02:40.280 INFO:tasks.workunit.client.1.smithi102.stdout:0/718: rmdir d3/dcf/de8 0 2024-09-19T09:02:40.282 INFO:tasks.workunit.client.1.smithi102.stdout:5/582: read d5/d7/d1a/d37/d39/d4c/f9b [3097453,127587] 0 2024-09-19T09:02:40.282 INFO:tasks.workunit.client.1.smithi102.stdout:8/513: creat d0/d10/d3a/d9a/fa3 x:0 0 0 2024-09-19T09:02:40.283 INFO:tasks.workunit.client.1.smithi102.stdout:5/583: fsync d5/d23/f24 0 2024-09-19T09:02:40.285 INFO:tasks.workunit.client.1.smithi102.stdout:6/497: dwrite d1/d26/d4b/d94/f8b [0,4194304] 0 2024-09-19T09:02:40.288 INFO:tasks.workunit.client.1.smithi102.stdout:4/652: creat d14/d16/fce x:0 0 0 2024-09-19T09:02:40.294 INFO:tasks.workunit.client.1.smithi102.stdout:1/601: unlink dd/d13/l92 0 2024-09-19T09:02:40.299 INFO:tasks.workunit.client.1.smithi102.stdout:0/719: creat d3/dd/d10/d15/d22/d37/d39/d44/dab/fed x:0 0 0 2024-09-19T09:02:40.300 INFO:tasks.workunit.client.1.smithi102.stdout:8/514: mknod d0/d4f/ca4 0 2024-09-19T09:02:40.302 INFO:tasks.workunit.client.1.smithi102.stdout:5/584: creat d5/d7/d1a/d37/d39/d81/fbb x:0 0 0 2024-09-19T09:02:40.304 INFO:tasks.workunit.client.1.smithi102.stdout:8/515: dread d0/f96 [0,4194304] 0 2024-09-19T09:02:40.304 INFO:tasks.workunit.client.1.smithi102.stdout:6/498: mknod d1/d26/d2e/d45/d47/d4d/d35/d41/da4/ca9 0 2024-09-19T09:02:40.305 INFO:tasks.workunit.client.1.smithi102.stdout:6/499: stat d1/d18/db/d65 0 2024-09-19T09:02:40.305 INFO:tasks.workunit.client.1.smithi102.stdout:8/516: write d0/d10/d3a/d9a/fa3 [499826,108565] 0 2024-09-19T09:02:40.306 INFO:tasks.workunit.client.1.smithi102.stdout:4/653: rmdir d14/d34/d9f 39 2024-09-19T09:02:40.313 INFO:tasks.workunit.client.1.smithi102.stdout:5/585: unlink d5/d60/c79 0 2024-09-19T09:02:40.315 INFO:tasks.workunit.client.1.smithi102.stdout:2/488: rename d7/d11/f1e to d7/fa0 0 2024-09-19T09:02:40.316 INFO:tasks.workunit.client.1.smithi102.stdout:8/517: mkdir d0/db/d1d/da5 0 2024-09-19T09:02:40.318 INFO:tasks.workunit.client.1.smithi102.stdout:6/500: creat d1/d26/d2e/d45/d47/d4d/d3b/d8d/faa x:0 0 0 2024-09-19T09:02:40.318 INFO:tasks.workunit.client.1.smithi102.stdout:5/586: dwrite d5/fe [4194304,4194304] 0 2024-09-19T09:02:40.320 INFO:tasks.workunit.client.1.smithi102.stdout:5/587: dread - d5/d7/d1a/f88 zero size 2024-09-19T09:02:40.320 INFO:tasks.workunit.client.1.smithi102.stdout:4/654: mknod d14/d16/d17/d2e/d37/d58/d89/da0/ccf 0 2024-09-19T09:02:40.323 INFO:tasks.workunit.client.1.smithi102.stdout:8/518: dwrite d0/db/d84/f95 [0,4194304] 0 2024-09-19T09:02:40.333 INFO:tasks.workunit.client.1.smithi102.stdout:2/489: mkdir d7/d50/d64/da1 0 2024-09-19T09:02:40.334 INFO:tasks.workunit.client.1.smithi102.stdout:6/501: write d1/d18/db/d65/f83 [1033468,51618] 0 2024-09-19T09:02:40.338 INFO:tasks.workunit.client.1.smithi102.stdout:0/720: creat d3/dd/d10/d15/fee x:0 0 0 2024-09-19T09:02:40.339 INFO:tasks.workunit.client.1.smithi102.stdout:4/655: mknod d14/d34/d5a/d5c/d81/cd0 0 2024-09-19T09:02:40.340 INFO:tasks.workunit.client.1.smithi102.stdout:8/519: rmdir d0/d10/d21/d39 39 2024-09-19T09:02:40.342 INFO:tasks.workunit.client.1.smithi102.stdout:9/568: rename d1/d2/d3/d1d/d4f/c68 to d1/d2/d7b/cb3 0 2024-09-19T09:02:40.342 INFO:tasks.workunit.client.1.smithi102.stdout:9/569: stat d1/d8/f44 0 2024-09-19T09:02:40.344 INFO:tasks.workunit.client.1.smithi102.stdout:6/502: unlink d1/d18/db/c20 0 2024-09-19T09:02:40.344 INFO:tasks.workunit.client.1.smithi102.stdout:4/656: dwrite d14/d16/d17/d2e/d37/f65 [0,4194304] 0 2024-09-19T09:02:40.349 INFO:tasks.workunit.client.1.smithi102.stdout:5/588: getdents d5/d7/d1a/d37/d34/d4d/d9c/db8 0 2024-09-19T09:02:40.350 INFO:tasks.workunit.client.1.smithi102.stdout:5/589: write d5/d7/d1b/fa8 [908465,77263] 0 2024-09-19T09:02:40.359 INFO:tasks.workunit.client.1.smithi102.stdout:3/671: sync 2024-09-19T09:02:40.359 INFO:tasks.workunit.client.1.smithi102.stdout:7/601: rename d1/d4/d9c/l55 to d1/d2f/lc1 0 2024-09-19T09:02:40.359 INFO:tasks.workunit.client.1.smithi102.stdout:9/570: mkdir d1/d2/d3/d1d/d4f/d6d/db4 0 2024-09-19T09:02:40.360 INFO:tasks.workunit.client.1.smithi102.stdout:7/602: chown d1/d3/d34/l92 67 1 2024-09-19T09:02:40.361 INFO:tasks.workunit.client.1.smithi102.stdout:9/571: truncate d1/d2/d3/d1d/fb1 920926 0 2024-09-19T09:02:40.364 INFO:tasks.workunit.client.1.smithi102.stdout:4/657: dread f12 [0,4194304] 0 2024-09-19T09:02:40.365 INFO:tasks.workunit.client.1.smithi102.stdout:2/490: rmdir d7/d12/d37/d93/d9e 0 2024-09-19T09:02:40.422 INFO:tasks.workunit.client.1.smithi102.stdout:3/672: mkdir d2/d19/d35/dce/ddc 0 2024-09-19T09:02:40.422 INFO:tasks.workunit.client.1.smithi102.stdout:5/590: symlink d5/d7/d1a/d37/d34/d73/lbc 0 2024-09-19T09:02:40.423 INFO:tasks.workunit.client.1.smithi102.stdout:7/603: unlink d1/d4/d9c/d25/d52/d7f/c96 0 2024-09-19T09:02:40.423 INFO:tasks.workunit.client.1.smithi102.stdout:0/721: creat d3/dd/d1a/fef x:0 0 0 2024-09-19T09:02:40.425 INFO:tasks.workunit.client.1.smithi102.stdout:5/591: write d5/d7/d1a/d42/fa9 [765723,21900] 0 2024-09-19T09:02:40.426 INFO:tasks.workunit.client.1.smithi102.stdout:9/572: mkdir d1/db5 0 2024-09-19T09:02:40.429 INFO:tasks.workunit.client.1.smithi102.stdout:2/491: creat d7/d50/d64/da1/fa2 x:0 0 0 2024-09-19T09:02:40.432 INFO:tasks.workunit.client.1.smithi102.stdout:7/604: dread d1/d3/d20/fb2 [4194304,4194304] 0 2024-09-19T09:02:40.433 INFO:tasks.workunit.client.1.smithi102.stdout:0/722: rename d3/dd/d10/d15/d22/d37/dd7 to d3/dcf/df0 0 2024-09-19T09:02:40.434 INFO:tasks.workunit.client.1.smithi102.stdout:4/658: dread d14/d16/d17/f1f [0,4194304] 0 2024-09-19T09:02:40.434 INFO:tasks.workunit.client.1.smithi102.stdout:3/673: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9d [0,4194304] 0 2024-09-19T09:02:40.436 INFO:tasks.workunit.client.1.smithi102.stdout:9/573: mkdir d1/d2/d3/d6f/d8d/da2/db6 0 2024-09-19T09:02:40.438 INFO:tasks.workunit.client.1.smithi102.stdout:7/605: symlink d1/d4/d9c/d25/d52/lc2 0 2024-09-19T09:02:40.442 INFO:tasks.workunit.client.1.smithi102.stdout:2/492: rename d7/d1a/f2a to d7/fa3 0 2024-09-19T09:02:40.442 INFO:tasks.workunit.client.1.smithi102.stdout:9/574: mknod d1/d8/d1c/cb7 0 2024-09-19T09:02:40.443 INFO:tasks.workunit.client.1.smithi102.stdout:0/723: dwrite d3/dd/d10/d15/d22/d4a/d80/fc6 [0,4194304] 0 2024-09-19T09:02:40.449 INFO:tasks.workunit.client.1.smithi102.stdout:3/674: rename d2/d19/d1c/d2f/d5a/d84/d4f/fd0 to d2/d19/d1c/d2f/d5a/d84/d4f/d72/fdd 0 2024-09-19T09:02:40.450 INFO:tasks.workunit.client.1.smithi102.stdout:1/602: sync 2024-09-19T09:02:40.451 INFO:tasks.workunit.client.1.smithi102.stdout:9/575: creat d1/d2/d3/d1d/d4f/fb8 x:0 0 0 2024-09-19T09:02:40.454 INFO:tasks.workunit.client.1.smithi102.stdout:4/659: getdents d14/d16/d17/d2e/d37/d58/d89/da6/d7c 0 2024-09-19T09:02:40.454 INFO:tasks.workunit.client.1.smithi102.stdout:0/724: read d3/dd/d10/d15/d22/d37/d3d/f48 [763867,48704] 0 2024-09-19T09:02:40.454 INFO:tasks.workunit.client.1.smithi102.stdout:2/493: mkdir d7/da4 0 2024-09-19T09:02:40.455 INFO:tasks.workunit.client.1.smithi102.stdout:2/494: truncate d7/d1a/d56/f98 627146 0 2024-09-19T09:02:40.457 INFO:tasks.workunit.client.1.smithi102.stdout:3/675: rmdir d2/d19/d47/db/d26/d63/d6f 39 2024-09-19T09:02:40.459 INFO:tasks.workunit.client.1.smithi102.stdout:9/576: unlink d1/d2/d3/d1d/l51 0 2024-09-19T09:02:40.460 INFO:tasks.workunit.client.1.smithi102.stdout:4/660: creat d14/d16/d17/d2e/d37/d58/d89/da0/fd1 x:0 0 0 2024-09-19T09:02:40.461 INFO:tasks.workunit.client.1.smithi102.stdout:0/725: rmdir d3/dd/d10/d15/d22/d37/d39/d44/d54/de5 39 2024-09-19T09:02:40.461 INFO:tasks.workunit.client.1.smithi102.stdout:7/606: link d1/d3/d20/c5e d1/cc3 0 2024-09-19T09:02:40.463 INFO:tasks.workunit.client.1.smithi102.stdout:2/495: symlink d7/d1a/d2b/d31/d51/la5 0 2024-09-19T09:02:40.464 INFO:tasks.workunit.client.1.smithi102.stdout:2/496: chown d7/d1a/d2b/d4e/l66 7 1 2024-09-19T09:02:40.465 INFO:tasks.workunit.client.1.smithi102.stdout:2/497: truncate d7/d1a/d56/f98 1296222 0 2024-09-19T09:02:40.467 INFO:tasks.workunit.client.1.smithi102.stdout:0/726: creat d3/dcf/df0/ff1 x:0 0 0 2024-09-19T09:02:40.470 INFO:tasks.workunit.client.1.smithi102.stdout:7/607: rename d1/d4/d9c/d25/d52/d7f/l86 to d1/d3/d34/db4/lc4 0 2024-09-19T09:02:40.471 INFO:tasks.workunit.client.1.smithi102.stdout:1/603: creat dd/d14/d35/fca x:0 0 0 2024-09-19T09:02:40.472 INFO:tasks.workunit.client.1.smithi102.stdout:9/577: dwrite d1/d8/d1c/f21 [0,4194304] 0 2024-09-19T09:02:40.475 INFO:tasks.workunit.client.1.smithi102.stdout:8/520: sync 2024-09-19T09:02:40.476 INFO:tasks.workunit.client.1.smithi102.stdout:3/676: dread d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9f [0,4194304] 0 2024-09-19T09:02:40.478 INFO:tasks.workunit.client.1.smithi102.stdout:2/498: rename f3 to d7/d12/d37/fa6 0 2024-09-19T09:02:40.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/578: dread - d1/d2/d3/d1d/d4f/d6d/d81/f92 zero size 2024-09-19T09:02:40.479 INFO:tasks.workunit.client.1.smithi102.stdout:4/661: dread d14/d16/f26 [0,4194304] 0 2024-09-19T09:02:40.480 INFO:tasks.workunit.client.1.smithi102.stdout:5/592: dwrite d5/d23/d3b/f5c [0,4194304] 0 2024-09-19T09:02:40.482 INFO:tasks.workunit.client.1.smithi102.stdout:0/727: dread d3/dd/d1a/d32/d7f/d99/fbd [0,4194304] 0 2024-09-19T09:02:40.484 INFO:tasks.workunit.client.1.smithi102.stdout:4/662: fdatasync d14/d34/d5a/d5c/d79/d8c/f9e 0 2024-09-19T09:02:40.486 INFO:tasks.workunit.client.1.smithi102.stdout:0/728: write d3/dd/d10/d84/fdf [607475,56757] 0 2024-09-19T09:02:40.487 INFO:tasks.workunit.client.1.smithi102.stdout:1/604: dwrite dd/d14/d18/f37 [0,4194304] 0 2024-09-19T09:02:40.488 INFO:tasks.workunit.client.1.smithi102.stdout:3/677: mkdir d2/d19/d1c/d2f/d5a/d84/d4f/d72/dde 0 2024-09-19T09:02:40.491 INFO:tasks.workunit.client.1.smithi102.stdout:1/605: fsync dd/d14/d35/fa2 0 2024-09-19T09:02:40.494 INFO:tasks.workunit.client.1.smithi102.stdout:5/593: chown d5/d7/d1a/d37/d34/l54 13 1 2024-09-19T09:02:40.496 INFO:tasks.workunit.client.1.smithi102.stdout:0/729: chown d3/dd/d10/d15/f36 21 1 2024-09-19T09:02:40.496 INFO:tasks.workunit.client.1.smithi102.stdout:2/499: dwrite d7/d1a/d2b/d31/d51/d6b/f8c [0,4194304] 0 2024-09-19T09:02:40.498 INFO:tasks.workunit.client.1.smithi102.stdout:8/521: rename d0/l70 to d0/d10/d21/d39/d50/d63/la6 0 2024-09-19T09:02:40.499 INFO:tasks.workunit.client.1.smithi102.stdout:8/522: write d0/db/f89 [4106692,29599] 0 2024-09-19T09:02:40.503 INFO:tasks.workunit.client.1.smithi102.stdout:2/500: dwrite d7/d1a/d2b/d31/f48 [0,4194304] 0 2024-09-19T09:02:40.505 INFO:tasks.workunit.client.1.smithi102.stdout:4/663: mkdir d14/d16/d17/d2e/d37/d58/d89/da6/d2f/dd2 0 2024-09-19T09:02:40.506 INFO:tasks.workunit.client.1.smithi102.stdout:4/664: read d14/d16/d1d/f43 [3942487,125390] 0 2024-09-19T09:02:40.508 INFO:tasks.workunit.client.1.smithi102.stdout:5/594: rmdir d5/d7/d1b 39 2024-09-19T09:02:40.512 INFO:tasks.workunit.client.1.smithi102.stdout:5/595: chown d5/d7/d1a/d37/d34/l54 1430883068 1 2024-09-19T09:02:40.512 INFO:tasks.workunit.client.1.smithi102.stdout:1/606: write dd/d13/f50 [1187980,56147] 0 2024-09-19T09:02:40.512 INFO:tasks.workunit.client.1.smithi102.stdout:0/730: fsync d3/dd/d10/d15/d19/fb3 0 2024-09-19T09:02:40.513 INFO:tasks.workunit.client.1.smithi102.stdout:6/503: sync 2024-09-19T09:02:40.514 INFO:tasks.workunit.client.1.smithi102.stdout:9/579: link d1/d8/d1c/f21 d1/d8/d1c/fb9 0 2024-09-19T09:02:40.515 INFO:tasks.workunit.client.1.smithi102.stdout:7/608: dwrite d1/d3/f1c [0,4194304] 0 2024-09-19T09:02:40.517 INFO:tasks.workunit.client.1.smithi102.stdout:3/678: rmdir d2/d19/d1c/d2f/d5a/d84/d4f 39 2024-09-19T09:02:40.518 INFO:tasks.workunit.client.1.smithi102.stdout:2/501: unlink d7/d12/d37/f3a 0 2024-09-19T09:02:40.525 INFO:tasks.workunit.client.1.smithi102.stdout:1/607: rename dd/d13/d3b to dd/d14/d35/d49/dcb 0 2024-09-19T09:02:40.526 INFO:tasks.workunit.client.1.smithi102.stdout:4/665: mkdir d14/d34/d9f/dd3 0 2024-09-19T09:02:40.527 INFO:tasks.workunit.client.1.smithi102.stdout:6/504: dread d1/f7b [0,4194304] 0 2024-09-19T09:02:40.527 INFO:tasks.workunit.client.1.smithi102.stdout:5/596: dwrite d5/d7/d1a/d37/d39/d81/fab [0,4194304] 0 2024-09-19T09:02:40.528 INFO:tasks.workunit.client.1.smithi102.stdout:8/523: dread d0/f96 [0,4194304] 0 2024-09-19T09:02:40.528 INFO:tasks.workunit.client.1.smithi102.stdout:2/502: rmdir d7/d1a/d2b 39 2024-09-19T09:02:40.530 INFO:tasks.workunit.client.1.smithi102.stdout:7/609: dread d1/d3/f78 [0,4194304] 0 2024-09-19T09:02:40.531 INFO:tasks.workunit.client.1.smithi102.stdout:8/524: write d0/d10/d21/f43 [3507413,36385] 0 2024-09-19T09:02:40.531 INFO:tasks.workunit.client.1.smithi102.stdout:0/731: creat d3/dd/d10/d15/d2c/ff2 x:0 0 0 2024-09-19T09:02:40.532 INFO:tasks.workunit.client.1.smithi102.stdout:0/732: chown d3 115 1 2024-09-19T09:02:40.533 INFO:tasks.workunit.client.1.smithi102.stdout:0/733: readlink d3/dd/d10/d15/d22/d37/l5f 0 2024-09-19T09:02:40.533 INFO:tasks.workunit.client.1.smithi102.stdout:9/580: creat d1/d2/d3/d6f/d8d/da2/db6/fba x:0 0 0 2024-09-19T09:02:40.562 INFO:tasks.workunit.client.1.smithi102.stdout:4/666: creat d14/d34/d5a/d5c/fd4 x:0 0 0 2024-09-19T09:02:40.562 INFO:tasks.workunit.client.1.smithi102.stdout:1/608: rename dd/d14/d35/d49/d62/d6c/f9c to dd/d14/d35/d49/dcb/fcc 0 2024-09-19T09:02:40.563 INFO:tasks.workunit.client.1.smithi102.stdout:5/597: fdatasync d5/d7/d1a/d37/d39/d4c/f9b 0 2024-09-19T09:02:40.564 INFO:tasks.workunit.client.1.smithi102.stdout:0/734: chown d3/dd/d10/d15/d3e/c57 4 1 2024-09-19T09:02:40.564 INFO:tasks.workunit.client.1.smithi102.stdout:3/679: dread d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f8d [0,4194304] 0 2024-09-19T09:02:40.564 INFO:tasks.workunit.client.1.smithi102.stdout:9/581: creat d1/d2/d3/d1d/fbb x:0 0 0 2024-09-19T09:02:40.565 INFO:tasks.workunit.client.1.smithi102.stdout:8/525: creat d0/d10/d21/d39/d50/da2/fa7 x:0 0 0 2024-09-19T09:02:40.569 INFO:tasks.workunit.client.1.smithi102.stdout:0/735: readlink d3/dd/d72/d98/lae 0 2024-09-19T09:02:40.569 INFO:tasks.workunit.client.1.smithi102.stdout:8/526: write d0/d10/d3a/d9a/f9d [726911,52753] 0 2024-09-19T09:02:40.650 INFO:tasks.workunit.client.1.smithi102.stdout:2/503: sync 2024-09-19T09:02:40.670 INFO:tasks.workunit.client.1.smithi102.stdout:7/610: rmdir d1/d4/d9c/d25/db1 0 2024-09-19T09:02:40.671 INFO:tasks.workunit.client.1.smithi102.stdout:5/598: creat d5/d7/d1a/d8f/fbd x:0 0 0 2024-09-19T09:02:40.671 INFO:tasks.workunit.client.1.smithi102.stdout:6/505: getdents d1/d26 0 2024-09-19T09:02:40.671 INFO:tasks.workunit.client.1.smithi102.stdout:3/680: creat d2/d19/d35/dce/fdf x:0 0 0 2024-09-19T09:02:40.672 INFO:tasks.workunit.client.1.smithi102.stdout:1/609: rename dd/d14/f26 to dd/d7a/da0/fcd 0 2024-09-19T09:02:40.673 INFO:tasks.workunit.client.1.smithi102.stdout:8/527: mknod d0/d10/d3a/d9a/ca8 0 2024-09-19T09:02:40.675 INFO:tasks.workunit.client.1.smithi102.stdout:9/582: symlink d1/d2/lbc 0 2024-09-19T09:02:40.676 INFO:tasks.workunit.client.1.smithi102.stdout:5/599: symlink d5/d7/d1a/d37/d34/d4d/d9c/lbe 0 2024-09-19T09:02:40.677 INFO:tasks.workunit.client.1.smithi102.stdout:3/681: write d2/d19/d47/db/d26/d63/d6f/d96/f9e [3766590,125806] 0 2024-09-19T09:02:40.678 INFO:tasks.workunit.client.1.smithi102.stdout:0/736: symlink d3/dd/d1a/lf3 0 2024-09-19T09:02:40.678 INFO:tasks.workunit.client.1.smithi102.stdout:0/737: fsync d3/dd/d72/feb 0 2024-09-19T09:02:40.680 INFO:tasks.workunit.client.1.smithi102.stdout:1/610: rmdir dd/d14/d35 39 2024-09-19T09:02:40.682 INFO:tasks.workunit.client.1.smithi102.stdout:2/504: symlink d7/d1a/la7 0 2024-09-19T09:02:40.683 INFO:tasks.workunit.client.1.smithi102.stdout:8/528: creat d0/d10/d21/d39/d50/d63/d83/fa9 x:0 0 0 2024-09-19T09:02:40.684 INFO:tasks.workunit.client.1.smithi102.stdout:8/529: chown d0/d10/d21/f6c 21496 1 2024-09-19T09:02:40.684 INFO:tasks.workunit.client.1.smithi102.stdout:6/506: mkdir d1/d18/db/dab 0 2024-09-19T09:02:40.685 INFO:tasks.workunit.client.1.smithi102.stdout:9/583: readlink d1/d8/d1c/l11 0 2024-09-19T09:02:40.687 INFO:tasks.workunit.client.1.smithi102.stdout:7/611: write d1/d4/f21 [242796,82920] 0 2024-09-19T09:02:40.689 INFO:tasks.workunit.client.1.smithi102.stdout:7/612: dread - d1/d4/d9c/d25/f87 zero size 2024-09-19T09:02:40.690 INFO:tasks.workunit.client.1.smithi102.stdout:2/505: write d7/d12/d37/fa6 [8006014,38705] 0 2024-09-19T09:02:40.692 INFO:tasks.workunit.client.1.smithi102.stdout:0/738: mknod d3/dd/d10/d15/d22/d37/d39/d44/d54/de5/cf4 0 2024-09-19T09:02:40.694 INFO:tasks.workunit.client.1.smithi102.stdout:5/600: dread d5/d7/d1a/f74 [0,4194304] 0 2024-09-19T09:02:40.694 INFO:tasks.workunit.client.1.smithi102.stdout:3/682: dread d2/d19/d47/db/f2e [0,4194304] 0 2024-09-19T09:02:40.695 INFO:tasks.workunit.client.1.smithi102.stdout:6/507: mkdir d1/d26/d2e/d45/dac 0 2024-09-19T09:02:40.697 INFO:tasks.workunit.client.1.smithi102.stdout:7/613: rename d1/d4/fbd to d1/d2d/dab/fc5 0 2024-09-19T09:02:40.698 INFO:tasks.workunit.client.1.smithi102.stdout:0/739: mkdir d3/dd/d10/d15/d3e/df5 0 2024-09-19T09:02:40.699 INFO:tasks.workunit.client.1.smithi102.stdout:8/530: getdents d0/d10/d3a/d9a 0 2024-09-19T09:02:40.700 INFO:tasks.workunit.client.1.smithi102.stdout:5/601: fsync d5/d7/d1b/fa8 0 2024-09-19T09:02:40.701 INFO:tasks.workunit.client.1.smithi102.stdout:7/614: fsync d1/d3/f9 0 2024-09-19T09:02:40.701 INFO:tasks.workunit.client.1.smithi102.stdout:6/508: creat d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fad x:0 0 0 2024-09-19T09:02:40.703 INFO:tasks.workunit.client.1.smithi102.stdout:3/683: creat d2/d19/d47/db/dc3/fe0 x:0 0 0 2024-09-19T09:02:40.703 INFO:tasks.workunit.client.1.smithi102.stdout:7/615: rename d1 to d1/d3/d72/dc6 22 2024-09-19T09:02:40.706 INFO:tasks.workunit.client.1.smithi102.stdout:4/667: sync 2024-09-19T09:02:40.720 INFO:tasks.workunit.client.1.smithi102.stdout:5/602: creat d5/d8d/d95/fbf x:0 0 0 2024-09-19T09:02:40.721 INFO:tasks.workunit.client.1.smithi102.stdout:8/531: write d0/d10/d21/f43 [2167275,100653] 0 2024-09-19T09:02:40.721 INFO:tasks.workunit.client.1.smithi102.stdout:6/509: write d1/d26/f85 [711159,89816] 0 2024-09-19T09:02:40.724 INFO:tasks.workunit.client.1.smithi102.stdout:2/506: dwrite d7/d1a/d2b/d4e/f67 [0,4194304] 0 2024-09-19T09:02:40.725 INFO:tasks.workunit.client.1.smithi102.stdout:8/532: mkdir d0/d4f/daa 0 2024-09-19T09:02:40.726 INFO:tasks.workunit.client.1.smithi102.stdout:9/584: dread d1/d2/d3/fb2 [0,4194304] 0 2024-09-19T09:02:40.726 INFO:tasks.workunit.client.1.smithi102.stdout:1/611: dread dd/d14/d35/f58 [0,4194304] 0 2024-09-19T09:02:40.728 INFO:tasks.workunit.client.1.smithi102.stdout:4/668: mkdir d14/d16/dd5 0 2024-09-19T09:02:40.729 INFO:tasks.workunit.client.1.smithi102.stdout:2/507: symlink d7/d50/d64/la8 0 2024-09-19T09:02:40.730 INFO:tasks.workunit.client.1.smithi102.stdout:6/510: mknod d1/d26/d4b/d94/da2/cae 0 2024-09-19T09:02:40.732 INFO:tasks.workunit.client.1.smithi102.stdout:3/684: rename d2/l8 to d2/d19/le1 0 2024-09-19T09:02:40.733 INFO:tasks.workunit.client.1.smithi102.stdout:2/508: dread - d7/d1a/d2b/d31/d51/d6b/f9c zero size 2024-09-19T09:02:40.733 INFO:tasks.workunit.client.1.smithi102.stdout:4/669: truncate d14/d16/d1d/f20 2316642 0 2024-09-19T09:02:40.734 INFO:tasks.workunit.client.1.smithi102.stdout:1/612: link dd/d13/d2d/d78/l88 dd/d14/d35/d49/d62/d6c/lce 0 2024-09-19T09:02:40.735 INFO:tasks.workunit.client.1.smithi102.stdout:7/616: rename d1/d4/c46 to d1/d4/d9c/d25/d52/cc7 0 2024-09-19T09:02:40.737 INFO:tasks.workunit.client.1.smithi102.stdout:2/509: chown d7/d11/l14 2516978 1 2024-09-19T09:02:40.739 INFO:tasks.workunit.client.1.smithi102.stdout:8/533: dwrite d0/d10/d21/d39/d87/f8e [0,4194304] 0 2024-09-19T09:02:40.739 INFO:tasks.workunit.client.1.smithi102.stdout:5/603: rename d5/d7/d1a/d42/d75 to d5/d7/d1a/d8f/dc0 0 2024-09-19T09:02:40.740 INFO:tasks.workunit.client.1.smithi102.stdout:9/585: dwrite d1/d2/d3/d1d/f9a [4194304,4194304] 0 2024-09-19T09:02:40.740 INFO:tasks.workunit.client.1.smithi102.stdout:7/617: write d1/d3/d34/d74/fa7 [395413,121322] 0 2024-09-19T09:02:40.741 INFO:tasks.workunit.client.1.smithi102.stdout:3/685: unlink d2/d19/d47/db/d26/f5d 0 2024-09-19T09:02:40.742 INFO:tasks.workunit.client.1.smithi102.stdout:1/613: truncate dd/d14/d35/d49/d62/d6c/fb3 923003 0 2024-09-19T09:02:40.744 INFO:tasks.workunit.client.1.smithi102.stdout:4/670: chown d14/d16/d17/d2e/d37/d58/d89/da6/d7c/c88 207864523 1 2024-09-19T09:02:40.746 INFO:tasks.workunit.client.1.smithi102.stdout:5/604: chown d5/d7/d1a/d37/d50/cac 8743 1 2024-09-19T09:02:40.746 INFO:tasks.workunit.client.1.smithi102.stdout:3/686: stat d2/d19/d47/db/d26/d63/d6f/d96/cd2 0 2024-09-19T09:02:40.747 INFO:tasks.workunit.client.1.smithi102.stdout:8/534: creat d0/d10/d21/d39/d87/fab x:0 0 0 2024-09-19T09:02:40.747 INFO:tasks.workunit.client.1.smithi102.stdout:7/618: symlink d1/d4/d9c/lc8 0 2024-09-19T09:02:40.748 INFO:tasks.workunit.client.1.smithi102.stdout:9/586: write d1/d2/d3/d1d/d4f/d6d/f7c [2300097,19184] 0 2024-09-19T09:02:40.751 INFO:tasks.workunit.client.1.smithi102.stdout:7/619: write d1/d3/d34/f66 [4015287,34761] 0 2024-09-19T09:02:40.751 INFO:tasks.workunit.client.1.smithi102.stdout:3/687: fdatasync d2/d19/d1c/d2f/d5a/d84/f9a 0 2024-09-19T09:02:40.752 INFO:tasks.workunit.client.1.smithi102.stdout:1/614: truncate dd/d7a/d8c/da6/fc9 547630 0 2024-09-19T09:02:40.752 INFO:tasks.workunit.client.1.smithi102.stdout:6/511: rename d1/d26/d2e/d45/d47/d4d/d3b to d1/d26/d2e/d45/daf 0 2024-09-19T09:02:40.757 INFO:tasks.workunit.client.1.smithi102.stdout:1/615: unlink dd/f10 0 2024-09-19T09:02:40.758 INFO:tasks.workunit.client.1.smithi102.stdout:2/510: dwrite d7/d50/d64/d7f/d83/f76 [0,4194304] 0 2024-09-19T09:02:40.762 INFO:tasks.workunit.client.1.smithi102.stdout:3/688: rmdir d2/d19/d47/db/d26/d63/d6f 39 2024-09-19T09:02:40.762 INFO:tasks.workunit.client.1.smithi102.stdout:6/512: dwrite d1/f2c [0,4194304] 0 2024-09-19T09:02:40.762 INFO:tasks.workunit.client.1.smithi102.stdout:3/689: chown d2/l4 14654324 1 2024-09-19T09:02:40.764 INFO:tasks.workunit.client.1.smithi102.stdout:6/513: fsync d1/d26/d2e/f5f 0 2024-09-19T09:02:40.773 INFO:tasks.workunit.client.1.smithi102.stdout:1/616: creat dd/d7a/da0/fcf x:0 0 0 2024-09-19T09:02:40.773 INFO:tasks.workunit.client.1.smithi102.stdout:2/511: creat d7/d50/d64/d7f/fa9 x:0 0 0 2024-09-19T09:02:40.774 INFO:tasks.workunit.client.1.smithi102.stdout:3/690: rename d2/l23 to d2/d19/d1c/d2f/d5a/d84/d53/le2 0 2024-09-19T09:02:40.775 INFO:tasks.workunit.client.1.smithi102.stdout:3/691: write d2/f6c [1385982,33469] 0 2024-09-19T09:02:40.776 INFO:tasks.workunit.client.1.smithi102.stdout:1/617: write dd/d14/d18/f1f [2368711,54666] 0 2024-09-19T09:02:40.777 INFO:tasks.workunit.client.1.smithi102.stdout:4/671: getdents d14/d16/d17/d2e/d37/d58/d89/da6 0 2024-09-19T09:02:40.779 INFO:tasks.workunit.client.1.smithi102.stdout:8/535: getdents d0/d10/d21/d39 0 2024-09-19T09:02:40.780 INFO:tasks.workunit.client.1.smithi102.stdout:4/672: rmdir d14/d34 39 2024-09-19T09:02:40.780 INFO:tasks.workunit.client.1.smithi102.stdout:2/512: dread d7/d1a/f49 [0,4194304] 0 2024-09-19T09:02:40.781 INFO:tasks.workunit.client.1.smithi102.stdout:9/587: dread d1/d8/d1c/f3e [0,4194304] 0 2024-09-19T09:02:40.782 INFO:tasks.workunit.client.1.smithi102.stdout:3/692: chown d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/fc2 5 1 2024-09-19T09:02:40.782 INFO:tasks.workunit.client.1.smithi102.stdout:2/513: write d7/d1a/f8f [643566,92045] 0 2024-09-19T09:02:40.785 INFO:tasks.workunit.client.1.smithi102.stdout:7/620: truncate d1/d3/d72/f75 2054990 0 2024-09-19T09:02:40.786 INFO:tasks.workunit.client.1.smithi102.stdout:3/693: stat d2/d19/d47/fad 0 2024-09-19T09:02:40.786 INFO:tasks.workunit.client.1.smithi102.stdout:7/621: chown d1/d3/c98 59198 1 2024-09-19T09:02:40.787 INFO:tasks.workunit.client.1.smithi102.stdout:4/673: symlink d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80/ld6 0 2024-09-19T09:02:40.788 INFO:tasks.workunit.client.1.smithi102.stdout:2/514: rename d7/d12/l2c to d7/d1a/d2b/d31/d51/d6b/laa 0 2024-09-19T09:02:40.788 INFO:tasks.workunit.client.1.smithi102.stdout:4/674: chown d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80/lb3 0 1 2024-09-19T09:02:40.789 INFO:tasks.workunit.client.1.smithi102.stdout:7/622: symlink d1/d4/lc9 0 2024-09-19T09:02:40.789 INFO:tasks.workunit.client.1.smithi102.stdout:0/740: sync 2024-09-19T09:02:40.790 INFO:tasks.workunit.client.1.smithi102.stdout:2/515: write d7/d1a/f8f [1281790,96386] 0 2024-09-19T09:02:40.793 INFO:tasks.workunit.client.1.smithi102.stdout:9/588: getdents d1/d2/d78/da0 0 2024-09-19T09:02:40.794 INFO:tasks.workunit.client.1.smithi102.stdout:8/536: write d0/d10/d21/f6c [3907725,100762] 0 2024-09-19T09:02:40.796 INFO:tasks.workunit.client.1.smithi102.stdout:7/623: dread d1/d2d/fb7 [0,4194304] 0 2024-09-19T09:02:40.800 INFO:tasks.workunit.client.1.smithi102.stdout:0/741: creat d3/dd/d10/d15/d22/d37/d39/d44/ff6 x:0 0 0 2024-09-19T09:02:40.801 INFO:tasks.workunit.client.1.smithi102.stdout:9/589: unlink d1/d2/c69 0 2024-09-19T09:02:40.802 INFO:tasks.workunit.client.1.smithi102.stdout:2/516: truncate d7/d12/f57 1653828 0 2024-09-19T09:02:40.805 INFO:tasks.workunit.client.1.smithi102.stdout:7/624: rename d1/d4/d9c/d25 to d1/d4/dca 0 2024-09-19T09:02:40.806 INFO:tasks.workunit.client.1.smithi102.stdout:9/590: mknod d1/d2/d7b/cbd 0 2024-09-19T09:02:40.808 INFO:tasks.workunit.client.1.smithi102.stdout:3/694: dwrite d2/d19/d35/f5c [0,4194304] 0 2024-09-19T09:02:40.810 INFO:tasks.workunit.client.1.smithi102.stdout:1/618: dread dd/d14/d35/fa2 [0,4194304] 0 2024-09-19T09:02:40.812 INFO:tasks.workunit.client.1.smithi102.stdout:7/625: chown d1/l39 63368 1 2024-09-19T09:02:40.813 INFO:tasks.workunit.client.1.smithi102.stdout:4/675: dwrite d14/f15 [0,4194304] 0 2024-09-19T09:02:40.815 INFO:tasks.workunit.client.1.smithi102.stdout:8/537: dwrite d0/d10/d21/d39/f3d [0,4194304] 0 2024-09-19T09:02:40.819 INFO:tasks.workunit.client.1.smithi102.stdout:3/695: mknod d2/d19/d1c/d2f/ce3 0 2024-09-19T09:02:40.820 INFO:tasks.workunit.client.1.smithi102.stdout:8/538: readlink d0/db/lc 0 2024-09-19T09:02:40.821 INFO:tasks.workunit.client.1.smithi102.stdout:7/626: truncate d1/d4/dca/f94 407218 0 2024-09-19T09:02:40.823 INFO:tasks.workunit.client.1.smithi102.stdout:1/619: rmdir dd/d14/d35/d49 39 2024-09-19T09:02:40.828 INFO:tasks.workunit.client.1.smithi102.stdout:2/517: dread d7/d12/d37/fa6 [0,4194304] 0 2024-09-19T09:02:40.828 INFO:tasks.workunit.client.1.smithi102.stdout:4/676: rename d14/d16/d17/d2e/d37/d58/d89/da6/d2f/dc9 to d14/dd7 0 2024-09-19T09:02:40.829 INFO:tasks.workunit.client.1.smithi102.stdout:1/620: creat dd/d14/d35/d49/dcb/fd0 x:0 0 0 2024-09-19T09:02:40.830 INFO:tasks.workunit.client.1.smithi102.stdout:2/518: truncate d7/d12/f6a 1583038 0 2024-09-19T09:02:40.830 INFO:tasks.workunit.client.1.smithi102.stdout:7/627: dwrite d1/d4/dca/f2e [0,4194304] 0 2024-09-19T09:02:40.832 INFO:tasks.workunit.client.1.smithi102.stdout:3/696: rename d2/d19/d1c/d2f/d5a/d84/fa3 to d2/d19/d35/fe4 0 2024-09-19T09:02:40.833 INFO:tasks.workunit.client.1.smithi102.stdout:2/519: mkdir d7/d1a/d2b/dab 0 2024-09-19T09:02:40.834 INFO:tasks.workunit.client.1.smithi102.stdout:8/539: rename d0/d4f/ca4 to d0/d10/d9b/cac 0 2024-09-19T09:02:40.835 INFO:tasks.workunit.client.1.smithi102.stdout:2/520: write d7/d1a/d2b/d4e/f67 [2019141,105832] 0 2024-09-19T09:02:40.835 INFO:tasks.workunit.client.1.smithi102.stdout:7/628: fdatasync d1/d3/f8a 0 2024-09-19T09:02:40.861 INFO:tasks.workunit.client.1.smithi102.stdout:5/605: sync 2024-09-19T09:02:40.868 INFO:tasks.workunit.client.1.smithi102.stdout:1/621: dwrite dd/d14/d35/f80 [0,4194304] 0 2024-09-19T09:02:40.869 INFO:tasks.workunit.client.1.smithi102.stdout:5/606: symlink d5/d8d/d95/lc1 0 2024-09-19T09:02:40.869 INFO:tasks.workunit.client.1.smithi102.stdout:3/697: write d2/d19/d47/db/d26/f7f [274758,51950] 0 2024-09-19T09:02:40.870 INFO:tasks.workunit.client.1.smithi102.stdout:7/629: creat d1/d4/d9c/fcb x:0 0 0 2024-09-19T09:02:40.871 INFO:tasks.workunit.client.1.smithi102.stdout:1/622: chown dd/d14/d35 16240 1 2024-09-19T09:02:40.873 INFO:tasks.workunit.client.1.smithi102.stdout:8/540: dwrite d0/fd [4194304,4194304] 0 2024-09-19T09:02:40.875 INFO:tasks.workunit.client.1.smithi102.stdout:3/698: readlink d2/d19/d47/db/d26/lab 0 2024-09-19T09:02:40.876 INFO:tasks.workunit.client.1.smithi102.stdout:5/607: fsync d5/d7/d1a/d37/d34/f4e 0 2024-09-19T09:02:40.880 INFO:tasks.workunit.client.1.smithi102.stdout:5/608: fsync d5/d60/f99 0 2024-09-19T09:02:40.881 INFO:tasks.workunit.client.1.smithi102.stdout:3/699: read d2/d19/f28 [4069456,21459] 0 2024-09-19T09:02:40.881 INFO:tasks.workunit.client.1.smithi102.stdout:2/521: dwrite d7/d1a/d2b/d31/f48 [0,4194304] 0 2024-09-19T09:02:40.884 INFO:tasks.workunit.client.1.smithi102.stdout:4/677: dread d14/d16/d17/d2e/d37/d58/d89/da6/f4b [0,4194304] 0 2024-09-19T09:02:40.885 INFO:tasks.workunit.client.1.smithi102.stdout:2/522: fsync d7/fa0 0 2024-09-19T09:02:40.886 INFO:tasks.workunit.client.1.smithi102.stdout:1/623: mknod dd/d13/cd1 0 2024-09-19T09:02:40.886 INFO:tasks.workunit.client.1.smithi102.stdout:5/609: chown d5/d7/d1a/d42/f44 0 1 2024-09-19T09:02:40.887 INFO:tasks.workunit.client.1.smithi102.stdout:3/700: write d2/d19/d47/db/fa5 [780136,48842] 0 2024-09-19T09:02:40.890 INFO:tasks.workunit.client.1.smithi102.stdout:2/523: readlink d7/d1a/l4d 0 2024-09-19T09:02:40.893 INFO:tasks.workunit.client.1.smithi102.stdout:3/701: chown d2/d19/d47/db/d26/d63/d6f 36268608 1 2024-09-19T09:02:40.894 INFO:tasks.workunit.client.1.smithi102.stdout:8/541: dwrite d0/d4f/f65 [0,4194304] 0 2024-09-19T09:02:40.894 INFO:tasks.workunit.client.1.smithi102.stdout:1/624: getdents dd/d14/dac/dc2 0 2024-09-19T09:02:40.898 INFO:tasks.workunit.client.1.smithi102.stdout:4/678: dread d14/f15 [0,4194304] 0 2024-09-19T09:02:40.899 INFO:tasks.workunit.client.1.smithi102.stdout:2/524: dread d7/d1a/d2b/f2d [0,4194304] 0 2024-09-19T09:02:40.900 INFO:tasks.workunit.client.1.smithi102.stdout:3/702: mkdir d2/d19/d35/dce/ddc/de5 0 2024-09-19T09:02:40.901 INFO:tasks.workunit.client.1.smithi102.stdout:8/542: write d0/f56 [7213539,50943] 0 2024-09-19T09:02:40.902 INFO:tasks.workunit.client.1.smithi102.stdout:1/625: unlink dd/d13/d2d/d78/l87 0 2024-09-19T09:02:40.903 INFO:tasks.workunit.client.1.smithi102.stdout:3/703: stat d2/d1e/dcb 0 2024-09-19T09:02:40.903 INFO:tasks.workunit.client.1.smithi102.stdout:8/543: dread - d0/d10/d21/f5b zero size 2024-09-19T09:02:40.904 INFO:tasks.workunit.client.1.smithi102.stdout:7/630: dread d1/d4/dca/d52/f58 [0,4194304] 0 2024-09-19T09:02:40.904 INFO:tasks.workunit.client.1.smithi102.stdout:2/525: dread - d7/d1a/d2b/f69 zero size 2024-09-19T09:02:40.906 INFO:tasks.workunit.client.1.smithi102.stdout:5/610: dwrite d5/d7/d1a/d37/d39/d4c/d89/fa4 [0,4194304] 0 2024-09-19T09:02:40.907 INFO:tasks.workunit.client.1.smithi102.stdout:7/631: mknod d1/d2d/ccc 0 2024-09-19T09:02:40.909 INFO:tasks.workunit.client.1.smithi102.stdout:2/526: write d7/d1a/d2b/d31/d51/d6b/f9c [466554,57165] 0 2024-09-19T09:02:40.909 INFO:tasks.workunit.client.1.smithi102.stdout:5/611: stat d5/d7/d1a/d37/d39/d4c/d89 0 2024-09-19T09:02:40.909 INFO:tasks.workunit.client.1.smithi102.stdout:3/704: unlink d2/d19/d47/db/d8b/fbf 0 2024-09-19T09:02:40.910 INFO:tasks.workunit.client.1.smithi102.stdout:8/544: dread d0/d5a/f71 [0,4194304] 0 2024-09-19T09:02:40.912 INFO:tasks.workunit.client.1.smithi102.stdout:1/626: creat dd/d14/d35/d49/d62/d6c/fd2 x:0 0 0 2024-09-19T09:02:40.913 INFO:tasks.workunit.client.1.smithi102.stdout:1/627: read dd/d14/d35/d49/d62/d6c/fb3 [648689,28384] 0 2024-09-19T09:02:40.915 INFO:tasks.workunit.client.1.smithi102.stdout:6/514: sync 2024-09-19T09:02:40.915 INFO:tasks.workunit.client.1.smithi102.stdout:2/527: unlink d7/d1a/la7 0 2024-09-19T09:02:40.929 INFO:tasks.workunit.client.1.smithi102.stdout:8/545: rmdir d0/d10/d21/d39/d50/da2 39 2024-09-19T09:02:40.930 INFO:tasks.workunit.client.1.smithi102.stdout:3/705: symlink d2/d19/d1c/d2f/d5a/d84/d53/le6 0 2024-09-19T09:02:40.931 INFO:tasks.workunit.client.1.smithi102.stdout:7/632: mkdir d1/d3/d20/dad/dcd 0 2024-09-19T09:02:40.931 INFO:tasks.workunit.client.1.smithi102.stdout:8/546: readlink d0/d4f/l5d 0 2024-09-19T09:02:40.933 INFO:tasks.workunit.client.1.smithi102.stdout:8/547: chown d0/d10/d21/d39/c51 47669 1 2024-09-19T09:02:40.933 INFO:tasks.workunit.client.1.smithi102.stdout:8/548: write d0/f56 [7310160,28629] 0 2024-09-19T09:02:40.934 INFO:tasks.workunit.client.1.smithi102.stdout:1/628: truncate dd/d14/f2b 329904 0 2024-09-19T09:02:40.935 INFO:tasks.workunit.client.1.smithi102.stdout:8/549: write d0/d10/d3a/d9a/f9d [287155,119464] 0 2024-09-19T09:02:40.936 INFO:tasks.workunit.client.1.smithi102.stdout:3/706: mknod d2/d19/d1c/d1f/d5f/ce7 0 2024-09-19T09:02:40.937 INFO:tasks.workunit.client.1.smithi102.stdout:7/633: symlink d1/d2f/d95/lce 0 2024-09-19T09:02:40.938 INFO:tasks.workunit.client.1.smithi102.stdout:4/679: dread d14/d16/d1d/f86 [0,4194304] 0 2024-09-19T09:02:40.939 INFO:tasks.workunit.client.1.smithi102.stdout:2/528: rename d7/d1a/d2b/d4e/l89 to d7/d1a/d56/lac 0 2024-09-19T09:02:40.941 INFO:tasks.workunit.client.1.smithi102.stdout:6/515: link d1/d18/l7f d1/d26/d2e/d45/d47/d4d/d35/d41/lb0 0 2024-09-19T09:02:40.943 INFO:tasks.workunit.client.1.smithi102.stdout:6/516: fsync d1/d26/d2e/d45/d47/f49 0 2024-09-19T09:02:40.944 INFO:tasks.workunit.client.1.smithi102.stdout:3/707: creat d2/d19/d1c/fe8 x:0 0 0 2024-09-19T09:02:40.944 INFO:tasks.workunit.client.1.smithi102.stdout:2/529: mknod d7/cad 0 2024-09-19T09:02:40.945 INFO:tasks.workunit.client.1.smithi102.stdout:4/680: dread - d14/d34/d5a/d5c/d79/fc1 zero size 2024-09-19T09:02:40.947 INFO:tasks.workunit.client.1.smithi102.stdout:1/629: link dd/d14/l20 dd/d13/d2d/d78/ld3 0 2024-09-19T09:02:40.947 INFO:tasks.workunit.client.1.smithi102.stdout:3/708: mknod d2/d19/d1c/d70/ce9 0 2024-09-19T09:02:40.948 INFO:tasks.workunit.client.1.smithi102.stdout:4/681: write d14/d16/d1d/f50 [2647953,18560] 0 2024-09-19T09:02:40.949 INFO:tasks.workunit.client.1.smithi102.stdout:2/530: mkdir d7/d1a/d2b/dae 0 2024-09-19T09:02:40.951 INFO:tasks.workunit.client.1.smithi102.stdout:7/634: dwrite d1/d4/dca/f77 [0,4194304] 0 2024-09-19T09:02:40.952 INFO:tasks.workunit.client.1.smithi102.stdout:4/682: readlink d14/l1b 0 2024-09-19T09:02:40.953 INFO:tasks.workunit.client.1.smithi102.stdout:8/550: dread d0/d64/f3c [0,4194304] 0 2024-09-19T09:02:40.954 INFO:tasks.workunit.client.1.smithi102.stdout:1/630: read dd/d14/f2a [2026197,10702] 0 2024-09-19T09:02:40.955 INFO:tasks.workunit.client.1.smithi102.stdout:8/551: readlink d0/d64/l2b 0 2024-09-19T09:02:40.955 INFO:tasks.workunit.client.1.smithi102.stdout:3/709: creat d2/d19/d1c/d1f/fea x:0 0 0 2024-09-19T09:02:40.959 INFO:tasks.workunit.client.1.smithi102.stdout:6/517: dwrite d1/d18/db/d65/f83 [0,4194304] 0 2024-09-19T09:02:40.963 INFO:tasks.workunit.client.1.smithi102.stdout:7/635: rename d1/d2d/l49 to d1/d4/dca/d52/d7f/lcf 0 2024-09-19T09:02:40.966 INFO:tasks.workunit.client.1.smithi102.stdout:3/710: unlink d2/d19/d47/l12 0 2024-09-19T09:02:40.968 INFO:tasks.workunit.client.1.smithi102.stdout:6/518: dread d1/d26/d4b/d94/d8a/f80 [0,4194304] 0 2024-09-19T09:02:40.969 INFO:tasks.workunit.client.1.smithi102.stdout:1/631: creat dd/d7a/fd4 x:0 0 0 2024-09-19T09:02:40.970 INFO:tasks.workunit.client.1.smithi102.stdout:6/519: chown d1/d3a/l9e 24742447 1 2024-09-19T09:02:40.972 INFO:tasks.workunit.client.1.smithi102.stdout:6/520: stat d1/d26/d4b/d94/d8a/f6f 0 2024-09-19T09:02:40.977 INFO:tasks.workunit.client.1.smithi102.stdout:1/632: read dd/f11 [862726,75396] 0 2024-09-19T09:02:40.977 INFO:tasks.workunit.client.1.smithi102.stdout:2/531: dwrite d7/d11/f68 [0,4194304] 0 2024-09-19T09:02:40.978 INFO:tasks.workunit.client.1.smithi102.stdout:8/552: dread d0/d10/f37 [0,4194304] 0 2024-09-19T09:02:40.982 INFO:tasks.workunit.client.1.smithi102.stdout:2/532: rename d7/d1a/d3d to d7/d12/d37/daf 0 2024-09-19T09:02:40.982 INFO:tasks.workunit.client.1.smithi102.stdout:3/711: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/faa [4194304,4194304] 0 2024-09-19T09:02:40.986 INFO:tasks.workunit.client.1.smithi102.stdout:8/553: mknod d0/d10/d21/d39/d50/cad 0 2024-09-19T09:02:40.986 INFO:tasks.workunit.client.1.smithi102.stdout:1/633: write f9 [1166222,125089] 0 2024-09-19T09:02:40.988 INFO:tasks.workunit.client.1.smithi102.stdout:2/533: write d7/d50/d64/f65 [223904,50559] 0 2024-09-19T09:02:40.989 INFO:tasks.workunit.client.1.smithi102.stdout:6/521: dwrite d1/d18/f1d [0,4194304] 0 2024-09-19T09:02:40.994 INFO:tasks.workunit.client.1.smithi102.stdout:2/534: stat d7/d1a/d2b/d31/f3c 0 2024-09-19T09:02:40.995 INFO:tasks.workunit.client.1.smithi102.stdout:8/554: symlink d0/db/d1d/da5/lae 0 2024-09-19T09:02:40.997 INFO:tasks.workunit.client.1.smithi102.stdout:6/522: getdents d1/d26/d2e 0 2024-09-19T09:02:40.997 INFO:tasks.workunit.client.1.smithi102.stdout:4/683: dread d14/d16/d17/d2e/d37/d58/f73 [0,4194304] 0 2024-09-19T09:02:40.997 INFO:tasks.workunit.client.1.smithi102.stdout:7/636: dwrite d1/d3/d20/f2c [8388608,4194304] 0 2024-09-19T09:02:40.998 INFO:tasks.workunit.client.1.smithi102.stdout:4/684: stat d14/l1b 0 2024-09-19T09:02:41.000 INFO:tasks.workunit.client.1.smithi102.stdout:6/523: write d1/d26/d4b/f51 [179182,97812] 0 2024-09-19T09:02:41.000 INFO:tasks.workunit.client.1.smithi102.stdout:8/555: mkdir d0/db/d1d/da5/daf 0 2024-09-19T09:02:41.003 INFO:tasks.workunit.client.1.smithi102.stdout:4/685: mknod d14/d16/dd5/cd8 0 2024-09-19T09:02:41.005 INFO:tasks.workunit.client.1.smithi102.stdout:6/524: fdatasync d1/d26/d2e/d45/f55 0 2024-09-19T09:02:41.007 INFO:tasks.workunit.client.1.smithi102.stdout:8/556: write d0/d10/d21/d39/d50/d63/d83/fa9 [223662,89921] 0 2024-09-19T09:02:41.009 INFO:tasks.workunit.client.1.smithi102.stdout:4/686: mknod d14/d16/d1d/d92/db1/cd9 0 2024-09-19T09:02:41.009 INFO:tasks.workunit.client.1.smithi102.stdout:2/535: dwrite d7/d1a/d2b/d31/d51/d6b/f9c [0,4194304] 0 2024-09-19T09:02:41.010 INFO:tasks.workunit.client.1.smithi102.stdout:6/525: readlink d1/d26/d2e/d45/daf/l57 0 2024-09-19T09:02:41.010 INFO:tasks.workunit.client.1.smithi102.stdout:3/712: write d2/d19/f28 [2285664,115178] 0 2024-09-19T09:02:41.010 INFO:tasks.workunit.client.1.smithi102.stdout:1/634: write dd/f1d [715236,53915] 0 2024-09-19T09:02:41.011 INFO:tasks.workunit.client.1.smithi102.stdout:8/557: truncate d0/d10/f2d 9022752 0 2024-09-19T09:02:41.012 INFO:tasks.workunit.client.1.smithi102.stdout:3/713: chown d2/d1e/f93 44176 1 2024-09-19T09:02:41.013 INFO:tasks.workunit.client.1.smithi102.stdout:6/526: creat d1/d26/d2e/fb1 x:0 0 0 2024-09-19T09:02:41.014 INFO:tasks.workunit.client.1.smithi102.stdout:1/635: unlink dd/d14/d18/f1f 0 2024-09-19T09:02:41.015 INFO:tasks.workunit.client.1.smithi102.stdout:6/527: write d1/fc [2015214,26312] 0 2024-09-19T09:02:41.019 INFO:tasks.workunit.client.1.smithi102.stdout:0/742: sync 2024-09-19T09:02:41.019 INFO:tasks.workunit.client.1.smithi102.stdout:9/591: sync 2024-09-19T09:02:41.019 INFO:tasks.workunit.client.1.smithi102.stdout:4/687: mknod d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80/cda 0 2024-09-19T09:02:41.022 INFO:tasks.workunit.client.1.smithi102.stdout:8/558: write d0/d10/d21/d39/d50/d63/d83/f9e [4126135,119793] 0 2024-09-19T09:02:41.022 INFO:tasks.workunit.client.1.smithi102.stdout:7/637: dread d1/d4/dca/d52/f6b [0,4194304] 0 2024-09-19T09:02:41.025 INFO:tasks.workunit.client.1.smithi102.stdout:9/592: fdatasync d1/d2/d3/d6f/fa4 0 2024-09-19T09:02:41.025 INFO:tasks.workunit.client.1.smithi102.stdout:0/743: stat d3/dd/d10/d15/d22/d37/d39/d44/d54/de5/cf4 0 2024-09-19T09:02:41.025 INFO:tasks.workunit.client.1.smithi102.stdout:6/528: unlink d1/d18/d37/c44 0 2024-09-19T09:02:41.027 INFO:tasks.workunit.client.1.smithi102.stdout:3/714: link d2/d19/d47/c20 d2/d19/d1c/d1f/ceb 0 2024-09-19T09:02:41.027 INFO:tasks.workunit.client.1.smithi102.stdout:0/744: chown d3/dd/d10/d15/d22/d37/f9a 6708197 1 2024-09-19T09:02:41.028 INFO:tasks.workunit.client.1.smithi102.stdout:9/593: stat d1/d2/d3/d1d/d4f/d6d/d81/d90 0 2024-09-19T09:02:41.029 INFO:tasks.workunit.client.1.smithi102.stdout:1/636: truncate dd/d14/f27 742610 0 2024-09-19T09:02:41.031 INFO:tasks.workunit.client.1.smithi102.stdout:4/688: unlink d14/d16/d17/d2e/d37/d58/d89/d78/f8b 0 2024-09-19T09:02:41.032 INFO:tasks.workunit.client.1.smithi102.stdout:3/715: dread d2/d19/d1c/d70/f8a [0,4194304] 0 2024-09-19T09:02:41.032 INFO:tasks.workunit.client.1.smithi102.stdout:7/638: dread d1/d4/f1a [0,4194304] 0 2024-09-19T09:02:41.033 INFO:tasks.workunit.client.1.smithi102.stdout:8/559: unlink d0/d10/l1a 0 2024-09-19T09:02:41.033 INFO:tasks.workunit.client.1.smithi102.stdout:3/716: fdatasync d2/d19/d35/dce/fdf 0 2024-09-19T09:02:41.035 INFO:tasks.workunit.client.1.smithi102.stdout:9/594: chown d1/d8/d1c/f99 866588850 1 2024-09-19T09:02:41.035 INFO:tasks.workunit.client.1.smithi102.stdout:1/637: dread dd/d14/f2b [0,4194304] 0 2024-09-19T09:02:41.036 INFO:tasks.workunit.client.1.smithi102.stdout:0/745: rmdir d3/dd/d10/d15/d22/d2a/dba/d9d 39 2024-09-19T09:02:41.037 INFO:tasks.workunit.client.1.smithi102.stdout:1/638: write dd/d13/d2d/d78/fa7 [699276,32653] 0 2024-09-19T09:02:41.040 INFO:tasks.workunit.client.1.smithi102.stdout:4/689: mkdir d14/d16/d17/d2e/d37/d58/d89/d78/ddb 0 2024-09-19T09:02:41.041 INFO:tasks.workunit.client.1.smithi102.stdout:6/529: mkdir d1/d26/d2e/d45/dac/db2 0 2024-09-19T09:02:41.042 INFO:tasks.workunit.client.1.smithi102.stdout:3/717: dread d2/d19/d47/db/d26/f7f [0,4194304] 0 2024-09-19T09:02:41.042 INFO:tasks.workunit.client.1.smithi102.stdout:6/530: dread - d1/d26/d2e/d45/daf/d8d/faa zero size 2024-09-19T09:02:41.043 INFO:tasks.workunit.client.1.smithi102.stdout:3/718: readlink d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/l7e 0 2024-09-19T09:02:41.044 INFO:tasks.workunit.client.1.smithi102.stdout:7/639: rename d1/d2f/cbc to d1/d3/d20/dad/cd0 0 2024-09-19T09:02:41.045 INFO:tasks.workunit.client.1.smithi102.stdout:3/719: read - d2/d19/d1c/d2f/d5a/d84/d64/fb2 zero size 2024-09-19T09:02:41.045 INFO:tasks.workunit.client.1.smithi102.stdout:7/640: dread - d1/d4/d9c/fcb zero size 2024-09-19T09:02:41.046 INFO:tasks.workunit.client.1.smithi102.stdout:9/595: creat d1/d2/d3/d6f/d8d/fbe x:0 0 0 2024-09-19T09:02:41.050 INFO:tasks.workunit.client.1.smithi102.stdout:0/746: fdatasync d3/dd/d10/d15/d22/d37/d39/d44/dab/fb2 0 2024-09-19T09:02:41.054 INFO:tasks.workunit.client.1.smithi102.stdout:8/560: mkdir d0/d4f/daa/db0 0 2024-09-19T09:02:41.055 INFO:tasks.workunit.client.1.smithi102.stdout:6/531: rename d1/d26/d2e/d45/d47/d4d/f34 to d1/d26/d4b/d94/d8a/fb3 0 2024-09-19T09:02:41.056 INFO:tasks.workunit.client.1.smithi102.stdout:3/720: fsync d2/f33 0 2024-09-19T09:02:41.060 INFO:tasks.workunit.client.1.smithi102.stdout:7/641: unlink d1/d2d/f9b 0 2024-09-19T09:02:41.062 INFO:tasks.workunit.client.1.smithi102.stdout:9/596: creat d1/d2/d3/d1d/d4f/fbf x:0 0 0 2024-09-19T09:02:41.063 INFO:tasks.workunit.client.1.smithi102.stdout:9/597: truncate d1/d2/d3/d1d/f66 150398 0 2024-09-19T09:02:41.064 INFO:tasks.workunit.client.1.smithi102.stdout:9/598: read - d1/d2/d3/d1d/d4f/d6d/d81/f84 zero size 2024-09-19T09:02:41.066 INFO:tasks.workunit.client.1.smithi102.stdout:4/690: fsync d14/d16/d1d/f72 0 2024-09-19T09:02:41.070 INFO:tasks.workunit.client.1.smithi102.stdout:8/561: rename d0/db/l68 to d0/d10/d21/d39/d50/d63/d83/lb1 0 2024-09-19T09:02:41.071 INFO:tasks.workunit.client.1.smithi102.stdout:3/721: dread d2/d19/d1c/d2f/d5a/d84/f91 [0,4194304] 0 2024-09-19T09:02:41.072 INFO:tasks.workunit.client.1.smithi102.stdout:3/722: stat d2/d19/d1c/d2f/d5a/d84/d53/f79 0 2024-09-19T09:02:41.074 INFO:tasks.workunit.client.1.smithi102.stdout:5/612: sync 2024-09-19T09:02:41.074 INFO:tasks.workunit.client.1.smithi102.stdout:5/613: chown d5/d7/d1a/d37/d34/d7f/d91 112075437 1 2024-09-19T09:02:41.075 INFO:tasks.workunit.client.1.smithi102.stdout:9/599: mkdir d1/d2/d78/da0/dc0 0 2024-09-19T09:02:41.078 INFO:tasks.workunit.client.1.smithi102.stdout:7/642: dwrite d1/d2f/f4a [0,4194304] 0 2024-09-19T09:02:41.085 INFO:tasks.workunit.client.1.smithi102.stdout:0/747: rmdir d3/dd/d10/d15/d3e/df5 0 2024-09-19T09:02:41.087 INFO:tasks.workunit.client.1.smithi102.stdout:0/748: chown d3/dd/d10/d15/d22/d37/d39/d44/dab/fed 98 1 2024-09-19T09:02:41.087 INFO:tasks.workunit.client.1.smithi102.stdout:9/600: creat d1/d2/d3/d1d/d4f/fc1 x:0 0 0 2024-09-19T09:02:41.088 INFO:tasks.workunit.client.1.smithi102.stdout:0/749: read - d3/dd/d10/d15/d22/d37/d39/d44/fb1 zero size 2024-09-19T09:02:41.089 INFO:tasks.workunit.client.1.smithi102.stdout:4/691: symlink d14/d34/ldc 0 2024-09-19T09:02:41.090 INFO:tasks.workunit.client.1.smithi102.stdout:4/692: chown d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f38 32770 1 2024-09-19T09:02:41.091 INFO:tasks.workunit.client.1.smithi102.stdout:7/643: rmdir d1/d4 39 2024-09-19T09:02:41.094 INFO:tasks.workunit.client.1.smithi102.stdout:6/532: link d1/d26/d2e/d45/d47/d4d/d35/l71 d1/d26/d2e/d70/lb4 0 2024-09-19T09:02:41.095 INFO:tasks.workunit.client.1.smithi102.stdout:3/723: symlink d2/d19/d35/dce/ddc/de5/lec 0 2024-09-19T09:02:41.096 INFO:tasks.workunit.client.1.smithi102.stdout:3/724: write d2/d19/d1c/d2f/d5a/d84/fb3 [2587503,9797] 0 2024-09-19T09:02:41.100 INFO:tasks.workunit.client.1.smithi102.stdout:9/601: unlink d1/d2/d3/d1d/fbb 0 2024-09-19T09:02:41.101 INFO:tasks.workunit.client.1.smithi102.stdout:5/614: dread d5/d60/f85 [0,4194304] 0 2024-09-19T09:02:41.102 INFO:tasks.workunit.client.1.smithi102.stdout:4/693: rmdir d14 39 2024-09-19T09:02:41.111 INFO:tasks.workunit.client.1.smithi102.stdout:3/725: unlink d2/d19/d47/db/l51 0 2024-09-19T09:02:41.187 INFO:tasks.workunit.client.1.smithi102.stdout:0/750: mknod d3/dd/d1a/d32/cf7 0 2024-09-19T09:02:41.191 INFO:tasks.workunit.client.1.smithi102.stdout:0/751: dwrite d3/dd/d10/d15/d22/d37/d3d/fbe [0,4194304] 0 2024-09-19T09:02:41.201 INFO:tasks.workunit.client.1.smithi102.stdout:5/615: rename d5/d7/d1a/d42/d4b to d5/d7b/dc2 0 2024-09-19T09:02:41.202 INFO:tasks.workunit.client.1.smithi102.stdout:4/694: fdatasync f13 0 2024-09-19T09:02:41.206 INFO:tasks.workunit.client.1.smithi102.stdout:8/562: getdents d0/d10/d21/d39/d50/d63/d83 0 2024-09-19T09:02:41.206 INFO:tasks.workunit.client.1.smithi102.stdout:8/563: readlink d0/db/d29/d97/l98 0 2024-09-19T09:02:41.207 INFO:tasks.workunit.client.1.smithi102.stdout:8/564: chown d0/d10/d21/f2e 92099585 1 2024-09-19T09:02:41.207 INFO:tasks.workunit.client.1.smithi102.stdout:6/533: symlink d1/d26/d2e/d45/dac/db2/lb5 0 2024-09-19T09:02:41.208 INFO:tasks.workunit.client.1.smithi102.stdout:8/565: readlink d0/d64/l2b 0 2024-09-19T09:02:41.213 INFO:tasks.workunit.client.1.smithi102.stdout:0/752: unlink d3/dd/d10/d15/d22/d37/c9e 0 2024-09-19T09:02:41.217 INFO:tasks.workunit.client.1.smithi102.stdout:1/639: dwrite dd/d14/d35/d49/d7d/d7f/f84 [0,4194304] 0 2024-09-19T09:02:41.218 INFO:tasks.workunit.client.1.smithi102.stdout:9/602: rmdir d1/db5 0 2024-09-19T09:02:41.220 INFO:tasks.workunit.client.1.smithi102.stdout:0/753: truncate d3/dd/d1a/d32/d7f/d99/fbd 2529981 0 2024-09-19T09:02:41.223 INFO:tasks.workunit.client.1.smithi102.stdout:6/534: fdatasync d1/d26/d2e/d45/d47/d4d/f4c 0 2024-09-19T09:02:41.225 INFO:tasks.workunit.client.1.smithi102.stdout:0/754: write d3/dd/f7c [3611434,129911] 0 2024-09-19T09:02:41.226 INFO:tasks.workunit.client.1.smithi102.stdout:5/616: link d5/d7/f29 d5/d60/fc3 0 2024-09-19T09:02:41.227 INFO:tasks.workunit.client.1.smithi102.stdout:7/644: dwrite d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:41.229 INFO:tasks.workunit.client.1.smithi102.stdout:5/617: write d5/f15 [5085505,57065] 0 2024-09-19T09:02:41.230 INFO:tasks.workunit.client.1.smithi102.stdout:8/566: dread d0/d10/d21/d39/f59 [0,4194304] 0 2024-09-19T09:02:41.230 INFO:tasks.workunit.client.1.smithi102.stdout:1/640: read dd/f25 [2351362,117743] 0 2024-09-19T09:02:41.232 INFO:tasks.workunit.client.1.smithi102.stdout:8/567: write d0/d10/d21/f43 [5283776,16100] 0 2024-09-19T09:02:41.238 INFO:tasks.workunit.client.1.smithi102.stdout:4/695: truncate d14/d16/d17/d2e/d37/d58/d89/f63 3180401 0 2024-09-19T09:02:41.239 INFO:tasks.workunit.client.1.smithi102.stdout:6/535: write d1/f43 [705641,16649] 0 2024-09-19T09:02:41.239 INFO:tasks.workunit.client.1.smithi102.stdout:5/618: read d5/d7/d1b/f46 [4013136,129046] 0 2024-09-19T09:02:41.239 INFO:tasks.workunit.client.1.smithi102.stdout:0/755: dread d3/dd/d10/d15/d22/d37/d3d/fbe [0,4194304] 0 2024-09-19T09:02:41.241 INFO:tasks.workunit.client.1.smithi102.stdout:4/696: fdatasync d14/d34/d5a/d5c/d81/d75/fb9 0 2024-09-19T09:02:41.241 INFO:tasks.workunit.client.1.smithi102.stdout:5/619: readlink d5/d7/d1a/d37/d39/d4c/lb0 0 2024-09-19T09:02:41.242 INFO:tasks.workunit.client.1.smithi102.stdout:5/620: stat d5/d7/d1a/d37/d34/d4d/c72 0 2024-09-19T09:02:41.243 INFO:tasks.workunit.client.1.smithi102.stdout:5/621: fdatasync d5/d7/d1a/f88 0 2024-09-19T09:02:41.254 INFO:tasks.workunit.client.1.smithi102.stdout:0/756: dread d3/dd/d10/d15/d3e/f3f [0,4194304] 0 2024-09-19T09:02:41.254 INFO:tasks.workunit.client.1.smithi102.stdout:0/757: fsync d3/dd/d1a/d32/d62/f97 0 2024-09-19T09:02:41.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:40 smithi102 ceph-mon[35280]: pgmap v27: 65 pgs: 65 active+clean; 1.3 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 45 MiB/s rd, 183 MiB/s wr, 515 op/s 2024-09-19T09:02:41.261 INFO:tasks.workunit.client.1.smithi102.stdout:9/603: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:41.284 INFO:tasks.workunit.client.1.smithi102.stdout:6/536: mknod d1/d26/d2e/d45/d47/d4d/d35/d79/cb6 0 2024-09-19T09:02:41.286 INFO:tasks.workunit.client.1.smithi102.stdout:4/697: creat d14/d34/d9f/fdd x:0 0 0 2024-09-19T09:02:41.286 INFO:tasks.workunit.client.1.smithi102.stdout:4/698: write d14/d16/fbf [523421,130472] 0 2024-09-19T09:02:41.287 INFO:tasks.workunit.client.1.smithi102.stdout:5/622: mknod d5/d7/d1a/d37/d34/d73/cc4 0 2024-09-19T09:02:41.287 INFO:tasks.workunit.client.1.smithi102.stdout:4/699: stat d14/d16/d1d/d92/db1/cc5 0 2024-09-19T09:02:41.289 INFO:tasks.workunit.client.1.smithi102.stdout:4/700: chown d14/d34/c7e 558 1 2024-09-19T09:02:41.289 INFO:tasks.workunit.client.1.smithi102.stdout:7/645: fdatasync d1/d4/dca/d52/f65 0 2024-09-19T09:02:41.290 INFO:tasks.workunit.client.1.smithi102.stdout:4/701: write d14/d34/d5a/d5c/d79/d8c/f91 [1004902,18426] 0 2024-09-19T09:02:41.295 INFO:tasks.workunit.client.1.smithi102.stdout:7/646: dread d1/d3/d34/d74/fa7 [0,4194304] 0 2024-09-19T09:02:41.295 INFO:tasks.workunit.client.1.smithi102.stdout:0/758: read d3/dd/d10/d15/f60 [2796079,119240] 0 2024-09-19T09:02:41.296 INFO:tasks.workunit.client.1.smithi102.stdout:9/604: symlink d1/d2/d3/d6f/d8d/da2/lc2 0 2024-09-19T09:02:41.300 INFO:tasks.workunit.client.1.smithi102.stdout:6/537: creat d1/d26/d2e/d45/d47/fb7 x:0 0 0 2024-09-19T09:02:41.301 INFO:tasks.workunit.client.1.smithi102.stdout:6/538: chown d1/d26/d2e/d45/d47/d4d/l68 3 1 2024-09-19T09:02:41.302 INFO:tasks.workunit.client.1.smithi102.stdout:6/539: fdatasync d1/d18/db/f19 0 2024-09-19T09:02:41.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:40 smithi049 ceph-mon[28158]: pgmap v27: 65 pgs: 65 active+clean; 1.3 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 45 MiB/s rd, 183 MiB/s wr, 515 op/s 2024-09-19T09:02:41.303 INFO:tasks.workunit.client.1.smithi102.stdout:5/623: symlink d5/d7/d1a/d42/lc5 0 2024-09-19T09:02:41.306 INFO:tasks.workunit.client.1.smithi102.stdout:3/726: sync 2024-09-19T09:02:41.307 INFO:tasks.workunit.client.1.smithi102.stdout:2/536: sync 2024-09-19T09:02:41.312 INFO:tasks.workunit.client.1.smithi102.stdout:7/647: rename d1/d3/f9 to d1/d3/d34/fd1 0 2024-09-19T09:02:41.318 INFO:tasks.workunit.client.1.smithi102.stdout:8/568: creat d0/d10/d21/d39/d50/fb2 x:0 0 0 2024-09-19T09:02:41.325 INFO:tasks.workunit.client.1.smithi102.stdout:2/537: creat d7/d1a/d2b/d31/fb0 x:0 0 0 2024-09-19T09:02:41.326 INFO:tasks.workunit.client.1.smithi102.stdout:2/538: stat d7/d12/c30 0 2024-09-19T09:02:41.326 INFO:tasks.workunit.client.1.smithi102.stdout:2/539: write d7/f9 [6978896,99970] 0 2024-09-19T09:02:41.333 INFO:tasks.workunit.client.1.smithi102.stdout:7/648: fdatasync d1/d4/f1a 0 2024-09-19T09:02:41.334 INFO:tasks.workunit.client.1.smithi102.stdout:7/649: write d1/d4/dca/f87 [374300,65616] 0 2024-09-19T09:02:41.334 INFO:tasks.workunit.client.1.smithi102.stdout:0/759: symlink d3/dd/d10/d15/da2/lf8 0 2024-09-19T09:02:41.339 INFO:tasks.workunit.client.1.smithi102.stdout:8/569: unlink d0/d4f/c85 0 2024-09-19T09:02:41.339 INFO:tasks.workunit.client.1.smithi102.stdout:0/760: dwrite d3/dd/d10/f38 [0,4194304] 0 2024-09-19T09:02:41.341 INFO:tasks.workunit.client.1.smithi102.stdout:6/540: symlink d1/d26/d2e/d45/lb8 0 2024-09-19T09:02:41.348 INFO:tasks.workunit.client.1.smithi102.stdout:2/540: fsync d7/d1a/d2b/d31/f80 0 2024-09-19T09:02:41.349 INFO:tasks.workunit.client.1.smithi102.stdout:2/541: stat d7/d50/d64/d7f/d83 0 2024-09-19T09:02:41.357 INFO:tasks.workunit.client.1.smithi102.stdout:6/541: rmdir d1/d26/d2e/d45/d47/d4d/d35/d79 39 2024-09-19T09:02:41.357 INFO:tasks.workunit.client.1.smithi102.stdout:3/727: write d2/d19/d1c/d2f/d5a/d84/d4f/f80 [1274752,38081] 0 2024-09-19T09:02:41.359 INFO:tasks.workunit.client.1.smithi102.stdout:4/702: truncate d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f6b 6034628 0 2024-09-19T09:02:41.360 INFO:tasks.workunit.client.1.smithi102.stdout:8/570: getdents d0/db/d1d/da5/daf 0 2024-09-19T09:02:41.361 INFO:tasks.workunit.client.1.smithi102.stdout:4/703: write d14/d34/d5a/d5c/f84 [4496834,111900] 0 2024-09-19T09:02:41.361 INFO:tasks.workunit.client.1.smithi102.stdout:6/542: dread d1/d18/f1d [0,4194304] 0 2024-09-19T09:02:41.361 INFO:tasks.workunit.client.1.smithi102.stdout:4/704: chown d14/l19 2595 1 2024-09-19T09:02:41.363 INFO:tasks.workunit.client.1.smithi102.stdout:2/542: mknod d7/d1a/cb1 0 2024-09-19T09:02:41.363 INFO:tasks.workunit.client.1.smithi102.stdout:4/705: chown d14/d16/d1d/d48/fb0 654 1 2024-09-19T09:02:41.363 INFO:tasks.workunit.client.1.smithi102.stdout:2/543: dread - d7/d50/f99 zero size 2024-09-19T09:02:41.364 INFO:tasks.workunit.client.1.smithi102.stdout:4/706: dread - d14/d16/d1d/d92/f93 zero size 2024-09-19T09:02:41.364 INFO:tasks.workunit.client.1.smithi102.stdout:3/728: rename d2/d19/d1c/d70/dc9 to d2/d19/d1c/d2f/d5a/d84/d53/ded 0 2024-09-19T09:02:41.366 INFO:tasks.workunit.client.1.smithi102.stdout:9/605: truncate d1/d2/d3/d1d/f9a 376819 0 2024-09-19T09:02:41.369 INFO:tasks.workunit.client.1.smithi102.stdout:6/543: rmdir d1/d3a 39 2024-09-19T09:02:41.372 INFO:tasks.workunit.client.1.smithi102.stdout:2/544: creat d7/d11/fb2 x:0 0 0 2024-09-19T09:02:41.373 INFO:tasks.workunit.client.1.smithi102.stdout:8/571: mkdir d0/d10/d21/db3 0 2024-09-19T09:02:41.374 INFO:tasks.workunit.client.1.smithi102.stdout:5/624: truncate d5/d7/d1a/d42/f66 396672 0 2024-09-19T09:02:41.375 INFO:tasks.workunit.client.1.smithi102.stdout:5/625: stat d5/l30 0 2024-09-19T09:02:41.375 INFO:tasks.workunit.client.1.smithi102.stdout:4/707: mknod d14/d16/cde 0 2024-09-19T09:02:41.376 INFO:tasks.workunit.client.1.smithi102.stdout:8/572: truncate d0/d10/d21/d39/d50/d63/d83/f8a 595744 0 2024-09-19T09:02:41.376 INFO:tasks.workunit.client.1.smithi102.stdout:2/545: symlink d7/d1a/d2b/d31/lb3 0 2024-09-19T09:02:41.377 INFO:tasks.workunit.client.1.smithi102.stdout:9/606: symlink d1/d8/lc3 0 2024-09-19T09:02:41.378 INFO:tasks.workunit.client.1.smithi102.stdout:8/573: chown d0/d10/d21/f6c 81051388 1 2024-09-19T09:02:41.378 INFO:tasks.workunit.client.1.smithi102.stdout:5/626: unlink d5/d23/d3b/l97 0 2024-09-19T09:02:41.379 INFO:tasks.workunit.client.1.smithi102.stdout:8/574: readlink d0/db/d1d/da5/lae 0 2024-09-19T09:02:41.381 INFO:tasks.workunit.client.1.smithi102.stdout:9/607: write d1/d8/d1c/f3e [4186925,25917] 0 2024-09-19T09:02:41.381 INFO:tasks.workunit.client.1.smithi102.stdout:7/650: write d1/d4/dca/f4e [634984,6508] 0 2024-09-19T09:02:41.382 INFO:tasks.workunit.client.1.smithi102.stdout:2/546: mkdir d7/d1a/d2b/dae/db4 0 2024-09-19T09:02:41.390 INFO:tasks.workunit.client.1.smithi102.stdout:5/627: mkdir d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6 0 2024-09-19T09:02:41.390 INFO:tasks.workunit.client.1.smithi102.stdout:7/651: creat d1/d2f/d95/fd2 x:0 0 0 2024-09-19T09:02:41.390 INFO:tasks.workunit.client.1.smithi102.stdout:6/544: dread d1/d18/db/f1f [0,4194304] 0 2024-09-19T09:02:41.390 INFO:tasks.workunit.client.1.smithi102.stdout:2/547: rmdir d7/d1a/d56 39 2024-09-19T09:02:41.390 INFO:tasks.workunit.client.1.smithi102.stdout:9/608: symlink d1/d2/d3/d6f/d8d/lc4 0 2024-09-19T09:02:41.391 INFO:tasks.workunit.client.1.smithi102.stdout:2/548: readlink d7/d1a/d2b/d31/l62 0 2024-09-19T09:02:41.392 INFO:tasks.workunit.client.1.smithi102.stdout:6/545: symlink d1/d18/d37/lb9 0 2024-09-19T09:02:41.392 INFO:tasks.workunit.client.1.smithi102.stdout:3/729: dread d2/f33 [0,4194304] 0 2024-09-19T09:02:41.393 INFO:tasks.workunit.client.1.smithi102.stdout:8/575: dwrite d0/db/f89 [4194304,4194304] 0 2024-09-19T09:02:41.395 INFO:tasks.workunit.client.1.smithi102.stdout:7/652: rename d1/d2d/l88 to d1/d3/d20/d6c/ld3 0 2024-09-19T09:02:41.396 INFO:tasks.workunit.client.1.smithi102.stdout:2/549: symlink d7/d12/lb5 0 2024-09-19T09:02:41.397 INFO:tasks.workunit.client.1.smithi102.stdout:6/546: symlink d1/d26/d2e/d45/daf/d8d/lba 0 2024-09-19T09:02:41.397 INFO:tasks.workunit.client.1.smithi102.stdout:2/550: readlink d7/d1a/l34 0 2024-09-19T09:02:41.402 INFO:tasks.workunit.client.1.smithi102.stdout:1/641: sync 2024-09-19T09:02:41.403 INFO:tasks.workunit.client.1.smithi102.stdout:9/609: dwrite d1/d8/d98/fad [0,4194304] 0 2024-09-19T09:02:41.404 INFO:tasks.workunit.client.1.smithi102.stdout:2/551: symlink d7/d12/lb6 0 2024-09-19T09:02:41.404 INFO:tasks.workunit.client.1.smithi102.stdout:6/547: read d1/d26/f85 [702659,62737] 0 2024-09-19T09:02:41.409 INFO:tasks.workunit.client.1.smithi102.stdout:8/576: dwrite d0/db/d1d/f31 [0,4194304] 0 2024-09-19T09:02:41.410 INFO:tasks.workunit.client.1.smithi102.stdout:5/628: write d5/d23/f26 [4362,23345] 0 2024-09-19T09:02:41.410 INFO:tasks.workunit.client.1.smithi102.stdout:3/730: dread d2/d1e/fca [0,4194304] 0 2024-09-19T09:02:41.410 INFO:tasks.workunit.client.1.smithi102.stdout:1/642: write dd/d68/f9a [2098154,60435] 0 2024-09-19T09:02:41.416 INFO:tasks.workunit.client.1.smithi102.stdout:9/610: creat d1/d2/d3/d1d/d4f/d6d/fc5 x:0 0 0 2024-09-19T09:02:41.419 INFO:tasks.workunit.client.1.smithi102.stdout:1/643: rmdir dd/d7a/da0 39 2024-09-19T09:02:41.419 INFO:tasks.workunit.client.1.smithi102.stdout:7/653: dwrite d1/d4/dca/f8e [0,4194304] 0 2024-09-19T09:02:41.421 INFO:tasks.workunit.client.1.smithi102.stdout:4/708: dwrite d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f5f [0,4194304] 0 2024-09-19T09:02:41.423 INFO:tasks.workunit.client.1.smithi102.stdout:7/654: write d1/f1e [3315575,122529] 0 2024-09-19T09:02:41.424 INFO:tasks.workunit.client.1.smithi102.stdout:1/644: chown dd/d13/d2d/f3c 241337 1 2024-09-19T09:02:41.427 INFO:tasks.workunit.client.1.smithi102.stdout:6/548: truncate d1/d18/db/f1f 1101348 0 2024-09-19T09:02:41.428 INFO:tasks.workunit.client.1.smithi102.stdout:5/629: creat d5/fc7 x:0 0 0 2024-09-19T09:02:41.429 INFO:tasks.workunit.client.1.smithi102.stdout:4/709: mknod d14/d34/d5a/cdf 0 2024-09-19T09:02:41.429 INFO:tasks.workunit.client.1.smithi102.stdout:9/611: write d1/d2/d3/d1d/d4f/d6d/d81/f84 [607067,86019] 0 2024-09-19T09:02:41.431 INFO:tasks.workunit.client.1.smithi102.stdout:8/577: dwrite d0/db/d29/f72 [4194304,4194304] 0 2024-09-19T09:02:41.433 INFO:tasks.workunit.client.1.smithi102.stdout:9/612: read d1/d2/f72 [4078164,7881] 0 2024-09-19T09:02:41.434 INFO:tasks.workunit.client.1.smithi102.stdout:7/655: mkdir d1/d3/d20/dad/dd4 0 2024-09-19T09:02:41.434 INFO:tasks.workunit.client.1.smithi102.stdout:1/645: mkdir dd/dd5 0 2024-09-19T09:02:41.438 INFO:tasks.workunit.client.1.smithi102.stdout:7/656: write d1/d3/f64 [1345174,84492] 0 2024-09-19T09:02:41.438 INFO:tasks.workunit.client.1.smithi102.stdout:9/613: creat d1/d2/d3/d6f/fc6 x:0 0 0 2024-09-19T09:02:41.439 INFO:tasks.workunit.client.1.smithi102.stdout:1/646: unlink dd/d13/d2d/l2e 0 2024-09-19T09:02:41.439 INFO:tasks.workunit.client.1.smithi102.stdout:3/731: link d2/d19/d47/db/d26/lcd d2/d19/d47/db/d26/d63/lee 0 2024-09-19T09:02:41.440 INFO:tasks.workunit.client.1.smithi102.stdout:5/630: symlink d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/lc8 0 2024-09-19T09:02:41.442 INFO:tasks.workunit.client.1.smithi102.stdout:4/710: mknod d14/d16/d17/d2e/d37/d58/d89/d78/ddb/ce0 0 2024-09-19T09:02:41.444 INFO:tasks.workunit.client.1.smithi102.stdout:1/647: dread dd/d13/d2d/d78/fa7 [0,4194304] 0 2024-09-19T09:02:41.449 INFO:tasks.workunit.client.1.smithi102.stdout:3/732: unlink d2/d19/d47/db/d26/d63/d6f/d96/f9e 0 2024-09-19T09:02:41.449 INFO:tasks.workunit.client.1.smithi102.stdout:7/657: read d1/d4/dca/f94 [213359,112076] 0 2024-09-19T09:02:41.450 INFO:tasks.workunit.client.1.smithi102.stdout:8/578: write d0/f96 [200477,46883] 0 2024-09-19T09:02:41.450 INFO:tasks.workunit.client.1.smithi102.stdout:4/711: symlink d14/dd7/le1 0 2024-09-19T09:02:41.452 INFO:tasks.workunit.client.1.smithi102.stdout:4/712: stat d14/d16/d17/d2e/d37/d58/f73 0 2024-09-19T09:02:41.455 INFO:tasks.workunit.client.1.smithi102.stdout:3/733: write d2/d19/d1c/d2f/d5a/d84/d4f/fd1 [800850,129425] 0 2024-09-19T09:02:41.456 INFO:tasks.workunit.client.1.smithi102.stdout:8/579: creat d0/d10/fb4 x:0 0 0 2024-09-19T09:02:41.456 INFO:tasks.workunit.client.1.smithi102.stdout:6/549: link d1/d26/d2e/d45/c50 d1/d18/db/d65/d8e/cbb 0 2024-09-19T09:02:41.456 INFO:tasks.workunit.client.1.smithi102.stdout:7/658: dwrite d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:41.459 INFO:tasks.workunit.client.1.smithi102.stdout:6/550: dread - d1/d18/db/d65/f96 zero size 2024-09-19T09:02:41.460 INFO:tasks.workunit.client.1.smithi102.stdout:9/614: getdents d1/d2/d3/d1d/d4f 0 2024-09-19T09:02:41.461 INFO:tasks.workunit.client.1.smithi102.stdout:3/734: fsync d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/fc2 0 2024-09-19T09:02:41.463 INFO:tasks.workunit.client.1.smithi102.stdout:9/615: dread - d1/d2/d3/d6f/fae zero size 2024-09-19T09:02:41.465 INFO:tasks.workunit.client.1.smithi102.stdout:8/580: dwrite d0/d10/f2d [0,4194304] 0 2024-09-19T09:02:41.468 INFO:tasks.workunit.client.1.smithi102.stdout:7/659: creat d1/d3/d20/dad/dcd/fd5 x:0 0 0 2024-09-19T09:02:41.468 INFO:tasks.workunit.client.1.smithi102.stdout:9/616: dread d1/d8/f5f [0,4194304] 0 2024-09-19T09:02:41.471 INFO:tasks.workunit.client.1.smithi102.stdout:4/713: getdents d14/d34/d5a/d5c/d79 0 2024-09-19T09:02:41.473 INFO:tasks.workunit.client.1.smithi102.stdout:3/735: mknod d2/d19/d1c/d2f/cef 0 2024-09-19T09:02:41.474 INFO:tasks.workunit.client.1.smithi102.stdout:9/617: read d1/d2/d3/d1d/d4f/d6d/f7c [3409365,32406] 0 2024-09-19T09:02:41.474 INFO:tasks.workunit.client.1.smithi102.stdout:7/660: unlink d1/d4/c28 0 2024-09-19T09:02:41.475 INFO:tasks.workunit.client.1.smithi102.stdout:8/581: rmdir d0/d10/d21/d39/d50/da2 39 2024-09-19T09:02:41.478 INFO:tasks.workunit.client.1.smithi102.stdout:6/551: fdatasync d1/d26/d2e/d45/d47/d4d/d35/f40 0 2024-09-19T09:02:41.478 INFO:tasks.workunit.client.1.smithi102.stdout:5/631: dwrite d5/d7/d1a/d42/f66 [0,4194304] 0 2024-09-19T09:02:41.478 INFO:tasks.workunit.client.1.smithi102.stdout:9/618: fdatasync d1/d2/d3/d1d/d4f/d6d/fa8 0 2024-09-19T09:02:41.479 INFO:tasks.workunit.client.1.smithi102.stdout:7/661: chown d1/d4/ca6 133788185 1 2024-09-19T09:02:41.479 INFO:tasks.workunit.client.1.smithi102.stdout:4/714: rename d14/d34/d9f to d14/d16/d17/d2e/d37/d58/de2 0 2024-09-19T09:02:41.483 INFO:tasks.workunit.client.1.smithi102.stdout:9/619: write d1/d8/d98/fad [5073585,90881] 0 2024-09-19T09:02:41.484 INFO:tasks.workunit.client.1.smithi102.stdout:7/662: dread d1/d4/f3d [0,4194304] 0 2024-09-19T09:02:41.485 INFO:tasks.workunit.client.1.smithi102.stdout:9/620: dread - d1/fa1 zero size 2024-09-19T09:02:41.485 INFO:tasks.workunit.client.1.smithi102.stdout:3/736: dread d2/d19/d47/db/d26/f7f [0,4194304] 0 2024-09-19T09:02:41.487 INFO:tasks.workunit.client.1.smithi102.stdout:4/715: rename d14/d16/d1d/d92/db1 to d14/d16/d17/de3 0 2024-09-19T09:02:41.487 INFO:tasks.workunit.client.1.smithi102.stdout:5/632: dread d5/d7/d1a/d8f/dc0/f76 [0,4194304] 0 2024-09-19T09:02:41.488 INFO:tasks.workunit.client.1.smithi102.stdout:4/716: chown d14/d34/d5a/d5c/d81/d75/caf 6 1 2024-09-19T09:02:41.488 INFO:tasks.workunit.client.1.smithi102.stdout:4/717: readlink d14/d16/d17/d2e/d60/lb4 0 2024-09-19T09:02:41.490 INFO:tasks.workunit.client.1.smithi102.stdout:4/718: write d14/d16/d1d/f53 [369520,70529] 0 2024-09-19T09:02:41.490 INFO:tasks.workunit.client.1.smithi102.stdout:6/552: creat d1/d26/d2e/d45/d47/d4d/fbc x:0 0 0 2024-09-19T09:02:41.494 INFO:tasks.workunit.client.1.smithi102.stdout:5/633: unlink d5/d7/d1a/d37/d50/f52 0 2024-09-19T09:02:41.499 INFO:tasks.workunit.client.1.smithi102.stdout:8/582: truncate d0/d10/d21/f24 2763848 0 2024-09-19T09:02:41.500 INFO:tasks.workunit.client.1.smithi102.stdout:9/621: write d1/f40 [662620,5932] 0 2024-09-19T09:02:41.502 INFO:tasks.workunit.client.1.smithi102.stdout:7/663: rmdir d1/d2f/da2 0 2024-09-19T09:02:41.503 INFO:tasks.workunit.client.1.smithi102.stdout:6/553: mknod d1/d18/db/cbd 0 2024-09-19T09:02:41.504 INFO:tasks.workunit.client.1.smithi102.stdout:8/583: mkdir d0/db/d29/db5 0 2024-09-19T09:02:41.504 INFO:tasks.workunit.client.1.smithi102.stdout:3/737: creat d2/d19/d47/db/d26/d63/ff0 x:0 0 0 2024-09-19T09:02:41.505 INFO:tasks.workunit.client.1.smithi102.stdout:4/719: dread d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f38 [0,4194304] 0 2024-09-19T09:02:41.505 INFO:tasks.workunit.client.1.smithi102.stdout:7/664: mknod d1/d3/d20/d6c/cd6 0 2024-09-19T09:02:41.505 INFO:tasks.workunit.client.1.smithi102.stdout:0/761: sync 2024-09-19T09:02:41.507 INFO:tasks.workunit.client.1.smithi102.stdout:7/665: truncate d1/d2d/f97 4196625 0 2024-09-19T09:02:41.507 INFO:tasks.workunit.client.1.smithi102.stdout:5/634: link l2 d5/d7/d1a/d37/d39/d81/lc9 0 2024-09-19T09:02:41.508 INFO:tasks.workunit.client.1.smithi102.stdout:3/738: truncate d2/f1d 747892 0 2024-09-19T09:02:41.509 INFO:tasks.workunit.client.1.smithi102.stdout:3/739: chown d2/d19/d35/l76 55780635 1 2024-09-19T09:02:41.511 INFO:tasks.workunit.client.1.smithi102.stdout:8/584: fsync d0/d10/d21/f24 0 2024-09-19T09:02:41.511 INFO:tasks.workunit.client.1.smithi102.stdout:5/635: dread d5/d7/d1a/d42/fa9 [0,4194304] 0 2024-09-19T09:02:41.513 INFO:tasks.workunit.client.1.smithi102.stdout:4/720: rename d14/d16/fc3 to d14/d16/d17/d2e/d37/d58/d89/da0/fe4 0 2024-09-19T09:02:41.514 INFO:tasks.workunit.client.1.smithi102.stdout:7/666: creat d1/d2f/fd7 x:0 0 0 2024-09-19T09:02:41.516 INFO:tasks.workunit.client.1.smithi102.stdout:3/740: mkdir d2/d19/d35/dce/ddc/df1 0 2024-09-19T09:02:41.519 INFO:tasks.workunit.client.1.smithi102.stdout:5/636: symlink d5/d7/d1a/d37/d34/d4d/d9c/lca 0 2024-09-19T09:02:41.521 INFO:tasks.workunit.client.1.smithi102.stdout:4/721: symlink d14/d16/d17/d2e/d37/d58/de2/le5 0 2024-09-19T09:02:41.522 INFO:tasks.workunit.client.1.smithi102.stdout:7/667: rename d1/d3/d20/l4d to d1/d2f/ld8 0 2024-09-19T09:02:41.525 INFO:tasks.workunit.client.1.smithi102.stdout:0/762: creat d3/dd/d10/d15/d19/ff9 x:0 0 0 2024-09-19T09:02:41.525 INFO:tasks.workunit.client.1.smithi102.stdout:3/741: unlink d2/d19/d1c/d2f/d5a/d84/d53/le6 0 2024-09-19T09:02:41.526 INFO:tasks.workunit.client.1.smithi102.stdout:6/554: dwrite d1/d18/f78 [0,4194304] 0 2024-09-19T09:02:41.526 INFO:tasks.workunit.client.1.smithi102.stdout:4/722: truncate d14/d34/d5a/d5c/fd4 961077 0 2024-09-19T09:02:41.528 INFO:tasks.workunit.client.1.smithi102.stdout:4/723: chown f12 990 1 2024-09-19T09:02:41.530 INFO:tasks.workunit.client.1.smithi102.stdout:5/637: dwrite d5/d23/f24 [0,4194304] 0 2024-09-19T09:02:41.531 INFO:tasks.workunit.client.1.smithi102.stdout:4/724: readlink d14/d16/d17/de3/lc2 0 2024-09-19T09:02:41.531 INFO:tasks.workunit.client.1.smithi102.stdout:6/555: creat d1/d26/d2e/fbe x:0 0 0 2024-09-19T09:02:41.533 INFO:tasks.workunit.client.1.smithi102.stdout:7/668: rename d1/d4/d9c/c5d to d1/d3/d20/d6c/cd9 0 2024-09-19T09:02:41.534 INFO:tasks.workunit.client.1.smithi102.stdout:3/742: creat d2/d19/d1c/d2f/d5a/d84/d64/ff2 x:0 0 0 2024-09-19T09:02:41.534 INFO:tasks.workunit.client.1.smithi102.stdout:5/638: dread - d5/d7/d1a/d8f/fbd zero size 2024-09-19T09:02:41.535 INFO:tasks.workunit.client.1.smithi102.stdout:8/585: truncate d0/d10/d21/d39/f3d 6320428 0 2024-09-19T09:02:41.536 INFO:tasks.workunit.client.1.smithi102.stdout:6/556: write d1/d26/d2e/d70/f9a [1663555,27209] 0 2024-09-19T09:02:41.537 INFO:tasks.workunit.client.1.smithi102.stdout:7/669: write d1/d3/f64 [233757,59199] 0 2024-09-19T09:02:41.537 INFO:tasks.workunit.client.1.smithi102.stdout:4/725: mknod d14/d34/d5a/d5c/d79/d8c/ce6 0 2024-09-19T09:02:41.539 INFO:tasks.workunit.client.1.smithi102.stdout:4/726: fdatasync d14/d16/fce 0 2024-09-19T09:02:41.540 INFO:tasks.workunit.client.1.smithi102.stdout:8/586: write d0/db/d1d/f34 [1258284,85400] 0 2024-09-19T09:02:41.542 INFO:tasks.workunit.client.1.smithi102.stdout:0/763: dwrite d3/dd/d10/d15/d22/d37/d39/d44/fe0 [0,4194304] 0 2024-09-19T09:02:41.542 INFO:tasks.workunit.client.1.smithi102.stdout:6/557: mknod d1/d26/d2e/d45/cbf 0 2024-09-19T09:02:41.543 INFO:tasks.workunit.client.1.smithi102.stdout:8/587: fdatasync d0/db/d1d/f7d 0 2024-09-19T09:02:41.544 INFO:tasks.workunit.client.1.smithi102.stdout:7/670: readlink d1/d4/dca/l42 0 2024-09-19T09:02:41.544 INFO:tasks.workunit.client.1.smithi102.stdout:5/639: rename d5/d7/d1a/d8f/dc0/f76 to d5/d8d/fcb 0 2024-09-19T09:02:41.548 INFO:tasks.workunit.client.1.smithi102.stdout:6/558: chown d1/d26/d2e/d45/f55 2 1 2024-09-19T09:02:41.549 INFO:tasks.workunit.client.1.smithi102.stdout:4/727: stat d14/d16/d17/d2e/d37/d58/d89/da6/d7c/d80 0 2024-09-19T09:02:41.550 INFO:tasks.workunit.client.1.smithi102.stdout:0/764: read d3/dd/d10/d15/f36 [1946635,61336] 0 2024-09-19T09:02:41.551 INFO:tasks.workunit.client.1.smithi102.stdout:7/671: chown d1/d4/dca/d52/lc2 1991 1 2024-09-19T09:02:41.551 INFO:tasks.workunit.client.1.smithi102.stdout:3/743: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/fd1 [0,4194304] 0 2024-09-19T09:02:41.552 INFO:tasks.workunit.client.1.smithi102.stdout:6/559: write d1/d26/d4b/d94/d8a/fb3 [2569749,129526] 0 2024-09-19T09:02:41.556 INFO:tasks.workunit.client.1.smithi102.stdout:0/765: symlink d3/dd/lfa 0 2024-09-19T09:02:41.558 INFO:tasks.workunit.client.1.smithi102.stdout:5/640: truncate d5/d7/d1a/d37/d39/d4c/f4a 673781 0 2024-09-19T09:02:41.559 INFO:tasks.workunit.client.1.smithi102.stdout:6/560: chown d1/d26/d2e/d45/c50 2054 1 2024-09-19T09:02:41.562 INFO:tasks.workunit.client.1.smithi102.stdout:5/641: chown d5/d23/d3b/f8c 4577877 1 2024-09-19T09:02:41.563 INFO:tasks.workunit.client.1.smithi102.stdout:0/766: getdents d3/dd/d1a/d32 0 2024-09-19T09:02:41.565 INFO:tasks.workunit.client.1.smithi102.stdout:7/672: dread d1/d4/dca/f77 [0,4194304] 0 2024-09-19T09:02:41.566 INFO:tasks.workunit.client.1.smithi102.stdout:3/744: dwrite d2/d19/d1c/d2f/d5a/d84/d53/fbb [0,4194304] 0 2024-09-19T09:02:41.569 INFO:tasks.workunit.client.1.smithi102.stdout:0/767: rmdir d3/dd/d10/d15/d22/d37/d39/d44/d54/de5 39 2024-09-19T09:02:41.569 INFO:tasks.workunit.client.1.smithi102.stdout:3/745: read d2/d19/d47/f89 [950237,68134] 0 2024-09-19T09:02:41.572 INFO:tasks.workunit.client.1.smithi102.stdout:3/746: readlink d2/d19/d47/lbe 0 2024-09-19T09:02:41.573 INFO:tasks.workunit.client.1.smithi102.stdout:3/747: stat d2/l65 0 2024-09-19T09:02:41.574 INFO:tasks.workunit.client.1.smithi102.stdout:7/673: dread d1/d2f/f4a [0,4194304] 0 2024-09-19T09:02:41.574 INFO:tasks.workunit.client.1.smithi102.stdout:5/642: dwrite d5/d7/d1a/d8f/dc0/f92 [0,4194304] 0 2024-09-19T09:02:41.579 INFO:tasks.workunit.client.1.smithi102.stdout:3/748: read d2/d19/d1c/d2f/d5a/d84/d4f/f85 [187839,99266] 0 2024-09-19T09:02:41.580 INFO:tasks.workunit.client.1.smithi102.stdout:4/728: truncate d14/d34/d5a/d5c/d79/d8c/fa9 3409049 0 2024-09-19T09:02:41.580 INFO:tasks.workunit.client.1.smithi102.stdout:0/768: dwrite d3/dd/d1a/fef [0,4194304] 0 2024-09-19T09:02:41.581 INFO:tasks.workunit.client.1.smithi102.stdout:7/674: truncate d1/d3/d72/f75 1686934 0 2024-09-19T09:02:41.582 INFO:tasks.workunit.client.1.smithi102.stdout:0/769: readlink d3/dd/d10/d15/d22/d37/d39/d44/d54/dd4/le3 0 2024-09-19T09:02:41.584 INFO:tasks.workunit.client.1.smithi102.stdout:3/749: rmdir d2/d19/d1c/d2f/d5a/d84/d64 39 2024-09-19T09:02:41.585 INFO:tasks.workunit.client.1.smithi102.stdout:6/561: truncate d1/d26/d2e/d45/daf/d8d/f92 170250 0 2024-09-19T09:02:41.623 INFO:tasks.workunit.client.1.smithi102.stdout:2/552: sync 2024-09-19T09:02:41.639 INFO:tasks.workunit.client.1.smithi102.stdout:4/729: rename d14/d16/d17/d2e/d37/d58/d89/da6/d2f/c74 to d14/dd7/ce7 0 2024-09-19T09:02:41.639 INFO:tasks.workunit.client.1.smithi102.stdout:0/770: symlink d3/dd/d10/d15/d19/d8d/lfb 0 2024-09-19T09:02:41.641 INFO:tasks.workunit.client.1.smithi102.stdout:3/750: creat d2/d1e/dcb/ff3 x:0 0 0 2024-09-19T09:02:41.642 INFO:tasks.workunit.client.1.smithi102.stdout:4/730: dread - d14/d16/d17/f7a zero size 2024-09-19T09:02:41.644 INFO:tasks.workunit.client.1.smithi102.stdout:2/553: symlink d7/d1a/lb7 0 2024-09-19T09:02:41.646 INFO:tasks.workunit.client.1.smithi102.stdout:4/731: mknod d14/dd7/ce8 0 2024-09-19T09:02:41.647 INFO:tasks.workunit.client.1.smithi102.stdout:7/675: link d1/d4/dca/d52/d7f/caa d1/d4/d9c/cda 0 2024-09-19T09:02:41.649 INFO:tasks.workunit.client.1.smithi102.stdout:2/554: creat d7/d1a/d56/fb8 x:0 0 0 2024-09-19T09:02:41.650 INFO:tasks.workunit.client.1.smithi102.stdout:6/562: write d1/d18/db/f30 [2895252,47588] 0 2024-09-19T09:02:41.652 INFO:tasks.workunit.client.1.smithi102.stdout:7/676: creat d1/d3/d20/dad/dd4/fdb x:0 0 0 2024-09-19T09:02:41.652 INFO:tasks.workunit.client.1.smithi102.stdout:4/732: link d14/d16/d1d/d48/l97 d14/d16/d1d/d92/le9 0 2024-09-19T09:02:41.652 INFO:tasks.workunit.client.1.smithi102.stdout:6/563: chown d1/d26/d2e/d45/daf/d8d 24489934 1 2024-09-19T09:02:41.656 INFO:tasks.workunit.client.1.smithi102.stdout:3/751: dread d2/d19/d47/f7 [8388608,4194304] 0 2024-09-19T09:02:41.663 INFO:tasks.workunit.client.1.smithi102.stdout:2/555: dwrite d7/d1a/d2b/d4e/f94 [0,4194304] 0 2024-09-19T09:02:41.663 INFO:tasks.workunit.client.1.smithi102.stdout:4/733: rename d14/d16/d1d/f44 to d14/d16/d17/d2e/d37/d58/d89/da6/d2f/fea 0 2024-09-19T09:02:41.664 INFO:tasks.workunit.client.1.smithi102.stdout:0/771: dwrite d3/dd/d10/d15/d22/d37/d3d/f48 [0,4194304] 0 2024-09-19T09:02:41.671 INFO:tasks.workunit.client.1.smithi102.stdout:7/677: dwrite d1/d3/d20/dad/dcd/fd5 [0,4194304] 0 2024-09-19T09:02:41.671 INFO:tasks.workunit.client.1.smithi102.stdout:0/772: symlink d3/dd/d10/d15/d22/d37/d3d/lfc 0 2024-09-19T09:02:41.674 INFO:tasks.workunit.client.1.smithi102.stdout:6/564: dwrite d1/d26/d4b/d94/fa1 [0,4194304] 0 2024-09-19T09:02:41.676 INFO:tasks.workunit.client.1.smithi102.stdout:0/773: dread - d3/dd/d10/d15/d22/d82/fc3 zero size 2024-09-19T09:02:41.679 INFO:tasks.workunit.client.1.smithi102.stdout:0/774: read d3/dd/d10/d15/d22/d37/d3d/f48 [1588455,71460] 0 2024-09-19T09:02:41.682 INFO:tasks.workunit.client.1.smithi102.stdout:2/556: dwrite d7/d1a/f8f [0,4194304] 0 2024-09-19T09:02:41.682 INFO:tasks.workunit.client.1.smithi102.stdout:0/775: chown d3/dd/d10/d15/d22/d4a/d80/fb5 5 1 2024-09-19T09:02:41.684 INFO:tasks.workunit.client.1.smithi102.stdout:0/776: chown d3/dd/d10/d15/d3e/c57 0 1 2024-09-19T09:02:41.684 INFO:tasks.workunit.client.1.smithi102.stdout:6/565: creat d1/d18/fc0 x:0 0 0 2024-09-19T09:02:41.686 INFO:tasks.workunit.client.1.smithi102.stdout:3/752: dread d2/d19/d1c/d2f/d5a/d84/f9a [0,4194304] 0 2024-09-19T09:02:41.686 INFO:tasks.workunit.client.1.smithi102.stdout:2/557: fdatasync d7/d1a/d2b/f2d 0 2024-09-19T09:02:41.688 INFO:tasks.workunit.client.1.smithi102.stdout:0/777: symlink d3/dd/d1a/d32/d7f/lfd 0 2024-09-19T09:02:41.690 INFO:tasks.workunit.client.1.smithi102.stdout:2/558: mkdir d7/d1a/d56/db9 0 2024-09-19T09:02:41.690 INFO:tasks.workunit.client.1.smithi102.stdout:3/753: symlink d2/d19/d35/dce/ddc/de5/lf4 0 2024-09-19T09:02:41.692 INFO:tasks.workunit.client.1.smithi102.stdout:6/566: creat d1/d26/d2e/d45/d47/d4d/d35/d79/fc1 x:0 0 0 2024-09-19T09:02:41.693 INFO:tasks.workunit.client.1.smithi102.stdout:2/559: mknod d7/d50/d64/cba 0 2024-09-19T09:02:41.694 INFO:tasks.workunit.client.1.smithi102.stdout:0/778: creat d3/dd/d10/d15/d22/d37/d39/d44/d54/dcd/ffe x:0 0 0 2024-09-19T09:02:41.695 INFO:tasks.workunit.client.1.smithi102.stdout:3/754: creat d2/d19/d1c/d2f/d5a/d84/d53/ff5 x:0 0 0 2024-09-19T09:02:41.697 INFO:tasks.workunit.client.1.smithi102.stdout:6/567: rmdir d1/d18/db/dab 0 2024-09-19T09:02:41.697 INFO:tasks.workunit.client.1.smithi102.stdout:0/779: write d3/dd/d10/d84/fdf [782590,18600] 0 2024-09-19T09:02:41.699 INFO:tasks.workunit.client.1.smithi102.stdout:3/755: read d2/d19/d1c/d2f/fb5 [2416934,45056] 0 2024-09-19T09:02:41.701 INFO:tasks.workunit.client.1.smithi102.stdout:2/560: dwrite d7/d1a/d2b/f69 [0,4194304] 0 2024-09-19T09:02:41.702 INFO:tasks.workunit.client.1.smithi102.stdout:2/561: chown d7/d1a/d2b/d4e 124076260 1 2024-09-19T09:02:41.702 INFO:tasks.workunit.client.1.smithi102.stdout:6/568: creat d1/d26/d2e/d45/d47/d4d/fc2 x:0 0 0 2024-09-19T09:02:41.705 INFO:tasks.workunit.client.1.smithi102.stdout:6/569: mkdir d1/d26/d2e/d45/d47/dc3 0 2024-09-19T09:02:41.705 INFO:tasks.workunit.client.1.smithi102.stdout:0/780: dread d3/dd/d10/d15/d22/d37/d3d/fbe [0,4194304] 0 2024-09-19T09:02:41.708 INFO:tasks.workunit.client.1.smithi102.stdout:6/570: creat d1/d26/d2e/fc4 x:0 0 0 2024-09-19T09:02:41.708 INFO:tasks.workunit.client.1.smithi102.stdout:4/734: write d14/d34/f6e [1611334,28788] 0 2024-09-19T09:02:41.711 INFO:tasks.workunit.client.1.smithi102.stdout:2/562: rename d7/d50/d64/d7f/d83/l6c to d7/d1a/d2b/dae/lbb 0 2024-09-19T09:02:41.711 INFO:tasks.workunit.client.1.smithi102.stdout:7/678: write d1/d3/d72/f75 [1038873,70246] 0 2024-09-19T09:02:41.714 INFO:tasks.workunit.client.1.smithi102.stdout:4/735: creat d14/dd7/feb x:0 0 0 2024-09-19T09:02:41.714 INFO:tasks.workunit.client.1.smithi102.stdout:4/736: chown d14/f6d 2116542041 1 2024-09-19T09:02:41.715 INFO:tasks.workunit.client.1.smithi102.stdout:2/563: dread d7/d1a/d2b/f69 [0,4194304] 0 2024-09-19T09:02:41.716 INFO:tasks.workunit.client.1.smithi102.stdout:7/679: creat d1/d2f/d95/fdc x:0 0 0 2024-09-19T09:02:41.717 INFO:tasks.workunit.client.1.smithi102.stdout:4/737: read d14/d16/d17/d2e/d37/f76 [322422,96160] 0 2024-09-19T09:02:41.717 INFO:tasks.workunit.client.1.smithi102.stdout:7/680: chown d1/d2d/f43 0 1 2024-09-19T09:02:41.717 INFO:tasks.workunit.client.1.smithi102.stdout:4/738: chown fe 2860415 1 2024-09-19T09:02:41.717 INFO:tasks.workunit.client.1.smithi102.stdout:6/571: symlink d1/d18/db/lc5 0 2024-09-19T09:02:41.718 INFO:tasks.workunit.client.1.smithi102.stdout:3/756: getdents d2/d19/d35/dce/ddc/de5 0 2024-09-19T09:02:41.720 INFO:tasks.workunit.client.1.smithi102.stdout:7/681: dread d1/d4/dca/f60 [0,4194304] 0 2024-09-19T09:02:41.720 INFO:tasks.workunit.client.1.smithi102.stdout:0/781: mknod d3/dd/d10/d15/d22/d2a/dba/d9d/de2/cff 0 2024-09-19T09:02:41.722 INFO:tasks.workunit.client.1.smithi102.stdout:0/782: chown d3/dd/d10/d15/d22/d37/d3d/lfc 6 1 2024-09-19T09:02:41.723 INFO:tasks.workunit.client.1.smithi102.stdout:4/739: creat d14/d16/d1d/d92/fec x:0 0 0 2024-09-19T09:02:41.725 INFO:tasks.workunit.client.1.smithi102.stdout:6/572: rename d1/d26/d2e/d45/cbf to d1/d26/d4b/d94/cc6 0 2024-09-19T09:02:41.725 INFO:tasks.workunit.client.1.smithi102.stdout:3/757: truncate d2/d1e/f4d 1267707 0 2024-09-19T09:02:41.726 INFO:tasks.workunit.client.1.smithi102.stdout:2/564: dwrite d7/d12/d37/fa6 [0,4194304] 0 2024-09-19T09:02:41.727 INFO:tasks.workunit.client.1.smithi102.stdout:3/758: dread - d2/d19/d47/fcc zero size 2024-09-19T09:02:41.729 INFO:tasks.workunit.client.1.smithi102.stdout:0/783: mkdir d3/dd/d10/d15/d22/d2a/dba/d9d/de2/d100 0 2024-09-19T09:02:41.730 INFO:tasks.workunit.client.1.smithi102.stdout:0/784: chown d3/dd/d1a/lf3 736201967 1 2024-09-19T09:02:41.731 INFO:tasks.workunit.client.1.smithi102.stdout:4/740: mkdir d14/d16/d17/d2e/d37/d58/d89/d78/ddb/ded 0 2024-09-19T09:02:41.732 INFO:tasks.workunit.client.1.smithi102.stdout:0/785: write d3/dd/d10/d15/d22/d4a/d80/fb5 [3811525,85861] 0 2024-09-19T09:02:41.733 INFO:tasks.workunit.client.1.smithi102.stdout:2/565: unlink d7/d1a/d2b/f69 0 2024-09-19T09:02:41.734 INFO:tasks.workunit.client.1.smithi102.stdout:6/573: rename d1/d26/d2e/d45/d47/f75 to d1/d26/d2e/d45/d47/d4d/d35/d79/fc7 0 2024-09-19T09:02:41.734 INFO:tasks.workunit.client.1.smithi102.stdout:1/648: sync 2024-09-19T09:02:41.735 INFO:tasks.workunit.client.1.smithi102.stdout:4/741: mknod d14/d34/d5a/d5c/d79/cee 0 2024-09-19T09:02:41.737 INFO:tasks.workunit.client.1.smithi102.stdout:2/566: mknod d7/d11/cbc 0 2024-09-19T09:02:41.739 INFO:tasks.workunit.client.1.smithi102.stdout:6/574: creat d1/d18/d37/fc8 x:0 0 0 2024-09-19T09:02:41.741 INFO:tasks.workunit.client.1.smithi102.stdout:7/682: dread d1/d4/f6 [0,4194304] 0 2024-09-19T09:02:41.741 INFO:tasks.workunit.client.1.smithi102.stdout:6/575: truncate d1/d26/d2e/d45/daf/d8d/faa 205154 0 2024-09-19T09:02:41.742 INFO:tasks.workunit.client.1.smithi102.stdout:0/786: mknod d3/dd/d10/d15/d22/d37/d39/c101 0 2024-09-19T09:02:41.742 INFO:tasks.workunit.client.1.smithi102.stdout:7/683: readlink d1/d3/d20/d6c/l6d 0 2024-09-19T09:02:41.743 INFO:tasks.workunit.client.1.smithi102.stdout:7/684: fdatasync d1/d3/d20/f2c 0 2024-09-19T09:02:41.744 INFO:tasks.workunit.client.1.smithi102.stdout:7/685: fdatasync d1/d3/d34/f66 0 2024-09-19T09:02:41.744 INFO:tasks.workunit.client.1.smithi102.stdout:2/567: creat d7/d1a/d2b/d31/d51/d6b/fbd x:0 0 0 2024-09-19T09:02:41.749 INFO:tasks.workunit.client.1.smithi102.stdout:3/759: rename d2/d19/d47/db/f2e to d2/d19/ff6 0 2024-09-19T09:02:41.751 INFO:tasks.workunit.client.1.smithi102.stdout:0/787: dwrite d3/dd/d10/f63 [4194304,4194304] 0 2024-09-19T09:02:41.752 INFO:tasks.workunit.client.1.smithi102.stdout:3/760: read - d2/d19/d1c/d1f/fc7 zero size 2024-09-19T09:02:41.754 INFO:tasks.workunit.client.1.smithi102.stdout:9/622: sync 2024-09-19T09:02:41.754 INFO:tasks.workunit.client.1.smithi102.stdout:5/643: sync 2024-09-19T09:02:41.754 INFO:tasks.workunit.client.1.smithi102.stdout:8/588: sync 2024-09-19T09:02:41.754 INFO:tasks.workunit.client.1.smithi102.stdout:0/788: read d3/dd/d10/d84/fb7 [2578882,86439] 0 2024-09-19T09:02:41.755 INFO:tasks.workunit.client.1.smithi102.stdout:7/686: dwrite d1/d4/dca/f87 [0,4194304] 0 2024-09-19T09:02:41.755 INFO:tasks.workunit.client.1.smithi102.stdout:2/568: mkdir d7/d1a/d2b/dae/dbe 0 2024-09-19T09:02:41.757 INFO:tasks.workunit.client.1.smithi102.stdout:6/576: symlink d1/d26/d2e/d45/d47/dc3/lc9 0 2024-09-19T09:02:41.758 INFO:tasks.workunit.client.1.smithi102.stdout:9/623: readlink d1/d2/d78/l8e 0 2024-09-19T09:02:41.758 INFO:tasks.workunit.client.1.smithi102.stdout:4/742: getdents d14/d16/d17/de3 0 2024-09-19T09:02:41.759 INFO:tasks.workunit.client.1.smithi102.stdout:1/649: dread dd/d14/d35/f80 [0,4194304] 0 2024-09-19T09:02:41.763 INFO:tasks.workunit.client.1.smithi102.stdout:3/761: chown d2/d19/d1c/d2f/d5a/d84/ca8 4678572 1 2024-09-19T09:02:41.763 INFO:tasks.workunit.client.1.smithi102.stdout:4/743: fdatasync d14/d16/d17/d2e/d37/d58/d89/da0/fb5 0 2024-09-19T09:02:41.763 INFO:tasks.workunit.client.1.smithi102.stdout:6/577: chown d1/d3a/f98 50 1 2024-09-19T09:02:41.764 INFO:tasks.workunit.client.1.smithi102.stdout:5/644: mknod d5/d7/d1a/d37/d39/ccc 0 2024-09-19T09:02:41.765 INFO:tasks.workunit.client.1.smithi102.stdout:9/624: mkdir d1/d2/d3/d1d/dc7 0 2024-09-19T09:02:41.765 INFO:tasks.workunit.client.1.smithi102.stdout:6/578: dread - d1/d18/db/d65/f96 zero size 2024-09-19T09:02:41.766 INFO:tasks.workunit.client.1.smithi102.stdout:6/579: chown d1/d26/f85 7909349 1 2024-09-19T09:02:41.767 INFO:tasks.workunit.client.1.smithi102.stdout:8/589: rename d0/db/d84/f91 to d0/d10/d3a/d9a/fb6 0 2024-09-19T09:02:41.767 INFO:tasks.workunit.client.1.smithi102.stdout:9/625: chown d1/d2/d3/d1d/d4f/d6d/d81/d90/faf 11116 1 2024-09-19T09:02:41.768 INFO:tasks.workunit.client.1.smithi102.stdout:8/590: write d0/d10/d21/f6c [1547464,1817] 0 2024-09-19T09:02:41.770 INFO:tasks.workunit.client.1.smithi102.stdout:8/591: truncate d0/db/d1d/f7d 556710 0 2024-09-19T09:02:41.770 INFO:tasks.workunit.client.1.smithi102.stdout:3/762: creat d2/d19/d47/db/d26/d63/d6f/ff7 x:0 0 0 2024-09-19T09:02:41.771 INFO:tasks.workunit.client.1.smithi102.stdout:3/763: readlink d2/d19/d35/l5e 0 2024-09-19T09:02:41.772 INFO:tasks.workunit.client.1.smithi102.stdout:4/744: creat d14/d16/d17/d2e/d37/d58/d89/da6/d2f/fef x:0 0 0 2024-09-19T09:02:41.772 INFO:tasks.workunit.client.1.smithi102.stdout:7/687: write d1/d4/f1a [1602177,6907] 0 2024-09-19T09:02:41.773 INFO:tasks.workunit.client.1.smithi102.stdout:6/580: write d1/d26/d4b/f7a [517640,3100] 0 2024-09-19T09:02:41.775 INFO:tasks.workunit.client.1.smithi102.stdout:0/789: mknod d3/dd/d10/d15/d22/d37/d39/d44/d54/de5/c102 0 2024-09-19T09:02:41.776 INFO:tasks.workunit.client.1.smithi102.stdout:8/592: creat d0/d4f/daa/fb7 x:0 0 0 2024-09-19T09:02:41.777 INFO:tasks.workunit.client.1.smithi102.stdout:7/688: rmdir d1/d3 39 2024-09-19T09:02:41.777 INFO:tasks.workunit.client.1.smithi102.stdout:3/764: read d2/d19/d47/db/f25 [421362,57507] 0 2024-09-19T09:02:41.778 INFO:tasks.workunit.client.1.smithi102.stdout:2/569: rename d7/d12/c3f to d7/d1a/d2b/d31/d51/cbf 0 2024-09-19T09:02:41.779 INFO:tasks.workunit.client.1.smithi102.stdout:1/650: link dd/d13/d2d/d78/lc7 dd/d13/d2d/ld6 0 2024-09-19T09:02:41.779 INFO:tasks.workunit.client.1.smithi102.stdout:6/581: read - d1/d18/d37/f5b zero size 2024-09-19T09:02:41.781 INFO:tasks.workunit.client.1.smithi102.stdout:5/645: creat d5/d7/d1a/d37/fcd x:0 0 0 2024-09-19T09:02:41.781 INFO:tasks.workunit.client.1.smithi102.stdout:2/570: write d7/d50/f8a [998090,126865] 0 2024-09-19T09:02:41.784 INFO:tasks.workunit.client.1.smithi102.stdout:9/626: getdents d1/d2/d3/d1d/d4f 0 2024-09-19T09:02:41.784 INFO:tasks.workunit.client.1.smithi102.stdout:5/646: chown d5/d23/d3b/l59 15243828 1 2024-09-19T09:02:41.784 INFO:tasks.workunit.client.1.smithi102.stdout:6/582: mkdir d1/d26/d2e/d70/dca 0 2024-09-19T09:02:41.786 INFO:tasks.workunit.client.1.smithi102.stdout:0/790: creat d3/dd/f103 x:0 0 0 2024-09-19T09:02:41.787 INFO:tasks.workunit.client.1.smithi102.stdout:8/593: dwrite d0/db/f89 [4194304,4194304] 0 2024-09-19T09:02:41.788 INFO:tasks.workunit.client.1.smithi102.stdout:7/689: creat d1/fdd x:0 0 0 2024-09-19T09:02:41.788 INFO:tasks.workunit.client.1.smithi102.stdout:2/571: write d7/d1a/d2b/d31/d51/d6b/f8c [2538785,97413] 0 2024-09-19T09:02:41.788 INFO:tasks.workunit.client.1.smithi102.stdout:3/765: creat d2/d19/d1c/d2f/d5a/ff8 x:0 0 0 2024-09-19T09:02:41.789 INFO:tasks.workunit.client.1.smithi102.stdout:5/647: chown d5/d23/d3b/f5c 98864 1 2024-09-19T09:02:41.790 INFO:tasks.workunit.client.1.smithi102.stdout:6/583: symlink d1/d26/d2e/lcb 0 2024-09-19T09:02:41.791 INFO:tasks.workunit.client.1.smithi102.stdout:8/594: dread - d0/d10/fb4 zero size 2024-09-19T09:02:41.792 INFO:tasks.workunit.client.1.smithi102.stdout:0/791: stat d3/dd/d10/d15/d22/d2a/l8f 0 2024-09-19T09:02:41.792 INFO:tasks.workunit.client.1.smithi102.stdout:9/627: creat d1/d2/d3/d6f/fc8 x:0 0 0 2024-09-19T09:02:41.797 INFO:tasks.workunit.client.1.smithi102.stdout:2/572: dread d7/d11/f43 [0,4194304] 0 2024-09-19T09:02:41.797 INFO:tasks.workunit.client.1.smithi102.stdout:1/651: dwrite dd/d14/d35/fca [0,4194304] 0 2024-09-19T09:02:41.797 INFO:tasks.workunit.client.1.smithi102.stdout:6/584: write d1/d18/f6a [2636621,116583] 0 2024-09-19T09:02:41.797 INFO:tasks.workunit.client.1.smithi102.stdout:5/648: unlink d5/d23/f24 0 2024-09-19T09:02:41.799 INFO:tasks.workunit.client.1.smithi102.stdout:9/628: fsync d1/d2/d3/d1d/d4f/d6d/d81/f92 0 2024-09-19T09:02:41.800 INFO:tasks.workunit.client.1.smithi102.stdout:6/585: chown d1/d18/d37/fa0 1 1 2024-09-19T09:02:41.801 INFO:tasks.workunit.client.1.smithi102.stdout:7/690: dread d1/d4/dca/f7d [0,4194304] 0 2024-09-19T09:02:41.801 INFO:tasks.workunit.client.1.smithi102.stdout:8/595: mkdir d0/d10/d21/d39/db8 0 2024-09-19T09:02:41.801 INFO:tasks.workunit.client.1.smithi102.stdout:3/766: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/ff9 x:0 0 0 2024-09-19T09:02:41.802 INFO:tasks.workunit.client.1.smithi102.stdout:4/745: truncate d14/d16/d17/d2e/d37/d58/d89/da6/f7f 1379561 0 2024-09-19T09:02:41.802 INFO:tasks.workunit.client.1.smithi102.stdout:9/629: readlink d1/d2/d78/l8e 0 2024-09-19T09:02:41.805 INFO:tasks.workunit.client.1.smithi102.stdout:2/573: dread d7/d1a/d2b/f35 [4194304,4194304] 0 2024-09-19T09:02:41.805 INFO:tasks.workunit.client.1.smithi102.stdout:8/596: dread - d0/d4f/daa/fb7 zero size 2024-09-19T09:02:41.806 INFO:tasks.workunit.client.1.smithi102.stdout:0/792: creat d3/dd/d10/d15/d22/d2a/dba/d9d/de2/f104 x:0 0 0 2024-09-19T09:02:41.807 INFO:tasks.workunit.client.1.smithi102.stdout:1/652: mknod dd/d14/d35/cd7 0 2024-09-19T09:02:41.808 INFO:tasks.workunit.client.1.smithi102.stdout:0/793: dread - d3/dd/f103 zero size 2024-09-19T09:02:41.808 INFO:tasks.workunit.client.1.smithi102.stdout:8/597: chown d0/d10/c47 101 1 2024-09-19T09:02:41.808 INFO:tasks.workunit.client.1.smithi102.stdout:3/767: mkdir d2/d19/d35/dce/ddc/dfa 0 2024-09-19T09:02:41.809 INFO:tasks.workunit.client.1.smithi102.stdout:6/586: truncate d1/d18/f23 187469 0 2024-09-19T09:02:41.810 INFO:tasks.workunit.client.1.smithi102.stdout:7/691: truncate d1/d4/f63 75044 0 2024-09-19T09:02:41.811 INFO:tasks.workunit.client.1.smithi102.stdout:5/649: creat d5/d7/d1a/fce x:0 0 0 2024-09-19T09:02:41.811 INFO:tasks.workunit.client.1.smithi102.stdout:7/692: fdatasync d1/d2d/f43 0 2024-09-19T09:02:41.811 INFO:tasks.workunit.client.1.smithi102.stdout:2/574: rmdir d7/d1a/d2b/dae 39 2024-09-19T09:02:41.811 INFO:tasks.workunit.client.1.smithi102.stdout:3/768: dread d2/d1e/f38 [0,4194304] 0 2024-09-19T09:02:41.813 INFO:tasks.workunit.client.1.smithi102.stdout:5/650: read - d5/d8d/d95/fbf zero size 2024-09-19T09:02:41.813 INFO:tasks.workunit.client.1.smithi102.stdout:2/575: fsync d7/d11/f1c 0 2024-09-19T09:02:41.813 INFO:tasks.workunit.client.1.smithi102.stdout:8/598: creat d0/d10/d21/d39/d50/d63/fb9 x:0 0 0 2024-09-19T09:02:41.814 INFO:tasks.workunit.client.1.smithi102.stdout:3/769: chown d2/d19/d1c/d1f/d5f/c8f 0 1 2024-09-19T09:02:41.815 INFO:tasks.workunit.client.1.smithi102.stdout:9/630: rename d1/d2/d3/d1d/f6a to d1/d2/d3/fc9 0 2024-09-19T09:02:41.815 INFO:tasks.workunit.client.1.smithi102.stdout:1/653: creat dd/d14/dac/fd8 x:0 0 0 2024-09-19T09:02:41.817 INFO:tasks.workunit.client.1.smithi102.stdout:7/693: mknod d1/cde 0 2024-09-19T09:02:41.817 INFO:tasks.workunit.client.1.smithi102.stdout:6/587: truncate d1/d18/db/f1f 1333310 0 2024-09-19T09:02:41.818 INFO:tasks.workunit.client.1.smithi102.stdout:7/694: read d1/d2f/f4a [3451101,127679] 0 2024-09-19T09:02:41.819 INFO:tasks.workunit.client.1.smithi102.stdout:6/588: write d1/d3a/f5d [4104847,59065] 0 2024-09-19T09:02:41.820 INFO:tasks.workunit.client.1.smithi102.stdout:4/746: rename d14/d16/d17/d2e/d37/d58/d89/da6/d2f/dd2 to d14/d34/d5a/d5c/d81/d75/df0 0 2024-09-19T09:02:41.821 INFO:tasks.workunit.client.1.smithi102.stdout:3/770: truncate d2/d19/d47/f7 2349145 0 2024-09-19T09:02:41.821 INFO:tasks.workunit.client.1.smithi102.stdout:9/631: write d1/d8/d1c/f28 [5044868,123680] 0 2024-09-19T09:02:41.822 INFO:tasks.workunit.client.1.smithi102.stdout:4/747: chown d14/d34/d5a/d5c/d79/d8c/f9e 1007 1 2024-09-19T09:02:41.824 INFO:tasks.workunit.client.1.smithi102.stdout:0/794: link d3/dd/d10/d15/d3e/c55 d3/dd/d10/d15/d22/d2a/dba/d9d/de2/d100/c105 0 2024-09-19T09:02:41.826 INFO:tasks.workunit.client.1.smithi102.stdout:4/748: truncate d14/d16/d1d/d92/f93 1028766 0 2024-09-19T09:02:41.829 INFO:tasks.workunit.client.1.smithi102.stdout:8/599: rename d0/d10/f92 to d0/db/d29/fba 0 2024-09-19T09:02:41.831 INFO:tasks.workunit.client.1.smithi102.stdout:4/749: dread - d14/d16/d17/d2e/d37/d58/d89/da6/d2f/fef zero size 2024-09-19T09:02:41.831 INFO:tasks.workunit.client.1.smithi102.stdout:3/771: dwrite d2/d19/d47/db/fa5 [0,4194304] 0 2024-09-19T09:02:41.831 INFO:tasks.workunit.client.1.smithi102.stdout:2/576: dread d7/d50/d64/d7f/d83/f76 [0,4194304] 0 2024-09-19T09:02:41.831 INFO:tasks.workunit.client.1.smithi102.stdout:9/632: fdatasync d1/d2/d3/f31 0 2024-09-19T09:02:41.832 INFO:tasks.workunit.client.1.smithi102.stdout:9/633: chown d1/d8/d1c 3168 1 2024-09-19T09:02:41.833 INFO:tasks.workunit.client.1.smithi102.stdout:5/651: rename d5/d7/d1a/f7e to d5/d7/d1a/fcf 0 2024-09-19T09:02:41.837 INFO:tasks.workunit.client.1.smithi102.stdout:7/695: symlink d1/d3/d34/ldf 0 2024-09-19T09:02:41.839 INFO:tasks.workunit.client.1.smithi102.stdout:8/600: fdatasync d0/d10/f37 0 2024-09-19T09:02:41.840 INFO:tasks.workunit.client.1.smithi102.stdout:8/601: read d0/d4f/f74 [1742290,34839] 0 2024-09-19T09:02:41.841 INFO:tasks.workunit.client.1.smithi102.stdout:2/577: creat d7/d50/d64/fc0 x:0 0 0 2024-09-19T09:02:41.845 INFO:tasks.workunit.client.1.smithi102.stdout:9/634: creat d1/d2/d78/fca x:0 0 0 2024-09-19T09:02:41.849 INFO:tasks.workunit.client.1.smithi102.stdout:6/589: dread d1/d18/f23 [0,4194304] 0 2024-09-19T09:02:41.850 INFO:tasks.workunit.client.1.smithi102.stdout:6/590: fsync d1/d18/d37/f7d 0 2024-09-19T09:02:41.852 INFO:tasks.workunit.client.1.smithi102.stdout:7/696: fsync d1/d3/d34/d4f/f50 0 2024-09-19T09:02:41.853 INFO:tasks.workunit.client.1.smithi102.stdout:1/654: getdents dd/d14/d35/d49/d62/d9e 0 2024-09-19T09:02:41.854 INFO:tasks.workunit.client.1.smithi102.stdout:8/602: symlink d0/db/d1d/da5/lbb 0 2024-09-19T09:02:41.856 INFO:tasks.workunit.client.1.smithi102.stdout:2/578: dread d7/d1a/d2b/d31/d51/f55 [0,4194304] 0 2024-09-19T09:02:41.856 INFO:tasks.workunit.client.1.smithi102.stdout:9/635: mkdir d1/d2/d3/d6f/dcb 0 2024-09-19T09:02:41.857 INFO:tasks.workunit.client.1.smithi102.stdout:9/636: readlink d1/d8/l9b 0 2024-09-19T09:02:41.857 INFO:tasks.workunit.client.1.smithi102.stdout:4/750: fsync d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f6b 0 2024-09-19T09:02:41.864 INFO:tasks.workunit.client.1.smithi102.stdout:3/772: write d2/d19/d47/db/d26/f3a [207788,99576] 0 2024-09-19T09:02:41.867 INFO:tasks.workunit.client.1.smithi102.stdout:0/795: write d3/dd/d1a/f1b [2341413,58983] 0 2024-09-19T09:02:41.872 INFO:tasks.workunit.client.1.smithi102.stdout:9/637: creat d1/d2/d3/d6f/d8d/fcc x:0 0 0 2024-09-19T09:02:41.872 INFO:tasks.workunit.client.1.smithi102.stdout:5/652: truncate d5/d7/d1a/d42/f66 427450 0 2024-09-19T09:02:41.874 INFO:tasks.workunit.client.1.smithi102.stdout:6/591: creat d1/d26/d2e/d45/d47/d4d/d35/d41/fcc x:0 0 0 2024-09-19T09:02:41.874 INFO:tasks.workunit.client.1.smithi102.stdout:5/653: readlink d5/d7b/dc2/la6 0 2024-09-19T09:02:41.874 INFO:tasks.workunit.client.1.smithi102.stdout:7/697: unlink d1/d2f/f82 0 2024-09-19T09:02:41.875 INFO:tasks.workunit.client.1.smithi102.stdout:6/592: stat d1/d26/d4b/d94/d8a/f8f 0 2024-09-19T09:02:41.876 INFO:tasks.workunit.client.1.smithi102.stdout:2/579: rename d7/d12/f57 to d7/d1a/d2b/d31/fc1 0 2024-09-19T09:02:41.877 INFO:tasks.workunit.client.1.smithi102.stdout:5/654: rmdir d5/d7/d1a/d8f/dc0 39 2024-09-19T09:02:41.877 INFO:tasks.workunit.client.1.smithi102.stdout:4/751: dwrite d14/d16/d17/f1c [0,4194304] 0 2024-09-19T09:02:41.878 INFO:tasks.workunit.client.1.smithi102.stdout:8/603: rmdir d0/db/d1d/da5/daf 0 2024-09-19T09:02:41.880 INFO:tasks.workunit.client.1.smithi102.stdout:7/698: chown d1/d4/dca/d52/d7f/caa 14021 1 2024-09-19T09:02:41.880 INFO:tasks.workunit.client.1.smithi102.stdout:9/638: creat d1/d2/d3/d1d/dc7/fcd x:0 0 0 2024-09-19T09:02:41.881 INFO:tasks.workunit.client.1.smithi102.stdout:3/773: creat d2/d19/d1c/d2f/d5a/d84/ffb x:0 0 0 2024-09-19T09:02:41.885 INFO:tasks.workunit.client.1.smithi102.stdout:5/655: readlink d5/d7/d1a/d37/d39/d81/lad 0 2024-09-19T09:02:41.885 INFO:tasks.workunit.client.1.smithi102.stdout:7/699: symlink d1/d3/d72/le0 0 2024-09-19T09:02:41.886 INFO:tasks.workunit.client.1.smithi102.stdout:3/774: dread - d2/d19/d1c/d1f/fc7 zero size 2024-09-19T09:02:41.888 INFO:tasks.workunit.client.1.smithi102.stdout:1/655: getdents dd/d5f 0 2024-09-19T09:02:41.888 INFO:tasks.workunit.client.1.smithi102.stdout:2/580: dwrite d7/d11/f68 [0,4194304] 0 2024-09-19T09:02:41.889 INFO:tasks.workunit.client.1.smithi102.stdout:0/796: getdents d3/dd/d1a 0 2024-09-19T09:02:41.893 INFO:tasks.workunit.client.1.smithi102.stdout:7/700: truncate d1/d2f/fd7 524829 0 2024-09-19T09:02:41.893 INFO:tasks.workunit.client.1.smithi102.stdout:9/639: mknod d1/d2/d78/da0/dc0/cce 0 2024-09-19T09:02:41.896 INFO:tasks.workunit.client.1.smithi102.stdout:4/752: dwrite d14/d16/d17/d2e/d37/d58/d89/da6/d2f/f5f [0,4194304] 0 2024-09-19T09:02:41.897 INFO:tasks.workunit.client.1.smithi102.stdout:0/797: write d3/dd/d1a/f1b [1455771,68766] 0 2024-09-19T09:02:41.901 INFO:tasks.workunit.client.1.smithi102.stdout:4/753: read d14/d16/d1d/d92/f93 [600669,77922] 0 2024-09-19T09:02:41.903 INFO:tasks.workunit.client.1.smithi102.stdout:1/656: dwrite fc [0,4194304] 0 2024-09-19T09:02:41.906 INFO:tasks.workunit.client.1.smithi102.stdout:7/701: link d1/d4/dca/fb9 d1/d2f/fe1 0 2024-09-19T09:02:41.908 INFO:tasks.workunit.client.1.smithi102.stdout:2/581: dread d7/d1a/d2b/d31/d51/d6b/f70 [0,4194304] 0 2024-09-19T09:02:41.909 INFO:tasks.workunit.client.1.smithi102.stdout:1/657: write dd/d7a/d8c/da6/fb0 [785108,4194] 0 2024-09-19T09:02:41.910 INFO:tasks.workunit.client.1.smithi102.stdout:4/754: fdatasync d14/d16/d17/d2e/d37/d58/d89/da6/f4b 0 2024-09-19T09:02:41.910 INFO:tasks.workunit.client.1.smithi102.stdout:8/604: dread d0/d10/d21/d39/d87/f8e [0,4194304] 0 2024-09-19T09:02:41.911 INFO:tasks.workunit.client.1.smithi102.stdout:7/702: fsync d1/d4/dca/d52/f58 0 2024-09-19T09:02:41.911 INFO:tasks.workunit.client.1.smithi102.stdout:9/640: link d1/d2/c5d d1/d2/d3/d1d/ccf 0 2024-09-19T09:02:41.913 INFO:tasks.workunit.client.1.smithi102.stdout:1/658: write dd/d13/d2d/d78/fb1 [299759,78144] 0 2024-09-19T09:02:41.913 INFO:tasks.workunit.client.1.smithi102.stdout:0/798: creat d3/dd/d10/f106 x:0 0 0 2024-09-19T09:02:41.914 INFO:tasks.workunit.client.1.smithi102.stdout:2/582: unlink d7/d1a/d2b/c90 0 2024-09-19T09:02:41.917 INFO:tasks.workunit.client.1.smithi102.stdout:4/755: write d14/d16/d17/d2e/d37/d58/d89/da0/fd1 [1037124,19094] 0 2024-09-19T09:02:41.919 INFO:tasks.workunit.client.1.smithi102.stdout:1/659: mknod dd/d14/d35/d49/d62/cd9 0 2024-09-19T09:02:41.919 INFO:tasks.workunit.client.1.smithi102.stdout:2/583: mknod d7/d1a/d56/cc2 0 2024-09-19T09:02:41.920 INFO:tasks.workunit.client.1.smithi102.stdout:7/703: mkdir d1/d4/dca/d52/d7f/da5/de2 0 2024-09-19T09:02:41.924 INFO:tasks.workunit.client.1.smithi102.stdout:4/756: rename d14/d16/fbf to d14/d16/ff1 0 2024-09-19T09:02:41.924 INFO:tasks.workunit.client.1.smithi102.stdout:7/704: symlink d1/d3/le3 0 2024-09-19T09:02:41.925 INFO:tasks.workunit.client.1.smithi102.stdout:2/584: mknod d7/d1a/d56/db9/cc3 0 2024-09-19T09:02:41.925 INFO:tasks.workunit.client.1.smithi102.stdout:0/799: dwrite d3/dd/d1a/d32/d7f/fd6 [0,4194304] 0 2024-09-19T09:02:41.926 INFO:tasks.workunit.client.1.smithi102.stdout:2/585: dread - d7/d50/d64/f77 zero size 2024-09-19T09:02:41.930 INFO:tasks.workunit.client.1.smithi102.stdout:2/586: mknod d7/d50/d64/d7f/cc4 0 2024-09-19T09:02:41.932 INFO:tasks.workunit.client.1.smithi102.stdout:4/757: write d14/d16/d1d/d92/f93 [1225159,71935] 0 2024-09-19T09:02:41.932 INFO:tasks.workunit.client.1.smithi102.stdout:7/705: truncate d1/d3/d34/fd1 2479328 0 2024-09-19T09:02:41.933 INFO:tasks.workunit.client.1.smithi102.stdout:8/605: dread d0/d10/d21/f6c [0,4194304] 0 2024-09-19T09:02:41.933 INFO:tasks.workunit.client.1.smithi102.stdout:7/706: stat d1/d2f/f41 0 2024-09-19T09:02:41.935 INFO:tasks.workunit.client.1.smithi102.stdout:2/587: symlink d7/d1a/d2b/dae/db4/lc5 0 2024-09-19T09:02:41.935 INFO:tasks.workunit.client.1.smithi102.stdout:7/707: symlink d1/d4/dca/le4 0 2024-09-19T09:02:41.936 INFO:tasks.workunit.client.1.smithi102.stdout:8/606: creat d0/d10/d21/d39/d50/d63/fbc x:0 0 0 2024-09-19T09:02:41.936 INFO:tasks.workunit.client.1.smithi102.stdout:7/708: dread - d1/d3/f93 zero size 2024-09-19T09:02:41.937 INFO:tasks.workunit.client.1.smithi102.stdout:2/588: write d7/f42 [682747,14435] 0 2024-09-19T09:02:41.938 INFO:tasks.workunit.client.1.smithi102.stdout:8/607: chown d0/d10/d21/d39/d50/d63/d83 12086416 1 2024-09-19T09:02:41.939 INFO:tasks.workunit.client.1.smithi102.stdout:2/589: mknod d7/d1a/d2b/d31/cc6 0 2024-09-19T09:02:41.941 INFO:tasks.workunit.client.1.smithi102.stdout:8/608: mknod d0/cbd 0 2024-09-19T09:02:41.941 INFO:tasks.workunit.client.1.smithi102.stdout:2/590: dread - d7/d1a/d56/f97 zero size 2024-09-19T09:02:41.945 INFO:tasks.workunit.client.1.smithi102.stdout:2/591: write d7/d50/d64/f77 [662116,72590] 0 2024-09-19T09:02:41.945 INFO:tasks.workunit.client.1.smithi102.stdout:7/709: dwrite d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:41.945 INFO:tasks.workunit.client.1.smithi102.stdout:8/609: symlink d0/d10/d21/d39/d87/lbe 0 2024-09-19T09:02:41.946 INFO:tasks.workunit.client.1.smithi102.stdout:7/710: stat d1/d3/d72/f75 0 2024-09-19T09:02:41.947 INFO:tasks.workunit.client.1.smithi102.stdout:8/610: fdatasync d0/db/f15 0 2024-09-19T09:02:41.949 INFO:tasks.workunit.client.1.smithi102.stdout:7/711: readlink d1/d3/d72/le0 0 2024-09-19T09:02:41.950 INFO:tasks.workunit.client.1.smithi102.stdout:9/641: truncate d1/d8/f44 142376 0 2024-09-19T09:02:41.950 INFO:tasks.workunit.client.1.smithi102.stdout:7/712: chown d1/d4/dca/f7d 1545 1 2024-09-19T09:02:41.952 INFO:tasks.workunit.client.1.smithi102.stdout:4/758: dread d14/d34/f28 [0,4194304] 0 2024-09-19T09:02:41.952 INFO:tasks.workunit.client.1.smithi102.stdout:2/592: unlink d7/d1a/d2b/d4e/c7c 0 2024-09-19T09:02:41.956 INFO:tasks.workunit.client.1.smithi102.stdout:7/713: write d1/d2f/f4a [1709227,32176] 0 2024-09-19T09:02:41.956 INFO:tasks.workunit.client.1.smithi102.stdout:4/759: rmdir d14/d34/d5a/d5c 39 2024-09-19T09:02:41.957 INFO:tasks.workunit.client.1.smithi102.stdout:4/760: readlink d14/l19 0 2024-09-19T09:02:41.958 INFO:tasks.workunit.client.1.smithi102.stdout:2/593: fsync d7/d1a/d2b/f81 0 2024-09-19T09:02:41.958 INFO:tasks.workunit.client.1.smithi102.stdout:5/656: dread d5/d7/d1b/f46 [0,4194304] 0 2024-09-19T09:02:41.961 INFO:tasks.workunit.client.1.smithi102.stdout:9/642: mkdir d1/d2/d3/dd0 0 2024-09-19T09:02:41.962 INFO:tasks.workunit.client.1.smithi102.stdout:9/643: write d1/d2/d3/f3c [836433,18433] 0 2024-09-19T09:02:41.963 INFO:tasks.workunit.client.1.smithi102.stdout:4/761: write d14/d16/d17/f66 [4651645,68433] 0 2024-09-19T09:02:41.965 INFO:tasks.workunit.client.1.smithi102.stdout:2/594: mkdir d7/d50/d64/d7f/d83/dc7 0 2024-09-19T09:02:41.968 INFO:tasks.workunit.client.1.smithi102.stdout:5/657: dread d5/d7/d1a/d37/d39/d4c/f4a [0,4194304] 0 2024-09-19T09:02:41.968 INFO:tasks.workunit.client.1.smithi102.stdout:4/762: read d14/d16/f1e [4046176,114054] 0 2024-09-19T09:02:41.969 INFO:tasks.workunit.client.1.smithi102.stdout:5/658: readlink d5/d7/d1a/l61 0 2024-09-19T09:02:41.970 INFO:tasks.workunit.client.1.smithi102.stdout:7/714: dwrite d1/d3/d34/d74/fc0 [0,4194304] 0 2024-09-19T09:02:41.970 INFO:tasks.workunit.client.1.smithi102.stdout:9/644: creat d1/d8/fd1 x:0 0 0 2024-09-19T09:02:41.974 INFO:tasks.workunit.client.1.smithi102.stdout:4/763: creat d14/d16/dd5/ff2 x:0 0 0 2024-09-19T09:02:41.974 INFO:tasks.workunit.client.1.smithi102.stdout:5/659: creat d5/d7/d1b/fd0 x:0 0 0 2024-09-19T09:02:41.977 INFO:tasks.workunit.client.1.smithi102.stdout:5/660: stat d5/d7/d1a/d37/d34/d73/cc4 0 2024-09-19T09:02:41.977 INFO:tasks.workunit.client.1.smithi102.stdout:2/595: dwrite d7/d12/d37/daf/f9d [0,4194304] 0 2024-09-19T09:02:41.978 INFO:tasks.workunit.client.1.smithi102.stdout:7/715: creat d1/d3/d34/d4f/fe5 x:0 0 0 2024-09-19T09:02:41.979 INFO:tasks.workunit.client.1.smithi102.stdout:8/611: truncate d0/d10/d21/d39/d50/d63/d83/fa9 229885 0 2024-09-19T09:02:41.980 INFO:tasks.workunit.client.1.smithi102.stdout:9/645: mknod d1/d2/d3/cd2 0 2024-09-19T09:02:41.982 INFO:tasks.workunit.client.1.smithi102.stdout:4/764: dread d14/d16/d17/d2e/d37/d58/d89/da0/fd1 [0,4194304] 0 2024-09-19T09:02:41.983 INFO:tasks.workunit.client.1.smithi102.stdout:2/596: dread d7/d1a/d2b/d31/f3e [0,4194304] 0 2024-09-19T09:02:41.987 INFO:tasks.workunit.client.1.smithi102.stdout:9/646: mkdir d1/d2/d3/d1d/d4f/d6d/d81/dd3 0 2024-09-19T09:02:41.989 INFO:tasks.workunit.client.1.smithi102.stdout:4/765: dread - d14/d34/d5a/d5c/d81/d75/fb9 zero size 2024-09-19T09:02:41.991 INFO:tasks.workunit.client.1.smithi102.stdout:4/766: chown d14/d16/d17/d2e/d37/f4a 14572 1 2024-09-19T09:02:41.991 INFO:tasks.workunit.client.1.smithi102.stdout:2/597: mkdir d7/d11/dc8 0 2024-09-19T09:02:41.992 INFO:tasks.workunit.client.1.smithi102.stdout:8/612: mknod d0/db/d29/db5/cbf 0 2024-09-19T09:02:41.993 INFO:tasks.workunit.client.1.smithi102.stdout:9/647: dread d1/d8/f56 [0,4194304] 0 2024-09-19T09:02:41.993 INFO:tasks.workunit.client.1.smithi102.stdout:2/598: write d7/d50/d64/f65 [1278948,80611] 0 2024-09-19T09:02:41.994 INFO:tasks.workunit.client.1.smithi102.stdout:8/613: chown d0/d10/l86 306 1 2024-09-19T09:02:41.994 INFO:tasks.workunit.client.1.smithi102.stdout:4/767: chown d14/d16/d17/d2e/d37/d58/d89/da6/d2f/la5 2 1 2024-09-19T09:02:41.997 INFO:tasks.workunit.client.1.smithi102.stdout:7/716: write d1/d3/d34/fd1 [2995809,55368] 0 2024-09-19T09:02:42.001 INFO:tasks.workunit.client.1.smithi102.stdout:7/717: write d1/d2f/f41 [2053846,23399] 0 2024-09-19T09:02:42.001 INFO:tasks.workunit.client.1.smithi102.stdout:8/614: mknod d0/d4f/cc0 0 2024-09-19T09:02:42.001 INFO:tasks.workunit.client.1.smithi102.stdout:7/718: stat d1/d4/dca/f4b 0 2024-09-19T09:02:42.001 INFO:tasks.workunit.client.1.smithi102.stdout:8/615: chown d0/d10/d21/d39/d87/fab 971 1 2024-09-19T09:02:42.001 INFO:tasks.workunit.client.1.smithi102.stdout:2/599: mknod d7/d12/d37/cc9 0 2024-09-19T09:02:42.001 INFO:tasks.workunit.client.1.smithi102.stdout:2/600: chown d7/d11/fb2 100476 1 2024-09-19T09:02:42.003 INFO:tasks.workunit.client.1.smithi102.stdout:5/661: dread d5/d7/d1a/d37/d39/d81/fab [0,4194304] 0 2024-09-19T09:02:42.003 INFO:tasks.workunit.client.1.smithi102.stdout:4/768: rename d14/d16/d17/d2e to d14/d16/d17/de3/dbd/df3 0 2024-09-19T09:02:42.007 INFO:tasks.workunit.client.1.smithi102.stdout:2/601: dwrite d7/d12/f9f [0,4194304] 0 2024-09-19T09:02:42.009 INFO:tasks.workunit.client.1.smithi102.stdout:9/648: creat d1/d8/fd4 x:0 0 0 2024-09-19T09:02:42.010 INFO:tasks.workunit.client.1.smithi102.stdout:8/616: write d0/d10/d21/f6c [2458640,30651] 0 2024-09-19T09:02:42.011 INFO:tasks.workunit.client.1.smithi102.stdout:9/649: chown d1/d2/d3/d1d/d4f/d6d 1548 1 2024-09-19T09:02:42.014 INFO:tasks.workunit.client.1.smithi102.stdout:4/769: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/de2/df4 0 2024-09-19T09:02:42.015 INFO:tasks.workunit.client.1.smithi102.stdout:5/662: mkdir d5/d7/d1a/d8f/dd1 0 2024-09-19T09:02:42.016 INFO:tasks.workunit.client.1.smithi102.stdout:9/650: mknod d1/d2/d3/d1d/d4f/cd5 0 2024-09-19T09:02:42.016 INFO:tasks.workunit.client.1.smithi102.stdout:2/602: creat d7/d1a/d2b/dab/fca x:0 0 0 2024-09-19T09:02:42.019 INFO:tasks.workunit.client.1.smithi102.stdout:9/651: stat d1/d2/d3/f77 0 2024-09-19T09:02:42.020 INFO:tasks.workunit.client.1.smithi102.stdout:5/663: mkdir d5/d60/db6/dd2 0 2024-09-19T09:02:42.020 INFO:tasks.workunit.client.1.smithi102.stdout:7/719: dwrite d1/d3/d34/d74/fa7 [0,4194304] 0 2024-09-19T09:02:42.022 INFO:tasks.workunit.client.1.smithi102.stdout:2/603: symlink d7/d1a/d2b/d31/lcb 0 2024-09-19T09:02:42.022 INFO:tasks.workunit.client.1.smithi102.stdout:8/617: dread d0/d64/f3c [0,4194304] 0 2024-09-19T09:02:42.024 INFO:tasks.workunit.client.1.smithi102.stdout:4/770: creat d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/ff5 x:0 0 0 2024-09-19T09:02:42.025 INFO:tasks.workunit.client.1.smithi102.stdout:2/604: mknod d7/d50/d64/da1/ccc 0 2024-09-19T09:02:42.027 INFO:tasks.workunit.client.1.smithi102.stdout:7/720: mkdir d1/d4/dca/d52/d7f/da5/de6 0 2024-09-19T09:02:42.029 INFO:tasks.workunit.client.1.smithi102.stdout:5/664: mknod d5/d7/d1a/d37/d34/d7f/d91/cd3 0 2024-09-19T09:02:42.030 INFO:tasks.workunit.client.1.smithi102.stdout:9/652: dwrite d1/d2/d3/fc9 [0,4194304] 0 2024-09-19T09:02:42.032 INFO:tasks.workunit.client.1.smithi102.stdout:4/771: rename d14/d16/d17/de3/dbd/df3/d37/f76 to d14/d16/dd5/ff6 0 2024-09-19T09:02:42.033 INFO:tasks.workunit.client.1.smithi102.stdout:4/772: dread - d14/d16/fce zero size 2024-09-19T09:02:42.034 INFO:tasks.workunit.client.1.smithi102.stdout:9/653: read d1/d2/d3/d6f/fa4 [2191840,15716] 0 2024-09-19T09:02:42.034 INFO:tasks.workunit.client.1.smithi102.stdout:2/605: dread d7/d12/f6a [0,4194304] 0 2024-09-19T09:02:42.036 INFO:tasks.workunit.client.1.smithi102.stdout:2/606: stat d7/d1a/d2b/d4e/l66 0 2024-09-19T09:02:42.037 INFO:tasks.workunit.client.1.smithi102.stdout:5/665: truncate d5/f15 1681812 0 2024-09-19T09:02:42.038 INFO:tasks.workunit.client.1.smithi102.stdout:4/773: creat d14/d34/d5a/d5c/d81/d75/df0/ff7 x:0 0 0 2024-09-19T09:02:42.038 INFO:tasks.workunit.client.1.smithi102.stdout:9/654: truncate d1/d2/d3/d6f/fc6 840573 0 2024-09-19T09:02:42.039 INFO:tasks.workunit.client.1.smithi102.stdout:2/607: unlink d7/d12/c30 0 2024-09-19T09:02:42.040 INFO:tasks.workunit.client.1.smithi102.stdout:5/666: dread d5/d8d/fcb [0,4194304] 0 2024-09-19T09:02:42.041 INFO:tasks.workunit.client.1.smithi102.stdout:4/774: truncate d14/d34/d5a/d5c/d79/fc1 133173 0 2024-09-19T09:02:42.043 INFO:tasks.workunit.client.1.smithi102.stdout:4/775: chown d14/d16/d17/de3/dbd/df3/d60/c90 355 1 2024-09-19T09:02:42.043 INFO:tasks.workunit.client.1.smithi102.stdout:8/618: write d0/d10/d21/d39/f3d [584326,765] 0 2024-09-19T09:02:42.044 INFO:tasks.workunit.client.1.smithi102.stdout:4/776: chown d14/d16/d17/de3/dbd/df3/c51 745237 1 2024-09-19T09:02:42.044 INFO:tasks.workunit.client.1.smithi102.stdout:8/619: chown d0/d10/d21/d39/db8 88694 1 2024-09-19T09:02:42.044 INFO:tasks.workunit.client.1.smithi102.stdout:7/721: truncate d1/d3/d20/fb2 812783 0 2024-09-19T09:02:42.045 INFO:tasks.workunit.client.1.smithi102.stdout:5/667: unlink d5/d7/d1a/d37/d34/d4d/d9c/lca 0 2024-09-19T09:02:42.046 INFO:tasks.workunit.client.1.smithi102.stdout:2/608: rename d7/d1a/d2b/d4e/f67 to d7/fcd 0 2024-09-19T09:02:42.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/4: sync 2024-09-19T09:02:42.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/5: dread - no filename 2024-09-19T09:02:42.047 INFO:tasks.workunit.client.0.smithi049.stdout:7/6: read - no filename 2024-09-19T09:02:42.047 INFO:tasks.workunit.client.1.smithi102.stdout:8/620: mkdir d0/d4f/dc1 0 2024-09-19T09:02:42.049 INFO:tasks.workunit.client.1.smithi102.stdout:2/609: chown c4 3826898 1 2024-09-19T09:02:42.051 INFO:tasks.workunit.client.1.smithi102.stdout:4/777: rename d14/d34/l8e to d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/lf8 0 2024-09-19T09:02:42.052 INFO:tasks.workunit.client.0.smithi049.stdout:7/7: mknod c0 0 2024-09-19T09:02:42.052 INFO:tasks.workunit.client.0.smithi049.stdout:7/8: dwrite - no filename 2024-09-19T09:02:42.052 INFO:tasks.workunit.client.0.smithi049.stdout:7/9: readlink - no filename 2024-09-19T09:02:42.053 INFO:tasks.workunit.client.1.smithi102.stdout:8/621: creat d0/d4f/fc2 x:0 0 0 2024-09-19T09:02:42.053 INFO:tasks.workunit.client.0.smithi049.stdout:7/10: mkdir d1 0 2024-09-19T09:02:42.055 INFO:tasks.workunit.client.1.smithi102.stdout:2/610: mkdir d7/d12/d37/d93/dce 0 2024-09-19T09:02:42.058 INFO:tasks.workunit.client.1.smithi102.stdout:4/778: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/df9 0 2024-09-19T09:02:42.059 INFO:tasks.workunit.client.1.smithi102.stdout:2/611: read d7/d50/d64/f77 [567768,90039] 0 2024-09-19T09:02:42.060 INFO:tasks.workunit.client.0.smithi049.stdout:7/11: creat d1/f2 x:0 0 0 2024-09-19T09:02:42.061 INFO:tasks.workunit.client.1.smithi102.stdout:7/722: dread d1/d3/d20/f2c [8388608,4194304] 0 2024-09-19T09:02:42.062 INFO:tasks.workunit.client.1.smithi102.stdout:9/655: dwrite d1/f45 [0,4194304] 0 2024-09-19T09:02:42.064 INFO:tasks.workunit.client.1.smithi102.stdout:4/779: mknod d14/d34/d5a/d5c/d79/cfa 0 2024-09-19T09:02:42.067 INFO:tasks.workunit.client.1.smithi102.stdout:2/612: symlink d7/d12/d37/d93/lcf 0 2024-09-19T09:02:42.072 INFO:tasks.workunit.client.1.smithi102.stdout:1/660: sync 2024-09-19T09:02:42.072 INFO:tasks.workunit.client.1.smithi102.stdout:0/800: sync 2024-09-19T09:02:42.072 INFO:tasks.workunit.client.1.smithi102.stdout:6/593: sync 2024-09-19T09:02:42.072 INFO:tasks.workunit.client.1.smithi102.stdout:3/775: sync 2024-09-19T09:02:42.072 INFO:tasks.workunit.client.1.smithi102.stdout:2/613: dread d7/d1a/d56/f98 [0,4194304] 0 2024-09-19T09:02:42.075 INFO:tasks.workunit.client.0.smithi049.stdout:7/12: dwrite d1/f2 [0,4194304] 0 2024-09-19T09:02:42.075 INFO:tasks.workunit.client.1.smithi102.stdout:9/656: dwrite d1/d8/d1c/f99 [0,4194304] 0 2024-09-19T09:02:42.075 INFO:tasks.workunit.client.1.smithi102.stdout:5/668: dwrite d5/d7b/dc2/f5f [0,4194304] 0 2024-09-19T09:02:42.077 INFO:tasks.workunit.client.1.smithi102.stdout:6/594: write d1/d3a/f7c [814904,94545] 0 2024-09-19T09:02:42.080 INFO:tasks.workunit.client.1.smithi102.stdout:9/657: chown d1/d2/d78/da0/fa7 13020 1 2024-09-19T09:02:42.082 INFO:tasks.workunit.client.1.smithi102.stdout:6/595: dread - d1/d26/d4b/d94/d8a/f6f zero size 2024-09-19T09:02:42.085 INFO:tasks.workunit.client.1.smithi102.stdout:0/801: rmdir d3/dd/d10/d15 39 2024-09-19T09:02:42.086 INFO:tasks.workunit.client.1.smithi102.stdout:8/622: truncate d0/db/d1d/f34 36444 0 2024-09-19T09:02:42.086 INFO:tasks.workunit.client.1.smithi102.stdout:4/780: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/ff5 [0,4194304] 0 2024-09-19T09:02:42.087 INFO:tasks.workunit.client.1.smithi102.stdout:9/658: chown d1/d2/d3/d1d/d4f/d6d/d81/d90/f93 975 1 2024-09-19T09:02:42.088 INFO:tasks.workunit.client.1.smithi102.stdout:3/776: dread d2/d19/d35/f41 [0,4194304] 0 2024-09-19T09:02:42.090 INFO:tasks.workunit.client.1.smithi102.stdout:9/659: fdatasync d1/d2/d3/d6f/d8d/da2/fab 0 2024-09-19T09:02:42.095 INFO:tasks.workunit.client.1.smithi102.stdout:1/661: mknod dd/d14/d35/d49/d62/cda 0 2024-09-19T09:02:42.098 INFO:tasks.workunit.client.1.smithi102.stdout:9/660: dwrite d1/d2/d3/d1d/d4f/fb8 [0,4194304] 0 2024-09-19T09:02:42.098 INFO:tasks.workunit.client.1.smithi102.stdout:5/669: fsync d5/d23/d3b/d78/f9a 0 2024-09-19T09:02:42.102 INFO:tasks.workunit.client.1.smithi102.stdout:0/802: fdatasync d3/dd/d10/d15/d2c/ff2 0 2024-09-19T09:02:42.106 INFO:tasks.workunit.client.1.smithi102.stdout:7/723: getdents d1/d3/d20/dad/dd4 0 2024-09-19T09:02:42.107 INFO:tasks.workunit.client.1.smithi102.stdout:7/724: chown d1/d3/d20/f35 33314007 1 2024-09-19T09:02:42.116 INFO:tasks.workunit.client.1.smithi102.stdout:3/777: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/d72/fdd [0,4194304] 0 2024-09-19T09:02:42.117 INFO:tasks.workunit.client.0.smithi049.stdout:7/13: fsync d1/f2 0 2024-09-19T09:02:42.117 INFO:tasks.workunit.client.0.smithi049.stdout:7/14: write d1/f2 [2491450,5962] 0 2024-09-19T09:02:42.118 INFO:tasks.workunit.client.1.smithi102.stdout:7/725: symlink d1/d2d/le7 0 2024-09-19T09:02:42.119 INFO:tasks.workunit.client.1.smithi102.stdout:5/670: symlink d5/d7/d1a/daa/ld4 0 2024-09-19T09:02:42.121 INFO:tasks.workunit.client.1.smithi102.stdout:9/661: symlink d1/d2/d3/d1d/d4f/d6d/d81/dd3/ld6 0 2024-09-19T09:02:42.122 INFO:tasks.workunit.client.1.smithi102.stdout:5/671: dread - d5/fc7 zero size 2024-09-19T09:02:42.124 INFO:tasks.workunit.client.1.smithi102.stdout:6/596: rename d1/d18/db/f19 to d1/fcd 0 2024-09-19T09:02:42.126 INFO:tasks.workunit.client.1.smithi102.stdout:4/781: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/f4b [0,4194304] 0 2024-09-19T09:02:42.131 INFO:tasks.workunit.client.1.smithi102.stdout:4/782: chown d14/d16/d1d/d48/c64 105561 1 2024-09-19T09:02:42.132 INFO:tasks.workunit.client.1.smithi102.stdout:3/778: dwrite d2/d19/d1c/d2f/d5a/d84/d53/fbb [0,4194304] 0 2024-09-19T09:02:42.139 INFO:tasks.workunit.client.1.smithi102.stdout:4/783: dwrite d14/d16/dd5/ff2 [0,4194304] 0 2024-09-19T09:02:42.141 INFO:tasks.workunit.client.1.smithi102.stdout:6/597: mkdir d1/d26/d2e/dce 0 2024-09-19T09:02:42.143 INFO:tasks.workunit.client.1.smithi102.stdout:6/598: truncate d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fad 649181 0 2024-09-19T09:02:42.144 INFO:tasks.workunit.client.1.smithi102.stdout:7/726: dread d1/d3/d20/f44 [0,4194304] 0 2024-09-19T09:02:42.155 INFO:tasks.workunit.client.1.smithi102.stdout:2/614: write d7/d1a/d2b/d31/fc1 [1022233,11690] 0 2024-09-19T09:02:42.156 INFO:tasks.workunit.client.1.smithi102.stdout:9/662: mknod d1/d2/cd7 0 2024-09-19T09:02:42.159 INFO:tasks.workunit.client.1.smithi102.stdout:6/599: fsync d1/d18/f24 0 2024-09-19T09:02:42.162 INFO:tasks.workunit.client.1.smithi102.stdout:3/779: dread d2/d19/d35/f5c [0,4194304] 0 2024-09-19T09:02:42.165 INFO:tasks.workunit.client.1.smithi102.stdout:9/663: dwrite d1/d2/d3/d6f/fc6 [0,4194304] 0 2024-09-19T09:02:42.169 INFO:tasks.workunit.client.1.smithi102.stdout:4/784: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d7c/d80/f95 [0,4194304] 0 2024-09-19T09:02:42.169 INFO:tasks.workunit.client.1.smithi102.stdout:9/664: read d1/d2/d3/fa [6423200,71823] 0 2024-09-19T09:02:42.174 INFO:tasks.workunit.client.1.smithi102.stdout:0/803: write d3/dd/d10/d15/d22/f2f [1108501,124605] 0 2024-09-19T09:02:42.175 INFO:tasks.workunit.client.1.smithi102.stdout:8/623: truncate d0/db/d1d/f34 158288 0 2024-09-19T09:02:42.177 INFO:tasks.workunit.client.1.smithi102.stdout:6/600: readlink d1/d26/d2e/d45/d47/d4d/d35/l48 0 2024-09-19T09:02:42.178 INFO:tasks.workunit.client.1.smithi102.stdout:8/624: truncate d0/d10/d21/d39/d87/f8e 5178929 0 2024-09-19T09:02:42.179 INFO:tasks.workunit.client.1.smithi102.stdout:1/662: truncate dd/d14/d18/f37 2967820 0 2024-09-19T09:02:42.181 INFO:tasks.workunit.client.1.smithi102.stdout:8/625: truncate d0/d10/d21/f2e 812752 0 2024-09-19T09:02:42.181 INFO:tasks.workunit.client.1.smithi102.stdout:3/780: truncate d2/d19/d1c/d2f/d5a/d84/d53/f79 4388023 0 2024-09-19T09:02:42.183 INFO:tasks.workunit.client.1.smithi102.stdout:0/804: dwrite d3/dd/d10/d15/d22/d37/d39/d44/ff6 [0,4194304] 0 2024-09-19T09:02:42.184 INFO:tasks.workunit.client.1.smithi102.stdout:4/785: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d7c/d80/d9d/dfb 0 2024-09-19T09:02:42.185 INFO:tasks.workunit.client.1.smithi102.stdout:0/805: write d3/dd/d10/d15/d22/f2f [991853,39501] 0 2024-09-19T09:02:42.189 INFO:tasks.workunit.client.1.smithi102.stdout:1/663: creat dd/d14/d18/fdb x:0 0 0 2024-09-19T09:02:42.191 INFO:tasks.workunit.client.1.smithi102.stdout:1/664: write dd/d14/d18/f3f [5920837,79069] 0 2024-09-19T09:02:42.192 INFO:tasks.workunit.client.1.smithi102.stdout:9/665: creat d1/d2/d3/d6f/dcb/fd8 x:0 0 0 2024-09-19T09:02:42.196 INFO:tasks.workunit.client.1.smithi102.stdout:5/672: truncate d5/d23/d3b/f5c 533394 0 2024-09-19T09:02:42.197 INFO:tasks.workunit.client.1.smithi102.stdout:5/673: chown d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6 30 1 2024-09-19T09:02:42.199 INFO:tasks.workunit.client.1.smithi102.stdout:5/674: truncate d5/d60/f99 1731213 0 2024-09-19T09:02:42.199 INFO:tasks.workunit.client.1.smithi102.stdout:4/786: creat d14/d34/d5a/d5c/d79/ffc x:0 0 0 2024-09-19T09:02:42.201 INFO:tasks.workunit.client.1.smithi102.stdout:0/806: rmdir d3/dd/d1a/d32/d62 39 2024-09-19T09:02:42.201 INFO:tasks.workunit.client.1.smithi102.stdout:5/675: fdatasync d5/d7b/dc2/f5f 0 2024-09-19T09:02:42.206 INFO:tasks.workunit.client.1.smithi102.stdout:8/626: dread d0/d10/d21/d39/f3d [0,4194304] 0 2024-09-19T09:02:42.206 INFO:tasks.workunit.client.1.smithi102.stdout:7/727: truncate d1/d2d/f97 2816837 0 2024-09-19T09:02:42.206 INFO:tasks.workunit.client.1.smithi102.stdout:1/665: fdatasync dd/d14/d35/d49/dcb/f6e 0 2024-09-19T09:02:42.206 INFO:tasks.workunit.client.1.smithi102.stdout:6/601: dread d1/d26/d4b/d94/d8a/fb3 [0,4194304] 0 2024-09-19T09:02:42.207 INFO:tasks.workunit.client.1.smithi102.stdout:2/615: dwrite f2 [0,4194304] 0 2024-09-19T09:02:42.209 INFO:tasks.workunit.client.1.smithi102.stdout:7/728: write d1/d4/dca/f7d [559355,24157] 0 2024-09-19T09:02:42.209 INFO:tasks.workunit.client.1.smithi102.stdout:9/666: creat d1/d2/d3/d6f/d8d/da2/fd9 x:0 0 0 2024-09-19T09:02:42.215 INFO:tasks.workunit.client.1.smithi102.stdout:8/627: dwrite d0/d10/fb4 [0,4194304] 0 2024-09-19T09:02:42.220 INFO:tasks.workunit.client.1.smithi102.stdout:4/787: symlink d14/d16/d17/de3/dbd/df3/d37/d58/de2/lfd 0 2024-09-19T09:02:42.225 INFO:tasks.workunit.client.1.smithi102.stdout:0/807: dwrite d3/dd/d10/d15/d19/f26 [0,4194304] 0 2024-09-19T09:02:42.227 INFO:tasks.workunit.client.1.smithi102.stdout:6/602: symlink d1/d18/db/d65/d8e/lcf 0 2024-09-19T09:02:42.229 INFO:tasks.workunit.client.1.smithi102.stdout:2/616: creat d7/d11/fd0 x:0 0 0 2024-09-19T09:02:42.234 INFO:tasks.workunit.client.1.smithi102.stdout:7/729: creat d1/d3/d20/dad/dd4/fe8 x:0 0 0 2024-09-19T09:02:42.236 INFO:tasks.workunit.client.1.smithi102.stdout:9/667: mknod d1/d2/d78/da0/cda 0 2024-09-19T09:02:42.243 INFO:tasks.workunit.client.1.smithi102.stdout:5/676: truncate d5/d7/d1a/d37/d34/f49 1073803 0 2024-09-19T09:02:42.244 INFO:tasks.workunit.client.1.smithi102.stdout:3/781: getdents d2/d19/d47 0 2024-09-19T09:02:42.245 INFO:tasks.workunit.client.1.smithi102.stdout:5/677: truncate d5/d7/d1a/d37/fcd 535099 0 2024-09-19T09:02:42.247 INFO:tasks.workunit.client.1.smithi102.stdout:6/603: unlink d1/d18/db/d65/f83 0 2024-09-19T09:02:42.253 INFO:tasks.workunit.client.1.smithi102.stdout:7/730: unlink d1/d3/d20/d6c/cd9 0 2024-09-19T09:02:42.254 INFO:tasks.workunit.client.1.smithi102.stdout:7/731: fsync d1/d2d/f54 0 2024-09-19T09:02:42.254 INFO:tasks.workunit.client.1.smithi102.stdout:9/668: creat d1/d2/d3/d6f/d8d/fdb x:0 0 0 2024-09-19T09:02:42.257 INFO:tasks.workunit.client.1.smithi102.stdout:9/669: write d1/d2/d3/d1d/f20 [6741765,33661] 0 2024-09-19T09:02:42.258 INFO:tasks.workunit.client.1.smithi102.stdout:7/732: dread d1/d4/dca/f87 [0,4194304] 0 2024-09-19T09:02:42.274 INFO:tasks.workunit.client.1.smithi102.stdout:1/666: truncate dd/d7a/d8c/da6/fc9 311467 0 2024-09-19T09:02:42.274 INFO:tasks.workunit.client.0.smithi049.stdout:6/0: sync 2024-09-19T09:02:42.274 INFO:tasks.workunit.client.0.smithi049.stdout:6/1: chown . 903191 1 2024-09-19T09:02:42.274 INFO:tasks.workunit.client.0.smithi049.stdout:6/2: link - no file 2024-09-19T09:02:42.279 INFO:tasks.workunit.client.1.smithi102.stdout:8/628: mknod d0/d10/d21/d39/d50/cc3 0 2024-09-19T09:02:42.279 INFO:tasks.workunit.client.1.smithi102.stdout:8/629: chown d0/d10/d21/f2e 71 1 2024-09-19T09:02:42.283 INFO:tasks.workunit.client.1.smithi102.stdout:3/782: stat d2/d19/d1c/d2f/d5a/d84/d64/faf 0 2024-09-19T09:02:42.288 INFO:tasks.workunit.client.1.smithi102.stdout:0/808: creat d3/dc7/f107 x:0 0 0 2024-09-19T09:02:42.289 INFO:tasks.workunit.client.1.smithi102.stdout:0/809: fdatasync d3/dd/d10/d15/d22/d2a/f6c 0 2024-09-19T09:02:42.293 INFO:tasks.workunit.client.1.smithi102.stdout:6/604: creat d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fd0 x:0 0 0 2024-09-19T09:02:42.293 INFO:tasks.workunit.client.1.smithi102.stdout:6/605: fsync d1/d26/d2e/d45/d47/d4d/d35/d41/fcc 0 2024-09-19T09:02:42.304 INFO:tasks.workunit.client.1.smithi102.stdout:9/670: creat d1/d2/d78/da0/dc0/fdc x:0 0 0 2024-09-19T09:02:42.307 INFO:tasks.workunit.client.1.smithi102.stdout:7/733: creat d1/d3/d34/d4f/fe9 x:0 0 0 2024-09-19T09:02:42.311 INFO:tasks.workunit.client.0.smithi049.stdout:7/15: creat d1/f3 x:0 0 0 2024-09-19T09:02:42.313 INFO:tasks.workunit.client.0.smithi049.stdout:6/3: creat f0 x:0 0 0 2024-09-19T09:02:42.313 INFO:tasks.workunit.client.0.smithi049.stdout:6/4: readlink - no filename 2024-09-19T09:02:42.313 INFO:tasks.workunit.client.0.smithi049.stdout:6/5: rmdir - no directory 2024-09-19T09:02:42.315 INFO:tasks.workunit.client.0.smithi049.stdout:2/6: sync 2024-09-19T09:02:42.315 INFO:tasks.workunit.client.0.smithi049.stdout:7/16: mknod d1/c4 0 2024-09-19T09:02:42.316 INFO:tasks.workunit.client.1.smithi102.stdout:4/788: truncate d14/d34/d5a/d5c/d79/d8c/f91 1637192 0 2024-09-19T09:02:42.320 INFO:tasks.workunit.client.0.smithi049.stdout:6/6: mknod c1 0 2024-09-19T09:02:42.321 INFO:tasks.workunit.client.1.smithi102.stdout:8/630: creat d0/d10/d9b/fc4 x:0 0 0 2024-09-19T09:02:42.321 INFO:tasks.workunit.client.1.smithi102.stdout:8/631: chown d0/d10/f7c 27936603 1 2024-09-19T09:02:42.321 INFO:tasks.workunit.client.1.smithi102.stdout:5/678: write d5/d7/d1a/d37/d34/f4e [221323,100576] 0 2024-09-19T09:02:42.322 INFO:tasks.workunit.client.0.smithi049.stdout:2/7: dread f0 [0,4194304] 0 2024-09-19T09:02:42.322 INFO:tasks.workunit.client.0.smithi049.stdout:6/7: dread - f0 zero size 2024-09-19T09:02:42.324 INFO:tasks.workunit.client.0.smithi049.stdout:6/8: write f0 [1027996,21028] 0 2024-09-19T09:02:42.325 INFO:tasks.workunit.client.0.smithi049.stdout:7/17: dwrite d1/f2 [4194304,4194304] 0 2024-09-19T09:02:42.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/8: mkdir d1 0 2024-09-19T09:02:42.329 INFO:tasks.workunit.client.0.smithi049.stdout:2/9: chown f0 50 1 2024-09-19T09:02:42.329 INFO:tasks.workunit.client.0.smithi049.stdout:2/10: read f0 [3855118,119360] 0 2024-09-19T09:02:42.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/9: symlink l2 0 2024-09-19T09:02:42.330 INFO:tasks.workunit.client.0.smithi049.stdout:2/11: chown f0 3 1 2024-09-19T09:02:42.333 INFO:tasks.workunit.client.1.smithi102.stdout:2/617: creat d7/d1a/fd1 x:0 0 0 2024-09-19T09:02:42.333 INFO:tasks.workunit.client.1.smithi102.stdout:5/679: dread d5/d7/d1a/d37/d39/f40 [0,4194304] 0 2024-09-19T09:02:42.334 INFO:tasks.workunit.client.0.smithi049.stdout:7/18: rename d1/c4 to d1/c5 0 2024-09-19T09:02:42.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/10: dread f0 [0,4194304] 0 2024-09-19T09:02:42.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/19: mknod d1/c6 0 2024-09-19T09:02:42.342 INFO:tasks.workunit.client.0.smithi049.stdout:6/11: creat f3 x:0 0 0 2024-09-19T09:02:42.343 INFO:tasks.workunit.client.1.smithi102.stdout:4/789: fsync d14/d16/f1e 0 2024-09-19T09:02:42.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/20: mkdir d1/d7 0 2024-09-19T09:02:42.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/21: chown d1/f2 101035266 1 2024-09-19T09:02:42.345 INFO:tasks.workunit.client.0.smithi049.stdout:6/12: creat f4 x:0 0 0 2024-09-19T09:02:42.347 INFO:tasks.workunit.client.1.smithi102.stdout:4/790: dwrite d14/d16/d1d/f50 [0,4194304] 0 2024-09-19T09:02:42.348 INFO:tasks.workunit.client.0.smithi049.stdout:7/22: mkdir d1/d8 0 2024-09-19T09:02:42.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/13: write f0 [1696814,80208] 0 2024-09-19T09:02:42.350 INFO:tasks.workunit.client.1.smithi102.stdout:0/810: symlink d3/dd/d10/d15/d22/d37/l108 0 2024-09-19T09:02:42.354 INFO:tasks.workunit.client.1.smithi102.stdout:5/680: creat d5/d60/fd5 x:0 0 0 2024-09-19T09:02:42.355 INFO:tasks.workunit.client.1.smithi102.stdout:5/681: fsync d5/d7b/dc2/f5f 0 2024-09-19T09:02:42.355 INFO:tasks.workunit.client.0.smithi049.stdout:6/14: symlink l5 0 2024-09-19T09:02:42.358 INFO:tasks.workunit.client.1.smithi102.stdout:2/618: rename d7/fa3 to d7/da4/fd2 0 2024-09-19T09:02:42.358 INFO:tasks.workunit.client.0.smithi049.stdout:7/23: dwrite d1/f3 [0,4194304] 0 2024-09-19T09:02:42.359 INFO:tasks.workunit.client.1.smithi102.stdout:2/619: chown d7/d50/d64/cba 235404355 1 2024-09-19T09:02:42.362 INFO:tasks.workunit.client.1.smithi102.stdout:3/783: write d2/d1e/fac [4350125,3394] 0 2024-09-19T09:02:42.363 INFO:tasks.workunit.client.0.smithi049.stdout:7/24: dread d1/f3 [0,4194304] 0 2024-09-19T09:02:42.363 INFO:tasks.workunit.client.1.smithi102.stdout:3/784: dread d2/d1e/f38 [0,4194304] 0 2024-09-19T09:02:42.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/25: dwrite d1/f3 [0,4194304] 0 2024-09-19T09:02:42.374 INFO:tasks.workunit.client.0.smithi049.stdout:7/26: fsync d1/f2 0 2024-09-19T09:02:42.376 INFO:tasks.workunit.client.1.smithi102.stdout:9/671: write d1/d2/d7b/f46 [1473138,121617] 0 2024-09-19T09:02:42.376 INFO:tasks.workunit.client.0.smithi049.stdout:6/15: link c1 c6 0 2024-09-19T09:02:42.378 INFO:tasks.workunit.client.1.smithi102.stdout:9/672: write d1/d2/d3/d1d/d4f/d6d/d81/d90/faf [605154,29149] 0 2024-09-19T09:02:42.383 INFO:tasks.workunit.client.0.smithi049.stdout:7/27: creat d1/d7/f9 x:0 0 0 2024-09-19T09:02:42.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/16: dwrite f3 [0,4194304] 0 2024-09-19T09:02:42.388 INFO:tasks.workunit.client.1.smithi102.stdout:6/606: rename d1/d18/db/f81 to d1/d18/db/fd1 0 2024-09-19T09:02:42.389 INFO:tasks.workunit.client.1.smithi102.stdout:5/682: rmdir d5/d7/d1a/d37/d34/d73 39 2024-09-19T09:02:42.390 INFO:tasks.workunit.client.0.smithi049.stdout:6/17: mknod c7 0 2024-09-19T09:02:42.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/28: creat d1/d7/fa x:0 0 0 2024-09-19T09:02:42.396 INFO:tasks.workunit.client.1.smithi102.stdout:7/734: write d1/d3/f1c [354572,57577] 0 2024-09-19T09:02:42.396 INFO:tasks.workunit.client.1.smithi102.stdout:7/735: stat d1/d2d/fb7 0 2024-09-19T09:02:42.397 INFO:tasks.workunit.client.1.smithi102.stdout:7/736: write d1/d2f/fd7 [341416,106726] 0 2024-09-19T09:02:42.398 INFO:tasks.workunit.client.1.smithi102.stdout:5/683: dread d5/d23/f26 [0,4194304] 0 2024-09-19T09:02:42.399 INFO:tasks.workunit.client.1.smithi102.stdout:5/684: stat d5/d7/d1a/d37/d39/d4c/f9b 0 2024-09-19T09:02:42.400 INFO:tasks.workunit.client.1.smithi102.stdout:3/785: truncate d2/d19/fb1 593448 0 2024-09-19T09:02:42.400 INFO:tasks.workunit.client.1.smithi102.stdout:7/737: read d1/d2f/fe1 [253639,81544] 0 2024-09-19T09:02:42.401 INFO:tasks.workunit.client.0.smithi049.stdout:7/29: creat d1/d8/fb x:0 0 0 2024-09-19T09:02:42.401 INFO:tasks.workunit.client.0.smithi049.stdout:7/30: readlink - no filename 2024-09-19T09:02:42.402 INFO:tasks.workunit.client.0.smithi049.stdout:6/18: link l2 l8 0 2024-09-19T09:02:42.402 INFO:tasks.workunit.client.1.smithi102.stdout:5/685: write d5/d7/d1a/d37/d39/d4c/d89/fa4 [1874706,10674] 0 2024-09-19T09:02:42.403 INFO:tasks.workunit.client.1.smithi102.stdout:1/667: getdents dd/d14/dac 0 2024-09-19T09:02:42.404 INFO:tasks.workunit.client.1.smithi102.stdout:1/668: write dd/d5f/f96 [1032158,44221] 0 2024-09-19T09:02:42.406 INFO:tasks.workunit.client.0.smithi049.stdout:6/19: dread f0 [0,4194304] 0 2024-09-19T09:02:42.407 INFO:tasks.workunit.client.0.smithi049.stdout:7/31: mknod d1/d8/cc 0 2024-09-19T09:02:42.409 INFO:tasks.workunit.client.0.smithi049.stdout:6/20: creat f9 x:0 0 0 2024-09-19T09:02:42.410 INFO:tasks.workunit.client.0.smithi049.stdout:7/32: symlink d1/d8/ld 0 2024-09-19T09:02:42.413 INFO:tasks.workunit.client.0.smithi049.stdout:7/33: creat d1/d7/fe x:0 0 0 2024-09-19T09:02:42.414 INFO:tasks.workunit.client.1.smithi102.stdout:2/620: mknod d7/d1a/cd3 0 2024-09-19T09:02:42.414 INFO:tasks.workunit.client.0.smithi049.stdout:7/34: write d1/d7/f9 [830876,51100] 0 2024-09-19T09:02:42.415 INFO:tasks.workunit.client.0.smithi049.stdout:6/21: unlink l8 0 2024-09-19T09:02:42.424 INFO:tasks.workunit.client.1.smithi102.stdout:8/632: getdents d0 0 2024-09-19T09:02:42.425 INFO:tasks.workunit.client.1.smithi102.stdout:9/673: symlink d1/d2/d3/d1d/d4f/d6d/db4/ldd 0 2024-09-19T09:02:42.426 INFO:tasks.workunit.client.1.smithi102.stdout:0/811: creat d3/dd/d10/d15/d22/d37/f109 x:0 0 0 2024-09-19T09:02:42.432 INFO:tasks.workunit.client.1.smithi102.stdout:4/791: getdents d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb 0 2024-09-19T09:02:42.432 INFO:tasks.workunit.client.0.smithi049.stdout:7/35: truncate d1/f3 1908181 0 2024-09-19T09:02:42.433 INFO:tasks.workunit.client.0.smithi049.stdout:7/36: write d1/d8/fb [394470,49216] 0 2024-09-19T09:02:42.433 INFO:tasks.workunit.client.1.smithi102.stdout:9/674: mkdir d1/d2/d3/d6f/dde 0 2024-09-19T09:02:42.435 INFO:tasks.workunit.client.1.smithi102.stdout:0/812: unlink d3/dd/d10/d15/d22/d37/ca0 0 2024-09-19T09:02:42.436 INFO:tasks.workunit.client.1.smithi102.stdout:6/607: link d1/d18/db/cbd d1/d26/d4b/cd2 0 2024-09-19T09:02:42.436 INFO:tasks.workunit.client.1.smithi102.stdout:0/813: stat d3 0 2024-09-19T09:02:42.436 INFO:tasks.workunit.client.1.smithi102.stdout:3/786: dwrite d2/d1e/f3d [0,4194304] 0 2024-09-19T09:02:42.436 INFO:tasks.workunit.client.0.smithi049.stdout:7/37: fdatasync d1/d8/fb 0 2024-09-19T09:02:42.436 INFO:tasks.workunit.client.0.smithi049.stdout:7/38: dread - d1/d7/fe zero size 2024-09-19T09:02:42.437 INFO:tasks.workunit.client.0.smithi049.stdout:7/39: truncate d1/d7/f9 1538959 0 2024-09-19T09:02:42.437 INFO:tasks.workunit.client.0.smithi049.stdout:7/40: write d1/f2 [4314069,44559] 0 2024-09-19T09:02:42.438 INFO:tasks.workunit.client.1.smithi102.stdout:2/621: symlink d7/d12/d37/d93/dce/ld4 0 2024-09-19T09:02:42.438 INFO:tasks.workunit.client.1.smithi102.stdout:5/686: write d5/f15 [259299,71559] 0 2024-09-19T09:02:42.439 INFO:tasks.workunit.client.0.smithi049.stdout:7/41: dread - d1/d7/fe zero size 2024-09-19T09:02:42.440 INFO:tasks.workunit.client.1.smithi102.stdout:9/675: symlink d1/d2/d3/d1d/d4f/d6d/db4/ldf 0 2024-09-19T09:02:42.441 INFO:tasks.workunit.client.1.smithi102.stdout:6/608: fdatasync d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fd0 0 2024-09-19T09:02:42.441 INFO:tasks.workunit.client.1.smithi102.stdout:3/787: creat d2/d1e/ffc x:0 0 0 2024-09-19T09:02:42.442 INFO:tasks.workunit.client.1.smithi102.stdout:5/687: chown d5/d7/d1a/daa 41061 1 2024-09-19T09:02:42.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/42: creat d1/ff x:0 0 0 2024-09-19T09:02:42.443 INFO:tasks.workunit.client.1.smithi102.stdout:9/676: write d1/f5c [1056803,128491] 0 2024-09-19T09:02:42.444 INFO:tasks.workunit.client.1.smithi102.stdout:7/738: link d1/d3/d72/l90 d1/d4/dca/d52/d7f/da5/de6/lea 0 2024-09-19T09:02:42.444 INFO:tasks.workunit.client.1.smithi102.stdout:2/622: write d7/d1a/d2b/f35 [3878356,93164] 0 2024-09-19T09:02:42.446 INFO:tasks.workunit.client.1.smithi102.stdout:2/623: chown d7/d11/dc8 163186768 1 2024-09-19T09:02:42.446 INFO:tasks.workunit.client.1.smithi102.stdout:4/792: link d14/d16/d17/de3/dbd/df3/d37/d58/d89/da0/fd1 d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ffe 0 2024-09-19T09:02:42.447 INFO:tasks.workunit.client.1.smithi102.stdout:0/814: truncate d3/dd/d10/d15/d22/d37/d39/d44/d54/de5/fe1 294570 0 2024-09-19T09:02:42.452 INFO:tasks.workunit.client.1.smithi102.stdout:0/815: fdatasync d3/dd/d10/d15/d3e/f5e 0 2024-09-19T09:02:42.454 INFO:tasks.workunit.client.1.smithi102.stdout:9/677: dwrite d1/d2/d3/d1d/d4f/d6d/fa8 [0,4194304] 0 2024-09-19T09:02:42.454 INFO:tasks.workunit.client.1.smithi102.stdout:7/739: dwrite d1/d3/d20/f2c [4194304,4194304] 0 2024-09-19T09:02:42.456 INFO:tasks.workunit.client.1.smithi102.stdout:7/740: truncate d1/d2d/f37 5152848 0 2024-09-19T09:02:42.456 INFO:tasks.workunit.client.1.smithi102.stdout:3/788: mkdir d2/d19/d47/db/d26/d63/dfd 0 2024-09-19T09:02:42.465 INFO:tasks.workunit.client.1.smithi102.stdout:9/678: unlink d1/d2/d3/d1d/l3b 0 2024-09-19T09:02:42.468 INFO:tasks.workunit.client.1.smithi102.stdout:7/741: truncate d1/d4/dca/f4b 938098 0 2024-09-19T09:02:42.469 INFO:tasks.workunit.client.1.smithi102.stdout:7/742: read d1/d3/d20/f9a [32412,12876] 0 2024-09-19T09:02:42.470 INFO:tasks.workunit.client.1.smithi102.stdout:7/743: read d1/d4/dca/fb9 [306256,108317] 0 2024-09-19T09:02:42.472 INFO:tasks.workunit.client.1.smithi102.stdout:3/789: rename d2/d1e/f38 to d2/d19/d1c/ffe 0 2024-09-19T09:02:42.473 INFO:tasks.workunit.client.1.smithi102.stdout:9/679: link d1/d8/d98/fad d1/d2/d3/d6f/d8d/da2/db6/fe0 0 2024-09-19T09:02:42.473 INFO:tasks.workunit.client.1.smithi102.stdout:3/790: stat d2/d19/d47/db/d26/d63/d6f/f8e 0 2024-09-19T09:02:42.474 INFO:tasks.workunit.client.1.smithi102.stdout:5/688: write d5/d7/d1a/f58 [4112320,13286] 0 2024-09-19T09:02:42.475 INFO:tasks.workunit.client.1.smithi102.stdout:6/609: truncate d1/f43 2004781 0 2024-09-19T09:02:42.478 INFO:tasks.workunit.client.1.smithi102.stdout:4/793: write d14/d16/dd5/ff6 [1553231,109962] 0 2024-09-19T09:02:42.479 INFO:tasks.workunit.client.1.smithi102.stdout:5/689: truncate d5/d7/d1a/d37/fcd 879920 0 2024-09-19T09:02:42.480 INFO:tasks.workunit.client.1.smithi102.stdout:9/680: rename d1/d2/d78/f79 to d1/d2/d3/d1d/d4f/d6d/db4/fe1 0 2024-09-19T09:02:42.483 INFO:tasks.workunit.client.1.smithi102.stdout:5/690: fdatasync d5/d7/f19 0 2024-09-19T09:02:42.487 INFO:tasks.workunit.client.1.smithi102.stdout:9/681: mknod d1/d2/d3/dd0/ce2 0 2024-09-19T09:02:42.489 INFO:tasks.workunit.client.1.smithi102.stdout:4/794: mknod d14/d16/d17/de3/dbd/df3/d37/d58/de2/cff 0 2024-09-19T09:02:42.491 INFO:tasks.workunit.client.1.smithi102.stdout:3/791: dwrite d2/d19/d1c/d2f/d5a/d84/d64/ff2 [0,4194304] 0 2024-09-19T09:02:42.492 INFO:tasks.workunit.client.1.smithi102.stdout:4/795: chown d14/d16/d1d/d48/l57 350 1 2024-09-19T09:02:42.492 INFO:tasks.workunit.client.1.smithi102.stdout:0/816: dwrite d3/dd/d10/d15/d2c/f3b [4194304,4194304] 0 2024-09-19T09:02:42.497 INFO:tasks.workunit.client.1.smithi102.stdout:5/691: dread d5/d7/d1a/d37/fcd [0,4194304] 0 2024-09-19T09:02:42.497 INFO:tasks.workunit.client.1.smithi102.stdout:9/682: dread - d1/d2/d3/d6f/dcb/fd8 zero size 2024-09-19T09:02:42.498 INFO:tasks.workunit.client.1.smithi102.stdout:6/610: dwrite d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fa7 [0,4194304] 0 2024-09-19T09:02:42.500 INFO:tasks.workunit.client.1.smithi102.stdout:3/792: write d2/d1e/ffc [505008,128506] 0 2024-09-19T09:02:42.504 INFO:tasks.workunit.client.1.smithi102.stdout:4/796: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/de2/df4/d100 0 2024-09-19T09:02:42.505 INFO:tasks.workunit.client.1.smithi102.stdout:3/793: mknod d2/d1e/dcb/cff 0 2024-09-19T09:02:42.505 INFO:tasks.workunit.client.1.smithi102.stdout:7/744: dread d1/d4/f21 [4194304,4194304] 0 2024-09-19T09:02:42.506 INFO:tasks.workunit.client.1.smithi102.stdout:0/817: dread d3/dd/d10/d15/d2c/f3b [4194304,4194304] 0 2024-09-19T09:02:42.507 INFO:tasks.workunit.client.1.smithi102.stdout:9/683: mkdir d1/d2/d3/d6f/d8d/da2/db6/de3 0 2024-09-19T09:02:42.508 INFO:tasks.workunit.client.1.smithi102.stdout:5/692: mknod d5/d60/db6/dd2/cd6 0 2024-09-19T09:02:42.508 INFO:tasks.workunit.client.1.smithi102.stdout:7/745: read d1/d2f/fe1 [316343,82044] 0 2024-09-19T09:02:42.508 INFO:tasks.workunit.client.1.smithi102.stdout:3/794: readlink d2/d19/d1c/d2f/d5a/d84/d53/l6b 0 2024-09-19T09:02:42.509 INFO:tasks.workunit.client.1.smithi102.stdout:6/611: mknod d1/d26/d2e/d70/dca/cd3 0 2024-09-19T09:02:42.510 INFO:tasks.workunit.client.1.smithi102.stdout:4/797: readlink d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/l29 0 2024-09-19T09:02:42.511 INFO:tasks.workunit.client.1.smithi102.stdout:0/818: mknod d3/dd/d10/d15/d22/d37/d3d/c10a 0 2024-09-19T09:02:42.512 INFO:tasks.workunit.client.1.smithi102.stdout:7/746: write d1/d3/d20/f9d [3782694,18421] 0 2024-09-19T09:02:42.513 INFO:tasks.workunit.client.1.smithi102.stdout:6/612: write d1/d26/d2e/fc4 [237290,91645] 0 2024-09-19T09:02:42.513 INFO:tasks.workunit.client.1.smithi102.stdout:5/693: stat d5/d7/d1a/d37/d34/d73/fa3 0 2024-09-19T09:02:42.514 INFO:tasks.workunit.client.1.smithi102.stdout:4/798: dread - d14/d34/d5a/d5c/d81/d75/fb2 zero size 2024-09-19T09:02:42.516 INFO:tasks.workunit.client.1.smithi102.stdout:4/799: dread - d14/d16/fce zero size 2024-09-19T09:02:42.516 INFO:tasks.workunit.client.1.smithi102.stdout:6/613: write d1/d26/d2e/fb1 [410424,122652] 0 2024-09-19T09:02:42.517 INFO:tasks.workunit.client.1.smithi102.stdout:9/684: rename d1/d2/d3/d6f/d8d/fbe to d1/d2/d3/d6f/fe4 0 2024-09-19T09:02:42.517 INFO:tasks.workunit.client.1.smithi102.stdout:7/747: creat d1/d2d/feb x:0 0 0 2024-09-19T09:02:42.518 INFO:tasks.workunit.client.1.smithi102.stdout:6/614: stat d1/d26/d4b/f51 0 2024-09-19T09:02:42.519 INFO:tasks.workunit.client.1.smithi102.stdout:7/748: readlink d1/d3/d20/d6c/l7a 0 2024-09-19T09:02:42.521 INFO:tasks.workunit.client.1.smithi102.stdout:5/694: rename d5/d7/d1a/d37/f2b to d5/d7/d1a/daa/fd7 0 2024-09-19T09:02:42.521 INFO:tasks.workunit.client.1.smithi102.stdout:6/615: write d1/d18/d37/fa0 [447152,9849] 0 2024-09-19T09:02:42.522 INFO:tasks.workunit.client.1.smithi102.stdout:4/800: mkdir d14/d16/d17/de3/dbd/df3/d37/d101 0 2024-09-19T09:02:42.523 INFO:tasks.workunit.client.1.smithi102.stdout:9/685: mknod d1/d8/ce5 0 2024-09-19T09:02:42.523 INFO:tasks.workunit.client.1.smithi102.stdout:5/695: read d5/d7/d1a/daa/fd7 [5641258,62078] 0 2024-09-19T09:02:42.524 INFO:tasks.workunit.client.1.smithi102.stdout:4/801: read d14/d34/d5a/d5c/fd4 [602568,39691] 0 2024-09-19T09:02:42.524 INFO:tasks.workunit.client.1.smithi102.stdout:5/696: chown d5/d60/db6 13 1 2024-09-19T09:02:42.524 INFO:tasks.workunit.client.1.smithi102.stdout:9/686: readlink d1/d2/d7b/l9c 0 2024-09-19T09:02:42.525 INFO:tasks.workunit.client.1.smithi102.stdout:7/749: fsync d1/d3/d20/f5a 0 2024-09-19T09:02:42.525 INFO:tasks.workunit.client.1.smithi102.stdout:5/697: dread - d5/d7/d1a/f88 zero size 2024-09-19T09:02:42.525 INFO:tasks.workunit.client.1.smithi102.stdout:4/802: write d14/d16/d17/f1c [3816088,8709] 0 2024-09-19T09:02:42.527 INFO:tasks.workunit.client.1.smithi102.stdout:6/616: mknod d1/d18/db/d65/d8e/cd4 0 2024-09-19T09:02:42.527 INFO:tasks.workunit.client.1.smithi102.stdout:3/795: write d2/d1e/f46 [790257,66379] 0 2024-09-19T09:02:42.530 INFO:tasks.workunit.client.1.smithi102.stdout:9/687: rmdir d1/d2/d3/d1d/d4f/d6d/d81/dd3 39 2024-09-19T09:02:42.531 INFO:tasks.workunit.client.1.smithi102.stdout:0/819: dread d3/fea [0,4194304] 0 2024-09-19T09:02:42.533 INFO:tasks.workunit.client.1.smithi102.stdout:0/820: fsync d3/dd/d10/d15/d22/d37/d39/d44/d54/de5/fe1 0 2024-09-19T09:02:42.535 INFO:tasks.workunit.client.1.smithi102.stdout:6/617: rename d1/f2c to d1/d18/d37/fd5 0 2024-09-19T09:02:42.536 INFO:tasks.workunit.client.1.smithi102.stdout:4/803: rmdir d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d7c/d80 39 2024-09-19T09:02:42.536 INFO:tasks.workunit.client.1.smithi102.stdout:6/618: chown d1/d18/f7e 2 1 2024-09-19T09:02:42.538 INFO:tasks.workunit.client.1.smithi102.stdout:5/698: dread d5/d7/d1a/d37/d39/d4c/f5d [0,4194304] 0 2024-09-19T09:02:42.539 INFO:tasks.workunit.client.1.smithi102.stdout:0/821: mkdir d3/dd/d10/d15/d22/d2a/d10b 0 2024-09-19T09:02:42.540 INFO:tasks.workunit.client.1.smithi102.stdout:3/796: fdatasync d2/d19/d1c/d2f/f55 0 2024-09-19T09:02:42.544 INFO:tasks.workunit.client.1.smithi102.stdout:6/619: rename d1/d26/d2e/d45/d47/d4d/d35/f82 to d1/d26/d2e/d45/d47/fd6 0 2024-09-19T09:02:42.544 INFO:tasks.workunit.client.1.smithi102.stdout:7/750: dwrite d1/d3/d20/d6c/fb0 [0,4194304] 0 2024-09-19T09:02:42.547 INFO:tasks.workunit.client.1.smithi102.stdout:6/620: write d1/d26/d2e/d45/daf/d8d/faa [960245,50514] 0 2024-09-19T09:02:42.548 INFO:tasks.workunit.client.0.smithi049.stdout:0/56: sync 2024-09-19T09:02:42.548 INFO:tasks.workunit.client.0.smithi049.stdout:8/47: sync 2024-09-19T09:02:42.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/26: sync 2024-09-19T09:02:42.548 INFO:tasks.workunit.client.0.smithi049.stdout:9/32: sync 2024-09-19T09:02:42.548 INFO:tasks.workunit.client.0.smithi049.stdout:5/34: sync 2024-09-19T09:02:42.548 INFO:tasks.workunit.client.0.smithi049.stdout:4/3: sync 2024-09-19T09:02:42.548 INFO:tasks.workunit.client.0.smithi049.stdout:3/12: sync 2024-09-19T09:02:42.549 INFO:tasks.workunit.client.0.smithi049.stdout:3/13: write - no filename 2024-09-19T09:02:42.550 INFO:tasks.workunit.client.1.smithi102.stdout:7/751: dread d1/d4/f6 [0,4194304] 0 2024-09-19T09:02:42.553 INFO:tasks.workunit.client.1.smithi102.stdout:0/822: rename d3/dd/d10/d15/d22 to d3/dd/d1a/d32/d7f/d10c 0 2024-09-19T09:02:42.554 INFO:tasks.workunit.client.1.smithi102.stdout:9/688: write d1/d2/d7b/f6b [1109274,27376] 0 2024-09-19T09:02:42.556 INFO:tasks.workunit.client.1.smithi102.stdout:3/797: truncate d2/d19/d47/db/d26/f7f 1256945 0 2024-09-19T09:02:42.556 INFO:tasks.workunit.client.0.smithi049.stdout:7/43: rename d1/d7/fe to d1/d8/f10 0 2024-09-19T09:02:42.557 INFO:tasks.workunit.client.1.smithi102.stdout:9/689: fdatasync d1/f2f 0 2024-09-19T09:02:42.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/57: dread - d5/fd zero size 2024-09-19T09:02:42.558 INFO:tasks.workunit.client.1.smithi102.stdout:3/798: write d2/f6c [2548182,69962] 0 2024-09-19T09:02:42.558 INFO:tasks.workunit.client.0.smithi049.stdout:9/33: chown d3/fa 7 1 2024-09-19T09:02:42.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/58: readlink d5/l8 0 2024-09-19T09:02:42.559 INFO:tasks.workunit.client.1.smithi102.stdout:4/804: rename d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/c9c to d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/c102 0 2024-09-19T09:02:42.559 INFO:tasks.workunit.client.1.smithi102.stdout:6/621: dread d1/d26/f85 [0,4194304] 0 2024-09-19T09:02:42.560 INFO:tasks.workunit.client.0.smithi049.stdout:5/35: mkdir d3/d5/de 0 2024-09-19T09:02:42.561 INFO:tasks.workunit.client.1.smithi102.stdout:7/752: dwrite d1/d3/d34/d74/fa7 [0,4194304] 0 2024-09-19T09:02:42.562 INFO:tasks.workunit.client.0.smithi049.stdout:7/44: symlink d1/l11 0 2024-09-19T09:02:42.562 INFO:tasks.workunit.client.0.smithi049.stdout:0/59: truncate d5/fd 250611 0 2024-09-19T09:02:42.563 INFO:tasks.workunit.client.0.smithi049.stdout:9/34: chown d3/lb 38702024 1 2024-09-19T09:02:42.563 INFO:tasks.workunit.client.1.smithi102.stdout:5/699: dwrite d5/d7/d1a/d37/d39/d4c/f9b [0,4194304] 0 2024-09-19T09:02:42.565 INFO:tasks.workunit.client.1.smithi102.stdout:4/805: write d14/d16/d17/f1c [1693941,3671] 0 2024-09-19T09:02:42.566 INFO:tasks.workunit.client.1.smithi102.stdout:5/700: read d5/d8d/fcb [427723,74638] 0 2024-09-19T09:02:42.569 INFO:tasks.workunit.client.0.smithi049.stdout:3/14: unlink d1/l2 0 2024-09-19T09:02:42.570 INFO:tasks.workunit.client.0.smithi049.stdout:8/48: dwrite d1/f7 [4194304,4194304] 0 2024-09-19T09:02:42.572 INFO:tasks.workunit.client.0.smithi049.stdout:8/49: readlink d1/lc 0 2024-09-19T09:02:42.574 INFO:tasks.workunit.client.0.smithi049.stdout:7/45: rmdir d1/d8 39 2024-09-19T09:02:42.574 INFO:tasks.workunit.client.1.smithi102.stdout:4/806: dwrite d14/d16/d1d/f53 [0,4194304] 0 2024-09-19T09:02:42.577 INFO:tasks.workunit.client.0.smithi049.stdout:8/50: chown d1/fb 19002185 1 2024-09-19T09:02:42.577 INFO:tasks.workunit.client.0.smithi049.stdout:0/60: dwrite d5/fc [0,4194304] 0 2024-09-19T09:02:42.586 INFO:tasks.workunit.client.0.smithi049.stdout:9/35: write d3/f8 [794009,17356] 0 2024-09-19T09:02:42.587 INFO:tasks.workunit.client.0.smithi049.stdout:1/27: mkdir d5/d6/d8 0 2024-09-19T09:02:42.589 INFO:tasks.workunit.client.1.smithi102.stdout:0/823: rename d3/f14 to d3/dd/d10/d15/f10d 0 2024-09-19T09:02:42.592 INFO:tasks.workunit.client.1.smithi102.stdout:4/807: mknod d14/d16/dd5/c103 0 2024-09-19T09:02:42.593 INFO:tasks.workunit.client.0.smithi049.stdout:7/46: chown d1/d8/fb 9817 1 2024-09-19T09:02:42.593 INFO:tasks.workunit.client.1.smithi102.stdout:4/808: chown d14/f6d 30787 1 2024-09-19T09:02:42.595 INFO:tasks.workunit.client.1.smithi102.stdout:6/622: fdatasync d1/d26/d2e/d45/daf/d8d/f92 0 2024-09-19T09:02:42.595 INFO:tasks.workunit.client.1.smithi102.stdout:3/799: dread d2/f34 [0,4194304] 0 2024-09-19T09:02:42.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/51: unlink d1/c4 0 2024-09-19T09:02:42.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/52: fsync d1/f9 0 2024-09-19T09:02:42.597 INFO:tasks.workunit.client.1.smithi102.stdout:3/800: readlink d2/d19/d1c/l75 0 2024-09-19T09:02:42.600 INFO:tasks.workunit.client.0.smithi049.stdout:4/4: truncate f0 7820126 0 2024-09-19T09:02:42.602 INFO:tasks.workunit.client.1.smithi102.stdout:7/753: write d1/d3/d34/d4f/f50 [4205099,64771] 0 2024-09-19T09:02:42.603 INFO:tasks.workunit.client.1.smithi102.stdout:5/701: rename d5/d7/d1a/d37/l63 to d5/d7/d1a/d37/d34/d73/ld8 0 2024-09-19T09:02:42.605 INFO:tasks.workunit.client.1.smithi102.stdout:6/623: dwrite d1/d18/d37/fa0 [0,4194304] 0 2024-09-19T09:02:42.605 INFO:tasks.workunit.client.0.smithi049.stdout:9/36: symlink d3/ld 0 2024-09-19T09:02:42.607 INFO:tasks.workunit.client.0.smithi049.stdout:0/61: write d5/fc [4856462,109835] 0 2024-09-19T09:02:42.608 INFO:tasks.workunit.client.1.smithi102.stdout:3/801: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/f80 [0,4194304] 0 2024-09-19T09:02:42.608 INFO:tasks.workunit.client.0.smithi049.stdout:0/62: fdatasync d5/f9 0 2024-09-19T09:02:42.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/28: creat d5/d6/f9 x:0 0 0 2024-09-19T09:02:42.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/29: chown d5/d6/f9 1741924484 1 2024-09-19T09:02:42.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/63: truncate d5/fd 709400 0 2024-09-19T09:02:42.611 INFO:tasks.workunit.client.1.smithi102.stdout:4/809: creat d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/f104 x:0 0 0 2024-09-19T09:02:42.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/37: dread d3/f8 [0,4194304] 0 2024-09-19T09:02:42.613 INFO:tasks.workunit.client.1.smithi102.stdout:7/754: dread d1/d3/f8a [0,4194304] 0 2024-09-19T09:02:42.614 INFO:tasks.workunit.client.1.smithi102.stdout:0/824: dread d3/dd/d1a/d32/d7f/d10c/f2f [0,4194304] 0 2024-09-19T09:02:42.615 INFO:tasks.workunit.client.0.smithi049.stdout:8/53: unlink d1/ce 0 2024-09-19T09:02:42.615 INFO:tasks.workunit.client.1.smithi102.stdout:1/669: sync 2024-09-19T09:02:42.618 INFO:tasks.workunit.client.1.smithi102.stdout:9/690: getdents d1/d2/d7b 0 2024-09-19T09:02:42.618 INFO:tasks.workunit.client.1.smithi102.stdout:0/825: dread - d3/dd/d72/fa7 zero size 2024-09-19T09:02:42.618 INFO:tasks.workunit.client.0.smithi049.stdout:8/54: write d1/f7 [6594192,64452] 0 2024-09-19T09:02:42.619 INFO:tasks.workunit.client.0.smithi049.stdout:5/36: truncate d3/f6 25398 0 2024-09-19T09:02:42.621 INFO:tasks.workunit.client.0.smithi049.stdout:0/64: dwrite d5/f9 [0,4194304] 0 2024-09-19T09:02:42.621 INFO:tasks.workunit.client.1.smithi102.stdout:1/670: dread dd/f11 [0,4194304] 0 2024-09-19T09:02:42.622 INFO:tasks.workunit.client.0.smithi049.stdout:9/38: dread d3/f7 [0,4194304] 0 2024-09-19T09:02:42.623 INFO:tasks.workunit.client.1.smithi102.stdout:4/810: dwrite d14/d16/d17/f66 [0,4194304] 0 2024-09-19T09:02:42.623 INFO:tasks.workunit.client.1.smithi102.stdout:5/702: mkdir d5/d23/d3b/dd9 0 2024-09-19T09:02:42.625 INFO:tasks.workunit.client.1.smithi102.stdout:3/802: mkdir d2/d19/d1c/d1f/d100 0 2024-09-19T09:02:42.625 INFO:tasks.workunit.client.0.smithi049.stdout:0/65: read d5/fa [1477096,93904] 0 2024-09-19T09:02:42.626 INFO:tasks.workunit.client.0.smithi049.stdout:1/30: rmdir d5 39 2024-09-19T09:02:42.627 INFO:tasks.workunit.client.0.smithi049.stdout:0/66: stat d5/fd 0 2024-09-19T09:02:42.628 INFO:tasks.workunit.client.1.smithi102.stdout:4/811: dread - d14/d16/d17/de3/dbd/df3/d37/d58/fbb zero size 2024-09-19T09:02:42.629 INFO:tasks.workunit.client.1.smithi102.stdout:4/812: chown d14/d16/l2d 119 1 2024-09-19T09:02:42.630 INFO:tasks.workunit.client.0.smithi049.stdout:3/15: rmdir d1 0 2024-09-19T09:02:42.631 INFO:tasks.workunit.client.1.smithi102.stdout:0/826: dwrite d3/dd/d1a/d32/d7f/d10c/d4a/d80/fc6 [0,4194304] 0 2024-09-19T09:02:42.632 INFO:tasks.workunit.client.1.smithi102.stdout:4/813: write d14/d16/d1d/f50 [2154331,127647] 0 2024-09-19T09:02:42.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/37: dwrite d3/f9 [0,4194304] 0 2024-09-19T09:02:42.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/38: stat d3/dc 0 2024-09-19T09:02:42.635 INFO:tasks.workunit.client.1.smithi102.stdout:0/827: chown d3/dd/d1a/d32/d7f/d10c/d4a/fd0 1885 1 2024-09-19T09:02:42.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/39: truncate d3/f8 843214 0 2024-09-19T09:02:42.636 INFO:tasks.workunit.client.1.smithi102.stdout:9/691: rename d1/c2a to d1/d2/d78/ce6 0 2024-09-19T09:02:42.638 INFO:tasks.workunit.client.0.smithi049.stdout:5/40: dread - d3/d5/fb zero size 2024-09-19T09:02:42.638 INFO:tasks.workunit.client.1.smithi102.stdout:9/692: chown d1/d2/d78/fca 3701 1 2024-09-19T09:02:42.641 INFO:tasks.workunit.client.1.smithi102.stdout:1/671: mkdir dd/d13/d2d/ddc 0 2024-09-19T09:02:42.645 INFO:tasks.workunit.client.1.smithi102.stdout:5/703: creat d5/d23/d3b/fda x:0 0 0 2024-09-19T09:02:42.646 INFO:tasks.workunit.client.1.smithi102.stdout:5/704: readlink d5/d7/d1a/d37/d39/d4c/lae 0 2024-09-19T09:02:42.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/39: symlink d3/le 0 2024-09-19T09:02:42.651 INFO:tasks.workunit.client.1.smithi102.stdout:7/755: symlink d1/d3/lec 0 2024-09-19T09:02:42.652 INFO:tasks.workunit.client.1.smithi102.stdout:3/803: dwrite d2/d1e/fca [0,4194304] 0 2024-09-19T09:02:42.656 INFO:tasks.workunit.client.1.smithi102.stdout:3/804: write d2/d19/d1c/d2f/d5a/d84/d4f/d72/ff9 [414205,105295] 0 2024-09-19T09:02:42.656 INFO:tasks.workunit.client.0.smithi049.stdout:0/67: creat d5/ff x:0 0 0 2024-09-19T09:02:42.658 INFO:tasks.workunit.client.1.smithi102.stdout:1/672: symlink dd/d14/d18/ldd 0 2024-09-19T09:02:42.658 INFO:tasks.workunit.client.1.smithi102.stdout:3/805: chown d2/l65 0 1 2024-09-19T09:02:42.661 INFO:tasks.workunit.client.1.smithi102.stdout:1/673: write dd/d14/d35/d49/d62/d6c/f8d [502948,61381] 0 2024-09-19T09:02:42.661 INFO:tasks.workunit.client.1.smithi102.stdout:5/705: fdatasync d5/d7/f35 0 2024-09-19T09:02:42.662 INFO:tasks.workunit.client.1.smithi102.stdout:5/706: chown d5/d60/c83 4833597 1 2024-09-19T09:02:42.665 INFO:tasks.workunit.client.1.smithi102.stdout:5/707: write d5/d7/d1a/d37/d34/d73/fa3 [267622,96460] 0 2024-09-19T09:02:42.669 INFO:tasks.workunit.client.1.smithi102.stdout:4/814: write d14/d16/d17/de3/dbd/df3/d37/d58/d89/f67 [945037,110754] 0 2024-09-19T09:02:42.670 INFO:tasks.workunit.client.0.smithi049.stdout:7/47: getdents d1/d8 0 2024-09-19T09:02:42.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/40: mknod d3/cf 0 2024-09-19T09:02:42.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/55: truncate d1/f7 7348003 0 2024-09-19T09:02:42.675 INFO:tasks.workunit.client.1.smithi102.stdout:7/756: dread d1/d3/d20/f2c [0,4194304] 0 2024-09-19T09:02:42.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/31: unlink f0 0 2024-09-19T09:02:42.677 INFO:tasks.workunit.client.0.smithi049.stdout:1/32: fdatasync f4 0 2024-09-19T09:02:42.678 INFO:tasks.workunit.client.0.smithi049.stdout:4/5: chown f0 22 1 2024-09-19T09:02:42.679 INFO:tasks.workunit.client.1.smithi102.stdout:1/674: dread dd/d14/f2b [0,4194304] 0 2024-09-19T09:02:42.679 INFO:tasks.workunit.client.0.smithi049.stdout:0/68: rmdir d5 39 2024-09-19T09:02:42.680 INFO:tasks.workunit.client.1.smithi102.stdout:6/624: link d1/d26/d2e/d45/d47/d4d/d35/d41/da4/ca9 d1/d26/d2e/d45/cd7 0 2024-09-19T09:02:42.682 INFO:tasks.workunit.client.1.smithi102.stdout:5/708: creat d5/d7/d1a/d37/d39/fdb x:0 0 0 2024-09-19T09:02:42.687 INFO:tasks.workunit.client.0.smithi049.stdout:9/41: rename d3/fa to d3/f10 0 2024-09-19T09:02:42.693 INFO:tasks.workunit.client.1.smithi102.stdout:3/806: truncate d2/d19/d1c/d2f/d5a/d84/f9a 2429057 0 2024-09-19T09:02:42.695 INFO:tasks.workunit.client.1.smithi102.stdout:1/675: rmdir dd/d13/d2d 39 2024-09-19T09:02:42.696 INFO:tasks.workunit.client.0.smithi049.stdout:3/16: link c0 c3 0 2024-09-19T09:02:42.696 INFO:tasks.workunit.client.1.smithi102.stdout:1/676: dread - dd/d14/d35/d49/dcb/fd0 zero size 2024-09-19T09:02:42.697 INFO:tasks.workunit.client.1.smithi102.stdout:1/677: write dd/d5f/f7c [3191868,105861] 0 2024-09-19T09:02:42.698 INFO:tasks.workunit.client.1.smithi102.stdout:6/625: rename d1/d18/db/d65/d8e/cd4 to d1/d3a/cd8 0 2024-09-19T09:02:42.698 INFO:tasks.workunit.client.1.smithi102.stdout:1/678: chown dd/d14/d18 87854526 1 2024-09-19T09:02:42.699 INFO:tasks.workunit.client.1.smithi102.stdout:1/679: chown dd/d14/d35/d49/dcb/f6e 58715 1 2024-09-19T09:02:42.700 INFO:tasks.workunit.client.0.smithi049.stdout:7/48: fdatasync d1/f3 0 2024-09-19T09:02:42.701 INFO:tasks.workunit.client.0.smithi049.stdout:9/42: fsync d3/f10 0 2024-09-19T09:02:42.702 INFO:tasks.workunit.client.1.smithi102.stdout:1/680: dread dd/d5f/f96 [0,4194304] 0 2024-09-19T09:02:42.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/6: dwrite f0 [0,4194304] 0 2024-09-19T09:02:42.704 INFO:tasks.workunit.client.1.smithi102.stdout:1/681: write dd/d7a/fd4 [88719,38344] 0 2024-09-19T09:02:42.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/33: creat d5/d6/fa x:0 0 0 2024-09-19T09:02:42.707 INFO:tasks.workunit.client.0.smithi049.stdout:0/69: mkdir d5/d10 0 2024-09-19T09:02:42.708 INFO:tasks.workunit.client.1.smithi102.stdout:3/807: symlink d2/d19/l101 0 2024-09-19T09:02:42.709 INFO:tasks.workunit.client.1.smithi102.stdout:3/808: dread - d2/d19/d47/db/d26/d63/d6f/fcf zero size 2024-09-19T09:02:42.709 INFO:tasks.workunit.client.1.smithi102.stdout:3/809: stat d2/d19 0 2024-09-19T09:02:42.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/17: symlink l4 0 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/18: dread - no filename 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/19: dread - no filename 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/20: dread - no filename 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/21: write - no filename 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/22: truncate - no filename 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/23: dread - no filename 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/24: dwrite - no filename 2024-09-19T09:02:42.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/70: write d5/ff [216080,72189] 0 2024-09-19T09:02:42.711 INFO:tasks.workunit.client.1.smithi102.stdout:4/815: link d14/d34/d5a/d5c/d81/d75/f77 d14/d34/d5a/f105 0 2024-09-19T09:02:42.711 INFO:tasks.workunit.client.0.smithi049.stdout:4/7: dread f0 [0,4194304] 0 2024-09-19T09:02:42.711 INFO:tasks.workunit.client.0.smithi049.stdout:0/71: chown d5/ff 17009 1 2024-09-19T09:02:42.712 INFO:tasks.workunit.client.0.smithi049.stdout:8/56: fsync d1/fb 0 2024-09-19T09:02:42.714 INFO:tasks.workunit.client.1.smithi102.stdout:1/682: rename dd/d14/d35/d49/d62/fa9 to dd/d14/d35/d49/d62/d6c/d99/db8/fde 0 2024-09-19T09:02:42.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/34: creat d5/fb x:0 0 0 2024-09-19T09:02:42.720 INFO:tasks.workunit.client.1.smithi102.stdout:3/810: dwrite d2/d19/d47/db/d26/d63/fa0 [0,4194304] 0 2024-09-19T09:02:42.720 INFO:tasks.workunit.client.0.smithi049.stdout:4/8: creat f1 x:0 0 0 2024-09-19T09:02:42.720 INFO:tasks.workunit.client.1.smithi102.stdout:4/816: dread d14/d16/d1d/f20 [0,4194304] 0 2024-09-19T09:02:42.721 INFO:tasks.workunit.client.0.smithi049.stdout:1/35: chown f4 0 1 2024-09-19T09:02:42.724 INFO:tasks.workunit.client.0.smithi049.stdout:7/49: dwrite d1/d8/f10 [0,4194304] 0 2024-09-19T09:02:42.724 INFO:tasks.workunit.client.0.smithi049.stdout:8/57: creat d1/ff x:0 0 0 2024-09-19T09:02:42.724 INFO:tasks.workunit.client.1.smithi102.stdout:1/683: mkdir dd/d14/d35/ddf 0 2024-09-19T09:02:42.725 INFO:tasks.workunit.client.1.smithi102.stdout:1/684: fdatasync dd/d14/d35/d49/d62/d6c/d99/faa 0 2024-09-19T09:02:42.726 INFO:tasks.workunit.client.0.smithi049.stdout:0/72: dwrite d5/f9 [4194304,4194304] 0 2024-09-19T09:02:42.726 INFO:tasks.workunit.client.0.smithi049.stdout:8/58: write d1/f9 [911233,20021] 0 2024-09-19T09:02:42.727 INFO:tasks.workunit.client.1.smithi102.stdout:3/811: mknod d2/d19/d47/db/d26/d63/d6f/c102 0 2024-09-19T09:02:42.732 INFO:tasks.workunit.client.1.smithi102.stdout:4/817: rename d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d7c to d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106 0 2024-09-19T09:02:42.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/9: creat f2 x:0 0 0 2024-09-19T09:02:42.735 INFO:tasks.workunit.client.1.smithi102.stdout:3/812: rmdir d2/d19/d1c/d2f/d5a/d84/d64 39 2024-09-19T09:02:42.736 INFO:tasks.workunit.client.0.smithi049.stdout:4/10: fsync f1 0 2024-09-19T09:02:42.737 INFO:tasks.workunit.client.1.smithi102.stdout:8/633: sync 2024-09-19T09:02:42.737 INFO:tasks.workunit.client.1.smithi102.stdout:2/624: sync 2024-09-19T09:02:42.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/73: creat d5/f11 x:0 0 0 2024-09-19T09:02:42.739 INFO:tasks.workunit.client.0.smithi049.stdout:0/74: dread - d5/f11 zero size 2024-09-19T09:02:42.739 INFO:tasks.workunit.client.0.smithi049.stdout:0/75: chown d5 144667 1 2024-09-19T09:02:42.741 INFO:tasks.workunit.client.0.smithi049.stdout:8/59: symlink d1/l10 0 2024-09-19T09:02:42.744 INFO:tasks.workunit.client.1.smithi102.stdout:8/634: creat d0/d10/d21/d39/d87/fc5 x:0 0 0 2024-09-19T09:02:42.745 INFO:tasks.workunit.client.1.smithi102.stdout:3/813: dwrite d2/d19/d47/db/d26/d63/d6f/ff7 [0,4194304] 0 2024-09-19T09:02:42.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/11: creat f3 x:0 0 0 2024-09-19T09:02:42.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/12: dread - f1 zero size 2024-09-19T09:02:42.746 INFO:tasks.workunit.client.0.smithi049.stdout:4/13: truncate f2 606903 0 2024-09-19T09:02:42.746 INFO:tasks.workunit.client.1.smithi102.stdout:3/814: write d2/d19/f73 [1127280,102161] 0 2024-09-19T09:02:42.747 INFO:tasks.workunit.client.1.smithi102.stdout:8/635: dread d0/d10/d21/d39/d50/d63/d83/f8a [0,4194304] 0 2024-09-19T09:02:42.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/60: mkdir d1/d11 0 2024-09-19T09:02:42.751 INFO:tasks.workunit.client.1.smithi102.stdout:4/818: dread d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/fea [0,4194304] 0 2024-09-19T09:02:42.752 INFO:tasks.workunit.client.1.smithi102.stdout:1/685: getdents dd/d14/d35/d49/d7d/d7f 0 2024-09-19T09:02:42.757 INFO:tasks.workunit.client.0.smithi049.stdout:0/76: creat d5/d10/f12 x:0 0 0 2024-09-19T09:02:42.761 INFO:tasks.workunit.client.0.smithi049.stdout:1/36: getdents d5/d6 0 2024-09-19T09:02:42.761 INFO:tasks.workunit.client.0.smithi049.stdout:4/14: dwrite f0 [0,4194304] 0 2024-09-19T09:02:42.762 INFO:tasks.workunit.client.0.smithi049.stdout:7/50: getdents d1 0 2024-09-19T09:02:42.762 INFO:tasks.workunit.client.0.smithi049.stdout:1/37: dread - d5/fb zero size 2024-09-19T09:02:42.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/15: dread - f3 zero size 2024-09-19T09:02:42.764 INFO:tasks.workunit.client.0.smithi049.stdout:0/77: mkdir d5/d10/d13 0 2024-09-19T09:02:42.764 INFO:tasks.workunit.client.0.smithi049.stdout:0/78: chown d5 14725 1 2024-09-19T09:02:42.766 INFO:tasks.workunit.client.0.smithi049.stdout:8/61: creat d1/d11/f12 x:0 0 0 2024-09-19T09:02:42.768 INFO:tasks.workunit.client.0.smithi049.stdout:8/62: fsync d1/fd 0 2024-09-19T09:02:42.769 INFO:tasks.workunit.client.0.smithi049.stdout:1/38: mkdir d5/d6/dc 0 2024-09-19T09:02:42.771 INFO:tasks.workunit.client.0.smithi049.stdout:4/16: dread f0 [0,4194304] 0 2024-09-19T09:02:42.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/17: dread - f1 zero size 2024-09-19T09:02:42.774 INFO:tasks.workunit.client.0.smithi049.stdout:1/39: mkdir d5/dd 0 2024-09-19T09:02:42.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/51: dwrite d1/d8/f10 [0,4194304] 0 2024-09-19T09:02:42.775 INFO:tasks.workunit.client.0.smithi049.stdout:1/40: truncate f3 860761 0 2024-09-19T09:02:42.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/18: mkdir d4 0 2024-09-19T09:02:42.778 INFO:tasks.workunit.client.0.smithi049.stdout:8/63: dread d1/f7 [0,4194304] 0 2024-09-19T09:02:42.778 INFO:tasks.workunit.client.0.smithi049.stdout:7/52: creat d1/d8/f12 x:0 0 0 2024-09-19T09:02:42.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/64: read - d1/d11/f12 zero size 2024-09-19T09:02:42.780 INFO:tasks.workunit.client.0.smithi049.stdout:7/53: chown d1/d8/ld 2436 1 2024-09-19T09:02:42.784 INFO:tasks.workunit.client.0.smithi049.stdout:1/41: write f2 [2025360,108589] 0 2024-09-19T09:02:42.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/65: truncate d1/f9 1399228 0 2024-09-19T09:02:42.787 INFO:tasks.workunit.client.0.smithi049.stdout:7/54: dread d1/d8/fb [0,4194304] 0 2024-09-19T09:02:42.787 INFO:tasks.workunit.client.0.smithi049.stdout:1/42: chown d5/d6/f7 10982533 1 2024-09-19T09:02:42.788 INFO:tasks.workunit.client.1.smithi102.stdout:8/636: write d0/db/f3b [1645929,28821] 0 2024-09-19T09:02:42.789 INFO:tasks.workunit.client.1.smithi102.stdout:2/625: link d7/d11/c32 d7/d50/d64/d7f/d83/cd5 0 2024-09-19T09:02:42.791 INFO:tasks.workunit.client.0.smithi049.stdout:8/66: unlink d1/c8 0 2024-09-19T09:02:42.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/19: dwrite f1 [0,4194304] 0 2024-09-19T09:02:42.792 INFO:tasks.workunit.client.0.smithi049.stdout:1/43: chown d5/fb 8 1 2024-09-19T09:02:42.793 INFO:tasks.workunit.client.0.smithi049.stdout:7/55: write d1/d8/f12 [281466,99734] 0 2024-09-19T09:02:42.793 INFO:tasks.workunit.client.1.smithi102.stdout:4/819: write d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/f6b [4276249,126247] 0 2024-09-19T09:02:42.793 INFO:tasks.workunit.client.1.smithi102.stdout:1/686: symlink dd/d14/le0 0 2024-09-19T09:02:42.795 INFO:tasks.workunit.client.0.smithi049.stdout:0/79: dwrite d5/fa [0,4194304] 0 2024-09-19T09:02:42.796 INFO:tasks.workunit.client.1.smithi102.stdout:8/637: creat d0/d64/fc6 x:0 0 0 2024-09-19T09:02:42.796 INFO:tasks.workunit.client.1.smithi102.stdout:3/815: dwrite d2/d19/d1c/d2f/d5a/d84/d64/ff2 [0,4194304] 0 2024-09-19T09:02:42.797 INFO:tasks.workunit.client.0.smithi049.stdout:1/44: dread f3 [0,4194304] 0 2024-09-19T09:02:42.799 INFO:tasks.workunit.client.0.smithi049.stdout:0/80: read d5/f9 [3304122,69971] 0 2024-09-19T09:02:42.801 INFO:tasks.workunit.client.0.smithi049.stdout:0/81: dread - d5/d10/f12 zero size 2024-09-19T09:02:42.802 INFO:tasks.workunit.client.1.smithi102.stdout:2/626: dwrite d7/d1a/d56/f97 [0,4194304] 0 2024-09-19T09:02:42.803 INFO:tasks.workunit.client.1.smithi102.stdout:2/627: stat d7/d11/f8e 0 2024-09-19T09:02:42.806 INFO:tasks.workunit.client.0.smithi049.stdout:8/67: symlink d1/l13 0 2024-09-19T09:02:42.807 INFO:tasks.workunit.client.1.smithi102.stdout:1/687: rmdir dd/d14/d35/d49/d62/d6c/d99/db8 39 2024-09-19T09:02:42.808 INFO:tasks.workunit.client.1.smithi102.stdout:1/688: dread - dd/d14/d35/d49/dcb/fcc zero size 2024-09-19T09:02:42.809 INFO:tasks.workunit.client.0.smithi049.stdout:7/56: mkdir d1/d7/d13 0 2024-09-19T09:02:42.810 INFO:tasks.workunit.client.1.smithi102.stdout:8/638: dread d0/d10/d21/d39/f59 [0,4194304] 0 2024-09-19T09:02:42.811 INFO:tasks.workunit.client.0.smithi049.stdout:4/20: dwrite f0 [0,4194304] 0 2024-09-19T09:02:42.814 INFO:tasks.workunit.client.1.smithi102.stdout:0/828: sync 2024-09-19T09:02:42.814 INFO:tasks.workunit.client.1.smithi102.stdout:2/628: mkdir d7/d50/d64/da1/dd6 0 2024-09-19T09:02:42.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/82: mknod d5/d10/c14 0 2024-09-19T09:02:42.815 INFO:tasks.workunit.client.0.smithi049.stdout:4/21: dread f2 [0,4194304] 0 2024-09-19T09:02:42.815 INFO:tasks.workunit.client.1.smithi102.stdout:0/829: chown d3/dd/d10 0 1 2024-09-19T09:02:42.815 INFO:tasks.workunit.client.1.smithi102.stdout:1/689: symlink dd/d14/d35/d49/d62/le1 0 2024-09-19T09:02:42.815 INFO:tasks.workunit.client.1.smithi102.stdout:1/690: stat dd/d5f/f63 0 2024-09-19T09:02:42.816 INFO:tasks.workunit.client.0.smithi049.stdout:4/22: dread f2 [0,4194304] 0 2024-09-19T09:02:42.817 INFO:tasks.workunit.client.1.smithi102.stdout:0/830: fsync d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/fb1 0 2024-09-19T09:02:42.817 INFO:tasks.workunit.client.0.smithi049.stdout:4/23: stat d4 0 2024-09-19T09:02:42.820 INFO:tasks.workunit.client.0.smithi049.stdout:8/68: rename d1/fd to d1/f14 0 2024-09-19T09:02:42.821 INFO:tasks.workunit.client.0.smithi049.stdout:1/45: getdents d5/dd 0 2024-09-19T09:02:42.822 INFO:tasks.workunit.client.1.smithi102.stdout:3/816: creat d2/d19/d47/db/d26/d63/dfd/f103 x:0 0 0 2024-09-19T09:02:42.822 INFO:tasks.workunit.client.1.smithi102.stdout:3/817: chown d2/d19/d35 464582 1 2024-09-19T09:02:42.822 INFO:tasks.workunit.client.1.smithi102.stdout:0/831: dread d3/fea [0,4194304] 0 2024-09-19T09:02:42.822 INFO:tasks.workunit.client.1.smithi102.stdout:8/639: creat d0/db/d29/db5/fc7 x:0 0 0 2024-09-19T09:02:42.823 INFO:tasks.workunit.client.0.smithi049.stdout:7/57: rename d1/d7/f9 to d1/d7/f14 0 2024-09-19T09:02:42.823 INFO:tasks.workunit.client.0.smithi049.stdout:1/46: stat d5/d6/dc 0 2024-09-19T09:02:42.824 INFO:tasks.workunit.client.0.smithi049.stdout:4/24: dread f1 [0,4194304] 0 2024-09-19T09:02:42.824 INFO:tasks.workunit.client.0.smithi049.stdout:7/58: stat d1/f2 0 2024-09-19T09:02:42.824 INFO:tasks.workunit.client.0.smithi049.stdout:7/59: chown d1/d7 4786 1 2024-09-19T09:02:42.824 INFO:tasks.workunit.client.0.smithi049.stdout:4/25: chown f2 14850064 1 2024-09-19T09:02:42.825 INFO:tasks.workunit.client.0.smithi049.stdout:1/47: chown d5/d6/fa 1407539 1 2024-09-19T09:02:42.826 INFO:tasks.workunit.client.0.smithi049.stdout:7/60: stat d1/d7/d13 0 2024-09-19T09:02:42.827 INFO:tasks.workunit.client.1.smithi102.stdout:4/820: link d14/d34/d5a/d5c/d79/cc8 d14/d34/d5a/d5c/c107 0 2024-09-19T09:02:42.828 INFO:tasks.workunit.client.1.smithi102.stdout:8/640: mknod d0/d5a/cc8 0 2024-09-19T09:02:42.828 INFO:tasks.workunit.client.1.smithi102.stdout:4/821: fdatasync d14/d16/d17/de3/dbd/df3/d37/d58/de2/fdd 0 2024-09-19T09:02:42.829 INFO:tasks.workunit.client.1.smithi102.stdout:0/832: write d3/dd/d1a/d32/d7f/d10c/d37/d3d/fbe [1104819,26714] 0 2024-09-19T09:02:42.830 INFO:tasks.workunit.client.0.smithi049.stdout:8/69: creat d1/f15 x:0 0 0 2024-09-19T09:02:42.835 INFO:tasks.workunit.client.1.smithi102.stdout:1/691: mkdir dd/dd5/de2 0 2024-09-19T09:02:42.837 INFO:tasks.workunit.client.1.smithi102.stdout:4/822: chown d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/l52 103915 1 2024-09-19T09:02:42.837 INFO:tasks.workunit.client.1.smithi102.stdout:4/823: fdatasync d14/d16/dd5/ff2 0 2024-09-19T09:02:42.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/83: dwrite d5/f9 [0,4194304] 0 2024-09-19T09:02:42.839 INFO:tasks.workunit.client.0.smithi049.stdout:4/26: write f2 [892711,17087] 0 2024-09-19T09:02:42.839 INFO:tasks.workunit.client.1.smithi102.stdout:0/833: creat d3/dd/d10/d15/da2/f10e x:0 0 0 2024-09-19T09:02:42.841 INFO:tasks.workunit.client.0.smithi049.stdout:7/61: dread d1/d8/f10 [0,4194304] 0 2024-09-19T09:02:42.841 INFO:tasks.workunit.client.0.smithi049.stdout:0/84: readlink d5/le 0 2024-09-19T09:02:42.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/48: dwrite d5/d6/fa [0,4194304] 0 2024-09-19T09:02:42.843 INFO:tasks.workunit.client.1.smithi102.stdout:3/818: rename d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/c74 to d2/d19/d1c/d2f/d5a/d84/d4f/d72/c104 0 2024-09-19T09:02:42.847 INFO:tasks.workunit.client.1.smithi102.stdout:1/692: fsync dd/d14/d35/d49/d7d/d7f/f8b 0 2024-09-19T09:02:42.849 INFO:tasks.workunit.client.0.smithi049.stdout:7/62: dread d1/f3 [0,4194304] 0 2024-09-19T09:02:42.851 INFO:tasks.workunit.client.0.smithi049.stdout:8/70: creat d1/f16 x:0 0 0 2024-09-19T09:02:42.853 INFO:tasks.workunit.client.1.smithi102.stdout:2/629: write d7/d50/d64/d7f/d83/f75 [679696,7206] 0 2024-09-19T09:02:42.853 INFO:tasks.workunit.client.0.smithi049.stdout:4/27: dwrite f3 [0,4194304] 0 2024-09-19T09:02:42.855 INFO:tasks.workunit.client.1.smithi102.stdout:4/824: symlink d14/d16/d17/de3/dbd/l108 0 2024-09-19T09:02:42.856 INFO:tasks.workunit.client.1.smithi102.stdout:0/834: fdatasync d3/dd/d10/d15/d2c/f59 0 2024-09-19T09:02:42.860 INFO:tasks.workunit.client.1.smithi102.stdout:8/641: rename d0/f42 to d0/d10/fc9 0 2024-09-19T09:02:42.862 INFO:tasks.workunit.client.0.smithi049.stdout:1/49: write f3 [236506,117085] 0 2024-09-19T09:02:42.863 INFO:tasks.workunit.client.1.smithi102.stdout:3/819: mknod d2/d1e/dcb/c105 0 2024-09-19T09:02:42.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/28: read f2 [383402,44760] 0 2024-09-19T09:02:42.869 INFO:tasks.workunit.client.1.smithi102.stdout:2/630: mknod d7/d1a/d2b/dab/cd7 0 2024-09-19T09:02:42.872 INFO:tasks.workunit.client.0.smithi049.stdout:4/29: dwrite f2 [0,4194304] 0 2024-09-19T09:02:42.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/30: chown f2 0 1 2024-09-19T09:02:42.890 INFO:tasks.workunit.client.1.smithi102.stdout:9/693: sync 2024-09-19T09:02:42.905 INFO:tasks.workunit.client.1.smithi102.stdout:6/626: sync 2024-09-19T09:02:42.906 INFO:tasks.workunit.client.1.smithi102.stdout:5/709: sync 2024-09-19T09:02:42.906 INFO:tasks.workunit.client.1.smithi102.stdout:7/757: sync 2024-09-19T09:02:42.906 INFO:tasks.workunit.client.0.smithi049.stdout:2/12: sync 2024-09-19T09:02:42.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/85: mkdir d5/d10/d13/d15 0 2024-09-19T09:02:42.907 INFO:tasks.workunit.client.0.smithi049.stdout:8/71: dwrite d1/f14 [0,4194304] 0 2024-09-19T09:02:42.907 INFO:tasks.workunit.client.1.smithi102.stdout:7/758: write d1/d3/d34/d74/fa7 [1610800,97434] 0 2024-09-19T09:02:42.908 INFO:tasks.workunit.client.1.smithi102.stdout:6/627: write d1/d26/d2e/d45/d47/d4d/fc2 [98824,24172] 0 2024-09-19T09:02:42.908 INFO:tasks.workunit.client.1.smithi102.stdout:7/759: chown d1/cde 16770660 1 2024-09-19T09:02:42.909 INFO:tasks.workunit.client.0.smithi049.stdout:8/72: truncate d1/ff 114818 0 2024-09-19T09:02:42.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/73: chown d1/f15 209313 1 2024-09-19T09:02:42.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/74: readlink d1/lc 0 2024-09-19T09:02:42.914 INFO:tasks.workunit.client.0.smithi049.stdout:8/75: readlink d1/l13 0 2024-09-19T09:02:42.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/63: symlink d1/d7/d13/l15 0 2024-09-19T09:02:42.918 INFO:tasks.workunit.client.0.smithi049.stdout:0/86: dwrite d5/d10/f12 [0,4194304] 0 2024-09-19T09:02:42.919 INFO:tasks.workunit.client.0.smithi049.stdout:0/87: readlink l0 0 2024-09-19T09:02:42.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/88: write d5/f9 [4667681,30841] 0 2024-09-19T09:02:42.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/89: stat d5/f11 0 2024-09-19T09:02:42.922 INFO:tasks.workunit.client.0.smithi049.stdout:4/31: read f1 [1504755,44187] 0 2024-09-19T09:02:42.923 INFO:tasks.workunit.client.0.smithi049.stdout:4/32: read f3 [326190,31044] 0 2024-09-19T09:02:42.925 INFO:tasks.workunit.client.0.smithi049.stdout:1/50: mknod d5/d6/d8/ce 0 2024-09-19T09:02:42.926 INFO:tasks.workunit.client.0.smithi049.stdout:1/51: truncate f3 1011097 0 2024-09-19T09:02:42.927 INFO:tasks.workunit.client.0.smithi049.stdout:1/52: write f2 [4564993,12939] 0 2024-09-19T09:02:42.929 INFO:tasks.workunit.client.1.smithi102.stdout:9/694: dread d1/d8/d1c/f3e [0,4194304] 0 2024-09-19T09:02:42.930 INFO:tasks.workunit.client.0.smithi049.stdout:8/76: rename d1/f16 to d1/d11/f17 0 2024-09-19T09:02:42.931 INFO:tasks.workunit.client.1.smithi102.stdout:8/642: fdatasync d0/db/f89 0 2024-09-19T09:02:42.932 INFO:tasks.workunit.client.0.smithi049.stdout:0/90: readlink d5/lb 0 2024-09-19T09:02:42.935 INFO:tasks.workunit.client.1.smithi102.stdout:5/710: write d5/d7/d1a/d37/d39/d4c/f4a [1428833,121] 0 2024-09-19T09:02:42.935 INFO:tasks.workunit.client.0.smithi049.stdout:2/13: mkdir d1/d2 0 2024-09-19T09:02:42.938 INFO:tasks.workunit.client.1.smithi102.stdout:1/693: mkdir dd/d13/d2d/ddc/de3 0 2024-09-19T09:02:42.941 INFO:tasks.workunit.client.0.smithi049.stdout:8/77: symlink d1/l18 0 2024-09-19T09:02:42.942 INFO:tasks.workunit.client.0.smithi049.stdout:8/78: write d1/f15 [877250,109196] 0 2024-09-19T09:02:42.943 INFO:tasks.workunit.client.0.smithi049.stdout:7/64: rename d1/d8/f10 to d1/d7/d13/f16 0 2024-09-19T09:02:42.943 INFO:tasks.workunit.client.0.smithi049.stdout:7/65: read d1/f2 [1787601,72693] 0 2024-09-19T09:02:42.944 INFO:tasks.workunit.client.1.smithi102.stdout:9/695: dread d1/d2/d3/f31 [0,4194304] 0 2024-09-19T09:02:42.944 INFO:tasks.workunit.client.1.smithi102.stdout:6/628: mkdir d1/d26/d2e/d45/d47/d4d/dd9 0 2024-09-19T09:02:42.948 INFO:tasks.workunit.client.0.smithi049.stdout:2/14: mkdir d1/d3 0 2024-09-19T09:02:42.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/15: chown d1/d2 28 1 2024-09-19T09:02:42.950 INFO:tasks.workunit.client.1.smithi102.stdout:0/835: rename d3/dd/d1a/l7b to d3/dd/d10/d15/l10f 0 2024-09-19T09:02:42.951 INFO:tasks.workunit.client.1.smithi102.stdout:0/836: write d3/dd/d10/f63 [6564415,98430] 0 2024-09-19T09:02:42.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/33: creat d4/f5 x:0 0 0 2024-09-19T09:02:42.952 INFO:tasks.workunit.client.1.smithi102.stdout:5/711: unlink d5/d7/d1a/d42/f6d 0 2024-09-19T09:02:42.954 INFO:tasks.workunit.client.1.smithi102.stdout:3/820: rmdir d2/d19/d1c/d1f/d100 0 2024-09-19T09:02:42.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/79: dwrite d1/fb [4194304,4194304] 0 2024-09-19T09:02:42.955 INFO:tasks.workunit.client.1.smithi102.stdout:1/694: symlink dd/d14/d35/d49/le4 0 2024-09-19T09:02:42.957 INFO:tasks.workunit.client.1.smithi102.stdout:2/631: link d7/d1a/d2b/d31/d51/l91 d7/d12/ld8 0 2024-09-19T09:02:42.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/66: dwrite d1/d8/f12 [0,4194304] 0 2024-09-19T09:02:42.958 INFO:tasks.workunit.client.1.smithi102.stdout:5/712: dwrite d5/d23/d3b/f8c [0,4194304] 0 2024-09-19T09:02:42.960 INFO:tasks.workunit.client.1.smithi102.stdout:4/825: getdents d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106 0 2024-09-19T09:02:42.963 INFO:tasks.workunit.client.1.smithi102.stdout:9/696: read d1/d2/d3/d1d/f49 [2874727,93524] 0 2024-09-19T09:02:42.965 INFO:tasks.workunit.client.0.smithi049.stdout:0/91: unlink d5/d10/f12 0 2024-09-19T09:02:42.967 INFO:tasks.workunit.client.1.smithi102.stdout:6/629: mkdir d1/d18/d37/dda 0 2024-09-19T09:02:42.969 INFO:tasks.workunit.client.0.smithi049.stdout:1/53: truncate f2 4499308 0 2024-09-19T09:02:42.970 INFO:tasks.workunit.client.1.smithi102.stdout:8/643: creat d0/d10/d21/d39/d50/d63/fca x:0 0 0 2024-09-19T09:02:42.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/92: dread d5/fc [0,4194304] 0 2024-09-19T09:02:42.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/80: mkdir d1/d19 0 2024-09-19T09:02:42.976 INFO:tasks.workunit.client.1.smithi102.stdout:7/760: rename d1/d3/f64 to d1/d3/d34/db4/fed 0 2024-09-19T09:02:42.976 INFO:tasks.workunit.client.0.smithi049.stdout:2/16: dwrite f0 [0,4194304] 0 2024-09-19T09:02:42.978 INFO:tasks.workunit.client.1.smithi102.stdout:7/761: read d1/d3/d20/dad/dcd/fd5 [1619214,80981] 0 2024-09-19T09:02:42.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/67: symlink d1/l17 0 2024-09-19T09:02:42.979 INFO:tasks.workunit.client.1.smithi102.stdout:3/821: fdatasync d2/d1e/f93 0 2024-09-19T09:02:42.983 INFO:tasks.workunit.client.1.smithi102.stdout:2/632: symlink d7/d12/d37/d93/dce/ld9 0 2024-09-19T09:02:42.984 INFO:tasks.workunit.client.0.smithi049.stdout:8/81: rename d1/d19 to d1/d1a 0 2024-09-19T09:02:42.985 INFO:tasks.workunit.client.0.smithi049.stdout:8/82: readlink d1/la 0 2024-09-19T09:02:42.985 INFO:tasks.workunit.client.0.smithi049.stdout:8/83: chown d1/la 524712492 1 2024-09-19T09:02:42.986 INFO:tasks.workunit.client.1.smithi102.stdout:5/713: truncate d5/d7/f19 1449023 0 2024-09-19T09:02:42.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/17: rmdir d1 39 2024-09-19T09:02:42.989 INFO:tasks.workunit.client.1.smithi102.stdout:5/714: read d5/d7/d1a/d37/d39/d81/fab [1106340,78750] 0 2024-09-19T09:02:42.990 INFO:tasks.workunit.client.0.smithi049.stdout:8/84: dread d1/f7 [4194304,4194304] 0 2024-09-19T09:02:42.994 INFO:tasks.workunit.client.1.smithi102.stdout:6/630: mkdir d1/d26/d2e/d45/d47/d4d/d35/d79/ddb 0 2024-09-19T09:02:43.002 INFO:tasks.workunit.client.1.smithi102.stdout:9/697: write d1/d8/d98/fad [4284333,61337] 0 2024-09-19T09:02:43.005 INFO:tasks.workunit.client.0.smithi049.stdout:8/85: rmdir d1/d11 39 2024-09-19T09:02:43.005 INFO:tasks.workunit.client.0.smithi049.stdout:8/86: chown d1/l13 39 1 2024-09-19T09:02:43.007 INFO:tasks.workunit.client.1.smithi102.stdout:0/837: dread d3/dd/d1a/d32/d7f/d99/fbd [0,4194304] 0 2024-09-19T09:02:43.008 INFO:tasks.workunit.client.0.smithi049.stdout:7/68: dread d1/d8/fb [0,4194304] 0 2024-09-19T09:02:43.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:42 smithi102 ceph-mon[35280]: pgmap v28: 65 pgs: 65 active+clean; 1.3 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 44 MiB/s rd, 169 MiB/s wr, 368 op/s 2024-09-19T09:02:43.008 INFO:tasks.workunit.client.1.smithi102.stdout:0/838: fsync d3/dd/f1f 0 2024-09-19T09:02:43.009 INFO:tasks.workunit.client.0.smithi049.stdout:1/54: unlink f2 0 2024-09-19T09:02:43.009 INFO:tasks.workunit.client.1.smithi102.stdout:3/822: dread d2/d19/d35/fe4 [0,4194304] 0 2024-09-19T09:02:43.011 INFO:tasks.workunit.client.1.smithi102.stdout:4/826: symlink d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/dfb/l109 0 2024-09-19T09:02:43.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/18: rename d1/d3 to d1/d4 0 2024-09-19T09:02:43.013 INFO:tasks.workunit.client.1.smithi102.stdout:5/715: mknod d5/d7b/dc2/cdc 0 2024-09-19T09:02:43.014 INFO:tasks.workunit.client.1.smithi102.stdout:5/716: dread - d5/d7/d1a/d37/d50/f57 zero size 2024-09-19T09:02:43.014 INFO:tasks.workunit.client.0.smithi049.stdout:8/87: write d1/f7 [3225567,54699] 0 2024-09-19T09:02:43.015 INFO:tasks.workunit.client.1.smithi102.stdout:5/717: chown d5/d7/d1a/d37/d34/d7f/c96 117947 1 2024-09-19T09:02:43.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/55: rename f4 to d5/dd/ff 0 2024-09-19T09:02:43.016 INFO:tasks.workunit.client.0.smithi049.stdout:1/56: write f3 [2045786,54656] 0 2024-09-19T09:02:43.017 INFO:tasks.workunit.client.1.smithi102.stdout:8/644: rename d0/d64/c67 to d0/d10/d21/d39/ccb 0 2024-09-19T09:02:43.017 INFO:tasks.workunit.client.0.smithi049.stdout:0/93: getdents d5/d10/d13 0 2024-09-19T09:02:43.018 INFO:tasks.workunit.client.1.smithi102.stdout:8/645: write d0/d10/d21/d39/d50/d63/fb9 [331278,28792] 0 2024-09-19T09:02:43.018 INFO:tasks.workunit.client.0.smithi049.stdout:0/94: read - d5/f11 zero size 2024-09-19T09:02:43.025 INFO:tasks.workunit.client.0.smithi049.stdout:8/88: dread - d1/d11/f17 zero size 2024-09-19T09:02:43.025 INFO:tasks.workunit.client.0.smithi049.stdout:1/57: dread f3 [0,4194304] 0 2024-09-19T09:02:43.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/69: mkdir d1/d7/d13/d18 0 2024-09-19T09:02:43.026 INFO:tasks.workunit.client.1.smithi102.stdout:1/695: creat dd/d14/d35/d49/d62/d6c/d99/fe5 x:0 0 0 2024-09-19T09:02:43.029 INFO:tasks.workunit.client.1.smithi102.stdout:0/839: mknod d3/dd/d1a/d32/d7f/d10c/d2a/dba/d9d/c110 0 2024-09-19T09:02:43.030 INFO:tasks.workunit.client.1.smithi102.stdout:7/762: write d1/d4/dca/f4b [609880,105562] 0 2024-09-19T09:02:43.032 INFO:tasks.workunit.client.0.smithi049.stdout:2/19: getdents d1/d2 0 2024-09-19T09:02:43.032 INFO:tasks.workunit.client.1.smithi102.stdout:0/840: dread d3/dd/d10/d8e/fe4 [0,4194304] 0 2024-09-19T09:02:43.032 INFO:tasks.workunit.client.1.smithi102.stdout:2/633: symlink d7/d50/d64/da1/dd6/lda 0 2024-09-19T09:02:43.034 INFO:tasks.workunit.client.0.smithi049.stdout:8/89: rename d1/f7 to d1/d11/f1b 0 2024-09-19T09:02:43.035 INFO:tasks.workunit.client.1.smithi102.stdout:4/827: fsync d14/d16/d17/f1f 0 2024-09-19T09:02:43.036 INFO:tasks.workunit.client.0.smithi049.stdout:7/70: mkdir d1/d8/d19 0 2024-09-19T09:02:43.037 INFO:tasks.workunit.client.0.smithi049.stdout:0/95: dread d5/fc [0,4194304] 0 2024-09-19T09:02:43.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/20: dwrite f0 [0,4194304] 0 2024-09-19T09:02:43.040 INFO:tasks.workunit.client.1.smithi102.stdout:5/718: mkdir d5/d7b/ddd 0 2024-09-19T09:02:43.041 INFO:tasks.workunit.client.0.smithi049.stdout:2/21: chown d1/d4 412 1 2024-09-19T09:02:43.043 INFO:tasks.workunit.client.1.smithi102.stdout:8/646: truncate d0/d4f/daa/fb7 948150 0 2024-09-19T09:02:43.045 INFO:tasks.workunit.client.1.smithi102.stdout:9/698: symlink d1/d2/d3/d1d/d4f/d6d/d81/dd3/le7 0 2024-09-19T09:02:43.049 INFO:tasks.workunit.client.1.smithi102.stdout:1/696: rename dd/d13/f50 to dd/d13/d2d/ddc/fe6 0 2024-09-19T09:02:43.050 INFO:tasks.workunit.client.1.smithi102.stdout:8/647: dwrite d0/db/d84/f95 [0,4194304] 0 2024-09-19T09:02:43.052 INFO:tasks.workunit.client.0.smithi049.stdout:0/96: unlink d5/f9 0 2024-09-19T09:02:43.053 INFO:tasks.workunit.client.1.smithi102.stdout:7/763: creat d1/d3/d20/d6c/fee x:0 0 0 2024-09-19T09:02:43.054 INFO:tasks.workunit.client.1.smithi102.stdout:0/841: symlink d3/dd/d1a/d32/d7f/d10c/d2a/l111 0 2024-09-19T09:02:43.054 INFO:tasks.workunit.client.1.smithi102.stdout:9/699: dwrite d1/d2/d3/f4b [0,4194304] 0 2024-09-19T09:02:43.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/97: dread d5/fc [0,4194304] 0 2024-09-19T09:02:43.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/71: unlink d1/c5 0 2024-09-19T09:02:43.059 INFO:tasks.workunit.client.1.smithi102.stdout:4/828: mknod d14/d34/d5a/d5c/d81/c10a 0 2024-09-19T09:02:43.061 INFO:tasks.workunit.client.1.smithi102.stdout:4/829: write d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/f95 [2415668,68630] 0 2024-09-19T09:02:43.062 INFO:tasks.workunit.client.1.smithi102.stdout:6/631: link d1/d18/d37/f7d d1/d18/fdc 0 2024-09-19T09:02:43.062 INFO:tasks.workunit.client.0.smithi049.stdout:0/98: dwrite d5/fa [0,4194304] 0 2024-09-19T09:02:43.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/22: link f0 d1/d2/f5 0 2024-09-19T09:02:43.063 INFO:tasks.workunit.client.1.smithi102.stdout:5/719: symlink d5/d7/d1a/d37/d34/d4d/lde 0 2024-09-19T09:02:43.065 INFO:tasks.workunit.client.0.smithi049.stdout:1/58: rename d5/fb to d5/d6/f10 0 2024-09-19T09:02:43.068 INFO:tasks.workunit.client.0.smithi049.stdout:1/59: dread - d5/dd/ff zero size 2024-09-19T09:02:43.075 INFO:tasks.workunit.client.1.smithi102.stdout:1/697: mkdir dd/d14/d35/d49/d62/d9e/dab/de7 0 2024-09-19T09:02:43.077 INFO:tasks.workunit.client.1.smithi102.stdout:8/648: symlink d0/db/d84/lcc 0 2024-09-19T09:02:43.078 INFO:tasks.workunit.client.1.smithi102.stdout:8/649: write d0/d4f/fc2 [459284,36018] 0 2024-09-19T09:02:43.079 INFO:tasks.workunit.client.1.smithi102.stdout:8/650: read - d0/d10/d21/d39/d87/fc5 zero size 2024-09-19T09:02:43.081 INFO:tasks.workunit.client.1.smithi102.stdout:2/634: link d7/d12/f17 d7/d1a/d2b/dab/fdb 0 2024-09-19T09:02:43.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/90: rename d1/l5 to d1/d1a/l1c 0 2024-09-19T09:02:43.084 INFO:tasks.workunit.client.0.smithi049.stdout:0/99: rename d5/d10/d13 to d5/d10/d13/d16 22 2024-09-19T09:02:43.085 INFO:tasks.workunit.client.0.smithi049.stdout:8/91: read d1/d11/f1b [6681736,17135] 0 2024-09-19T09:02:43.086 INFO:tasks.workunit.client.1.smithi102.stdout:0/842: mknod d3/dd/d1a/d32/d7f/d10c/d37/d3d/c112 0 2024-09-19T09:02:43.088 INFO:tasks.workunit.client.0.smithi049.stdout:2/23: dread f0 [0,4194304] 0 2024-09-19T09:02:43.090 INFO:tasks.workunit.client.0.smithi049.stdout:8/92: dread d1/f14 [0,4194304] 0 2024-09-19T09:02:43.094 INFO:tasks.workunit.client.1.smithi102.stdout:3/823: getdents d2/d19/d47/db/dc3 0 2024-09-19T09:02:43.096 INFO:tasks.workunit.client.0.smithi049.stdout:7/72: rmdir d1 39 2024-09-19T09:02:43.097 INFO:tasks.workunit.client.0.smithi049.stdout:8/93: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:02:43.098 INFO:tasks.workunit.client.1.smithi102.stdout:5/720: dwrite d5/d8d/fcb [0,4194304] 0 2024-09-19T09:02:43.098 INFO:tasks.workunit.client.1.smithi102.stdout:1/698: write dd/d14/dac/fd8 [111883,19727] 0 2024-09-19T09:02:43.104 INFO:tasks.workunit.client.1.smithi102.stdout:5/721: dread d5/d7/d1a/d37/d39/d4c/f4a [0,4194304] 0 2024-09-19T09:02:43.116 INFO:tasks.workunit.client.1.smithi102.stdout:7/764: rename d1/d4/dca/c47 to d1/d3/d20/cef 0 2024-09-19T09:02:43.118 INFO:tasks.workunit.client.1.smithi102.stdout:1/699: dread - dd/d14/d35/d49/d62/d6c/d99/db8/fde zero size 2024-09-19T09:02:43.120 INFO:tasks.workunit.client.1.smithi102.stdout:3/824: dread d2/d19/d1c/d2f/d5a/d84/d4f/fb0 [0,4194304] 0 2024-09-19T09:02:43.121 INFO:tasks.workunit.client.1.smithi102.stdout:0/843: mkdir d3/dd/d1a/d32/d113 0 2024-09-19T09:02:43.126 INFO:tasks.workunit.client.1.smithi102.stdout:8/651: rename d0/d64/f3c to d0/db/d1d/fcd 0 2024-09-19T09:02:43.128 INFO:tasks.workunit.client.1.smithi102.stdout:7/765: unlink d1/d4/dca/f4e 0 2024-09-19T09:02:43.128 INFO:tasks.workunit.client.1.smithi102.stdout:7/766: stat d1/d3/d20/l5f 0 2024-09-19T09:02:43.129 INFO:tasks.workunit.client.1.smithi102.stdout:1/700: symlink dd/d14/d35/d49/le8 0 2024-09-19T09:02:43.133 INFO:tasks.workunit.client.1.smithi102.stdout:8/652: unlink d0/d64/c3e 0 2024-09-19T09:02:43.133 INFO:tasks.workunit.client.1.smithi102.stdout:1/701: dread dd/d14/dac/fd8 [0,4194304] 0 2024-09-19T09:02:43.135 INFO:tasks.workunit.client.1.smithi102.stdout:4/830: dwrite d14/d34/d5a/f105 [0,4194304] 0 2024-09-19T09:02:43.138 INFO:tasks.workunit.client.1.smithi102.stdout:6/632: dwrite d1/d26/d4b/d94/f73 [0,4194304] 0 2024-09-19T09:02:43.140 INFO:tasks.workunit.client.1.smithi102.stdout:4/831: write d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/fef [531674,33519] 0 2024-09-19T09:02:43.142 INFO:tasks.workunit.client.1.smithi102.stdout:6/633: write d1/d26/d4b/d94/fa1 [2097368,102382] 0 2024-09-19T09:02:43.143 INFO:tasks.workunit.client.1.smithi102.stdout:7/767: mkdir d1/d4/dca/d52/d7f/da5/de2/df0 0 2024-09-19T09:02:43.145 INFO:tasks.workunit.client.1.smithi102.stdout:8/653: mknod d0/d10/cce 0 2024-09-19T09:02:43.145 INFO:tasks.workunit.client.1.smithi102.stdout:8/654: read d0/db/d84/f95 [320855,4635] 0 2024-09-19T09:02:43.150 INFO:tasks.workunit.client.1.smithi102.stdout:5/722: getdents d5/d7/d1a/d37/d34/d4d/d9c 0 2024-09-19T09:02:43.152 INFO:tasks.workunit.client.1.smithi102.stdout:5/723: truncate d5/d7/d1a/d37/d39/fdb 316777 0 2024-09-19T09:02:43.152 INFO:tasks.workunit.client.1.smithi102.stdout:1/702: write dd/d14/d35/d49/dcb/fcc [820557,8953] 0 2024-09-19T09:02:43.154 INFO:tasks.workunit.client.1.smithi102.stdout:2/635: rename d7/d1a/d56/l7e to d7/d1a/ldc 0 2024-09-19T09:02:43.158 INFO:tasks.workunit.client.1.smithi102.stdout:4/832: read d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/f7f [5419,112423] 0 2024-09-19T09:02:43.159 INFO:tasks.workunit.client.1.smithi102.stdout:6/634: chown d1/d18/db/c17 31735567 1 2024-09-19T09:02:43.160 INFO:tasks.workunit.client.1.smithi102.stdout:7/768: chown d1/d3/d34/d74/c9f 992 1 2024-09-19T09:02:43.161 INFO:tasks.workunit.client.1.smithi102.stdout:7/769: chown d1/d2d/f54 1 1 2024-09-19T09:02:43.164 INFO:tasks.workunit.client.1.smithi102.stdout:8/655: write d0/d10/d21/d39/d50/da2/fa7 [769000,31694] 0 2024-09-19T09:02:43.165 INFO:tasks.workunit.client.1.smithi102.stdout:5/724: creat d5/d7/d1a/d37/d34/d73/fdf x:0 0 0 2024-09-19T09:02:43.165 INFO:tasks.workunit.client.1.smithi102.stdout:7/770: read d1/d2f/f4a [3165047,67516] 0 2024-09-19T09:02:43.166 INFO:tasks.workunit.client.1.smithi102.stdout:9/700: sync 2024-09-19T09:02:43.167 INFO:tasks.workunit.client.1.smithi102.stdout:4/833: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/f5f [0,4194304] 0 2024-09-19T09:02:43.167 INFO:tasks.workunit.client.1.smithi102.stdout:7/771: fsync d1/f8f 0 2024-09-19T09:02:43.168 INFO:tasks.workunit.client.0.smithi049.stdout:6/22: sync 2024-09-19T09:02:43.169 INFO:tasks.workunit.client.1.smithi102.stdout:4/834: chown d14/d16/d17/de3/dbd/df3/f4e 0 1 2024-09-19T09:02:43.169 INFO:tasks.workunit.client.1.smithi102.stdout:3/825: rename d2/d19/d47/db/d26/d63/d6f/d96/cd2 to d2/d19/d47/db/dc3/c106 0 2024-09-19T09:02:43.176 INFO:tasks.workunit.client.1.smithi102.stdout:1/703: dread dd/d14/d35/d49/f6d [0,4194304] 0 2024-09-19T09:02:43.178 INFO:tasks.workunit.client.1.smithi102.stdout:7/772: dwrite d1/d3/d20/d6c/fee [0,4194304] 0 2024-09-19T09:02:43.183 INFO:tasks.workunit.client.1.smithi102.stdout:8/656: creat d0/d10/d21/d39/d50/d63/fcf x:0 0 0 2024-09-19T09:02:43.185 INFO:tasks.workunit.client.1.smithi102.stdout:9/701: mknod d1/d2/d3/d1d/d4f/d6d/d81/d90/ce8 0 2024-09-19T09:02:43.186 INFO:tasks.workunit.client.1.smithi102.stdout:9/702: chown d1/d2/d78/f7d 17 1 2024-09-19T09:02:43.187 INFO:tasks.workunit.client.1.smithi102.stdout:9/703: chown d1/d2/d7b/cbd 1410361 1 2024-09-19T09:02:43.188 INFO:tasks.workunit.client.1.smithi102.stdout:9/704: dread - d1/d2/d3/d6f/d8d/da2/db6/fba zero size 2024-09-19T09:02:43.190 INFO:tasks.workunit.client.1.smithi102.stdout:6/635: creat d1/d26/d2e/dce/fdd x:0 0 0 2024-09-19T09:02:43.190 INFO:tasks.workunit.client.1.smithi102.stdout:4/835: dread d14/f6d [0,4194304] 0 2024-09-19T09:02:43.191 INFO:tasks.workunit.client.1.smithi102.stdout:6/636: truncate d1/d18/d37/f7d 256411 0 2024-09-19T09:02:43.193 INFO:tasks.workunit.client.1.smithi102.stdout:3/826: readlink d2/d19/d1c/d1f/d5f/l7a 0 2024-09-19T09:02:43.193 INFO:tasks.workunit.client.1.smithi102.stdout:2/636: write d7/d1a/f49 [688251,93650] 0 2024-09-19T09:02:43.193 INFO:tasks.workunit.client.1.smithi102.stdout:3/827: dread - d2/d19/d47/db/fa1 zero size 2024-09-19T09:02:43.194 INFO:tasks.workunit.client.1.smithi102.stdout:2/637: write d7/d12/f9f [149200,108052] 0 2024-09-19T09:02:43.197 INFO:tasks.workunit.client.1.smithi102.stdout:7/773: fsync d1/d3/d20/f35 0 2024-09-19T09:02:43.200 INFO:tasks.workunit.client.1.smithi102.stdout:3/828: dwrite d2/d19/d1c/d70/f8a [0,4194304] 0 2024-09-19T09:02:43.202 INFO:tasks.workunit.client.1.smithi102.stdout:9/705: fsync d1/d2/d3/d1d/d4f/d6d/f7c 0 2024-09-19T09:02:43.205 INFO:tasks.workunit.client.1.smithi102.stdout:4/836: symlink d14/d16/d1d/d92/l10b 0 2024-09-19T09:02:43.207 INFO:tasks.workunit.client.1.smithi102.stdout:6/637: chown d1/d26/d2e/d45/d47/d4d/d35/f39 261408255 1 2024-09-19T09:02:43.211 INFO:tasks.workunit.client.1.smithi102.stdout:2/638: creat d7/d1a/d56/db9/fdd x:0 0 0 2024-09-19T09:02:43.211 INFO:tasks.workunit.client.1.smithi102.stdout:4/837: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/f95 [0,4194304] 0 2024-09-19T09:02:43.212 INFO:tasks.workunit.client.1.smithi102.stdout:2/639: stat d7/d11/l14 0 2024-09-19T09:02:43.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/704: mknod dd/d14/dac/dc2/ce9 0 2024-09-19T09:02:43.214 INFO:tasks.workunit.client.1.smithi102.stdout:1/705: fdatasync dd/f1d 0 2024-09-19T09:02:43.216 INFO:tasks.workunit.client.1.smithi102.stdout:1/706: chown dd/d13/l19 78 1 2024-09-19T09:02:43.219 INFO:tasks.workunit.client.1.smithi102.stdout:4/838: dwrite f13 [4194304,4194304] 0 2024-09-19T09:02:43.221 INFO:tasks.workunit.client.1.smithi102.stdout:4/839: stat d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/f4b 0 2024-09-19T09:02:43.222 INFO:tasks.workunit.client.1.smithi102.stdout:3/829: mknod d2/d19/d1c/d1f/d5f/c107 0 2024-09-19T09:02:43.224 INFO:tasks.workunit.client.1.smithi102.stdout:7/774: dread d1/d3/d20/fb2 [0,4194304] 0 2024-09-19T09:02:43.224 INFO:tasks.workunit.client.1.smithi102.stdout:0/844: rename d3/dd/d1a/d32/d7f/d10c/d2a/dba/d9d/de2/cff to d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/c114 0 2024-09-19T09:02:43.228 INFO:tasks.workunit.client.1.smithi102.stdout:0/845: chown d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/fd2 17048 1 2024-09-19T09:02:43.229 INFO:tasks.workunit.client.1.smithi102.stdout:0/846: write d3/dd/d10/d15/d19/f26 [5236270,94221] 0 2024-09-19T09:02:43.229 INFO:tasks.workunit.client.1.smithi102.stdout:0/847: dread - d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/dab/fed zero size 2024-09-19T09:02:43.229 INFO:tasks.workunit.client.1.smithi102.stdout:9/706: creat d1/d2/d3/d6f/d8d/da2/fe9 x:0 0 0 2024-09-19T09:02:43.234 INFO:tasks.workunit.client.1.smithi102.stdout:6/638: dread d1/d26/d4b/d94/d8a/fb3 [0,4194304] 0 2024-09-19T09:02:43.234 INFO:tasks.workunit.client.1.smithi102.stdout:2/640: mkdir d7/d1a/d2b/d31/dde 0 2024-09-19T09:02:43.237 INFO:tasks.workunit.client.1.smithi102.stdout:8/657: truncate d0/d10/d21/d39/d50/da2/fa7 330808 0 2024-09-19T09:02:43.238 INFO:tasks.workunit.client.1.smithi102.stdout:4/840: symlink d14/d34/d5a/d5c/d81/d75/l10c 0 2024-09-19T09:02:43.241 INFO:tasks.workunit.client.1.smithi102.stdout:5/725: rename d5/d7/d1a/d37/d39/d4c/d89 to d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/de0 0 2024-09-19T09:02:43.242 INFO:tasks.workunit.client.1.smithi102.stdout:7/775: rmdir d1/d3/d34/d74 39 2024-09-19T09:02:43.247 INFO:tasks.workunit.client.1.smithi102.stdout:7/776: chown d1/d4/dca/d52/d7f/da5/de2 4 1 2024-09-19T09:02:43.248 INFO:tasks.workunit.client.1.smithi102.stdout:4/841: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/fbb [0,4194304] 0 2024-09-19T09:02:43.248 INFO:tasks.workunit.client.1.smithi102.stdout:0/848: creat d3/dd/d1a/d32/d7f/d10c/d37/d3d/d90/f115 x:0 0 0 2024-09-19T09:02:43.249 INFO:tasks.workunit.client.1.smithi102.stdout:9/707: fsync d1/d2/d3/d1d/f49 0 2024-09-19T09:02:43.249 INFO:tasks.workunit.client.1.smithi102.stdout:7/777: write d1/d2f/fd7 [1223907,42648] 0 2024-09-19T09:02:43.252 INFO:tasks.workunit.client.1.smithi102.stdout:7/778: stat d1/d3/d20/dad/dd4/fe8 0 2024-09-19T09:02:43.252 INFO:tasks.workunit.client.1.smithi102.stdout:9/708: chown d1/d2/d78/da0/fa7 163048 1 2024-09-19T09:02:43.256 INFO:tasks.workunit.client.1.smithi102.stdout:1/707: mkdir dd/d66/dea 0 2024-09-19T09:02:43.258 INFO:tasks.workunit.client.1.smithi102.stdout:8/658: creat d0/d10/d21/d39/d50/d63/d83/fd0 x:0 0 0 2024-09-19T09:02:43.260 INFO:tasks.workunit.client.1.smithi102.stdout:7/779: dwrite d1/d4/d9c/fcb [0,4194304] 0 2024-09-19T09:02:43.266 INFO:tasks.workunit.client.1.smithi102.stdout:0/849: dread d3/dd/d10/f38 [0,4194304] 0 2024-09-19T09:02:43.288 INFO:tasks.workunit.client.0.smithi049.stdout:8/94: rmdir d1/d1a 39 2024-09-19T09:02:43.289 INFO:tasks.workunit.client.0.smithi049.stdout:5/41: sync 2024-09-19T09:02:43.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/42: truncate d3/f8 1444181 0 2024-09-19T09:02:43.290 INFO:tasks.workunit.client.0.smithi049.stdout:1/60: stat d5/d6/d8/ce 0 2024-09-19T09:02:43.291 INFO:tasks.workunit.client.0.smithi049.stdout:6/23: stat c1 0 2024-09-19T09:02:43.291 INFO:tasks.workunit.client.0.smithi049.stdout:6/24: chown l5 16 1 2024-09-19T09:02:43.293 INFO:tasks.workunit.client.0.smithi049.stdout:0/100: mknod d5/d10/d13/d15/c17 0 2024-09-19T09:02:43.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/24: rename d1/d2/f5 to d1/d2/f6 0 2024-09-19T09:02:43.300 INFO:tasks.workunit.client.0.smithi049.stdout:0/101: dwrite d5/f11 [0,4194304] 0 2024-09-19T09:02:43.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/95: rename d1 to d1/d1d 22 2024-09-19T09:02:43.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/96: chown d1/l13 126 1 2024-09-19T09:02:43.302 INFO:tasks.workunit.client.0.smithi049.stdout:1/61: chown d5/d6/f9 3938 1 2024-09-19T09:02:43.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:42 smithi049 ceph-mon[28158]: pgmap v28: 65 pgs: 65 active+clean; 1.3 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 44 MiB/s rd, 169 MiB/s wr, 368 op/s 2024-09-19T09:02:43.307 INFO:tasks.workunit.client.0.smithi049.stdout:6/25: rename f4 to fa 0 2024-09-19T09:02:43.307 INFO:tasks.workunit.client.0.smithi049.stdout:6/26: dread - f9 zero size 2024-09-19T09:02:43.308 INFO:tasks.workunit.client.0.smithi049.stdout:6/27: fdatasync f3 0 2024-09-19T09:02:43.311 INFO:tasks.workunit.client.0.smithi049.stdout:7/73: mkdir d1/d1a 0 2024-09-19T09:02:43.313 INFO:tasks.workunit.client.0.smithi049.stdout:0/102: creat d5/d10/d13/d15/f18 x:0 0 0 2024-09-19T09:02:43.322 INFO:tasks.workunit.client.0.smithi049.stdout:6/28: creat fb x:0 0 0 2024-09-19T09:02:43.324 INFO:tasks.workunit.client.1.smithi102.stdout:4/842: dread d14/d16/d17/f1f [0,4194304] 0 2024-09-19T09:02:43.324 INFO:tasks.workunit.client.0.smithi049.stdout:2/25: fdatasync f0 0 2024-09-19T09:02:43.326 INFO:tasks.workunit.client.0.smithi049.stdout:7/74: chown d1/c6 1 1 2024-09-19T09:02:43.327 INFO:tasks.workunit.client.1.smithi102.stdout:9/709: symlink d1/d2/d78/lea 0 2024-09-19T09:02:43.329 INFO:tasks.workunit.client.0.smithi049.stdout:3/25: sync 2024-09-19T09:02:43.329 INFO:tasks.workunit.client.0.smithi049.stdout:4/34: sync 2024-09-19T09:02:43.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/26: dwrite - no filename 2024-09-19T09:02:43.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/27: truncate - no filename 2024-09-19T09:02:43.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/28: write - no filename 2024-09-19T09:02:43.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/29: dread - no filename 2024-09-19T09:02:43.330 INFO:tasks.workunit.client.0.smithi049.stdout:9/43: sync 2024-09-19T09:02:43.330 INFO:tasks.workunit.client.0.smithi049.stdout:4/35: chown d4 3560 1 2024-09-19T09:02:43.331 INFO:tasks.workunit.client.1.smithi102.stdout:1/708: write dd/d5f/f93 [985156,96700] 0 2024-09-19T09:02:43.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/44: readlink d3/l4 0 2024-09-19T09:02:43.333 INFO:tasks.workunit.client.1.smithi102.stdout:8/659: creat d0/db/d29/db5/fd1 x:0 0 0 2024-09-19T09:02:43.333 INFO:tasks.workunit.client.0.smithi049.stdout:1/62: fsync d5/d6/f10 0 2024-09-19T09:02:43.334 INFO:tasks.workunit.client.1.smithi102.stdout:8/660: readlink d0/d10/d21/d39/l88 0 2024-09-19T09:02:43.335 INFO:tasks.workunit.client.1.smithi102.stdout:7/780: fsync d1/d2f/f4a 0 2024-09-19T09:02:43.339 INFO:tasks.workunit.client.1.smithi102.stdout:8/661: dwrite d0/d4f/fc2 [0,4194304] 0 2024-09-19T09:02:43.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/26: creat d1/f7 x:0 0 0 2024-09-19T09:02:43.347 INFO:tasks.workunit.client.0.smithi049.stdout:5/43: truncate d3/f9 3168690 0 2024-09-19T09:02:43.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/29: dwrite f0 [0,4194304] 0 2024-09-19T09:02:43.350 INFO:tasks.workunit.client.0.smithi049.stdout:4/36: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:43.350 INFO:tasks.workunit.client.1.smithi102.stdout:6/639: write d1/d26/d2e/d45/d47/fd6 [296927,130622] 0 2024-09-19T09:02:43.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/30: creat f5 x:0 0 0 2024-09-19T09:02:43.352 INFO:tasks.workunit.client.0.smithi049.stdout:3/31: truncate f5 512107 0 2024-09-19T09:02:43.355 INFO:tasks.workunit.client.0.smithi049.stdout:0/103: write d5/fc [5492537,106326] 0 2024-09-19T09:02:43.355 INFO:tasks.workunit.client.0.smithi049.stdout:6/30: dread f3 [0,4194304] 0 2024-09-19T09:02:43.357 INFO:tasks.workunit.client.1.smithi102.stdout:4/843: creat d14/d34/d5a/d5c/d81/d75/df0/f10d x:0 0 0 2024-09-19T09:02:43.357 INFO:tasks.workunit.client.0.smithi049.stdout:6/31: fdatasync f3 0 2024-09-19T09:02:43.359 INFO:tasks.workunit.client.1.smithi102.stdout:4/844: readlink d14/d16/d17/de3/dbd/df3/d60/lb4 0 2024-09-19T09:02:43.361 INFO:tasks.workunit.client.0.smithi049.stdout:2/27: symlink d1/l8 0 2024-09-19T09:02:43.362 INFO:tasks.workunit.client.0.smithi049.stdout:1/63: dread d5/d6/f7 [0,4194304] 0 2024-09-19T09:02:43.365 INFO:tasks.workunit.client.1.smithi102.stdout:1/709: stat dd/d14/l3d 0 2024-09-19T09:02:43.365 INFO:tasks.workunit.client.1.smithi102.stdout:1/710: dread - dd/d14/d35/d49/dcb/fd0 zero size 2024-09-19T09:02:43.366 INFO:tasks.workunit.client.0.smithi049.stdout:2/28: dread f0 [0,4194304] 0 2024-09-19T09:02:43.367 INFO:tasks.workunit.client.0.smithi049.stdout:7/75: write d1/d7/d13/f16 [2372712,24399] 0 2024-09-19T09:02:43.367 INFO:tasks.workunit.client.0.smithi049.stdout:8/97: link d1/la d1/l1e 0 2024-09-19T09:02:43.367 INFO:tasks.workunit.client.0.smithi049.stdout:7/76: chown d1/d7 103935180 1 2024-09-19T09:02:43.368 INFO:tasks.workunit.client.0.smithi049.stdout:4/37: creat d4/f6 x:0 0 0 2024-09-19T09:02:43.369 INFO:tasks.workunit.client.1.smithi102.stdout:3/830: getdents d2/d19/d47/db/d26/d63/dfd 0 2024-09-19T09:02:43.369 INFO:tasks.workunit.client.0.smithi049.stdout:4/38: write f2 [1120116,18818] 0 2024-09-19T09:02:43.370 INFO:tasks.workunit.client.0.smithi049.stdout:4/39: chown d4/f6 10710 1 2024-09-19T09:02:43.371 INFO:tasks.workunit.client.0.smithi049.stdout:3/32: creat f6 x:0 0 0 2024-09-19T09:02:43.372 INFO:tasks.workunit.client.0.smithi049.stdout:3/33: dread f5 [0,4194304] 0 2024-09-19T09:02:43.373 INFO:tasks.workunit.client.1.smithi102.stdout:8/662: read d0/d10/d21/d39/d50/d63/d83/f8a [122782,118712] 0 2024-09-19T09:02:43.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/104: mkdir d5/d10/d13/d19 0 2024-09-19T09:02:43.376 INFO:tasks.workunit.client.0.smithi049.stdout:3/34: chown c0 1 1 2024-09-19T09:02:43.377 INFO:tasks.workunit.client.1.smithi102.stdout:0/850: link d3/dd/d10/d15/d2c/ff2 d3/dd/d1a/d32/d7f/d10c/d2a/dba/d9d/f116 0 2024-09-19T09:02:43.381 INFO:tasks.workunit.client.0.smithi049.stdout:4/40: dwrite d4/f5 [0,4194304] 0 2024-09-19T09:02:43.382 INFO:tasks.workunit.client.1.smithi102.stdout:7/781: dread d1/d3/d34/d74/fc0 [0,4194304] 0 2024-09-19T09:02:43.383 INFO:tasks.workunit.client.1.smithi102.stdout:5/726: rename d5/d23/d3b to d5/d7/d1a/de1 0 2024-09-19T09:02:43.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/32: mkdir dc 0 2024-09-19T09:02:43.386 INFO:tasks.workunit.client.1.smithi102.stdout:6/640: creat d1/d26/d2e/fde x:0 0 0 2024-09-19T09:02:43.388 INFO:tasks.workunit.client.0.smithi049.stdout:1/64: unlink d5/dd/ff 0 2024-09-19T09:02:43.389 INFO:tasks.workunit.client.1.smithi102.stdout:9/710: write d1/d8/f5f [877171,31759] 0 2024-09-19T09:02:43.389 INFO:tasks.workunit.client.1.smithi102.stdout:2/641: getdents d7/d1a/d2b/dab 0 2024-09-19T09:02:43.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/44: truncate d3/f6 108087 0 2024-09-19T09:02:43.391 INFO:tasks.workunit.client.1.smithi102.stdout:0/851: dread d3/dd/d1a/d32/d7f/d10c/d37/f9a [0,4194304] 0 2024-09-19T09:02:43.393 INFO:tasks.workunit.client.1.smithi102.stdout:0/852: chown d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/de5/cf4 899 1 2024-09-19T09:02:43.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/29: rename d1/l8 to d1/l9 0 2024-09-19T09:02:43.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/30: stat d1/d4 0 2024-09-19T09:02:43.397 INFO:tasks.workunit.client.0.smithi049.stdout:8/98: write d1/fb [3172526,130991] 0 2024-09-19T09:02:43.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/77: chown d1/d8/fb 2403087 1 2024-09-19T09:02:43.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/99: dwrite d1/ff [0,4194304] 0 2024-09-19T09:02:43.413 INFO:tasks.workunit.client.1.smithi102.stdout:7/782: dread d1/d3/d20/f35 [0,4194304] 0 2024-09-19T09:02:43.417 INFO:tasks.workunit.client.0.smithi049.stdout:8/100: dread d1/ff [0,4194304] 0 2024-09-19T09:02:43.418 INFO:tasks.workunit.client.0.smithi049.stdout:8/101: chown d1/d11/f17 1 1 2024-09-19T09:02:43.420 INFO:tasks.workunit.client.0.smithi049.stdout:3/35: mknod c7 0 2024-09-19T09:02:43.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/102: write d1/ff [3682268,66777] 0 2024-09-19T09:02:43.425 INFO:tasks.workunit.client.0.smithi049.stdout:0/105: mknod d5/d10/d13/d15/c1a 0 2024-09-19T09:02:43.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/106: write d5/fd [1476803,54363] 0 2024-09-19T09:02:43.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/45: link d3/cf d3/c11 0 2024-09-19T09:02:43.428 INFO:tasks.workunit.client.0.smithi049.stdout:9/46: read - d3/f10 zero size 2024-09-19T09:02:43.433 INFO:tasks.workunit.client.0.smithi049.stdout:4/41: mknod d4/c7 0 2024-09-19T09:02:43.433 INFO:tasks.workunit.client.0.smithi049.stdout:9/47: write d3/f10 [861370,93819] 0 2024-09-19T09:02:43.434 INFO:tasks.workunit.client.0.smithi049.stdout:1/65: chown d5/d6/fa 5321670 1 2024-09-19T09:02:43.434 INFO:tasks.workunit.client.1.smithi102.stdout:2/642: truncate d7/d1a/f71 618944 0 2024-09-19T09:02:43.434 INFO:tasks.workunit.client.1.smithi102.stdout:2/643: fsync d7/f9 0 2024-09-19T09:02:43.434 INFO:tasks.workunit.client.1.smithi102.stdout:2/644: chown d7/d1a/d2b/d31/d51/f55 248 1 2024-09-19T09:02:43.435 INFO:tasks.workunit.client.0.smithi049.stdout:2/31: truncate d1/d2/f6 3329178 0 2024-09-19T09:02:43.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/66: rename d5 to d5/dd/d11 22 2024-09-19T09:02:43.436 INFO:tasks.workunit.client.0.smithi049.stdout:0/107: dwrite d5/f11 [0,4194304] 0 2024-09-19T09:02:43.437 INFO:tasks.workunit.client.0.smithi049.stdout:2/32: write d1/f7 [716017,74433] 0 2024-09-19T09:02:43.443 INFO:tasks.workunit.client.1.smithi102.stdout:1/711: symlink dd/d13/leb 0 2024-09-19T09:02:43.443 INFO:tasks.workunit.client.1.smithi102.stdout:7/783: fdatasync d1/d3/d34/db4/fed 0 2024-09-19T09:02:43.447 INFO:tasks.workunit.client.0.smithi049.stdout:1/67: dread d5/d6/fa [0,4194304] 0 2024-09-19T09:02:43.449 INFO:tasks.workunit.client.0.smithi049.stdout:0/108: dwrite d5/fd [0,4194304] 0 2024-09-19T09:02:43.451 INFO:tasks.workunit.client.1.smithi102.stdout:6/641: symlink d1/d26/d2e/d45/d47/d4d/dd9/ldf 0 2024-09-19T09:02:43.451 INFO:tasks.workunit.client.0.smithi049.stdout:1/68: write d5/d6/f10 [253002,22042] 0 2024-09-19T09:02:43.452 INFO:tasks.workunit.client.0.smithi049.stdout:3/36: symlink l8 0 2024-09-19T09:02:43.452 INFO:tasks.workunit.client.0.smithi049.stdout:3/37: dread - f6 zero size 2024-09-19T09:02:43.455 INFO:tasks.workunit.client.1.smithi102.stdout:9/711: mknod d1/ceb 0 2024-09-19T09:02:43.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/69: dread d5/d6/f7 [0,4194304] 0 2024-09-19T09:02:43.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/70: dread d5/d6/f7 [0,4194304] 0 2024-09-19T09:02:43.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/33: creat dc/fd x:0 0 0 2024-09-19T09:02:43.469 INFO:tasks.workunit.client.0.smithi049.stdout:4/42: mknod d4/c8 0 2024-09-19T09:02:43.472 INFO:tasks.workunit.client.1.smithi102.stdout:3/831: dwrite d2/f1d [0,4194304] 0 2024-09-19T09:02:43.474 INFO:tasks.workunit.client.1.smithi102.stdout:7/784: unlink d1/d4/dca/fb9 0 2024-09-19T09:02:43.475 INFO:tasks.workunit.client.0.smithi049.stdout:7/78: dwrite d1/d8/f12 [4194304,4194304] 0 2024-09-19T09:02:43.477 INFO:tasks.workunit.client.1.smithi102.stdout:1/712: readlink dd/d14/d35/d49/d62/d6c/lce 0 2024-09-19T09:02:43.477 INFO:tasks.workunit.client.0.smithi049.stdout:4/43: dread d4/f5 [0,4194304] 0 2024-09-19T09:02:43.478 INFO:tasks.workunit.client.1.smithi102.stdout:1/713: write dd/d7a/fd4 [484510,92885] 0 2024-09-19T09:02:43.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/44: write f0 [4509564,68507] 0 2024-09-19T09:02:43.480 INFO:tasks.workunit.client.1.smithi102.stdout:2/645: dread d7/ff [0,4194304] 0 2024-09-19T09:02:43.481 INFO:tasks.workunit.client.1.smithi102.stdout:8/663: link d0/d10/c20 d0/d10/d9b/cd2 0 2024-09-19T09:02:43.481 INFO:tasks.workunit.client.1.smithi102.stdout:2/646: write d7/f9 [3865986,85412] 0 2024-09-19T09:02:43.486 INFO:tasks.workunit.client.0.smithi049.stdout:2/33: creat d1/d2/fa x:0 0 0 2024-09-19T09:02:43.487 INFO:tasks.workunit.client.1.smithi102.stdout:5/727: link d5/d60/fc3 d5/d7b/fe2 0 2024-09-19T09:02:43.488 INFO:tasks.workunit.client.0.smithi049.stdout:2/34: write d1/d2/fa [980200,28720] 0 2024-09-19T09:02:43.488 INFO:tasks.workunit.client.1.smithi102.stdout:5/728: write d5/d7/d1a/d37/d39/d4c/fb4 [613099,69095] 0 2024-09-19T09:02:43.489 INFO:tasks.workunit.client.1.smithi102.stdout:5/729: chown d5/d7/d1a/de1/fda 130 1 2024-09-19T09:02:43.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/109: rename d5/fc to d5/d10/d13/d15/f1b 0 2024-09-19T09:02:43.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/38: symlink l9 0 2024-09-19T09:02:43.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/39: fsync f6 0 2024-09-19T09:02:43.497 INFO:tasks.workunit.client.0.smithi049.stdout:3/40: fsync f6 0 2024-09-19T09:02:43.498 INFO:tasks.workunit.client.1.smithi102.stdout:4/845: link d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/f8a d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/dfb/f10e 0 2024-09-19T09:02:43.501 INFO:tasks.workunit.client.1.smithi102.stdout:6/642: dwrite d1/d26/d2e/d45/daf/d8d/f9c [0,4194304] 0 2024-09-19T09:02:43.503 INFO:tasks.workunit.client.1.smithi102.stdout:0/853: rename d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/d7a to d3/dd/d1a/d32/d117 0 2024-09-19T09:02:43.508 INFO:tasks.workunit.client.0.smithi049.stdout:1/71: dwrite f3 [0,4194304] 0 2024-09-19T09:02:43.511 INFO:tasks.workunit.client.1.smithi102.stdout:8/664: dwrite d0/db/d1d/f8d [0,4194304] 0 2024-09-19T09:02:43.512 INFO:tasks.workunit.client.1.smithi102.stdout:8/665: readlink d0/db/d1d/l38 0 2024-09-19T09:02:43.514 INFO:tasks.workunit.client.0.smithi049.stdout:4/45: rename d4/c8 to d4/c9 0 2024-09-19T09:02:43.516 INFO:tasks.workunit.client.1.smithi102.stdout:5/730: creat d5/d7/d1a/d42/fe3 x:0 0 0 2024-09-19T09:02:43.519 INFO:tasks.workunit.client.1.smithi102.stdout:9/712: mknod d1/d2/d3/d6f/dde/cec 0 2024-09-19T09:02:43.527 INFO:tasks.workunit.client.0.smithi049.stdout:4/46: dwrite d4/f6 [0,4194304] 0 2024-09-19T09:02:43.528 INFO:tasks.workunit.client.1.smithi102.stdout:1/714: rename dd/d14/d35/d49/d62/d6c/d99/fe5 to dd/d14/d35/d49/fec 0 2024-09-19T09:02:43.530 INFO:tasks.workunit.client.1.smithi102.stdout:0/854: read d3/dd/d1a/fa6 [260742,31952] 0 2024-09-19T09:02:43.530 INFO:tasks.workunit.client.0.smithi049.stdout:3/41: truncate f5 2357 0 2024-09-19T09:02:43.531 INFO:tasks.workunit.client.0.smithi049.stdout:3/42: stat l8 0 2024-09-19T09:02:43.532 INFO:tasks.workunit.client.0.smithi049.stdout:3/43: dread - f6 zero size 2024-09-19T09:02:43.532 INFO:tasks.workunit.client.1.smithi102.stdout:3/832: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/dde/f108 x:0 0 0 2024-09-19T09:02:43.535 INFO:tasks.workunit.client.0.smithi049.stdout:3/44: write f6 [108675,36554] 0 2024-09-19T09:02:43.535 INFO:tasks.workunit.client.0.smithi049.stdout:4/47: dread f0 [0,4194304] 0 2024-09-19T09:02:43.535 INFO:tasks.workunit.client.0.smithi049.stdout:3/45: readlink l9 0 2024-09-19T09:02:43.541 INFO:tasks.workunit.client.1.smithi102.stdout:5/731: unlink d5/d7/d1b/fd0 0 2024-09-19T09:02:43.544 INFO:tasks.workunit.client.0.smithi049.stdout:4/48: dwrite d4/f6 [0,4194304] 0 2024-09-19T09:02:43.546 INFO:tasks.workunit.client.0.smithi049.stdout:4/49: truncate f2 4648889 0 2024-09-19T09:02:43.548 INFO:tasks.workunit.client.0.smithi049.stdout:0/110: getdents d5/d10/d13/d19 0 2024-09-19T09:02:43.548 INFO:tasks.workunit.client.1.smithi102.stdout:6/643: creat d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/fe0 x:0 0 0 2024-09-19T09:02:43.551 INFO:tasks.workunit.client.1.smithi102.stdout:4/846: rename d14/d34/d5a/f105 to d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/f10f 0 2024-09-19T09:02:43.555 INFO:tasks.workunit.client.0.smithi049.stdout:9/48: getdents d3 0 2024-09-19T09:02:43.555 INFO:tasks.workunit.client.1.smithi102.stdout:0/855: truncate d3/dd/d1a/d32/d7f/d10c/d37/d39/fa5 380624 0 2024-09-19T09:02:43.555 INFO:tasks.workunit.client.0.smithi049.stdout:9/49: stat d3/cf 0 2024-09-19T09:02:43.557 INFO:tasks.workunit.client.1.smithi102.stdout:3/833: creat d2/d19/d1c/d2f/d5a/d84/d64/f109 x:0 0 0 2024-09-19T09:02:43.558 INFO:tasks.workunit.client.1.smithi102.stdout:2/647: link d7/d12/d37/daf/c5b d7/d12/d37/d93/cdf 0 2024-09-19T09:02:43.560 INFO:tasks.workunit.client.1.smithi102.stdout:8/666: mkdir d0/dd3 0 2024-09-19T09:02:43.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/50: unlink f3 0 2024-09-19T09:02:43.564 INFO:tasks.workunit.client.0.smithi049.stdout:7/79: rename d1/d8/cc to d1/c1b 0 2024-09-19T09:02:43.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/50: rename d3 to d3/d12 22 2024-09-19T09:02:43.565 INFO:tasks.workunit.client.0.smithi049.stdout:7/80: dread - d1/d7/fa zero size 2024-09-19T09:02:43.566 INFO:tasks.workunit.client.1.smithi102.stdout:6/644: creat d1/d26/d2e/d45/d47/d4d/d35/d79/fe1 x:0 0 0 2024-09-19T09:02:43.566 INFO:tasks.workunit.client.1.smithi102.stdout:6/645: readlink d1/d18/l9b 0 2024-09-19T09:02:43.567 INFO:tasks.workunit.client.0.smithi049.stdout:0/111: creat d5/d10/d13/f1c x:0 0 0 2024-09-19T09:02:43.568 INFO:tasks.workunit.client.0.smithi049.stdout:0/112: dread - d5/d10/d13/f1c zero size 2024-09-19T09:02:43.570 INFO:tasks.workunit.client.0.smithi049.stdout:0/113: write d5/d10/d13/d15/f18 [275245,93400] 0 2024-09-19T09:02:43.573 INFO:tasks.workunit.client.1.smithi102.stdout:4/847: mkdir d14/d16/d1d/d110 0 2024-09-19T09:02:43.573 INFO:tasks.workunit.client.1.smithi102.stdout:2/648: dread d7/d1a/d2b/f35 [0,4194304] 0 2024-09-19T09:02:43.575 INFO:tasks.workunit.client.0.smithi049.stdout:8/103: link d1/d1a/l1c d1/d1a/l1f 0 2024-09-19T09:02:43.578 INFO:tasks.workunit.client.1.smithi102.stdout:0/856: mknod d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd/c118 0 2024-09-19T09:02:43.579 INFO:tasks.workunit.client.0.smithi049.stdout:2/35: getdents d1/d2 0 2024-09-19T09:02:43.579 INFO:tasks.workunit.client.1.smithi102.stdout:0/857: stat d3/dd/d10/d15/d19/d8d/lfb 0 2024-09-19T09:02:43.580 INFO:tasks.workunit.client.1.smithi102.stdout:0/858: fsync d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/de5/fe1 0 2024-09-19T09:02:43.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/51: fsync d3/f8 0 2024-09-19T09:02:43.585 INFO:tasks.workunit.client.0.smithi049.stdout:7/81: read d1/f2 [3970423,19155] 0 2024-09-19T09:02:43.586 INFO:tasks.workunit.client.0.smithi049.stdout:0/114: creat d5/d10/f1d x:0 0 0 2024-09-19T09:02:43.587 INFO:tasks.workunit.client.0.smithi049.stdout:0/115: read d5/d10/d13/d15/f1b [3097643,21224] 0 2024-09-19T09:02:43.589 INFO:tasks.workunit.client.0.smithi049.stdout:8/104: symlink d1/d1a/l20 0 2024-09-19T09:02:43.590 INFO:tasks.workunit.client.0.smithi049.stdout:0/116: dread d5/ff [0,4194304] 0 2024-09-19T09:02:43.590 INFO:tasks.workunit.client.1.smithi102.stdout:1/715: creat dd/d7a/fed x:0 0 0 2024-09-19T09:02:43.591 INFO:tasks.workunit.client.1.smithi102.stdout:2/649: mknod d7/d50/d64/da1/dd6/ce0 0 2024-09-19T09:02:43.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/117: dread d5/ff [0,4194304] 0 2024-09-19T09:02:43.593 INFO:tasks.workunit.client.1.smithi102.stdout:0/859: dread d3/dd/d1a/d32/d7f/d10c/d82/fe7 [0,4194304] 0 2024-09-19T09:02:43.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/82: truncate d1/f2 4343787 0 2024-09-19T09:02:43.599 INFO:tasks.workunit.client.1.smithi102.stdout:1/716: readlink dd/d14/l61 0 2024-09-19T09:02:43.600 INFO:tasks.workunit.client.0.smithi049.stdout:3/46: dread f5 [0,4194304] 0 2024-09-19T09:02:43.602 INFO:tasks.workunit.client.0.smithi049.stdout:9/52: write d3/f7 [1565074,98620] 0 2024-09-19T09:02:43.602 INFO:tasks.workunit.client.1.smithi102.stdout:6/646: dread d1/d26/d2e/d45/d47/d4d/d35/d79/fc7 [0,4194304] 0 2024-09-19T09:02:43.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/53: stat d3/l4 0 2024-09-19T09:02:43.603 INFO:tasks.workunit.client.1.smithi102.stdout:6/647: chown d1/d18/db/d65 14 1 2024-09-19T09:02:43.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/118: creat d5/d10/d13/d15/f1e x:0 0 0 2024-09-19T09:02:43.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/51: fdatasync d4/f6 0 2024-09-19T09:02:43.605 INFO:tasks.workunit.client.1.smithi102.stdout:3/834: creat d2/d19/d1c/d2f/d5a/d84/f10a x:0 0 0 2024-09-19T09:02:43.606 INFO:tasks.workunit.client.1.smithi102.stdout:3/835: write d2/d19/d1c/fe8 [896217,3014] 0 2024-09-19T09:02:43.607 INFO:tasks.workunit.client.1.smithi102.stdout:3/836: readlink d2/d19/d1c/d2f/d5a/l5b 0 2024-09-19T09:02:43.610 INFO:tasks.workunit.client.0.smithi049.stdout:7/83: fdatasync d1/d7/f14 0 2024-09-19T09:02:43.611 INFO:tasks.workunit.client.1.smithi102.stdout:8/667: mkdir d0/d10/d21/d39/d50/dd4 0 2024-09-19T09:02:43.621 INFO:tasks.workunit.client.0.smithi049.stdout:4/52: mknod d4/ca 0 2024-09-19T09:02:43.623 INFO:tasks.workunit.client.0.smithi049.stdout:7/84: creat d1/d8/f1c x:0 0 0 2024-09-19T09:02:43.624 INFO:tasks.workunit.client.0.smithi049.stdout:9/54: dwrite f1 [4194304,4194304] 0 2024-09-19T09:02:43.624 INFO:tasks.workunit.client.0.smithi049.stdout:8/105: creat d1/f21 x:0 0 0 2024-09-19T09:02:43.626 INFO:tasks.workunit.client.0.smithi049.stdout:8/106: write d1/f15 [800674,15240] 0 2024-09-19T09:02:43.627 INFO:tasks.workunit.client.0.smithi049.stdout:2/36: getdents d1 0 2024-09-19T09:02:43.631 INFO:tasks.workunit.client.0.smithi049.stdout:9/55: creat d3/f13 x:0 0 0 2024-09-19T09:02:43.632 INFO:tasks.workunit.client.0.smithi049.stdout:3/47: link l9 la 0 2024-09-19T09:02:43.634 INFO:tasks.workunit.client.1.smithi102.stdout:7/785: sync 2024-09-19T09:02:43.635 INFO:tasks.workunit.client.1.smithi102.stdout:4/848: creat d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/dfb/f111 x:0 0 0 2024-09-19T09:02:43.635 INFO:tasks.workunit.client.1.smithi102.stdout:6/648: creat d1/d26/d2e/d45/daf/d8d/fe2 x:0 0 0 2024-09-19T09:02:43.636 INFO:tasks.workunit.client.0.smithi049.stdout:2/37: creat d1/d4/fb x:0 0 0 2024-09-19T09:02:43.636 INFO:tasks.workunit.client.1.smithi102.stdout:3/837: rename d2/d19/d47/f89 to d2/d19/d47/db/f10b 0 2024-09-19T09:02:43.636 INFO:tasks.workunit.client.0.smithi049.stdout:0/119: link d5/l6 d5/d10/d13/d15/l1f 0 2024-09-19T09:02:43.637 INFO:tasks.workunit.client.1.smithi102.stdout:2/650: dread d7/d1a/f8f [0,4194304] 0 2024-09-19T09:02:43.638 INFO:tasks.workunit.client.0.smithi049.stdout:2/38: stat d1/f7 0 2024-09-19T09:02:43.639 INFO:tasks.workunit.client.1.smithi102.stdout:4/849: read - d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/f104 zero size 2024-09-19T09:02:43.640 INFO:tasks.workunit.client.0.smithi049.stdout:2/39: chown d1/d4 3264 1 2024-09-19T09:02:43.640 INFO:tasks.workunit.client.1.smithi102.stdout:3/838: chown d2/d19/d1c/d2f/d5a/d84/d4f/f85 25 1 2024-09-19T09:02:43.642 INFO:tasks.workunit.client.1.smithi102.stdout:2/651: mkdir d7/d12/de1 0 2024-09-19T09:02:43.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/56: dwrite f1 [0,4194304] 0 2024-09-19T09:02:43.644 INFO:tasks.workunit.client.0.smithi049.stdout:3/48: rename c3 to cb 0 2024-09-19T09:02:43.645 INFO:tasks.workunit.client.1.smithi102.stdout:8/668: dwrite d0/d10/d21/f43 [4194304,4194304] 0 2024-09-19T09:02:43.645 INFO:tasks.workunit.client.1.smithi102.stdout:0/860: getdents d3/dd/d10/d15/d2c 0 2024-09-19T09:02:43.647 INFO:tasks.workunit.client.1.smithi102.stdout:8/669: stat d0/d10/f2d 0 2024-09-19T09:02:43.648 INFO:tasks.workunit.client.1.smithi102.stdout:3/839: mkdir d2/d10c 0 2024-09-19T09:02:43.648 INFO:tasks.workunit.client.1.smithi102.stdout:6/649: dwrite d1/d26/d2e/d45/daf/d8d/f9f [0,4194304] 0 2024-09-19T09:02:43.649 INFO:tasks.workunit.client.0.smithi049.stdout:8/107: dwrite d1/d11/f17 [0,4194304] 0 2024-09-19T09:02:43.651 INFO:tasks.workunit.client.1.smithi102.stdout:8/670: fsync d0/d10/d21/d39/d50/d63/d83/fd0 0 2024-09-19T09:02:43.653 INFO:tasks.workunit.client.1.smithi102.stdout:3/840: fdatasync d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/faa 0 2024-09-19T09:02:43.654 INFO:tasks.workunit.client.1.smithi102.stdout:0/861: dread d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/de5/fe1 [0,4194304] 0 2024-09-19T09:02:43.654 INFO:tasks.workunit.client.1.smithi102.stdout:3/841: readlink d2/d19/d1c/d2f/d5a/d84/l6e 0 2024-09-19T09:02:43.654 INFO:tasks.workunit.client.1.smithi102.stdout:2/652: mkdir d7/d1a/d2b/dab/de2 0 2024-09-19T09:02:43.654 INFO:tasks.workunit.client.0.smithi049.stdout:4/53: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:43.655 INFO:tasks.workunit.client.1.smithi102.stdout:3/842: stat d2/d19 0 2024-09-19T09:02:43.657 INFO:tasks.workunit.client.1.smithi102.stdout:7/786: dread d1/d4/dca/d52/f65 [0,4194304] 0 2024-09-19T09:02:43.657 INFO:tasks.workunit.client.1.smithi102.stdout:7/787: dread - d1/fdd zero size 2024-09-19T09:02:43.659 INFO:tasks.workunit.client.0.smithi049.stdout:0/120: dwrite d5/fa [0,4194304] 0 2024-09-19T09:02:43.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/49: creat fc x:0 0 0 2024-09-19T09:02:43.662 INFO:tasks.workunit.client.0.smithi049.stdout:8/108: chown d1/la 1777354 1 2024-09-19T09:02:43.663 INFO:tasks.workunit.client.0.smithi049.stdout:7/85: getdents d1/d8 0 2024-09-19T09:02:43.665 INFO:tasks.workunit.client.0.smithi049.stdout:0/121: truncate d5/d10/f1d 46757 0 2024-09-19T09:02:43.668 INFO:tasks.workunit.client.0.smithi049.stdout:4/54: rename d4/ca to d4/cb 0 2024-09-19T09:02:43.668 INFO:tasks.workunit.client.0.smithi049.stdout:9/57: dread d3/f8 [0,4194304] 0 2024-09-19T09:02:43.669 INFO:tasks.workunit.client.1.smithi102.stdout:6/650: mknod d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/ce3 0 2024-09-19T09:02:43.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/55: read f0 [3215897,3180] 0 2024-09-19T09:02:43.670 INFO:tasks.workunit.client.0.smithi049.stdout:2/40: truncate d1/d2/f6 2919063 0 2024-09-19T09:02:43.670 INFO:tasks.workunit.client.1.smithi102.stdout:8/671: dread - d0/db/d29/fba zero size 2024-09-19T09:02:43.670 INFO:tasks.workunit.client.1.smithi102.stdout:6/651: fdatasync d1/fc 0 2024-09-19T09:02:43.671 INFO:tasks.workunit.client.1.smithi102.stdout:8/672: write d0/fd [5278980,128115] 0 2024-09-19T09:02:43.671 INFO:tasks.workunit.client.1.smithi102.stdout:6/652: write d1/d26/d4b/d94/f8b [1097100,80177] 0 2024-09-19T09:02:43.675 INFO:tasks.workunit.client.0.smithi049.stdout:7/86: rmdir d1/d7/d13 39 2024-09-19T09:02:43.677 INFO:tasks.workunit.client.1.smithi102.stdout:2/653: fsync d7/d1a/d2b/d31/f80 0 2024-09-19T09:02:43.677 INFO:tasks.workunit.client.0.smithi049.stdout:7/87: chown d1/d7/f14 5095 1 2024-09-19T09:02:43.679 INFO:tasks.workunit.client.0.smithi049.stdout:0/122: stat d5/l6 0 2024-09-19T09:02:43.680 INFO:tasks.workunit.client.1.smithi102.stdout:4/850: link d14/f15 d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/f112 0 2024-09-19T09:02:43.682 INFO:tasks.workunit.client.0.smithi049.stdout:9/58: mkdir d3/d14 0 2024-09-19T09:02:43.683 INFO:tasks.workunit.client.0.smithi049.stdout:9/59: chown d3/lc 0 1 2024-09-19T09:02:43.683 INFO:tasks.workunit.client.1.smithi102.stdout:2/654: dwrite d7/d12/d37/daf/f9d [4194304,4194304] 0 2024-09-19T09:02:43.685 INFO:tasks.workunit.client.1.smithi102.stdout:3/843: dread d2/d19/d1c/d2f/d5a/d84/f91 [0,4194304] 0 2024-09-19T09:02:43.688 INFO:tasks.workunit.client.0.smithi049.stdout:8/109: mknod d1/c22 0 2024-09-19T09:02:43.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/56: rename f1 to d4/fc 0 2024-09-19T09:02:43.693 INFO:tasks.workunit.client.1.smithi102.stdout:6/653: symlink d1/d26/d2e/d45/dac/db2/le4 0 2024-09-19T09:02:43.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/88: readlink d1/l11 0 2024-09-19T09:02:43.694 INFO:tasks.workunit.client.1.smithi102.stdout:3/844: dwrite d2/d19/d1c/d2f/d5a/d84/ffb [0,4194304] 0 2024-09-19T09:02:43.697 INFO:tasks.workunit.client.0.smithi049.stdout:0/123: creat d5/f20 x:0 0 0 2024-09-19T09:02:43.698 INFO:tasks.workunit.client.0.smithi049.stdout:0/124: rename d5/d10/d13 to d5/d10/d13/d21 22 2024-09-19T09:02:43.699 INFO:tasks.workunit.client.1.smithi102.stdout:8/673: dwrite d0/f96 [0,4194304] 0 2024-09-19T09:02:43.700 INFO:tasks.workunit.client.0.smithi049.stdout:9/60: creat d3/f15 x:0 0 0 2024-09-19T09:02:43.701 INFO:tasks.workunit.client.1.smithi102.stdout:8/674: write d0/d10/d21/d39/d50/d63/fca [596821,51750] 0 2024-09-19T09:02:43.702 INFO:tasks.workunit.client.1.smithi102.stdout:4/851: unlink d14/d16/d17/de3/dbd/df3/d37/d58/de2/le5 0 2024-09-19T09:02:43.705 INFO:tasks.workunit.client.0.smithi049.stdout:7/89: dwrite d1/d8/f1c [0,4194304] 0 2024-09-19T09:02:43.705 INFO:tasks.workunit.client.0.smithi049.stdout:9/61: truncate d3/f10 1719195 0 2024-09-19T09:02:43.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/62: write d3/f7 [2057477,64980] 0 2024-09-19T09:02:43.708 INFO:tasks.workunit.client.1.smithi102.stdout:0/862: dread d3/dd/d1a/d32/d7f/d10c/d37/d3d/d90/fb0 [0,4194304] 0 2024-09-19T09:02:43.713 INFO:tasks.workunit.client.1.smithi102.stdout:7/788: link d1/d4/dca/l30 d1/d3/d72/lf1 0 2024-09-19T09:02:43.714 INFO:tasks.workunit.client.1.smithi102.stdout:9/713: sync 2024-09-19T09:02:43.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/125: mknod d5/d10/d13/d15/c22 0 2024-09-19T09:02:43.718 INFO:tasks.workunit.client.1.smithi102.stdout:3/845: mkdir d2/d19/d1c/d2f/d5a/d84/d4f/d72/d10d 0 2024-09-19T09:02:43.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/63: unlink d3/lb 0 2024-09-19T09:02:43.721 INFO:tasks.workunit.client.1.smithi102.stdout:7/789: dwrite d1/d4/dca/d52/f58 [0,4194304] 0 2024-09-19T09:02:43.721 INFO:tasks.workunit.client.0.smithi049.stdout:3/50: dwrite f5 [0,4194304] 0 2024-09-19T09:02:43.723 INFO:tasks.workunit.client.1.smithi102.stdout:4/852: creat d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/f113 x:0 0 0 2024-09-19T09:02:43.725 INFO:tasks.workunit.client.1.smithi102.stdout:7/790: dread d1/d3/d20/d6c/fee [0,4194304] 0 2024-09-19T09:02:43.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/41: dread f0 [0,4194304] 0 2024-09-19T09:02:43.727 INFO:tasks.workunit.client.1.smithi102.stdout:2/655: getdents d7/d1a/d2b/dae/dbe 0 2024-09-19T09:02:43.729 INFO:tasks.workunit.client.0.smithi049.stdout:8/110: dwrite d1/ff [0,4194304] 0 2024-09-19T09:02:43.735 INFO:tasks.workunit.client.1.smithi102.stdout:0/863: mkdir d3/dd/d10/d84/d119 0 2024-09-19T09:02:43.739 INFO:tasks.workunit.client.0.smithi049.stdout:4/57: rename d4/c9 to d4/cd 0 2024-09-19T09:02:43.739 INFO:tasks.workunit.client.1.smithi102.stdout:6/654: link d1/d26/d4b/f51 d1/d26/d2e/d70/fe5 0 2024-09-19T09:02:43.740 INFO:tasks.workunit.client.1.smithi102.stdout:6/655: stat d1/d18 0 2024-09-19T09:02:43.740 INFO:tasks.workunit.client.0.smithi049.stdout:7/90: rename d1/f3 to d1/d1a/f1d 0 2024-09-19T09:02:43.742 INFO:tasks.workunit.client.0.smithi049.stdout:9/64: mknod d3/c16 0 2024-09-19T09:02:43.743 INFO:tasks.workunit.client.1.smithi102.stdout:9/714: mkdir d1/d2/d3/d1d/d4f/ded 0 2024-09-19T09:02:43.746 INFO:tasks.workunit.client.0.smithi049.stdout:3/51: stat l9 0 2024-09-19T09:02:43.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/91: dread - d1/d7/fa zero size 2024-09-19T09:02:43.746 INFO:tasks.workunit.client.0.smithi049.stdout:9/65: dread - d3/f15 zero size 2024-09-19T09:02:43.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/111: dwrite d1/d11/f12 [0,4194304] 0 2024-09-19T09:02:43.747 INFO:tasks.workunit.client.1.smithi102.stdout:8/675: symlink d0/d4f/daa/ld5 0 2024-09-19T09:02:43.750 INFO:tasks.workunit.client.0.smithi049.stdout:2/42: dwrite d1/d4/fb [0,4194304] 0 2024-09-19T09:02:43.751 INFO:tasks.workunit.client.0.smithi049.stdout:8/112: readlink d1/d1a/l1c 0 2024-09-19T09:02:43.751 INFO:tasks.workunit.client.0.smithi049.stdout:2/43: readlink d1/l9 0 2024-09-19T09:02:43.752 INFO:tasks.workunit.client.1.smithi102.stdout:9/715: dread d1/d2/d3/f3c [0,4194304] 0 2024-09-19T09:02:43.752 INFO:tasks.workunit.client.1.smithi102.stdout:4/853: symlink d14/d16/dd5/l114 0 2024-09-19T09:02:43.754 INFO:tasks.workunit.client.1.smithi102.stdout:9/716: stat d1/d2/d3/d1d/d4f/d6d/d81/dd3/ld6 0 2024-09-19T09:02:43.754 INFO:tasks.workunit.client.1.smithi102.stdout:8/676: dwrite d0/d10/f37 [4194304,4194304] 0 2024-09-19T09:02:43.755 INFO:tasks.workunit.client.1.smithi102.stdout:9/717: write d1/d8/f5f [1846861,10085] 0 2024-09-19T09:02:43.756 INFO:tasks.workunit.client.1.smithi102.stdout:4/854: write d14/d34/d5a/d5c/d81/d75/df0/f10d [186302,53028] 0 2024-09-19T09:02:43.758 INFO:tasks.workunit.client.1.smithi102.stdout:9/718: chown d1/d2/d3/d6f/dcb 919 1 2024-09-19T09:02:43.758 INFO:tasks.workunit.client.0.smithi049.stdout:4/58: creat d4/fe x:0 0 0 2024-09-19T09:02:43.759 INFO:tasks.workunit.client.1.smithi102.stdout:6/656: unlink d1/d26/d2e/d45/d47/d4d/d35/d41/c53 0 2024-09-19T09:02:43.759 INFO:tasks.workunit.client.0.smithi049.stdout:2/44: dread d1/f7 [0,4194304] 0 2024-09-19T09:02:43.761 INFO:tasks.workunit.client.0.smithi049.stdout:0/126: mknod d5/d10/d13/d19/c23 0 2024-09-19T09:02:43.762 INFO:tasks.workunit.client.0.smithi049.stdout:3/52: creat fd x:0 0 0 2024-09-19T09:02:43.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/127: truncate d5/d10/f1d 96741 0 2024-09-19T09:02:43.764 INFO:tasks.workunit.client.1.smithi102.stdout:2/656: dwrite d7/fcd [0,4194304] 0 2024-09-19T09:02:43.766 INFO:tasks.workunit.client.0.smithi049.stdout:9/66: unlink d3/f8 0 2024-09-19T09:02:43.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/92: write d1/d7/d13/f16 [3578656,116711] 0 2024-09-19T09:02:43.770 INFO:tasks.workunit.client.0.smithi049.stdout:9/67: write d3/f7 [2197771,109432] 0 2024-09-19T09:02:43.771 INFO:tasks.workunit.client.0.smithi049.stdout:8/113: rmdir d1/d11 39 2024-09-19T09:02:43.772 INFO:tasks.workunit.client.0.smithi049.stdout:9/68: fsync d3/f10 0 2024-09-19T09:02:43.772 INFO:tasks.workunit.client.1.smithi102.stdout:4/855: unlink d14/d16/dd5/ff6 0 2024-09-19T09:02:43.773 INFO:tasks.workunit.client.0.smithi049.stdout:8/114: readlink d1/l18 0 2024-09-19T09:02:43.773 INFO:tasks.workunit.client.1.smithi102.stdout:4/856: write d14/d34/d5a/d5c/f84 [4262065,18419] 0 2024-09-19T09:02:43.774 INFO:tasks.workunit.client.0.smithi049.stdout:8/115: write d1/ff [5151727,103941] 0 2024-09-19T09:02:43.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/53: dwrite f5 [4194304,4194304] 0 2024-09-19T09:02:43.777 INFO:tasks.workunit.client.0.smithi049.stdout:2/45: creat d1/d4/fc x:0 0 0 2024-09-19T09:02:43.782 INFO:tasks.workunit.client.1.smithi102.stdout:6/657: mkdir d1/d26/d2e/dce/de6 0 2024-09-19T09:02:43.785 INFO:tasks.workunit.client.1.smithi102.stdout:3/846: symlink d2/d19/d47/l10e 0 2024-09-19T09:02:43.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/93: mknod d1/d1a/c1e 0 2024-09-19T09:02:43.792 INFO:tasks.workunit.client.0.smithi049.stdout:9/69: creat d3/f17 x:0 0 0 2024-09-19T09:02:43.794 INFO:tasks.workunit.client.1.smithi102.stdout:7/791: rename d1/d2f/d95 to d1/d4/dca/d52/d7f/da5/df2 0 2024-09-19T09:02:43.798 INFO:tasks.workunit.client.0.smithi049.stdout:4/59: truncate d4/fc 361466 0 2024-09-19T09:02:43.800 INFO:tasks.workunit.client.0.smithi049.stdout:3/54: creat fe x:0 0 0 2024-09-19T09:02:43.802 INFO:tasks.workunit.client.0.smithi049.stdout:2/46: creat d1/fd x:0 0 0 2024-09-19T09:02:43.802 INFO:tasks.workunit.client.0.smithi049.stdout:2/47: readlink d1/l9 0 2024-09-19T09:02:43.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/60: symlink d4/lf 0 2024-09-19T09:02:43.806 INFO:tasks.workunit.client.0.smithi049.stdout:3/55: creat ff x:0 0 0 2024-09-19T09:02:43.807 INFO:tasks.workunit.client.0.smithi049.stdout:3/56: write fe [784132,10733] 0 2024-09-19T09:02:43.807 INFO:tasks.workunit.client.0.smithi049.stdout:2/48: dread d1/d4/fb [0,4194304] 0 2024-09-19T09:02:43.808 INFO:tasks.workunit.client.0.smithi049.stdout:7/94: mkdir d1/d1f 0 2024-09-19T09:02:43.809 INFO:tasks.workunit.client.0.smithi049.stdout:9/70: symlink d3/d14/l18 0 2024-09-19T09:02:43.810 INFO:tasks.workunit.client.0.smithi049.stdout:8/116: creat d1/f23 x:0 0 0 2024-09-19T09:02:43.810 INFO:tasks.workunit.client.0.smithi049.stdout:8/117: write d1/f15 [1905740,29853] 0 2024-09-19T09:02:43.812 INFO:tasks.workunit.client.0.smithi049.stdout:4/61: mknod d4/c10 0 2024-09-19T09:02:43.814 INFO:tasks.workunit.client.0.smithi049.stdout:0/128: getdents d5/d10/d13/d19 0 2024-09-19T09:02:43.814 INFO:tasks.workunit.client.0.smithi049.stdout:0/129: chown d5 187878 1 2024-09-19T09:02:43.815 INFO:tasks.workunit.client.0.smithi049.stdout:3/57: mkdir d10 0 2024-09-19T09:02:43.817 INFO:tasks.workunit.client.0.smithi049.stdout:7/95: symlink d1/d7/d13/l20 0 2024-09-19T09:02:43.818 INFO:tasks.workunit.client.0.smithi049.stdout:2/49: mknod d1/d4/ce 0 2024-09-19T09:02:43.818 INFO:tasks.workunit.client.0.smithi049.stdout:0/130: dread d5/d10/d13/d15/f1b [4194304,4194304] 0 2024-09-19T09:02:43.818 INFO:tasks.workunit.client.1.smithi102.stdout:5/732: sync 2024-09-19T09:02:43.818 INFO:tasks.workunit.client.1.smithi102.stdout:1/717: sync 2024-09-19T09:02:43.819 INFO:tasks.workunit.client.1.smithi102.stdout:2/657: mknod d7/d1a/d2b/ce3 0 2024-09-19T09:02:43.819 INFO:tasks.workunit.client.0.smithi049.stdout:9/71: unlink d3/f7 0 2024-09-19T09:02:43.820 INFO:tasks.workunit.client.0.smithi049.stdout:9/72: dread - d3/f13 zero size 2024-09-19T09:02:43.820 INFO:tasks.workunit.client.1.smithi102.stdout:9/719: creat d1/d2/d3/fee x:0 0 0 2024-09-19T09:02:43.821 INFO:tasks.workunit.client.0.smithi049.stdout:9/73: fsync d3/f17 0 2024-09-19T09:02:43.821 INFO:tasks.workunit.client.1.smithi102.stdout:3/847: dread d2/d19/d1c/ffe [0,4194304] 0 2024-09-19T09:02:43.821 INFO:tasks.workunit.client.0.smithi049.stdout:9/74: chown f1 2845 1 2024-09-19T09:02:43.822 INFO:tasks.workunit.client.1.smithi102.stdout:3/848: fsync d2/d1e/dcb/ff3 0 2024-09-19T09:02:43.823 INFO:tasks.workunit.client.0.smithi049.stdout:8/118: rename d1/c22 to d1/d1a/c24 0 2024-09-19T09:02:43.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/131: dread d5/fa [0,4194304] 0 2024-09-19T09:02:43.823 INFO:tasks.workunit.client.0.smithi049.stdout:9/75: read - d3/f17 zero size 2024-09-19T09:02:43.823 INFO:tasks.workunit.client.1.smithi102.stdout:6/658: dwrite d1/d26/d2e/d45/d47/d4d/d35/d79/fc7 [4194304,4194304] 0 2024-09-19T09:02:43.823 INFO:tasks.workunit.client.0.smithi049.stdout:8/119: stat d1/la 0 2024-09-19T09:02:43.824 INFO:tasks.workunit.client.0.smithi049.stdout:4/62: symlink d4/l11 0 2024-09-19T09:02:43.824 INFO:tasks.workunit.client.1.smithi102.stdout:6/659: truncate d1/d26/d4b/f7a 655473 0 2024-09-19T09:02:43.825 INFO:tasks.workunit.client.1.smithi102.stdout:7/792: mknod d1/d2f/cf3 0 2024-09-19T09:02:43.826 INFO:tasks.workunit.client.1.smithi102.stdout:6/660: read d1/d26/d2e/f5f [1380772,1808] 0 2024-09-19T09:02:43.826 INFO:tasks.workunit.client.1.smithi102.stdout:7/793: stat d1/d3/d20/d6c/l7a 0 2024-09-19T09:02:43.828 INFO:tasks.workunit.client.1.smithi102.stdout:5/733: mkdir d5/d60/db6/de4 0 2024-09-19T09:02:43.828 INFO:tasks.workunit.client.1.smithi102.stdout:7/794: chown d1/d4/dca/d52/d7f/da5/de2/df0 114953 1 2024-09-19T09:02:43.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/96: creat d1/d1a/f21 x:0 0 0 2024-09-19T09:02:43.829 INFO:tasks.workunit.client.1.smithi102.stdout:5/734: chown d5/d7/d1a/d37/d34/d7f/d91/cd3 2 1 2024-09-19T09:02:43.830 INFO:tasks.workunit.client.0.smithi049.stdout:7/97: write d1/d7/fa [700653,55727] 0 2024-09-19T09:02:43.831 INFO:tasks.workunit.client.1.smithi102.stdout:2/658: unlink d7/d50/d64/da1/dd6/lda 0 2024-09-19T09:02:43.833 INFO:tasks.workunit.client.0.smithi049.stdout:2/50: mknod d1/d2/cf 0 2024-09-19T09:02:43.835 INFO:tasks.workunit.client.0.smithi049.stdout:9/76: creat d3/d14/f19 x:0 0 0 2024-09-19T09:02:43.838 INFO:tasks.workunit.client.1.smithi102.stdout:8/677: link d0/cbd d0/d64/cd6 0 2024-09-19T09:02:43.838 INFO:tasks.workunit.client.1.smithi102.stdout:8/678: fsync d0/d4f/f81 0 2024-09-19T09:02:43.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/132: creat d5/d10/d13/d19/f24 x:0 0 0 2024-09-19T09:02:43.841 INFO:tasks.workunit.client.0.smithi049.stdout:2/51: dwrite d1/fd [0,4194304] 0 2024-09-19T09:02:43.842 INFO:tasks.workunit.client.1.smithi102.stdout:8/679: dread d0/d10/d21/d39/f59 [0,4194304] 0 2024-09-19T09:02:43.842 INFO:tasks.workunit.client.0.smithi049.stdout:4/63: creat d4/f12 x:0 0 0 2024-09-19T09:02:43.842 INFO:tasks.workunit.client.1.smithi102.stdout:8/680: chown d0/db/d1d/l38 294462 1 2024-09-19T09:02:43.843 INFO:tasks.workunit.client.0.smithi049.stdout:0/133: write d5/d10/d13/d15/f18 [446583,51607] 0 2024-09-19T09:02:43.843 INFO:tasks.workunit.client.1.smithi102.stdout:8/681: write d0/db/f89 [1809144,36333] 0 2024-09-19T09:02:43.844 INFO:tasks.workunit.client.1.smithi102.stdout:7/795: symlink d1/d3/d20/d6c/lf4 0 2024-09-19T09:02:43.845 INFO:tasks.workunit.client.1.smithi102.stdout:7/796: chown d1/d3/d20/f35 543143896 1 2024-09-19T09:02:43.845 INFO:tasks.workunit.client.0.smithi049.stdout:3/58: mkdir d10/d11 0 2024-09-19T09:02:43.847 INFO:tasks.workunit.client.0.smithi049.stdout:3/59: write fe [646240,11810] 0 2024-09-19T09:02:43.848 INFO:tasks.workunit.client.1.smithi102.stdout:5/735: symlink d5/d7/d1a/d37/d50/le5 0 2024-09-19T09:02:43.851 INFO:tasks.workunit.client.1.smithi102.stdout:9/720: getdents d1/d2/d3/d6f/d8d/da2/db6/de3 0 2024-09-19T09:02:43.851 INFO:tasks.workunit.client.1.smithi102.stdout:9/721: chown d1/d8/f56 242 1 2024-09-19T09:02:43.853 INFO:tasks.workunit.client.0.smithi049.stdout:9/77: mkdir d3/d14/d1a 0 2024-09-19T09:02:43.854 INFO:tasks.workunit.client.0.smithi049.stdout:8/120: rmdir d1/d11 39 2024-09-19T09:02:43.855 INFO:tasks.workunit.client.0.smithi049.stdout:9/78: truncate d3/f13 174918 0 2024-09-19T09:02:43.855 INFO:tasks.workunit.client.1.smithi102.stdout:6/661: creat d1/d18/d37/dda/fe7 x:0 0 0 2024-09-19T09:02:43.855 INFO:tasks.workunit.client.0.smithi049.stdout:9/79: dread - d3/d14/f19 zero size 2024-09-19T09:02:43.857 INFO:tasks.workunit.client.1.smithi102.stdout:8/682: mknod d0/d4f/daa/cd7 0 2024-09-19T09:02:43.859 INFO:tasks.workunit.client.0.smithi049.stdout:4/64: creat d4/f13 x:0 0 0 2024-09-19T09:02:43.859 INFO:tasks.workunit.client.0.smithi049.stdout:4/65: fsync d4/fe 0 2024-09-19T09:02:43.860 INFO:tasks.workunit.client.0.smithi049.stdout:0/134: fsync d5/d10/d13/d19/f24 0 2024-09-19T09:02:43.860 INFO:tasks.workunit.client.1.smithi102.stdout:2/659: symlink d7/d11/dc8/le4 0 2024-09-19T09:02:43.861 INFO:tasks.workunit.client.1.smithi102.stdout:5/736: symlink d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/le6 0 2024-09-19T09:02:43.862 INFO:tasks.workunit.client.1.smithi102.stdout:8/683: dwrite d0/d10/d21/f43 [0,4194304] 0 2024-09-19T09:02:43.864 INFO:tasks.workunit.client.1.smithi102.stdout:8/684: write d0/d10/d21/d39/d87/fab [627345,109982] 0 2024-09-19T09:02:43.864 INFO:tasks.workunit.client.1.smithi102.stdout:9/722: unlink d1/d2/d3/d6f/d8d/da2/fab 0 2024-09-19T09:02:43.866 INFO:tasks.workunit.client.1.smithi102.stdout:3/849: mkdir d2/d19/d47/db/dc3/d10f 0 2024-09-19T09:02:43.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/98: symlink d1/d1f/l22 0 2024-09-19T09:02:43.868 INFO:tasks.workunit.client.1.smithi102.stdout:6/662: write d1/d18/db/f1a [3395497,38269] 0 2024-09-19T09:02:43.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/121: chown d1/d1a/c24 61 1 2024-09-19T09:02:43.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/122: readlink d1/d1a/l1c 0 2024-09-19T09:02:43.871 INFO:tasks.workunit.client.0.smithi049.stdout:9/80: mknod d3/c1b 0 2024-09-19T09:02:43.873 INFO:tasks.workunit.client.1.smithi102.stdout:7/797: unlink d1/d4/dca/l30 0 2024-09-19T09:02:43.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/66: creat d4/f14 x:0 0 0 2024-09-19T09:02:43.874 INFO:tasks.workunit.client.1.smithi102.stdout:6/663: dwrite d1/d18/db/f10 [0,4194304] 0 2024-09-19T09:02:43.875 INFO:tasks.workunit.client.1.smithi102.stdout:2/660: unlink d7/d1a/lb7 0 2024-09-19T09:02:43.875 INFO:tasks.workunit.client.0.smithi049.stdout:0/135: mknod d5/d10/c25 0 2024-09-19T09:02:43.877 INFO:tasks.workunit.client.1.smithi102.stdout:6/664: dread d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fad [0,4194304] 0 2024-09-19T09:02:43.878 INFO:tasks.workunit.client.0.smithi049.stdout:3/60: mknod d10/d11/c12 0 2024-09-19T09:02:43.881 INFO:tasks.workunit.client.0.smithi049.stdout:0/136: dread d5/f11 [0,4194304] 0 2024-09-19T09:02:43.882 INFO:tasks.workunit.client.0.smithi049.stdout:7/99: rename d1/d7/d13/f16 to d1/d8/d19/f23 0 2024-09-19T09:02:43.884 INFO:tasks.workunit.client.1.smithi102.stdout:9/723: dread d1/d2/d3/f38 [0,4194304] 0 2024-09-19T09:02:43.885 INFO:tasks.workunit.client.1.smithi102.stdout:3/850: rename d2/d19/d1c/d1f/d5f/ce7 to d2/d1e/c110 0 2024-09-19T09:02:43.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/81: creat d3/f1c x:0 0 0 2024-09-19T09:02:43.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/82: fsync d3/f17 0 2024-09-19T09:02:43.889 INFO:tasks.workunit.client.1.smithi102.stdout:2/661: mkdir d7/d1a/d2b/dae/de5 0 2024-09-19T09:02:43.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/61: rmdir d10/d11 39 2024-09-19T09:02:43.890 INFO:tasks.workunit.client.1.smithi102.stdout:5/737: symlink d5/d60/db6/de4/le7 0 2024-09-19T09:02:43.891 INFO:tasks.workunit.client.1.smithi102.stdout:3/851: dwrite d2/d19/d1c/d70/f8a [0,4194304] 0 2024-09-19T09:02:43.892 INFO:tasks.workunit.client.1.smithi102.stdout:6/665: mkdir d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/de8 0 2024-09-19T09:02:43.894 INFO:tasks.workunit.client.0.smithi049.stdout:9/83: dwrite d3/f17 [0,4194304] 0 2024-09-19T09:02:43.895 INFO:tasks.workunit.client.1.smithi102.stdout:0/864: sync 2024-09-19T09:02:43.897 INFO:tasks.workunit.client.0.smithi049.stdout:7/100: rename d1/l17 to d1/d7/d13/d18/l24 0 2024-09-19T09:02:43.898 INFO:tasks.workunit.client.0.smithi049.stdout:7/101: read d1/d8/f1c [1521613,27618] 0 2024-09-19T09:02:43.898 INFO:tasks.workunit.client.0.smithi049.stdout:8/123: mknod d1/c25 0 2024-09-19T09:02:43.900 INFO:tasks.workunit.client.1.smithi102.stdout:6/666: dwrite d1/d26/d2e/fb1 [0,4194304] 0 2024-09-19T09:02:43.900 INFO:tasks.workunit.client.1.smithi102.stdout:2/662: mknod d7/d12/d37/daf/ce6 0 2024-09-19T09:02:43.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/124: truncate d1/f15 2503484 0 2024-09-19T09:02:43.901 INFO:tasks.workunit.client.0.smithi049.stdout:8/125: chown d1/f9 3814 1 2024-09-19T09:02:43.903 INFO:tasks.workunit.client.0.smithi049.stdout:8/126: readlink d1/la 0 2024-09-19T09:02:43.907 INFO:tasks.workunit.client.1.smithi102.stdout:3/852: dread - d2/d19/d47/db/d26/d63/f9b zero size 2024-09-19T09:02:43.910 INFO:tasks.workunit.client.0.smithi049.stdout:0/137: rmdir d5 39 2024-09-19T09:02:43.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/102: dwrite d1/d8/fb [0,4194304] 0 2024-09-19T09:02:43.912 INFO:tasks.workunit.client.1.smithi102.stdout:9/724: mknod d1/d2/d3/d1d/d4f/d6d/d81/cef 0 2024-09-19T09:02:43.914 INFO:tasks.workunit.client.1.smithi102.stdout:9/725: truncate d1/d2/d3/d1d/f76 5339741 0 2024-09-19T09:02:43.919 INFO:tasks.workunit.client.0.smithi049.stdout:9/84: unlink d3/cf 0 2024-09-19T09:02:43.920 INFO:tasks.workunit.client.1.smithi102.stdout:6/667: mknod d1/d26/d4b/ce9 0 2024-09-19T09:02:43.923 INFO:tasks.workunit.client.1.smithi102.stdout:0/865: dread d3/dd/d1a/d32/d7f/fd6 [0,4194304] 0 2024-09-19T09:02:43.924 INFO:tasks.workunit.client.1.smithi102.stdout:0/866: dread - d3/dd/d1a/d32/d7f/d10c/d37/f109 zero size 2024-09-19T09:02:43.925 INFO:tasks.workunit.client.1.smithi102.stdout:3/853: fsync d2/d19/d1c/d2f/d5a/d84/d4f/d72/fa6 0 2024-09-19T09:02:43.932 INFO:tasks.workunit.client.1.smithi102.stdout:9/726: mkdir d1/d8/d98/df0 0 2024-09-19T09:02:43.932 INFO:tasks.workunit.client.1.smithi102.stdout:9/727: chown d1/d2/d3/d1d/d4f/d6d/fa8 111 1 2024-09-19T09:02:43.933 INFO:tasks.workunit.client.1.smithi102.stdout:9/728: chown d1/d2/d3/d1d/d4f 108112031 1 2024-09-19T09:02:43.933 INFO:tasks.workunit.client.1.smithi102.stdout:5/738: write d5/d7/d1a/d42/f44 [3925909,62588] 0 2024-09-19T09:02:43.934 INFO:tasks.workunit.client.0.smithi049.stdout:3/62: mkdir d10/d11/d13 0 2024-09-19T09:02:43.935 INFO:tasks.workunit.client.0.smithi049.stdout:7/103: symlink d1/d7/d13/l25 0 2024-09-19T09:02:43.937 INFO:tasks.workunit.client.1.smithi102.stdout:6/668: unlink d1/d18/f95 0 2024-09-19T09:02:43.939 INFO:tasks.workunit.client.1.smithi102.stdout:2/663: link d7/da4/fd2 d7/d12/fe7 0 2024-09-19T09:02:43.941 INFO:tasks.workunit.client.0.smithi049.stdout:4/67: dwrite d4/fc [0,4194304] 0 2024-09-19T09:02:43.942 INFO:tasks.workunit.client.0.smithi049.stdout:8/127: rmdir d1/d11 39 2024-09-19T09:02:43.943 INFO:tasks.workunit.client.1.smithi102.stdout:0/867: symlink d3/dd/d1a/d32/d7f/d10c/d4a/l11a 0 2024-09-19T09:02:43.945 INFO:tasks.workunit.client.1.smithi102.stdout:2/664: dwrite d7/d1a/d2b/dab/fca [0,4194304] 0 2024-09-19T09:02:43.946 INFO:tasks.workunit.client.1.smithi102.stdout:2/665: write d7/d1a/d2b/d4e/f94 [891476,43783] 0 2024-09-19T09:02:43.950 INFO:tasks.workunit.client.1.smithi102.stdout:3/854: fsync d2/d19/d47/db/f25 0 2024-09-19T09:02:43.951 INFO:tasks.workunit.client.1.smithi102.stdout:9/729: creat d1/d2/d3/d1d/d4f/d6d/d81/d90/ff1 x:0 0 0 2024-09-19T09:02:43.952 INFO:tasks.workunit.client.1.smithi102.stdout:9/730: write d1/d8/d1c/f28 [1248457,72480] 0 2024-09-19T09:02:43.958 INFO:tasks.workunit.client.1.smithi102.stdout:9/731: dwrite d1/d2/d7b/fa3 [0,4194304] 0 2024-09-19T09:02:43.959 INFO:tasks.workunit.client.1.smithi102.stdout:6/669: creat d1/d26/d2e/d45/dac/db2/fea x:0 0 0 2024-09-19T09:02:43.960 INFO:tasks.workunit.client.0.smithi049.stdout:9/85: getdents d3/d14/d1a 0 2024-09-19T09:02:43.961 INFO:tasks.workunit.client.1.smithi102.stdout:9/732: dread - d1/d2/d3/d1d/d4f/d6d/d81/d90/ff1 zero size 2024-09-19T09:02:43.974 INFO:tasks.workunit.client.1.smithi102.stdout:4/857: sync 2024-09-19T09:02:44.025 INFO:tasks.workunit.client.1.smithi102.stdout:7/798: sync 2024-09-19T09:02:44.025 INFO:tasks.workunit.client.1.smithi102.stdout:8/685: sync 2024-09-19T09:02:44.025 INFO:tasks.workunit.client.1.smithi102.stdout:1/718: sync 2024-09-19T09:02:44.026 INFO:tasks.workunit.client.1.smithi102.stdout:1/719: stat dd/d14/d35/d49/d62 0 2024-09-19T09:02:44.105 INFO:tasks.workunit.client.0.smithi049.stdout:4/68: mkdir d4/d15 0 2024-09-19T09:02:44.106 INFO:tasks.workunit.client.1.smithi102.stdout:0/868: symlink d3/dd/d1a/d32/d7f/d10c/d37/d3d/l11b 0 2024-09-19T09:02:44.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/138: write d5/f11 [5111369,107452] 0 2024-09-19T09:02:44.108 INFO:tasks.workunit.client.0.smithi049.stdout:0/139: write d5/d10/d13/d15/f1e [445437,57410] 0 2024-09-19T09:02:44.170 INFO:tasks.workunit.client.1.smithi102.stdout:2/666: mknod d7/d50/d64/d7f/d83/ce8 0 2024-09-19T09:02:44.171 INFO:tasks.workunit.client.0.smithi049.stdout:7/104: unlink d1/d1a/f1d 0 2024-09-19T09:02:44.173 INFO:tasks.workunit.client.0.smithi049.stdout:3/63: link ff d10/d11/d13/f14 0 2024-09-19T09:02:44.177 INFO:tasks.workunit.client.1.smithi102.stdout:6/670: fsync d1/d18/f1d 0 2024-09-19T09:02:44.179 INFO:tasks.workunit.client.0.smithi049.stdout:7/105: mknod d1/d1a/c26 0 2024-09-19T09:02:44.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/69: getdents d4/d15 0 2024-09-19T09:02:44.183 INFO:tasks.workunit.client.0.smithi049.stdout:8/128: link d1/d1a/c24 d1/d1a/c26 0 2024-09-19T09:02:44.183 INFO:tasks.workunit.client.1.smithi102.stdout:1/720: dread - dd/d14/d18/fdb zero size 2024-09-19T09:02:44.184 INFO:tasks.workunit.client.1.smithi102.stdout:0/869: symlink d3/dd/d10/d15/da2/l11c 0 2024-09-19T09:02:44.184 INFO:tasks.workunit.client.0.smithi049.stdout:7/106: read d1/d8/f1c [3724814,90130] 0 2024-09-19T09:02:44.186 INFO:tasks.workunit.client.1.smithi102.stdout:3/855: creat d2/d19/d47/db/dc3/d10f/f111 x:0 0 0 2024-09-19T09:02:44.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/86: rmdir d3/d14 39 2024-09-19T09:02:44.187 INFO:tasks.workunit.client.1.smithi102.stdout:6/671: dread d1/ff [0,4194304] 0 2024-09-19T09:02:44.188 INFO:tasks.workunit.client.1.smithi102.stdout:7/799: dwrite d1/d3/d20/dad/dcd/fd5 [0,4194304] 0 2024-09-19T09:02:44.189 INFO:tasks.workunit.client.1.smithi102.stdout:6/672: write d1/d26/d2e/d45/d47/d4d/fc2 [483104,85315] 0 2024-09-19T09:02:44.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/64: creat d10/f15 x:0 0 0 2024-09-19T09:02:44.193 INFO:tasks.workunit.client.0.smithi049.stdout:7/107: mknod d1/d8/d19/c27 0 2024-09-19T09:02:44.195 INFO:tasks.workunit.client.1.smithi102.stdout:8/686: mknod d0/d10/d21/d39/d50/cd8 0 2024-09-19T09:02:44.198 INFO:tasks.workunit.client.0.smithi049.stdout:4/70: link d4/fe d4/f16 0 2024-09-19T09:02:44.200 INFO:tasks.workunit.client.0.smithi049.stdout:8/129: mkdir d1/d27 0 2024-09-19T09:02:44.202 INFO:tasks.workunit.client.0.smithi049.stdout:3/65: dwrite fc [0,4194304] 0 2024-09-19T09:02:44.202 INFO:tasks.workunit.client.0.smithi049.stdout:7/108: creat d1/d7/d13/d18/f28 x:0 0 0 2024-09-19T09:02:44.203 INFO:tasks.workunit.client.1.smithi102.stdout:5/739: link d5/d7/d1a/d37/d34/d73/ld8 d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/de0/le8 0 2024-09-19T09:02:44.203 INFO:tasks.workunit.client.0.smithi049.stdout:7/109: chown c0 3505210 1 2024-09-19T09:02:44.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/87: creat d3/d14/f1d x:0 0 0 2024-09-19T09:02:44.205 INFO:tasks.workunit.client.1.smithi102.stdout:1/721: dread dd/d14/d35/f48 [0,4194304] 0 2024-09-19T09:02:44.207 INFO:tasks.workunit.client.0.smithi049.stdout:4/71: creat d4/f17 x:0 0 0 2024-09-19T09:02:44.209 INFO:tasks.workunit.client.0.smithi049.stdout:8/130: truncate d1/f14 1354997 0 2024-09-19T09:02:44.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/131: readlink d1/l1e 0 2024-09-19T09:02:44.211 INFO:tasks.workunit.client.0.smithi049.stdout:3/66: unlink l4 0 2024-09-19T09:02:44.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/67: dread - ff zero size 2024-09-19T09:02:44.212 INFO:tasks.workunit.client.0.smithi049.stdout:8/132: write d1/f15 [1774838,5889] 0 2024-09-19T09:02:44.213 INFO:tasks.workunit.client.1.smithi102.stdout:9/733: rename d1/d2/d3/d1d/d4f/fb8 to d1/d2/d3/ff2 0 2024-09-19T09:02:44.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/722: dread dd/d13/d2d/ddc/fe6 [0,4194304] 0 2024-09-19T09:02:44.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/68: read - ff zero size 2024-09-19T09:02:44.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/110: unlink d1/d8/f12 0 2024-09-19T09:02:44.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/72: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:02:44.216 INFO:tasks.workunit.client.1.smithi102.stdout:4/858: creat d14/f115 x:0 0 0 2024-09-19T09:02:44.217 INFO:tasks.workunit.client.1.smithi102.stdout:4/859: chown f13 228004 1 2024-09-19T09:02:44.218 INFO:tasks.workunit.client.0.smithi049.stdout:9/88: write d3/f13 [329655,14623] 0 2024-09-19T09:02:44.224 INFO:tasks.workunit.client.0.smithi049.stdout:4/73: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:02:44.227 INFO:tasks.workunit.client.1.smithi102.stdout:4/860: dwrite d14/d34/d5a/d5c/d79/d8c/fb7 [0,4194304] 0 2024-09-19T09:02:44.228 INFO:tasks.workunit.client.1.smithi102.stdout:8/687: dwrite d0/d10/d3a/d9a/fb6 [0,4194304] 0 2024-09-19T09:02:44.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/69: fdatasync ff 0 2024-09-19T09:02:44.238 INFO:tasks.workunit.client.1.smithi102.stdout:2/667: rename d7/d12 to d7/d1a/d2b/d31/dde/de9 0 2024-09-19T09:02:44.238 INFO:tasks.workunit.client.1.smithi102.stdout:7/800: dwrite d1/d2f/fe1 [0,4194304] 0 2024-09-19T09:02:44.238 INFO:tasks.workunit.client.1.smithi102.stdout:0/870: dwrite d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/f6b [0,4194304] 0 2024-09-19T09:02:44.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/111: creat d1/d1f/f29 x:0 0 0 2024-09-19T09:02:44.240 INFO:tasks.workunit.client.0.smithi049.stdout:5/45: sync 2024-09-19T09:02:44.241 INFO:tasks.workunit.client.1.smithi102.stdout:0/871: fsync d3/fea 0 2024-09-19T09:02:44.249 INFO:tasks.workunit.client.1.smithi102.stdout:3/856: creat d2/d19/f112 x:0 0 0 2024-09-19T09:02:44.252 INFO:tasks.workunit.client.0.smithi049.stdout:5/46: dwrite d3/d5/fb [0,4194304] 0 2024-09-19T09:02:44.260 INFO:tasks.workunit.client.1.smithi102.stdout:2/668: dread d7/d50/f8a [0,4194304] 0 2024-09-19T09:02:44.315 INFO:tasks.workunit.client.1.smithi102.stdout:6/673: creat d1/d18/db/feb x:0 0 0 2024-09-19T09:02:44.321 INFO:tasks.workunit.client.1.smithi102.stdout:1/723: write dd/d13/f56 [1071159,21377] 0 2024-09-19T09:02:44.322 INFO:tasks.workunit.client.0.smithi049.stdout:8/133: creat d1/d27/f28 x:0 0 0 2024-09-19T09:02:44.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/134: read - d1/d27/f28 zero size 2024-09-19T09:02:44.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/135: read - d1/d27/f28 zero size 2024-09-19T09:02:44.332 INFO:tasks.workunit.client.0.smithi049.stdout:8/136: dread d1/f15 [0,4194304] 0 2024-09-19T09:02:44.333 INFO:tasks.workunit.client.0.smithi049.stdout:8/137: fdatasync d1/f21 0 2024-09-19T09:02:44.335 INFO:tasks.workunit.client.1.smithi102.stdout:8/688: mkdir d0/d10/d21/d39/d50/d63/d83/dd9 0 2024-09-19T09:02:44.335 INFO:tasks.workunit.client.1.smithi102.stdout:5/740: sync 2024-09-19T09:02:44.336 INFO:tasks.workunit.client.0.smithi049.stdout:9/89: link d3/d14/f1d d3/d14/f1e 0 2024-09-19T09:02:44.343 INFO:tasks.workunit.client.0.smithi049.stdout:4/74: creat d4/d15/f18 x:0 0 0 2024-09-19T09:02:44.343 INFO:tasks.workunit.client.0.smithi049.stdout:4/75: chown d4/f5 0 1 2024-09-19T09:02:44.344 INFO:tasks.workunit.client.0.smithi049.stdout:4/76: fsync d4/fc 0 2024-09-19T09:02:44.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/70: creat d10/d11/d13/f16 x:0 0 0 2024-09-19T09:02:44.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/71: write fd [470501,8583] 0 2024-09-19T09:02:44.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/138: creat d1/d1a/f29 x:0 0 0 2024-09-19T09:02:44.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/139: stat d1/f21 0 2024-09-19T09:02:44.370 INFO:tasks.workunit.client.0.smithi049.stdout:4/77: mkdir d4/d15/d19 0 2024-09-19T09:02:44.370 INFO:tasks.workunit.client.0.smithi049.stdout:4/78: readlink d4/lf 0 2024-09-19T09:02:44.387 INFO:tasks.workunit.client.0.smithi049.stdout:3/72: symlink d10/l17 0 2024-09-19T09:02:44.389 INFO:tasks.workunit.client.0.smithi049.stdout:7/112: getdents d1/d8 0 2024-09-19T09:02:44.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/113: stat d1/d7/d13/d18/f28 0 2024-09-19T09:02:44.391 INFO:tasks.workunit.client.0.smithi049.stdout:7/114: chown d1/d7/d13/l20 19 1 2024-09-19T09:02:44.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/115: write d1/d7/d13/d18/f28 [763841,1551] 0 2024-09-19T09:02:44.396 INFO:tasks.workunit.client.0.smithi049.stdout:9/90: creat d3/f1f x:0 0 0 2024-09-19T09:02:44.401 INFO:tasks.workunit.client.0.smithi049.stdout:3/73: creat d10/d11/d13/f18 x:0 0 0 2024-09-19T09:02:44.407 INFO:tasks.workunit.client.0.smithi049.stdout:9/91: mknod d3/d14/c20 0 2024-09-19T09:02:44.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/140: link d1/la d1/l2a 0 2024-09-19T09:02:44.414 INFO:tasks.workunit.client.0.smithi049.stdout:7/116: fdatasync d1/f2 0 2024-09-19T09:02:44.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/92: chown d3/le 564 1 2024-09-19T09:02:44.419 INFO:tasks.workunit.client.0.smithi049.stdout:3/74: mknod d10/c19 0 2024-09-19T09:02:44.419 INFO:tasks.workunit.client.0.smithi049.stdout:8/141: dwrite d1/ff [0,4194304] 0 2024-09-19T09:02:44.425 INFO:tasks.workunit.client.1.smithi102.stdout:2/669: rename d7/d1a/cb1 to d7/d11/dc8/cea 0 2024-09-19T09:02:44.426 INFO:tasks.workunit.client.1.smithi102.stdout:2/670: fdatasync d7/d1a/f49 0 2024-09-19T09:02:44.427 INFO:tasks.workunit.client.0.smithi049.stdout:7/117: symlink d1/d1f/l2a 0 2024-09-19T09:02:44.428 INFO:tasks.workunit.client.1.smithi102.stdout:6/674: chown d1/d18/l7f 341527 1 2024-09-19T09:02:44.429 INFO:tasks.workunit.client.1.smithi102.stdout:6/675: readlink d1/d26/d2e/d45/daf/d8d/lba 0 2024-09-19T09:02:44.429 INFO:tasks.workunit.client.1.smithi102.stdout:6/676: chown d1/d18/l9b 84862 1 2024-09-19T09:02:44.431 INFO:tasks.workunit.client.1.smithi102.stdout:1/724: mknod dd/d14/d35/d49/d62/d9e/dab/cee 0 2024-09-19T09:02:44.431 INFO:tasks.workunit.client.1.smithi102.stdout:1/725: readlink dd/d14/d18/lc8 0 2024-09-19T09:02:44.432 INFO:tasks.workunit.client.0.smithi049.stdout:3/75: creat d10/d11/f1a x:0 0 0 2024-09-19T09:02:44.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/142: creat d1/d1a/f2b x:0 0 0 2024-09-19T09:02:44.435 INFO:tasks.workunit.client.0.smithi049.stdout:7/118: rmdir d1/d7 39 2024-09-19T09:02:44.437 INFO:tasks.workunit.client.0.smithi049.stdout:9/93: mkdir d3/d14/d1a/d21 0 2024-09-19T09:02:44.439 INFO:tasks.workunit.client.1.smithi102.stdout:7/801: symlink d1/d3/lf5 0 2024-09-19T09:02:44.442 INFO:tasks.workunit.client.0.smithi049.stdout:8/143: write d1/d11/f1b [8737438,115088] 0 2024-09-19T09:02:44.443 INFO:tasks.workunit.client.0.smithi049.stdout:8/144: fdatasync d1/f23 0 2024-09-19T09:02:44.444 INFO:tasks.workunit.client.1.smithi102.stdout:3/857: mknod d2/d19/d35/dce/ddc/dfa/c113 0 2024-09-19T09:02:44.445 INFO:tasks.workunit.client.1.smithi102.stdout:6/677: dread d1/fcd [0,4194304] 0 2024-09-19T09:02:44.445 INFO:tasks.workunit.client.0.smithi049.stdout:7/119: creat d1/d8/d19/f2b x:0 0 0 2024-09-19T09:02:44.446 INFO:tasks.workunit.client.1.smithi102.stdout:6/678: write d1/d18/db/feb [30983,63805] 0 2024-09-19T09:02:44.447 INFO:tasks.workunit.client.1.smithi102.stdout:6/679: dread d1/f1b [0,4194304] 0 2024-09-19T09:02:44.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/94: write d3/f10 [2361631,44875] 0 2024-09-19T09:02:44.454 INFO:tasks.workunit.client.1.smithi102.stdout:6/680: dwrite d1/d26/d4b/f7a [0,4194304] 0 2024-09-19T09:02:44.454 INFO:tasks.workunit.client.0.smithi049.stdout:7/120: creat d1/d1f/f2c x:0 0 0 2024-09-19T09:02:44.455 INFO:tasks.workunit.client.1.smithi102.stdout:4/861: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da0/fd1 [0,4194304] 0 2024-09-19T09:02:44.455 INFO:tasks.workunit.client.0.smithi049.stdout:7/121: truncate d1/d8/fb 4854929 0 2024-09-19T09:02:44.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/122: readlink d1/d1f/l2a 0 2024-09-19T09:02:44.457 INFO:tasks.workunit.client.1.smithi102.stdout:7/802: unlink d1/d2d/fb7 0 2024-09-19T09:02:44.463 INFO:tasks.workunit.client.0.smithi049.stdout:7/123: mkdir d1/d8/d2d 0 2024-09-19T09:02:44.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/145: link d1/d1a/c24 d1/d1a/c2c 0 2024-09-19T09:02:44.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/146: fdatasync d1/d11/f17 0 2024-09-19T09:02:44.466 INFO:tasks.workunit.client.0.smithi049.stdout:8/147: write d1/d27/f28 [393952,130814] 0 2024-09-19T09:02:44.467 INFO:tasks.workunit.client.0.smithi049.stdout:7/124: write d1/d7/fa [1383651,89832] 0 2024-09-19T09:02:44.472 INFO:tasks.workunit.client.1.smithi102.stdout:4/862: unlink d14/d16/dd5/cd8 0 2024-09-19T09:02:44.474 INFO:tasks.workunit.client.0.smithi049.stdout:8/148: unlink d1/l13 0 2024-09-19T09:02:44.477 INFO:tasks.workunit.client.0.smithi049.stdout:7/125: mknod d1/d7/d13/d18/c2e 0 2024-09-19T09:02:44.479 INFO:tasks.workunit.client.1.smithi102.stdout:0/872: symlink d3/dd/d1a/d32/d7f/d10c/d2a/l11d 0 2024-09-19T09:02:44.481 INFO:tasks.workunit.client.0.smithi049.stdout:7/126: dread d1/d8/fb [0,4194304] 0 2024-09-19T09:02:44.481 INFO:tasks.workunit.client.1.smithi102.stdout:8/689: getdents d0/d4f 0 2024-09-19T09:02:44.482 INFO:tasks.workunit.client.1.smithi102.stdout:8/690: chown d0/d10/fc9 21 1 2024-09-19T09:02:44.486 INFO:tasks.workunit.client.1.smithi102.stdout:4/863: dwrite f12 [4194304,4194304] 0 2024-09-19T09:02:44.487 INFO:tasks.workunit.client.0.smithi049.stdout:8/149: rename d1/d11/f17 to d1/f2d 0 2024-09-19T09:02:44.488 INFO:tasks.workunit.client.0.smithi049.stdout:8/150: readlink d1/l10 0 2024-09-19T09:02:44.488 INFO:tasks.workunit.client.0.smithi049.stdout:7/127: dwrite d1/d8/d19/f2b [0,4194304] 0 2024-09-19T09:02:44.490 INFO:tasks.workunit.client.0.smithi049.stdout:6/34: sync 2024-09-19T09:02:44.496 INFO:tasks.workunit.client.1.smithi102.stdout:4/864: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/d116 0 2024-09-19T09:02:44.497 INFO:tasks.workunit.client.0.smithi049.stdout:8/151: mkdir d1/d11/d2e 0 2024-09-19T09:02:44.497 INFO:tasks.workunit.client.1.smithi102.stdout:4/865: chown d14/d34/d5a/d5c/fd4 309 1 2024-09-19T09:02:44.498 INFO:tasks.workunit.client.1.smithi102.stdout:0/873: mkdir d3/dd/d1a/d32/d113/d11e 0 2024-09-19T09:02:44.499 INFO:tasks.workunit.client.0.smithi049.stdout:8/152: write d1/d11/f12 [1643890,32467] 0 2024-09-19T09:02:44.499 INFO:tasks.workunit.client.1.smithi102.stdout:0/874: chown d3/l20 25180694 1 2024-09-19T09:02:44.499 INFO:tasks.workunit.client.0.smithi049.stdout:5/47: write d3/f6 [589679,116364] 0 2024-09-19T09:02:44.500 INFO:tasks.workunit.client.0.smithi049.stdout:8/153: write d1/d27/f28 [294551,72979] 0 2024-09-19T09:02:44.500 INFO:tasks.workunit.client.0.smithi049.stdout:5/48: chown l0 252355674 1 2024-09-19T09:02:44.502 INFO:tasks.workunit.client.0.smithi049.stdout:8/154: write d1/f23 [779246,108940] 0 2024-09-19T09:02:44.503 INFO:tasks.workunit.client.0.smithi049.stdout:8/155: write d1/fb [6422470,95704] 0 2024-09-19T09:02:44.505 INFO:tasks.workunit.client.1.smithi102.stdout:4/866: creat d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/dfb/f117 x:0 0 0 2024-09-19T09:02:44.506 INFO:tasks.workunit.client.1.smithi102.stdout:0/875: dwrite d3/dd/d10/d15/fee [0,4194304] 0 2024-09-19T09:02:44.506 INFO:tasks.workunit.client.1.smithi102.stdout:4/867: chown d14/d34/f28 18 1 2024-09-19T09:02:44.507 INFO:tasks.workunit.client.0.smithi049.stdout:7/128: link d1/f2 d1/d8/f2f 0 2024-09-19T09:02:44.508 INFO:tasks.workunit.client.0.smithi049.stdout:7/129: write d1/d1a/f21 [739352,18522] 0 2024-09-19T09:02:44.511 INFO:tasks.workunit.client.1.smithi102.stdout:0/876: write d3/dd/d10/d15/d2c/f3b [9372707,87445] 0 2024-09-19T09:02:44.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/130: link d1/d8/d19/f2b d1/d8/f30 0 2024-09-19T09:02:44.515 INFO:tasks.workunit.client.1.smithi102.stdout:0/877: write d3/dd/d5b/fcb [207102,69306] 0 2024-09-19T09:02:44.519 INFO:tasks.workunit.client.0.smithi049.stdout:5/49: mknod d3/cf 0 2024-09-19T09:02:44.522 INFO:tasks.workunit.client.1.smithi102.stdout:7/803: rename d1/f1e to d1/d4/ff6 0 2024-09-19T09:02:44.524 INFO:tasks.workunit.client.0.smithi049.stdout:5/50: dread d3/f6 [0,4194304] 0 2024-09-19T09:02:44.525 INFO:tasks.workunit.client.1.smithi102.stdout:9/734: mkdir d1/df3 0 2024-09-19T09:02:44.526 INFO:tasks.workunit.client.1.smithi102.stdout:9/735: write d1/d2/d3/d1d/f20 [1300804,64208] 0 2024-09-19T09:02:44.528 INFO:tasks.workunit.client.1.smithi102.stdout:7/804: dwrite d1/d3/d34/d4f/fe5 [0,4194304] 0 2024-09-19T09:02:44.530 INFO:tasks.workunit.client.1.smithi102.stdout:4/868: rename d14/d34/d5a/d5c/d81/d75/df0 to d14/d16/d17/de3/dbd/df3/d118 0 2024-09-19T09:02:44.533 INFO:tasks.workunit.client.1.smithi102.stdout:9/736: mknod d1/d2/d78/da0/dc0/cf4 0 2024-09-19T09:02:44.536 INFO:tasks.workunit.client.1.smithi102.stdout:7/805: mknod d1/d3/d20/d6c/cf7 0 2024-09-19T09:02:44.541 INFO:tasks.workunit.client.0.smithi049.stdout:4/79: truncate f0 2035106 0 2024-09-19T09:02:44.543 INFO:tasks.workunit.client.0.smithi049.stdout:3/76: fsync d10/d11/d13/f18 0 2024-09-19T09:02:44.545 INFO:tasks.workunit.client.1.smithi102.stdout:0/878: rename d3/dd/d1a/d32/d7f/d10c/d37/l68 to d3/dd/d10/d15/d19/l11f 0 2024-09-19T09:02:44.547 INFO:tasks.workunit.client.1.smithi102.stdout:7/806: symlink d1/d2f/lf8 0 2024-09-19T09:02:44.548 INFO:tasks.workunit.client.0.smithi049.stdout:3/77: mknod d10/d11/d13/c1b 0 2024-09-19T09:02:44.548 INFO:tasks.workunit.client.1.smithi102.stdout:0/879: dread d3/dd/d10/d15/fee [0,4194304] 0 2024-09-19T09:02:44.549 INFO:tasks.workunit.client.1.smithi102.stdout:0/880: chown d3/dd/d10/d15/d19/f46 3363 1 2024-09-19T09:02:44.549 INFO:tasks.workunit.client.0.smithi049.stdout:4/80: getdents d4/d15/d19 0 2024-09-19T09:02:44.550 INFO:tasks.workunit.client.0.smithi049.stdout:4/81: truncate d4/f14 257261 0 2024-09-19T09:02:44.551 INFO:tasks.workunit.client.1.smithi102.stdout:7/807: rename d1/d2d/dab to d1/d4/dca/d52/d7f/da5/df2/df9 0 2024-09-19T09:02:44.552 INFO:tasks.workunit.client.1.smithi102.stdout:7/808: chown d1/d3/d20/dad/dd4/fe8 3842197 1 2024-09-19T09:02:44.554 INFO:tasks.workunit.client.1.smithi102.stdout:0/881: creat d3/dd/d1a/d32/d7f/d10c/d82/f120 x:0 0 0 2024-09-19T09:02:44.554 INFO:tasks.workunit.client.1.smithi102.stdout:0/882: chown d3/dd/d72/d98/lae 0 1 2024-09-19T09:02:44.555 INFO:tasks.workunit.client.1.smithi102.stdout:0/883: readlink d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/l1d 0 2024-09-19T09:02:44.555 INFO:tasks.workunit.client.0.smithi049.stdout:3/78: creat d10/f1c x:0 0 0 2024-09-19T09:02:44.556 INFO:tasks.workunit.client.1.smithi102.stdout:7/809: readlink d1/d3/d72/lf1 0 2024-09-19T09:02:44.559 INFO:tasks.workunit.client.1.smithi102.stdout:6/681: sync 2024-09-19T09:02:44.563 INFO:tasks.workunit.client.1.smithi102.stdout:5/741: write d5/d7/d1a/d42/fa0 [812035,65897] 0 2024-09-19T09:02:44.565 INFO:tasks.workunit.client.1.smithi102.stdout:5/742: chown l2 4285457 1 2024-09-19T09:02:44.567 INFO:tasks.workunit.client.1.smithi102.stdout:0/884: dread d3/dd/d10/d15/d19/d7e/faf [0,4194304] 0 2024-09-19T09:02:44.567 INFO:tasks.workunit.client.1.smithi102.stdout:5/743: write d5/d7/d1a/daa/fd7 [1253183,86939] 0 2024-09-19T09:02:44.569 INFO:tasks.workunit.client.1.smithi102.stdout:2/671: truncate d7/d1a/d2b/d31/d51/f55 2444611 0 2024-09-19T09:02:44.571 INFO:tasks.workunit.client.1.smithi102.stdout:5/744: mkdir d5/d7/d1a/d37/d34/d4d/d9c/de9 0 2024-09-19T09:02:44.572 INFO:tasks.workunit.client.1.smithi102.stdout:0/885: creat d3/dd/d1a/d32/d117/f121 x:0 0 0 2024-09-19T09:02:44.573 INFO:tasks.workunit.client.1.smithi102.stdout:5/745: dread - d5/d60/fd5 zero size 2024-09-19T09:02:44.573 INFO:tasks.workunit.client.1.smithi102.stdout:1/726: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:44.574 INFO:tasks.workunit.client.1.smithi102.stdout:6/682: dread d1/d18/db/f1a [0,4194304] 0 2024-09-19T09:02:44.574 INFO:tasks.workunit.client.1.smithi102.stdout:0/886: chown d3/dd/d10/d8e 3353193 1 2024-09-19T09:02:44.575 INFO:tasks.workunit.client.1.smithi102.stdout:5/746: write d5/d7/d1a/daa/fd7 [6226650,73960] 0 2024-09-19T09:02:44.575 INFO:tasks.workunit.client.1.smithi102.stdout:2/672: mknod d7/d1a/ceb 0 2024-09-19T09:02:44.578 INFO:tasks.workunit.client.1.smithi102.stdout:1/727: symlink dd/d13/d2d/ddc/lef 0 2024-09-19T09:02:44.580 INFO:tasks.workunit.client.1.smithi102.stdout:0/887: creat d3/dd/d10/d15/d3e/f122 x:0 0 0 2024-09-19T09:02:44.582 INFO:tasks.workunit.client.1.smithi102.stdout:6/683: mkdir d1/d26/d2e/d45/dec 0 2024-09-19T09:02:44.583 INFO:tasks.workunit.client.1.smithi102.stdout:3/858: dwrite d2/d19/d1c/d2f/d5a/d84/f9a [0,4194304] 0 2024-09-19T09:02:44.584 INFO:tasks.workunit.client.1.smithi102.stdout:5/747: unlink d5/d7/d1a/l6c 0 2024-09-19T09:02:44.586 INFO:tasks.workunit.client.1.smithi102.stdout:5/748: rmdir d5 39 2024-09-19T09:02:44.588 INFO:tasks.workunit.client.1.smithi102.stdout:6/684: symlink d1/d26/d2e/d70/dca/led 0 2024-09-19T09:02:44.591 INFO:tasks.workunit.client.1.smithi102.stdout:8/691: dwrite d0/db/d84/f95 [0,4194304] 0 2024-09-19T09:02:44.591 INFO:tasks.workunit.client.1.smithi102.stdout:1/728: link dd/d14/le0 dd/lf0 0 2024-09-19T09:02:44.592 INFO:tasks.workunit.client.1.smithi102.stdout:2/673: dwrite d7/d1a/d2b/d31/d51/d6b/f8c [0,4194304] 0 2024-09-19T09:02:44.593 INFO:tasks.workunit.client.1.smithi102.stdout:6/685: write d1/d26/d2e/d70/f9a [390803,78261] 0 2024-09-19T09:02:44.593 INFO:tasks.workunit.client.1.smithi102.stdout:3/859: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/dde/f114 x:0 0 0 2024-09-19T09:02:44.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/131: truncate d1/d8/d19/f2b 2059911 0 2024-09-19T09:02:44.598 INFO:tasks.workunit.client.1.smithi102.stdout:6/686: write d1/d26/d2e/d45/dac/db2/fea [701260,49786] 0 2024-09-19T09:02:44.599 INFO:tasks.workunit.client.1.smithi102.stdout:3/860: dread - d2/d19/d1c/d2f/d5a/d84/d64/f109 zero size 2024-09-19T09:02:44.600 INFO:tasks.workunit.client.1.smithi102.stdout:2/674: fdatasync d7/ff 0 2024-09-19T09:02:44.603 INFO:tasks.workunit.client.1.smithi102.stdout:1/729: mkdir dd/dd5/df1 0 2024-09-19T09:02:44.606 INFO:tasks.workunit.client.1.smithi102.stdout:0/888: link d3/dd/d10/d15/d3e/cd3 d3/dd/d10/d15/d3e/c123 0 2024-09-19T09:02:44.609 INFO:tasks.workunit.client.0.smithi049.stdout:7/132: mkdir d1/d8/d2d/d31 0 2024-09-19T09:02:44.610 INFO:tasks.workunit.client.0.smithi049.stdout:7/133: stat d1/d8/d19/f2b 0 2024-09-19T09:02:44.610 INFO:tasks.workunit.client.0.smithi049.stdout:7/134: chown d1/d8/d2d/d31 262035 1 2024-09-19T09:02:44.611 INFO:tasks.workunit.client.1.smithi102.stdout:3/861: unlink d2/d19/d35/f41 0 2024-09-19T09:02:44.613 INFO:tasks.workunit.client.1.smithi102.stdout:2/675: mknod d7/d1a/d2b/d31/d51/cec 0 2024-09-19T09:02:44.614 INFO:tasks.workunit.client.1.smithi102.stdout:9/737: write d1/d2/d3/f38 [357234,103939] 0 2024-09-19T09:02:44.614 INFO:tasks.workunit.client.1.smithi102.stdout:2/676: chown d7/d1a/d2b/dae/de5 26 1 2024-09-19T09:02:44.615 INFO:tasks.workunit.client.1.smithi102.stdout:1/730: creat dd/d14/d35/d49/d7d/ff2 x:0 0 0 2024-09-19T09:02:44.618 INFO:tasks.workunit.client.1.smithi102.stdout:0/889: symlink d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/l124 0 2024-09-19T09:02:44.620 INFO:tasks.workunit.client.1.smithi102.stdout:4/869: dwrite d14/d16/d17/f1c [0,4194304] 0 2024-09-19T09:02:44.621 INFO:tasks.workunit.client.1.smithi102.stdout:7/810: getdents d1/d2f 0 2024-09-19T09:02:44.622 INFO:tasks.workunit.client.1.smithi102.stdout:6/687: link d1/d18/d37/f4e d1/d26/d2e/fee 0 2024-09-19T09:02:44.624 INFO:tasks.workunit.client.1.smithi102.stdout:9/738: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:44.630 INFO:tasks.workunit.client.0.smithi049.stdout:7/135: getdents d1 0 2024-09-19T09:02:44.634 INFO:tasks.workunit.client.1.smithi102.stdout:0/890: mknod d3/dd/d10/d15/da2/c125 0 2024-09-19T09:02:44.637 INFO:tasks.workunit.client.1.smithi102.stdout:6/688: fdatasync d1/d26/d2e/d45/d47/d4d/f33 0 2024-09-19T09:02:44.640 INFO:tasks.workunit.client.0.smithi049.stdout:7/136: rename d1/d7/d13/d18/l24 to d1/d7/d13/d18/l32 0 2024-09-19T09:02:44.642 INFO:tasks.workunit.client.1.smithi102.stdout:9/739: readlink d1/d2/d3/d1d/d4f/d6d/lb0 0 2024-09-19T09:02:44.642 INFO:tasks.workunit.client.0.smithi049.stdout:7/137: creat d1/d1f/f33 x:0 0 0 2024-09-19T09:02:44.647 INFO:tasks.workunit.client.1.smithi102.stdout:9/740: dwrite d1/d2/d3/d6f/dcb/fd8 [0,4194304] 0 2024-09-19T09:02:44.650 INFO:tasks.workunit.client.1.smithi102.stdout:6/689: chown d1/d18/db/c27 14 1 2024-09-19T09:02:44.650 INFO:tasks.workunit.client.1.smithi102.stdout:7/811: mknod d1/d4/dca/d52/d7f/da5/de2/df0/cfa 0 2024-09-19T09:02:44.653 INFO:tasks.workunit.client.1.smithi102.stdout:4/870: rename d14/d16/d1d/d92/le9 to d14/d16/d17/de3/dbd/df3/d37/d58/l119 0 2024-09-19T09:02:44.653 INFO:tasks.workunit.client.1.smithi102.stdout:1/731: link dd/d14/d35/d49/d7d/d7f/f8b dd/d66/dea/ff3 0 2024-09-19T09:02:44.654 INFO:tasks.workunit.client.0.smithi049.stdout:7/138: link d1/d8/f30 d1/d8/d19/f34 0 2024-09-19T09:02:44.654 INFO:tasks.workunit.client.0.smithi049.stdout:7/139: readlink d1/d8/ld 0 2024-09-19T09:02:44.657 INFO:tasks.workunit.client.1.smithi102.stdout:6/690: dread - d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fd0 zero size 2024-09-19T09:02:44.657 INFO:tasks.workunit.client.1.smithi102.stdout:0/891: creat d3/dd/d1a/d77/f126 x:0 0 0 2024-09-19T09:02:44.658 INFO:tasks.workunit.client.1.smithi102.stdout:6/691: chown d1/d26 9 1 2024-09-19T09:02:44.660 INFO:tasks.workunit.client.1.smithi102.stdout:5/749: dwrite d5/d7/d1b/f6f [0,4194304] 0 2024-09-19T09:02:44.660 INFO:tasks.workunit.client.1.smithi102.stdout:9/741: dwrite d1/d2/d3/d1d/f20 [4194304,4194304] 0 2024-09-19T09:02:44.662 INFO:tasks.workunit.client.1.smithi102.stdout:7/812: dread d1/d4/f3d [0,4194304] 0 2024-09-19T09:02:44.662 INFO:tasks.workunit.client.0.smithi049.stdout:7/140: dwrite d1/d7/d13/d18/f28 [0,4194304] 0 2024-09-19T09:02:44.662 INFO:tasks.workunit.client.1.smithi102.stdout:5/750: readlink d5/d7/d1a/d37/d39/d4c/lb0 0 2024-09-19T09:02:44.672 INFO:tasks.workunit.client.1.smithi102.stdout:3/862: write d2/ff [1424260,67806] 0 2024-09-19T09:02:44.677 INFO:tasks.workunit.client.1.smithi102.stdout:2/677: write d7/d1a/d2b/d31/f80 [4814882,97348] 0 2024-09-19T09:02:44.680 INFO:tasks.workunit.client.1.smithi102.stdout:7/813: mkdir d1/d3/d72/dfb 0 2024-09-19T09:02:44.684 INFO:tasks.workunit.client.1.smithi102.stdout:0/892: dread d3/dd/d10/d15/d3e/f5e [0,4194304] 0 2024-09-19T09:02:44.684 INFO:tasks.workunit.client.1.smithi102.stdout:9/742: creat d1/d8/d1c/ff5 x:0 0 0 2024-09-19T09:02:44.685 INFO:tasks.workunit.client.1.smithi102.stdout:3/863: creat d2/d19/d1c/f115 x:0 0 0 2024-09-19T09:02:44.685 INFO:tasks.workunit.client.1.smithi102.stdout:7/814: read d1/d3/d34/f66 [1432546,19440] 0 2024-09-19T09:02:44.686 INFO:tasks.workunit.client.1.smithi102.stdout:0/893: write d3/dd/f7c [4079508,36785] 0 2024-09-19T09:02:44.689 INFO:tasks.workunit.client.1.smithi102.stdout:0/894: fdatasync d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/fd2 0 2024-09-19T09:02:44.690 INFO:tasks.workunit.client.1.smithi102.stdout:2/678: link d7/d1a/d2b/d31/dde/de9/lb6 d7/d1a/d56/led 0 2024-09-19T09:02:44.691 INFO:tasks.workunit.client.1.smithi102.stdout:3/864: truncate d2/d19/d35/fc6 576814 0 2024-09-19T09:02:44.692 INFO:tasks.workunit.client.1.smithi102.stdout:7/815: truncate d1/d3/d34/d4f/f8d 576204 0 2024-09-19T09:02:44.693 INFO:tasks.workunit.client.1.smithi102.stdout:1/732: write dd/d13/d2d/f39 [2148512,27470] 0 2024-09-19T09:02:44.696 INFO:tasks.workunit.client.1.smithi102.stdout:7/816: rmdir d1/d4/dca 39 2024-09-19T09:02:44.698 INFO:tasks.workunit.client.1.smithi102.stdout:0/895: link d3/dd/d1a/d32/d7f/d10c/f2f d3/dd/d1a/d32/d7f/d10c/d2a/f127 0 2024-09-19T09:02:44.704 INFO:tasks.workunit.client.0.smithi049.stdout:7/141: dwrite d1/d8/fb [4194304,4194304] 0 2024-09-19T09:02:44.705 INFO:tasks.workunit.client.0.smithi049.stdout:7/142: fdatasync d1/d1f/f2c 0 2024-09-19T09:02:44.706 INFO:tasks.workunit.client.0.smithi049.stdout:7/143: truncate d1/d1a/f21 1503417 0 2024-09-19T09:02:44.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/144: dwrite d1/d7/fa [0,4194304] 0 2024-09-19T09:02:44.720 INFO:tasks.workunit.client.1.smithi102.stdout:1/733: rename ca to dd/d14/d35/d49/d62/d9e/cf4 0 2024-09-19T09:02:44.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/145: dwrite d1/d1f/f29 [0,4194304] 0 2024-09-19T09:02:44.723 INFO:tasks.workunit.client.1.smithi102.stdout:4/871: dread d14/d16/d17/de3/dbd/df3/d37/d58/de2/fad [0,4194304] 0 2024-09-19T09:02:44.727 INFO:tasks.workunit.client.1.smithi102.stdout:1/734: rename dd/d14/d35/d49/fba to dd/dd5/df1/ff5 0 2024-09-19T09:02:44.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/146: dread d1/d1a/f21 [0,4194304] 0 2024-09-19T09:02:44.729 INFO:tasks.workunit.client.1.smithi102.stdout:2/679: write d7/d1a/d2b/d31/d51/f55 [872587,62555] 0 2024-09-19T09:02:44.735 INFO:tasks.workunit.client.1.smithi102.stdout:9/743: dwrite d1/d2/d3/f31 [0,4194304] 0 2024-09-19T09:02:44.736 INFO:tasks.workunit.client.1.smithi102.stdout:4/872: write d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/f5f [4819922,46484] 0 2024-09-19T09:02:44.738 INFO:tasks.workunit.client.1.smithi102.stdout:3/865: dwrite d2/d19/d47/db/f44 [4194304,4194304] 0 2024-09-19T09:02:44.739 INFO:tasks.workunit.client.1.smithi102.stdout:7/817: dwrite d1/d3/d34/d74/fc0 [0,4194304] 0 2024-09-19T09:02:44.739 INFO:tasks.workunit.client.1.smithi102.stdout:9/744: stat d1/d8/d1c/f99 0 2024-09-19T09:02:44.742 INFO:tasks.workunit.client.1.smithi102.stdout:3/866: stat d2/d19/d47/db/fa5 0 2024-09-19T09:02:44.743 INFO:tasks.workunit.client.0.smithi049.stdout:7/147: dwrite d1/d8/f2f [4194304,4194304] 0 2024-09-19T09:02:44.745 INFO:tasks.workunit.client.1.smithi102.stdout:2/680: dread d7/fa0 [4194304,4194304] 0 2024-09-19T09:02:44.746 INFO:tasks.workunit.client.1.smithi102.stdout:0/896: dread d3/dd/d1a/d32/d7f/d99/fbd [0,4194304] 0 2024-09-19T09:02:44.747 INFO:tasks.workunit.client.0.smithi049.stdout:7/148: unlink d1/d8/d19/f23 0 2024-09-19T09:02:44.749 INFO:tasks.workunit.client.1.smithi102.stdout:1/735: dwrite dd/d14/d35/d49/dcb/fd0 [0,4194304] 0 2024-09-19T09:02:44.750 INFO:tasks.workunit.client.1.smithi102.stdout:0/897: readlink d3/dd/d1a/d32/d7f/d10c/d2a/l11d 0 2024-09-19T09:02:44.751 INFO:tasks.workunit.client.1.smithi102.stdout:7/818: creat d1/d3/d20/dad/dcd/ffc x:0 0 0 2024-09-19T09:02:44.752 INFO:tasks.workunit.client.1.smithi102.stdout:0/898: chown d3/dd/d72/feb 29 1 2024-09-19T09:02:44.754 INFO:tasks.workunit.client.1.smithi102.stdout:1/736: mkdir dd/d14/d35/d49/df6 0 2024-09-19T09:02:44.756 INFO:tasks.workunit.client.1.smithi102.stdout:4/873: link d14/d16/l2d d14/d34/l11a 0 2024-09-19T09:02:44.759 INFO:tasks.workunit.client.1.smithi102.stdout:2/681: symlink d7/d50/d64/d7f/d83/dc7/lee 0 2024-09-19T09:02:44.760 INFO:tasks.workunit.client.1.smithi102.stdout:1/737: stat dd/d14/d35/d49/d62/d6c/d99/lb4 0 2024-09-19T09:02:44.763 INFO:tasks.workunit.client.1.smithi102.stdout:0/899: creat d3/dd/d1a/d32/d113/d11e/f128 x:0 0 0 2024-09-19T09:02:44.764 INFO:tasks.workunit.client.1.smithi102.stdout:3/867: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/f116 x:0 0 0 2024-09-19T09:02:44.765 INFO:tasks.workunit.client.1.smithi102.stdout:2/682: creat d7/d50/d64/d7f/d83/dc7/fef x:0 0 0 2024-09-19T09:02:44.765 INFO:tasks.workunit.client.1.smithi102.stdout:1/738: fdatasync dd/d14/dac/fb5 0 2024-09-19T09:02:44.766 INFO:tasks.workunit.client.1.smithi102.stdout:2/683: fdatasync d7/d50/d64/da1/fa2 0 2024-09-19T09:02:44.767 INFO:tasks.workunit.client.1.smithi102.stdout:0/900: creat d3/dd/d5b/f129 x:0 0 0 2024-09-19T09:02:44.767 INFO:tasks.workunit.client.1.smithi102.stdout:2/684: readlink d7/d1a/d2b/d31/dde/de9/d37/d93/lcf 0 2024-09-19T09:02:44.768 INFO:tasks.workunit.client.1.smithi102.stdout:9/745: dread d1/f5c [0,4194304] 0 2024-09-19T09:02:44.768 INFO:tasks.workunit.client.1.smithi102.stdout:0/901: fdatasync d3/dd/d10/d15/d3e/f3f 0 2024-09-19T09:02:44.769 INFO:tasks.workunit.client.1.smithi102.stdout:9/746: dread - d1/fa1 zero size 2024-09-19T09:02:44.769 INFO:tasks.workunit.client.1.smithi102.stdout:8/692: sync 2024-09-19T09:02:44.770 INFO:tasks.workunit.client.1.smithi102.stdout:3/868: rename d2/d19/d47/db/fa1 to d2/d19/d1c/f117 0 2024-09-19T09:02:44.773 INFO:tasks.workunit.client.1.smithi102.stdout:0/902: mkdir d3/dd/d1a/d32/d7f/d10c/d2a/d12a 0 2024-09-19T09:02:44.775 INFO:tasks.workunit.client.1.smithi102.stdout:9/747: dwrite d1/d2/d3/d6f/fc6 [0,4194304] 0 2024-09-19T09:02:44.775 INFO:tasks.workunit.client.1.smithi102.stdout:3/869: fdatasync d2/d19/d1c/ffe 0 2024-09-19T09:02:44.777 INFO:tasks.workunit.client.1.smithi102.stdout:3/870: read d2/d1e/f4d [612820,30386] 0 2024-09-19T09:02:44.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/149: dwrite d1/d8/d19/f34 [0,4194304] 0 2024-09-19T09:02:44.784 INFO:tasks.workunit.client.1.smithi102.stdout:7/819: dwrite d1/d3/d20/f35 [0,4194304] 0 2024-09-19T09:02:44.786 INFO:tasks.workunit.client.1.smithi102.stdout:7/820: fsync d1/d2d/f43 0 2024-09-19T09:02:44.786 INFO:tasks.workunit.client.1.smithi102.stdout:8/693: link d0/db/d29/c58 d0/d10/cda 0 2024-09-19T09:02:44.787 INFO:tasks.workunit.client.1.smithi102.stdout:0/903: dread d3/dd/d10/d15/fee [0,4194304] 0 2024-09-19T09:02:44.787 INFO:tasks.workunit.client.1.smithi102.stdout:4/874: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/fcc [0,4194304] 0 2024-09-19T09:02:44.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/150: creat d1/d1f/f35 x:0 0 0 2024-09-19T09:02:44.792 INFO:tasks.workunit.client.1.smithi102.stdout:9/748: link d1/d2/d3/d1d/d4f/d6d/d81/f92 d1/d2/d3/d6f/dcb/ff6 0 2024-09-19T09:02:44.796 INFO:tasks.workunit.client.1.smithi102.stdout:1/739: write dd/d14/f4e [27003,18848] 0 2024-09-19T09:02:44.796 INFO:tasks.workunit.client.1.smithi102.stdout:4/875: dread d14/d16/ff1 [0,4194304] 0 2024-09-19T09:02:44.797 INFO:tasks.workunit.client.1.smithi102.stdout:2/685: getdents d7 0 2024-09-19T09:02:44.797 INFO:tasks.workunit.client.1.smithi102.stdout:9/749: stat d1/d2/d3/d6f/fa4 0 2024-09-19T09:02:44.797 INFO:tasks.workunit.client.0.smithi049.stdout:7/151: mkdir d1/d8/d2d/d36 0 2024-09-19T09:02:44.797 INFO:tasks.workunit.client.0.smithi049.stdout:7/152: write d1/ff [920813,36683] 0 2024-09-19T09:02:44.798 INFO:tasks.workunit.client.0.smithi049.stdout:7/153: chown d1/l11 3710964 1 2024-09-19T09:02:44.799 INFO:tasks.workunit.client.1.smithi102.stdout:2/686: stat d7/d1a/d2b/d31/dde/de9/d37/daf/c85 0 2024-09-19T09:02:44.799 INFO:tasks.workunit.client.1.smithi102.stdout:8/694: unlink d0/db/f89 0 2024-09-19T09:02:44.803 INFO:tasks.workunit.client.0.smithi049.stdout:7/154: dread d1/d7/f14 [0,4194304] 0 2024-09-19T09:02:44.804 INFO:tasks.workunit.client.1.smithi102.stdout:9/750: mkdir d1/d2/d78/df7 0 2024-09-19T09:02:44.805 INFO:tasks.workunit.client.1.smithi102.stdout:1/740: rename dd/dd5/de2 to dd/d14/d35/d49/d62/d9e/dab/de7/df7 0 2024-09-19T09:02:44.805 INFO:tasks.workunit.client.1.smithi102.stdout:2/687: fsync d7/da4/fd2 0 2024-09-19T09:02:44.806 INFO:tasks.workunit.client.0.smithi049.stdout:7/155: creat d1/d8/d19/f37 x:0 0 0 2024-09-19T09:02:44.807 INFO:tasks.workunit.client.0.smithi049.stdout:2/52: sync 2024-09-19T09:02:44.807 INFO:tasks.workunit.client.0.smithi049.stdout:1/72: sync 2024-09-19T09:02:44.807 INFO:tasks.workunit.client.0.smithi049.stdout:0/140: sync 2024-09-19T09:02:44.807 INFO:tasks.workunit.client.0.smithi049.stdout:7/156: chown d1/d1a 20718 1 2024-09-19T09:02:44.809 INFO:tasks.workunit.client.1.smithi102.stdout:3/871: dwrite d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f8d [0,4194304] 0 2024-09-19T09:02:44.809 INFO:tasks.workunit.client.0.smithi049.stdout:7/157: chown d1/d1a/c26 1 1 2024-09-19T09:02:44.810 INFO:tasks.workunit.client.1.smithi102.stdout:7/821: dwrite d1/d4/dca/f7d [0,4194304] 0 2024-09-19T09:02:44.812 INFO:tasks.workunit.client.0.smithi049.stdout:2/53: creat d1/d2/f10 x:0 0 0 2024-09-19T09:02:44.816 INFO:tasks.workunit.client.1.smithi102.stdout:9/751: unlink d1/d2/d3/d1d/d4f/fbf 0 2024-09-19T09:02:44.817 INFO:tasks.workunit.client.1.smithi102.stdout:6/692: sync 2024-09-19T09:02:44.817 INFO:tasks.workunit.client.1.smithi102.stdout:5/751: sync 2024-09-19T09:02:44.818 INFO:tasks.workunit.client.1.smithi102.stdout:0/904: write d3/dd/d1a/d32/d7f/d10c/f2f [701097,100721] 0 2024-09-19T09:02:44.819 INFO:tasks.workunit.client.0.smithi049.stdout:1/73: dread f3 [0,4194304] 0 2024-09-19T09:02:44.820 INFO:tasks.workunit.client.1.smithi102.stdout:0/905: read d3/dd/d10/d15/d19/d7e/faf [2107151,112982] 0 2024-09-19T09:02:44.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/54: truncate d1/d2/f10 765547 0 2024-09-19T09:02:44.824 INFO:tasks.workunit.client.0.smithi049.stdout:1/74: chown f3 6273 1 2024-09-19T09:02:44.824 INFO:tasks.workunit.client.0.smithi049.stdout:0/141: dwrite d5/d10/d13/f1c [0,4194304] 0 2024-09-19T09:02:44.824 INFO:tasks.workunit.client.0.smithi049.stdout:2/55: read d1/fd [4163448,50823] 0 2024-09-19T09:02:44.826 INFO:tasks.workunit.client.1.smithi102.stdout:0/906: dwrite d3/dd/d10/f63 [4194304,4194304] 0 2024-09-19T09:02:44.827 INFO:tasks.workunit.client.0.smithi049.stdout:0/142: fsync d5/d10/f1d 0 2024-09-19T09:02:44.828 INFO:tasks.workunit.client.1.smithi102.stdout:0/907: write d3/dd/d10/d15/d3e/f3f [2532226,62336] 0 2024-09-19T09:02:44.828 INFO:tasks.workunit.client.1.smithi102.stdout:1/741: creat dd/d7a/d8c/da6/ff8 x:0 0 0 2024-09-19T09:02:44.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/158: dwrite d1/d1f/f29 [0,4194304] 0 2024-09-19T09:02:44.832 INFO:tasks.workunit.client.0.smithi049.stdout:1/75: creat d5/dd/f12 x:0 0 0 2024-09-19T09:02:44.833 INFO:tasks.workunit.client.1.smithi102.stdout:3/872: mknod d2/d19/d47/db/dc3/d10f/c118 0 2024-09-19T09:02:44.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/56: creat d1/f11 x:0 0 0 2024-09-19T09:02:44.836 INFO:tasks.workunit.client.1.smithi102.stdout:7/822: rmdir d1/d4/dca 39 2024-09-19T09:02:44.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/143: dread d5/fd [0,4194304] 0 2024-09-19T09:02:44.836 INFO:tasks.workunit.client.0.smithi049.stdout:2/57: fsync d1/d2/fa 0 2024-09-19T09:02:44.837 INFO:tasks.workunit.client.0.smithi049.stdout:2/58: chown d1/d4/fb 2 1 2024-09-19T09:02:44.838 INFO:tasks.workunit.client.1.smithi102.stdout:2/688: dread d7/d11/f68 [0,4194304] 0 2024-09-19T09:02:44.839 INFO:tasks.workunit.client.0.smithi049.stdout:2/59: read d1/d2/fa [194778,20055] 0 2024-09-19T09:02:44.843 INFO:tasks.workunit.client.1.smithi102.stdout:6/693: read d1/d18/f25 [184231,63004] 0 2024-09-19T09:02:44.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/159: unlink d1/c1b 0 2024-09-19T09:02:44.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/76: fsync f3 0 2024-09-19T09:02:44.847 INFO:tasks.workunit.client.0.smithi049.stdout:1/77: truncate f3 4862793 0 2024-09-19T09:02:44.847 INFO:tasks.workunit.client.0.smithi049.stdout:1/78: chown d5/d6/d8 1 1 2024-09-19T09:02:44.848 INFO:tasks.workunit.client.1.smithi102.stdout:4/876: truncate d14/d16/d17/de3/dbd/df3/d37/d58/f73 2209440 0 2024-09-19T09:02:44.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/144: mkdir d5/d10/d13/d19/d26 0 2024-09-19T09:02:44.852 INFO:tasks.workunit.client.0.smithi049.stdout:0/145: write d5/d10/f1d [971861,70232] 0 2024-09-19T09:02:44.853 INFO:tasks.workunit.client.0.smithi049.stdout:2/60: creat d1/f12 x:0 0 0 2024-09-19T09:02:44.855 INFO:tasks.workunit.client.1.smithi102.stdout:3/873: creat d2/d19/d47/db/dc3/d10f/f119 x:0 0 0 2024-09-19T09:02:44.855 INFO:tasks.workunit.client.1.smithi102.stdout:5/752: write d5/d7/d1a/d37/d39/d4c/f5d [619442,2916] 0 2024-09-19T09:02:44.856 INFO:tasks.workunit.client.1.smithi102.stdout:1/742: dread dd/d14/f2b [0,4194304] 0 2024-09-19T09:02:44.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/79: dwrite d5/d6/f10 [0,4194304] 0 2024-09-19T09:02:44.856 INFO:tasks.workunit.client.0.smithi049.stdout:0/146: chown d5/d10/d13/d15/f18 16 1 2024-09-19T09:02:44.857 INFO:tasks.workunit.client.1.smithi102.stdout:7/823: chown d1/d4/dca/f2e 16 1 2024-09-19T09:02:44.860 INFO:tasks.workunit.client.0.smithi049.stdout:0/147: write d5/d10/f1d [449669,27618] 0 2024-09-19T09:02:44.861 INFO:tasks.workunit.client.1.smithi102.stdout:2/689: rmdir d7/d1a/d2b/d4e 39 2024-09-19T09:02:44.861 INFO:tasks.workunit.client.1.smithi102.stdout:2/690: write d7/d1a/d2b/d31/dde/de9/d37/daf/f9d [1474445,70580] 0 2024-09-19T09:02:44.861 INFO:tasks.workunit.client.0.smithi049.stdout:2/61: write d1/d4/fb [1120305,20977] 0 2024-09-19T09:02:44.862 INFO:tasks.workunit.client.0.smithi049.stdout:2/62: readlink d1/l9 0 2024-09-19T09:02:44.864 INFO:tasks.workunit.client.0.smithi049.stdout:1/80: rename d5/dd to d5/d6/d8/d13 0 2024-09-19T09:02:44.866 INFO:tasks.workunit.client.1.smithi102.stdout:8/695: getdents d0/d10/d21/d39/d50/d63 0 2024-09-19T09:02:44.868 INFO:tasks.workunit.client.0.smithi049.stdout:0/148: symlink d5/d10/d13/l27 0 2024-09-19T09:02:44.871 INFO:tasks.workunit.client.1.smithi102.stdout:8/696: dread d0/d10/d3a/d9a/f9d [0,4194304] 0 2024-09-19T09:02:44.873 INFO:tasks.workunit.client.1.smithi102.stdout:0/908: mkdir d3/dd/d1a/d32/d7f/d10c/d37/d39/d12b 0 2024-09-19T09:02:44.874 INFO:tasks.workunit.client.1.smithi102.stdout:6/694: write d1/d3a/f98 [229626,96645] 0 2024-09-19T09:02:44.874 INFO:tasks.workunit.client.0.smithi049.stdout:7/160: chown d1/d1a/f21 1 1 2024-09-19T09:02:44.876 INFO:tasks.workunit.client.0.smithi049.stdout:0/149: unlink d5/d10/d13/d15/c22 0 2024-09-19T09:02:44.877 INFO:tasks.workunit.client.1.smithi102.stdout:5/753: symlink d5/d7/d1a/d37/d50/lea 0 2024-09-19T09:02:44.879 INFO:tasks.workunit.client.1.smithi102.stdout:0/909: dwrite d3/dd/d10/d15/d2c/f59 [0,4194304] 0 2024-09-19T09:02:44.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/63: link d1/d2/f10 d1/d2/f13 0 2024-09-19T09:02:44.880 INFO:tasks.workunit.client.1.smithi102.stdout:0/910: chown d3/dd/d1a/d32/d7f/fd6 22625 1 2024-09-19T09:02:44.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/150: dread d5/d10/d13/d15/f1b [0,4194304] 0 2024-09-19T09:02:44.882 INFO:tasks.workunit.client.1.smithi102.stdout:1/743: rmdir dd/d14/d35/d49/d62/d6c/d99 39 2024-09-19T09:02:44.884 INFO:tasks.workunit.client.0.smithi049.stdout:7/161: read d1/d8/d19/f2b [4059769,83813] 0 2024-09-19T09:02:44.885 INFO:tasks.workunit.client.1.smithi102.stdout:5/754: dread d5/d7/d1a/d37/d34/f4e [0,4194304] 0 2024-09-19T09:02:44.885 INFO:tasks.workunit.client.1.smithi102.stdout:3/874: truncate d2/d19/d47/db/d26/d63/d6f/f8e 3235373 0 2024-09-19T09:02:44.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/64: rename d1/d2/f10 to d1/f14 0 2024-09-19T09:02:44.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/65: readlink d1/l9 0 2024-09-19T09:02:44.889 INFO:tasks.workunit.client.0.smithi049.stdout:0/151: rmdir d5 39 2024-09-19T09:02:44.891 INFO:tasks.workunit.client.1.smithi102.stdout:2/691: creat d7/d1a/d2b/d31/dde/de9/ff0 x:0 0 0 2024-09-19T09:02:44.892 INFO:tasks.workunit.client.1.smithi102.stdout:9/752: sync 2024-09-19T09:02:45.005 INFO:tasks.workunit.client.0.smithi049.stdout:2/66: rename d1/d2/fa to d1/f15 0 2024-09-19T09:02:45.006 INFO:tasks.workunit.client.0.smithi049.stdout:2/67: chown d1/d2/cf 88582 1 2024-09-19T09:02:45.006 INFO:tasks.workunit.client.1.smithi102.stdout:8/697: mknod d0/db/d29/cdb 0 2024-09-19T09:02:45.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/68: chown d1/d4/ce 3894 1 2024-09-19T09:02:45.007 INFO:tasks.workunit.client.1.smithi102.stdout:8/698: write d0/d10/d3a/d9a/fb6 [3839150,127864] 0 2024-09-19T09:02:45.008 INFO:tasks.workunit.client.0.smithi049.stdout:0/152: rename d5/d10/d13 to d5/d10/d13/d28 22 2024-09-19T09:02:45.010 INFO:tasks.workunit.client.1.smithi102.stdout:6/695: creat d1/d26/d4b/d94/da2/fef x:0 0 0 2024-09-19T09:02:45.011 INFO:tasks.workunit.client.0.smithi049.stdout:1/81: getdents d5 0 2024-09-19T09:02:45.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/162: rmdir d1/d7/d13/d18 39 2024-09-19T09:02:45.016 INFO:tasks.workunit.client.1.smithi102.stdout:1/744: dread - dd/d14/fbe zero size 2024-09-19T09:02:45.016 INFO:tasks.workunit.client.0.smithi049.stdout:2/69: mkdir d1/d16 0 2024-09-19T09:02:45.018 INFO:tasks.workunit.client.1.smithi102.stdout:5/755: mknod d5/d7/d1b/ceb 0 2024-09-19T09:02:45.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/82: truncate d5/d6/f7 2959989 0 2024-09-19T09:02:45.020 INFO:tasks.workunit.client.1.smithi102.stdout:2/692: mknod d7/d50/d64/cf1 0 2024-09-19T09:02:45.021 INFO:tasks.workunit.client.1.smithi102.stdout:9/753: chown d1/d2/d3/c59 136 1 2024-09-19T09:02:45.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/153: dread d5/fa [0,4194304] 0 2024-09-19T09:02:45.022 INFO:tasks.workunit.client.1.smithi102.stdout:9/754: chown d1/d2/d7b/l9c 9 1 2024-09-19T09:02:45.022 INFO:tasks.workunit.client.0.smithi049.stdout:2/70: creat d1/d4/f17 x:0 0 0 2024-09-19T09:02:45.023 INFO:tasks.workunit.client.0.smithi049.stdout:0/154: truncate d5/d10/f1d 1833882 0 2024-09-19T09:02:45.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/163: rename d1/ff to d1/d1a/f38 0 2024-09-19T09:02:45.029 INFO:tasks.workunit.client.0.smithi049.stdout:0/155: mkdir d5/d10/d13/d15/d29 0 2024-09-19T09:02:45.033 INFO:tasks.workunit.client.1.smithi102.stdout:5/756: dread d5/d7/d1a/de1/f8c [0,4194304] 0 2024-09-19T09:02:45.033 INFO:tasks.workunit.client.1.smithi102.stdout:7/824: creat d1/d3/d34/ffd x:0 0 0 2024-09-19T09:02:45.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/71: rmdir d1 39 2024-09-19T09:02:45.034 INFO:tasks.workunit.client.1.smithi102.stdout:7/825: truncate d1/d3/d34/fd1 3056831 0 2024-09-19T09:02:45.035 INFO:tasks.workunit.client.1.smithi102.stdout:0/911: mkdir d3/dd/d1a/d32/d7f/d10c/d37/d39/d12b/d12c 0 2024-09-19T09:02:45.035 INFO:tasks.workunit.client.1.smithi102.stdout:0/912: stat d3/dd/d72 0 2024-09-19T09:02:45.037 INFO:tasks.workunit.client.1.smithi102.stdout:0/913: truncate d3/dd/d1a/d32/d7f/d10c/d37/f109 925393 0 2024-09-19T09:02:45.037 INFO:tasks.workunit.client.1.smithi102.stdout:1/745: fdatasync dd/d14/f2a 0 2024-09-19T09:02:45.038 INFO:tasks.workunit.client.1.smithi102.stdout:0/914: dread - d3/dd/d1a/d32/d113/d11e/f128 zero size 2024-09-19T09:02:45.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/72: stat d1/d2/f13 0 2024-09-19T09:02:45.039 INFO:tasks.workunit.client.1.smithi102.stdout:0/915: fdatasync d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd/ffe 0 2024-09-19T09:02:45.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/156: link l0 d5/d10/d13/d15/l2a 0 2024-09-19T09:02:45.042 INFO:tasks.workunit.client.1.smithi102.stdout:2/693: mkdir d7/d1a/d2b/d31/d51/df2 0 2024-09-19T09:02:45.042 INFO:tasks.workunit.client.0.smithi049.stdout:2/73: mknod d1/d2/c18 0 2024-09-19T09:02:45.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/164: mknod d1/d1a/c39 0 2024-09-19T09:02:45.045 INFO:tasks.workunit.client.1.smithi102.stdout:4/877: getdents d14/d16/d17/de3/dbd/df3/d37/d58/de2/df4 0 2024-09-19T09:02:45.048 INFO:tasks.workunit.client.1.smithi102.stdout:8/699: fdatasync d0/d10/d21/d39/d50/da2/fa7 0 2024-09-19T09:02:45.049 INFO:tasks.workunit.client.0.smithi049.stdout:0/157: read d5/ff [257423,8729] 0 2024-09-19T09:02:45.051 INFO:tasks.workunit.client.0.smithi049.stdout:2/74: mkdir d1/d19 0 2024-09-19T09:02:45.052 INFO:tasks.workunit.client.1.smithi102.stdout:9/755: write d1/d2/d3/d1d/d4f/d6d/d81/f92 [430851,94299] 0 2024-09-19T09:02:45.053 INFO:tasks.workunit.client.1.smithi102.stdout:9/756: stat d1/d2/d3/d1d/d4f/f86 0 2024-09-19T09:02:45.054 INFO:tasks.workunit.client.1.smithi102.stdout:9/757: write d1/d2/d3/d1d/f20 [3178774,68340] 0 2024-09-19T09:02:45.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/158: mknod d5/d10/d13/d15/c2b 0 2024-09-19T09:02:45.055 INFO:tasks.workunit.client.1.smithi102.stdout:9/758: readlink d1/d8/l60 0 2024-09-19T09:02:45.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/165: mknod d1/d8/c3a 0 2024-09-19T09:02:45.058 INFO:tasks.workunit.client.1.smithi102.stdout:0/916: creat d3/dd/d10/d15/d19/d8d/f12d x:0 0 0 2024-09-19T09:02:45.058 INFO:tasks.workunit.client.0.smithi049.stdout:2/75: creat d1/d19/f1a x:0 0 0 2024-09-19T09:02:45.059 INFO:tasks.workunit.client.0.smithi049.stdout:2/76: read - d1/d4/fc zero size 2024-09-19T09:02:45.060 INFO:tasks.workunit.client.0.smithi049.stdout:0/159: rename d5/l8 to d5/d10/d13/d19/l2c 0 2024-09-19T09:02:45.062 INFO:tasks.workunit.client.1.smithi102.stdout:2/694: rename d7/d11/fd0 to d7/d1a/d2b/dae/ff3 0 2024-09-19T09:02:45.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/77: creat d1/d19/f1b x:0 0 0 2024-09-19T09:02:45.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/160: write d5/d10/d13/d15/f1b [5034116,88358] 0 2024-09-19T09:02:45.067 INFO:tasks.workunit.client.0.smithi049.stdout:7/166: creat d1/d7/d13/d18/f3b x:0 0 0 2024-09-19T09:02:45.067 INFO:tasks.workunit.client.0.smithi049.stdout:7/167: chown d1/d8/ld 114979 1 2024-09-19T09:02:45.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/78: creat d1/d16/f1c x:0 0 0 2024-09-19T09:02:45.070 INFO:tasks.workunit.client.1.smithi102.stdout:7/826: symlink d1/d4/dca/d52/d7f/da5/de6/lfe 0 2024-09-19T09:02:45.072 INFO:tasks.workunit.client.0.smithi049.stdout:7/168: write d1/f2 [2862720,48781] 0 2024-09-19T09:02:45.075 INFO:tasks.workunit.client.0.smithi049.stdout:0/161: link d5/d10/d13/d15/f1b d5/d10/d13/d19/f2d 0 2024-09-19T09:02:45.078 INFO:tasks.workunit.client.1.smithi102.stdout:1/746: fsync dd/d14/d35/d49/d7d/d7f/f8b 0 2024-09-19T09:02:45.082 INFO:tasks.workunit.client.1.smithi102.stdout:5/757: truncate d5/d7/d1a/d37/f45 377932 0 2024-09-19T09:02:45.083 INFO:tasks.workunit.client.1.smithi102.stdout:3/875: getdents d2/d19 0 2024-09-19T09:02:45.087 INFO:tasks.workunit.client.0.smithi049.stdout:7/169: link d1/d7/d13/d18/f3b d1/d1f/f3c 0 2024-09-19T09:02:45.089 INFO:tasks.workunit.client.0.smithi049.stdout:0/162: write d5/fa [3144037,98922] 0 2024-09-19T09:02:45.091 INFO:tasks.workunit.client.1.smithi102.stdout:8/700: creat d0/d10/d21/db3/fdc x:0 0 0 2024-09-19T09:02:45.091 INFO:tasks.workunit.client.0.smithi049.stdout:7/170: dread d1/d8/d19/f2b [0,4194304] 0 2024-09-19T09:02:45.092 INFO:tasks.workunit.client.1.smithi102.stdout:6/696: getdents d1/d26/d4b/d94/d8a 0 2024-09-19T09:02:45.092 INFO:tasks.workunit.client.0.smithi049.stdout:7/171: stat d1/d8 0 2024-09-19T09:02:45.093 INFO:tasks.workunit.client.1.smithi102.stdout:7/827: mkdir d1/d3/d34/d74/dff 0 2024-09-19T09:02:45.093 INFO:tasks.workunit.client.1.smithi102.stdout:8/701: dread d0/d10/d21/d39/d50/d63/d83/f8a [0,4194304] 0 2024-09-19T09:02:45.094 INFO:tasks.workunit.client.0.smithi049.stdout:0/163: mknod d5/d10/d13/d15/c2e 0 2024-09-19T09:02:45.094 INFO:tasks.workunit.client.0.smithi049.stdout:7/172: rmdir d1/d7 39 2024-09-19T09:02:45.094 INFO:tasks.workunit.client.0.smithi049.stdout:0/164: truncate d5/f20 81820 0 2024-09-19T09:02:45.095 INFO:tasks.workunit.client.1.smithi102.stdout:1/747: read dd/d7a/d8c/d8e/f98 [122125,95694] 0 2024-09-19T09:02:45.096 INFO:tasks.workunit.client.1.smithi102.stdout:5/758: mkdir d5/d7/d1a/de1/d78/dec 0 2024-09-19T09:02:45.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/165: mkdir d5/d10/d2f 0 2024-09-19T09:02:45.098 INFO:tasks.workunit.client.1.smithi102.stdout:3/876: creat d2/d19/d35/dce/f11a x:0 0 0 2024-09-19T09:02:45.099 INFO:tasks.workunit.client.0.smithi049.stdout:0/166: read d5/d10/d13/d15/f18 [219160,47139] 0 2024-09-19T09:02:45.099 INFO:tasks.workunit.client.1.smithi102.stdout:0/917: unlink d3/dd/d1a/l79 0 2024-09-19T09:02:45.100 INFO:tasks.workunit.client.1.smithi102.stdout:2/695: symlink d7/d1a/d2b/d31/d51/df2/lf4 0 2024-09-19T09:02:45.101 INFO:tasks.workunit.client.1.smithi102.stdout:2/696: chown d7/d1a/d56/f98 0 1 2024-09-19T09:02:45.110 INFO:tasks.workunit.client.0.smithi049.stdout:7/173: link d1/d7/d13/l15 d1/d7/l3d 0 2024-09-19T09:02:45.113 INFO:tasks.workunit.client.0.smithi049.stdout:7/174: chown d1/d7/d13/l15 1260 1 2024-09-19T09:02:45.114 INFO:tasks.workunit.client.1.smithi102.stdout:9/759: link d1/d2/d3/l3d d1/d2/d78/da0/dc0/lf8 0 2024-09-19T09:02:45.115 INFO:tasks.workunit.client.1.smithi102.stdout:5/759: creat d5/d60/db6/dd2/fed x:0 0 0 2024-09-19T09:02:45.115 INFO:tasks.workunit.client.1.smithi102.stdout:8/702: write d0/d10/d21/d39/d87/f8e [5050316,52558] 0 2024-09-19T09:02:45.116 INFO:tasks.workunit.client.1.smithi102.stdout:3/877: dread - d2/d19/d1c/d2f/d5a/d84/d53/ff5 zero size 2024-09-19T09:02:45.116 INFO:tasks.workunit.client.1.smithi102.stdout:4/878: getdents d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb 0 2024-09-19T09:02:45.117 INFO:tasks.workunit.client.1.smithi102.stdout:9/760: write d1/d8/d1c/f62 [1625263,21883] 0 2024-09-19T09:02:45.117 INFO:tasks.workunit.client.1.smithi102.stdout:7/828: dread d1/d2d/f54 [0,4194304] 0 2024-09-19T09:02:45.118 INFO:tasks.workunit.client.1.smithi102.stdout:2/697: chown d7/d11/dc8/cea 24579186 1 2024-09-19T09:02:45.119 INFO:tasks.workunit.client.1.smithi102.stdout:8/703: dread - d0/d10/d9b/fc4 zero size 2024-09-19T09:02:45.119 INFO:tasks.workunit.client.1.smithi102.stdout:6/697: getdents d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/de8 0 2024-09-19T09:02:45.120 INFO:tasks.workunit.client.1.smithi102.stdout:0/918: rename d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/dab/fb2 to d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd/f12e 0 2024-09-19T09:02:45.120 INFO:tasks.workunit.client.1.smithi102.stdout:9/761: fsync d1/d2/d3/d6f/dcb/ff6 0 2024-09-19T09:02:45.120 INFO:tasks.workunit.client.1.smithi102.stdout:5/760: mkdir d5/d8d/d95/dee 0 2024-09-19T09:02:45.121 INFO:tasks.workunit.client.1.smithi102.stdout:7/829: write d1/d4/dca/f2e [4856834,102635] 0 2024-09-19T09:02:45.123 INFO:tasks.workunit.client.0.smithi049.stdout:0/167: dwrite d5/d10/d13/d19/f2d [4194304,4194304] 0 2024-09-19T09:02:45.123 INFO:tasks.workunit.client.0.smithi049.stdout:7/175: rename d1/d1f/f3c to d1/d7/d13/f3e 0 2024-09-19T09:02:45.123 INFO:tasks.workunit.client.1.smithi102.stdout:3/878: write d2/d19/d1c/d2f/d5a/d84/d64/fb2 [872603,74926] 0 2024-09-19T09:02:45.125 INFO:tasks.workunit.client.0.smithi049.stdout:9/95: sync 2024-09-19T09:02:45.126 INFO:tasks.workunit.client.0.smithi049.stdout:0/168: mkdir d5/d10/d13/d30 0 2024-09-19T09:02:45.127 INFO:tasks.workunit.client.1.smithi102.stdout:7/830: truncate d1/d4/d9c/f62 1638416 0 2024-09-19T09:02:45.129 INFO:tasks.workunit.client.0.smithi049.stdout:9/96: readlink d3/l9 0 2024-09-19T09:02:45.130 INFO:tasks.workunit.client.1.smithi102.stdout:0/919: dwrite d3/dd/d10/d15/d19/d8d/f12d [0,4194304] 0 2024-09-19T09:02:45.132 INFO:tasks.workunit.client.1.smithi102.stdout:8/704: symlink d0/d5a/ldd 0 2024-09-19T09:02:45.133 INFO:tasks.workunit.client.1.smithi102.stdout:8/705: stat d0/d10/d21/d39/d87/f8e 0 2024-09-19T09:02:45.140 INFO:tasks.workunit.client.1.smithi102.stdout:8/706: dwrite d0/db/d29/f72 [0,4194304] 0 2024-09-19T09:02:45.143 INFO:tasks.workunit.client.1.smithi102.stdout:4/879: dread d14/d16/d17/de3/dbd/df3/d37/d58/f73 [0,4194304] 0 2024-09-19T09:02:45.177 INFO:tasks.workunit.client.1.smithi102.stdout:1/748: sync 2024-09-19T09:02:45.178 INFO:tasks.workunit.client.1.smithi102.stdout:1/749: chown dd/d14/d35/d49/le8 1984 1 2024-09-19T09:02:45.208 INFO:tasks.workunit.client.0.smithi049.stdout:9/97: dread - d3/f1c zero size 2024-09-19T09:02:45.209 INFO:tasks.workunit.client.1.smithi102.stdout:6/698: rename d1/d26/d2e/d45/c77 to d1/d26/d2e/d45/d47/d4d/dd9/cf0 0 2024-09-19T09:02:45.209 INFO:tasks.workunit.client.1.smithi102.stdout:6/699: fsync d1/d26/d2e/d45/d47/d4d/fbc 0 2024-09-19T09:02:45.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/169: creat d5/d10/d13/d30/f31 x:0 0 0 2024-09-19T09:02:45.210 INFO:tasks.workunit.client.1.smithi102.stdout:6/700: read - d1/d26/d2e/d45/d47/fb7 zero size 2024-09-19T09:02:45.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/35: sync 2024-09-19T09:02:45.251 INFO:tasks.workunit.client.0.smithi049.stdout:5/51: sync 2024-09-19T09:02:45.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/156: sync 2024-09-19T09:02:45.252 INFO:tasks.workunit.client.0.smithi049.stdout:6/36: dread - fa zero size 2024-09-19T09:02:45.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:44 smithi102 ceph-mon[35280]: pgmap v29: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 78 MiB/s rd, 252 MiB/s wr, 551 op/s 2024-09-19T09:02:45.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/176: rename d1/d7/d13/d18/l32 to d1/d8/l3f 0 2024-09-19T09:02:45.269 INFO:tasks.workunit.client.1.smithi102.stdout:7/831: symlink d1/d2d/l100 0 2024-09-19T09:02:45.270 INFO:tasks.workunit.client.0.smithi049.stdout:0/170: mknod d5/d10/c32 0 2024-09-19T09:02:45.272 INFO:tasks.workunit.client.0.smithi049.stdout:5/52: creat d3/f10 x:0 0 0 2024-09-19T09:02:45.273 INFO:tasks.workunit.client.0.smithi049.stdout:8/157: symlink d1/d11/l2f 0 2024-09-19T09:02:45.275 INFO:tasks.workunit.client.0.smithi049.stdout:8/158: chown d1/d27/f28 93137 1 2024-09-19T09:02:45.276 INFO:tasks.workunit.client.1.smithi102.stdout:5/761: dwrite d5/d23/f26 [0,4194304] 0 2024-09-19T09:02:45.276 INFO:tasks.workunit.client.1.smithi102.stdout:0/920: creat d3/dd/d1a/d32/d7f/d10c/d2a/dba/d9d/f12f x:0 0 0 2024-09-19T09:02:45.277 INFO:tasks.workunit.client.1.smithi102.stdout:5/762: chown d5/d60/db6/dd2/cd6 0 1 2024-09-19T09:02:45.278 INFO:tasks.workunit.client.0.smithi049.stdout:0/171: dwrite d5/d10/d13/d15/f1b [0,4194304] 0 2024-09-19T09:02:45.278 INFO:tasks.workunit.client.0.smithi049.stdout:6/37: mknod dc/ce 0 2024-09-19T09:02:45.283 INFO:tasks.workunit.client.0.smithi049.stdout:6/38: dread f0 [0,4194304] 0 2024-09-19T09:02:45.283 INFO:tasks.workunit.client.1.smithi102.stdout:8/707: creat d0/db/d29/fde x:0 0 0 2024-09-19T09:02:45.284 INFO:tasks.workunit.client.0.smithi049.stdout:6/39: write f9 [130946,56487] 0 2024-09-19T09:02:45.285 INFO:tasks.workunit.client.0.smithi049.stdout:9/98: mkdir d3/d22 0 2024-09-19T09:02:45.287 INFO:tasks.workunit.client.1.smithi102.stdout:1/750: truncate dd/d13/d2d/f3c 121260 0 2024-09-19T09:02:45.288 INFO:tasks.workunit.client.0.smithi049.stdout:5/53: unlink d3/la 0 2024-09-19T09:02:45.290 INFO:tasks.workunit.client.0.smithi049.stdout:8/159: chown d1/f14 7123 1 2024-09-19T09:02:45.290 INFO:tasks.workunit.client.1.smithi102.stdout:6/701: mkdir d1/d26/d2e/d45/dac/df1 0 2024-09-19T09:02:45.291 INFO:tasks.workunit.client.0.smithi049.stdout:8/160: write d1/d11/f12 [44897,36042] 0 2024-09-19T09:02:45.291 INFO:tasks.workunit.client.1.smithi102.stdout:6/702: chown d1/d26/d2e/d70/dca/led 13 1 2024-09-19T09:02:45.292 INFO:tasks.workunit.client.1.smithi102.stdout:6/703: fsync d1/d18/d37/fc8 0 2024-09-19T09:02:45.292 INFO:tasks.workunit.client.0.smithi049.stdout:0/172: creat d5/d10/d13/d19/f33 x:0 0 0 2024-09-19T09:02:45.294 INFO:tasks.workunit.client.0.smithi049.stdout:7/177: unlink d1/c6 0 2024-09-19T09:02:45.297 INFO:tasks.workunit.client.0.smithi049.stdout:6/40: creat dc/ff x:0 0 0 2024-09-19T09:02:45.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:44 smithi049 ceph-mon[28158]: pgmap v29: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 78 MiB/s rd, 252 MiB/s wr, 551 op/s 2024-09-19T09:02:45.303 INFO:tasks.workunit.client.0.smithi049.stdout:6/41: dwrite dc/fd [0,4194304] 0 2024-09-19T09:02:45.312 INFO:tasks.workunit.client.0.smithi049.stdout:6/42: dwrite dc/fd [0,4194304] 0 2024-09-19T09:02:45.319 INFO:tasks.workunit.client.0.smithi049.stdout:9/99: write d3/d14/f1d [400015,90148] 0 2024-09-19T09:02:45.329 INFO:tasks.workunit.client.0.smithi049.stdout:6/43: symlink dc/l10 0 2024-09-19T09:02:45.329 INFO:tasks.workunit.client.0.smithi049.stdout:0/173: write d5/fd [4167703,64668] 0 2024-09-19T09:02:45.330 INFO:tasks.workunit.client.0.smithi049.stdout:5/54: link d3/dc/ld d3/d5/l11 0 2024-09-19T09:02:45.332 INFO:tasks.workunit.client.0.smithi049.stdout:7/178: write d1/d7/d13/d18/f28 [4461546,13298] 0 2024-09-19T09:02:45.334 INFO:tasks.workunit.client.0.smithi049.stdout:8/161: link d1/f15 d1/d11/f30 0 2024-09-19T09:02:45.335 INFO:tasks.workunit.client.0.smithi049.stdout:8/162: fsync d1/d27/f28 0 2024-09-19T09:02:45.337 INFO:tasks.workunit.client.0.smithi049.stdout:0/174: mknod d5/d10/d13/d15/c34 0 2024-09-19T09:02:45.337 INFO:tasks.workunit.client.0.smithi049.stdout:6/44: dwrite fb [0,4194304] 0 2024-09-19T09:02:45.344 INFO:tasks.workunit.client.0.smithi049.stdout:0/175: dwrite d5/d10/f1d [0,4194304] 0 2024-09-19T09:02:45.346 INFO:tasks.workunit.client.1.smithi102.stdout:3/879: mknod d2/d19/d1c/d2f/d5a/c11b 0 2024-09-19T09:02:45.348 INFO:tasks.workunit.client.1.smithi102.stdout:9/762: creat d1/d2/d3/ff9 x:0 0 0 2024-09-19T09:02:45.349 INFO:tasks.workunit.client.1.smithi102.stdout:9/763: chown d1/d2/d3/f4b 287348524 1 2024-09-19T09:02:45.350 INFO:tasks.workunit.client.0.smithi049.stdout:6/45: symlink dc/l11 0 2024-09-19T09:02:45.350 INFO:tasks.workunit.client.0.smithi049.stdout:4/82: sync 2024-09-19T09:02:45.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/79: sync 2024-09-19T09:02:45.351 INFO:tasks.workunit.client.1.smithi102.stdout:3/880: dwrite d2/d1e/f3d [0,4194304] 0 2024-09-19T09:02:45.351 INFO:tasks.workunit.client.0.smithi049.stdout:4/83: truncate f2 4901144 0 2024-09-19T09:02:45.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/80: write d10/f1c [950097,47313] 0 2024-09-19T09:02:45.353 INFO:tasks.workunit.client.1.smithi102.stdout:0/921: unlink d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd/ffe 0 2024-09-19T09:02:45.357 INFO:tasks.workunit.client.1.smithi102.stdout:5/763: creat d5/d7/d1a/d37/d34/d4d/d9c/db8/fef x:0 0 0 2024-09-19T09:02:45.357 INFO:tasks.workunit.client.0.smithi049.stdout:5/55: mkdir d3/d5/de/d12 0 2024-09-19T09:02:45.361 INFO:tasks.workunit.client.0.smithi049.stdout:7/179: truncate d1/d1a/f21 1110886 0 2024-09-19T09:02:45.363 INFO:tasks.workunit.client.1.smithi102.stdout:1/751: unlink dd/d14/d35/d49/le8 0 2024-09-19T09:02:45.365 INFO:tasks.workunit.client.1.smithi102.stdout:2/698: getdents d7/d1a/d2b/d31/d51/df2 0 2024-09-19T09:02:45.365 INFO:tasks.workunit.client.0.smithi049.stdout:0/176: truncate d5/d10/d13/d15/f18 93860 0 2024-09-19T09:02:45.365 INFO:tasks.workunit.client.0.smithi049.stdout:6/46: dwrite dc/ff [0,4194304] 0 2024-09-19T09:02:45.366 INFO:tasks.workunit.client.0.smithi049.stdout:6/47: chown f3 345775 1 2024-09-19T09:02:45.367 INFO:tasks.workunit.client.0.smithi049.stdout:8/163: mknod d1/c31 0 2024-09-19T09:02:45.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/81: dwrite fc [0,4194304] 0 2024-09-19T09:02:45.375 INFO:tasks.workunit.client.0.smithi049.stdout:4/84: rename d4/c10 to d4/d15/c1a 0 2024-09-19T09:02:45.381 INFO:tasks.workunit.client.0.smithi049.stdout:0/177: dwrite d5/d10/d13/d15/f1e [0,4194304] 0 2024-09-19T09:02:45.381 INFO:tasks.workunit.client.0.smithi049.stdout:9/100: rename d3/l6 to d3/l23 0 2024-09-19T09:02:45.384 INFO:tasks.workunit.client.0.smithi049.stdout:9/101: truncate d3/f1c 367758 0 2024-09-19T09:02:45.385 INFO:tasks.workunit.client.1.smithi102.stdout:1/752: dread dd/d14/d35/fa2 [0,4194304] 0 2024-09-19T09:02:45.386 INFO:tasks.workunit.client.0.smithi049.stdout:3/82: dwrite fd [0,4194304] 0 2024-09-19T09:02:45.386 INFO:tasks.workunit.client.1.smithi102.stdout:1/753: chown dd/d68/c91 481 1 2024-09-19T09:02:45.387 INFO:tasks.workunit.client.1.smithi102.stdout:1/754: readlink dd/d14/d35/d49/l5a 0 2024-09-19T09:02:45.388 INFO:tasks.workunit.client.0.smithi049.stdout:9/102: write d3/f13 [49570,13700] 0 2024-09-19T09:02:45.389 INFO:tasks.workunit.client.0.smithi049.stdout:7/180: unlink d1/d1f/l22 0 2024-09-19T09:02:45.391 INFO:tasks.workunit.client.0.smithi049.stdout:3/83: fdatasync fc 0 2024-09-19T09:02:45.395 INFO:tasks.workunit.client.1.smithi102.stdout:0/922: symlink d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/dab/l130 0 2024-09-19T09:02:45.396 INFO:tasks.workunit.client.0.smithi049.stdout:0/178: dwrite d5/f11 [0,4194304] 0 2024-09-19T09:02:45.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/48: mkdir dc/d12 0 2024-09-19T09:02:45.398 INFO:tasks.workunit.client.1.smithi102.stdout:5/764: truncate d5/d7/d1a/d37/d39/d4c/f4a 1784566 0 2024-09-19T09:02:45.405 INFO:tasks.workunit.client.1.smithi102.stdout:8/708: symlink d0/db/ldf 0 2024-09-19T09:02:45.405 INFO:tasks.workunit.client.1.smithi102.stdout:4/880: creat d14/d34/f11b x:0 0 0 2024-09-19T09:02:45.407 INFO:tasks.workunit.client.0.smithi049.stdout:0/179: dwrite d5/f11 [4194304,4194304] 0 2024-09-19T09:02:45.407 INFO:tasks.workunit.client.1.smithi102.stdout:2/699: rename d7/d1a/d2b/dab/cd7 to d7/cf5 0 2024-09-19T09:02:45.412 INFO:tasks.workunit.client.1.smithi102.stdout:7/832: creat d1/d3/d20/f101 x:0 0 0 2024-09-19T09:02:45.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/103: rename d3/f10 to d3/d14/f24 0 2024-09-19T09:02:45.418 INFO:tasks.workunit.client.1.smithi102.stdout:3/881: write d2/d19/fb1 [1498321,49822] 0 2024-09-19T09:02:45.421 INFO:tasks.workunit.client.0.smithi049.stdout:9/104: write f1 [8488673,24953] 0 2024-09-19T09:02:45.421 INFO:tasks.workunit.client.0.smithi049.stdout:7/181: mknod d1/d7/d13/d18/c40 0 2024-09-19T09:02:45.421 INFO:tasks.workunit.client.0.smithi049.stdout:9/105: chown f1 30053 1 2024-09-19T09:02:45.423 INFO:tasks.workunit.client.1.smithi102.stdout:8/709: unlink d0/db/d29/l62 0 2024-09-19T09:02:45.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/182: dread d1/d7/f14 [0,4194304] 0 2024-09-19T09:02:45.424 INFO:tasks.workunit.client.1.smithi102.stdout:8/710: write d0/fd [4020091,106624] 0 2024-09-19T09:02:45.425 INFO:tasks.workunit.client.1.smithi102.stdout:0/923: dread d3/dd/d1a/d32/d7f/d10c/d37/d3d/f48 [0,4194304] 0 2024-09-19T09:02:45.426 INFO:tasks.workunit.client.1.smithi102.stdout:6/704: creat d1/d26/d2e/d45/d47/d4d/ff2 x:0 0 0 2024-09-19T09:02:45.429 INFO:tasks.workunit.client.0.smithi049.stdout:0/180: rmdir d5/d10/d13/d15 39 2024-09-19T09:02:45.430 INFO:tasks.workunit.client.1.smithi102.stdout:8/711: fsync d0/fd 0 2024-09-19T09:02:45.430 INFO:tasks.workunit.client.1.smithi102.stdout:1/755: mknod dd/d14/cf9 0 2024-09-19T09:02:45.430 INFO:tasks.workunit.client.1.smithi102.stdout:8/712: readlink d0/d5a/ldd 0 2024-09-19T09:02:45.431 INFO:tasks.workunit.client.0.smithi049.stdout:9/106: dwrite d3/d14/f19 [0,4194304] 0 2024-09-19T09:02:45.431 INFO:tasks.workunit.client.1.smithi102.stdout:3/882: stat d2/d1e/cb4 0 2024-09-19T09:02:45.432 INFO:tasks.workunit.client.1.smithi102.stdout:8/713: truncate d0/db/d29/db5/fd1 584443 0 2024-09-19T09:02:45.432 INFO:tasks.workunit.client.1.smithi102.stdout:3/883: stat d2/d1e/ffc 0 2024-09-19T09:02:45.436 INFO:tasks.workunit.client.1.smithi102.stdout:4/881: mknod d14/d16/d17/de3/dbd/df3/d37/d101/c11c 0 2024-09-19T09:02:45.444 INFO:tasks.workunit.client.0.smithi049.stdout:1/83: sync 2024-09-19T09:02:45.445 INFO:tasks.workunit.client.1.smithi102.stdout:0/924: chown d3/dd/d1a/fef 47207775 1 2024-09-19T09:02:45.445 INFO:tasks.workunit.client.0.smithi049.stdout:7/183: creat d1/d1a/f41 x:0 0 0 2024-09-19T09:02:45.446 INFO:tasks.workunit.client.0.smithi049.stdout:7/184: chown d1/d7/d13/l25 694 1 2024-09-19T09:02:45.453 INFO:tasks.workunit.client.1.smithi102.stdout:1/756: truncate dd/d13/d2d/d78/fa7 680064 0 2024-09-19T09:02:45.454 INFO:tasks.workunit.client.1.smithi102.stdout:1/757: chown dd/d14/d35/d49/d7d/d7f 26068442 1 2024-09-19T09:02:45.454 INFO:tasks.workunit.client.1.smithi102.stdout:9/764: truncate d1/d2/d3/d6f/fc6 710667 0 2024-09-19T09:02:45.455 INFO:tasks.workunit.client.1.smithi102.stdout:9/765: fdatasync d1/d2/d78/da0/dc0/fdc 0 2024-09-19T09:02:45.456 INFO:tasks.workunit.client.0.smithi049.stdout:5/56: getdents d3/d5/de 0 2024-09-19T09:02:45.458 INFO:tasks.workunit.client.1.smithi102.stdout:5/765: creat d5/d7/d1a/d8f/ff0 x:0 0 0 2024-09-19T09:02:45.458 INFO:tasks.workunit.client.1.smithi102.stdout:5/766: chown d5/d7/d1a/daa 223672818 1 2024-09-19T09:02:45.460 INFO:tasks.workunit.client.0.smithi049.stdout:3/84: creat d10/f1d x:0 0 0 2024-09-19T09:02:45.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/84: creat d5/d6/d8/f14 x:0 0 0 2024-09-19T09:02:45.463 INFO:tasks.workunit.client.1.smithi102.stdout:6/705: rmdir d1/d26/d2e 39 2024-09-19T09:02:45.465 INFO:tasks.workunit.client.0.smithi049.stdout:7/185: fdatasync d1/d8/d19/f34 0 2024-09-19T09:02:45.466 INFO:tasks.workunit.client.0.smithi049.stdout:6/49: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:45.467 INFO:tasks.workunit.client.0.smithi049.stdout:1/85: write d5/d6/d8/f14 [965611,15595] 0 2024-09-19T09:02:45.468 INFO:tasks.workunit.client.0.smithi049.stdout:4/85: getdents d4 0 2024-09-19T09:02:45.468 INFO:tasks.workunit.client.1.smithi102.stdout:2/700: chown d7/d1a/d2b/d31/dde/de9/f9f 3 1 2024-09-19T09:02:45.469 INFO:tasks.workunit.client.0.smithi049.stdout:7/186: chown d1/d1f/l2a 2 1 2024-09-19T09:02:45.471 INFO:tasks.workunit.client.1.smithi102.stdout:7/833: rename d1/d3/d20/fb2 to d1/d3/d34/f102 0 2024-09-19T09:02:45.472 INFO:tasks.workunit.client.0.smithi049.stdout:6/50: readlink dc/l10 0 2024-09-19T09:02:45.473 INFO:tasks.workunit.client.0.smithi049.stdout:7/187: chown d1/d1a 58 1 2024-09-19T09:02:45.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/164: dwrite d1/f15 [0,4194304] 0 2024-09-19T09:02:45.474 INFO:tasks.workunit.client.1.smithi102.stdout:7/834: dread d1/d3/f78 [0,4194304] 0 2024-09-19T09:02:45.475 INFO:tasks.workunit.client.1.smithi102.stdout:1/758: rmdir dd/d14/d35/d49/d62/d6c 39 2024-09-19T09:02:45.475 INFO:tasks.workunit.client.0.smithi049.stdout:1/86: dread - d5/d6/d8/d13/f12 zero size 2024-09-19T09:02:45.476 INFO:tasks.workunit.client.0.smithi049.stdout:3/85: mknod d10/d11/c1e 0 2024-09-19T09:02:45.477 INFO:tasks.workunit.client.1.smithi102.stdout:9/766: truncate d1/d2/f37 1225225 0 2024-09-19T09:02:45.478 INFO:tasks.workunit.client.0.smithi049.stdout:0/181: dread d5/d10/d13/d15/f18 [0,4194304] 0 2024-09-19T09:02:45.479 INFO:tasks.workunit.client.1.smithi102.stdout:9/767: write d1/d2/d3/d6f/dcb/ff6 [269221,106292] 0 2024-09-19T09:02:45.481 INFO:tasks.workunit.client.0.smithi049.stdout:0/182: write d5/d10/f1d [2880646,31984] 0 2024-09-19T09:02:45.483 INFO:tasks.workunit.client.0.smithi049.stdout:5/57: rename d3/f9 to d3/d5/de/d12/f13 0 2024-09-19T09:02:45.485 INFO:tasks.workunit.client.1.smithi102.stdout:5/767: fdatasync d5/d60/fc3 0 2024-09-19T09:02:45.485 INFO:tasks.workunit.client.0.smithi049.stdout:8/165: dwrite d1/f21 [0,4194304] 0 2024-09-19T09:02:45.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/86: mknod d4/c1b 0 2024-09-19T09:02:45.489 INFO:tasks.workunit.client.1.smithi102.stdout:5/768: write d5/d60/fd5 [486401,119118] 0 2024-09-19T09:02:45.491 INFO:tasks.workunit.client.1.smithi102.stdout:4/882: symlink d14/d16/l11d 0 2024-09-19T09:02:45.491 INFO:tasks.workunit.client.1.smithi102.stdout:9/768: dwrite d1/d2/d3/fee [0,4194304] 0 2024-09-19T09:02:45.494 INFO:tasks.workunit.client.1.smithi102.stdout:8/714: dwrite d0/d4f/f76 [0,4194304] 0 2024-09-19T09:02:45.495 INFO:tasks.workunit.client.0.smithi049.stdout:4/87: dwrite d4/f12 [0,4194304] 0 2024-09-19T09:02:45.497 INFO:tasks.workunit.client.1.smithi102.stdout:8/715: dread - d0/db/d29/fde zero size 2024-09-19T09:02:45.498 INFO:tasks.workunit.client.0.smithi049.stdout:3/86: creat d10/d11/d13/f1f x:0 0 0 2024-09-19T09:02:45.498 INFO:tasks.workunit.client.1.smithi102.stdout:0/925: mknod d3/dd/d1a/d32/d7f/d10c/d2a/d10b/c131 0 2024-09-19T09:02:45.499 INFO:tasks.workunit.client.1.smithi102.stdout:8/716: chown d0/d4f/l60 0 1 2024-09-19T09:02:45.500 INFO:tasks.workunit.client.1.smithi102.stdout:8/717: fsync d0/f96 0 2024-09-19T09:02:45.500 INFO:tasks.workunit.client.1.smithi102.stdout:7/835: fdatasync d1/d4/dca/f77 0 2024-09-19T09:02:45.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/87: creat d5/d6/d8/d13/f15 x:0 0 0 2024-09-19T09:02:45.507 INFO:tasks.workunit.client.0.smithi049.stdout:0/183: mknod d5/d10/c35 0 2024-09-19T09:02:45.508 INFO:tasks.workunit.client.0.smithi049.stdout:8/166: symlink d1/d11/l32 0 2024-09-19T09:02:45.509 INFO:tasks.workunit.client.0.smithi049.stdout:6/51: creat dc/d12/f13 x:0 0 0 2024-09-19T09:02:45.513 INFO:tasks.workunit.client.1.smithi102.stdout:4/883: creat d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/f11e x:0 0 0 2024-09-19T09:02:45.514 INFO:tasks.workunit.client.1.smithi102.stdout:4/884: write d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/f11e [721034,25074] 0 2024-09-19T09:02:45.515 INFO:tasks.workunit.client.1.smithi102.stdout:8/718: write d0/d10/fc9 [1102443,29200] 0 2024-09-19T09:02:45.516 INFO:tasks.workunit.client.0.smithi049.stdout:2/79: sync 2024-09-19T09:02:45.516 INFO:tasks.workunit.client.1.smithi102.stdout:1/759: fdatasync dd/f12 0 2024-09-19T09:02:45.516 INFO:tasks.workunit.client.0.smithi049.stdout:6/52: fdatasync dc/ff 0 2024-09-19T09:02:45.517 INFO:tasks.workunit.client.1.smithi102.stdout:1/760: stat dd/d7a/d8c 0 2024-09-19T09:02:45.517 INFO:tasks.workunit.client.0.smithi049.stdout:7/188: symlink d1/d7/d13/l42 0 2024-09-19T09:02:45.521 INFO:tasks.workunit.client.0.smithi049.stdout:1/88: dwrite d5/d6/d8/f14 [0,4194304] 0 2024-09-19T09:02:45.521 INFO:tasks.workunit.client.0.smithi049.stdout:3/87: mknod d10/d11/d13/c20 0 2024-09-19T09:02:45.521 INFO:tasks.workunit.client.0.smithi049.stdout:4/88: fsync d4/f5 0 2024-09-19T09:02:45.522 INFO:tasks.workunit.client.1.smithi102.stdout:1/761: write dd/d14/d35/f58 [3737881,112802] 0 2024-09-19T09:02:45.523 INFO:tasks.workunit.client.1.smithi102.stdout:9/769: creat d1/ffa x:0 0 0 2024-09-19T09:02:45.525 INFO:tasks.workunit.client.0.smithi049.stdout:0/184: mkdir d5/d10/d13/d15/d36 0 2024-09-19T09:02:45.525 INFO:tasks.workunit.client.1.smithi102.stdout:5/769: link d5/d8d/d95/ca1 d5/d7/d1a/de1/d78/cf1 0 2024-09-19T09:02:45.525 INFO:tasks.workunit.client.1.smithi102.stdout:0/926: dread d3/dd/d10/d15/d2c/f9b [0,4194304] 0 2024-09-19T09:02:45.526 INFO:tasks.workunit.client.1.smithi102.stdout:3/884: truncate d2/f34 963625 0 2024-09-19T09:02:45.527 INFO:tasks.workunit.client.0.smithi049.stdout:8/167: dread d1/f23 [0,4194304] 0 2024-09-19T09:02:45.529 INFO:tasks.workunit.client.0.smithi049.stdout:4/89: read d4/f6 [2272864,29510] 0 2024-09-19T09:02:45.530 INFO:tasks.workunit.client.0.smithi049.stdout:2/80: symlink d1/d2/l1d 0 2024-09-19T09:02:45.531 INFO:tasks.workunit.client.0.smithi049.stdout:8/168: write d1/f21 [1094440,121016] 0 2024-09-19T09:02:45.532 INFO:tasks.workunit.client.1.smithi102.stdout:6/706: write d1/d26/d4b/f51 [597331,30541] 0 2024-09-19T09:02:45.533 INFO:tasks.workunit.client.0.smithi049.stdout:4/90: chown d4/d15 2961039 1 2024-09-19T09:02:45.536 INFO:tasks.workunit.client.1.smithi102.stdout:1/762: rmdir dd/d13/d2d/d78 39 2024-09-19T09:02:45.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/169: fdatasync d1/f15 0 2024-09-19T09:02:45.537 INFO:tasks.workunit.client.0.smithi049.stdout:7/189: dwrite d1/d8/f2f [4194304,4194304] 0 2024-09-19T09:02:45.538 INFO:tasks.workunit.client.0.smithi049.stdout:6/53: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:45.540 INFO:tasks.workunit.client.1.smithi102.stdout:5/770: mkdir d5/d7/d1a/d37/d39/d81/df2 0 2024-09-19T09:02:45.542 INFO:tasks.workunit.client.0.smithi049.stdout:3/88: creat d10/d11/f21 x:0 0 0 2024-09-19T09:02:45.543 INFO:tasks.workunit.client.1.smithi102.stdout:5/771: dread d5/d23/f26 [0,4194304] 0 2024-09-19T09:02:45.545 INFO:tasks.workunit.client.1.smithi102.stdout:0/927: truncate d3/dd/d10/d15/d19/f46 583117 0 2024-09-19T09:02:45.547 INFO:tasks.workunit.client.0.smithi049.stdout:7/190: truncate d1/d7/d13/d18/f3b 92886 0 2024-09-19T09:02:45.549 INFO:tasks.workunit.client.0.smithi049.stdout:4/91: dwrite d4/f5 [4194304,4194304] 0 2024-09-19T09:02:45.550 INFO:tasks.workunit.client.0.smithi049.stdout:4/92: fsync d4/fc 0 2024-09-19T09:02:45.550 INFO:tasks.workunit.client.1.smithi102.stdout:2/701: link d7/c23 d7/da4/cf6 0 2024-09-19T09:02:45.551 INFO:tasks.workunit.client.1.smithi102.stdout:3/885: read d2/d19/d1c/d2f/d5a/d84/f91 [1080567,5391] 0 2024-09-19T09:02:45.556 INFO:tasks.workunit.client.0.smithi049.stdout:4/93: dread d4/f6 [0,4194304] 0 2024-09-19T09:02:45.557 INFO:tasks.workunit.client.0.smithi049.stdout:5/58: link d3/dc/ld d3/l14 0 2024-09-19T09:02:45.557 INFO:tasks.workunit.client.1.smithi102.stdout:4/885: truncate d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/fa1 3807837 0 2024-09-19T09:02:45.558 INFO:tasks.workunit.client.0.smithi049.stdout:6/54: readlink l2 0 2024-09-19T09:02:45.559 INFO:tasks.workunit.client.0.smithi049.stdout:6/55: stat fa 0 2024-09-19T09:02:45.561 INFO:tasks.workunit.client.1.smithi102.stdout:4/886: read d14/d34/d5a/d5c/d81/d75/f77 [768458,45573] 0 2024-09-19T09:02:45.562 INFO:tasks.workunit.client.1.smithi102.stdout:6/707: stat d1/d26/d2e 0 2024-09-19T09:02:45.563 INFO:tasks.workunit.client.0.smithi049.stdout:3/89: mknod d10/d11/d13/c22 0 2024-09-19T09:02:45.564 INFO:tasks.workunit.client.1.smithi102.stdout:7/836: getdents d1/d2d 0 2024-09-19T09:02:45.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/90: read f6 [116257,32044] 0 2024-09-19T09:02:45.565 INFO:tasks.workunit.client.0.smithi049.stdout:6/56: dwrite f9 [0,4194304] 0 2024-09-19T09:02:45.567 INFO:tasks.workunit.client.1.smithi102.stdout:1/763: mknod dd/dd5/df1/cfa 0 2024-09-19T09:02:45.574 INFO:tasks.workunit.client.0.smithi049.stdout:7/191: rename d1/d8/d19/f2b to d1/d7/d13/d18/f43 0 2024-09-19T09:02:45.575 INFO:tasks.workunit.client.1.smithi102.stdout:0/928: dread d3/dd/d1a/d32/d7f/fd6 [0,4194304] 0 2024-09-19T09:02:45.576 INFO:tasks.workunit.client.1.smithi102.stdout:5/772: unlink d5/d7/d1a/d37/d39/d81/lad 0 2024-09-19T09:02:45.576 INFO:tasks.workunit.client.1.smithi102.stdout:5/773: readlink d5/d60/db6/de4/le7 0 2024-09-19T09:02:45.577 INFO:tasks.workunit.client.0.smithi049.stdout:4/94: stat d4/d15/c1a 0 2024-09-19T09:02:45.577 INFO:tasks.workunit.client.1.smithi102.stdout:0/929: readlink d3/dd/d1a/d32/d7f/d10c/d37/l5f 0 2024-09-19T09:02:45.580 INFO:tasks.workunit.client.1.smithi102.stdout:3/886: creat d2/d19/d47/db/d26/f11c x:0 0 0 2024-09-19T09:02:45.583 INFO:tasks.workunit.client.0.smithi049.stdout:1/89: creat d5/d6/dc/f16 x:0 0 0 2024-09-19T09:02:45.583 INFO:tasks.workunit.client.0.smithi049.stdout:0/185: truncate d5/f11 8108915 0 2024-09-19T09:02:45.584 INFO:tasks.workunit.client.1.smithi102.stdout:4/887: mkdir d14/d34/d5a/d5c/d11f 0 2024-09-19T09:02:45.587 INFO:tasks.workunit.client.0.smithi049.stdout:3/91: mknod d10/d11/d13/c23 0 2024-09-19T09:02:45.588 INFO:tasks.workunit.client.1.smithi102.stdout:7/837: mkdir d1/d2f/d103 0 2024-09-19T09:02:45.588 INFO:tasks.workunit.client.0.smithi049.stdout:3/92: dread - d10/f1d zero size 2024-09-19T09:02:45.589 INFO:tasks.workunit.client.1.smithi102.stdout:1/764: rmdir dd/d14/d35/d49/d7d 39 2024-09-19T09:02:45.591 INFO:tasks.workunit.client.0.smithi049.stdout:3/93: dread - d10/f15 zero size 2024-09-19T09:02:45.591 INFO:tasks.workunit.client.0.smithi049.stdout:1/90: dwrite f3 [0,4194304] 0 2024-09-19T09:02:45.591 INFO:tasks.workunit.client.1.smithi102.stdout:9/770: creat d1/ffb x:0 0 0 2024-09-19T09:02:45.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/186: dread d5/fd [0,4194304] 0 2024-09-19T09:02:45.592 INFO:tasks.workunit.client.0.smithi049.stdout:3/94: readlink l8 0 2024-09-19T09:02:45.593 INFO:tasks.workunit.client.0.smithi049.stdout:7/192: symlink d1/d1a/l44 0 2024-09-19T09:02:45.594 INFO:tasks.workunit.client.0.smithi049.stdout:1/91: write f3 [4780065,127362] 0 2024-09-19T09:02:45.594 INFO:tasks.workunit.client.0.smithi049.stdout:1/92: readlink - no filename 2024-09-19T09:02:45.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/95: creat d4/d15/f1c x:0 0 0 2024-09-19T09:02:45.598 INFO:tasks.workunit.client.1.smithi102.stdout:2/702: mkdir d7/d1a/d2b/dab/de2/df7 0 2024-09-19T09:02:45.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/187: dread d5/ff [0,4194304] 0 2024-09-19T09:02:45.599 INFO:tasks.workunit.client.0.smithi049.stdout:5/59: truncate d3/d5/de/d12/f13 1585710 0 2024-09-19T09:02:45.601 INFO:tasks.workunit.client.0.smithi049.stdout:4/96: fsync d4/f14 0 2024-09-19T09:02:45.608 INFO:tasks.workunit.client.1.smithi102.stdout:0/930: rename d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/c89 to d3/dd/d10/d15/d19/d8d/de6/c132 0 2024-09-19T09:02:45.610 INFO:tasks.workunit.client.0.smithi049.stdout:3/95: dwrite fd [0,4194304] 0 2024-09-19T09:02:45.611 INFO:tasks.workunit.client.1.smithi102.stdout:3/887: creat d2/d19/d35/dce/ddc/f11d x:0 0 0 2024-09-19T09:02:45.611 INFO:tasks.workunit.client.0.smithi049.stdout:1/93: dwrite f3 [0,4194304] 0 2024-09-19T09:02:45.612 INFO:tasks.workunit.client.0.smithi049.stdout:7/193: dwrite d1/d1f/f33 [0,4194304] 0 2024-09-19T09:02:45.614 INFO:tasks.workunit.client.0.smithi049.stdout:1/94: write d5/d6/d8/d13/f15 [303361,46755] 0 2024-09-19T09:02:45.625 INFO:tasks.workunit.client.1.smithi102.stdout:9/771: unlink d1/d2/d3/d1d/d4f/d6d/f7c 0 2024-09-19T09:02:45.625 INFO:tasks.workunit.client.1.smithi102.stdout:0/931: rename d3/dd/d1a/d32/d7f/d10c/d2a/dba/d9d/de2 to d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/d133 0 2024-09-19T09:02:45.626 INFO:tasks.workunit.client.0.smithi049.stdout:4/97: mknod d4/d15/c1d 0 2024-09-19T09:02:45.627 INFO:tasks.workunit.client.1.smithi102.stdout:0/932: fsync d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/ff6 0 2024-09-19T09:02:45.628 INFO:tasks.workunit.client.1.smithi102.stdout:3/888: write d2/d19/d35/f5c [357433,94002] 0 2024-09-19T09:02:45.632 INFO:tasks.workunit.client.1.smithi102.stdout:6/708: creat d1/d18/db/ff3 x:0 0 0 2024-09-19T09:02:45.633 INFO:tasks.workunit.client.1.smithi102.stdout:6/709: dread - d1/d26/d2e/d45/d47/d4d/fbc zero size 2024-09-19T09:02:45.634 INFO:tasks.workunit.client.0.smithi049.stdout:6/57: truncate dc/fd 143989 0 2024-09-19T09:02:45.634 INFO:tasks.workunit.client.0.smithi049.stdout:4/98: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:02:45.636 INFO:tasks.workunit.client.1.smithi102.stdout:1/765: mknod dd/d14/cfb 0 2024-09-19T09:02:45.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/96: rmdir d10 39 2024-09-19T09:02:45.639 INFO:tasks.workunit.client.1.smithi102.stdout:9/772: symlink d1/d2/d3/d6f/d8d/da2/db6/lfc 0 2024-09-19T09:02:45.647 INFO:tasks.workunit.client.1.smithi102.stdout:9/773: dwrite d1/d2/d3/d6f/fae [0,4194304] 0 2024-09-19T09:02:45.648 INFO:tasks.workunit.client.1.smithi102.stdout:8/719: sync 2024-09-19T09:02:45.649 INFO:tasks.workunit.client.1.smithi102.stdout:4/888: dread d14/d16/d17/de3/dbd/df3/d37/d58/d89/f31 [0,4194304] 0 2024-09-19T09:02:45.652 INFO:tasks.workunit.client.1.smithi102.stdout:6/710: rmdir d1/d26/d2e/d45/d47/d4d/dd9 39 2024-09-19T09:02:45.655 INFO:tasks.workunit.client.1.smithi102.stdout:7/838: creat d1/d4/f104 x:0 0 0 2024-09-19T09:02:45.657 INFO:tasks.workunit.client.1.smithi102.stdout:6/711: dread d1/d26/d2e/fc4 [0,4194304] 0 2024-09-19T09:02:45.663 INFO:tasks.workunit.client.0.smithi049.stdout:4/99: creat d4/f1e x:0 0 0 2024-09-19T09:02:45.668 INFO:tasks.workunit.client.1.smithi102.stdout:4/889: chown d14/d34/d5a/d5c/d79/d8c/fa9 1799 1 2024-09-19T09:02:45.669 INFO:tasks.workunit.client.0.smithi049.stdout:7/194: creat d1/d8/d2d/d36/f45 x:0 0 0 2024-09-19T09:02:45.669 INFO:tasks.workunit.client.1.smithi102.stdout:4/890: dread - d14/f115 zero size 2024-09-19T09:02:45.669 INFO:tasks.workunit.client.1.smithi102.stdout:0/933: dread d3/dd/d10/f6a [0,4194304] 0 2024-09-19T09:02:45.670 INFO:tasks.workunit.client.1.smithi102.stdout:4/891: chown d14/l1a 14 1 2024-09-19T09:02:45.671 INFO:tasks.workunit.client.1.smithi102.stdout:3/889: dwrite d2/d1e/f93 [0,4194304] 0 2024-09-19T09:02:45.671 INFO:tasks.workunit.client.0.smithi049.stdout:1/95: dread d5/d6/f7 [0,4194304] 0 2024-09-19T09:02:45.671 INFO:tasks.workunit.client.1.smithi102.stdout:8/720: rename d0/d10/d3a/d9a/ca8 to d0/d10/d21/d39/db8/ce0 0 2024-09-19T09:02:45.672 INFO:tasks.workunit.client.0.smithi049.stdout:4/100: dwrite d4/f6 [0,4194304] 0 2024-09-19T09:02:45.672 INFO:tasks.workunit.client.0.smithi049.stdout:5/60: stat d3/d5/de/d12/f13 0 2024-09-19T09:02:45.673 INFO:tasks.workunit.client.1.smithi102.stdout:3/890: write d2/d19/d47/db/d26/d63/d6f/fcf [506312,127139] 0 2024-09-19T09:02:45.679 INFO:tasks.workunit.client.0.smithi049.stdout:6/58: link fb dc/d12/f14 0 2024-09-19T09:02:45.680 INFO:tasks.workunit.client.0.smithi049.stdout:0/188: link d5/d10/c32 d5/d10/d13/d15/d29/c37 0 2024-09-19T09:02:45.682 INFO:tasks.workunit.client.1.smithi102.stdout:6/712: rmdir d1/d18/d37/dda 39 2024-09-19T09:02:45.684 INFO:tasks.workunit.client.1.smithi102.stdout:1/766: truncate dd/d14/f94 63716 0 2024-09-19T09:02:45.688 INFO:tasks.workunit.client.0.smithi049.stdout:7/195: rename d1/d7/d13/d18/f28 to d1/d8/d19/f46 0 2024-09-19T09:02:45.689 INFO:tasks.workunit.client.1.smithi102.stdout:6/713: dwrite d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/fe0 [0,4194304] 0 2024-09-19T09:02:45.690 INFO:tasks.workunit.client.0.smithi049.stdout:5/61: creat d3/d5/de/f15 x:0 0 0 2024-09-19T09:02:45.692 INFO:tasks.workunit.client.1.smithi102.stdout:7/839: write d1/d4/ff6 [1818244,57687] 0 2024-09-19T09:02:45.694 INFO:tasks.workunit.client.0.smithi049.stdout:4/101: rmdir d4 39 2024-09-19T09:02:45.696 INFO:tasks.workunit.client.1.smithi102.stdout:4/892: dread d14/d16/d17/de3/dbd/df3/f4e [0,4194304] 0 2024-09-19T09:02:45.697 INFO:tasks.workunit.client.1.smithi102.stdout:6/714: dwrite d1/d26/d2e/d45/d47/fd6 [0,4194304] 0 2024-09-19T09:02:45.697 INFO:tasks.workunit.client.0.smithi049.stdout:7/196: dwrite d1/d7/fa [0,4194304] 0 2024-09-19T09:02:45.699 INFO:tasks.workunit.client.1.smithi102.stdout:0/934: creat d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/de5/f134 x:0 0 0 2024-09-19T09:02:45.701 INFO:tasks.workunit.client.0.smithi049.stdout:1/96: symlink d5/d6/dc/l17 0 2024-09-19T09:02:45.703 INFO:tasks.workunit.client.1.smithi102.stdout:3/891: rmdir d2/d1e/dc5 39 2024-09-19T09:02:45.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/59: unlink dc/l11 0 2024-09-19T09:02:45.705 INFO:tasks.workunit.client.0.smithi049.stdout:3/97: symlink d10/l24 0 2024-09-19T09:02:45.706 INFO:tasks.workunit.client.1.smithi102.stdout:6/715: dwrite d1/d26/d2e/d45/d47/d4d/f72 [0,4194304] 0 2024-09-19T09:02:45.712 INFO:tasks.workunit.client.1.smithi102.stdout:7/840: mknod d1/d3/d20/dad/dcd/c105 0 2024-09-19T09:02:45.712 INFO:tasks.workunit.client.1.smithi102.stdout:7/841: dread - d1/d2d/feb zero size 2024-09-19T09:02:45.714 INFO:tasks.workunit.client.0.smithi049.stdout:4/102: read - d4/f1e zero size 2024-09-19T09:02:45.718 INFO:tasks.workunit.client.1.smithi102.stdout:0/935: symlink d3/dd/d1a/d32/d7f/d10c/d82/l135 0 2024-09-19T09:02:45.719 INFO:tasks.workunit.client.0.smithi049.stdout:3/98: mknod d10/d11/c25 0 2024-09-19T09:02:45.720 INFO:tasks.workunit.client.1.smithi102.stdout:3/892: creat d2/d1e/d54/f11e x:0 0 0 2024-09-19T09:02:45.721 INFO:tasks.workunit.client.1.smithi102.stdout:1/767: creat dd/d14/d35/ddf/ffc x:0 0 0 2024-09-19T09:02:45.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/197: creat d1/d8/d2d/d31/f47 x:0 0 0 2024-09-19T09:02:45.724 INFO:tasks.workunit.client.1.smithi102.stdout:8/721: creat d0/db/fe1 x:0 0 0 2024-09-19T09:02:45.725 INFO:tasks.workunit.client.1.smithi102.stdout:8/722: read d0/d10/d21/d39/d50/d63/d83/f8a [33358,127074] 0 2024-09-19T09:02:45.727 INFO:tasks.workunit.client.1.smithi102.stdout:0/936: readlink d3/dd/d72/l95 0 2024-09-19T09:02:45.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/99: creat d10/d11/f26 x:0 0 0 2024-09-19T09:02:45.731 INFO:tasks.workunit.client.1.smithi102.stdout:8/723: dwrite d0/d10/fc9 [0,4194304] 0 2024-09-19T09:02:45.731 INFO:tasks.workunit.client.0.smithi049.stdout:0/189: rename d5/l6 to d5/d10/d13/l38 0 2024-09-19T09:02:45.736 INFO:tasks.workunit.client.0.smithi049.stdout:6/60: write dc/d12/f14 [506578,83653] 0 2024-09-19T09:02:45.738 INFO:tasks.workunit.client.1.smithi102.stdout:4/893: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/faa [0,4194304] 0 2024-09-19T09:02:45.738 INFO:tasks.workunit.client.0.smithi049.stdout:4/103: mkdir d4/d15/d19/d1f 0 2024-09-19T09:02:45.739 INFO:tasks.workunit.client.0.smithi049.stdout:4/104: dread - d4/d15/f1c zero size 2024-09-19T09:02:45.739 INFO:tasks.workunit.client.1.smithi102.stdout:3/893: getdents d2/d19/d35/dce/ddc/df1 0 2024-09-19T09:02:45.740 INFO:tasks.workunit.client.1.smithi102.stdout:3/894: write d2/d19/d1c/fe8 [535453,55983] 0 2024-09-19T09:02:45.741 INFO:tasks.workunit.client.0.smithi049.stdout:3/100: read - d10/d11/d13/f14 zero size 2024-09-19T09:02:45.741 INFO:tasks.workunit.client.0.smithi049.stdout:6/61: read f3 [1465896,50189] 0 2024-09-19T09:02:45.741 INFO:tasks.workunit.client.1.smithi102.stdout:3/895: truncate d2/d19/d1c/fe8 1858278 0 2024-09-19T09:02:45.742 INFO:tasks.workunit.client.1.smithi102.stdout:0/937: creat d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd/f136 x:0 0 0 2024-09-19T09:02:45.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/62: write d3/d5/de/d12/f13 [2563242,60514] 0 2024-09-19T09:02:45.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/198: rmdir d1 39 2024-09-19T09:02:45.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/97: truncate d5/d6/f10 1690444 0 2024-09-19T09:02:45.749 INFO:tasks.workunit.client.1.smithi102.stdout:8/724: symlink d0/d10/d21/d39/le2 0 2024-09-19T09:02:45.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/62: rmdir dc 39 2024-09-19T09:02:45.752 INFO:tasks.workunit.client.1.smithi102.stdout:1/768: getdents dd/d14/d35/d49/d62/d9e/dab/de7/df7 0 2024-09-19T09:02:45.754 INFO:tasks.workunit.client.0.smithi049.stdout:3/101: mkdir d10/d11/d27 0 2024-09-19T09:02:45.755 INFO:tasks.workunit.client.0.smithi049.stdout:3/102: dread - d10/d11/d13/f1f zero size 2024-09-19T09:02:45.755 INFO:tasks.workunit.client.1.smithi102.stdout:7/842: creat d1/d3/d72/f106 x:0 0 0 2024-09-19T09:02:45.756 INFO:tasks.workunit.client.0.smithi049.stdout:0/190: creat d5/d10/d2f/f39 x:0 0 0 2024-09-19T09:02:45.756 INFO:tasks.workunit.client.0.smithi049.stdout:4/105: write d4/f16 [815409,113186] 0 2024-09-19T09:02:45.758 INFO:tasks.workunit.client.0.smithi049.stdout:0/191: chown d5/d10/d13/d19/f33 113921783 1 2024-09-19T09:02:45.758 INFO:tasks.workunit.client.1.smithi102.stdout:4/894: creat d14/d16/d17/de3/dbd/df3/d37/d58/de2/df4/f120 x:0 0 0 2024-09-19T09:02:45.760 INFO:tasks.workunit.client.1.smithi102.stdout:7/843: dwrite d1/d3/f93 [0,4194304] 0 2024-09-19T09:02:45.761 INFO:tasks.workunit.client.0.smithi049.stdout:5/63: symlink d3/d5/l16 0 2024-09-19T09:02:45.762 INFO:tasks.workunit.client.1.smithi102.stdout:7/844: truncate d1/d4/dca/f77 5233521 0 2024-09-19T09:02:45.762 INFO:tasks.workunit.client.1.smithi102.stdout:3/896: fsync d2/d19/d1c/fe8 0 2024-09-19T09:02:45.767 INFO:tasks.workunit.client.1.smithi102.stdout:6/716: getdents d1/d26/d4b/d94 0 2024-09-19T09:02:45.768 INFO:tasks.workunit.client.0.smithi049.stdout:5/64: dwrite d3/d5/de/d12/f13 [0,4194304] 0 2024-09-19T09:02:45.768 INFO:tasks.workunit.client.0.smithi049.stdout:6/63: stat dc/d12/f14 0 2024-09-19T09:02:45.769 INFO:tasks.workunit.client.0.smithi049.stdout:5/65: chown d3/d5/de 711885 1 2024-09-19T09:02:45.770 INFO:tasks.workunit.client.0.smithi049.stdout:5/66: readlink d3/d5/l16 0 2024-09-19T09:02:45.770 INFO:tasks.workunit.client.0.smithi049.stdout:3/103: creat d10/d11/d13/f28 x:0 0 0 2024-09-19T09:02:45.772 INFO:tasks.workunit.client.1.smithi102.stdout:1/769: unlink dd/d14/d35/d49/d62/d9e/dab/cee 0 2024-09-19T09:02:45.772 INFO:tasks.workunit.client.0.smithi049.stdout:3/104: chown d10/d11/c25 123300340 1 2024-09-19T09:02:45.773 INFO:tasks.workunit.client.1.smithi102.stdout:2/703: sync 2024-09-19T09:02:45.773 INFO:tasks.workunit.client.1.smithi102.stdout:9/774: sync 2024-09-19T09:02:45.773 INFO:tasks.workunit.client.1.smithi102.stdout:5/774: sync 2024-09-19T09:02:45.778 INFO:tasks.workunit.client.1.smithi102.stdout:8/725: mknod d0/d4f/dc1/ce3 0 2024-09-19T09:02:45.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/105: unlink f6 0 2024-09-19T09:02:45.782 INFO:tasks.workunit.client.0.smithi049.stdout:5/67: rmdir d3/d5 39 2024-09-19T09:02:45.783 INFO:tasks.workunit.client.1.smithi102.stdout:1/770: stat dd/d13/d2d/d78/fb1 0 2024-09-19T09:02:45.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/192: creat d5/d10/d13/d15/d36/f3a x:0 0 0 2024-09-19T09:02:45.787 INFO:tasks.workunit.client.0.smithi049.stdout:0/193: dread - d5/d10/d13/d19/f33 zero size 2024-09-19T09:02:45.787 INFO:tasks.workunit.client.1.smithi102.stdout:5/775: unlink d5/d7/d1a/d37/d50/c7d 0 2024-09-19T09:02:45.787 INFO:tasks.workunit.client.0.smithi049.stdout:9/107: sync 2024-09-19T09:02:45.788 INFO:tasks.workunit.client.0.smithi049.stdout:9/108: fsync f1 0 2024-09-19T09:02:45.789 INFO:tasks.workunit.client.1.smithi102.stdout:0/938: dwrite d3/dd/d1a/d77/f8c [0,4194304] 0 2024-09-19T09:02:45.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/199: link d1/d1a/f41 d1/d1f/f48 0 2024-09-19T09:02:45.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/200: chown d1/d1f 62986424 1 2024-09-19T09:02:45.792 INFO:tasks.workunit.client.1.smithi102.stdout:7/845: mknod d1/d3/d20/c107 0 2024-09-19T09:02:45.794 INFO:tasks.workunit.client.0.smithi049.stdout:7/201: dread d1/d8/f1c [0,4194304] 0 2024-09-19T09:02:45.794 INFO:tasks.workunit.client.1.smithi102.stdout:9/775: dread d1/d2/d3/ff2 [0,4194304] 0 2024-09-19T09:02:45.794 INFO:tasks.workunit.client.1.smithi102.stdout:7/846: write d1/d4/dca/d52/f58 [1608458,95338] 0 2024-09-19T09:02:45.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/64: link f0 dc/d12/f15 0 2024-09-19T09:02:45.799 INFO:tasks.workunit.client.0.smithi049.stdout:3/106: symlink d10/d11/d13/l29 0 2024-09-19T09:02:45.801 INFO:tasks.workunit.client.0.smithi049.stdout:5/68: mknod d3/dc/c17 0 2024-09-19T09:02:45.802 INFO:tasks.workunit.client.1.smithi102.stdout:6/717: dwrite d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fad [0,4194304] 0 2024-09-19T09:02:45.804 INFO:tasks.workunit.client.1.smithi102.stdout:6/718: chown d1/d3a/f7c 890088 1 2024-09-19T09:02:45.804 INFO:tasks.workunit.client.0.smithi049.stdout:4/106: dwrite f0 [0,4194304] 0 2024-09-19T09:02:45.805 INFO:tasks.workunit.client.1.smithi102.stdout:2/704: symlink d7/d50/d64/d7f/d83/dc7/lf8 0 2024-09-19T09:02:45.807 INFO:tasks.workunit.client.1.smithi102.stdout:7/847: dwrite d1/d4/dca/d52/f58 [0,4194304] 0 2024-09-19T09:02:45.808 INFO:tasks.workunit.client.0.smithi049.stdout:9/109: rmdir d3/d14/d1a 39 2024-09-19T09:02:45.808 INFO:tasks.workunit.client.1.smithi102.stdout:6/719: chown d1/d26/d4b/ca3 0 1 2024-09-19T09:02:45.808 INFO:tasks.workunit.client.1.smithi102.stdout:9/776: dwrite d1/d2/d3/f31 [0,4194304] 0 2024-09-19T09:02:45.813 INFO:tasks.workunit.client.0.smithi049.stdout:5/69: dwrite d3/f8 [0,4194304] 0 2024-09-19T09:02:45.813 INFO:tasks.workunit.client.1.smithi102.stdout:8/726: dwrite d0/d10/f48 [0,4194304] 0 2024-09-19T09:02:45.814 INFO:tasks.workunit.client.0.smithi049.stdout:4/107: dread d4/fe [0,4194304] 0 2024-09-19T09:02:45.816 INFO:tasks.workunit.client.1.smithi102.stdout:3/897: creat d2/d19/d47/db/d26/d63/f11f x:0 0 0 2024-09-19T09:02:45.817 INFO:tasks.workunit.client.0.smithi049.stdout:7/202: mknod d1/d7/d13/d18/c49 0 2024-09-19T09:02:45.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/65: mkdir dc/d16 0 2024-09-19T09:02:45.818 INFO:tasks.workunit.client.0.smithi049.stdout:3/107: symlink d10/d11/d13/l2a 0 2024-09-19T09:02:45.819 INFO:tasks.workunit.client.1.smithi102.stdout:3/898: chown d2/d19/d47/db/d26/d63/fa0 1104 1 2024-09-19T09:02:45.820 INFO:tasks.workunit.client.1.smithi102.stdout:0/939: mknod d3/dd/d1a/c137 0 2024-09-19T09:02:45.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/66: chown l2 29 1 2024-09-19T09:02:45.821 INFO:tasks.workunit.client.0.smithi049.stdout:3/108: chown d10/d11/d13/f1f 117500710 1 2024-09-19T09:02:45.821 INFO:tasks.workunit.client.1.smithi102.stdout:4/895: getdents d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78 0 2024-09-19T09:02:45.824 INFO:tasks.workunit.client.1.smithi102.stdout:7/848: creat d1/d3/d20/dad/dcd/f108 x:0 0 0 2024-09-19T09:02:45.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/194: mkdir d5/d10/d13/d15/d29/d3b 0 2024-09-19T09:02:45.826 INFO:tasks.workunit.client.1.smithi102.stdout:9/777: creat d1/d2/d78/da0/ffd x:0 0 0 2024-09-19T09:02:45.826 INFO:tasks.workunit.client.1.smithi102.stdout:8/727: dwrite d0/d64/fc6 [0,4194304] 0 2024-09-19T09:02:45.827 INFO:tasks.workunit.client.1.smithi102.stdout:7/849: chown d1/la4 2168 1 2024-09-19T09:02:45.828 INFO:tasks.workunit.client.0.smithi049.stdout:2/81: sync 2024-09-19T09:02:45.828 INFO:tasks.workunit.client.0.smithi049.stdout:8/170: sync 2024-09-19T09:02:45.829 INFO:tasks.workunit.client.1.smithi102.stdout:7/850: dread - d1/fdd zero size 2024-09-19T09:02:45.830 INFO:tasks.workunit.client.1.smithi102.stdout:2/705: rename d7/d1a/fd1 to d7/d1a/d2b/dae/ff9 0 2024-09-19T09:02:45.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/109: dread d10/f1c [0,4194304] 0 2024-09-19T09:02:45.834 INFO:tasks.workunit.client.0.smithi049.stdout:4/108: unlink d4/d15/f1c 0 2024-09-19T09:02:45.836 INFO:tasks.workunit.client.1.smithi102.stdout:0/940: fsync d3/dd/d1a/d77/fce 0 2024-09-19T09:02:45.837 INFO:tasks.workunit.client.1.smithi102.stdout:0/941: symlink d3/dd/d1a/d32/d113/d11e/l138 2 2024-09-19T09:02:45.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/98: dread d5/d6/f10 [0,4194304] 0 2024-09-19T09:02:45.838 INFO:tasks.workunit.client.1.smithi102.stdout:3/899: mkdir d2/d19/d1c/d2f/d5a/d84/d4f/d72/d120 0 2024-09-19T09:02:45.839 INFO:tasks.workunit.client.1.smithi102.stdout:3/900: write d2/d19/d35/f5c [2954201,50937] 0 2024-09-19T09:02:45.840 INFO:tasks.workunit.client.0.smithi049.stdout:1/99: dread - d5/d6/dc/f16 zero size 2024-09-19T09:02:45.840 INFO:tasks.workunit.client.1.smithi102.stdout:3/901: write d2/d19/fb1 [1319848,25516] 0 2024-09-19T09:02:45.841 INFO:tasks.workunit.client.1.smithi102.stdout:3/902: dread - d2/d19/d47/db/d26/d63/dfd/f103 zero size 2024-09-19T09:02:45.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/100: read d5/d6/f10 [1598445,91249] 0 2024-09-19T09:02:45.843 INFO:tasks.workunit.client.1.smithi102.stdout:3/903: write d2/d19/d1c/d2f/d5a/d84/d53/ff5 [557939,63231] 0 2024-09-19T09:02:45.843 INFO:tasks.workunit.client.0.smithi049.stdout:4/109: dwrite d4/f12 [0,4194304] 0 2024-09-19T09:02:45.847 INFO:tasks.workunit.client.0.smithi049.stdout:0/195: mkdir d5/d10/d3c 0 2024-09-19T09:02:45.849 INFO:tasks.workunit.client.0.smithi049.stdout:2/82: write d1/f15 [712362,120203] 0 2024-09-19T09:02:45.849 INFO:tasks.workunit.client.1.smithi102.stdout:3/904: dwrite d2/d19/d47/db/d26/d63/d6f/fcf [0,4194304] 0 2024-09-19T09:02:45.850 INFO:tasks.workunit.client.1.smithi102.stdout:9/778: rmdir d1/d2/d78/da0/dc0 39 2024-09-19T09:02:45.852 INFO:tasks.workunit.client.1.smithi102.stdout:3/905: chown d2/d19/d1c/d2f/d5a/d84/d4f/c56 10 1 2024-09-19T09:02:45.853 INFO:tasks.workunit.client.0.smithi049.stdout:0/196: dread d5/d10/d13/d19/f2d [4194304,4194304] 0 2024-09-19T09:02:45.855 INFO:tasks.workunit.client.0.smithi049.stdout:9/110: creat d3/d14/d1a/f25 x:0 0 0 2024-09-19T09:02:45.861 INFO:tasks.workunit.client.0.smithi049.stdout:5/70: rename d3/d5/l16 to d3/d5/de/l18 0 2024-09-19T09:02:45.861 INFO:tasks.workunit.client.0.smithi049.stdout:0/197: dwrite d5/f20 [0,4194304] 0 2024-09-19T09:02:45.863 INFO:tasks.workunit.client.1.smithi102.stdout:0/942: creat d3/f139 x:0 0 0 2024-09-19T09:02:45.864 INFO:tasks.workunit.client.1.smithi102.stdout:0/943: fsync d3/dd/d72/feb 0 2024-09-19T09:02:45.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/71: read d3/d5/de/d12/f13 [1705012,110735] 0 2024-09-19T09:02:45.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/198: dread - d5/d10/d13/d19/f33 zero size 2024-09-19T09:02:45.864 INFO:tasks.workunit.client.1.smithi102.stdout:0/944: chown d3/dd/d1a/d32/d7f/d10c/d2a/d10b 49328 1 2024-09-19T09:02:45.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/203: symlink d1/d7/d13/l4a 0 2024-09-19T09:02:45.870 INFO:tasks.workunit.client.1.smithi102.stdout:1/771: truncate dd/d14/d35/d49/d62/d6c/f8d 160231 0 2024-09-19T09:02:45.870 INFO:tasks.workunit.client.1.smithi102.stdout:5/776: sync 2024-09-19T09:02:45.870 INFO:tasks.workunit.client.1.smithi102.stdout:4/896: symlink d14/d16/d17/de3/dbd/df3/l121 0 2024-09-19T09:02:45.872 INFO:tasks.workunit.client.1.smithi102.stdout:8/728: creat d0/dd3/fe4 x:0 0 0 2024-09-19T09:02:45.872 INFO:tasks.workunit.client.1.smithi102.stdout:6/720: dwrite d1/d26/d4b/d94/d8a/fb3 [0,4194304] 0 2024-09-19T09:02:45.872 INFO:tasks.workunit.client.1.smithi102.stdout:5/777: fsync d5/d7/d1a/daa/fd7 0 2024-09-19T09:02:45.873 INFO:tasks.workunit.client.1.smithi102.stdout:4/897: dread - d14/d34/d5a/d5c/f8d zero size 2024-09-19T09:02:45.874 INFO:tasks.workunit.client.1.smithi102.stdout:5/778: chown d5/d8d/d95/fbf 365016951 1 2024-09-19T09:02:45.874 INFO:tasks.workunit.client.1.smithi102.stdout:6/721: dread - d1/d26/d4b/d94/d8a/f6f zero size 2024-09-19T09:02:45.875 INFO:tasks.workunit.client.1.smithi102.stdout:3/906: unlink d2/f2d 0 2024-09-19T09:02:45.877 INFO:tasks.workunit.client.1.smithi102.stdout:2/706: unlink d7/da4/cf6 0 2024-09-19T09:02:45.881 INFO:tasks.workunit.client.0.smithi049.stdout:1/101: mknod d5/d6/d8/d13/c18 0 2024-09-19T09:02:45.884 INFO:tasks.workunit.client.1.smithi102.stdout:3/907: dwrite d2/d19/d47/db/dc3/d10f/f111 [0,4194304] 0 2024-09-19T09:02:45.886 INFO:tasks.workunit.client.1.smithi102.stdout:2/707: dwrite d7/d1a/d2b/d31/f48 [0,4194304] 0 2024-09-19T09:02:45.886 INFO:tasks.workunit.client.0.smithi049.stdout:2/83: mkdir d1/d4/d1e 0 2024-09-19T09:02:45.887 INFO:tasks.workunit.client.0.smithi049.stdout:6/67: truncate fb 3098288 0 2024-09-19T09:02:45.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/84: chown d1/d4/ce 477 1 2024-09-19T09:02:45.890 INFO:tasks.workunit.client.0.smithi049.stdout:3/110: mknod d10/c2b 0 2024-09-19T09:02:45.894 INFO:tasks.workunit.client.1.smithi102.stdout:9/779: mkdir d1/d2/d78/df7/dfe 0 2024-09-19T09:02:45.895 INFO:tasks.workunit.client.1.smithi102.stdout:6/722: dread d1/d18/db/f30 [0,4194304] 0 2024-09-19T09:02:45.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/111: rename d3/f13 to d3/d14/d1a/d21/f26 0 2024-09-19T09:02:45.897 INFO:tasks.workunit.client.1.smithi102.stdout:1/772: dwrite dd/d14/d35/d49/d7d/ff2 [0,4194304] 0 2024-09-19T09:02:45.898 INFO:tasks.workunit.client.0.smithi049.stdout:9/112: chown f1 1456137 1 2024-09-19T09:02:45.902 INFO:tasks.workunit.client.1.smithi102.stdout:4/898: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/d122 0 2024-09-19T09:02:45.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/110: write d4/f16 [1971203,62436] 0 2024-09-19T09:02:45.905 INFO:tasks.workunit.client.0.smithi049.stdout:4/111: chown d4/d15/f18 193506341 1 2024-09-19T09:02:45.905 INFO:tasks.workunit.client.1.smithi102.stdout:7/851: creat d1/d3/d72/f109 x:0 0 0 2024-09-19T09:02:45.915 INFO:tasks.workunit.client.1.smithi102.stdout:6/723: mknod d1/d26/d2e/d45/d47/d4d/d35/d41/cf4 0 2024-09-19T09:02:45.917 INFO:tasks.workunit.client.1.smithi102.stdout:5/779: dread d5/d7/d1a/d37/d39/d4c/f6b [0,4194304] 0 2024-09-19T09:02:45.917 INFO:tasks.workunit.client.1.smithi102.stdout:1/773: fsync dd/d5f/f96 0 2024-09-19T09:02:45.918 INFO:tasks.workunit.client.1.smithi102.stdout:1/774: stat dd/d5f/ca4 0 2024-09-19T09:02:45.918 INFO:tasks.workunit.client.1.smithi102.stdout:5/780: write d5/d7/d1a/f58 [3437527,109608] 0 2024-09-19T09:02:45.919 INFO:tasks.workunit.client.1.smithi102.stdout:5/781: fsync d5/d7/d1a/d37/d39/d81/fbb 0 2024-09-19T09:02:45.924 INFO:tasks.workunit.client.0.smithi049.stdout:7/204: mknod d1/c4b 0 2024-09-19T09:02:45.926 INFO:tasks.workunit.client.1.smithi102.stdout:9/780: link d1/d2/d3/d1d/f9a d1/d8/d98/fff 0 2024-09-19T09:02:45.927 INFO:tasks.workunit.client.0.smithi049.stdout:4/112: creat d4/d15/f20 x:0 0 0 2024-09-19T09:02:45.928 INFO:tasks.workunit.client.0.smithi049.stdout:1/102: mkdir d5/d6/d19 0 2024-09-19T09:02:45.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/113: read - d4/d15/f18 zero size 2024-09-19T09:02:45.929 INFO:tasks.workunit.client.1.smithi102.stdout:2/708: write d7/d1a/d2b/d31/dde/de9/f4b [412112,20073] 0 2024-09-19T09:02:45.930 INFO:tasks.workunit.client.0.smithi049.stdout:6/68: write dc/d12/f15 [560877,32792] 0 2024-09-19T09:02:45.930 INFO:tasks.workunit.client.0.smithi049.stdout:7/205: dread d1/d7/fa [0,4194304] 0 2024-09-19T09:02:45.932 INFO:tasks.workunit.client.0.smithi049.stdout:3/111: write d10/d11/d13/f14 [681776,37424] 0 2024-09-19T09:02:45.933 INFO:tasks.workunit.client.0.smithi049.stdout:7/206: truncate d1/d8/f2f 9307623 0 2024-09-19T09:02:45.935 INFO:tasks.workunit.client.0.smithi049.stdout:8/171: getdents d1 0 2024-09-19T09:02:45.936 INFO:tasks.workunit.client.0.smithi049.stdout:8/172: stat d1/d11/f1b 0 2024-09-19T09:02:45.938 INFO:tasks.workunit.client.0.smithi049.stdout:5/72: rename d3/d5/de/l18 to d3/d5/l19 0 2024-09-19T09:02:45.938 INFO:tasks.workunit.client.0.smithi049.stdout:5/73: chown d3 0 1 2024-09-19T09:02:45.939 INFO:tasks.workunit.client.1.smithi102.stdout:6/724: dread d1/d18/f7 [0,4194304] 0 2024-09-19T09:02:45.939 INFO:tasks.workunit.client.1.smithi102.stdout:0/945: getdents d3/dd/d10/d15/d19/d7e 0 2024-09-19T09:02:45.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/74: dread - d3/f10 zero size 2024-09-19T09:02:45.939 INFO:tasks.workunit.client.1.smithi102.stdout:0/946: stat d3/dd/d10/d15/d19/d8d 0 2024-09-19T09:02:45.940 INFO:tasks.workunit.client.1.smithi102.stdout:6/725: write d1/d26/d2e/d45/daf/d8d/f9c [5049411,130795] 0 2024-09-19T09:02:45.940 INFO:tasks.workunit.client.1.smithi102.stdout:8/729: getdents d0/d5a 0 2024-09-19T09:02:45.941 INFO:tasks.workunit.client.1.smithi102.stdout:0/947: write d3/dd/f1f [4752593,36227] 0 2024-09-19T09:02:45.943 INFO:tasks.workunit.client.0.smithi049.stdout:2/85: truncate f0 1435751 0 2024-09-19T09:02:45.943 INFO:tasks.workunit.client.1.smithi102.stdout:9/781: creat d1/d2/d3/d1d/d4f/f100 x:0 0 0 2024-09-19T09:02:45.943 INFO:tasks.workunit.client.1.smithi102.stdout:9/782: dread - d1/d2/d3/d6f/d8d/da2/fe9 zero size 2024-09-19T09:02:45.944 INFO:tasks.workunit.client.0.smithi049.stdout:1/103: readlink d5/d6/dc/l17 0 2024-09-19T09:02:45.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/114: rmdir d4/d15/d19 39 2024-09-19T09:02:45.945 INFO:tasks.workunit.client.1.smithi102.stdout:4/899: rename d14/d16/d17/de3/dbd/df3/d60/c9b to d14/d16/c123 0 2024-09-19T09:02:45.948 INFO:tasks.workunit.client.1.smithi102.stdout:0/948: symlink d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/d133/l13a 0 2024-09-19T09:02:45.949 INFO:tasks.workunit.client.1.smithi102.stdout:0/949: chown d3/dd/d1a/d32/d7f/d10c/d2a/dba/d9d/f116 93113169 1 2024-09-19T09:02:45.950 INFO:tasks.workunit.client.1.smithi102.stdout:0/950: readlink d3/dd/d1a/d32/d7f/lfd 0 2024-09-19T09:02:45.950 INFO:tasks.workunit.client.1.smithi102.stdout:2/709: mkdir d7/d11/dc8/dfa 0 2024-09-19T09:02:45.951 INFO:tasks.workunit.client.1.smithi102.stdout:0/951: chown d3/dd/fb4 3366316 1 2024-09-19T09:02:45.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/115: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:45.953 INFO:tasks.workunit.client.1.smithi102.stdout:9/783: rmdir d1/d2/d3/dd0 39 2024-09-19T09:02:45.953 INFO:tasks.workunit.client.1.smithi102.stdout:9/784: readlink d1/d2/la5 0 2024-09-19T09:02:45.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/75: write d3/f6 [259302,122828] 0 2024-09-19T09:02:45.964 INFO:tasks.workunit.client.0.smithi049.stdout:0/199: getdents d5 0 2024-09-19T09:02:45.965 INFO:tasks.workunit.client.1.smithi102.stdout:4/900: rmdir d14/d16 39 2024-09-19T09:02:45.965 INFO:tasks.workunit.client.1.smithi102.stdout:8/730: dread d0/f56 [4194304,4194304] 0 2024-09-19T09:02:45.966 INFO:tasks.workunit.client.0.smithi049.stdout:4/116: dwrite d4/d15/f18 [0,4194304] 0 2024-09-19T09:02:45.967 INFO:tasks.workunit.client.0.smithi049.stdout:4/117: write d4/f13 [4731589,117871] 0 2024-09-19T09:02:45.968 INFO:tasks.workunit.client.0.smithi049.stdout:0/200: write d5/d10/f1d [1639472,127899] 0 2024-09-19T09:02:45.968 INFO:tasks.workunit.client.1.smithi102.stdout:1/775: getdents dd/d14/d35/d49/d62/d9e 0 2024-09-19T09:02:45.974 INFO:tasks.workunit.client.1.smithi102.stdout:2/710: symlink d7/d1a/d2b/d31/dde/de9/d37/daf/lfb 0 2024-09-19T09:02:45.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/69: mkdir dc/d16/d17 0 2024-09-19T09:02:45.978 INFO:tasks.workunit.client.0.smithi049.stdout:3/112: creat d10/d11/d27/f2c x:0 0 0 2024-09-19T09:02:45.979 INFO:tasks.workunit.client.1.smithi102.stdout:8/731: mknod d0/db/d29/d97/ce5 0 2024-09-19T09:02:45.980 INFO:tasks.workunit.client.1.smithi102.stdout:8/732: write d0/db/fe1 [638186,120829] 0 2024-09-19T09:02:45.981 INFO:tasks.workunit.client.0.smithi049.stdout:4/118: dwrite d4/f12 [4194304,4194304] 0 2024-09-19T09:02:45.981 INFO:tasks.workunit.client.1.smithi102.stdout:2/711: symlink d7/d11/dc8/lfc 0 2024-09-19T09:02:45.982 INFO:tasks.workunit.client.0.smithi049.stdout:9/113: rename d3/c1b to d3/c27 0 2024-09-19T09:02:45.982 INFO:tasks.workunit.client.0.smithi049.stdout:7/207: dwrite d1/d1f/f48 [0,4194304] 0 2024-09-19T09:02:45.984 INFO:tasks.workunit.client.0.smithi049.stdout:5/76: creat d3/d5/de/f1a x:0 0 0 2024-09-19T09:02:45.987 INFO:tasks.workunit.client.1.smithi102.stdout:8/733: creat d0/d4f/fe6 x:0 0 0 2024-09-19T09:02:45.987 INFO:tasks.workunit.client.1.smithi102.stdout:8/734: dread - d0/d4f/fe6 zero size 2024-09-19T09:02:45.989 INFO:tasks.workunit.client.0.smithi049.stdout:3/113: dwrite d10/d11/d27/f2c [0,4194304] 0 2024-09-19T09:02:45.992 INFO:tasks.workunit.client.1.smithi102.stdout:9/785: rename d1/d2/d3/d6f/d8d/da2/lc2 to d1/d2/d3/d1d/d4f/d6d/d81/l101 0 2024-09-19T09:02:45.994 INFO:tasks.workunit.client.0.smithi049.stdout:0/201: rename d5/d10/d13/d19 to d5/d10/d13/d15/d36/d3d 0 2024-09-19T09:02:45.996 INFO:tasks.workunit.client.1.smithi102.stdout:8/735: creat d0/d10/d21/db3/fe7 x:0 0 0 2024-09-19T09:02:45.997 INFO:tasks.workunit.client.1.smithi102.stdout:8/736: chown d0/db/c6b 33331168 1 2024-09-19T09:02:46.001 INFO:tasks.workunit.client.1.smithi102.stdout:4/901: rename d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/ff5 to d14/d34/d5a/d5c/d81/d75/f124 0 2024-09-19T09:02:46.003 INFO:tasks.workunit.client.1.smithi102.stdout:9/786: unlink d1/d8/l4e 0 2024-09-19T09:02:46.003 INFO:tasks.workunit.client.1.smithi102.stdout:8/737: dwrite d0/d10/d21/db3/fdc [0,4194304] 0 2024-09-19T09:02:46.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/104: mkdir d5/d6/d8/d1a 0 2024-09-19T09:02:46.008 INFO:tasks.workunit.client.1.smithi102.stdout:9/787: dread d1/d2/d3/d1d/d4f/d6d/d81/d90/faf [0,4194304] 0 2024-09-19T09:02:46.012 INFO:tasks.workunit.client.1.smithi102.stdout:9/788: chown d1/d8/d1c/c55 393185 1 2024-09-19T09:02:46.016 INFO:tasks.workunit.client.1.smithi102.stdout:2/712: rename d7/d1a/d2b/d31/d51/d6b/f8c to d7/d1a/d2b/ffd 0 2024-09-19T09:02:46.017 INFO:tasks.workunit.client.0.smithi049.stdout:0/202: creat d5/d10/d13/d15/d29/f3e x:0 0 0 2024-09-19T09:02:46.019 INFO:tasks.workunit.client.1.smithi102.stdout:9/789: chown d1/d2/c39 886 1 2024-09-19T09:02:46.022 INFO:tasks.workunit.client.1.smithi102.stdout:4/902: rename d14/d34/d5a/d5c/d81/d75/fb9 to d14/d16/d17/de3/dbd/df3/d37/f125 0 2024-09-19T09:02:46.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/105: dwrite d5/d6/f9 [0,4194304] 0 2024-09-19T09:02:46.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/119: link d4/d15/f18 d4/f21 0 2024-09-19T09:02:46.025 INFO:tasks.workunit.client.1.smithi102.stdout:9/790: mknod d1/d2/d3/d1d/d4f/d6d/c102 0 2024-09-19T09:02:46.029 INFO:tasks.workunit.client.1.smithi102.stdout:4/903: rename d14/d16/ff1 to d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/f126 0 2024-09-19T09:02:46.029 INFO:tasks.workunit.client.1.smithi102.stdout:4/904: readlink d14/l19 0 2024-09-19T09:02:46.031 INFO:tasks.workunit.client.0.smithi049.stdout:3/114: link fe d10/d11/d13/f2d 0 2024-09-19T09:02:46.035 INFO:tasks.workunit.client.1.smithi102.stdout:4/905: dwrite d14/d16/d17/f1c [0,4194304] 0 2024-09-19T09:02:46.035 INFO:tasks.workunit.client.0.smithi049.stdout:8/173: getdents d1 0 2024-09-19T09:02:46.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/120: dwrite d4/f17 [0,4194304] 0 2024-09-19T09:02:46.037 INFO:tasks.workunit.client.0.smithi049.stdout:8/174: fsync d1/fb 0 2024-09-19T09:02:46.037 INFO:tasks.workunit.client.0.smithi049.stdout:9/114: creat d3/f28 x:0 0 0 2024-09-19T09:02:46.038 INFO:tasks.workunit.client.0.smithi049.stdout:7/208: creat d1/d7/f4c x:0 0 0 2024-09-19T09:02:46.039 INFO:tasks.workunit.client.0.smithi049.stdout:8/175: fsync d1/d27/f28 0 2024-09-19T09:02:46.039 INFO:tasks.workunit.client.0.smithi049.stdout:6/70: link dc/d12/f14 dc/d16/f18 0 2024-09-19T09:02:46.041 INFO:tasks.workunit.client.1.smithi102.stdout:4/906: symlink d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/d116/l127 0 2024-09-19T09:02:46.044 INFO:tasks.workunit.client.0.smithi049.stdout:9/115: symlink d3/d14/d1a/d21/l29 0 2024-09-19T09:02:46.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/209: dread d1/d1a/f38 [0,4194304] 0 2024-09-19T09:02:46.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/116: write d3/d14/f1d [153848,110913] 0 2024-09-19T09:02:46.045 INFO:tasks.workunit.client.1.smithi102.stdout:4/907: mknod d14/d16/d17/de3/dbd/df3/d37/d58/d89/c128 0 2024-09-19T09:02:46.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/210: truncate d1/d8/f2f 9925591 0 2024-09-19T09:02:46.046 INFO:tasks.workunit.client.0.smithi049.stdout:9/117: read d3/d14/f19 [3026031,31989] 0 2024-09-19T09:02:46.047 INFO:tasks.workunit.client.0.smithi049.stdout:8/176: creat d1/f33 x:0 0 0 2024-09-19T09:02:46.049 INFO:tasks.workunit.client.0.smithi049.stdout:1/106: rename d5/d6/d8/d13/f15 to d5/d6/f1b 0 2024-09-19T09:02:46.055 INFO:tasks.workunit.client.1.smithi102.stdout:4/908: rename d14/d16/d17/de3/dbd/df3/d37/f3e to d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/f129 0 2024-09-19T09:02:46.055 INFO:tasks.workunit.client.1.smithi102.stdout:4/909: dread - d14/d34/d5a/d5c/d79/ffc zero size 2024-09-19T09:02:46.056 INFO:tasks.workunit.client.0.smithi049.stdout:0/203: link d5/d10/d13/d15/l2a d5/d10/d13/d15/d36/d3d/l3f 0 2024-09-19T09:02:46.056 INFO:tasks.workunit.client.0.smithi049.stdout:8/177: mknod d1/d1a/c34 0 2024-09-19T09:02:46.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/204: write d5/d10/d13/d15/d36/d3d/f24 [101805,47155] 0 2024-09-19T09:02:46.057 INFO:tasks.workunit.client.0.smithi049.stdout:3/115: rename d10/d11/f21 to d10/d11/d27/f2e 0 2024-09-19T09:02:46.059 INFO:tasks.workunit.client.1.smithi102.stdout:4/910: mknod d14/d34/d5a/d5c/d81/c12a 0 2024-09-19T09:02:46.060 INFO:tasks.workunit.client.0.smithi049.stdout:1/107: mknod d5/d6/dc/c1c 0 2024-09-19T09:02:46.062 INFO:tasks.workunit.client.0.smithi049.stdout:1/108: read d5/d6/d8/f14 [2931992,130546] 0 2024-09-19T09:02:46.063 INFO:tasks.workunit.client.1.smithi102.stdout:4/911: dread d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/f11e [0,4194304] 0 2024-09-19T09:02:46.064 INFO:tasks.workunit.client.0.smithi049.stdout:9/118: unlink d3/c11 0 2024-09-19T09:02:46.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/116: dwrite d10/d11/d27/f2c [0,4194304] 0 2024-09-19T09:02:46.067 INFO:tasks.workunit.client.1.smithi102.stdout:4/912: creat d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/f12b x:0 0 0 2024-09-19T09:02:46.067 INFO:tasks.workunit.client.0.smithi049.stdout:8/178: creat d1/d27/f35 x:0 0 0 2024-09-19T09:02:46.069 INFO:tasks.workunit.client.0.smithi049.stdout:4/121: link d4/d15/c1d d4/d15/d19/d1f/c22 0 2024-09-19T09:02:46.069 INFO:tasks.workunit.client.1.smithi102.stdout:4/913: read d14/d16/d17/de3/dbd/df3/d37/f4a [2497941,108704] 0 2024-09-19T09:02:46.071 INFO:tasks.workunit.client.0.smithi049.stdout:6/71: getdents dc/d12 0 2024-09-19T09:02:46.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/205: dread d5/d10/d13/d15/f1b [0,4194304] 0 2024-09-19T09:02:46.072 INFO:tasks.workunit.client.1.smithi102.stdout:3/908: sync 2024-09-19T09:02:46.072 INFO:tasks.workunit.client.1.smithi102.stdout:3/909: chown d2/d19/d1c/d2f/d5a/d84/d64/fb2 447 1 2024-09-19T09:02:46.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/117: rename d10/d11/d13/l2a to d10/d11/l2f 0 2024-09-19T09:02:46.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/72: creat dc/f19 x:0 0 0 2024-09-19T09:02:46.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/73: stat fa 0 2024-09-19T09:02:46.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/109: symlink d5/d6/d8/d1a/l1d 0 2024-09-19T09:02:46.086 INFO:tasks.workunit.client.1.smithi102.stdout:3/910: link d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/d77/f116 d2/d19/d1c/d2f/f121 0 2024-09-19T09:02:46.087 INFO:tasks.workunit.client.0.smithi049.stdout:9/119: symlink d3/l2a 0 2024-09-19T09:02:46.087 INFO:tasks.workunit.client.0.smithi049.stdout:4/122: mknod d4/d15/d19/d1f/c23 0 2024-09-19T09:02:46.087 INFO:tasks.workunit.client.0.smithi049.stdout:8/179: rename d1/f15 to d1/d27/f36 0 2024-09-19T09:02:46.087 INFO:tasks.workunit.client.1.smithi102.stdout:3/911: symlink d2/d19/d1c/d2f/d5a/d84/l122 0 2024-09-19T09:02:46.089 INFO:tasks.workunit.client.0.smithi049.stdout:0/206: mknod d5/d10/d13/d15/d29/d3b/c40 0 2024-09-19T09:02:46.090 INFO:tasks.workunit.client.1.smithi102.stdout:3/912: dread d2/d19/d47/db/d26/d63/d6f/fcf [0,4194304] 0 2024-09-19T09:02:46.091 INFO:tasks.workunit.client.1.smithi102.stdout:3/913: readlink d2/d19/le1 0 2024-09-19T09:02:46.096 INFO:tasks.workunit.client.0.smithi049.stdout:6/74: truncate dc/ff 2542765 0 2024-09-19T09:02:46.097 INFO:tasks.workunit.client.1.smithi102.stdout:3/914: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f123 x:0 0 0 2024-09-19T09:02:46.104 INFO:tasks.workunit.client.0.smithi049.stdout:6/75: write f3 [3605705,38227] 0 2024-09-19T09:02:46.106 INFO:tasks.workunit.client.0.smithi049.stdout:3/118: dwrite d10/d11/d13/f2d [0,4194304] 0 2024-09-19T09:02:46.107 INFO:tasks.workunit.client.0.smithi049.stdout:8/180: dwrite d1/d27/f35 [0,4194304] 0 2024-09-19T09:02:46.108 INFO:tasks.workunit.client.0.smithi049.stdout:6/76: chown dc/d16 219656 1 2024-09-19T09:02:46.110 INFO:tasks.workunit.client.0.smithi049.stdout:8/181: chown d1/d27/f36 19 1 2024-09-19T09:02:46.116 INFO:tasks.workunit.client.0.smithi049.stdout:3/119: mkdir d10/d11/d13/d30 0 2024-09-19T09:02:46.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/120: fdatasync fc 0 2024-09-19T09:02:46.119 INFO:tasks.workunit.client.1.smithi102.stdout:2/713: dread d7/d1a/f49 [0,4194304] 0 2024-09-19T09:02:46.120 INFO:tasks.workunit.client.1.smithi102.stdout:2/714: chown d7 1198776 1 2024-09-19T09:02:46.120 INFO:tasks.workunit.client.0.smithi049.stdout:9/120: dwrite d3/d14/d1a/d21/f26 [0,4194304] 0 2024-09-19T09:02:46.121 INFO:tasks.workunit.client.1.smithi102.stdout:0/952: write d3/dd/d10/d15/d19/f46 [772682,126565] 0 2024-09-19T09:02:46.123 INFO:tasks.workunit.client.0.smithi049.stdout:8/182: mknod d1/d27/c37 0 2024-09-19T09:02:46.124 INFO:tasks.workunit.client.0.smithi049.stdout:5/77: fsync d3/d5/de/f1a 0 2024-09-19T09:02:46.126 INFO:tasks.workunit.client.0.smithi049.stdout:0/207: dwrite d5/d10/d13/d15/d36/f3a [0,4194304] 0 2024-09-19T09:02:46.134 INFO:tasks.workunit.client.1.smithi102.stdout:0/953: mknod d3/dcf/df0/c13b 0 2024-09-19T09:02:46.134 INFO:tasks.workunit.client.0.smithi049.stdout:3/121: dread fd [0,4194304] 0 2024-09-19T09:02:46.136 INFO:tasks.workunit.client.1.smithi102.stdout:0/954: read - d3/dd/d10/f106 zero size 2024-09-19T09:02:46.137 INFO:tasks.workunit.client.0.smithi049.stdout:3/122: write fe [3152001,22407] 0 2024-09-19T09:02:46.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/183: dread d1/ff [0,4194304] 0 2024-09-19T09:02:46.138 INFO:tasks.workunit.client.1.smithi102.stdout:2/715: mkdir d7/d1a/d2b/d4e/dfe 0 2024-09-19T09:02:46.139 INFO:tasks.workunit.client.1.smithi102.stdout:8/738: dwrite d0/d10/d21/d39/d50/da2/fa7 [0,4194304] 0 2024-09-19T09:02:46.141 INFO:tasks.workunit.client.1.smithi102.stdout:7/852: sync 2024-09-19T09:02:46.141 INFO:tasks.workunit.client.1.smithi102.stdout:1/776: sync 2024-09-19T09:02:46.141 INFO:tasks.workunit.client.1.smithi102.stdout:6/726: sync 2024-09-19T09:02:46.141 INFO:tasks.workunit.client.1.smithi102.stdout:5/782: sync 2024-09-19T09:02:46.143 INFO:tasks.workunit.client.1.smithi102.stdout:6/727: chown d1/d26/d2e/d45 14398935 1 2024-09-19T09:02:46.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/121: dread - d3/f15 zero size 2024-09-19T09:02:46.146 INFO:tasks.workunit.client.1.smithi102.stdout:7/853: truncate d1/d3/d20/f101 224313 0 2024-09-19T09:02:46.147 INFO:tasks.workunit.client.0.smithi049.stdout:4/123: getdents d4 0 2024-09-19T09:02:46.151 INFO:tasks.workunit.client.1.smithi102.stdout:6/728: dwrite d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fa7 [0,4194304] 0 2024-09-19T09:02:46.152 INFO:tasks.workunit.client.1.smithi102.stdout:8/739: mkdir d0/d4f/de8 0 2024-09-19T09:02:46.156 INFO:tasks.workunit.client.0.smithi049.stdout:0/208: creat d5/d10/d13/d15/d36/f41 x:0 0 0 2024-09-19T09:02:46.156 INFO:tasks.workunit.client.0.smithi049.stdout:9/122: dwrite f1 [8388608,4194304] 0 2024-09-19T09:02:46.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/124: dread d4/f6 [0,4194304] 0 2024-09-19T09:02:46.160 INFO:tasks.workunit.client.1.smithi102.stdout:2/716: rename d7/d1a/d2b/d4e/f94 to d7/d1a/d2b/d31/dde/de9/fff 0 2024-09-19T09:02:46.162 INFO:tasks.workunit.client.0.smithi049.stdout:9/123: read d3/d14/d1a/d21/f26 [2604263,46520] 0 2024-09-19T09:02:46.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/124: stat d3/f28 0 2024-09-19T09:02:46.164 INFO:tasks.workunit.client.0.smithi049.stdout:9/125: chown d3/l2a 0 1 2024-09-19T09:02:46.166 INFO:tasks.workunit.client.1.smithi102.stdout:1/777: dread - dd/d14/d35/d49/d62/d6c/d99/db8/fde zero size 2024-09-19T09:02:46.167 INFO:tasks.workunit.client.1.smithi102.stdout:9/791: dwrite d1/d2/d3/f12 [0,4194304] 0 2024-09-19T09:02:46.169 INFO:tasks.workunit.client.1.smithi102.stdout:9/792: write d1/d2/d3/d1d/d4f/d6d/d81/f92 [213468,49657] 0 2024-09-19T09:02:46.171 INFO:tasks.workunit.client.0.smithi049.stdout:8/184: truncate d1/f14 1292644 0 2024-09-19T09:02:46.171 INFO:tasks.workunit.client.1.smithi102.stdout:0/955: truncate d3/dd/d1a/f51 826332 0 2024-09-19T09:02:46.172 INFO:tasks.workunit.client.1.smithi102.stdout:9/793: write d1/d2/d3/ff9 [99140,191] 0 2024-09-19T09:02:46.172 INFO:tasks.workunit.client.1.smithi102.stdout:0/956: dread - d3/f139 zero size 2024-09-19T09:02:46.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/123: dread d10/f1c [0,4194304] 0 2024-09-19T09:02:46.176 INFO:tasks.workunit.client.1.smithi102.stdout:9/794: dwrite d1/d2/d3/f31 [0,4194304] 0 2024-09-19T09:02:46.178 INFO:tasks.workunit.client.1.smithi102.stdout:7/854: symlink d1/d3/d20/dad/l10a 0 2024-09-19T09:02:46.181 INFO:tasks.workunit.client.1.smithi102.stdout:6/729: write d1/d18/d37/fd5 [2195534,129718] 0 2024-09-19T09:02:46.183 INFO:tasks.workunit.client.1.smithi102.stdout:9/795: dwrite d1/d2/d3/d6f/fc8 [0,4194304] 0 2024-09-19T09:02:46.188 INFO:tasks.workunit.client.1.smithi102.stdout:8/740: dread d0/fd [4194304,4194304] 0 2024-09-19T09:02:46.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/124: dwrite d10/d11/d13/f28 [0,4194304] 0 2024-09-19T09:02:46.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/125: chown d10/d11/d27/f2e 572 1 2024-09-19T09:02:46.188 INFO:tasks.workunit.client.1.smithi102.stdout:2/717: symlink d7/d1a/d2b/d31/dde/de9/d37/daf/l100 0 2024-09-19T09:02:46.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/125: rename d4/d15/f18 to d4/f24 0 2024-09-19T09:02:46.189 INFO:tasks.workunit.client.1.smithi102.stdout:2/718: chown d7/d1a/d2b/d31/fc1 0 1 2024-09-19T09:02:46.191 INFO:tasks.workunit.client.1.smithi102.stdout:2/719: dread - d7/d1a/d56/db9/fdd zero size 2024-09-19T09:02:46.192 INFO:tasks.workunit.client.1.smithi102.stdout:2/720: write d7/d1a/d2b/f81 [5030972,23153] 0 2024-09-19T09:02:46.193 INFO:tasks.workunit.client.1.smithi102.stdout:2/721: dread - d7/d11/fb2 zero size 2024-09-19T09:02:46.200 INFO:tasks.workunit.client.1.smithi102.stdout:1/778: dread dd/d13/d2d/d78/fa7 [0,4194304] 0 2024-09-19T09:02:46.203 INFO:tasks.workunit.client.0.smithi049.stdout:7/211: truncate d1/d1f/f29 1951217 0 2024-09-19T09:02:46.204 INFO:tasks.workunit.client.0.smithi049.stdout:4/126: dread d4/f16 [0,4194304] 0 2024-09-19T09:02:46.207 INFO:tasks.workunit.client.0.smithi049.stdout:8/185: symlink d1/d11/l38 0 2024-09-19T09:02:46.208 INFO:tasks.workunit.client.1.smithi102.stdout:6/730: dread - d1/d18/f7e zero size 2024-09-19T09:02:46.208 INFO:tasks.workunit.client.0.smithi049.stdout:8/186: truncate d1/d27/f35 4805742 0 2024-09-19T09:02:46.209 INFO:tasks.workunit.client.0.smithi049.stdout:8/187: stat d1/d27/f28 0 2024-09-19T09:02:46.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/188: write d1/d11/f1b [1348287,54398] 0 2024-09-19T09:02:46.211 INFO:tasks.workunit.client.0.smithi049.stdout:8/189: readlink d1/d1a/l1c 0 2024-09-19T09:02:46.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/77: getdents dc 0 2024-09-19T09:02:46.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/78: truncate fa 838939 0 2024-09-19T09:02:46.214 INFO:tasks.workunit.client.1.smithi102.stdout:4/914: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/de2/fad [4194304,4194304] 0 2024-09-19T09:02:46.215 INFO:tasks.workunit.client.0.smithi049.stdout:6/79: rename dc to dc/d16/d17/d1a 22 2024-09-19T09:02:46.217 INFO:tasks.workunit.client.1.smithi102.stdout:2/722: rmdir d7/d50/d64 39 2024-09-19T09:02:46.223 INFO:tasks.workunit.client.1.smithi102.stdout:0/957: creat d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/d133/d100/f13c x:0 0 0 2024-09-19T09:02:46.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/126: unlink d3/ld 0 2024-09-19T09:02:46.227 INFO:tasks.workunit.client.1.smithi102.stdout:6/731: readlink d1/d26/d2e/d45/d47/d4d/d35/l71 0 2024-09-19T09:02:46.227 INFO:tasks.workunit.client.1.smithi102.stdout:0/958: read d3/dd/d1a/d32/d7f/d10c/d37/d3d/d90/fb0 [708464,90889] 0 2024-09-19T09:02:46.229 INFO:tasks.workunit.client.1.smithi102.stdout:3/915: write d2/d19/d1c/d2f/d5a/d84/d64/faf [442840,29633] 0 2024-09-19T09:02:46.231 INFO:tasks.workunit.client.0.smithi049.stdout:8/190: write d1/ff [4707471,1749] 0 2024-09-19T09:02:46.233 INFO:tasks.workunit.client.0.smithi049.stdout:5/78: getdents d3/dc 0 2024-09-19T09:02:46.233 INFO:tasks.workunit.client.1.smithi102.stdout:4/915: chown d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/la7 185 1 2024-09-19T09:02:46.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/110: dwrite d5/d6/f10 [0,4194304] 0 2024-09-19T09:02:46.235 INFO:tasks.workunit.client.1.smithi102.stdout:2/723: fdatasync d7/d1a/d2b/f2d 0 2024-09-19T09:02:46.236 INFO:tasks.workunit.client.0.smithi049.stdout:1/111: dread - d5/d6/d8/d13/f12 zero size 2024-09-19T09:02:46.238 INFO:tasks.workunit.client.1.smithi102.stdout:1/779: rename dd/d13/d2d/ld6 to dd/d68/lfd 0 2024-09-19T09:02:46.240 INFO:tasks.workunit.client.0.smithi049.stdout:0/209: rmdir d5/d10/d13/d15/d36/d3d/d26 0 2024-09-19T09:02:46.241 INFO:tasks.workunit.client.1.smithi102.stdout:1/780: dread dd/d14/f2b [0,4194304] 0 2024-09-19T09:02:46.244 INFO:tasks.workunit.client.0.smithi049.stdout:3/126: creat d10/d11/d13/d30/f31 x:0 0 0 2024-09-19T09:02:46.244 INFO:tasks.workunit.client.0.smithi049.stdout:3/127: stat d10/d11/f1a 0 2024-09-19T09:02:46.246 INFO:tasks.workunit.client.0.smithi049.stdout:3/128: write d10/d11/d13/f1f [88051,43763] 0 2024-09-19T09:02:46.246 INFO:tasks.workunit.client.1.smithi102.stdout:5/783: dwrite d5/d7/f35 [4194304,4194304] 0 2024-09-19T09:02:46.246 INFO:tasks.workunit.client.1.smithi102.stdout:0/959: rmdir d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd 39 2024-09-19T09:02:46.250 INFO:tasks.workunit.client.1.smithi102.stdout:8/741: creat d0/d10/d21/fe9 x:0 0 0 2024-09-19T09:02:46.251 INFO:tasks.workunit.client.1.smithi102.stdout:8/742: chown d0/d4f/fe6 4445334 1 2024-09-19T09:02:46.251 INFO:tasks.workunit.client.1.smithi102.stdout:5/784: dread d5/d60/fd5 [0,4194304] 0 2024-09-19T09:02:46.252 INFO:tasks.workunit.client.1.smithi102.stdout:8/743: stat d0/d10/d21/d39/l40 0 2024-09-19T09:02:46.253 INFO:tasks.workunit.client.1.smithi102.stdout:3/916: symlink d2/d19/d47/db/d26/d63/d6f/d96/l124 0 2024-09-19T09:02:46.253 INFO:tasks.workunit.client.1.smithi102.stdout:5/785: chown d5/d60/db6/dd2/fed 1654148501 1 2024-09-19T09:02:46.253 INFO:tasks.workunit.client.0.smithi049.stdout:3/129: dwrite d10/f15 [0,4194304] 0 2024-09-19T09:02:46.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/212: mkdir d1/d4d 0 2024-09-19T09:02:46.261 INFO:tasks.workunit.client.1.smithi102.stdout:4/916: creat d14/d34/d5a/d5c/d79/d8c/f12c x:0 0 0 2024-09-19T09:02:46.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/213: dwrite d1/d1f/f2c [0,4194304] 0 2024-09-19T09:02:46.264 INFO:tasks.workunit.client.0.smithi049.stdout:7/214: stat d1/d7/d13/d18/f43 0 2024-09-19T09:02:46.266 INFO:tasks.workunit.client.0.smithi049.stdout:7/215: read - d1/d8/d2d/d31/f47 zero size 2024-09-19T09:02:46.268 INFO:tasks.workunit.client.0.smithi049.stdout:7/216: write d1/d8/d2d/d36/f45 [714619,49051] 0 2024-09-19T09:02:46.269 INFO:tasks.workunit.client.0.smithi049.stdout:8/191: rename d1/d11/f30 to d1/f39 0 2024-09-19T09:02:46.271 INFO:tasks.workunit.client.1.smithi102.stdout:0/960: dread d3/dd/d1a/d77/f8c [4194304,4194304] 0 2024-09-19T09:02:46.274 INFO:tasks.workunit.client.0.smithi049.stdout:5/79: stat d3/d5/l11 0 2024-09-19T09:02:46.276 INFO:tasks.workunit.client.1.smithi102.stdout:6/732: unlink d1/d18/db/fd1 0 2024-09-19T09:02:46.278 INFO:tasks.workunit.client.1.smithi102.stdout:7/855: dwrite d1/d4/d9c/f89 [0,4194304] 0 2024-09-19T09:02:46.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/80: dwrite d3/f10 [0,4194304] 0 2024-09-19T09:02:46.284 INFO:tasks.workunit.client.0.smithi049.stdout:5/81: write d3/f10 [2751876,98208] 0 2024-09-19T09:02:46.289 INFO:tasks.workunit.client.1.smithi102.stdout:6/733: dwrite d1/d26/d4b/d94/d8a/f6f [0,4194304] 0 2024-09-19T09:02:46.289 INFO:tasks.workunit.client.0.smithi049.stdout:1/112: dread d5/d6/d8/f14 [0,4194304] 0 2024-09-19T09:02:46.290 INFO:tasks.workunit.client.0.smithi049.stdout:9/127: mknod d3/d14/c2b 0 2024-09-19T09:02:46.290 INFO:tasks.workunit.client.1.smithi102.stdout:9/796: dwrite d1/d2/d3/f3c [0,4194304] 0 2024-09-19T09:02:46.291 INFO:tasks.workunit.client.1.smithi102.stdout:9/797: readlink d1/d2/d3/d1d/d4f/l75 0 2024-09-19T09:02:46.292 INFO:tasks.workunit.client.0.smithi049.stdout:3/130: creat d10/d11/d13/f32 x:0 0 0 2024-09-19T09:02:46.292 INFO:tasks.workunit.client.1.smithi102.stdout:3/917: stat d2/d19/d47/db/d26/d63/d6f/c99 0 2024-09-19T09:02:46.292 INFO:tasks.workunit.client.1.smithi102.stdout:9/798: readlink d1/d2/d7b/l54 0 2024-09-19T09:02:46.297 INFO:tasks.workunit.client.0.smithi049.stdout:8/192: chown l0 388 1 2024-09-19T09:02:46.297 INFO:tasks.workunit.client.1.smithi102.stdout:5/786: dread d5/d7/d1a/de1/f5c [0,4194304] 0 2024-09-19T09:02:46.298 INFO:tasks.workunit.client.1.smithi102.stdout:5/787: truncate d5/d7/d1a/de1/fda 602352 0 2024-09-19T09:02:46.299 INFO:tasks.workunit.client.0.smithi049.stdout:7/217: fsync d1/d8/f30 0 2024-09-19T09:02:46.305 INFO:tasks.workunit.client.0.smithi049.stdout:4/127: truncate f2 2339935 0 2024-09-19T09:02:46.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/82: rmdir d3/dc 39 2024-09-19T09:02:46.310 INFO:tasks.workunit.client.0.smithi049.stdout:6/80: truncate f9 2006811 0 2024-09-19T09:02:46.312 INFO:tasks.workunit.client.0.smithi049.stdout:1/113: creat d5/f1e x:0 0 0 2024-09-19T09:02:46.315 INFO:tasks.workunit.client.0.smithi049.stdout:3/131: rename d10/d11/d13/c20 to d10/d11/d13/d30/c33 0 2024-09-19T09:02:46.316 INFO:tasks.workunit.client.1.smithi102.stdout:5/788: dread d5/d7/d1a/daa/fd7 [4194304,4194304] 0 2024-09-19T09:02:46.316 INFO:tasks.workunit.client.0.smithi049.stdout:8/193: creat d1/d11/f3a x:0 0 0 2024-09-19T09:02:46.318 INFO:tasks.workunit.client.0.smithi049.stdout:6/81: dwrite dc/d12/f13 [0,4194304] 0 2024-09-19T09:02:46.321 INFO:tasks.workunit.client.0.smithi049.stdout:0/210: creat d5/d10/d13/f42 x:0 0 0 2024-09-19T09:02:46.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/128: fdatasync d4/fe 0 2024-09-19T09:02:46.331 INFO:tasks.workunit.client.0.smithi049.stdout:7/218: dread d1/d7/d13/d18/f43 [0,4194304] 0 2024-09-19T09:02:46.332 INFO:tasks.workunit.client.0.smithi049.stdout:2/86: sync 2024-09-19T09:02:46.337 INFO:tasks.workunit.client.0.smithi049.stdout:3/132: chown c0 244 1 2024-09-19T09:02:46.345 INFO:tasks.workunit.client.0.smithi049.stdout:4/129: fdatasync d4/f21 0 2024-09-19T09:02:46.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/128: creat d3/f2c x:0 0 0 2024-09-19T09:02:46.351 INFO:tasks.workunit.client.0.smithi049.stdout:4/130: dwrite d4/f17 [0,4194304] 0 2024-09-19T09:02:46.353 INFO:tasks.workunit.client.1.smithi102.stdout:2/724: mkdir d7/d11/dc8/dfa/d101 0 2024-09-19T09:02:46.353 INFO:tasks.workunit.client.0.smithi049.stdout:4/131: truncate d4/d15/f20 54485 0 2024-09-19T09:02:46.356 INFO:tasks.workunit.client.1.smithi102.stdout:8/744: sync 2024-09-19T09:02:46.356 INFO:tasks.workunit.client.0.smithi049.stdout:2/87: creat d1/d4/f1f x:0 0 0 2024-09-19T09:02:46.358 INFO:tasks.workunit.client.0.smithi049.stdout:3/133: write d10/d11/d27/f2e [644317,61863] 0 2024-09-19T09:02:46.359 INFO:tasks.workunit.client.1.smithi102.stdout:0/961: chown d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd/c118 606323 1 2024-09-19T09:02:46.360 INFO:tasks.workunit.client.0.smithi049.stdout:5/83: dwrite d3/d5/de/d12/f13 [0,4194304] 0 2024-09-19T09:02:46.363 INFO:tasks.workunit.client.1.smithi102.stdout:7/856: creat d1/d4/d9c/f10b x:0 0 0 2024-09-19T09:02:46.363 INFO:tasks.workunit.client.1.smithi102.stdout:7/857: chown d1/d3/d20/d6c/cd6 2139892951 1 2024-09-19T09:02:46.366 INFO:tasks.workunit.client.0.smithi049.stdout:5/84: dread d3/f10 [0,4194304] 0 2024-09-19T09:02:46.372 INFO:tasks.workunit.client.0.smithi049.stdout:0/211: write d5/f11 [9132245,118212] 0 2024-09-19T09:02:46.375 INFO:tasks.workunit.client.0.smithi049.stdout:9/129: read d3/f17 [3664734,85993] 0 2024-09-19T09:02:46.377 INFO:tasks.workunit.client.0.smithi049.stdout:1/114: link d5/d6/dc/f16 d5/d6/f1f 0 2024-09-19T09:02:46.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/130: truncate d3/f2c 687894 0 2024-09-19T09:02:46.378 INFO:tasks.workunit.client.1.smithi102.stdout:6/734: mkdir d1/d26/d2e/d45/dac/db2/df5 0 2024-09-19T09:02:46.380 INFO:tasks.workunit.client.1.smithi102.stdout:3/918: creat d2/d19/d1c/d1f/f125 x:0 0 0 2024-09-19T09:02:46.380 INFO:tasks.workunit.client.1.smithi102.stdout:3/919: chown d2/d1e/f93 996416 1 2024-09-19T09:02:46.381 INFO:tasks.workunit.client.1.smithi102.stdout:3/920: stat d2/d19/d35/dce/ddc/de5/lec 0 2024-09-19T09:02:46.381 INFO:tasks.workunit.client.0.smithi049.stdout:0/212: dwrite d5/d10/d13/d15/d36/d3d/f24 [0,4194304] 0 2024-09-19T09:02:46.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/132: creat d4/f25 x:0 0 0 2024-09-19T09:02:46.382 INFO:tasks.workunit.client.1.smithi102.stdout:3/921: write d2/d19/d47/db/d26/d63/fa0 [3504744,93709] 0 2024-09-19T09:02:46.384 INFO:tasks.workunit.client.1.smithi102.stdout:3/922: write d2/d19/d47/db/d26/d63/ff0 [962048,92006] 0 2024-09-19T09:02:46.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/88: rename d1/d16 to d1/d4/d20 0 2024-09-19T09:02:46.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/82: rmdir dc/d16/d17 0 2024-09-19T09:02:46.394 INFO:tasks.workunit.client.1.smithi102.stdout:2/725: unlink d7/d1a/d2b/d31/dde/de9/d37/d93/cdf 0 2024-09-19T09:02:46.395 INFO:tasks.workunit.client.1.smithi102.stdout:1/781: dwrite dd/d14/f27 [0,4194304] 0 2024-09-19T09:02:46.396 INFO:tasks.workunit.client.1.smithi102.stdout:2/726: readlink d7/d1a/d2b/d31/dde/de9/ld8 0 2024-09-19T09:02:46.398 INFO:tasks.workunit.client.1.smithi102.stdout:1/782: truncate dd/d7a/d8c/da6/fb0 1119738 0 2024-09-19T09:02:46.399 INFO:tasks.workunit.client.1.smithi102.stdout:8/745: symlink d0/d10/d21/d39/d50/d63/lea 0 2024-09-19T09:02:46.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/194: write d1/f14 [612139,83171] 0 2024-09-19T09:02:46.400 INFO:tasks.workunit.client.1.smithi102.stdout:1/783: chown dd/d14/d35/d49/d7d/d7f/f8b 73392 1 2024-09-19T09:02:46.402 INFO:tasks.workunit.client.1.smithi102.stdout:0/962: stat d3/dd/d1a/f1b 0 2024-09-19T09:02:46.403 INFO:tasks.workunit.client.0.smithi049.stdout:5/85: creat d3/d5/f1b x:0 0 0 2024-09-19T09:02:46.404 INFO:tasks.workunit.client.0.smithi049.stdout:5/86: dread - d3/d5/de/f1a zero size 2024-09-19T09:02:46.406 INFO:tasks.workunit.client.1.smithi102.stdout:7/858: rename d1/d3/d20/dad/dd4/fe8 to d1/d3/d72/dfb/f10c 0 2024-09-19T09:02:46.406 INFO:tasks.workunit.client.1.smithi102.stdout:7/859: stat d1/d2d/l100 0 2024-09-19T09:02:46.413 INFO:tasks.workunit.client.1.smithi102.stdout:9/799: write d1/d2/d3/d1d/fb1 [277326,24167] 0 2024-09-19T09:02:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:1/115: write d5/d6/f1b [975501,19884] 0 2024-09-19T09:02:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:4/133: creat d4/d15/d19/d1f/f26 x:0 0 0 2024-09-19T09:02:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:4/134: write d4/f5 [7204866,108042] 0 2024-09-19T09:02:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:4/135: stat d4/d15/c1a 0 2024-09-19T09:02:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:0/213: creat d5/d10/d13/d15/f43 x:0 0 0 2024-09-19T09:02:46.419 INFO:tasks.workunit.client.1.smithi102.stdout:5/789: dwrite d5/d7/d1b/f46 [0,4194304] 0 2024-09-19T09:02:46.420 INFO:tasks.workunit.client.1.smithi102.stdout:2/727: truncate d7/d1a/d2b/d31/f3e 310461 0 2024-09-19T09:02:46.424 INFO:tasks.workunit.client.1.smithi102.stdout:4/917: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/f94 [0,4194304] 0 2024-09-19T09:02:46.426 INFO:tasks.workunit.client.1.smithi102.stdout:1/784: creat dd/d14/d35/d49/d7d/ffe x:0 0 0 2024-09-19T09:02:46.428 INFO:tasks.workunit.client.1.smithi102.stdout:0/963: fsync d3/dd/d1a/d32/d7f/d10c/fe9 0 2024-09-19T09:02:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:4/136: dwrite d4/f14 [0,4194304] 0 2024-09-19T09:02:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:8/195: creat d1/d1a/f3b x:0 0 0 2024-09-19T09:02:46.435 INFO:tasks.workunit.client.0.smithi049.stdout:5/87: mkdir d3/d5/d1c 0 2024-09-19T09:02:46.435 INFO:tasks.workunit.client.0.smithi049.stdout:4/137: dread d4/f21 [0,4194304] 0 2024-09-19T09:02:46.438 INFO:tasks.workunit.client.0.smithi049.stdout:5/88: chown d3/cf 1300894 1 2024-09-19T09:02:46.440 INFO:tasks.workunit.client.1.smithi102.stdout:7/860: symlink d1/d4/dca/d52/d7f/da5/df2/df9/l10d 0 2024-09-19T09:02:46.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/219: getdents d1/d8/d2d/d36 0 2024-09-19T09:02:46.443 INFO:tasks.workunit.client.0.smithi049.stdout:8/196: dwrite d1/fb [4194304,4194304] 0 2024-09-19T09:02:46.445 INFO:tasks.workunit.client.1.smithi102.stdout:6/735: dwrite d1/d18/f23 [0,4194304] 0 2024-09-19T09:02:46.448 INFO:tasks.workunit.client.0.smithi049.stdout:1/116: creat d5/f20 x:0 0 0 2024-09-19T09:02:46.449 INFO:tasks.workunit.client.1.smithi102.stdout:9/800: creat d1/d2/d7b/f103 x:0 0 0 2024-09-19T09:02:46.449 INFO:tasks.workunit.client.1.smithi102.stdout:7/861: dwrite d1/f8f [0,4194304] 0 2024-09-19T09:02:46.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/117: chown d5/d6/d8/ce 344067566 1 2024-09-19T09:02:46.450 INFO:tasks.workunit.client.0.smithi049.stdout:5/89: dwrite d3/f6 [0,4194304] 0 2024-09-19T09:02:46.452 INFO:tasks.workunit.client.1.smithi102.stdout:5/790: rmdir d5/d60 39 2024-09-19T09:02:46.453 INFO:tasks.workunit.client.1.smithi102.stdout:2/728: creat d7/d1a/d2b/d31/d51/f102 x:0 0 0 2024-09-19T09:02:46.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/214: fdatasync d5/fd 0 2024-09-19T09:02:46.456 INFO:tasks.workunit.client.0.smithi049.stdout:2/89: mkdir d1/d4/d1e/d21 0 2024-09-19T09:02:46.457 INFO:tasks.workunit.client.1.smithi102.stdout:8/746: mkdir d0/d10/d21/d39/d50/deb 0 2024-09-19T09:02:46.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/215: dread d5/f11 [4194304,4194304] 0 2024-09-19T09:02:46.461 INFO:tasks.workunit.client.0.smithi049.stdout:3/134: creat d10/f34 x:0 0 0 2024-09-19T09:02:46.461 INFO:tasks.workunit.client.1.smithi102.stdout:4/918: unlink d14/d16/l11d 0 2024-09-19T09:02:46.462 INFO:tasks.workunit.client.0.smithi049.stdout:6/83: getdents dc/d12 0 2024-09-19T09:02:46.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/216: fsync d5/d10/d13/d30/f31 0 2024-09-19T09:02:46.463 INFO:tasks.workunit.client.1.smithi102.stdout:0/964: mknod d3/dd/d1a/d32/d117/c13d 0 2024-09-19T09:02:46.466 INFO:tasks.workunit.client.0.smithi049.stdout:4/138: symlink d4/d15/d19/d1f/l27 0 2024-09-19T09:02:46.468 INFO:tasks.workunit.client.1.smithi102.stdout:6/736: creat d1/d3a/ff6 x:0 0 0 2024-09-19T09:02:46.468 INFO:tasks.workunit.client.1.smithi102.stdout:6/737: chown d1/d26/d2e/d45/f55 6980 1 2024-09-19T09:02:46.469 INFO:tasks.workunit.client.1.smithi102.stdout:6/738: readlink d1/d26/d2e/d45/l38 0 2024-09-19T09:02:46.469 INFO:tasks.workunit.client.1.smithi102.stdout:6/739: truncate d1/f1b 646661 0 2024-09-19T09:02:46.469 INFO:tasks.workunit.client.1.smithi102.stdout:7/862: mknod d1/d3/d72/dfb/c10e 0 2024-09-19T09:02:46.471 INFO:tasks.workunit.client.0.smithi049.stdout:9/131: rename d3/d14/f1d to d3/d14/f2d 0 2024-09-19T09:02:46.472 INFO:tasks.workunit.client.0.smithi049.stdout:9/132: chown d3/d22 2 1 2024-09-19T09:02:46.473 INFO:tasks.workunit.client.0.smithi049.stdout:9/133: stat d3/d14/d1a/d21/f26 0 2024-09-19T09:02:46.474 INFO:tasks.workunit.client.1.smithi102.stdout:9/801: rename d1/d2/d78/da0/fa7 to d1/d2/d78/df7/f104 0 2024-09-19T09:02:46.475 INFO:tasks.workunit.client.0.smithi049.stdout:9/134: truncate d3/d14/d1a/f25 683762 0 2024-09-19T09:02:46.479 INFO:tasks.workunit.client.0.smithi049.stdout:7/220: dread d1/d1f/f29 [0,4194304] 0 2024-09-19T09:02:46.482 INFO:tasks.workunit.client.1.smithi102.stdout:5/791: symlink d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/lf3 0 2024-09-19T09:02:46.484 INFO:tasks.workunit.client.0.smithi049.stdout:5/90: symlink d3/d5/de/d12/l1d 0 2024-09-19T09:02:46.484 INFO:tasks.workunit.client.1.smithi102.stdout:3/923: write d2/d19/d47/f71 [5566892,62675] 0 2024-09-19T09:02:46.485 INFO:tasks.workunit.client.1.smithi102.stdout:1/785: mknod dd/d14/d35/d49/d62/cff 0 2024-09-19T09:02:46.488 INFO:tasks.workunit.client.1.smithi102.stdout:1/786: fsync dd/d7a/d8c/da6/ff8 0 2024-09-19T09:02:46.488 INFO:tasks.workunit.client.1.smithi102.stdout:6/740: dread d1/d26/d4b/d94/f73 [0,4194304] 0 2024-09-19T09:02:46.493 INFO:tasks.workunit.client.1.smithi102.stdout:2/729: dread d7/d1a/d2b/dab/fca [0,4194304] 0 2024-09-19T09:02:46.494 INFO:tasks.workunit.client.1.smithi102.stdout:5/792: dread d5/d7/d1a/daa/fd7 [4194304,4194304] 0 2024-09-19T09:02:46.494 INFO:tasks.workunit.client.0.smithi049.stdout:3/135: rename cb to d10/d11/c35 0 2024-09-19T09:02:46.494 INFO:tasks.workunit.client.0.smithi049.stdout:3/136: fdatasync fe 0 2024-09-19T09:02:46.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/84: mkdir dc/d1b 0 2024-09-19T09:02:46.494 INFO:tasks.workunit.client.0.smithi049.stdout:0/217: creat d5/d10/f44 x:0 0 0 2024-09-19T09:02:46.494 INFO:tasks.workunit.client.0.smithi049.stdout:0/218: read - d5/d10/d13/d30/f31 zero size 2024-09-19T09:02:46.495 INFO:tasks.workunit.client.1.smithi102.stdout:7/863: rename d1/d3/d20/c80 to d1/d3/d20/d6c/c10f 0 2024-09-19T09:02:46.498 INFO:tasks.workunit.client.0.smithi049.stdout:8/197: mkdir d1/d11/d2e/d3c 0 2024-09-19T09:02:46.501 INFO:tasks.workunit.client.0.smithi049.stdout:8/198: dread d1/f39 [0,4194304] 0 2024-09-19T09:02:46.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/221: symlink d1/d7/d13/d18/l4e 0 2024-09-19T09:02:46.504 INFO:tasks.workunit.client.1.smithi102.stdout:1/787: write dd/d13/d2d/ddc/fe6 [565096,72913] 0 2024-09-19T09:02:46.506 INFO:tasks.workunit.client.1.smithi102.stdout:6/741: symlink d1/d3a/lf7 0 2024-09-19T09:02:46.507 INFO:tasks.workunit.client.1.smithi102.stdout:6/742: write d1/d26/d4b/d94/fa1 [1669683,77681] 0 2024-09-19T09:02:46.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/90: creat d1/d4/d1e/d21/f22 x:0 0 0 2024-09-19T09:02:46.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/118: dwrite d5/d6/f1f [0,4194304] 0 2024-09-19T09:02:46.513 INFO:tasks.workunit.client.1.smithi102.stdout:5/793: mkdir d5/d7/d1a/d37/d34/d4d/df4 0 2024-09-19T09:02:46.516 INFO:tasks.workunit.client.1.smithi102.stdout:1/788: dread dd/d13/f56 [0,4194304] 0 2024-09-19T09:02:46.518 INFO:tasks.workunit.client.1.smithi102.stdout:3/924: rename d2/d19/d1c/d2f/c30 to d2/d19/d35/dce/c126 0 2024-09-19T09:02:46.519 INFO:tasks.workunit.client.0.smithi049.stdout:6/85: symlink dc/l1c 0 2024-09-19T09:02:46.521 INFO:tasks.workunit.client.1.smithi102.stdout:7/864: creat d1/d2d/f110 x:0 0 0 2024-09-19T09:02:46.522 INFO:tasks.workunit.client.1.smithi102.stdout:7/865: dread - d1/d3/d20/dad/dcd/ffc zero size 2024-09-19T09:02:46.522 INFO:tasks.workunit.client.0.smithi049.stdout:0/219: rmdir d5/d10/d13/d15/d29 39 2024-09-19T09:02:46.523 INFO:tasks.workunit.client.1.smithi102.stdout:9/802: mknod d1/d8/d1c/c105 0 2024-09-19T09:02:46.526 INFO:tasks.workunit.client.0.smithi049.stdout:9/135: mknod d3/d14/c2e 0 2024-09-19T09:02:46.528 INFO:tasks.workunit.client.0.smithi049.stdout:8/199: stat d1/l1e 0 2024-09-19T09:02:46.529 INFO:tasks.workunit.client.0.smithi049.stdout:8/200: fsync d1/d1a/f3b 0 2024-09-19T09:02:46.529 INFO:tasks.workunit.client.0.smithi049.stdout:8/201: stat d1/c31 0 2024-09-19T09:02:46.530 INFO:tasks.workunit.client.0.smithi049.stdout:7/222: creat d1/d8/d2d/f4f x:0 0 0 2024-09-19T09:02:46.530 INFO:tasks.workunit.client.1.smithi102.stdout:4/919: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/fbe [0,4194304] 0 2024-09-19T09:02:46.535 INFO:tasks.workunit.client.0.smithi049.stdout:3/137: write fd [1216471,80289] 0 2024-09-19T09:02:46.536 INFO:tasks.workunit.client.0.smithi049.stdout:3/138: fdatasync d10/d11/d13/f32 0 2024-09-19T09:02:46.545 INFO:tasks.workunit.client.0.smithi049.stdout:5/91: truncate d3/d5/fb 2457929 0 2024-09-19T09:02:46.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/86: mknod dc/d16/c1d 0 2024-09-19T09:02:46.547 INFO:tasks.workunit.client.1.smithi102.stdout:3/925: creat d2/f127 x:0 0 0 2024-09-19T09:02:46.548 INFO:tasks.workunit.client.0.smithi049.stdout:0/220: symlink d5/d10/l45 0 2024-09-19T09:02:46.548 INFO:tasks.workunit.client.1.smithi102.stdout:7/866: mknod d1/d4/d9c/c111 0 2024-09-19T09:02:46.549 INFO:tasks.workunit.client.0.smithi049.stdout:4/139: creat d4/d15/f28 x:0 0 0 2024-09-19T09:02:46.550 INFO:tasks.workunit.client.0.smithi049.stdout:0/221: write d5/d10/d13/d15/d36/d3d/f24 [2539602,57187] 0 2024-09-19T09:02:46.550 INFO:tasks.workunit.client.1.smithi102.stdout:9/803: mkdir d1/d2/d3/d6f/d8d/da2/d106 0 2024-09-19T09:02:46.551 INFO:tasks.workunit.client.0.smithi049.stdout:4/140: rename d4/d15/d19 to d4/d15/d19/d29 22 2024-09-19T09:02:46.551 INFO:tasks.workunit.client.0.smithi049.stdout:8/202: creat d1/f3d x:0 0 0 2024-09-19T09:02:46.552 INFO:tasks.workunit.client.0.smithi049.stdout:8/203: fdatasync d1/f21 0 2024-09-19T09:02:46.553 INFO:tasks.workunit.client.1.smithi102.stdout:8/747: getdents d0/db 0 2024-09-19T09:02:46.553 INFO:tasks.workunit.client.1.smithi102.stdout:5/794: write d5/fe [1606638,5777] 0 2024-09-19T09:02:46.554 INFO:tasks.workunit.client.0.smithi049.stdout:7/223: mkdir d1/d7/d13/d18/d50 0 2024-09-19T09:02:46.554 INFO:tasks.workunit.client.1.smithi102.stdout:0/965: getdents d3/dd/d1a/d32/d7f/d10c/d37/d39 0 2024-09-19T09:02:46.555 INFO:tasks.workunit.client.1.smithi102.stdout:8/748: write d0/d10/d21/f6c [1227088,85358] 0 2024-09-19T09:02:46.555 INFO:tasks.workunit.client.0.smithi049.stdout:8/204: read d1/fb [7699714,94394] 0 2024-09-19T09:02:46.556 INFO:tasks.workunit.client.0.smithi049.stdout:3/139: creat d10/d11/f36 x:0 0 0 2024-09-19T09:02:46.557 INFO:tasks.workunit.client.0.smithi049.stdout:2/91: unlink d1/d2/f6 0 2024-09-19T09:02:46.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/141: dread d4/f14 [0,4194304] 0 2024-09-19T09:02:46.559 INFO:tasks.workunit.client.1.smithi102.stdout:4/920: mkdir d14/d16/d17/de3/dbd/df3/d118/d12d 0 2024-09-19T09:02:46.559 INFO:tasks.workunit.client.0.smithi049.stdout:1/119: mkdir d5/d6/d19/d21 0 2024-09-19T09:02:46.561 INFO:tasks.workunit.client.1.smithi102.stdout:0/966: dwrite d3/dd/d10/d15/d2c/f59 [0,4194304] 0 2024-09-19T09:02:46.562 INFO:tasks.workunit.client.0.smithi049.stdout:4/142: write d4/f21 [5215466,35480] 0 2024-09-19T09:02:46.563 INFO:tasks.workunit.client.1.smithi102.stdout:7/867: dread d1/d4/d9c/fcb [0,4194304] 0 2024-09-19T09:02:46.563 INFO:tasks.workunit.client.0.smithi049.stdout:3/140: dread d10/d11/d13/f28 [0,4194304] 0 2024-09-19T09:02:46.564 INFO:tasks.workunit.client.1.smithi102.stdout:6/743: symlink d1/d18/d37/dda/lf8 0 2024-09-19T09:02:46.567 INFO:tasks.workunit.client.0.smithi049.stdout:5/92: creat d3/d5/de/f1e x:0 0 0 2024-09-19T09:02:46.567 INFO:tasks.workunit.client.0.smithi049.stdout:1/120: dread f3 [4194304,4194304] 0 2024-09-19T09:02:46.568 INFO:tasks.workunit.client.0.smithi049.stdout:5/93: chown d3/d5/l7 2 1 2024-09-19T09:02:46.571 INFO:tasks.workunit.client.1.smithi102.stdout:6/744: dwrite d1/d26/d2e/d45/daf/d8d/fe2 [0,4194304] 0 2024-09-19T09:02:46.578 INFO:tasks.workunit.client.0.smithi049.stdout:6/87: dwrite fa [0,4194304] 0 2024-09-19T09:02:46.578 INFO:tasks.workunit.client.1.smithi102.stdout:1/789: mknod dd/d14/d35/d49/d62/c100 0 2024-09-19T09:02:46.579 INFO:tasks.workunit.client.0.smithi049.stdout:7/224: dread d1/d8/f2f [0,4194304] 0 2024-09-19T09:02:46.582 INFO:tasks.workunit.client.1.smithi102.stdout:3/926: fsync d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9d 0 2024-09-19T09:02:46.589 INFO:tasks.workunit.client.0.smithi049.stdout:8/205: symlink d1/l3e 0 2024-09-19T09:02:46.589 INFO:tasks.workunit.client.0.smithi049.stdout:6/88: dwrite dc/f19 [0,4194304] 0 2024-09-19T09:02:46.590 INFO:tasks.workunit.client.1.smithi102.stdout:5/795: mknod d5/d7/d1a/d37/d34/d4d/d9c/cf5 0 2024-09-19T09:02:46.590 INFO:tasks.workunit.client.1.smithi102.stdout:5/796: fsync d5/d7/d1a/d37/d39/d4c/fb4 0 2024-09-19T09:02:46.595 INFO:tasks.workunit.client.0.smithi049.stdout:2/92: rmdir d1/d4 39 2024-09-19T09:02:46.599 INFO:tasks.workunit.client.1.smithi102.stdout:4/921: creat d14/d16/d17/de3/dbd/df3/d37/d101/f12e x:0 0 0 2024-09-19T09:02:46.602 INFO:tasks.workunit.client.1.smithi102.stdout:0/967: symlink d3/dd/d1a/d77/l13e 0 2024-09-19T09:02:46.604 INFO:tasks.workunit.client.0.smithi049.stdout:5/94: creat d3/d5/f1f x:0 0 0 2024-09-19T09:02:46.605 INFO:tasks.workunit.client.1.smithi102.stdout:2/730: link d7/d1a/ceb d7/d50/d64/d7f/d83/dc7/c103 0 2024-09-19T09:02:46.607 INFO:tasks.workunit.client.0.smithi049.stdout:5/95: write d3/d5/f1b [9230,121612] 0 2024-09-19T09:02:46.611 INFO:tasks.workunit.client.0.smithi049.stdout:0/222: creat d5/d10/d13/d15/d29/d3b/f46 x:0 0 0 2024-09-19T09:02:46.620 INFO:tasks.workunit.client.1.smithi102.stdout:4/922: dread d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/f5f [0,4194304] 0 2024-09-19T09:02:46.620 INFO:tasks.workunit.client.1.smithi102.stdout:9/804: unlink d1/d2/d3/d6f/fc6 0 2024-09-19T09:02:46.622 INFO:tasks.workunit.client.0.smithi049.stdout:1/121: dread d5/d6/fa [0,4194304] 0 2024-09-19T09:02:46.622 INFO:tasks.workunit.client.0.smithi049.stdout:8/206: mkdir d1/d11/d3f 0 2024-09-19T09:02:46.623 INFO:tasks.workunit.client.1.smithi102.stdout:6/745: write d1/d26/d2e/d45/d47/f49 [865706,102760] 0 2024-09-19T09:02:46.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/122: dread - d5/f1e zero size 2024-09-19T09:02:46.624 INFO:tasks.workunit.client.1.smithi102.stdout:5/797: mknod d5/d8d/d95/cf6 0 2024-09-19T09:02:46.624 INFO:tasks.workunit.client.1.smithi102.stdout:5/798: readlink d5/d7/d1a/d37/d34/d73/lbc 0 2024-09-19T09:02:46.638 INFO:tasks.workunit.client.1.smithi102.stdout:8/749: dwrite d0/db/d1d/f34 [0,4194304] 0 2024-09-19T09:02:46.639 INFO:tasks.workunit.client.0.smithi049.stdout:0/223: stat d5/d10/d13/d15/l1f 0 2024-09-19T09:02:46.640 INFO:tasks.workunit.client.0.smithi049.stdout:0/224: fsync d5/d10/f1d 0 2024-09-19T09:02:46.641 INFO:tasks.workunit.client.1.smithi102.stdout:0/968: dwrite d3/dd/d1a/d32/d7f/d10c/d37/d3d/d90/fb0 [0,4194304] 0 2024-09-19T09:02:46.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/225: write d1/f2 [9903821,52904] 0 2024-09-19T09:02:46.647 INFO:tasks.workunit.client.1.smithi102.stdout:1/790: truncate dd/d14/d35/d49/dcb/fcc 726797 0 2024-09-19T09:02:46.647 INFO:tasks.workunit.client.0.smithi049.stdout:8/207: symlink d1/d27/l40 0 2024-09-19T09:02:46.650 INFO:tasks.workunit.client.0.smithi049.stdout:2/93: dread d1/fd [0,4194304] 0 2024-09-19T09:02:46.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/89: rename fb to dc/d12/f1e 0 2024-09-19T09:02:46.653 INFO:tasks.workunit.client.0.smithi049.stdout:3/141: link d10/d11/d13/c23 d10/d11/d13/c37 0 2024-09-19T09:02:46.654 INFO:tasks.workunit.client.0.smithi049.stdout:3/142: chown l8 3 1 2024-09-19T09:02:46.655 INFO:tasks.workunit.client.0.smithi049.stdout:3/143: stat d10/d11/d13/l29 0 2024-09-19T09:02:46.656 INFO:tasks.workunit.client.0.smithi049.stdout:3/144: fsync fc 0 2024-09-19T09:02:46.657 INFO:tasks.workunit.client.0.smithi049.stdout:0/225: creat d5/d10/d13/d15/d29/d3b/f47 x:0 0 0 2024-09-19T09:02:46.658 INFO:tasks.workunit.client.1.smithi102.stdout:7/868: creat d1/d4/f112 x:0 0 0 2024-09-19T09:02:46.663 INFO:tasks.workunit.client.1.smithi102.stdout:8/750: mkdir d0/d10/d21/d39/d50/da2/dec 0 2024-09-19T09:02:46.665 INFO:tasks.workunit.client.0.smithi049.stdout:0/226: dwrite d5/f20 [0,4194304] 0 2024-09-19T09:02:46.666 INFO:tasks.workunit.client.0.smithi049.stdout:6/90: symlink dc/d16/l1f 0 2024-09-19T09:02:46.670 INFO:tasks.workunit.client.0.smithi049.stdout:8/208: rmdir d1/d27 39 2024-09-19T09:02:46.672 INFO:tasks.workunit.client.1.smithi102.stdout:4/923: write d14/d34/d5a/d5c/f8d [963186,127832] 0 2024-09-19T09:02:46.673 INFO:tasks.workunit.client.1.smithi102.stdout:4/924: chown d14/d16/d17/c22 4831 1 2024-09-19T09:02:46.677 INFO:tasks.workunit.client.1.smithi102.stdout:4/925: write d14/d16/d17/de3/dbd/df3/d37/d58/de2/df4/f120 [476098,97808] 0 2024-09-19T09:02:46.677 INFO:tasks.workunit.client.1.smithi102.stdout:5/799: dwrite d5/d7/d1b/f9e [4194304,4194304] 0 2024-09-19T09:02:46.678 INFO:tasks.workunit.client.0.smithi049.stdout:7/226: mknod d1/d7/d13/d18/d50/c51 0 2024-09-19T09:02:46.679 INFO:tasks.workunit.client.0.smithi049.stdout:8/209: dwrite d1/d11/f3a [0,4194304] 0 2024-09-19T09:02:46.681 INFO:tasks.workunit.client.0.smithi049.stdout:6/91: rmdir dc/d16 39 2024-09-19T09:02:46.682 INFO:tasks.workunit.client.1.smithi102.stdout:2/731: link d7/d1a/d2b/d31/d51/c54 d7/d1a/d56/c104 0 2024-09-19T09:02:46.682 INFO:tasks.workunit.client.1.smithi102.stdout:0/969: mknod d3/dd/d10/c13f 0 2024-09-19T09:02:46.683 INFO:tasks.workunit.client.1.smithi102.stdout:2/732: chown d7/d1a/d2b/d31/d51/f102 84821033 1 2024-09-19T09:02:46.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/96: getdents d3/d5/de 0 2024-09-19T09:02:46.684 INFO:tasks.workunit.client.1.smithi102.stdout:9/805: creat d1/d2/d3/f107 x:0 0 0 2024-09-19T09:02:46.685 INFO:tasks.workunit.client.1.smithi102.stdout:9/806: fdatasync d1/f45 0 2024-09-19T09:02:46.690 INFO:tasks.workunit.client.1.smithi102.stdout:9/807: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:46.692 INFO:tasks.workunit.client.1.smithi102.stdout:1/791: write f4 [3806786,127500] 0 2024-09-19T09:02:46.693 INFO:tasks.workunit.client.0.smithi049.stdout:2/94: write d1/f14 [872280,105437] 0 2024-09-19T09:02:46.697 INFO:tasks.workunit.client.1.smithi102.stdout:6/746: rename d1/f43 to d1/d26/ff9 0 2024-09-19T09:02:46.698 INFO:tasks.workunit.client.1.smithi102.stdout:4/926: symlink d14/d34/d5a/d5c/d79/l12f 0 2024-09-19T09:02:46.699 INFO:tasks.workunit.client.1.smithi102.stdout:5/800: mknod d5/d7/d1a/d37/d34/d73/cf7 0 2024-09-19T09:02:46.699 INFO:tasks.workunit.client.0.smithi049.stdout:1/123: link d5/d6/f7 d5/d6/d8/d13/f22 0 2024-09-19T09:02:46.702 INFO:tasks.workunit.client.0.smithi049.stdout:5/97: dwrite d3/d5/de/f1e [0,4194304] 0 2024-09-19T09:02:46.702 INFO:tasks.workunit.client.0.smithi049.stdout:6/92: truncate dc/fd 809939 0 2024-09-19T09:02:46.703 INFO:tasks.workunit.client.1.smithi102.stdout:0/970: mkdir d3/dcf/d140 0 2024-09-19T09:02:46.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/145: creat d10/f38 x:0 0 0 2024-09-19T09:02:46.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/95: mkdir d1/d2/d23 0 2024-09-19T09:02:46.708 INFO:tasks.workunit.client.0.smithi049.stdout:7/227: dwrite d1/d1a/f38 [0,4194304] 0 2024-09-19T09:02:46.709 INFO:tasks.workunit.client.0.smithi049.stdout:8/210: creat d1/d27/f41 x:0 0 0 2024-09-19T09:02:46.710 INFO:tasks.workunit.client.1.smithi102.stdout:9/808: unlink d1/d2/d3/d6f/fae 0 2024-09-19T09:02:46.712 INFO:tasks.workunit.client.0.smithi049.stdout:3/146: read d10/d11/d27/f2c [1070869,129624] 0 2024-09-19T09:02:46.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/228: stat d1/d7/f14 0 2024-09-19T09:02:46.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/124: rename d5/d6/f9 to d5/f23 0 2024-09-19T09:02:46.716 INFO:tasks.workunit.client.1.smithi102.stdout:1/792: dread - dd/d7a/d8c/d8e/fc3 zero size 2024-09-19T09:02:46.717 INFO:tasks.workunit.client.1.smithi102.stdout:1/793: write dd/d5f/f93 [1062696,44273] 0 2024-09-19T09:02:46.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/229: write d1/f2 [2561273,122709] 0 2024-09-19T09:02:46.722 INFO:tasks.workunit.client.0.smithi049.stdout:5/98: dwrite d3/d5/de/f15 [0,4194304] 0 2024-09-19T09:02:46.722 INFO:tasks.workunit.client.0.smithi049.stdout:2/96: creat d1/d2/f24 x:0 0 0 2024-09-19T09:02:46.724 INFO:tasks.workunit.client.0.smithi049.stdout:3/147: creat d10/d11/f39 x:0 0 0 2024-09-19T09:02:46.725 INFO:tasks.workunit.client.1.smithi102.stdout:5/801: creat d5/d8d/d95/ff8 x:0 0 0 2024-09-19T09:02:46.725 INFO:tasks.workunit.client.1.smithi102.stdout:5/802: readlink d5/d7/d1a/d37/d39/d81/lc9 0 2024-09-19T09:02:46.726 INFO:tasks.workunit.client.0.smithi049.stdout:8/211: rmdir d1/d11 39 2024-09-19T09:02:46.729 INFO:tasks.workunit.client.1.smithi102.stdout:8/751: creat d0/d10/d21/d39/d50/fed x:0 0 0 2024-09-19T09:02:46.731 INFO:tasks.workunit.client.1.smithi102.stdout:4/927: truncate d14/d16/d17/de3/dbd/df3/d37/d58/f73 738680 0 2024-09-19T09:02:46.732 INFO:tasks.workunit.client.1.smithi102.stdout:4/928: chown d14/d34/d5a/d5c/f7b 15821468 1 2024-09-19T09:02:46.732 INFO:tasks.workunit.client.0.smithi049.stdout:3/148: dwrite fe [0,4194304] 0 2024-09-19T09:02:46.732 INFO:tasks.workunit.client.1.smithi102.stdout:4/929: readlink d14/d34/ldc 0 2024-09-19T09:02:46.733 INFO:tasks.workunit.client.0.smithi049.stdout:3/149: write d10/d11/f26 [129696,71066] 0 2024-09-19T09:02:46.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/150: fdatasync d10/d11/d13/f18 0 2024-09-19T09:02:46.743 INFO:tasks.workunit.client.0.smithi049.stdout:7/230: readlink d1/l11 0 2024-09-19T09:02:46.747 INFO:tasks.workunit.client.0.smithi049.stdout:1/125: mkdir d5/d6/d8/d13/d24 0 2024-09-19T09:02:46.748 INFO:tasks.workunit.client.0.smithi049.stdout:7/231: dread d1/d8/d2d/d36/f45 [0,4194304] 0 2024-09-19T09:02:46.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/99: mkdir d3/d5/d20 0 2024-09-19T09:02:46.750 INFO:tasks.workunit.client.1.smithi102.stdout:6/747: mknod d1/d26/d2e/d45/dac/df1/cfa 0 2024-09-19T09:02:46.750 INFO:tasks.workunit.client.1.smithi102.stdout:5/803: dread d5/d7/d1a/d37/d39/d4c/f9b [0,4194304] 0 2024-09-19T09:02:46.751 INFO:tasks.workunit.client.1.smithi102.stdout:5/804: dread - d5/d7/d1a/d37/d34/d73/fdf zero size 2024-09-19T09:02:46.751 INFO:tasks.workunit.client.0.smithi049.stdout:2/97: truncate d1/fd 2180705 0 2024-09-19T09:02:46.753 INFO:tasks.workunit.client.0.smithi049.stdout:2/98: chown d1/d19/f1b 0 1 2024-09-19T09:02:46.753 INFO:tasks.workunit.client.1.smithi102.stdout:4/930: creat d14/dd7/f130 x:0 0 0 2024-09-19T09:02:46.753 INFO:tasks.workunit.client.1.smithi102.stdout:3/927: sync 2024-09-19T09:02:46.755 INFO:tasks.workunit.client.1.smithi102.stdout:3/928: truncate d2/d19/d1c/f115 383064 0 2024-09-19T09:02:46.757 INFO:tasks.workunit.client.1.smithi102.stdout:9/809: symlink d1/d2/d78/df7/dfe/l108 0 2024-09-19T09:02:46.760 INFO:tasks.workunit.client.0.smithi049.stdout:6/93: truncate dc/fd 1110817 0 2024-09-19T09:02:46.761 INFO:tasks.workunit.client.1.smithi102.stdout:2/733: getdents d7/d11/dc8/dfa 0 2024-09-19T09:02:46.763 INFO:tasks.workunit.client.0.smithi049.stdout:8/212: mknod d1/d11/d3f/c42 0 2024-09-19T09:02:46.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/213: chown d1/d1a/f2b 7 1 2024-09-19T09:02:46.765 INFO:tasks.workunit.client.1.smithi102.stdout:0/971: rename d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/dcd/f136 to d3/dd/d1a/d32/d7f/d10c/f141 0 2024-09-19T09:02:46.767 INFO:tasks.workunit.client.1.smithi102.stdout:0/972: read d3/dd/d10/d15/f36 [2595229,36853] 0 2024-09-19T09:02:46.772 INFO:tasks.workunit.client.0.smithi049.stdout:8/214: fdatasync d1/d11/f1b 0 2024-09-19T09:02:46.775 INFO:tasks.workunit.client.0.smithi049.stdout:7/232: link d1/d7/d13/l42 d1/d7/d13/l52 0 2024-09-19T09:02:46.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/233: chown d1/d8/d19/f34 3414398 1 2024-09-19T09:02:46.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/99: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:02:46.781 INFO:tasks.workunit.client.0.smithi049.stdout:8/215: dread d1/f39 [0,4194304] 0 2024-09-19T09:02:46.781 INFO:tasks.workunit.client.1.smithi102.stdout:3/929: getdents d2/d19/d47/db/d8b/dd9 0 2024-09-19T09:02:46.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/100: write d1/d4/fb [1227217,95244] 0 2024-09-19T09:02:46.787 INFO:tasks.workunit.client.1.smithi102.stdout:9/810: symlink d1/d2/d3/d6f/d8d/da2/d106/l109 0 2024-09-19T09:02:46.788 INFO:tasks.workunit.client.1.smithi102.stdout:5/805: creat d5/d7/d1a/ff9 x:0 0 0 2024-09-19T09:02:46.790 INFO:tasks.workunit.client.1.smithi102.stdout:8/752: getdents d0/d4f 0 2024-09-19T09:02:46.791 INFO:tasks.workunit.client.1.smithi102.stdout:2/734: symlink d7/d1a/d2b/d31/dde/de9/de1/l105 0 2024-09-19T09:02:46.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/234: rename d1/d7/d13 to d1/d53 0 2024-09-19T09:02:46.793 INFO:tasks.workunit.client.1.smithi102.stdout:3/930: symlink d2/d19/d1c/d2f/d5a/d84/d53/ded/l128 0 2024-09-19T09:02:46.794 INFO:tasks.workunit.client.0.smithi049.stdout:2/101: mkdir d1/d19/d25 0 2024-09-19T09:02:46.795 INFO:tasks.workunit.client.0.smithi049.stdout:2/102: write d1/d4/f17 [1043969,62211] 0 2024-09-19T09:02:46.795 INFO:tasks.workunit.client.1.smithi102.stdout:1/794: rename dd/l4c to dd/d7a/da0/l101 0 2024-09-19T09:02:46.796 INFO:tasks.workunit.client.1.smithi102.stdout:7/869: sync 2024-09-19T09:02:46.797 INFO:tasks.workunit.client.1.smithi102.stdout:7/870: fsync d1/d3/d34/d4f/fe9 0 2024-09-19T09:02:46.798 INFO:tasks.workunit.client.1.smithi102.stdout:9/811: symlink d1/d2/d3/d1d/d4f/d6d/d81/d90/l10a 0 2024-09-19T09:02:46.798 INFO:tasks.workunit.client.0.smithi049.stdout:7/235: dread d1/d8/d19/f34 [0,4194304] 0 2024-09-19T09:02:46.798 INFO:tasks.workunit.client.0.smithi049.stdout:7/236: chown d1/d8/d2d/d31/f47 526542166 1 2024-09-19T09:02:46.799 INFO:tasks.workunit.client.1.smithi102.stdout:9/812: readlink d1/d2/d3/d1d/d4f/d6d/lb0 0 2024-09-19T09:02:46.799 INFO:tasks.workunit.client.1.smithi102.stdout:5/806: read d5/d7/d1a/d37/d39/d4c/f4a [873926,25748] 0 2024-09-19T09:02:46.799 INFO:tasks.workunit.client.0.smithi049.stdout:7/237: chown d1/d8/fb 1 1 2024-09-19T09:02:46.799 INFO:tasks.workunit.client.0.smithi049.stdout:2/103: mkdir d1/d4/d20/d26 0 2024-09-19T09:02:46.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/104: chown d1/f14 160404 1 2024-09-19T09:02:46.802 INFO:tasks.workunit.client.0.smithi049.stdout:8/216: getdents d1/d27 0 2024-09-19T09:02:46.805 INFO:tasks.workunit.client.1.smithi102.stdout:1/795: read - dd/d7a/da0/fcf zero size 2024-09-19T09:02:46.808 INFO:tasks.workunit.client.0.smithi049.stdout:8/217: dwrite d1/d1a/f3b [0,4194304] 0 2024-09-19T09:02:46.811 INFO:tasks.workunit.client.0.smithi049.stdout:8/218: mknod d1/d11/c43 0 2024-09-19T09:02:46.812 INFO:tasks.workunit.client.0.smithi049.stdout:2/105: truncate d1/d4/fb 4067688 0 2024-09-19T09:02:46.812 INFO:tasks.workunit.client.0.smithi049.stdout:8/219: write d1/f3d [582407,77421] 0 2024-09-19T09:02:46.815 INFO:tasks.workunit.client.0.smithi049.stdout:2/106: symlink d1/d4/d20/l27 0 2024-09-19T09:02:46.816 INFO:tasks.workunit.client.1.smithi102.stdout:8/753: dwrite d0/d10/d21/d39/d87/f8c [0,4194304] 0 2024-09-19T09:02:46.816 INFO:tasks.workunit.client.0.smithi049.stdout:2/107: fdatasync d1/f15 0 2024-09-19T09:02:46.817 INFO:tasks.workunit.client.0.smithi049.stdout:2/108: dread - d1/d19/f1a zero size 2024-09-19T09:02:46.820 INFO:tasks.workunit.client.1.smithi102.stdout:0/973: getdents d3/dd/d1a/d32/d7f/d10c/d4a 0 2024-09-19T09:02:46.821 INFO:tasks.workunit.client.1.smithi102.stdout:9/813: write d1/d2/d3/d1d/f49 [3873187,69775] 0 2024-09-19T09:02:46.822 INFO:tasks.workunit.client.1.smithi102.stdout:7/871: fsync d1/d2f/f4a 0 2024-09-19T09:02:46.824 INFO:tasks.workunit.client.1.smithi102.stdout:6/748: rename d1/d26/d2e/d45/daf/c52 to d1/cfb 0 2024-09-19T09:02:46.825 INFO:tasks.workunit.client.0.smithi049.stdout:2/109: truncate f0 507465 0 2024-09-19T09:02:46.826 INFO:tasks.workunit.client.0.smithi049.stdout:2/110: dread - d1/d19/f1b zero size 2024-09-19T09:02:46.828 INFO:tasks.workunit.client.1.smithi102.stdout:1/796: creat dd/d66/dea/f102 x:0 0 0 2024-09-19T09:02:46.832 INFO:tasks.workunit.client.0.smithi049.stdout:2/111: dread d1/fd [0,4194304] 0 2024-09-19T09:02:46.833 INFO:tasks.workunit.client.1.smithi102.stdout:2/735: getdents d7/d1a/d2b/d31/dde/de9/de1 0 2024-09-19T09:02:46.834 INFO:tasks.workunit.client.0.smithi049.stdout:8/220: fsync d1/d1a/f3b 0 2024-09-19T09:02:46.837 INFO:tasks.workunit.client.0.smithi049.stdout:2/112: creat d1/d4/d1e/f28 x:0 0 0 2024-09-19T09:02:46.841 INFO:tasks.workunit.client.1.smithi102.stdout:0/974: write d3/dd/d10/d15/f36 [5202038,50194] 0 2024-09-19T09:02:46.841 INFO:tasks.workunit.client.1.smithi102.stdout:7/872: symlink d1/d4/l113 0 2024-09-19T09:02:46.841 INFO:tasks.workunit.client.1.smithi102.stdout:6/749: dread d1/d26/d4b/f7a [0,4194304] 0 2024-09-19T09:02:46.843 INFO:tasks.workunit.client.1.smithi102.stdout:9/814: creat d1/d2/d3/d6f/d8d/da2/db6/de3/f10b x:0 0 0 2024-09-19T09:02:46.844 INFO:tasks.workunit.client.1.smithi102.stdout:8/754: dread d0/d4f/f76 [0,4194304] 0 2024-09-19T09:02:46.844 INFO:tasks.workunit.client.1.smithi102.stdout:6/750: truncate d1/d18/d37/dda/fe7 237565 0 2024-09-19T09:02:46.846 INFO:tasks.workunit.client.0.smithi049.stdout:2/113: creat d1/d19/d25/f29 x:0 0 0 2024-09-19T09:02:46.847 INFO:tasks.workunit.client.0.smithi049.stdout:2/114: write d1/d19/f1a [512214,127599] 0 2024-09-19T09:02:46.848 INFO:tasks.workunit.client.1.smithi102.stdout:4/931: rename d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/lf8 to d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/d116/l131 0 2024-09-19T09:02:46.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/221: truncate d1/f9 2735660 0 2024-09-19T09:02:46.851 INFO:tasks.workunit.client.0.smithi049.stdout:2/115: creat d1/d4/f2a x:0 0 0 2024-09-19T09:02:46.852 INFO:tasks.workunit.client.1.smithi102.stdout:2/736: write d7/d1a/d2b/d31/d51/f5f [919683,101653] 0 2024-09-19T09:02:46.852 INFO:tasks.workunit.client.1.smithi102.stdout:8/755: creat d0/db/fee x:0 0 0 2024-09-19T09:02:46.854 INFO:tasks.workunit.client.1.smithi102.stdout:8/756: write d0/d10/f37 [9100729,37977] 0 2024-09-19T09:02:46.854 INFO:tasks.workunit.client.1.smithi102.stdout:9/815: fdatasync d1/d2/d3/d1d/d4f/f82 0 2024-09-19T09:02:46.856 INFO:tasks.workunit.client.1.smithi102.stdout:6/751: mknod d1/d3a/cfc 0 2024-09-19T09:02:46.857 INFO:tasks.workunit.client.0.smithi049.stdout:8/222: link d1/l3e d1/d27/l44 0 2024-09-19T09:02:46.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/223: readlink d1/lc 0 2024-09-19T09:02:46.861 INFO:tasks.workunit.client.1.smithi102.stdout:0/975: mkdir d3/dd/d1a/d32/d7f/d10c/d37/d142 0 2024-09-19T09:02:46.862 INFO:tasks.workunit.client.1.smithi102.stdout:0/976: chown d3/dd/d10/d15/d3e/f5e 246622 1 2024-09-19T09:02:46.862 INFO:tasks.workunit.client.0.smithi049.stdout:8/224: mkdir d1/d11/d45 0 2024-09-19T09:02:46.863 INFO:tasks.workunit.client.1.smithi102.stdout:2/737: fsync d7/d1a/d2b/dab/fca 0 2024-09-19T09:02:46.863 INFO:tasks.workunit.client.0.smithi049.stdout:8/225: chown d1/d1a/c34 51 1 2024-09-19T09:02:46.872 INFO:tasks.workunit.client.1.smithi102.stdout:3/931: rename d2/ld8 to d2/d19/d1c/d2f/d5a/d84/d4f/d72/d10d/l129 0 2024-09-19T09:02:46.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/226: symlink d1/l46 0 2024-09-19T09:02:46.874 INFO:tasks.workunit.client.1.smithi102.stdout:6/752: truncate d1/d26/d4b/d94/d8a/f80 602054 0 2024-09-19T09:02:46.874 INFO:tasks.workunit.client.1.smithi102.stdout:6/753: chown d1/d18 1799583 1 2024-09-19T09:02:46.875 INFO:tasks.workunit.client.1.smithi102.stdout:4/932: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/df9/d132 0 2024-09-19T09:02:46.878 INFO:tasks.workunit.client.0.smithi049.stdout:8/227: rename d1/d27/f28 to d1/d27/f47 0 2024-09-19T09:02:46.880 INFO:tasks.workunit.client.1.smithi102.stdout:0/977: creat d3/dcf/f143 x:0 0 0 2024-09-19T09:02:46.882 INFO:tasks.workunit.client.1.smithi102.stdout:9/816: symlink d1/d2/d3/dd0/l10c 0 2024-09-19T09:02:46.884 INFO:tasks.workunit.client.0.smithi049.stdout:8/228: dwrite d1/d11/f3a [0,4194304] 0 2024-09-19T09:02:46.884 INFO:tasks.workunit.client.1.smithi102.stdout:9/817: truncate d1/d2/d78/fca 147880 0 2024-09-19T09:02:46.885 INFO:tasks.workunit.client.1.smithi102.stdout:1/797: rename dd/d13/d2d to dd/d7a/d8c/d8e/d103 0 2024-09-19T09:02:46.887 INFO:tasks.workunit.client.1.smithi102.stdout:6/754: stat d1/d26/d2e/d45/d47/d4d/d35/l6e 0 2024-09-19T09:02:46.887 INFO:tasks.workunit.client.1.smithi102.stdout:0/978: dwrite d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/de5/f134 [0,4194304] 0 2024-09-19T09:02:46.888 INFO:tasks.workunit.client.1.smithi102.stdout:9/818: truncate d1/d2/d3/d1d/d4f/d6d/d81/f92 984522 0 2024-09-19T09:02:46.889 INFO:tasks.workunit.client.0.smithi049.stdout:8/229: write d1/d27/f47 [326827,93374] 0 2024-09-19T09:02:46.889 INFO:tasks.workunit.client.1.smithi102.stdout:5/807: sync 2024-09-19T09:02:46.890 INFO:tasks.workunit.client.1.smithi102.stdout:9/819: write d1/d8/f5f [708917,91674] 0 2024-09-19T09:02:46.891 INFO:tasks.workunit.client.1.smithi102.stdout:7/873: link d1/d4/dca/d52/d7f/da5/de6/lea d1/d2f/d103/l114 0 2024-09-19T09:02:46.892 INFO:tasks.workunit.client.1.smithi102.stdout:7/874: stat d1/d3/d72/f106 0 2024-09-19T09:02:46.893 INFO:tasks.workunit.client.1.smithi102.stdout:9/820: chown d1/d2/d3/d1d/d4f/d6d/d81/dd3/ld6 92613703 1 2024-09-19T09:02:46.894 INFO:tasks.workunit.client.1.smithi102.stdout:8/757: write d0/db/d1d/fcd [5170839,100215] 0 2024-09-19T09:02:46.898 INFO:tasks.workunit.client.1.smithi102.stdout:2/738: rename d7/d1a/d2b/d31/dde/de9/d37 to d7/d1a/d2b/d31/d106 0 2024-09-19T09:02:46.900 INFO:tasks.workunit.client.1.smithi102.stdout:0/979: creat d3/dc7/f144 x:0 0 0 2024-09-19T09:02:46.901 INFO:tasks.workunit.client.0.smithi049.stdout:8/230: fsync d1/d11/f3a 0 2024-09-19T09:02:46.903 INFO:tasks.workunit.client.1.smithi102.stdout:5/808: mkdir d5/d7/d1a/d37/d39/d81/dfa 0 2024-09-19T09:02:46.906 INFO:tasks.workunit.client.1.smithi102.stdout:2/739: dwrite d7/d1a/d2b/d31/d51/d6b/fbd [0,4194304] 0 2024-09-19T09:02:46.907 INFO:tasks.workunit.client.1.smithi102.stdout:2/740: fdatasync d7/d1a/d56/fb8 0 2024-09-19T09:02:46.908 INFO:tasks.workunit.client.1.smithi102.stdout:2/741: chown d7/d1a/d2b/d4e/dfe 995 1 2024-09-19T09:02:46.909 INFO:tasks.workunit.client.1.smithi102.stdout:3/932: dwrite d2/d19/d47/db/d26/f7f [0,4194304] 0 2024-09-19T09:02:46.961 INFO:tasks.workunit.client.0.smithi049.stdout:8/231: getdents d1/d11/d45 0 2024-09-19T09:02:46.962 INFO:tasks.workunit.client.0.smithi049.stdout:8/232: dread - d1/d1a/f2b zero size 2024-09-19T09:02:46.963 INFO:tasks.workunit.client.1.smithi102.stdout:8/758: rename d0/d5a/f71 to d0/d10/d21/d39/d50/d63/d83/dd9/fef 0 2024-09-19T09:02:46.964 INFO:tasks.workunit.client.1.smithi102.stdout:1/798: getdents dd/d5f 0 2024-09-19T09:02:46.964 INFO:tasks.workunit.client.0.smithi049.stdout:8/233: rmdir d1/d11 39 2024-09-19T09:02:46.968 INFO:tasks.workunit.client.1.smithi102.stdout:4/933: truncate d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/faa 2131661 0 2024-09-19T09:02:46.969 INFO:tasks.workunit.client.1.smithi102.stdout:6/755: dwrite d1/d26/d2e/d45/d47/d4d/f4c [0,4194304] 0 2024-09-19T09:02:46.969 INFO:tasks.workunit.client.1.smithi102.stdout:4/934: write d14/dd7/feb [121747,51065] 0 2024-09-19T09:02:46.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/234: dwrite d1/f3d [0,4194304] 0 2024-09-19T09:02:46.972 INFO:tasks.workunit.client.1.smithi102.stdout:7/875: mkdir d1/d3/d20/d115 0 2024-09-19T09:02:46.973 INFO:tasks.workunit.client.1.smithi102.stdout:7/876: chown d1/d4/dca/d52/d7f/da5/df2/ca9 0 1 2024-09-19T09:02:46.973 INFO:tasks.workunit.client.1.smithi102.stdout:9/821: mknod d1/d8/d98/df0/c10d 0 2024-09-19T09:02:46.980 INFO:tasks.workunit.client.0.smithi049.stdout:8/235: dwrite d1/f21 [0,4194304] 0 2024-09-19T09:02:46.980 INFO:tasks.workunit.client.1.smithi102.stdout:0/980: rename d3/dd/d10/d84/l9c to d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/d133/l145 0 2024-09-19T09:02:46.983 INFO:tasks.workunit.client.1.smithi102.stdout:8/759: creat d0/d10/d21/d39/ff0 x:0 0 0 2024-09-19T09:02:46.985 INFO:tasks.workunit.client.0.smithi049.stdout:8/236: chown d1/d11/f1b 92803772 1 2024-09-19T09:02:46.986 INFO:tasks.workunit.client.1.smithi102.stdout:5/809: mknod d5/d7/d1a/de1/d78/dec/cfb 0 2024-09-19T09:02:46.988 INFO:tasks.workunit.client.1.smithi102.stdout:5/810: write d5/d7/d1b/f9e [5649006,26848] 0 2024-09-19T09:02:46.989 INFO:tasks.workunit.client.1.smithi102.stdout:2/742: symlink d7/d1a/d2b/dab/de2/df7/l107 0 2024-09-19T09:02:46.989 INFO:tasks.workunit.client.0.smithi049.stdout:8/237: dread d1/d11/f3a [0,4194304] 0 2024-09-19T09:02:46.990 INFO:tasks.workunit.client.1.smithi102.stdout:5/811: dread - d5/d7/d1a/fce zero size 2024-09-19T09:02:46.990 INFO:tasks.workunit.client.1.smithi102.stdout:7/877: fdatasync d1/d3/d20/f5a 0 2024-09-19T09:02:46.993 INFO:tasks.workunit.client.1.smithi102.stdout:0/981: unlink d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/d133/d100/f13c 0 2024-09-19T09:02:46.995 INFO:tasks.workunit.client.1.smithi102.stdout:1/799: mknod dd/d13/c104 0 2024-09-19T09:02:47.001 INFO:tasks.workunit.client.1.smithi102.stdout:3/933: truncate d2/d19/d1c/d2f/d5a/d84/f91 4167465 0 2024-09-19T09:02:47.002 INFO:tasks.workunit.client.1.smithi102.stdout:3/934: chown d2/d19/d35/l3f 22760109 1 2024-09-19T09:02:47.002 INFO:tasks.workunit.client.1.smithi102.stdout:7/878: unlink d1/d4/dca/f8e 0 2024-09-19T09:02:47.003 INFO:tasks.workunit.client.1.smithi102.stdout:5/812: unlink d5/d7/d1a/d37/d39/d81/fab 0 2024-09-19T09:02:47.005 INFO:tasks.workunit.client.1.smithi102.stdout:6/756: dread d1/ff [0,4194304] 0 2024-09-19T09:02:47.005 INFO:tasks.workunit.client.1.smithi102.stdout:0/982: rename d3/dc7/f144 to d3/dd/d10/d15/d19/d8d/f146 0 2024-09-19T09:02:47.006 INFO:tasks.workunit.client.0.smithi049.stdout:8/238: write d1/d11/f1b [1627513,67723] 0 2024-09-19T09:02:47.008 INFO:tasks.workunit.client.1.smithi102.stdout:2/743: write d7/d1a/d2b/f82 [970662,86543] 0 2024-09-19T09:02:47.009 INFO:tasks.workunit.client.1.smithi102.stdout:4/935: creat d14/d34/d5a/f133 x:0 0 0 2024-09-19T09:02:47.010 INFO:tasks.workunit.client.1.smithi102.stdout:0/983: chown d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54 4371943 1 2024-09-19T09:02:47.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/239: link d1/d1a/f29 d1/d1a/f48 0 2024-09-19T09:02:47.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/240: fdatasync d1/d11/f3a 0 2024-09-19T09:02:47.011 INFO:tasks.workunit.client.1.smithi102.stdout:4/936: write f12 [5478558,5165] 0 2024-09-19T09:02:47.013 INFO:tasks.workunit.client.1.smithi102.stdout:8/760: dread d0/d10/f37 [4194304,4194304] 0 2024-09-19T09:02:47.013 INFO:tasks.workunit.client.1.smithi102.stdout:9/822: dwrite d1/d2/d7b/f6b [0,4194304] 0 2024-09-19T09:02:47.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/241: read d1/d11/f12 [1287563,21262] 0 2024-09-19T09:02:47.014 INFO:tasks.workunit.client.1.smithi102.stdout:9/823: chown d1/d2/d3/dd0 86 1 2024-09-19T09:02:47.015 INFO:tasks.workunit.client.1.smithi102.stdout:9/824: write d1/d2/d3/fa [1019574,80932] 0 2024-09-19T09:02:47.016 INFO:tasks.workunit.client.1.smithi102.stdout:6/757: symlink d1/d26/d4b/d94/da2/lfd 0 2024-09-19T09:02:47.021 INFO:tasks.workunit.client.0.smithi049.stdout:8/242: dwrite d1/f21 [0,4194304] 0 2024-09-19T09:02:47.023 INFO:tasks.workunit.client.1.smithi102.stdout:2/744: creat d7/d50/d64/d7f/d83/dc7/f108 x:0 0 0 2024-09-19T09:02:47.028 INFO:tasks.workunit.client.1.smithi102.stdout:9/825: mkdir d1/d2/d3/d6f/d8d/da2/d106/d10e 0 2024-09-19T09:02:47.028 INFO:tasks.workunit.client.0.smithi049.stdout:8/243: creat d1/d11/d2e/d3c/f49 x:0 0 0 2024-09-19T09:02:47.029 INFO:tasks.workunit.client.1.smithi102.stdout:9/826: dread - d1/d2/d3/d6f/d8d/da2/fd9 zero size 2024-09-19T09:02:47.030 INFO:tasks.workunit.client.1.smithi102.stdout:6/758: symlink d1/d26/d2e/d45/d47/lfe 0 2024-09-19T09:02:47.032 INFO:tasks.workunit.client.1.smithi102.stdout:0/984: mknod d3/dd/c147 0 2024-09-19T09:02:47.033 INFO:tasks.workunit.client.1.smithi102.stdout:9/827: write d1/d2/d3/d6f/d8d/da2/db6/fba [602741,91052] 0 2024-09-19T09:02:47.033 INFO:tasks.workunit.client.1.smithi102.stdout:1/800: truncate dd/d7a/d8c/d8e/d103/f39 1272186 0 2024-09-19T09:02:47.034 INFO:tasks.workunit.client.1.smithi102.stdout:4/937: mknod d14/c134 0 2024-09-19T09:02:47.034 INFO:tasks.workunit.client.1.smithi102.stdout:0/985: fsync d3/dd/d10/d15/d3e/f3f 0 2024-09-19T09:02:47.035 INFO:tasks.workunit.client.1.smithi102.stdout:1/801: fsync dd/d7a/fed 0 2024-09-19T09:02:47.036 INFO:tasks.workunit.client.0.smithi049.stdout:8/244: dwrite d1/f21 [0,4194304] 0 2024-09-19T09:02:47.039 INFO:tasks.workunit.client.0.smithi049.stdout:8/245: symlink d1/d11/d2e/d3c/l4a 0 2024-09-19T09:02:47.040 INFO:tasks.workunit.client.1.smithi102.stdout:5/813: dwrite d5/d7b/fe2 [0,4194304] 0 2024-09-19T09:02:47.041 INFO:tasks.workunit.client.1.smithi102.stdout:1/802: readlink dd/d14/d35/d49/d62/d6c/l9f 0 2024-09-19T09:02:47.041 INFO:tasks.workunit.client.1.smithi102.stdout:3/935: dread d2/d19/d1c/d2f/d5a/d84/f9a [0,4194304] 0 2024-09-19T09:02:47.041 INFO:tasks.workunit.client.1.smithi102.stdout:8/761: rename d0/db/d29/c6e to d0/d10/cf1 0 2024-09-19T09:02:47.042 INFO:tasks.workunit.client.0.smithi049.stdout:8/246: fdatasync d1/d27/f36 0 2024-09-19T09:02:47.043 INFO:tasks.workunit.client.1.smithi102.stdout:1/803: fsync dd/d14/d18/f3f 0 2024-09-19T09:02:47.047 INFO:tasks.workunit.client.1.smithi102.stdout:5/814: creat d5/d23/ffc x:0 0 0 2024-09-19T09:02:47.047 INFO:tasks.workunit.client.1.smithi102.stdout:1/804: dread dd/d14/d35/d49/dcb/f6e [0,4194304] 0 2024-09-19T09:02:47.047 INFO:tasks.workunit.client.0.smithi049.stdout:8/247: creat d1/d27/f4b x:0 0 0 2024-09-19T09:02:47.050 INFO:tasks.workunit.client.1.smithi102.stdout:0/986: mkdir d3/dd/d1a/d32/d7f/d10c/d148 0 2024-09-19T09:02:47.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:46 smithi049 ceph-mon[28158]: pgmap v30: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 167 MiB/s wr, 390 op/s 2024-09-19T09:02:47.053 INFO:tasks.workunit.client.0.smithi049.stdout:8/248: mknod d1/d11/d2e/c4c 0 2024-09-19T09:02:47.055 INFO:tasks.workunit.client.1.smithi102.stdout:9/828: rename d1/d2/d3/d1d/f97 to d1/d2/d78/df7/dfe/f10f 0 2024-09-19T09:02:47.056 INFO:tasks.workunit.client.1.smithi102.stdout:2/745: write d7/d1a/d2b/f2d [1075361,2915] 0 2024-09-19T09:02:47.057 INFO:tasks.workunit.client.1.smithi102.stdout:9/829: read d1/d2/d3/f5 [3846712,47154] 0 2024-09-19T09:02:47.058 INFO:tasks.workunit.client.1.smithi102.stdout:9/830: truncate d1/d2/d3/f107 355231 0 2024-09-19T09:02:47.059 INFO:tasks.workunit.client.1.smithi102.stdout:0/987: stat d3/c47 0 2024-09-19T09:02:47.060 INFO:tasks.workunit.client.1.smithi102.stdout:0/988: fdatasync d3/dc7/f107 0 2024-09-19T09:02:47.060 INFO:tasks.workunit.client.1.smithi102.stdout:3/936: symlink d2/d19/d1c/d2f/d5a/l12a 0 2024-09-19T09:02:47.062 INFO:tasks.workunit.client.1.smithi102.stdout:9/831: mknod d1/d8/d98/c110 0 2024-09-19T09:02:47.062 INFO:tasks.workunit.client.1.smithi102.stdout:5/815: mkdir d5/d60/dfd 0 2024-09-19T09:02:47.067 INFO:tasks.workunit.client.1.smithi102.stdout:3/937: mknod d2/d19/d1c/d70/c12b 0 2024-09-19T09:02:47.070 INFO:tasks.workunit.client.1.smithi102.stdout:5/816: creat d5/d8d/ffe x:0 0 0 2024-09-19T09:02:47.071 INFO:tasks.workunit.client.1.smithi102.stdout:0/989: dwrite d3/dd/d72/fa7 [0,4194304] 0 2024-09-19T09:02:47.071 INFO:tasks.workunit.client.1.smithi102.stdout:9/832: mkdir d1/d2/d3/d6f/d8d/da2/d106/d10e/d111 0 2024-09-19T09:02:47.071 INFO:tasks.workunit.client.1.smithi102.stdout:5/817: dread - d5/d7/d1a/d37/d34/d73/fdf zero size 2024-09-19T09:02:47.073 INFO:tasks.workunit.client.1.smithi102.stdout:5/818: write d5/d8d/d95/ff8 [828772,130979] 0 2024-09-19T09:02:47.073 INFO:tasks.workunit.client.1.smithi102.stdout:4/938: truncate d14/d34/f6e 3440858 0 2024-09-19T09:02:47.075 INFO:tasks.workunit.client.1.smithi102.stdout:3/938: creat d2/d19/d1c/d2f/d5a/d84/d4f/d72/d10d/f12c x:0 0 0 2024-09-19T09:02:47.076 INFO:tasks.workunit.client.0.smithi049.stdout:8/249: truncate d1/f2d 2325428 0 2024-09-19T09:02:47.078 INFO:tasks.workunit.client.1.smithi102.stdout:2/746: getdents d7/d1a/d2b/d31 0 2024-09-19T09:02:47.078 INFO:tasks.workunit.client.1.smithi102.stdout:2/747: chown d7/d1a/d56/db9 30562 1 2024-09-19T09:02:47.079 INFO:tasks.workunit.client.1.smithi102.stdout:4/939: rmdir d14/d16/d17/de3/dbd/df3/d118 39 2024-09-19T09:02:47.080 INFO:tasks.workunit.client.1.smithi102.stdout:4/940: dread - d14/d16/d17/f7a zero size 2024-09-19T09:02:47.081 INFO:tasks.workunit.client.1.smithi102.stdout:1/805: truncate fc 1855193 0 2024-09-19T09:02:47.082 INFO:tasks.workunit.client.1.smithi102.stdout:3/939: mknod d2/d19/d1c/d2f/d5a/d84/d4f/c12d 0 2024-09-19T09:02:47.083 INFO:tasks.workunit.client.1.smithi102.stdout:0/990: creat d3/dcf/d140/f149 x:0 0 0 2024-09-19T09:02:47.086 INFO:tasks.workunit.client.1.smithi102.stdout:2/748: creat d7/d1a/d56/f109 x:0 0 0 2024-09-19T09:02:47.087 INFO:tasks.workunit.client.1.smithi102.stdout:4/941: creat d14/dd7/f135 x:0 0 0 2024-09-19T09:02:47.087 INFO:tasks.workunit.client.1.smithi102.stdout:1/806: mknod dd/d14/d35/d49/d62/d9e/c105 0 2024-09-19T09:02:47.088 INFO:tasks.workunit.client.1.smithi102.stdout:2/749: symlink d7/d1a/d2b/dab/de2/df7/l10a 0 2024-09-19T09:02:47.089 INFO:tasks.workunit.client.1.smithi102.stdout:5/819: link d5/d23/l90 d5/d7/d1a/d37/d34/d4d/d9c/db8/lff 0 2024-09-19T09:02:47.090 INFO:tasks.workunit.client.1.smithi102.stdout:1/807: read dd/d14/d18/f3f [2330974,113875] 0 2024-09-19T09:02:47.091 INFO:tasks.workunit.client.1.smithi102.stdout:2/750: write d7/d1a/d2b/f82 [615108,125278] 0 2024-09-19T09:02:47.093 INFO:tasks.workunit.client.1.smithi102.stdout:1/808: chown dd/d7a/d8c/da6 7 1 2024-09-19T09:02:47.093 INFO:tasks.workunit.client.1.smithi102.stdout:3/940: creat d2/d1e/f12e x:0 0 0 2024-09-19T09:02:47.097 INFO:tasks.workunit.client.1.smithi102.stdout:5/820: rename d5/d7/d1a/d37/d39/fdb to d5/d60/dfd/f100 0 2024-09-19T09:02:47.099 INFO:tasks.workunit.client.1.smithi102.stdout:0/991: dread d3/dd/d10/d15/f10d [0,4194304] 0 2024-09-19T09:02:47.100 INFO:tasks.workunit.client.1.smithi102.stdout:9/833: truncate d1/d2/d7b/f6b 2474414 0 2024-09-19T09:02:47.100 INFO:tasks.workunit.client.1.smithi102.stdout:3/941: write d2/d19/d1c/d2f/d5a/d84/d4f/d72/d10d/f12c [71086,119297] 0 2024-09-19T09:02:47.100 INFO:tasks.workunit.client.1.smithi102.stdout:5/821: dread - d5/d7/d1a/ff9 zero size 2024-09-19T09:02:47.102 INFO:tasks.workunit.client.1.smithi102.stdout:4/942: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/dfb/f10e [0,4194304] 0 2024-09-19T09:02:47.105 INFO:tasks.workunit.client.1.smithi102.stdout:2/751: getdents d7/d1a/d2b/dab/de2 0 2024-09-19T09:02:47.105 INFO:tasks.workunit.client.1.smithi102.stdout:3/942: rmdir d2/d19/d47 39 2024-09-19T09:02:47.106 INFO:tasks.workunit.client.1.smithi102.stdout:0/992: fsync d3/dd/d1a/d32/d7f/d10c/d37/d39/d44/d54/de5/fe1 0 2024-09-19T09:02:47.107 INFO:tasks.workunit.client.1.smithi102.stdout:5/822: creat d5/d60/f101 x:0 0 0 2024-09-19T09:02:47.109 INFO:tasks.workunit.client.1.smithi102.stdout:9/834: write d1/d2/d3/d1d/f63 [6806184,70509] 0 2024-09-19T09:02:47.113 INFO:tasks.workunit.client.1.smithi102.stdout:4/943: dwrite d14/d34/d5a/d5c/d79/fc1 [0,4194304] 0 2024-09-19T09:02:47.115 INFO:tasks.workunit.client.1.smithi102.stdout:0/993: rmdir d3/dd/d1a/d32/d117 39 2024-09-19T09:02:47.116 INFO:tasks.workunit.client.1.smithi102.stdout:2/752: rename d7/d1a/d2b/d31/d51/cec to d7/d11/c10b 0 2024-09-19T09:02:47.116 INFO:tasks.workunit.client.1.smithi102.stdout:1/809: link dd/d7a/d8c/da6/fc9 dd/d14/d35/d49/f106 0 2024-09-19T09:02:47.119 INFO:tasks.workunit.client.1.smithi102.stdout:5/823: mkdir d5/d7/d1a/d37/d34/d4d/d9c/db8/d102 0 2024-09-19T09:02:47.119 INFO:tasks.workunit.client.1.smithi102.stdout:9/835: mknod d1/d2/d3/d6f/dcb/c112 0 2024-09-19T09:02:47.122 INFO:tasks.workunit.client.1.smithi102.stdout:4/944: creat d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/f136 x:0 0 0 2024-09-19T09:02:47.124 INFO:tasks.workunit.client.1.smithi102.stdout:4/945: fsync d14/dd7/f135 0 2024-09-19T09:02:47.126 INFO:tasks.workunit.client.1.smithi102.stdout:3/943: stat d2/d19/d47/db/d26/lcd 0 2024-09-19T09:02:47.126 INFO:tasks.workunit.client.1.smithi102.stdout:2/753: dwrite d7/d1a/d2b/d31/dde/de9/f4b [0,4194304] 0 2024-09-19T09:02:47.129 INFO:tasks.workunit.client.1.smithi102.stdout:0/994: creat d3/dd/d10/d84/d119/f14a x:0 0 0 2024-09-19T09:02:47.131 INFO:tasks.workunit.client.1.smithi102.stdout:2/754: write d7/d50/d64/d7f/d83/dc7/fef [19114,98988] 0 2024-09-19T09:02:47.131 INFO:tasks.workunit.client.1.smithi102.stdout:5/824: dwrite d5/d60/db6/dd2/fed [0,4194304] 0 2024-09-19T09:02:47.133 INFO:tasks.workunit.client.1.smithi102.stdout:4/946: creat d14/d34/d5a/d5c/d81/f137 x:0 0 0 2024-09-19T09:02:47.134 INFO:tasks.workunit.client.1.smithi102.stdout:0/995: fdatasync d3/dd/d10/d15/d19/ff9 0 2024-09-19T09:02:47.136 INFO:tasks.workunit.client.1.smithi102.stdout:2/755: chown d7/d50/d64/fc0 4646930 1 2024-09-19T09:02:47.136 INFO:tasks.workunit.client.1.smithi102.stdout:9/836: getdents d1/d2/d3/d1d 0 2024-09-19T09:02:47.136 INFO:tasks.workunit.client.1.smithi102.stdout:3/944: chown d2/d19/d1c/d2f/d5a/d84/d53/fbb 234 1 2024-09-19T09:02:47.137 INFO:tasks.workunit.client.1.smithi102.stdout:2/756: fsync d7/fa0 0 2024-09-19T09:02:47.138 INFO:tasks.workunit.client.1.smithi102.stdout:9/837: write d1/d2/d3/d6f/d8d/da2/fe9 [1016379,75318] 0 2024-09-19T09:02:47.138 INFO:tasks.workunit.client.1.smithi102.stdout:0/996: creat d3/dd/d10/d15/d2c/f14b x:0 0 0 2024-09-19T09:02:47.140 INFO:tasks.workunit.client.1.smithi102.stdout:5/825: link d5/d60/dfd/f100 d5/d7b/f103 0 2024-09-19T09:02:47.142 INFO:tasks.workunit.client.1.smithi102.stdout:5/826: write d5/d7/d1a/d37/d39/d4c/f5d [248979,66126] 0 2024-09-19T09:02:47.144 INFO:tasks.workunit.client.1.smithi102.stdout:5/827: write d5/d7b/fe2 [1892649,24779] 0 2024-09-19T09:02:47.145 INFO:tasks.workunit.client.1.smithi102.stdout:2/757: mkdir d7/d1a/d2b/dab/de2/df7/d10c 0 2024-09-19T09:02:47.146 INFO:tasks.workunit.client.1.smithi102.stdout:9/838: rmdir d1/d2/d3/d1d/d4f/d6d/d81 39 2024-09-19T09:02:47.146 INFO:tasks.workunit.client.1.smithi102.stdout:1/810: dread f6 [0,4194304] 0 2024-09-19T09:02:47.147 INFO:tasks.workunit.client.1.smithi102.stdout:0/997: mknod d3/dd/d72/c14c 0 2024-09-19T09:02:47.150 INFO:tasks.workunit.client.1.smithi102.stdout:2/758: fsync d7/f9 0 2024-09-19T09:02:47.152 INFO:tasks.workunit.client.1.smithi102.stdout:9/839: unlink d1/d8/lc3 0 2024-09-19T09:02:47.154 INFO:tasks.workunit.client.1.smithi102.stdout:5/828: mknod d5/d7/d1a/c104 0 2024-09-19T09:02:47.154 INFO:tasks.workunit.client.1.smithi102.stdout:4/947: write d14/d34/d5a/d5c/f8d [4762130,101393] 0 2024-09-19T09:02:47.156 INFO:tasks.workunit.client.1.smithi102.stdout:7/879: sync 2024-09-19T09:02:47.156 INFO:tasks.workunit.client.1.smithi102.stdout:2/759: mknod d7/d11/dc8/dfa/c10d 0 2024-09-19T09:02:47.156 INFO:tasks.workunit.client.1.smithi102.stdout:9/840: fsync d1/d2/d3/f3c 0 2024-09-19T09:02:47.157 INFO:tasks.workunit.client.1.smithi102.stdout:7/880: readlink d1/l39 0 2024-09-19T09:02:47.159 INFO:tasks.workunit.client.1.smithi102.stdout:5/829: write d5/d8d/d95/fbf [794176,11517] 0 2024-09-19T09:02:47.162 INFO:tasks.workunit.client.1.smithi102.stdout:7/881: fdatasync d1/d2d/f43 0 2024-09-19T09:02:47.163 INFO:tasks.workunit.client.1.smithi102.stdout:2/760: write d7/d1a/d2b/d31/dde/de9/f9f [1870757,86544] 0 2024-09-19T09:02:47.164 INFO:tasks.workunit.client.1.smithi102.stdout:1/811: dread dd/d7a/d8c/d8e/d103/f39 [0,4194304] 0 2024-09-19T09:02:47.165 INFO:tasks.workunit.client.1.smithi102.stdout:0/998: dwrite d3/dd/d1a/d32/d7f/d10c/d82/f120 [0,4194304] 0 2024-09-19T09:02:47.165 INFO:tasks.workunit.client.1.smithi102.stdout:3/945: dread d2/d19/d47/f71 [4194304,4194304] 0 2024-09-19T09:02:47.167 INFO:tasks.workunit.client.1.smithi102.stdout:7/882: fsync d1/d3/d20/dad/dcd/fd5 0 2024-09-19T09:02:47.167 INFO:tasks.workunit.client.1.smithi102.stdout:1/812: chown dd/d5f/f96 885 1 2024-09-19T09:02:47.168 INFO:tasks.workunit.client.1.smithi102.stdout:7/883: chown d1/d4/dca/l42 165 1 2024-09-19T09:02:47.172 INFO:tasks.workunit.client.1.smithi102.stdout:4/948: write d14/d34/d5a/d5c/fd4 [807305,1679] 0 2024-09-19T09:02:47.172 INFO:tasks.workunit.client.1.smithi102.stdout:1/813: creat dd/d14/dac/f107 x:0 0 0 2024-09-19T09:02:47.174 INFO:tasks.workunit.client.1.smithi102.stdout:7/884: symlink d1/d4/d9c/l116 0 2024-09-19T09:02:47.176 INFO:tasks.workunit.client.1.smithi102.stdout:7/885: chown d1/d2d/le7 0 1 2024-09-19T09:02:47.177 INFO:tasks.workunit.client.1.smithi102.stdout:4/949: rmdir d14/d16/d17/de3 39 2024-09-19T09:02:47.180 INFO:tasks.workunit.client.1.smithi102.stdout:1/814: creat dd/d14/d35/d49/d62/d9e/dab/de7/df7/f108 x:0 0 0 2024-09-19T09:02:47.181 INFO:tasks.workunit.client.1.smithi102.stdout:9/841: dwrite d1/d2/d3/f5 [0,4194304] 0 2024-09-19T09:02:47.181 INFO:tasks.workunit.client.1.smithi102.stdout:3/946: creat d2/d19/d47/db/d26/d63/f12f x:0 0 0 2024-09-19T09:02:47.181 INFO:tasks.workunit.client.1.smithi102.stdout:7/886: mknod d1/d3/d20/d6c/c117 0 2024-09-19T09:02:47.183 INFO:tasks.workunit.client.1.smithi102.stdout:5/830: dwrite d5/d7/d1a/d37/d34/d4d/f64 [0,4194304] 0 2024-09-19T09:02:47.183 INFO:tasks.workunit.client.1.smithi102.stdout:9/842: dread - d1/d8/fd4 zero size 2024-09-19T09:02:47.183 INFO:tasks.workunit.client.1.smithi102.stdout:0/999: link d3/dd/d10/d15/d3e/cd3 d3/dd/d1a/d32/d7f/d10c/d2a/dba/de/d133/c14d 0 2024-09-19T09:02:47.186 INFO:tasks.workunit.client.1.smithi102.stdout:8/762: sync 2024-09-19T09:02:47.186 INFO:tasks.workunit.client.1.smithi102.stdout:6/759: sync 2024-09-19T09:02:47.188 INFO:tasks.workunit.client.1.smithi102.stdout:5/831: dread - d5/d7/d1a/f88 zero size 2024-09-19T09:02:47.189 INFO:tasks.workunit.client.1.smithi102.stdout:7/887: mknod d1/d3/d20/dad/c118 0 2024-09-19T09:02:47.192 INFO:tasks.workunit.client.1.smithi102.stdout:3/947: mknod d2/d19/d1c/d2f/d5a/c130 0 2024-09-19T09:02:47.193 INFO:tasks.workunit.client.1.smithi102.stdout:4/950: read - d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/f136 zero size 2024-09-19T09:02:47.193 INFO:tasks.workunit.client.1.smithi102.stdout:2/761: dread d7/d1a/d2b/d31/d51/f5f [0,4194304] 0 2024-09-19T09:02:47.195 INFO:tasks.workunit.client.1.smithi102.stdout:7/888: mkdir d1/d2d/d119 0 2024-09-19T09:02:47.196 INFO:tasks.workunit.client.1.smithi102.stdout:3/948: fsync d2/d1e/d54/f11e 0 2024-09-19T09:02:47.196 INFO:tasks.workunit.client.1.smithi102.stdout:9/843: dread d1/d2/d3/d1d/f30 [4194304,4194304] 0 2024-09-19T09:02:47.197 INFO:tasks.workunit.client.1.smithi102.stdout:5/832: rename d5/d7/d1a/c6a to d5/d7b/ddd/c105 0 2024-09-19T09:02:47.197 INFO:tasks.workunit.client.1.smithi102.stdout:7/889: readlink d1/d4/lc9 0 2024-09-19T09:02:47.199 INFO:tasks.workunit.client.1.smithi102.stdout:2/762: fsync d7/d1a/d2b/d31/d106/daf/f9d 0 2024-09-19T09:02:47.199 INFO:tasks.workunit.client.1.smithi102.stdout:6/760: mknod d1/d26/d2e/d45/dac/db2/df5/cff 0 2024-09-19T09:02:47.200 INFO:tasks.workunit.client.1.smithi102.stdout:5/833: chown d5/d60/fc3 43231 1 2024-09-19T09:02:47.202 INFO:tasks.workunit.client.1.smithi102.stdout:1/815: dwrite dd/d14/d35/d49/fec [0,4194304] 0 2024-09-19T09:02:47.205 INFO:tasks.workunit.client.1.smithi102.stdout:4/951: unlink d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/cda 0 2024-09-19T09:02:47.205 INFO:tasks.workunit.client.1.smithi102.stdout:9/844: creat d1/d2/d3/d1d/dc7/f113 x:0 0 0 2024-09-19T09:02:47.209 INFO:tasks.workunit.client.1.smithi102.stdout:5/834: read d5/f6e [1272260,16649] 0 2024-09-19T09:02:47.209 INFO:tasks.workunit.client.1.smithi102.stdout:7/890: creat d1/d3/d20/d115/f11a x:0 0 0 2024-09-19T09:02:47.213 INFO:tasks.workunit.client.1.smithi102.stdout:7/891: chown d1/d3/d20/f9a 0 1 2024-09-19T09:02:47.213 INFO:tasks.workunit.client.1.smithi102.stdout:3/949: dwrite d2/d19/d1c/fe8 [0,4194304] 0 2024-09-19T09:02:47.218 INFO:tasks.workunit.client.1.smithi102.stdout:8/763: truncate d0/d10/fc9 1890955 0 2024-09-19T09:02:47.220 INFO:tasks.workunit.client.1.smithi102.stdout:9/845: creat d1/f114 x:0 0 0 2024-09-19T09:02:47.223 INFO:tasks.workunit.client.1.smithi102.stdout:7/892: symlink d1/d3/d34/l11b 0 2024-09-19T09:02:47.223 INFO:tasks.workunit.client.1.smithi102.stdout:5/835: dwrite d5/d7/d1a/d37/d39/d4c/fb4 [0,4194304] 0 2024-09-19T09:02:47.224 INFO:tasks.workunit.client.1.smithi102.stdout:8/764: mkdir d0/d10/d21/db3/df2 0 2024-09-19T09:02:47.225 INFO:tasks.workunit.client.1.smithi102.stdout:9/846: readlink d1/d2/d3/d6f/d8d/da2/db6/lfc 0 2024-09-19T09:02:47.226 INFO:tasks.workunit.client.1.smithi102.stdout:4/952: write d14/d16/d1d/f72 [2376853,76198] 0 2024-09-19T09:02:47.227 INFO:tasks.workunit.client.1.smithi102.stdout:7/893: dread - d1/d3/d34/ffd zero size 2024-09-19T09:02:47.232 INFO:tasks.workunit.client.1.smithi102.stdout:3/950: truncate d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9d 3930862 0 2024-09-19T09:02:47.236 INFO:tasks.workunit.client.1.smithi102.stdout:5/836: write d5/d7/d1a/d37/d34/d4d/f64 [3419945,37778] 0 2024-09-19T09:02:47.237 INFO:tasks.workunit.client.1.smithi102.stdout:8/765: dread d0/d10/d21/d39/d50/d63/fb9 [0,4194304] 0 2024-09-19T09:02:47.237 INFO:tasks.workunit.client.1.smithi102.stdout:2/763: dwrite d7/ff [4194304,4194304] 0 2024-09-19T09:02:47.241 INFO:tasks.workunit.client.1.smithi102.stdout:1/816: dwrite dd/d14/d35/d49/d62/d6c/f8d [0,4194304] 0 2024-09-19T09:02:47.242 INFO:tasks.workunit.client.1.smithi102.stdout:9/847: mkdir d1/d2/d3/d1d/d4f/d6d/d81/d90/d115 0 2024-09-19T09:02:47.242 INFO:tasks.workunit.client.1.smithi102.stdout:5/837: truncate d5/d60/f101 398116 0 2024-09-19T09:02:47.243 INFO:tasks.workunit.client.1.smithi102.stdout:6/761: dread d1/d26/d2e/d45/daf/d8d/f9c [0,4194304] 0 2024-09-19T09:02:47.243 INFO:tasks.workunit.client.1.smithi102.stdout:2/764: chown d7/d50/d64/f65 5659840 1 2024-09-19T09:02:47.244 INFO:tasks.workunit.client.1.smithi102.stdout:4/953: symlink d14/d16/d17/de3/dbd/df3/d37/d58/de2/dd3/l138 0 2024-09-19T09:02:47.245 INFO:tasks.workunit.client.1.smithi102.stdout:8/766: creat d0/d10/ff3 x:0 0 0 2024-09-19T09:02:47.247 INFO:tasks.workunit.client.1.smithi102.stdout:1/817: read - dd/d14/d35/fb6 zero size 2024-09-19T09:02:47.249 INFO:tasks.workunit.client.1.smithi102.stdout:5/838: chown d5/d7/d1a/d42/fe3 11 1 2024-09-19T09:02:47.250 INFO:tasks.workunit.client.1.smithi102.stdout:9/848: truncate d1/d2/f72 4694113 0 2024-09-19T09:02:47.250 INFO:tasks.workunit.client.1.smithi102.stdout:6/762: write d1/d26/d4b/d94/d8a/f6f [4014794,125143] 0 2024-09-19T09:02:47.250 INFO:tasks.workunit.client.1.smithi102.stdout:4/954: chown d14/d16/d17/de3/dbd/df3/l30 1674783 1 2024-09-19T09:02:47.252 INFO:tasks.workunit.client.1.smithi102.stdout:7/894: dwrite d1/d3/d34/d4f/fe9 [0,4194304] 0 2024-09-19T09:02:47.253 INFO:tasks.workunit.client.1.smithi102.stdout:6/763: dread - d1/d18/fc0 zero size 2024-09-19T09:02:47.253 INFO:tasks.workunit.client.1.smithi102.stdout:4/955: chown lb 3 1 2024-09-19T09:02:47.255 INFO:tasks.workunit.client.1.smithi102.stdout:8/767: rename d0/d4f/cc0 to d0/d10/d3a/d9a/cf4 0 2024-09-19T09:02:47.257 INFO:tasks.workunit.client.1.smithi102.stdout:6/764: chown d1/d26/d2e/d45/daf/d8d/lba 359753 1 2024-09-19T09:02:47.257 INFO:tasks.workunit.client.1.smithi102.stdout:1/818: dread dd/d7a/d8c/da6/fc9 [0,4194304] 0 2024-09-19T09:02:47.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:46 smithi102 ceph-mon[35280]: pgmap v30: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 167 MiB/s wr, 390 op/s 2024-09-19T09:02:47.266 INFO:tasks.workunit.client.1.smithi102.stdout:2/765: rename d7/d1a/d2b/dae/dbe to d7/d1a/d2b/d31/d106/d93/dce/d10e 0 2024-09-19T09:02:47.267 INFO:tasks.workunit.client.1.smithi102.stdout:4/956: mknod d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/c139 0 2024-09-19T09:02:47.271 INFO:tasks.workunit.client.1.smithi102.stdout:8/768: dwrite d0/db/d29/fde [0,4194304] 0 2024-09-19T09:02:47.271 INFO:tasks.workunit.client.1.smithi102.stdout:5/839: dread d5/d7/f19 [0,4194304] 0 2024-09-19T09:02:47.288 INFO:tasks.workunit.client.1.smithi102.stdout:1/819: truncate dd/f12 1422734 0 2024-09-19T09:02:47.289 INFO:tasks.workunit.client.1.smithi102.stdout:1/820: dread - dd/dd5/df1/ff5 zero size 2024-09-19T09:02:47.289 INFO:tasks.workunit.client.1.smithi102.stdout:1/821: readlink dd/d14/l61 0 2024-09-19T09:02:47.290 INFO:tasks.workunit.client.1.smithi102.stdout:9/849: rename d1/d2/d3/f38 to d1/d2/d3/d1d/d4f/d6d/d81/d90/f116 0 2024-09-19T09:02:47.290 INFO:tasks.workunit.client.1.smithi102.stdout:4/957: dread - d14/d16/d1d/d92/fec zero size 2024-09-19T09:02:47.293 INFO:tasks.workunit.client.1.smithi102.stdout:6/765: truncate d1/d26/d2e/f5f 389181 0 2024-09-19T09:02:47.295 INFO:tasks.workunit.client.1.smithi102.stdout:7/895: rename d1/d3/lec to d1/d4/dca/d52/d7f/da5/de6/l11c 0 2024-09-19T09:02:47.296 INFO:tasks.workunit.client.1.smithi102.stdout:1/822: symlink dd/d7a/d8c/da6/l109 0 2024-09-19T09:02:47.296 INFO:tasks.workunit.client.1.smithi102.stdout:9/850: dread d1/d2/d3/d6f/d8d/da2/db6/fe0 [4194304,4194304] 0 2024-09-19T09:02:47.297 INFO:tasks.workunit.client.1.smithi102.stdout:9/851: fsync d1/d2/d3/d6f/dcb/ff6 0 2024-09-19T09:02:47.298 INFO:tasks.workunit.client.1.smithi102.stdout:9/852: fsync d1/d2/d3/d1d/d4f/d6d/d81/f92 0 2024-09-19T09:02:47.299 INFO:tasks.workunit.client.1.smithi102.stdout:4/958: unlink d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/f113 0 2024-09-19T09:02:47.301 INFO:tasks.workunit.client.1.smithi102.stdout:5/840: creat d5/d7/d1a/d37/d34/f106 x:0 0 0 2024-09-19T09:02:47.309 INFO:tasks.workunit.client.1.smithi102.stdout:5/841: truncate d5/f6e 2356650 0 2024-09-19T09:02:47.309 INFO:tasks.workunit.client.1.smithi102.stdout:6/766: creat d1/d18/db/f100 x:0 0 0 2024-09-19T09:02:47.310 INFO:tasks.workunit.client.1.smithi102.stdout:8/769: rename d0/d10/d21/f6c to d0/ff5 0 2024-09-19T09:02:47.312 INFO:tasks.workunit.client.1.smithi102.stdout:6/767: symlink d1/d26/d2e/d45/daf/d8d/l101 0 2024-09-19T09:02:47.313 INFO:tasks.workunit.client.1.smithi102.stdout:6/768: dread - d1/d26/d4b/d94/da2/fef zero size 2024-09-19T09:02:47.313 INFO:tasks.workunit.client.1.smithi102.stdout:7/896: rename d1/d3/d20/dad/dd4/fdb to d1/d2d/f11d 0 2024-09-19T09:02:47.315 INFO:tasks.workunit.client.1.smithi102.stdout:7/897: stat d1/d3/d72/f8b 0 2024-09-19T09:02:47.317 INFO:tasks.workunit.client.1.smithi102.stdout:5/842: rename d5/d60/f101 to d5/d7/d1a/d37/d39/d4c/f107 0 2024-09-19T09:02:47.321 INFO:tasks.workunit.client.1.smithi102.stdout:8/770: dread d0/fd [4194304,4194304] 0 2024-09-19T09:02:47.322 INFO:tasks.workunit.client.1.smithi102.stdout:6/769: creat d1/d26/d2e/d45/d47/d4d/f102 x:0 0 0 2024-09-19T09:02:47.322 INFO:tasks.workunit.client.1.smithi102.stdout:8/771: write d0/db/fee [583784,29531] 0 2024-09-19T09:02:47.328 INFO:tasks.workunit.client.1.smithi102.stdout:5/843: link d5/d7/d1a/d37/d34/f49 d5/d7/d1a/d37/d34/d7f/d91/f108 0 2024-09-19T09:02:47.329 INFO:tasks.workunit.client.1.smithi102.stdout:7/898: dread d1/d3/d72/f8b [0,4194304] 0 2024-09-19T09:02:47.329 INFO:tasks.workunit.client.1.smithi102.stdout:6/770: rmdir d1/d26/d2e/d45/dec 0 2024-09-19T09:02:47.331 INFO:tasks.workunit.client.1.smithi102.stdout:8/772: link d0/db/f3b d0/d10/d21/d39/d50/d63/ff6 0 2024-09-19T09:02:47.333 INFO:tasks.workunit.client.1.smithi102.stdout:8/773: symlink d0/d10/d21/d39/d50/da2/lf7 0 2024-09-19T09:02:47.334 INFO:tasks.workunit.client.1.smithi102.stdout:7/899: dwrite d1/d3/d34/f66 [0,4194304] 0 2024-09-19T09:02:47.350 INFO:tasks.workunit.client.1.smithi102.stdout:8/774: mknod d0/d10/d21/d39/d50/deb/cf8 0 2024-09-19T09:02:47.353 INFO:tasks.workunit.client.1.smithi102.stdout:5/844: dread d5/d7/f35 [0,4194304] 0 2024-09-19T09:02:47.355 INFO:tasks.workunit.client.1.smithi102.stdout:1/823: write dd/d14/d35/d49/d7d/d7f/f8b [1065911,30154] 0 2024-09-19T09:02:47.355 INFO:tasks.workunit.client.1.smithi102.stdout:9/853: write d1/d2/d3/d1d/d4f/d6d/d81/d90/faf [717969,130961] 0 2024-09-19T09:02:47.357 INFO:tasks.workunit.client.1.smithi102.stdout:7/900: dwrite d1/d3/d72/f106 [0,4194304] 0 2024-09-19T09:02:47.358 INFO:tasks.workunit.client.1.smithi102.stdout:4/959: truncate d14/d16/d17/de3/dbd/df3/d37/d58/de2/fad 4542161 0 2024-09-19T09:02:47.360 INFO:tasks.workunit.client.1.smithi102.stdout:8/775: dread - d0/d10/d21/d39/d50/fb2 zero size 2024-09-19T09:02:47.361 INFO:tasks.workunit.client.1.smithi102.stdout:2/766: dwrite d7/d1a/d2b/d31/d106/f88 [0,4194304] 0 2024-09-19T09:02:47.362 INFO:tasks.workunit.client.1.smithi102.stdout:1/824: read dd/d14/d35/d49/dcb/f6e [355599,22750] 0 2024-09-19T09:02:47.363 INFO:tasks.workunit.client.1.smithi102.stdout:5/845: mknod d5/d23/c109 0 2024-09-19T09:02:47.364 INFO:tasks.workunit.client.1.smithi102.stdout:9/854: chown d1/d2/d3/d1d/d4f/d6d/db4/ldf 22311375 1 2024-09-19T09:02:47.366 INFO:tasks.workunit.client.1.smithi102.stdout:5/846: chown d5/d7/d1a/d8f/fbd 15441505 1 2024-09-19T09:02:47.367 INFO:tasks.workunit.client.1.smithi102.stdout:8/776: symlink d0/d10/d3a/lf9 0 2024-09-19T09:02:47.370 INFO:tasks.workunit.client.1.smithi102.stdout:9/855: mknod d1/d2/d3/d6f/d8d/da2/db6/c117 0 2024-09-19T09:02:47.375 INFO:tasks.workunit.client.1.smithi102.stdout:4/960: dread d14/d16/d1d/f20 [0,4194304] 0 2024-09-19T09:02:47.376 INFO:tasks.workunit.client.1.smithi102.stdout:5/847: creat d5/d7/d1a/d37/d34/d7f/d91/f10a x:0 0 0 2024-09-19T09:02:47.377 INFO:tasks.workunit.client.1.smithi102.stdout:1/825: rename dd/d14/d35/d49/d62/d6c/d99/db8/cc4 to dd/d14/d35/d49/dcb/c10a 0 2024-09-19T09:02:47.379 INFO:tasks.workunit.client.1.smithi102.stdout:7/901: getdents d1/d2d 0 2024-09-19T09:02:47.379 INFO:tasks.workunit.client.1.smithi102.stdout:9/856: fdatasync d1/d2/d3/d1d/f30 0 2024-09-19T09:02:47.380 INFO:tasks.workunit.client.1.smithi102.stdout:1/826: write dd/d7a/d8c/da6/ff8 [779387,69988] 0 2024-09-19T09:02:47.381 INFO:tasks.workunit.client.1.smithi102.stdout:4/961: symlink d14/d16/d17/de3/dbd/df3/d37/l13a 0 2024-09-19T09:02:47.383 INFO:tasks.workunit.client.1.smithi102.stdout:5/848: chown d5/d7/d1a/d37/d34/f49 49644195 1 2024-09-19T09:02:47.384 INFO:tasks.workunit.client.1.smithi102.stdout:2/767: dread d7/d1a/d2b/dab/fca [0,4194304] 0 2024-09-19T09:02:47.387 INFO:tasks.workunit.client.1.smithi102.stdout:7/902: rename d1/d3/d20/f9a to d1/d3/d20/dad/f11e 0 2024-09-19T09:02:47.390 INFO:tasks.workunit.client.1.smithi102.stdout:8/777: truncate d0/db/fe1 352124 0 2024-09-19T09:02:47.391 INFO:tasks.workunit.client.1.smithi102.stdout:3/951: sync 2024-09-19T09:02:47.391 INFO:tasks.workunit.client.1.smithi102.stdout:2/768: mknod d7/d1a/d2b/d31/d51/df2/c10f 0 2024-09-19T09:02:47.391 INFO:tasks.workunit.client.1.smithi102.stdout:5/849: dread d5/d7/d1a/d37/d39/d4c/f5d [0,4194304] 0 2024-09-19T09:02:47.392 INFO:tasks.workunit.client.1.smithi102.stdout:1/827: symlink dd/d14/d35/d49/d62/l10b 0 2024-09-19T09:02:47.392 INFO:tasks.workunit.client.1.smithi102.stdout:1/828: readlink dd/d7a/d8c/lbb 0 2024-09-19T09:02:47.393 INFO:tasks.workunit.client.1.smithi102.stdout:4/962: rename d14/d16/d17/c22 to d14/d34/d5a/d5c/d81/c13b 0 2024-09-19T09:02:47.394 INFO:tasks.workunit.client.1.smithi102.stdout:7/903: mknod d1/d4/dca/d52/d7f/da5/de2/df0/c11f 0 2024-09-19T09:02:47.395 INFO:tasks.workunit.client.1.smithi102.stdout:7/904: write d1/d3/d20/dad/dcd/ffc [743213,12777] 0 2024-09-19T09:02:47.398 INFO:tasks.workunit.client.1.smithi102.stdout:7/905: fsync d1/d4/ff6 0 2024-09-19T09:02:47.399 INFO:tasks.workunit.client.1.smithi102.stdout:9/857: write d1/d2/d3/d1d/dc7/fcd [349099,98198] 0 2024-09-19T09:02:47.400 INFO:tasks.workunit.client.1.smithi102.stdout:3/952: symlink d2/d19/d1c/d2f/d5a/d84/d4f/d72/l131 0 2024-09-19T09:02:47.400 INFO:tasks.workunit.client.1.smithi102.stdout:5/850: mkdir d5/d23/d10b 0 2024-09-19T09:02:47.401 INFO:tasks.workunit.client.1.smithi102.stdout:1/829: unlink dd/d14/d35/d49/d62/d9e/dab/lbd 0 2024-09-19T09:02:47.402 INFO:tasks.workunit.client.1.smithi102.stdout:8/778: mkdir d0/d4f/de8/dfa 0 2024-09-19T09:02:47.403 INFO:tasks.workunit.client.1.smithi102.stdout:1/830: chown dd/d14/d35/d49/d7d 129 1 2024-09-19T09:02:47.406 INFO:tasks.workunit.client.1.smithi102.stdout:5/851: dread d5/d7/f29 [0,4194304] 0 2024-09-19T09:02:47.409 INFO:tasks.workunit.client.1.smithi102.stdout:8/779: creat d0/d10/ffb x:0 0 0 2024-09-19T09:02:47.410 INFO:tasks.workunit.client.1.smithi102.stdout:8/780: chown d0/d5a/ldd 0 1 2024-09-19T09:02:47.410 INFO:tasks.workunit.client.1.smithi102.stdout:8/781: chown d0/d4f/f65 1 1 2024-09-19T09:02:47.412 INFO:tasks.workunit.client.1.smithi102.stdout:7/906: creat d1/d3/f120 x:0 0 0 2024-09-19T09:02:47.413 INFO:tasks.workunit.client.1.smithi102.stdout:5/852: mknod d5/d7/d1a/d37/d34/d7f/c10c 0 2024-09-19T09:02:47.414 INFO:tasks.workunit.client.1.smithi102.stdout:4/963: dread d14/d34/d5a/d5c/d79/d8c/fb7 [0,4194304] 0 2024-09-19T09:02:47.415 INFO:tasks.workunit.client.1.smithi102.stdout:3/953: link d2/d19/d47/db/d26/f11c d2/d19/d47/db/dc3/f132 0 2024-09-19T09:02:47.417 INFO:tasks.workunit.client.1.smithi102.stdout:8/782: symlink d0/d4f/lfc 0 2024-09-19T09:02:47.418 INFO:tasks.workunit.client.1.smithi102.stdout:2/769: dwrite d7/d50/d64/f65 [0,4194304] 0 2024-09-19T09:02:47.418 INFO:tasks.workunit.client.1.smithi102.stdout:8/783: read d0/db/d29/fde [2464137,28518] 0 2024-09-19T09:02:47.419 INFO:tasks.workunit.client.1.smithi102.stdout:9/858: creat d1/d2/d3/d1d/d4f/d6d/f118 x:0 0 0 2024-09-19T09:02:47.420 INFO:tasks.workunit.client.1.smithi102.stdout:7/907: mknod d1/d4/dca/d52/c121 0 2024-09-19T09:02:47.421 INFO:tasks.workunit.client.1.smithi102.stdout:5/853: truncate d5/d60/fd5 1326426 0 2024-09-19T09:02:47.423 INFO:tasks.workunit.client.1.smithi102.stdout:1/831: creat dd/d7a/d8c/d8e/d103/f10c x:0 0 0 2024-09-19T09:02:47.423 INFO:tasks.workunit.client.1.smithi102.stdout:9/859: dread d1/d2/d3/ff9 [0,4194304] 0 2024-09-19T09:02:47.424 INFO:tasks.workunit.client.1.smithi102.stdout:5/854: write d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/de0/fa4 [4406093,77784] 0 2024-09-19T09:02:47.426 INFO:tasks.workunit.client.1.smithi102.stdout:2/770: creat d7/d1a/d2b/d31/d106/d93/f110 x:0 0 0 2024-09-19T09:02:47.427 INFO:tasks.workunit.client.1.smithi102.stdout:8/784: creat d0/d10/d21/d39/d87/ffd x:0 0 0 2024-09-19T09:02:47.430 INFO:tasks.workunit.client.1.smithi102.stdout:1/832: creat dd/d68/f10d x:0 0 0 2024-09-19T09:02:47.432 INFO:tasks.workunit.client.1.smithi102.stdout:6/771: sync 2024-09-19T09:02:47.432 INFO:tasks.workunit.client.1.smithi102.stdout:4/964: rename d14/d16/d17/de3/dbd/df3/d37/d58/l119 to d14/d16/d17/de3/l13c 0 2024-09-19T09:02:47.432 INFO:tasks.workunit.client.1.smithi102.stdout:6/772: chown d1/d3a 446 1 2024-09-19T09:02:47.434 INFO:tasks.workunit.client.1.smithi102.stdout:2/771: dwrite d7/d50/d64/d7f/d83/f75 [0,4194304] 0 2024-09-19T09:02:47.434 INFO:tasks.workunit.client.1.smithi102.stdout:5/855: symlink d5/d23/l10d 0 2024-09-19T09:02:47.434 INFO:tasks.workunit.client.1.smithi102.stdout:6/773: stat d1/d26/d2e/d45/d47/dc3/lc9 0 2024-09-19T09:02:47.435 INFO:tasks.workunit.client.1.smithi102.stdout:2/772: chown d7/d1a/d56/db9 0 1 2024-09-19T09:02:47.435 INFO:tasks.workunit.client.1.smithi102.stdout:5/856: truncate d5/d7b/f103 1268878 0 2024-09-19T09:02:47.436 INFO:tasks.workunit.client.1.smithi102.stdout:2/773: dread - d7/d50/d64/da1/fa2 zero size 2024-09-19T09:02:47.438 INFO:tasks.workunit.client.1.smithi102.stdout:8/785: creat d0/d10/d21/db3/ffe x:0 0 0 2024-09-19T09:02:47.440 INFO:tasks.workunit.client.1.smithi102.stdout:8/786: truncate d0/d10/d21/db3/ffe 690660 0 2024-09-19T09:02:47.440 INFO:tasks.workunit.client.1.smithi102.stdout:8/787: readlink d0/d10/d21/d39/le2 0 2024-09-19T09:02:47.441 INFO:tasks.workunit.client.1.smithi102.stdout:7/908: rename d1/d4/lb8 to d1/d3/d20/dad/dd4/l122 0 2024-09-19T09:02:47.442 INFO:tasks.workunit.client.1.smithi102.stdout:7/909: write d1/d2d/f54 [3528178,64891] 0 2024-09-19T09:02:47.446 INFO:tasks.workunit.client.1.smithi102.stdout:9/860: rename d1/d2/d3/f12 to d1/d2/d3/d6f/d8d/da2/d106/d10e/f119 0 2024-09-19T09:02:47.448 INFO:tasks.workunit.client.1.smithi102.stdout:8/788: creat d0/d10/d9b/fff x:0 0 0 2024-09-19T09:02:47.449 INFO:tasks.workunit.client.1.smithi102.stdout:6/774: truncate d1/d18/d37/f4e 480449 0 2024-09-19T09:02:47.450 INFO:tasks.workunit.client.0.smithi049.stdout:0/227: sync 2024-09-19T09:02:47.450 INFO:tasks.workunit.client.0.smithi049.stdout:4/143: sync 2024-09-19T09:02:47.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/136: sync 2024-09-19T09:02:47.451 INFO:tasks.workunit.client.1.smithi102.stdout:5/857: getdents d5/d7/d1a/d37/d39/d81/df2 0 2024-09-19T09:02:47.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/228: truncate d5/fd 698118 0 2024-09-19T09:02:47.454 INFO:tasks.workunit.client.0.smithi049.stdout:9/137: rename d3/d14/f19 to d3/d14/d1a/d21/f2f 0 2024-09-19T09:02:47.454 INFO:tasks.workunit.client.1.smithi102.stdout:9/861: dwrite d1/d8/d1c/f28 [4194304,4194304] 0 2024-09-19T09:02:47.457 INFO:tasks.workunit.client.1.smithi102.stdout:3/954: dwrite d2/d19/ff6 [0,4194304] 0 2024-09-19T09:02:47.457 INFO:tasks.workunit.client.1.smithi102.stdout:1/833: dread dd/d14/d18/f37 [0,4194304] 0 2024-09-19T09:02:47.459 INFO:tasks.workunit.client.1.smithi102.stdout:1/834: dread - dd/d68/f10d zero size 2024-09-19T09:02:47.470 INFO:tasks.workunit.client.1.smithi102.stdout:5/858: dread d5/d23/f26 [0,4194304] 0 2024-09-19T09:02:47.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/144: mknod d4/d15/c2a 0 2024-09-19T09:02:47.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/229: creat d5/d10/d13/d15/d36/f48 x:0 0 0 2024-09-19T09:02:47.584 INFO:tasks.workunit.client.0.smithi049.stdout:4/145: rename d4/d15/d19 to d4/d15/d19/d1f/d2b 22 2024-09-19T09:02:47.659 INFO:tasks.workunit.client.1.smithi102.stdout:2/774: rmdir d7/d1a/d2b/d4e/dfe 0 2024-09-19T09:02:47.660 INFO:tasks.workunit.client.0.smithi049.stdout:9/138: mknod d3/d14/c30 0 2024-09-19T09:02:47.661 INFO:tasks.workunit.client.1.smithi102.stdout:4/965: getdents d14/d16/d17/de3/dbd/df3/d37/d58/d89/da0 0 2024-09-19T09:02:47.662 INFO:tasks.workunit.client.0.smithi049.stdout:0/230: creat d5/d10/d13/d30/f49 x:0 0 0 2024-09-19T09:02:47.666 INFO:tasks.workunit.client.1.smithi102.stdout:9/862: mkdir d1/d2/d3/d6f/d8d/da2/db6/d11a 0 2024-09-19T09:02:47.668 INFO:tasks.workunit.client.0.smithi049.stdout:9/139: mkdir d3/d14/d1a/d21/d31 0 2024-09-19T09:02:47.668 INFO:tasks.workunit.client.0.smithi049.stdout:0/231: dwrite d5/d10/d13/d15/f1e [0,4194304] 0 2024-09-19T09:02:47.669 INFO:tasks.workunit.client.1.smithi102.stdout:3/955: symlink d2/d1e/dcb/l133 0 2024-09-19T09:02:47.670 INFO:tasks.workunit.client.0.smithi049.stdout:0/232: chown d5/d10/d13/d15/d29/d3b/f46 26362948 1 2024-09-19T09:02:47.674 INFO:tasks.workunit.client.1.smithi102.stdout:1/835: rename dd/d14/fbe to dd/d68/f10e 0 2024-09-19T09:02:47.679 INFO:tasks.workunit.client.0.smithi049.stdout:9/140: mknod d3/d14/d1a/d21/c32 0 2024-09-19T09:02:47.682 INFO:tasks.workunit.client.1.smithi102.stdout:1/836: dwrite dd/d7a/d8c/d8e/d103/ddc/fe6 [0,4194304] 0 2024-09-19T09:02:47.685 INFO:tasks.workunit.client.1.smithi102.stdout:5/859: dwrite d5/d7/f29 [0,4194304] 0 2024-09-19T09:02:47.688 INFO:tasks.workunit.client.1.smithi102.stdout:6/775: dwrite d1/d18/f78 [0,4194304] 0 2024-09-19T09:02:47.688 INFO:tasks.workunit.client.0.smithi049.stdout:4/146: getdents d4/d15/d19/d1f 0 2024-09-19T09:02:47.689 INFO:tasks.workunit.client.0.smithi049.stdout:9/141: dwrite d3/f1f [0,4194304] 0 2024-09-19T09:02:47.690 INFO:tasks.workunit.client.0.smithi049.stdout:3/151: sync 2024-09-19T09:02:47.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/152: write d10/f34 [1000168,110041] 0 2024-09-19T09:02:47.696 INFO:tasks.workunit.client.1.smithi102.stdout:5/860: dread d5/d8d/d95/ff8 [0,4194304] 0 2024-09-19T09:02:47.705 INFO:tasks.workunit.client.1.smithi102.stdout:5/861: dwrite d5/d7/d1a/fce [0,4194304] 0 2024-09-19T09:02:47.707 INFO:tasks.workunit.client.0.smithi049.stdout:3/153: dwrite d10/d11/d13/f18 [0,4194304] 0 2024-09-19T09:02:47.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/142: rename d3/d14/c2b to d3/d14/d1a/c33 0 2024-09-19T09:02:47.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/154: write fc [4163347,14450] 0 2024-09-19T09:02:47.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/155: fsync d10/f1d 0 2024-09-19T09:02:47.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/233: getdents d5/d10/d2f 0 2024-09-19T09:02:47.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/234: chown d5/d10/f44 363471 1 2024-09-19T09:02:47.712 INFO:tasks.workunit.client.1.smithi102.stdout:7/910: getdents d1/d3/d20 0 2024-09-19T09:02:47.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/235: stat d5/d10/d13/f42 0 2024-09-19T09:02:47.717 INFO:tasks.workunit.client.1.smithi102.stdout:8/789: link d0/db/f3b d0/d10/d21/d39/d50/da2/dec/f100 0 2024-09-19T09:02:47.721 INFO:tasks.workunit.client.1.smithi102.stdout:2/775: dwrite d7/d1a/d2b/d31/dde/de9/f17 [8388608,4194304] 0 2024-09-19T09:02:47.721 INFO:tasks.workunit.client.0.smithi049.stdout:3/156: rename ff to d10/d11/f3a 0 2024-09-19T09:02:47.723 INFO:tasks.workunit.client.1.smithi102.stdout:2/776: write d7/d1a/d56/db9/fdd [360812,18327] 0 2024-09-19T09:02:47.723 INFO:tasks.workunit.client.1.smithi102.stdout:6/776: rename d1/d18/d37/c3d to d1/d26/d4b/c103 0 2024-09-19T09:02:47.723 INFO:tasks.workunit.client.0.smithi049.stdout:4/147: write d4/f6 [36702,96082] 0 2024-09-19T09:02:47.724 INFO:tasks.workunit.client.1.smithi102.stdout:2/777: chown d7/d1a/d2b/d31/dde/de9/l2e 145988 1 2024-09-19T09:02:47.725 INFO:tasks.workunit.client.0.smithi049.stdout:0/236: creat d5/d10/d13/d15/d29/d3b/f4a x:0 0 0 2024-09-19T09:02:47.725 INFO:tasks.workunit.client.1.smithi102.stdout:2/778: chown d7/d50/d64/d7f/d83 11262 1 2024-09-19T09:02:47.726 INFO:tasks.workunit.client.1.smithi102.stdout:9/863: creat d1/df3/f11b x:0 0 0 2024-09-19T09:02:47.731 INFO:tasks.workunit.client.1.smithi102.stdout:3/956: truncate d2/d19/f28 1195493 0 2024-09-19T09:02:47.732 INFO:tasks.workunit.client.0.smithi049.stdout:3/157: creat d10/d11/d13/d30/f3b x:0 0 0 2024-09-19T09:02:47.734 INFO:tasks.workunit.client.0.smithi049.stdout:4/148: creat d4/d15/d19/f2c x:0 0 0 2024-09-19T09:02:47.734 INFO:tasks.workunit.client.0.smithi049.stdout:3/158: stat d10/d11/d13/f32 0 2024-09-19T09:02:47.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/237: dwrite d5/d10/d13/d15/f43 [0,4194304] 0 2024-09-19T09:02:47.736 INFO:tasks.workunit.client.1.smithi102.stdout:4/966: link d14/dd7/le1 d14/d16/d1d/l13d 0 2024-09-19T09:02:47.737 INFO:tasks.workunit.client.0.smithi049.stdout:4/149: write d4/f5 [5122217,10205] 0 2024-09-19T09:02:47.741 INFO:tasks.workunit.client.0.smithi049.stdout:9/143: dwrite d3/d14/d1a/d21/f26 [0,4194304] 0 2024-09-19T09:02:47.742 INFO:tasks.workunit.client.0.smithi049.stdout:9/144: dread - d3/f15 zero size 2024-09-19T09:02:47.744 INFO:tasks.workunit.client.0.smithi049.stdout:9/145: truncate d3/f15 868735 0 2024-09-19T09:02:47.745 INFO:tasks.workunit.client.1.smithi102.stdout:2/779: mkdir d7/d1a/d2b/d31/d111 0 2024-09-19T09:02:47.746 INFO:tasks.workunit.client.0.smithi049.stdout:9/146: write d3/f1f [4489403,90733] 0 2024-09-19T09:02:47.749 INFO:tasks.workunit.client.0.smithi049.stdout:3/159: dwrite d10/d11/d13/f2d [4194304,4194304] 0 2024-09-19T09:02:47.749 INFO:tasks.workunit.client.0.smithi049.stdout:0/238: readlink l0 0 2024-09-19T09:02:47.750 INFO:tasks.workunit.client.1.smithi102.stdout:9/864: stat d1/d2/d78/f89 0 2024-09-19T09:02:47.751 INFO:tasks.workunit.client.1.smithi102.stdout:9/865: chown d1/d2/d3/d1d/dc7/f113 376356 1 2024-09-19T09:02:47.756 INFO:tasks.workunit.client.0.smithi049.stdout:4/150: rename d4/cd to d4/c2d 0 2024-09-19T09:02:47.759 INFO:tasks.workunit.client.1.smithi102.stdout:5/862: write d5/d60/f99 [496214,65763] 0 2024-09-19T09:02:47.760 INFO:tasks.workunit.client.1.smithi102.stdout:4/967: fsync d14/d16/d17/f1f 0 2024-09-19T09:02:47.761 INFO:tasks.workunit.client.0.smithi049.stdout:3/160: creat d10/d11/d13/d30/f3c x:0 0 0 2024-09-19T09:02:47.762 INFO:tasks.workunit.client.1.smithi102.stdout:6/777: mknod d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/de8/c104 0 2024-09-19T09:02:47.762 INFO:tasks.workunit.client.0.smithi049.stdout:3/161: write d10/d11/f26 [837196,54887] 0 2024-09-19T09:02:47.763 INFO:tasks.workunit.client.1.smithi102.stdout:6/778: fsync d1/d26/d2e/d45/dac/db2/fea 0 2024-09-19T09:02:47.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/239: creat d5/d10/d13/d15/d29/f4b x:0 0 0 2024-09-19T09:02:47.764 INFO:tasks.workunit.client.1.smithi102.stdout:6/779: stat d1/d26/d2e/d45/d47/d4d/d35/f39 0 2024-09-19T09:02:47.764 INFO:tasks.workunit.client.0.smithi049.stdout:9/147: mkdir d3/d14/d34 0 2024-09-19T09:02:47.766 INFO:tasks.workunit.client.1.smithi102.stdout:9/866: fdatasync d1/d2/f4a 0 2024-09-19T09:02:47.768 INFO:tasks.workunit.client.0.smithi049.stdout:9/148: rename d3/f1c to d3/d14/d1a/f35 0 2024-09-19T09:02:47.769 INFO:tasks.workunit.client.0.smithi049.stdout:3/162: mkdir d10/d3d 0 2024-09-19T09:02:47.770 INFO:tasks.workunit.client.0.smithi049.stdout:3/163: truncate d10/f1d 768996 0 2024-09-19T09:02:47.771 INFO:tasks.workunit.client.1.smithi102.stdout:9/867: dwrite d1/fa1 [0,4194304] 0 2024-09-19T09:02:47.772 INFO:tasks.workunit.client.1.smithi102.stdout:2/780: rename d7/d1a/d56/led to d7/d50/d64/d7f/l112 0 2024-09-19T09:02:47.775 INFO:tasks.workunit.client.1.smithi102.stdout:6/780: mknod d1/d26/d2e/d45/dac/df1/c105 0 2024-09-19T09:02:47.776 INFO:tasks.workunit.client.0.smithi049.stdout:9/149: write d3/d14/d1a/f35 [810314,32646] 0 2024-09-19T09:02:47.777 INFO:tasks.workunit.client.1.smithi102.stdout:8/790: link d0/d10/c90 d0/db/c101 0 2024-09-19T09:02:47.777 INFO:tasks.workunit.client.1.smithi102.stdout:3/957: write d2/d1e/d54/f97 [3061,76466] 0 2024-09-19T09:02:47.778 INFO:tasks.workunit.client.0.smithi049.stdout:3/164: dwrite d10/d11/f1a [0,4194304] 0 2024-09-19T09:02:47.779 INFO:tasks.workunit.client.0.smithi049.stdout:9/150: write f1 [9589178,111514] 0 2024-09-19T09:02:47.780 INFO:tasks.workunit.client.0.smithi049.stdout:9/151: fdatasync d3/d14/d1a/f25 0 2024-09-19T09:02:47.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/240: link l0 d5/d10/d13/d15/l4c 0 2024-09-19T09:02:47.787 INFO:tasks.workunit.client.1.smithi102.stdout:9/868: creat d1/d2/d3/d1d/d4f/f11c x:0 0 0 2024-09-19T09:02:47.789 INFO:tasks.workunit.client.1.smithi102.stdout:4/968: rename d14/dd7/f130 to d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/f13e 0 2024-09-19T09:02:47.791 INFO:tasks.workunit.client.1.smithi102.stdout:2/781: rmdir d7/d1a/d2b/d31/dde/de9 39 2024-09-19T09:02:47.792 INFO:tasks.workunit.client.1.smithi102.stdout:6/781: dread - d1/d26/d2e/d45/d47/d4d/d35/d79/fc1 zero size 2024-09-19T09:02:47.793 INFO:tasks.workunit.client.1.smithi102.stdout:6/782: fsync d1/d26/d4b/f51 0 2024-09-19T09:02:47.795 INFO:tasks.workunit.client.0.smithi049.stdout:0/241: symlink d5/d10/l4d 0 2024-09-19T09:02:47.796 INFO:tasks.workunit.client.0.smithi049.stdout:0/242: stat d5/d10/d13/d30/f31 0 2024-09-19T09:02:47.798 INFO:tasks.workunit.client.0.smithi049.stdout:3/165: mkdir d10/d3e 0 2024-09-19T09:02:47.798 INFO:tasks.workunit.client.0.smithi049.stdout:3/166: chown fd 3 1 2024-09-19T09:02:47.799 INFO:tasks.workunit.client.0.smithi049.stdout:9/152: creat d3/d22/f36 x:0 0 0 2024-09-19T09:02:47.801 INFO:tasks.workunit.client.1.smithi102.stdout:1/837: sync 2024-09-19T09:02:47.801 INFO:tasks.workunit.client.1.smithi102.stdout:7/911: sync 2024-09-19T09:02:47.802 INFO:tasks.workunit.client.1.smithi102.stdout:1/838: write dd/d7a/fed [834335,81381] 0 2024-09-19T09:02:47.803 INFO:tasks.workunit.client.0.smithi049.stdout:3/167: symlink d10/d11/d13/d30/l3f 0 2024-09-19T09:02:47.804 INFO:tasks.workunit.client.1.smithi102.stdout:1/839: dread - dd/d66/dea/f102 zero size 2024-09-19T09:02:47.804 INFO:tasks.workunit.client.1.smithi102.stdout:3/958: dread d2/d19/d1c/d70/f8a [0,4194304] 0 2024-09-19T09:02:47.808 INFO:tasks.workunit.client.1.smithi102.stdout:2/782: rename d7/d1a/d2b/d31/d51/d6b/l6d to d7/d1a/d2b/dae/l113 0 2024-09-19T09:02:47.809 INFO:tasks.workunit.client.0.smithi049.stdout:3/168: unlink d10/d11/d13/f2d 0 2024-09-19T09:02:47.809 INFO:tasks.workunit.client.1.smithi102.stdout:2/783: chown d7/d1a/l34 256698 1 2024-09-19T09:02:47.810 INFO:tasks.workunit.client.1.smithi102.stdout:4/969: dwrite d14/d34/d5a/d5c/d81/d75/f124 [0,4194304] 0 2024-09-19T09:02:47.811 INFO:tasks.workunit.client.0.smithi049.stdout:9/153: creat d3/d14/d34/f37 x:0 0 0 2024-09-19T09:02:47.811 INFO:tasks.workunit.client.0.smithi049.stdout:5/100: sync 2024-09-19T09:02:47.811 INFO:tasks.workunit.client.0.smithi049.stdout:1/126: sync 2024-09-19T09:02:47.811 INFO:tasks.workunit.client.1.smithi102.stdout:6/783: truncate d1/d18/db/f90 888396 0 2024-09-19T09:02:47.813 INFO:tasks.workunit.client.1.smithi102.stdout:8/791: creat d0/db/d1d/f102 x:0 0 0 2024-09-19T09:02:47.814 INFO:tasks.workunit.client.0.smithi049.stdout:0/243: creat d5/d10/d13/f4e x:0 0 0 2024-09-19T09:02:47.815 INFO:tasks.workunit.client.1.smithi102.stdout:5/863: getdents d5/d7 0 2024-09-19T09:02:47.816 INFO:tasks.workunit.client.1.smithi102.stdout:7/912: mkdir d1/d4/dca/d52/d7f/da5/df2/df9/d123 0 2024-09-19T09:02:47.818 INFO:tasks.workunit.client.1.smithi102.stdout:9/869: dwrite d1/d8/fd1 [0,4194304] 0 2024-09-19T09:02:47.819 INFO:tasks.workunit.client.1.smithi102.stdout:9/870: chown d1/d2/d3/d1d/d4f/f5a 4 1 2024-09-19T09:02:47.820 INFO:tasks.workunit.client.1.smithi102.stdout:9/871: chown d1/d2/f4a 15 1 2024-09-19T09:02:47.823 INFO:tasks.workunit.client.0.smithi049.stdout:9/154: rename d3/d22/f36 to d3/d22/f38 0 2024-09-19T09:02:47.826 INFO:tasks.workunit.client.1.smithi102.stdout:8/792: symlink d0/d10/d21/d39/d50/d63/d83/l103 0 2024-09-19T09:02:47.826 INFO:tasks.workunit.client.0.smithi049.stdout:3/169: dwrite d10/d11/f39 [0,4194304] 0 2024-09-19T09:02:47.828 INFO:tasks.workunit.client.1.smithi102.stdout:7/913: creat d1/d4/dca/d52/d7f/da5/de2/df0/f124 x:0 0 0 2024-09-19T09:02:47.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/127: dwrite d5/d6/f1b [0,4194304] 0 2024-09-19T09:02:47.831 INFO:tasks.workunit.client.1.smithi102.stdout:1/840: rename dd/d14/d35/d49/dcb/c10a to dd/d14/dac/dc2/c10f 0 2024-09-19T09:02:47.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/170: chown d10/d11/d13/f16 75790 1 2024-09-19T09:02:47.833 INFO:tasks.workunit.client.0.smithi049.stdout:5/101: dwrite d3/d5/de/f15 [0,4194304] 0 2024-09-19T09:02:47.836 INFO:tasks.workunit.client.1.smithi102.stdout:9/872: truncate d1/d2/d78/f89 470288 0 2024-09-19T09:02:47.837 INFO:tasks.workunit.client.0.smithi049.stdout:9/155: dread d3/f1f [0,4194304] 0 2024-09-19T09:02:47.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/244: creat d5/d10/d13/f4f x:0 0 0 2024-09-19T09:02:47.839 INFO:tasks.workunit.client.0.smithi049.stdout:9/156: chown d3/d14/f1e 24 1 2024-09-19T09:02:47.843 INFO:tasks.workunit.client.0.smithi049.stdout:9/157: dread d3/f15 [0,4194304] 0 2024-09-19T09:02:47.843 INFO:tasks.workunit.client.0.smithi049.stdout:0/245: truncate d5/d10/d13/d15/f43 4412987 0 2024-09-19T09:02:47.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/158: truncate d3/d14/f2d 789424 0 2024-09-19T09:02:47.847 INFO:tasks.workunit.client.0.smithi049.stdout:9/159: dread - d3/d14/d34/f37 zero size 2024-09-19T09:02:47.847 INFO:tasks.workunit.client.1.smithi102.stdout:4/970: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/f10f [0,4194304] 0 2024-09-19T09:02:47.848 INFO:tasks.workunit.client.0.smithi049.stdout:3/171: write d10/d11/f39 [4663481,74140] 0 2024-09-19T09:02:47.849 INFO:tasks.workunit.client.0.smithi049.stdout:1/128: rename d5/d6/d8/f14 to d5/d6/d8/f25 0 2024-09-19T09:02:47.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/172: write d10/d11/d13/f32 [430484,40908] 0 2024-09-19T09:02:47.852 INFO:tasks.workunit.client.0.smithi049.stdout:1/129: dread - d5/d6/d8/d13/f12 zero size 2024-09-19T09:02:47.852 INFO:tasks.workunit.client.0.smithi049.stdout:3/173: write fd [3335683,126852] 0 2024-09-19T09:02:47.853 INFO:tasks.workunit.client.0.smithi049.stdout:1/130: chown d5/d6/fa 121 1 2024-09-19T09:02:47.853 INFO:tasks.workunit.client.1.smithi102.stdout:3/959: mkdir d2/d19/d35/dce/ddc/df1/d134 0 2024-09-19T09:02:47.853 INFO:tasks.workunit.client.0.smithi049.stdout:3/174: truncate d10/f38 256000 0 2024-09-19T09:02:47.854 INFO:tasks.workunit.client.1.smithi102.stdout:6/784: write d1/d18/f7e [358690,104812] 0 2024-09-19T09:02:47.854 INFO:tasks.workunit.client.0.smithi049.stdout:3/175: readlink l9 0 2024-09-19T09:02:47.855 INFO:tasks.workunit.client.1.smithi102.stdout:2/784: rename d7/d1a/d2b/d31/d51/d6b/l7b to d7/d50/d64/d7f/l114 0 2024-09-19T09:02:47.856 INFO:tasks.workunit.client.1.smithi102.stdout:6/785: truncate d1/d18/db/f100 924968 0 2024-09-19T09:02:47.857 INFO:tasks.workunit.client.1.smithi102.stdout:1/841: mkdir dd/d7a/d8c/da6/d110 0 2024-09-19T09:02:47.857 INFO:tasks.workunit.client.1.smithi102.stdout:1/842: dread - dd/d68/f10e zero size 2024-09-19T09:02:47.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/246: rename d5/f20 to d5/f50 0 2024-09-19T09:02:47.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/131: dwrite d5/d6/f10 [0,4194304] 0 2024-09-19T09:02:47.865 INFO:tasks.workunit.client.1.smithi102.stdout:8/793: mkdir d0/db/d104 0 2024-09-19T09:02:47.867 INFO:tasks.workunit.client.1.smithi102.stdout:4/971: mkdir d14/d16/d17/de3/dbd/df3/d37/d58/d89/da0/d13f 0 2024-09-19T09:02:47.869 INFO:tasks.workunit.client.0.smithi049.stdout:3/176: unlink d10/f1c 0 2024-09-19T09:02:47.872 INFO:tasks.workunit.client.0.smithi049.stdout:9/160: dwrite d3/d14/f1e [0,4194304] 0 2024-09-19T09:02:47.877 INFO:tasks.workunit.client.0.smithi049.stdout:0/247: creat d5/d10/d13/d15/d36/f51 x:0 0 0 2024-09-19T09:02:47.880 INFO:tasks.workunit.client.1.smithi102.stdout:5/864: getdents d5/d7/d1a 0 2024-09-19T09:02:47.881 INFO:tasks.workunit.client.0.smithi049.stdout:3/177: dwrite d10/d11/d13/d30/f3b [0,4194304] 0 2024-09-19T09:02:47.882 INFO:tasks.workunit.client.0.smithi049.stdout:0/248: fsync d5/d10/d13/f1c 0 2024-09-19T09:02:47.882 INFO:tasks.workunit.client.0.smithi049.stdout:5/102: write d3/f10 [2957290,83986] 0 2024-09-19T09:02:47.883 INFO:tasks.workunit.client.1.smithi102.stdout:8/794: truncate d0/d10/d21/d39/f59 1510400 0 2024-09-19T09:02:47.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/161: rename d3/d14/c20 to d3/d14/d1a/d21/d31/c39 0 2024-09-19T09:02:47.887 INFO:tasks.workunit.client.1.smithi102.stdout:3/960: dread d2/d19/d1c/d2f/d5a/d84/d4f/f80 [0,4194304] 0 2024-09-19T09:02:47.892 INFO:tasks.workunit.client.1.smithi102.stdout:9/873: dwrite d1/d8/d1c/f99 [0,4194304] 0 2024-09-19T09:02:47.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/132: link f3 d5/f26 0 2024-09-19T09:02:47.896 INFO:tasks.workunit.client.0.smithi049.stdout:9/162: dwrite d3/f28 [0,4194304] 0 2024-09-19T09:02:47.898 INFO:tasks.workunit.client.0.smithi049.stdout:3/178: creat d10/d11/d13/d30/f40 x:0 0 0 2024-09-19T09:02:47.900 INFO:tasks.workunit.client.1.smithi102.stdout:4/972: dread f12 [4194304,4194304] 0 2024-09-19T09:02:47.901 INFO:tasks.workunit.client.0.smithi049.stdout:5/103: symlink d3/d5/de/l21 0 2024-09-19T09:02:47.905 INFO:tasks.workunit.client.0.smithi049.stdout:3/179: dread d10/d11/d27/f2e [0,4194304] 0 2024-09-19T09:02:47.907 INFO:tasks.workunit.client.1.smithi102.stdout:8/795: creat d0/db/d1d/f105 x:0 0 0 2024-09-19T09:02:47.908 INFO:tasks.workunit.client.0.smithi049.stdout:7/238: sync 2024-09-19T09:02:47.908 INFO:tasks.workunit.client.0.smithi049.stdout:2/116: sync 2024-09-19T09:02:47.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/94: sync 2024-09-19T09:02:47.909 INFO:tasks.workunit.client.1.smithi102.stdout:4/973: dwrite d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/fef [0,4194304] 0 2024-09-19T09:02:47.910 INFO:tasks.workunit.client.1.smithi102.stdout:3/961: readlink d2/d19/d1c/d2f/d5a/d84/l6e 0 2024-09-19T09:02:47.913 INFO:tasks.workunit.client.0.smithi049.stdout:1/133: mknod d5/c27 0 2024-09-19T09:02:47.915 INFO:tasks.workunit.client.1.smithi102.stdout:7/914: rename d1/d3/d20/f9d to d1/f125 0 2024-09-19T09:02:47.916 INFO:tasks.workunit.client.1.smithi102.stdout:7/915: dread - d1/d2d/feb zero size 2024-09-19T09:02:47.921 INFO:tasks.workunit.client.1.smithi102.stdout:4/974: dwrite d14/d34/d5a/d5c/d81/d75/f77 [0,4194304] 0 2024-09-19T09:02:47.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/249: dread d5/d10/f1d [0,4194304] 0 2024-09-19T09:02:47.922 INFO:tasks.workunit.client.0.smithi049.stdout:5/104: rmdir d3 39 2024-09-19T09:02:47.922 INFO:tasks.workunit.client.0.smithi049.stdout:1/134: dread d5/d6/f1b [0,4194304] 0 2024-09-19T09:02:47.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/180: dwrite d10/d11/f3a [0,4194304] 0 2024-09-19T09:02:47.929 INFO:tasks.workunit.client.0.smithi049.stdout:0/250: mkdir d5/d10/d2f/d52 0 2024-09-19T09:02:47.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/181: read - d10/d11/d13/f16 zero size 2024-09-19T09:02:47.932 INFO:tasks.workunit.client.1.smithi102.stdout:3/962: symlink d2/d19/d1c/d1f/d5f/l135 0 2024-09-19T09:02:47.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/163: dread d3/d14/d1a/d21/f2f [0,4194304] 0 2024-09-19T09:02:47.938 INFO:tasks.workunit.client.0.smithi049.stdout:2/117: rename d1/d19 to d1/d2b 0 2024-09-19T09:02:47.939 INFO:tasks.workunit.client.0.smithi049.stdout:2/118: chown d1/d4/fc 4276 1 2024-09-19T09:02:47.940 INFO:tasks.workunit.client.1.smithi102.stdout:6/786: getdents d1/d18 0 2024-09-19T09:02:47.940 INFO:tasks.workunit.client.0.smithi049.stdout:1/135: mknod d5/d6/d19/d21/c28 0 2024-09-19T09:02:47.941 INFO:tasks.workunit.client.1.smithi102.stdout:1/843: link dd/d7a/d8c/fbc dd/d14/d35/d49/d62/d6c/d99/f111 0 2024-09-19T09:02:47.942 INFO:tasks.workunit.client.1.smithi102.stdout:5/865: link d5/d7/d1a/d37/c2c d5/d7/d1a/daa/c10e 0 2024-09-19T09:02:47.943 INFO:tasks.workunit.client.1.smithi102.stdout:8/796: mkdir d0/db/d104/d106 0 2024-09-19T09:02:47.947 INFO:tasks.workunit.client.0.smithi049.stdout:5/105: creat d3/d5/d1c/f22 x:0 0 0 2024-09-19T09:02:47.948 INFO:tasks.workunit.client.1.smithi102.stdout:2/785: rename d7/d1a/d2b/d31/dde/de9 to d7/d50/d64/da1/d115 0 2024-09-19T09:02:47.951 INFO:tasks.workunit.client.0.smithi049.stdout:9/164: dwrite d3/d14/f24 [0,4194304] 0 2024-09-19T09:02:47.951 INFO:tasks.workunit.client.1.smithi102.stdout:9/874: dwrite d1/d2/d3/fb2 [4194304,4194304] 0 2024-09-19T09:02:47.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/136: creat d5/d6/dc/f29 x:0 0 0 2024-09-19T09:02:47.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/106: dread d3/d5/de/d12/f13 [0,4194304] 0 2024-09-19T09:02:47.957 INFO:tasks.workunit.client.1.smithi102.stdout:5/866: rmdir d5/d7/d1a/d37/d34/d4d 39 2024-09-19T09:02:47.957 INFO:tasks.workunit.client.1.smithi102.stdout:5/867: chown d5/d7/d1a/d42/c98 65 1 2024-09-19T09:02:47.958 INFO:tasks.workunit.client.1.smithi102.stdout:5/868: chown d5/d7/d1a/d42/l80 36 1 2024-09-19T09:02:47.958 INFO:tasks.workunit.client.0.smithi049.stdout:6/95: dread dc/d12/f1e [0,4194304] 0 2024-09-19T09:02:47.959 INFO:tasks.workunit.client.1.smithi102.stdout:5/869: stat d5/d7/d1a/f88 0 2024-09-19T09:02:47.959 INFO:tasks.workunit.client.1.smithi102.stdout:5/870: write d5/d7/d1a/ff9 [809055,22972] 0 2024-09-19T09:02:47.960 INFO:tasks.workunit.client.1.smithi102.stdout:8/797: truncate d0/f56 9733491 0 2024-09-19T09:02:47.963 INFO:tasks.workunit.client.1.smithi102.stdout:3/963: symlink d2/d1e/l136 0 2024-09-19T09:02:47.965 INFO:tasks.workunit.client.0.smithi049.stdout:2/119: creat d1/d2/d23/f2c x:0 0 0 2024-09-19T09:02:47.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/120: dread - d1/d4/fc zero size 2024-09-19T09:02:47.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/121: write d1/d4/d1e/f28 [565339,118512] 0 2024-09-19T09:02:47.967 INFO:tasks.workunit.client.1.smithi102.stdout:4/975: rename d14/d34/d5a/d5c/d81/d75/f77 to d14/d16/d17/de3/dbd/df3/d37/f140 0 2024-09-19T09:02:47.969 INFO:tasks.workunit.client.0.smithi049.stdout:2/122: fdatasync d1/d4/f1f 0 2024-09-19T09:02:47.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/165: symlink d3/d14/d1a/d21/d31/l3a 0 2024-09-19T09:02:47.970 INFO:tasks.workunit.client.1.smithi102.stdout:2/786: mknod d7/d1a/d2b/d31/c116 0 2024-09-19T09:02:47.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/137: creat d5/d6/d8/f2a x:0 0 0 2024-09-19T09:02:47.974 INFO:tasks.workunit.client.1.smithi102.stdout:1/844: write dd/d13/f36 [1025835,1841] 0 2024-09-19T09:02:47.974 INFO:tasks.workunit.client.0.smithi049.stdout:5/107: creat d3/d5/de/f23 x:0 0 0 2024-09-19T09:02:47.974 INFO:tasks.workunit.client.0.smithi049.stdout:0/251: dwrite d5/d10/d13/d15/f18 [0,4194304] 0 2024-09-19T09:02:47.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/108: fdatasync d3/d5/d1c/f22 0 2024-09-19T09:02:47.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/182: truncate d10/d11/d13/f28 4022236 0 2024-09-19T09:02:47.979 INFO:tasks.workunit.client.1.smithi102.stdout:8/798: write d0/db/d29/f72 [2808503,117519] 0 2024-09-19T09:02:47.980 INFO:tasks.workunit.client.0.smithi049.stdout:6/96: dread dc/d16/f18 [0,4194304] 0 2024-09-19T09:02:47.981 INFO:tasks.workunit.client.0.smithi049.stdout:6/97: fdatasync fa 0 2024-09-19T09:02:47.983 INFO:tasks.workunit.client.1.smithi102.stdout:3/964: chown d2/d19/d47/c20 3494 1 2024-09-19T09:02:47.983 INFO:tasks.workunit.client.1.smithi102.stdout:3/965: readlink d2/d19/d35/dce/ddc/de5/lf4 0 2024-09-19T09:02:47.985 INFO:tasks.workunit.client.0.smithi049.stdout:9/166: rmdir d3/d14 39 2024-09-19T09:02:47.987 INFO:tasks.workunit.client.0.smithi049.stdout:1/138: truncate d5/d6/f1b 2455924 0 2024-09-19T09:02:47.991 INFO:tasks.workunit.client.1.smithi102.stdout:4/976: unlink d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/l42 0 2024-09-19T09:02:47.993 INFO:tasks.workunit.client.0.smithi049.stdout:5/109: symlink d3/d5/l24 0 2024-09-19T09:02:47.996 INFO:tasks.workunit.client.0.smithi049.stdout:3/183: creat d10/d11/f41 x:0 0 0 2024-09-19T09:02:47.997 INFO:tasks.workunit.client.1.smithi102.stdout:7/916: getdents d1/d4/dca/d52/d7f/da5/df2/df9 0 2024-09-19T09:02:47.997 INFO:tasks.workunit.client.0.smithi049.stdout:3/184: stat c7 0 2024-09-19T09:02:47.998 INFO:tasks.workunit.client.0.smithi049.stdout:2/123: mkdir d1/d2d 0 2024-09-19T09:02:47.999 INFO:tasks.workunit.client.1.smithi102.stdout:1/845: creat dd/d7a/da0/f112 x:0 0 0 2024-09-19T09:02:48.000 INFO:tasks.workunit.client.0.smithi049.stdout:5/110: dwrite d3/d5/de/f1e [0,4194304] 0 2024-09-19T09:02:48.000 INFO:tasks.workunit.client.0.smithi049.stdout:2/124: chown d1/d2/f24 39 1 2024-09-19T09:02:48.001 INFO:tasks.workunit.client.0.smithi049.stdout:2/125: fdatasync d1/d2/d23/f2c 0 2024-09-19T09:02:48.002 INFO:tasks.workunit.client.1.smithi102.stdout:9/875: creat d1/d2/d3/d6f/d8d/da2/d106/d10e/d111/f11d x:0 0 0 2024-09-19T09:02:48.008 INFO:tasks.workunit.client.1.smithi102.stdout:8/799: truncate d0/d10/fb4 4969089 0 2024-09-19T09:02:48.009 INFO:tasks.workunit.client.0.smithi049.stdout:0/252: fsync d5/fd 0 2024-09-19T09:02:48.009 INFO:tasks.workunit.client.1.smithi102.stdout:2/787: dwrite d7/d1a/d2b/d31/d51/d6b/f70 [0,4194304] 0 2024-09-19T09:02:48.010 INFO:tasks.workunit.client.1.smithi102.stdout:3/966: creat d2/d19/d1c/d1f/f137 x:0 0 0 2024-09-19T09:02:48.010 INFO:tasks.workunit.client.1.smithi102.stdout:2/788: stat d7/d1a/d2b/f2d 0 2024-09-19T09:02:48.012 INFO:tasks.workunit.client.1.smithi102.stdout:6/787: rename d1/d26/d2e/d45/d47/d4d/d35/l60 to d1/d26/d2e/d45/d47/d4d/d35/d41/l106 0 2024-09-19T09:02:48.014 INFO:tasks.workunit.client.1.smithi102.stdout:4/977: symlink d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/l141 0 2024-09-19T09:02:48.014 INFO:tasks.workunit.client.1.smithi102.stdout:6/788: chown d1/d26/d2e/d45/dac/db2/df5/cff 15656111 1 2024-09-19T09:02:48.018 INFO:tasks.workunit.client.1.smithi102.stdout:2/789: creat d7/d50/d64/da1/d115/de1/f117 x:0 0 0 2024-09-19T09:02:48.018 INFO:tasks.workunit.client.1.smithi102.stdout:2/790: stat d7/d50/d64/da1/dd6/ce0 0 2024-09-19T09:02:48.019 INFO:tasks.workunit.client.1.smithi102.stdout:2/791: fdatasync d7/d1a/d56/db9/fdd 0 2024-09-19T09:02:48.020 INFO:tasks.workunit.client.1.smithi102.stdout:7/917: dread d1/d3/d34/f102 [0,4194304] 0 2024-09-19T09:02:48.020 INFO:tasks.workunit.client.1.smithi102.stdout:3/967: mknod d2/d19/d1c/d1f/c138 0 2024-09-19T09:02:48.021 INFO:tasks.workunit.client.1.smithi102.stdout:3/968: readlink d2/d19/d1c/d2f/d5a/d84/d53/ded/l128 0 2024-09-19T09:02:48.023 INFO:tasks.workunit.client.1.smithi102.stdout:9/876: rename d1/d2/d3/d6f/d8d/da2/db6/fe0 to d1/d2/d3/d1d/d4f/d6d/d81/dd3/f11e 0 2024-09-19T09:02:48.024 INFO:tasks.workunit.client.0.smithi049.stdout:0/253: unlink d5/f11 0 2024-09-19T09:02:48.025 INFO:tasks.workunit.client.1.smithi102.stdout:1/846: mknod dd/d14/d35/d49/df6/c113 0 2024-09-19T09:02:48.025 INFO:tasks.workunit.client.0.smithi049.stdout:0/254: dread - d5/d10/d13/d30/f31 zero size 2024-09-19T09:02:48.026 INFO:tasks.workunit.client.1.smithi102.stdout:6/789: mkdir d1/d26/d2e/d45/dac/db2/d107 0 2024-09-19T09:02:48.027 INFO:tasks.workunit.client.0.smithi049.stdout:0/255: fsync d5/d10/d13/d15/d29/d3b/f4a 0 2024-09-19T09:02:48.029 INFO:tasks.workunit.client.1.smithi102.stdout:4/978: truncate d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/d2f/f38 2121933 0 2024-09-19T09:02:48.030 INFO:tasks.workunit.client.0.smithi049.stdout:0/256: truncate d5/d10/d13/d30/f31 83899 0 2024-09-19T09:02:48.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/98: dwrite dc/d16/f18 [0,4194304] 0 2024-09-19T09:02:48.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/99: dwrite dc/d16/f18 [0,4194304] 0 2024-09-19T09:02:48.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/185: stat d10/d11/d13/f28 0 2024-09-19T09:02:48.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/139: write d5/d6/f7 [1160092,75358] 0 2024-09-19T09:02:48.050 INFO:tasks.workunit.client.0.smithi049.stdout:6/100: read dc/fd [688426,116663] 0 2024-09-19T09:02:48.050 INFO:tasks.workunit.client.0.smithi049.stdout:3/186: dwrite fc [4194304,4194304] 0 2024-09-19T09:02:48.052 INFO:tasks.workunit.client.0.smithi049.stdout:9/167: link d3/l9 d3/l3b 0 2024-09-19T09:02:48.056 INFO:tasks.workunit.client.0.smithi049.stdout:3/187: dread d10/d11/f1a [0,4194304] 0 2024-09-19T09:02:48.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/111: truncate d3/f10 396890 0 2024-09-19T09:02:48.063 INFO:tasks.workunit.client.0.smithi049.stdout:0/257: creat d5/d10/d13/d15/f53 x:0 0 0 2024-09-19T09:02:48.065 INFO:tasks.workunit.client.0.smithi049.stdout:5/112: creat d3/d5/de/f25 x:0 0 0 2024-09-19T09:02:48.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/188: dwrite d10/f15 [0,4194304] 0 2024-09-19T09:02:48.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/168: symlink d3/d14/l3c 0 2024-09-19T09:02:48.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/113: dread d3/d5/f1b [0,4194304] 0 2024-09-19T09:02:48.073 INFO:tasks.workunit.client.0.smithi049.stdout:0/258: unlink d5/d10/d13/d15/d36/d3d/c23 0 2024-09-19T09:02:48.075 INFO:tasks.workunit.client.1.smithi102.stdout:2/792: truncate d7/d50/d64/da1/d115/f5d 3904290 0 2024-09-19T09:02:48.075 INFO:tasks.workunit.client.1.smithi102.stdout:8/800: rename d0/d10/d21/d39/d50/da2/fa7 to d0/db/d1d/f107 0 2024-09-19T09:02:48.076 INFO:tasks.workunit.client.0.smithi049.stdout:2/126: dwrite f0 [0,4194304] 0 2024-09-19T09:02:48.079 INFO:tasks.workunit.client.0.smithi049.stdout:6/101: dread f3 [0,4194304] 0 2024-09-19T09:02:48.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/259: write d5/d10/d13/d15/f18 [4549674,81552] 0 2024-09-19T09:02:48.082 INFO:tasks.workunit.client.0.smithi049.stdout:5/114: stat d3/d5/l19 0 2024-09-19T09:02:48.083 INFO:tasks.workunit.client.0.smithi049.stdout:5/115: write d3/f6 [2190594,96852] 0 2024-09-19T09:02:48.087 INFO:tasks.workunit.client.0.smithi049.stdout:1/140: dread d5/d6/d8/d13/f22 [0,4194304] 0 2024-09-19T09:02:48.087 INFO:tasks.workunit.client.0.smithi049.stdout:1/141: chown d5/d6 253 1 2024-09-19T09:02:48.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/116: chown d3/d5/de/f1e 4448 1 2024-09-19T09:02:48.091 INFO:tasks.workunit.client.1.smithi102.stdout:3/969: dread d2/d1e/d54/fb9 [0,4194304] 0 2024-09-19T09:02:48.092 INFO:tasks.workunit.client.1.smithi102.stdout:1/847: truncate dd/f16 1362985 0 2024-09-19T09:02:48.096 INFO:tasks.workunit.client.1.smithi102.stdout:8/801: truncate d0/d10/d21/d39/d50/d63/d83/f8a 1438041 0 2024-09-19T09:02:48.098 INFO:tasks.workunit.client.1.smithi102.stdout:9/877: link d1/d8/d98/df0/c10d d1/d2/d3/dd0/c11f 0 2024-09-19T09:02:48.100 INFO:tasks.workunit.client.0.smithi049.stdout:5/117: dwrite d3/d5/d1c/f22 [0,4194304] 0 2024-09-19T09:02:48.102 INFO:tasks.workunit.client.0.smithi049.stdout:5/118: write d3/d5/f1f [559727,68678] 0 2024-09-19T09:02:48.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/102: dread dc/d12/f15 [4194304,4194304] 0 2024-09-19T09:02:48.107 INFO:tasks.workunit.client.0.smithi049.stdout:2/127: mknod d1/d2d/c2e 0 2024-09-19T09:02:48.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/189: dread fd [0,4194304] 0 2024-09-19T09:02:48.110 INFO:tasks.workunit.client.1.smithi102.stdout:2/793: write d7/d11/f8e [4236303,96121] 0 2024-09-19T09:02:48.111 INFO:tasks.workunit.client.0.smithi049.stdout:3/190: chown d10/c19 49 1 2024-09-19T09:02:48.111 INFO:tasks.workunit.client.1.smithi102.stdout:4/979: dread d14/d16/d17/de3/dbd/df3/d37/d58/d89/f63 [0,4194304] 0 2024-09-19T09:02:48.111 INFO:tasks.workunit.client.0.smithi049.stdout:9/169: dread f1 [8388608,4194304] 0 2024-09-19T09:02:48.117 INFO:tasks.workunit.client.1.smithi102.stdout:6/790: getdents d1/d26/d2e/d45/d47/d4d 0 2024-09-19T09:02:48.117 INFO:tasks.workunit.client.1.smithi102.stdout:6/791: dread - d1/d26/d2e/d45/d47/d4d/d35/d79/fc1 zero size 2024-09-19T09:02:48.117 INFO:tasks.workunit.client.0.smithi049.stdout:1/142: mkdir d5/d6/d8/d13/d24/d2b 0 2024-09-19T09:02:48.119 INFO:tasks.workunit.client.1.smithi102.stdout:5/871: sync 2024-09-19T09:02:48.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/128: creat d1/d4/d1e/f2f x:0 0 0 2024-09-19T09:02:48.121 INFO:tasks.workunit.client.0.smithi049.stdout:2/129: chown d1/d4/d20 3176 1 2024-09-19T09:02:48.126 INFO:tasks.workunit.client.1.smithi102.stdout:4/980: fdatasync d14/d16/d17/de3/dbd/df3/d37/f4a 0 2024-09-19T09:02:48.126 INFO:tasks.workunit.client.1.smithi102.stdout:8/802: symlink d0/db/d104/d106/l108 0 2024-09-19T09:02:48.126 INFO:tasks.workunit.client.0.smithi049.stdout:8/250: sync 2024-09-19T09:02:48.126 INFO:tasks.workunit.client.0.smithi049.stdout:4/151: sync 2024-09-19T09:02:48.126 INFO:tasks.workunit.client.0.smithi049.stdout:8/251: write d1/d1a/f3b [3940530,128843] 0 2024-09-19T09:02:48.126 INFO:tasks.workunit.client.0.smithi049.stdout:0/260: rename d5/lb to d5/d10/d13/d15/l54 0 2024-09-19T09:02:48.127 INFO:tasks.workunit.client.1.smithi102.stdout:8/803: readlink d0/d5a/ldd 0 2024-09-19T09:02:48.127 INFO:tasks.workunit.client.1.smithi102.stdout:3/970: dwrite d2/d1e/f8c [0,4194304] 0 2024-09-19T09:02:48.127 INFO:tasks.workunit.client.0.smithi049.stdout:8/252: write d1/d11/f1b [6667931,85224] 0 2024-09-19T09:02:48.127 INFO:tasks.workunit.client.0.smithi049.stdout:5/119: rename d3 to d3/d5/de/d12/d26 22 2024-09-19T09:02:48.129 INFO:tasks.workunit.client.1.smithi102.stdout:8/804: read - d0/d10/d9b/fc4 zero size 2024-09-19T09:02:48.129 INFO:tasks.workunit.client.0.smithi049.stdout:6/103: dread f0 [0,4194304] 0 2024-09-19T09:02:48.129 INFO:tasks.workunit.client.0.smithi049.stdout:1/143: unlink d5/d6/d8/ce 0 2024-09-19T09:02:48.130 INFO:tasks.workunit.client.0.smithi049.stdout:8/253: write d1/d1a/f3b [2235892,20540] 0 2024-09-19T09:02:48.130 INFO:tasks.workunit.client.1.smithi102.stdout:5/872: dwrite d5/d7/d1a/d37/d39/d81/fbb [0,4194304] 0 2024-09-19T09:02:48.131 INFO:tasks.workunit.client.0.smithi049.stdout:3/191: write d10/d11/d27/f2c [762490,107149] 0 2024-09-19T09:02:48.133 INFO:tasks.workunit.client.1.smithi102.stdout:6/792: creat d1/d26/d4b/f108 x:0 0 0 2024-09-19T09:02:48.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/130: chown d1/d4/fb 3873 1 2024-09-19T09:02:48.133 INFO:tasks.workunit.client.0.smithi049.stdout:8/254: chown d1/d27/c37 115704 1 2024-09-19T09:02:48.134 INFO:tasks.workunit.client.1.smithi102.stdout:6/793: chown d1/d26/d2e/d45/d47/d4d/c4a 12737634 1 2024-09-19T09:02:48.141 INFO:tasks.workunit.client.0.smithi049.stdout:0/261: unlink d5/d10/f44 0 2024-09-19T09:02:48.143 INFO:tasks.workunit.client.0.smithi049.stdout:5/120: symlink d3/d5/l27 0 2024-09-19T09:02:48.145 INFO:tasks.workunit.client.1.smithi102.stdout:9/878: rename d1/d2/d3/d1d/d4f/l75 to d1/d8/d1c/l120 0 2024-09-19T09:02:48.145 INFO:tasks.workunit.client.0.smithi049.stdout:7/239: sync 2024-09-19T09:02:48.149 INFO:tasks.workunit.client.0.smithi049.stdout:7/240: dread d1/d53/d18/f3b [0,4194304] 0 2024-09-19T09:02:48.151 INFO:tasks.workunit.client.1.smithi102.stdout:6/794: chown d1/d26/d4b/c103 255 1 2024-09-19T09:02:48.151 INFO:tasks.workunit.client.1.smithi102.stdout:6/795: read - d1/d26/d4b/d94/da2/fef zero size 2024-09-19T09:02:48.152 INFO:tasks.workunit.client.0.smithi049.stdout:0/262: dwrite d5/d10/d13/d15/d36/d3d/f33 [0,4194304] 0 2024-09-19T09:02:48.154 INFO:tasks.workunit.client.0.smithi049.stdout:9/170: truncate d3/f28 144070 0 2024-09-19T09:02:48.155 INFO:tasks.workunit.client.0.smithi049.stdout:4/152: dread d4/fc [0,4194304] 0 2024-09-19T09:02:48.157 INFO:tasks.workunit.client.0.smithi049.stdout:2/131: unlink d1/fd 0 2024-09-19T09:02:48.158 INFO:tasks.workunit.client.1.smithi102.stdout:4/981: mknod d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/c142 0 2024-09-19T09:02:48.159 INFO:tasks.workunit.client.0.smithi049.stdout:5/121: dwrite d3/d5/de/f15 [4194304,4194304] 0 2024-09-19T09:02:48.160 INFO:tasks.workunit.client.1.smithi102.stdout:2/794: dwrite d7/d1a/f71 [0,4194304] 0 2024-09-19T09:02:48.161 INFO:tasks.workunit.client.0.smithi049.stdout:5/122: fsync d3/d5/de/f23 0 2024-09-19T09:02:48.163 INFO:tasks.workunit.client.1.smithi102.stdout:8/805: rename d0/d10/d3a to d0/d10/d21/d39/db8/d109 0 2024-09-19T09:02:48.164 INFO:tasks.workunit.client.0.smithi049.stdout:2/132: dread d1/f7 [0,4194304] 0 2024-09-19T09:02:48.166 INFO:tasks.workunit.client.0.smithi049.stdout:6/104: mkdir dc/d1b/d20 0 2024-09-19T09:02:48.166 INFO:tasks.workunit.client.1.smithi102.stdout:3/971: dread d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f9d [0,4194304] 0 2024-09-19T09:02:48.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/133: dread - d1/d2/d23/f2c zero size 2024-09-19T09:02:48.167 INFO:tasks.workunit.client.1.smithi102.stdout:9/879: creat d1/d2/d3/d6f/f121 x:0 0 0 2024-09-19T09:02:48.168 INFO:tasks.workunit.client.0.smithi049.stdout:8/255: dread d1/f2d [0,4194304] 0 2024-09-19T09:02:48.169 INFO:tasks.workunit.client.0.smithi049.stdout:8/256: truncate d1/d1a/f2b 60846 0 2024-09-19T09:02:48.170 INFO:tasks.workunit.client.0.smithi049.stdout:8/257: write d1/f14 [2311349,40879] 0 2024-09-19T09:02:48.171 INFO:tasks.workunit.client.0.smithi049.stdout:8/258: readlink d1/l2a 0 2024-09-19T09:02:48.174 INFO:tasks.workunit.client.1.smithi102.stdout:5/873: dwrite d5/d7/d1b/f51 [0,4194304] 0 2024-09-19T09:02:48.175 INFO:tasks.workunit.client.1.smithi102.stdout:2/795: unlink d7/d1a/d2b/ffd 0 2024-09-19T09:02:48.181 INFO:tasks.workunit.client.1.smithi102.stdout:4/982: rename d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded/f12b to d14/d34/d5a/d5c/d79/f143 0 2024-09-19T09:02:48.183 INFO:tasks.workunit.client.1.smithi102.stdout:5/874: dwrite d5/d60/f99 [0,4194304] 0 2024-09-19T09:02:48.184 INFO:tasks.workunit.client.1.smithi102.stdout:5/875: write d5/d7/d1b/f6f [2334434,95423] 0 2024-09-19T09:02:48.184 INFO:tasks.workunit.client.0.smithi049.stdout:7/241: unlink d1/d8/f2f 0 2024-09-19T09:02:48.185 INFO:tasks.workunit.client.1.smithi102.stdout:8/806: mknod d0/d10/d21/d39/db8/c10a 0 2024-09-19T09:02:48.186 INFO:tasks.workunit.client.0.smithi049.stdout:7/242: dread d1/d53/d18/f3b [0,4194304] 0 2024-09-19T09:02:48.188 INFO:tasks.workunit.client.1.smithi102.stdout:6/796: fdatasync d1/d18/db/f90 0 2024-09-19T09:02:48.195 INFO:tasks.workunit.client.0.smithi049.stdout:6/105: truncate dc/fd 2005052 0 2024-09-19T09:02:48.197 INFO:tasks.workunit.client.0.smithi049.stdout:2/134: mknod d1/d2d/c30 0 2024-09-19T09:02:48.198 INFO:tasks.workunit.client.1.smithi102.stdout:7/918: sync 2024-09-19T09:02:48.198 INFO:tasks.workunit.client.1.smithi102.stdout:3/972: rename d2/d19/d1c/d2f/d5a/ff8 to d2/d19/d1c/d2f/d5a/d84/d53/ded/f139 0 2024-09-19T09:02:48.199 INFO:tasks.workunit.client.0.smithi049.stdout:1/144: truncate d5/f23 3654602 0 2024-09-19T09:02:48.203 INFO:tasks.workunit.client.0.smithi049.stdout:3/192: rmdir d10/d3e 0 2024-09-19T09:02:48.205 INFO:tasks.workunit.client.0.smithi049.stdout:3/193: write d10/d11/f39 [2404630,13378] 0 2024-09-19T09:02:48.210 INFO:tasks.workunit.client.0.smithi049.stdout:4/153: write d4/f16 [283549,98398] 0 2024-09-19T09:02:48.211 INFO:tasks.workunit.client.1.smithi102.stdout:4/983: dread d14/d16/d1d/f53 [0,4194304] 0 2024-09-19T09:02:48.213 INFO:tasks.workunit.client.1.smithi102.stdout:4/984: write d14/d16/d17/de3/dbd/df3/d37/d58/fbb [1917577,23212] 0 2024-09-19T09:02:48.213 INFO:tasks.workunit.client.1.smithi102.stdout:6/797: rename d1/d18/db/d65/d8e to d1/d26/d4b/d94/d8a/d109 0 2024-09-19T09:02:48.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/123: mknod d3/c28 0 2024-09-19T09:02:48.214 INFO:tasks.workunit.client.0.smithi049.stdout:9/171: dwrite d3/f17 [4194304,4194304] 0 2024-09-19T09:02:48.215 INFO:tasks.workunit.client.1.smithi102.stdout:7/919: rmdir d1/d4/dca/d52 39 2024-09-19T09:02:48.216 INFO:tasks.workunit.client.0.smithi049.stdout:6/106: mknod dc/d16/c21 0 2024-09-19T09:02:48.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/107: write dc/d12/f13 [2246406,79013] 0 2024-09-19T09:02:48.219 INFO:tasks.workunit.client.0.smithi049.stdout:2/135: symlink d1/d4/d20/l31 0 2024-09-19T09:02:48.219 INFO:tasks.workunit.client.1.smithi102.stdout:2/796: dwrite d7/d11/f1c [0,4194304] 0 2024-09-19T09:02:48.224 INFO:tasks.workunit.client.0.smithi049.stdout:6/108: read fa [3278311,68701] 0 2024-09-19T09:02:48.225 INFO:tasks.workunit.client.1.smithi102.stdout:5/876: write d5/d7/d1a/d37/d39/f40 [1267398,122841] 0 2024-09-19T09:02:48.225 INFO:tasks.workunit.client.1.smithi102.stdout:6/798: dwrite d1/d26/d2e/d45/d47/d4d/f72 [4194304,4194304] 0 2024-09-19T09:02:48.230 INFO:tasks.workunit.client.1.smithi102.stdout:5/877: read d5/d7/d1a/d37/d39/d81/fbb [1787964,51156] 0 2024-09-19T09:02:48.232 INFO:tasks.workunit.client.1.smithi102.stdout:1/848: sync 2024-09-19T09:02:48.232 INFO:tasks.workunit.client.1.smithi102.stdout:9/880: dwrite d1/d2/d78/df7/dfe/f10f [0,4194304] 0 2024-09-19T09:02:48.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/243: dwrite d1/d53/f3e [0,4194304] 0 2024-09-19T09:02:48.238 INFO:tasks.workunit.client.0.smithi049.stdout:3/194: unlink d10/d11/f41 0 2024-09-19T09:02:48.240 INFO:tasks.workunit.client.1.smithi102.stdout:4/985: creat d14/d16/d1d/d48/f144 x:0 0 0 2024-09-19T09:02:48.246 INFO:tasks.workunit.client.0.smithi049.stdout:8/259: truncate d1/ff 4794638 0 2024-09-19T09:02:48.246 INFO:tasks.workunit.client.1.smithi102.stdout:1/849: dread dd/d7a/d8c/d8e/d103/f39 [0,4194304] 0 2024-09-19T09:02:48.247 INFO:tasks.workunit.client.1.smithi102.stdout:1/850: read dd/d14/d18/f40 [2795076,7636] 0 2024-09-19T09:02:48.248 INFO:tasks.workunit.client.1.smithi102.stdout:3/973: dread d2/d19/d47/db/d26/d63/d6f/f8e [0,4194304] 0 2024-09-19T09:02:48.248 INFO:tasks.workunit.client.0.smithi049.stdout:3/195: dwrite d10/f38 [0,4194304] 0 2024-09-19T09:02:48.249 INFO:tasks.workunit.client.1.smithi102.stdout:1/851: dread - dd/d5f/f63 zero size 2024-09-19T09:02:48.249 INFO:tasks.workunit.client.1.smithi102.stdout:1/852: chown dd/d66 169596196 1 2024-09-19T09:02:48.250 INFO:tasks.workunit.client.0.smithi049.stdout:3/196: write d10/d11/d13/f32 [74428,63566] 0 2024-09-19T09:02:48.251 INFO:tasks.workunit.client.1.smithi102.stdout:2/797: rmdir d7/d1a/d2b/dae/db4 39 2024-09-19T09:02:48.252 INFO:tasks.workunit.client.1.smithi102.stdout:8/807: link d0/d4f/f74 d0/db/d1d/f10b 0 2024-09-19T09:02:48.255 INFO:tasks.workunit.client.0.smithi049.stdout:9/172: creat d3/d14/d34/f3d x:0 0 0 2024-09-19T09:02:48.256 INFO:tasks.workunit.client.1.smithi102.stdout:6/799: symlink d1/d26/d4b/d94/d8a/d109/l10a 0 2024-09-19T09:02:48.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/173: write d3/d14/f2d [2189866,126804] 0 2024-09-19T09:02:48.258 INFO:tasks.workunit.client.0.smithi049.stdout:9/174: truncate d3/d14/f1e 5142389 0 2024-09-19T09:02:48.258 INFO:tasks.workunit.client.1.smithi102.stdout:8/808: dwrite d0/d10/d21/db3/fdc [0,4194304] 0 2024-09-19T09:02:48.259 INFO:tasks.workunit.client.1.smithi102.stdout:6/800: chown d1/d26/d2e/d70 109264001 1 2024-09-19T09:02:48.260 INFO:tasks.workunit.client.1.smithi102.stdout:8/809: dread - d0/d10/d21/d39/d50/d63/d83/fd0 zero size 2024-09-19T09:02:48.261 INFO:tasks.workunit.client.0.smithi049.stdout:6/109: unlink fa 0 2024-09-19T09:02:48.264 INFO:tasks.workunit.client.1.smithi102.stdout:4/986: unlink d14/d34/d5a/d5c/fd4 0 2024-09-19T09:02:48.267 INFO:tasks.workunit.client.0.smithi049.stdout:9/175: dread d3/d14/d1a/f35 [0,4194304] 0 2024-09-19T09:02:48.273 INFO:tasks.workunit.client.1.smithi102.stdout:1/853: creat dd/d7a/d8c/da6/f114 x:0 0 0 2024-09-19T09:02:48.275 INFO:tasks.workunit.client.0.smithi049.stdout:7/244: dread d1/d8/d19/f46 [0,4194304] 0 2024-09-19T09:02:48.280 INFO:tasks.workunit.client.0.smithi049.stdout:5/124: symlink d3/d5/d20/l29 0 2024-09-19T09:02:48.281 INFO:tasks.workunit.client.0.smithi049.stdout:5/125: chown d3/d5/d20/l29 233152 1 2024-09-19T09:02:48.281 INFO:tasks.workunit.client.0.smithi049.stdout:5/126: stat d3/d5/l7 0 2024-09-19T09:02:48.281 INFO:tasks.workunit.client.1.smithi102.stdout:6/801: mknod d1/d18/c10b 0 2024-09-19T09:02:48.282 INFO:tasks.workunit.client.1.smithi102.stdout:6/802: readlink d1/d26/d2e/d45/d47/d4d/d35/l6e 0 2024-09-19T09:02:48.283 INFO:tasks.workunit.client.1.smithi102.stdout:5/878: symlink d5/d7/d1a/d8f/dc0/l10f 0 2024-09-19T09:02:48.286 INFO:tasks.workunit.client.0.smithi049.stdout:4/154: write f2 [2656034,4295] 0 2024-09-19T09:02:48.287 INFO:tasks.workunit.client.0.smithi049.stdout:4/155: truncate d4/f17 4812482 0 2024-09-19T09:02:48.287 INFO:tasks.workunit.client.1.smithi102.stdout:6/803: dwrite d1/fc [0,4194304] 0 2024-09-19T09:02:48.288 INFO:tasks.workunit.client.0.smithi049.stdout:4/156: write d4/f5 [3170167,32555] 0 2024-09-19T09:02:48.291 INFO:tasks.workunit.client.0.smithi049.stdout:9/176: creat d3/d22/f3e x:0 0 0 2024-09-19T09:02:48.293 INFO:tasks.workunit.client.0.smithi049.stdout:7/245: creat d1/d8/f54 x:0 0 0 2024-09-19T09:02:48.295 INFO:tasks.workunit.client.0.smithi049.stdout:1/145: write d5/f23 [1244700,115516] 0 2024-09-19T09:02:48.301 INFO:tasks.workunit.client.0.smithi049.stdout:4/157: creat d4/d15/d19/d1f/f2e x:0 0 0 2024-09-19T09:02:48.307 INFO:tasks.workunit.client.0.smithi049.stdout:1/146: chown d5/d6/f1b 10971 1 2024-09-19T09:02:48.310 INFO:tasks.workunit.client.0.smithi049.stdout:4/158: dwrite d4/d15/d19/d1f/f26 [0,4194304] 0 2024-09-19T09:02:48.311 INFO:tasks.workunit.client.0.smithi049.stdout:4/159: write d4/fe [3074984,108995] 0 2024-09-19T09:02:48.312 INFO:tasks.workunit.client.0.smithi049.stdout:1/147: dread - d5/d6/d8/f2a zero size 2024-09-19T09:02:48.317 INFO:tasks.workunit.client.0.smithi049.stdout:3/197: getdents d10/d11/d13/d30 0 2024-09-19T09:02:48.321 INFO:tasks.workunit.client.0.smithi049.stdout:4/160: dwrite d4/f12 [0,4194304] 0 2024-09-19T09:02:48.321 INFO:tasks.workunit.client.0.smithi049.stdout:7/246: dread d1/d8/fb [0,4194304] 0 2024-09-19T09:02:48.323 INFO:tasks.workunit.client.0.smithi049.stdout:7/247: stat d1/d8/d2d/d31 0 2024-09-19T09:02:48.326 INFO:tasks.workunit.client.0.smithi049.stdout:6/110: link dc/ce dc/c22 0 2024-09-19T09:02:48.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/248: write d1/d8/d19/f34 [4271839,731] 0 2024-09-19T09:02:48.329 INFO:tasks.workunit.client.0.smithi049.stdout:9/177: creat d3/d14/f3f x:0 0 0 2024-09-19T09:02:48.331 INFO:tasks.workunit.client.0.smithi049.stdout:9/178: dread - d3/d22/f3e zero size 2024-09-19T09:02:48.334 INFO:tasks.workunit.client.0.smithi049.stdout:4/161: dwrite d4/f1e [0,4194304] 0 2024-09-19T09:02:48.342 INFO:tasks.workunit.client.0.smithi049.stdout:6/111: creat dc/d1b/f23 x:0 0 0 2024-09-19T09:02:48.342 INFO:tasks.workunit.client.0.smithi049.stdout:9/179: fsync f1 0 2024-09-19T09:02:48.353 INFO:tasks.workunit.client.0.smithi049.stdout:3/198: dwrite d10/d11/f1a [0,4194304] 0 2024-09-19T09:02:48.354 INFO:tasks.workunit.client.0.smithi049.stdout:9/180: mknod d3/d14/d34/c40 0 2024-09-19T09:02:48.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/162: dread d4/f17 [0,4194304] 0 2024-09-19T09:02:48.355 INFO:tasks.workunit.client.0.smithi049.stdout:1/148: truncate d5/d6/f10 3496026 0 2024-09-19T09:02:48.358 INFO:tasks.workunit.client.0.smithi049.stdout:7/249: link d1/d8/d2d/d31/f47 d1/d8/d19/f55 0 2024-09-19T09:02:48.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/112: mknod dc/c24 0 2024-09-19T09:02:48.362 INFO:tasks.workunit.client.0.smithi049.stdout:3/199: dwrite d10/d11/d13/f16 [0,4194304] 0 2024-09-19T09:02:48.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/181: chown d3/l23 77 1 2024-09-19T09:02:48.364 INFO:tasks.workunit.client.0.smithi049.stdout:4/163: rename d4/f12 to d4/d15/d19/f2f 0 2024-09-19T09:02:48.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/182: write d3/d14/d1a/d21/f26 [3277192,18246] 0 2024-09-19T09:02:48.368 INFO:tasks.workunit.client.0.smithi049.stdout:9/183: dread - d3/d22/f38 zero size 2024-09-19T09:02:48.368 INFO:tasks.workunit.client.0.smithi049.stdout:7/250: mknod d1/d8/c56 0 2024-09-19T09:02:48.374 INFO:tasks.workunit.client.0.smithi049.stdout:6/113: dwrite dc/d16/f18 [0,4194304] 0 2024-09-19T09:02:48.376 INFO:tasks.workunit.client.0.smithi049.stdout:1/149: creat d5/d6/d8/d13/d24/d2b/f2c x:0 0 0 2024-09-19T09:02:48.378 INFO:tasks.workunit.client.0.smithi049.stdout:4/164: dwrite d4/d15/d19/f2c [0,4194304] 0 2024-09-19T09:02:48.378 INFO:tasks.workunit.client.0.smithi049.stdout:9/184: rename d3/f15 to d3/d14/d1a/d21/f41 0 2024-09-19T09:02:48.390 INFO:tasks.workunit.client.0.smithi049.stdout:1/150: dwrite d5/d6/d8/f2a [0,4194304] 0 2024-09-19T09:02:48.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/114: write dc/d12/f15 [5334535,114899] 0 2024-09-19T09:02:48.394 INFO:tasks.workunit.client.0.smithi049.stdout:9/185: dwrite d3/d14/f3f [0,4194304] 0 2024-09-19T09:02:48.396 INFO:tasks.workunit.client.0.smithi049.stdout:4/165: creat d4/f30 x:0 0 0 2024-09-19T09:02:48.409 INFO:tasks.workunit.client.1.smithi102.stdout:3/974: symlink d2/d19/d35/dce/ddc/df1/d134/l13a 0 2024-09-19T09:02:48.412 INFO:tasks.workunit.client.1.smithi102.stdout:1/854: mkdir dd/d7a/d8c/d8e/d103/d78/d115 0 2024-09-19T09:02:48.415 INFO:tasks.workunit.client.0.smithi049.stdout:6/115: rename dc/d16/c21 to dc/d16/c25 0 2024-09-19T09:02:48.415 INFO:tasks.workunit.client.1.smithi102.stdout:2/798: creat d7/d1a/d2b/dae/de5/f118 x:0 0 0 2024-09-19T09:02:48.416 INFO:tasks.workunit.client.0.smithi049.stdout:6/116: write dc/d12/f13 [1901921,28644] 0 2024-09-19T09:02:48.416 INFO:tasks.workunit.client.1.smithi102.stdout:2/799: read - d7/d50/d64/da1/d115/de1/f117 zero size 2024-09-19T09:02:48.417 INFO:tasks.workunit.client.0.smithi049.stdout:6/117: truncate dc/d12/f14 5162898 0 2024-09-19T09:02:48.418 INFO:tasks.workunit.client.0.smithi049.stdout:6/118: stat dc/l10 0 2024-09-19T09:02:48.421 INFO:tasks.workunit.client.1.smithi102.stdout:9/881: rename d1/d2/d3/d1d/d4f/ded to d1/d2/d3/d122 0 2024-09-19T09:02:48.424 INFO:tasks.workunit.client.0.smithi049.stdout:9/186: dread d3/d14/d1a/d21/f41 [0,4194304] 0 2024-09-19T09:02:48.426 INFO:tasks.workunit.client.0.smithi049.stdout:7/251: write d1/d1f/f29 [183910,106342] 0 2024-09-19T09:02:48.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/200: write fe [4066772,23847] 0 2024-09-19T09:02:48.429 INFO:tasks.workunit.client.1.smithi102.stdout:3/975: dread d2/d19/d47/db/d26/d63/fa0 [0,4194304] 0 2024-09-19T09:02:48.430 INFO:tasks.workunit.client.1.smithi102.stdout:1/855: mknod dd/d14/d35/d49/d7d/c116 0 2024-09-19T09:02:48.430 INFO:tasks.workunit.client.1.smithi102.stdout:1/856: stat dd/d66/c89 0 2024-09-19T09:02:48.432 INFO:tasks.workunit.client.0.smithi049.stdout:9/187: dwrite d3/d14/f1e [4194304,4194304] 0 2024-09-19T09:02:48.434 INFO:tasks.workunit.client.0.smithi049.stdout:6/119: fsync dc/fd 0 2024-09-19T09:02:48.435 INFO:tasks.workunit.client.0.smithi049.stdout:9/188: chown d3/d14/d1a/d21/f2f 0 1 2024-09-19T09:02:48.437 INFO:tasks.workunit.client.0.smithi049.stdout:7/252: dread d1/d8/f30 [0,4194304] 0 2024-09-19T09:02:48.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/201: rmdir d10 39 2024-09-19T09:02:48.440 INFO:tasks.workunit.client.0.smithi049.stdout:4/166: getdents d4/d15/d19 0 2024-09-19T09:02:48.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/253: dread d1/d8/d19/f34 [0,4194304] 0 2024-09-19T09:02:48.442 INFO:tasks.workunit.client.1.smithi102.stdout:9/882: rmdir d1/d2/d3/d1d/d4f/d6d/db4 39 2024-09-19T09:02:48.442 INFO:tasks.workunit.client.1.smithi102.stdout:9/883: stat d1/d2/d3/f2c 0 2024-09-19T09:02:48.444 INFO:tasks.workunit.client.1.smithi102.stdout:6/804: read - d1/d18/db/ff3 zero size 2024-09-19T09:02:48.446 INFO:tasks.workunit.client.1.smithi102.stdout:1/857: symlink dd/d14/d35/d49/d7d/l117 0 2024-09-19T09:02:48.448 INFO:tasks.workunit.client.1.smithi102.stdout:4/987: link d14/d34/d5a/d5c/d81/d75/caf d14/d16/d17/de3/dbd/df3/d37/d58/d89/da0/d13f/c145 0 2024-09-19T09:02:48.448 INFO:tasks.workunit.client.1.smithi102.stdout:7/920: write d1/d3/d20/f5a [142347,101038] 0 2024-09-19T09:02:48.449 INFO:tasks.workunit.client.1.smithi102.stdout:4/988: dread - d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/d80/d9d/f136 zero size 2024-09-19T09:02:48.451 INFO:tasks.workunit.client.1.smithi102.stdout:8/810: getdents d0/db 0 2024-09-19T09:02:48.451 INFO:tasks.workunit.client.0.smithi049.stdout:6/120: symlink dc/l26 0 2024-09-19T09:02:48.452 INFO:tasks.workunit.client.0.smithi049.stdout:6/121: chown dc/l1c 509 1 2024-09-19T09:02:48.453 INFO:tasks.workunit.client.1.smithi102.stdout:5/879: write d5/d60/f85 [3937092,104832] 0 2024-09-19T09:02:48.454 INFO:tasks.workunit.client.1.smithi102.stdout:6/805: mkdir d1/d26/d2e/d45/d47/d4d/d35/d41/da4/d10c 0 2024-09-19T09:02:48.456 INFO:tasks.workunit.client.1.smithi102.stdout:4/989: dwrite d14/d16/d1d/d48/f144 [0,4194304] 0 2024-09-19T09:02:48.456 INFO:tasks.workunit.client.1.smithi102.stdout:6/806: write d1/d26/d4b/d94/f8b [2664883,107837] 0 2024-09-19T09:02:48.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/151: dwrite d5/f26 [0,4194304] 0 2024-09-19T09:02:48.460 INFO:tasks.workunit.client.0.smithi049.stdout:1/152: write d5/d6/d8/d13/f12 [158163,130525] 0 2024-09-19T09:02:48.461 INFO:tasks.workunit.client.1.smithi102.stdout:7/921: write d1/d3/d72/f8b [4031842,512] 0 2024-09-19T09:02:48.466 INFO:tasks.workunit.client.1.smithi102.stdout:8/811: mkdir d0/d64/d10c 0 2024-09-19T09:02:48.467 INFO:tasks.workunit.client.0.smithi049.stdout:6/122: creat dc/d12/f27 x:0 0 0 2024-09-19T09:02:48.469 INFO:tasks.workunit.client.1.smithi102.stdout:3/976: write d2/d19/d1c/d2f/d5a/d84/d4f/f85 [4871625,38370] 0 2024-09-19T09:02:48.470 INFO:tasks.workunit.client.0.smithi049.stdout:9/189: creat d3/d14/f42 x:0 0 0 2024-09-19T09:02:48.472 INFO:tasks.workunit.client.1.smithi102.stdout:2/800: dwrite d7/d50/d64/da1/d115/f6a [0,4194304] 0 2024-09-19T09:02:48.472 INFO:tasks.workunit.client.0.smithi049.stdout:3/202: symlink d10/l42 0 2024-09-19T09:02:48.473 INFO:tasks.workunit.client.0.smithi049.stdout:4/167: truncate d4/f5 2021039 0 2024-09-19T09:02:48.474 INFO:tasks.workunit.client.1.smithi102.stdout:1/858: write dd/f1d [2819665,56613] 0 2024-09-19T09:02:48.475 INFO:tasks.workunit.client.0.smithi049.stdout:7/254: rmdir d1/d4d 0 2024-09-19T09:02:48.476 INFO:tasks.workunit.client.1.smithi102.stdout:6/807: creat d1/d26/d2e/d45/daf/f10d x:0 0 0 2024-09-19T09:02:48.476 INFO:tasks.workunit.client.1.smithi102.stdout:8/812: dwrite d0/db/d29/db5/fd1 [0,4194304] 0 2024-09-19T09:02:48.477 INFO:tasks.workunit.client.0.smithi049.stdout:6/123: mknod dc/d16/c28 0 2024-09-19T09:02:48.477 INFO:tasks.workunit.client.1.smithi102.stdout:4/990: write d14/d16/d17/de3/dbd/df3/d37/d58/d89/d106/f10f [2349710,123421] 0 2024-09-19T09:02:48.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/124: write dc/d12/f27 [147620,80622] 0 2024-09-19T09:02:48.479 INFO:tasks.workunit.client.1.smithi102.stdout:8/813: readlink d0/d10/d21/d39/d87/lbe 0 2024-09-19T09:02:48.479 INFO:tasks.workunit.client.0.smithi049.stdout:3/203: creat d10/d11/d27/f43 x:0 0 0 2024-09-19T09:02:48.481 INFO:tasks.workunit.client.0.smithi049.stdout:3/204: write fe [3486358,122183] 0 2024-09-19T09:02:48.481 INFO:tasks.workunit.client.1.smithi102.stdout:4/991: fsync d14/d16/d17/de3/dbd/df3/d37/d58/d89/da6/f94 0 2024-09-19T09:02:48.481 INFO:tasks.workunit.client.1.smithi102.stdout:8/814: chown d0/d10/d21/d39/d50/fb2 70305973 1 2024-09-19T09:02:48.482 INFO:tasks.workunit.client.1.smithi102.stdout:9/884: creat d1/f123 x:0 0 0 2024-09-19T09:02:48.482 INFO:tasks.workunit.client.1.smithi102.stdout:8/815: stat d0/db/f15 0 2024-09-19T09:02:48.483 INFO:tasks.workunit.client.1.smithi102.stdout:4/992: chown d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded 23470976 1 2024-09-19T09:02:48.484 INFO:tasks.workunit.client.0.smithi049.stdout:4/168: symlink d4/d15/d19/l31 0 2024-09-19T09:02:48.485 INFO:tasks.workunit.client.0.smithi049.stdout:4/169: readlink d4/d15/d19/d1f/l27 0 2024-09-19T09:02:48.488 INFO:tasks.workunit.client.0.smithi049.stdout:7/255: read d1/d7/fa [269612,115715] 0 2024-09-19T09:02:48.490 INFO:tasks.workunit.client.0.smithi049.stdout:6/125: unlink c6 0 2024-09-19T09:02:48.491 INFO:tasks.workunit.client.1.smithi102.stdout:1/859: readlink dd/lf0 0 2024-09-19T09:02:48.491 INFO:tasks.workunit.client.0.smithi049.stdout:6/126: chown dc/f19 891 1 2024-09-19T09:02:48.492 INFO:tasks.workunit.client.0.smithi049.stdout:4/170: dwrite d4/fc [0,4194304] 0 2024-09-19T09:02:48.493 INFO:tasks.workunit.client.1.smithi102.stdout:6/808: creat d1/d26/d2e/d45/d47/d4d/d35/d41/f10e x:0 0 0 2024-09-19T09:02:48.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/205: write fd [5219778,113040] 0 2024-09-19T09:02:48.497 INFO:tasks.workunit.client.1.smithi102.stdout:7/922: creat d1/d4/dca/d52/d7f/da5/de2/df0/f126 x:0 0 0 2024-09-19T09:02:48.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/190: creat d3/f43 x:0 0 0 2024-09-19T09:02:48.501 INFO:tasks.workunit.client.0.smithi049.stdout:7/256: creat d1/d1a/f57 x:0 0 0 2024-09-19T09:02:48.503 INFO:tasks.workunit.client.0.smithi049.stdout:1/153: truncate d5/d6/d8/f2a 2388357 0 2024-09-19T09:02:48.504 INFO:tasks.workunit.client.0.smithi049.stdout:6/127: truncate dc/fd 1833663 0 2024-09-19T09:02:48.504 INFO:tasks.workunit.client.0.smithi049.stdout:6/128: fdatasync f0 0 2024-09-19T09:02:48.506 INFO:tasks.workunit.client.0.smithi049.stdout:4/171: write d4/f14 [2223147,61718] 0 2024-09-19T09:02:48.507 INFO:tasks.workunit.client.1.smithi102.stdout:2/801: dread d7/d1a/d56/f97 [0,4194304] 0 2024-09-19T09:02:48.508 INFO:tasks.workunit.client.1.smithi102.stdout:5/880: creat d5/d7/d1a/d37/d34/d4d/d9c/de9/f110 x:0 0 0 2024-09-19T09:02:48.509 INFO:tasks.workunit.client.1.smithi102.stdout:5/881: chown d5/d7/d1a/de1/fda 951765157 1 2024-09-19T09:02:48.509 INFO:tasks.workunit.client.0.smithi049.stdout:3/206: mknod d10/d11/c44 0 2024-09-19T09:02:48.510 INFO:tasks.workunit.client.1.smithi102.stdout:1/860: mknod dd/d14/d35/d49/d7d/d7f/c118 0 2024-09-19T09:02:48.512 INFO:tasks.workunit.client.0.smithi049.stdout:9/191: mkdir d3/d14/d34/d44 0 2024-09-19T09:02:48.513 INFO:tasks.workunit.client.0.smithi049.stdout:9/192: dread - d3/f43 zero size 2024-09-19T09:02:48.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/172: dwrite d4/f25 [0,4194304] 0 2024-09-19T09:02:48.514 INFO:tasks.workunit.client.0.smithi049.stdout:9/193: fdatasync d3/f17 0 2024-09-19T09:02:48.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/257: chown d1/f2 52341580 1 2024-09-19T09:02:48.517 INFO:tasks.workunit.client.1.smithi102.stdout:9/885: mknod d1/d2/d78/da0/dc0/c124 0 2024-09-19T09:02:48.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/129: unlink dc/d12/f13 0 2024-09-19T09:02:48.522 INFO:tasks.workunit.client.0.smithi049.stdout:3/207: unlink la 0 2024-09-19T09:02:48.522 INFO:tasks.workunit.client.1.smithi102.stdout:2/802: creat d7/d1a/d56/db9/f119 x:0 0 0 2024-09-19T09:02:48.523 INFO:tasks.workunit.client.1.smithi102.stdout:2/803: read d7/d1a/d56/f97 [3238075,21281] 0 2024-09-19T09:02:48.524 INFO:tasks.workunit.client.0.smithi049.stdout:3/208: truncate d10/d11/d13/d30/f3c 645433 0 2024-09-19T09:02:48.524 INFO:tasks.workunit.client.1.smithi102.stdout:2/804: chown d7/d1a/d2b/d31/d106/daf/f9d 3 1 2024-09-19T09:02:48.524 INFO:tasks.workunit.client.1.smithi102.stdout:1/861: creat dd/d14/d35/d49/dcb/f119 x:0 0 0 2024-09-19T09:02:48.525 INFO:tasks.workunit.client.1.smithi102.stdout:2/805: chown d7/d1a/d2b/d31/f48 74116098 1 2024-09-19T09:02:48.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/130: dwrite dc/d12/f14 [0,4194304] 0 2024-09-19T09:02:48.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/173: unlink f0 0 2024-09-19T09:02:48.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/174: fsync d4/f1e 0 2024-09-19T09:02:48.534 INFO:tasks.workunit.client.1.smithi102.stdout:7/923: symlink d1/d3/d72/l127 0 2024-09-19T09:02:48.534 INFO:tasks.workunit.client.1.smithi102.stdout:9/886: symlink d1/d2/d3/d6f/d8d/da2/db6/de3/l125 0 2024-09-19T09:02:48.534 INFO:tasks.workunit.client.1.smithi102.stdout:2/806: dread d7/d1a/d2b/d31/f3e [0,4194304] 0 2024-09-19T09:02:48.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/194: mknod d3/d14/d1a/d21/c45 0 2024-09-19T09:02:48.535 INFO:tasks.workunit.client.0.smithi049.stdout:6/131: dwrite dc/d12/f1e [4194304,4194304] 0 2024-09-19T09:02:48.535 INFO:tasks.workunit.client.0.smithi049.stdout:7/258: mkdir d1/d53/d18/d50/d58 0 2024-09-19T09:02:48.536 INFO:tasks.workunit.client.0.smithi049.stdout:6/132: fdatasync dc/d12/f27 0 2024-09-19T09:02:48.540 INFO:tasks.workunit.client.1.smithi102.stdout:8/816: rmdir d0/d10/d21/db3/df2 0 2024-09-19T09:02:48.543 INFO:tasks.workunit.client.0.smithi049.stdout:7/259: dwrite d1/d1f/f48 [0,4194304] 0 2024-09-19T09:02:48.545 INFO:tasks.workunit.client.1.smithi102.stdout:5/882: creat d5/d7/d1a/d8f/dd1/f111 x:0 0 0 2024-09-19T09:02:48.550 INFO:tasks.workunit.client.1.smithi102.stdout:1/862: creat dd/d7a/d8c/d8e/d103/d78/f11a x:0 0 0 2024-09-19T09:02:48.550 INFO:tasks.workunit.client.0.smithi049.stdout:3/209: creat d10/d11/d27/f45 x:0 0 0 2024-09-19T09:02:48.554 INFO:tasks.workunit.client.1.smithi102.stdout:2/807: mkdir d7/d1a/d56/d11a 0 2024-09-19T09:02:48.555 INFO:tasks.workunit.client.1.smithi102.stdout:2/808: write d7/d11/f1c [4182829,54058] 0 2024-09-19T09:02:48.558 INFO:tasks.workunit.client.1.smithi102.stdout:9/887: rename d1/d2/la5 to d1/d2/d78/da0/dc0/l126 0 2024-09-19T09:02:48.562 INFO:tasks.workunit.client.1.smithi102.stdout:6/809: getdents d1/d26/d2e/d45/daf 0 2024-09-19T09:02:48.563 INFO:tasks.workunit.client.1.smithi102.stdout:6/810: chown d1/d26/d2e/d45/daf/d8d/l101 1709480 1 2024-09-19T09:02:48.563 INFO:tasks.workunit.client.1.smithi102.stdout:6/811: dread - d1/d3a/ff6 zero size 2024-09-19T09:02:48.564 INFO:tasks.workunit.client.0.smithi049.stdout:9/195: write d3/f1f [3708657,119117] 0 2024-09-19T09:02:48.565 INFO:tasks.workunit.client.1.smithi102.stdout:1/863: unlink dd/d14/d35/ddf/ffc 0 2024-09-19T09:02:48.565 INFO:tasks.workunit.client.1.smithi102.stdout:1/864: dread - dd/d7a/d8c/d8e/fc3 zero size 2024-09-19T09:02:48.567 INFO:tasks.workunit.client.1.smithi102.stdout:7/924: creat d1/d3/d20/dad/f128 x:0 0 0 2024-09-19T09:02:48.568 INFO:tasks.workunit.client.1.smithi102.stdout:7/925: chown d1/d4/dca/d52/f65 1713 1 2024-09-19T09:02:48.570 INFO:tasks.workunit.client.0.smithi049.stdout:9/196: dwrite d3/d14/d34/f37 [0,4194304] 0 2024-09-19T09:02:48.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/197: chown d3/l9 61 1 2024-09-19T09:02:48.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/198: stat d3/d14/d34/f3d 0 2024-09-19T09:02:48.572 INFO:tasks.workunit.client.1.smithi102.stdout:2/809: truncate d7/d50/d64/d7f/d83/f76 3935346 0 2024-09-19T09:02:48.578 INFO:tasks.workunit.client.1.smithi102.stdout:6/812: mknod d1/d26/d2e/d45/dac/df1/c10f 0 2024-09-19T09:02:48.578 INFO:tasks.workunit.client.1.smithi102.stdout:6/813: stat d1/d3a/cfc 0 2024-09-19T09:02:48.579 INFO:tasks.workunit.client.0.smithi049.stdout:7/260: dwrite d1/d8/d19/f46 [4194304,4194304] 0 2024-09-19T09:02:48.580 INFO:tasks.workunit.client.1.smithi102.stdout:1/865: mkdir dd/d14/d35/d49/d7d/d7f/d11b 0 2024-09-19T09:02:48.580 INFO:tasks.workunit.client.1.smithi102.stdout:1/866: readlink dd/d14/le0 0 2024-09-19T09:02:48.581 INFO:tasks.workunit.client.1.smithi102.stdout:1/867: readlink dd/d14/l3d 0 2024-09-19T09:02:48.584 INFO:tasks.workunit.client.1.smithi102.stdout:9/888: mknod d1/d2/d3/d1d/d4f/d6d/d81/d90/d115/c127 0 2024-09-19T09:02:48.586 INFO:tasks.workunit.client.1.smithi102.stdout:6/814: fsync d1/d18/db/f1a 0 2024-09-19T09:02:48.586 INFO:tasks.workunit.client.0.smithi049.stdout:1/154: dread d5/d6/d8/f2a [0,4194304] 0 2024-09-19T09:02:48.587 INFO:tasks.workunit.client.0.smithi049.stdout:1/155: chown d5/d6/f1b 177711025 1 2024-09-19T09:02:48.589 INFO:tasks.workunit.client.1.smithi102.stdout:5/883: dwrite d5/d7/d1b/f41 [0,4194304] 0 2024-09-19T09:02:48.628 INFO:tasks.workunit.client.1.smithi102.stdout:1/868: mkdir dd/d14/d35/d49/d7d/d11c 0 2024-09-19T09:02:48.628 INFO:tasks.workunit.client.0.smithi049.stdout:3/210: mkdir d10/d3d/d46 0 2024-09-19T09:02:48.631 INFO:tasks.workunit.client.0.smithi049.stdout:3/211: write fd [2686779,63912] 0 2024-09-19T09:02:48.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/175: truncate d4/fe 3039780 0 2024-09-19T09:02:48.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/261: fdatasync d1/d8/fb 0 2024-09-19T09:02:48.632 INFO:tasks.workunit.client.1.smithi102.stdout:1/869: dread dd/d7a/d8c/da6/ff8 [0,4194304] 0 2024-09-19T09:02:48.634 INFO:tasks.workunit.client.0.smithi049.stdout:1/156: mknod d5/d6/d8/d1a/c2d 0 2024-09-19T09:02:48.638 INFO:tasks.workunit.client.1.smithi102.stdout:6/815: creat d1/d3a/f110 x:0 0 0 2024-09-19T09:02:48.639 INFO:tasks.workunit.client.0.smithi049.stdout:3/212: dread d10/f38 [0,4194304] 0 2024-09-19T09:02:48.639 INFO:tasks.workunit.client.0.smithi049.stdout:4/176: dwrite d4/d15/d19/f2c [0,4194304] 0 2024-09-19T09:02:48.640 INFO:tasks.workunit.client.1.smithi102.stdout:5/884: mknod d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/c112 0 2024-09-19T09:02:48.641 INFO:tasks.workunit.client.1.smithi102.stdout:9/889: dwrite d1/d2/d3/d1d/d4f/d6d/d81/d90/f116 [0,4194304] 0 2024-09-19T09:02:48.646 INFO:tasks.workunit.client.1.smithi102.stdout:7/926: creat d1/d4/dca/d52/d7f/f129 x:0 0 0 2024-09-19T09:02:48.650 INFO:tasks.workunit.client.1.smithi102.stdout:1/870: rename dd/d14/d35/d49/d62/d9e/cf4 to dd/d66/dea/c11d 0 2024-09-19T09:02:48.652 INFO:tasks.workunit.client.0.smithi049.stdout:7/262: rename d1/d1f to d1/d53/d18/d59 0 2024-09-19T09:02:48.653 INFO:tasks.workunit.client.0.smithi049.stdout:9/199: truncate d3/f1f 389213 0 2024-09-19T09:02:48.654 INFO:tasks.workunit.client.0.smithi049.stdout:1/157: mknod d5/d6/d19/c2e 0 2024-09-19T09:02:48.655 INFO:tasks.workunit.client.1.smithi102.stdout:6/816: creat d1/d26/d4b/d94/d8a/f111 x:0 0 0 2024-09-19T09:02:48.657 INFO:tasks.workunit.client.0.smithi049.stdout:7/263: dread d1/d8/d19/f34 [0,4194304] 0 2024-09-19T09:02:48.657 INFO:tasks.workunit.client.1.smithi102.stdout:5/885: creat d5/d7/d1a/daa/f113 x:0 0 0 2024-09-19T09:02:48.658 INFO:tasks.workunit.client.1.smithi102.stdout:5/886: chown d5/l30 85951917 1 2024-09-19T09:02:48.658 INFO:tasks.workunit.client.1.smithi102.stdout:5/887: fsync d5/d7b/fe2 0 2024-09-19T09:02:48.659 INFO:tasks.workunit.client.1.smithi102.stdout:9/890: symlink d1/d2/d3/d6f/d8d/da2/d106/d10e/l128 0 2024-09-19T09:02:48.660 INFO:tasks.workunit.client.1.smithi102.stdout:5/888: fsync d5/d7/d1a/d37/d34/f106 0 2024-09-19T09:02:48.662 INFO:tasks.workunit.client.1.smithi102.stdout:6/817: dread d1/d3a/f98 [0,4194304] 0 2024-09-19T09:02:48.662 INFO:tasks.workunit.client.0.smithi049.stdout:1/158: dwrite d5/d6/dc/f29 [0,4194304] 0 2024-09-19T09:02:48.663 INFO:tasks.workunit.client.1.smithi102.stdout:6/818: write d1/d26/d2e/d45/dac/db2/fea [326623,39247] 0 2024-09-19T09:02:48.663 INFO:tasks.workunit.client.0.smithi049.stdout:9/200: mknod d3/d14/d1a/d21/d31/c46 0 2024-09-19T09:02:48.665 INFO:tasks.workunit.client.0.smithi049.stdout:1/159: read d5/d6/fa [2747906,116506] 0 2024-09-19T09:02:48.665 INFO:tasks.workunit.client.1.smithi102.stdout:7/927: chown d1/d3/d20/dad/dd4/l122 33790344 1 2024-09-19T09:02:48.668 INFO:tasks.workunit.client.0.smithi049.stdout:7/264: creat d1/d8/d2d/f5a x:0 0 0 2024-09-19T09:02:48.676 INFO:tasks.workunit.client.1.smithi102.stdout:5/889: rename d5/d7/d1b/c7a to d5/d23/d10b/c114 0 2024-09-19T09:02:48.676 INFO:tasks.workunit.client.1.smithi102.stdout:5/890: stat d5/d7/d1b/c38 0 2024-09-19T09:02:48.677 INFO:tasks.workunit.client.0.smithi049.stdout:1/160: creat d5/d6/d8/d13/d24/f2f x:0 0 0 2024-09-19T09:02:48.678 INFO:tasks.workunit.client.0.smithi049.stdout:4/177: fsync d4/f16 0 2024-09-19T09:02:48.679 INFO:tasks.workunit.client.1.smithi102.stdout:3/977: sync 2024-09-19T09:02:48.680 INFO:tasks.workunit.client.1.smithi102.stdout:1/871: symlink dd/d7a/d8c/d8e/d103/ddc/de3/l11e 0 2024-09-19T09:02:48.682 INFO:tasks.workunit.client.0.smithi049.stdout:3/213: getdents d10/d11/d13 0 2024-09-19T09:02:48.682 INFO:tasks.workunit.client.1.smithi102.stdout:5/891: dwrite d5/d7/d1b/f9e [0,4194304] 0 2024-09-19T09:02:48.683 INFO:tasks.workunit.client.0.smithi049.stdout:3/214: write d10/d11/d27/f2c [5095117,7598] 0 2024-09-19T09:02:48.683 INFO:tasks.workunit.client.0.smithi049.stdout:9/201: symlink d3/d14/d34/d44/l47 0 2024-09-19T09:02:48.685 INFO:tasks.workunit.client.0.smithi049.stdout:1/161: mkdir d5/d6/d19/d30 0 2024-09-19T09:02:48.687 INFO:tasks.workunit.client.0.smithi049.stdout:4/178: mkdir d4/d15/d19/d32 0 2024-09-19T09:02:48.693 INFO:tasks.workunit.client.0.smithi049.stdout:3/215: dwrite d10/d11/d13/f1f [0,4194304] 0 2024-09-19T09:02:48.693 INFO:tasks.workunit.client.1.smithi102.stdout:6/819: dread d1/d26/d2e/d45/d47/d4d/d35/f39 [0,4194304] 0 2024-09-19T09:02:48.695 INFO:tasks.workunit.client.0.smithi049.stdout:1/162: mknod d5/d6/d8/c31 0 2024-09-19T09:02:48.695 INFO:tasks.workunit.client.1.smithi102.stdout:9/891: getdents d1/d2/d3/d1d/d4f/d6d/d81/d90 0 2024-09-19T09:02:48.698 INFO:tasks.workunit.client.0.smithi049.stdout:7/265: creat d1/d53/f5b x:0 0 0 2024-09-19T09:02:48.698 INFO:tasks.workunit.client.0.smithi049.stdout:3/216: dread fc [4194304,4194304] 0 2024-09-19T09:02:48.701 INFO:tasks.workunit.client.1.smithi102.stdout:3/978: dread d2/d19/d1c/d2f/d5a/d84/d4f/d72/d90/f8d [0,4194304] 0 2024-09-19T09:02:48.703 INFO:tasks.workunit.client.0.smithi049.stdout:7/266: dread d1/d8/fb [0,4194304] 0 2024-09-19T09:02:48.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/179: dread d4/f16 [0,4194304] 0 2024-09-19T09:02:48.705 INFO:tasks.workunit.client.0.smithi049.stdout:7/267: write d1/d8/d19/f37 [81399,90050] 0 2024-09-19T09:02:48.705 INFO:tasks.workunit.client.0.smithi049.stdout:4/180: write d4/d15/f28 [419929,122436] 0 2024-09-19T09:02:48.709 INFO:tasks.workunit.client.0.smithi049.stdout:4/181: dread d4/f16 [0,4194304] 0 2024-09-19T09:02:48.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/182: write d4/f16 [1981168,7324] 0 2024-09-19T09:02:48.714 INFO:tasks.workunit.client.1.smithi102.stdout:7/928: getdents d1 0 2024-09-19T09:02:48.714 INFO:tasks.workunit.client.1.smithi102.stdout:6/820: creat d1/d26/d4b/d94/da2/f112 x:0 0 0 2024-09-19T09:02:48.714 INFO:tasks.workunit.client.1.smithi102.stdout:9/892: rename d1/d2/d3/d1d/f20 to d1/d2/d3/d6f/f129 0 2024-09-19T09:02:48.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/268: rmdir d1/d53/d18 39 2024-09-19T09:02:48.715 INFO:tasks.workunit.client.0.smithi049.stdout:3/217: symlink d10/l47 0 2024-09-19T09:02:48.715 INFO:tasks.workunit.client.1.smithi102.stdout:9/893: fdatasync d1/d2/d3/d6f/f121 0 2024-09-19T09:02:48.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/218: chown d10/d11/d13/f1f 3 1 2024-09-19T09:02:48.716 INFO:tasks.workunit.client.0.smithi049.stdout:9/202: write d3/d14/d1a/d21/f2f [2460018,68776] 0 2024-09-19T09:02:48.718 INFO:tasks.workunit.client.0.smithi049.stdout:3/219: truncate d10/d11/d13/d30/f31 557093 0 2024-09-19T09:02:48.720 INFO:tasks.workunit.client.1.smithi102.stdout:7/929: chown d1/d4/dca/d52/d7f/cb3 1188 1 2024-09-19T09:02:48.721 INFO:tasks.workunit.client.0.smithi049.stdout:4/183: mknod d4/d15/c33 0 2024-09-19T09:02:48.722 INFO:tasks.workunit.client.1.smithi102.stdout:3/979: symlink d2/d19/d1c/d2f/d5a/d84/d4f/d72/dde/l13b 0 2024-09-19T09:02:48.722 INFO:tasks.workunit.client.1.smithi102.stdout:1/872: dwrite dd/d14/d35/d49/d62/d6c/d99/f111 [0,4194304] 0 2024-09-19T09:02:48.723 INFO:tasks.workunit.client.0.smithi049.stdout:9/203: creat d3/d14/d34/f48 x:0 0 0 2024-09-19T09:02:48.725 INFO:tasks.workunit.client.0.smithi049.stdout:1/163: write d5/d6/f10 [3744664,50536] 0 2024-09-19T09:02:48.726 INFO:tasks.workunit.client.0.smithi049.stdout:1/164: dread - d5/f1e zero size 2024-09-19T09:02:48.728 INFO:tasks.workunit.client.1.smithi102.stdout:7/930: rmdir d1/d4 39 2024-09-19T09:02:48.729 INFO:tasks.workunit.client.0.smithi049.stdout:4/184: rmdir d4/d15/d19/d1f 39 2024-09-19T09:02:48.731 INFO:tasks.workunit.client.0.smithi049.stdout:9/204: symlink d3/d14/d1a/d21/d31/l49 0 2024-09-19T09:02:48.733 INFO:tasks.workunit.client.1.smithi102.stdout:3/980: fsync d2/d19/d47/db/d26/d63/d6f/ff7 0 2024-09-19T09:02:48.737 INFO:tasks.workunit.client.1.smithi102.stdout:1/873: truncate dd/d5f/f96 757201 0 2024-09-19T09:02:48.737 INFO:tasks.workunit.client.1.smithi102.stdout:9/894: unlink d1/d2/d7b/cb3 0 2024-09-19T09:02:48.737 INFO:tasks.workunit.client.0.smithi049.stdout:1/165: creat d5/d6/d19/d21/f32 x:0 0 0 2024-09-19T09:02:48.738 INFO:tasks.workunit.client.0.smithi049.stdout:4/185: mkdir d4/d34 0 2024-09-19T09:02:48.740 INFO:tasks.workunit.client.0.smithi049.stdout:9/205: rename d3/d14/d1a/d21/c32 to d3/d22/c4a 0 2024-09-19T09:02:48.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/166: rename d5/d6/d19 to d5/d6/d19/d30/d33 22 2024-09-19T09:02:48.741 INFO:tasks.workunit.client.0.smithi049.stdout:7/269: getdents d1 0 2024-09-19T09:02:48.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/186: dread d4/d15/f28 [0,4194304] 0 2024-09-19T09:02:48.743 INFO:tasks.workunit.client.0.smithi049.stdout:3/220: creat d10/f48 x:0 0 0 2024-09-19T09:02:48.743 INFO:tasks.workunit.client.1.smithi102.stdout:1/874: readlink dd/d14/l32 0 2024-09-19T09:02:48.743 INFO:tasks.workunit.client.0.smithi049.stdout:4/187: fsync d4/f1e 0 2024-09-19T09:02:48.744 INFO:tasks.workunit.client.1.smithi102.stdout:1/875: chown dd/d14/d35/d49/d62/d9e/dab/de7 120305492 1 2024-09-19T09:02:48.744 INFO:tasks.workunit.client.1.smithi102.stdout:9/895: truncate d1/d2/d3/d1d/d4f/d6d/fc5 1001674 0 2024-09-19T09:02:48.745 INFO:tasks.workunit.client.1.smithi102.stdout:9/896: write d1/d2/d3/d6f/d8d/da2/fe9 [369744,90602] 0 2024-09-19T09:02:48.746 INFO:tasks.workunit.client.0.smithi049.stdout:9/206: creat d3/d14/d34/d44/f4b x:0 0 0 2024-09-19T09:02:48.746 INFO:tasks.workunit.client.1.smithi102.stdout:6/821: creat d1/d18/d37/f113 x:0 0 0 2024-09-19T09:02:48.747 INFO:tasks.workunit.client.0.smithi049.stdout:9/207: dread - d3/d14/f42 zero size 2024-09-19T09:02:48.748 INFO:tasks.workunit.client.1.smithi102.stdout:7/931: fsync d1/d4/dca/d52/f58 0 2024-09-19T09:02:48.749 INFO:tasks.workunit.client.1.smithi102.stdout:8/817: sync 2024-09-19T09:02:48.749 INFO:tasks.workunit.client.1.smithi102.stdout:2/810: sync 2024-09-19T09:02:48.749 INFO:tasks.workunit.client.1.smithi102.stdout:4/993: sync 2024-09-19T09:02:48.751 INFO:tasks.workunit.client.0.smithi049.stdout:4/188: mkdir d4/d35 0 2024-09-19T09:02:48.753 INFO:tasks.workunit.client.1.smithi102.stdout:3/981: unlink d2/d19/d47/fcc 0 2024-09-19T09:02:48.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/208: dwrite d3/d14/f3f [0,4194304] 0 2024-09-19T09:02:48.756 INFO:tasks.workunit.client.0.smithi049.stdout:1/167: rename d5/d6/d8/d13/d24/d2b/f2c to d5/d6/d8/d13/f34 0 2024-09-19T09:02:48.758 INFO:tasks.workunit.client.0.smithi049.stdout:1/168: write d5/f20 [311376,122724] 0 2024-09-19T09:02:48.760 INFO:tasks.workunit.client.0.smithi049.stdout:3/221: mknod d10/d11/d13/d30/c49 0 2024-09-19T09:02:48.761 INFO:tasks.workunit.client.0.smithi049.stdout:3/222: readlink d10/d11/d13/d30/l3f 0 2024-09-19T09:02:48.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/223: write d10/d11/d13/d30/f31 [472755,33322] 0 2024-09-19T09:02:48.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/270: dread d1/d1a/f38 [0,4194304] 0 2024-09-19T09:02:48.769 INFO:tasks.workunit.client.1.smithi102.stdout:6/822: creat d1/d26/d2e/d45/daf/f114 x:0 0 0 2024-09-19T09:02:48.772 INFO:tasks.workunit.client.1.smithi102.stdout:7/932: truncate d1/d3/d34/db4/fed 2195266 0 2024-09-19T09:02:48.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/189: dread d4/f14 [0,4194304] 0 2024-09-19T09:02:48.773 INFO:tasks.workunit.client.0.smithi049.stdout:9/209: mkdir d3/d14/d34/d4c 0 2024-09-19T09:02:48.773 INFO:tasks.workunit.client.1.smithi102.stdout:7/933: truncate d1/d4/f112 865855 0 2024-09-19T09:02:48.774 INFO:tasks.workunit.client.0.smithi049.stdout:9/210: fdatasync d3/d14/d1a/d21/f26 0 2024-09-19T09:02:48.775 INFO:tasks.workunit.client.1.smithi102.stdout:2/811: rmdir d7/d50/d64/d7f 39 2024-09-19T09:02:48.778 INFO:tasks.workunit.client.1.smithi102.stdout:4/994: rmdir d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/ded 39 2024-09-19T09:02:48.782 INFO:tasks.workunit.client.0.smithi049.stdout:3/224: unlink d10/d11/f26 0 2024-09-19T09:02:48.783 INFO:tasks.workunit.client.1.smithi102.stdout:3/982: unlink d2/d19/d47/l10e 0 2024-09-19T09:02:48.787 INFO:tasks.workunit.client.0.smithi049.stdout:4/190: symlink d4/l36 0 2024-09-19T09:02:48.789 INFO:tasks.workunit.client.1.smithi102.stdout:9/897: symlink d1/d2/d3/d1d/d4f/d6d/l12a 0 2024-09-19T09:02:48.792 INFO:tasks.workunit.client.1.smithi102.stdout:6/823: creat d1/d26/d4b/d94/da2/f115 x:0 0 0 2024-09-19T09:02:48.792 INFO:tasks.workunit.client.1.smithi102.stdout:5/892: sync 2024-09-19T09:02:48.793 INFO:tasks.workunit.client.0.smithi049.stdout:4/191: chown d4/l36 665 1 2024-09-19T09:02:48.793 INFO:tasks.workunit.client.0.smithi049.stdout:9/211: mkdir d3/d14/d34/d44/d4d 0 2024-09-19T09:02:48.794 INFO:tasks.workunit.client.0.smithi049.stdout:9/212: write d3/f2c [239158,104823] 0 2024-09-19T09:02:48.796 INFO:tasks.workunit.client.0.smithi049.stdout:4/192: dwrite d4/fc [0,4194304] 0 2024-09-19T09:02:48.797 INFO:tasks.workunit.client.0.smithi049.stdout:3/225: creat d10/d3d/f4a x:0 0 0 2024-09-19T09:02:48.800 INFO:tasks.workunit.client.1.smithi102.stdout:6/824: dwrite d1/d18/d37/dda/fe7 [0,4194304] 0 2024-09-19T09:02:48.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/169: dread d5/f23 [0,4194304] 0 2024-09-19T09:02:48.801 INFO:tasks.workunit.client.1.smithi102.stdout:5/893: dwrite d5/d7/d1b/f6f [0,4194304] 0 2024-09-19T09:02:48.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/170: write d5/d6/dc/f16 [583740,106383] 0 2024-09-19T09:02:48.803 INFO:tasks.workunit.client.0.smithi049.stdout:7/271: dread d1/d53/d18/d59/f2c [0,4194304] 0 2024-09-19T09:02:48.804 INFO:tasks.workunit.client.1.smithi102.stdout:2/812: dread d7/d50/d64/d7f/d83/dc7/fef [0,4194304] 0 2024-09-19T09:02:48.805 INFO:tasks.workunit.client.1.smithi102.stdout:2/813: chown d7/d1a/d56/fb8 12189312 1 2024-09-19T09:02:48.807 INFO:tasks.workunit.client.1.smithi102.stdout:6/825: dwrite d1/d3a/f5d [4194304,4194304] 0 2024-09-19T09:02:48.808 INFO:tasks.workunit.client.1.smithi102.stdout:6/826: chown d1/d26/d2e/d45/d47 1981863 1 2024-09-19T09:02:48.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/171: dwrite d5/d6/f10 [0,4194304] 0 2024-09-19T09:02:48.868 INFO:tasks.workunit.client.1.smithi102.stdout:8/818: link d0/d10/d21/d39/f3d d0/d10/d21/d39/d50/da2/dec/f10d 0 2024-09-19T09:02:48.869 INFO:tasks.workunit.client.0.smithi049.stdout:9/213: mknod d3/d14/d34/c4e 0 2024-09-19T09:02:48.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/226: rename d10/c2b to d10/d3d/c4b 0 2024-09-19T09:02:48.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/227: chown d10/d11/d13/c1b 2822816 1 2024-09-19T09:02:48.876 INFO:tasks.workunit.client.0.smithi049.stdout:7/272: creat d1/d8/d2d/d36/f5c x:0 0 0 2024-09-19T09:02:48.877 INFO:tasks.workunit.client.0.smithi049.stdout:4/193: symlink d4/d35/l37 0 2024-09-19T09:02:48.878 INFO:tasks.workunit.client.0.smithi049.stdout:4/194: write d4/f25 [3429808,101287] 0 2024-09-19T09:02:48.880 INFO:tasks.workunit.client.0.smithi049.stdout:9/214: symlink d3/d14/d34/d44/l4f 0 2024-09-19T09:02:48.881 INFO:tasks.workunit.client.0.smithi049.stdout:9/215: dread - d3/d14/d34/f3d zero size 2024-09-19T09:02:48.883 INFO:tasks.workunit.client.0.smithi049.stdout:1/172: rename d5/d6/d8/d1a/c2d to d5/d6/d8/d13/d24/c35 0 2024-09-19T09:02:48.887 INFO:tasks.workunit.client.1.smithi102.stdout:7/934: dread d1/d3/d20/d6c/fb0 [0,4194304] 0 2024-09-19T09:02:48.890 INFO:tasks.workunit.client.1.smithi102.stdout:2/814: dread d7/f42 [0,4194304] 0 2024-09-19T09:02:48.890 INFO:tasks.workunit.client.0.smithi049.stdout:9/216: unlink d3/d14/c30 0 2024-09-19T09:02:48.893 INFO:tasks.workunit.client.0.smithi049.stdout:4/195: rename d4/l11 to d4/d34/l38 0 2024-09-19T09:02:48.895 INFO:tasks.workunit.client.1.smithi102.stdout:1/876: getdents dd/d14/d35/d49/d62/d6c/d99 0 2024-09-19T09:02:48.897 INFO:tasks.workunit.client.0.smithi049.stdout:3/228: link d10/d11/d13/f18 d10/d3d/d46/f4c 0 2024-09-19T09:02:48.905 INFO:tasks.workunit.client.0.smithi049.stdout:4/196: rename d4/d15/c33 to d4/d35/c39 0 2024-09-19T09:02:48.906 INFO:tasks.workunit.client.1.smithi102.stdout:9/898: dwrite d1/d2/d3/d1d/f63 [0,4194304] 0 2024-09-19T09:02:48.906 INFO:tasks.workunit.client.0.smithi049.stdout:4/197: readlink d4/d35/l37 0 2024-09-19T09:02:48.906 INFO:tasks.workunit.client.1.smithi102.stdout:6/827: dwrite d1/d18/db/f31 [0,4194304] 0 2024-09-19T09:02:48.908 INFO:tasks.workunit.client.1.smithi102.stdout:3/983: dwrite d2/d19/d1c/d2f/d5a/d84/fb3 [0,4194304] 0 2024-09-19T09:02:48.908 INFO:tasks.workunit.client.0.smithi049.stdout:3/229: symlink d10/d11/l4d 0 2024-09-19T09:02:48.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/230: write fe [8379975,65320] 0 2024-09-19T09:02:48.913 INFO:tasks.workunit.client.1.smithi102.stdout:6/828: dread d1/d26/d2e/d45/d47/d4d/d35/f39 [0,4194304] 0 2024-09-19T09:02:48.914 INFO:tasks.workunit.client.0.smithi049.stdout:7/273: creat d1/d53/f5d x:0 0 0 2024-09-19T09:02:48.916 INFO:tasks.workunit.client.1.smithi102.stdout:7/935: creat d1/d3/d72/dfb/f12a x:0 0 0 2024-09-19T09:02:48.916 INFO:tasks.workunit.client.1.smithi102.stdout:5/894: write d5/d7/d1a/d37/d39/d4c/f55 [7421629,5054] 0 2024-09-19T09:02:48.919 INFO:tasks.workunit.client.0.smithi049.stdout:3/231: dwrite d10/f15 [4194304,4194304] 0 2024-09-19T09:02:48.920 INFO:tasks.workunit.client.0.smithi049.stdout:3/232: write fd [3378137,47888] 0 2024-09-19T09:02:48.922 INFO:tasks.workunit.client.1.smithi102.stdout:7/936: read d1/d4/dca/d52/f65 [377577,90889] 0 2024-09-19T09:02:48.923 INFO:tasks.workunit.client.0.smithi049.stdout:9/217: symlink d3/l50 0 2024-09-19T09:02:48.923 INFO:tasks.workunit.client.1.smithi102.stdout:4/995: getdents d14/d16/d17 0 2024-09-19T09:02:48.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/233: mknod d10/d3d/c4e 0 2024-09-19T09:02:48.933 INFO:tasks.workunit.client.0.smithi049.stdout:4/198: mkdir d4/d15/d3a 0 2024-09-19T09:02:48.933 INFO:tasks.workunit.client.1.smithi102.stdout:9/899: dwrite d1/d2/d3/d1d/d4f/d6d/f118 [0,4194304] 0 2024-09-19T09:02:48.934 INFO:tasks.workunit.client.1.smithi102.stdout:1/877: mkdir dd/d7a/d8c/d8e/d103/d11f 0 2024-09-19T09:02:48.937 INFO:tasks.workunit.client.1.smithi102.stdout:7/937: creat d1/d3/d20/dad/f12b x:0 0 0 2024-09-19T09:02:48.939 INFO:tasks.workunit.client.0.smithi049.stdout:3/234: dread d10/f38 [0,4194304] 0 2024-09-19T09:02:48.940 INFO:tasks.workunit.client.0.smithi049.stdout:3/235: write d10/d11/f36 [245301,10] 0 2024-09-19T09:02:48.942 INFO:tasks.workunit.client.1.smithi102.stdout:3/984: link d2/d19/d1c/d2f/d5a/d84/d4f/fb0 d2/d19/d1c/d2f/d5a/d84/d4f/d72/dde/f13c 0 2024-09-19T09:02:48.942 INFO:tasks.workunit.client.1.smithi102.stdout:2/815: dwrite d7/d1a/d2b/d31/fc1 [0,4194304] 0 2024-09-19T09:02:48.944 INFO:tasks.workunit.client.0.smithi049.stdout:9/218: creat d3/d14/f51 x:0 0 0 2024-09-19T09:02:48.944 INFO:tasks.workunit.client.1.smithi102.stdout:8/819: truncate d0/d10/d21/d39/d87/f8c 3804782 0 2024-09-19T09:02:48.946 INFO:tasks.workunit.client.0.smithi049.stdout:3/236: mkdir d10/d11/d27/d4f 0 2024-09-19T09:02:48.948 INFO:tasks.workunit.client.1.smithi102.stdout:5/895: symlink d5/d7/d1a/d37/d39/d81/df2/l115 0 2024-09-19T09:02:48.949 INFO:tasks.workunit.client.0.smithi049.stdout:7/274: truncate d1/d1a/f38 3251340 0 2024-09-19T09:02:48.950 INFO:tasks.workunit.client.0.smithi049.stdout:7/275: stat d1/d1a/c39 0 2024-09-19T09:02:48.950 INFO:tasks.workunit.client.1.smithi102.stdout:3/985: dwrite d2/d1e/d54/f97 [0,4194304] 0 2024-09-19T09:02:48.951 INFO:tasks.workunit.client.1.smithi102.stdout:5/896: stat d5/d7/d1a/d42/l80 0 2024-09-19T09:02:48.952 INFO:tasks.workunit.client.1.smithi102.stdout:9/900: rename d1/c7a to d1/d2/d78/df7/dfe/c12b 0 2024-09-19T09:02:48.954 INFO:tasks.workunit.client.0.smithi049.stdout:7/276: creat d1/d8/f5e x:0 0 0 2024-09-19T09:02:48.955 INFO:tasks.workunit.client.1.smithi102.stdout:4/996: dread d14/f15 [0,4194304] 0 2024-09-19T09:02:48.955 INFO:tasks.workunit.client.0.smithi049.stdout:3/237: symlink d10/d11/d27/d4f/l50 0 2024-09-19T09:02:48.957 INFO:tasks.workunit.client.1.smithi102.stdout:3/986: dread d2/d19/d1c/d2f/d5a/d84/d4f/d72/d10d/f12c [0,4194304] 0 2024-09-19T09:02:48.958 INFO:tasks.workunit.client.1.smithi102.stdout:2/816: mkdir d7/d1a/d2b/dab/de2/d11b 0 2024-09-19T09:02:48.960 INFO:tasks.workunit.client.1.smithi102.stdout:4/997: truncate d14/d16/d17/de3/dbd/df3/d37/d58/d89/da0/fe4 715086 0 2024-09-19T09:02:48.960 INFO:tasks.workunit.client.1.smithi102.stdout:3/987: readlink d2/d19/d1c/d2f/d5a/d84/d4f/d72/dde/l13b 0 2024-09-19T09:02:48.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/277: dread d1/d53/d18/d59/f48 [0,4194304] 0 2024-09-19T09:02:48.961 INFO:tasks.workunit.client.1.smithi102.stdout:8/820: mkdir d0/d4f/daa/d10e 0 2024-09-19T09:02:48.961 INFO:tasks.workunit.client.0.smithi049.stdout:7/278: stat d1/d53/d18/c49 0 2024-09-19T09:02:48.962 INFO:tasks.workunit.client.0.smithi049.stdout:3/238: mkdir d10/d3d/d51 0 2024-09-19T09:02:48.963 INFO:tasks.workunit.client.0.smithi049.stdout:0/263: sync 2024-09-19T09:02:48.966 INFO:tasks.workunit.client.1.smithi102.stdout:5/897: mkdir d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/d116 0 2024-09-19T09:02:48.968 INFO:tasks.workunit.client.0.smithi049.stdout:7/279: dwrite d1/d8/fb [4194304,4194304] 0 2024-09-19T09:02:48.969 INFO:tasks.workunit.client.0.smithi049.stdout:3/239: mkdir d10/d11/d27/d52 0 2024-09-19T09:02:48.972 INFO:tasks.workunit.client.1.smithi102.stdout:5/898: dwrite d5/d7/d1a/d37/d39/f40 [0,4194304] 0 2024-09-19T09:02:48.973 INFO:tasks.workunit.client.0.smithi049.stdout:0/264: dwrite d5/d10/d13/f4f [0,4194304] 0 2024-09-19T09:02:48.975 INFO:tasks.workunit.client.1.smithi102.stdout:6/829: getdents d1/d3a 0 2024-09-19T09:02:48.978 INFO:tasks.workunit.client.1.smithi102.stdout:3/988: mkdir d2/d19/d47/db/d8b/d13d 0 2024-09-19T09:02:48.979 INFO:tasks.workunit.client.1.smithi102.stdout:3/989: write d2/f127 [1032726,14207] 0 2024-09-19T09:02:48.985 INFO:tasks.workunit.client.1.smithi102.stdout:8/821: symlink d0/d64/l10f 0 2024-09-19T09:02:48.985 INFO:tasks.workunit.client.0.smithi049.stdout:3/240: symlink d10/d11/l53 0 2024-09-19T09:02:48.986 INFO:tasks.workunit.client.1.smithi102.stdout:7/938: write d1/d3/d34/d4f/f50 [1269873,122592] 0 2024-09-19T09:02:48.987 INFO:tasks.workunit.client.1.smithi102.stdout:8/822: chown d0/d10/d21/d39/db8 229473575 1 2024-09-19T09:02:48.989 INFO:tasks.workunit.client.1.smithi102.stdout:7/939: stat d1/d3/d34/d74/fa7 0 2024-09-19T09:02:48.992 INFO:tasks.workunit.client.1.smithi102.stdout:3/990: dwrite d2/d19/d47/db/d26/d63/dfd/f103 [0,4194304] 0 2024-09-19T09:02:48.993 INFO:tasks.workunit.client.1.smithi102.stdout:6/830: mknod d1/d26/d2e/c116 0 2024-09-19T09:02:48.995 INFO:tasks.workunit.client.1.smithi102.stdout:4/998: mknod d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/ddb/c146 0 2024-09-19T09:02:48.997 INFO:tasks.workunit.client.1.smithi102.stdout:4/999: read - d14/d16/d17/de3/dbd/df3/d37/d58/d89/d78/f13e zero size 2024-09-19T09:02:49.000 INFO:tasks.workunit.client.1.smithi102.stdout:6/831: symlink d1/d26/d4b/d94/d8a/l117 0 2024-09-19T09:02:49.004 INFO:tasks.workunit.client.1.smithi102.stdout:9/901: dwrite d1/d2/d3/d1d/d4f/f82 [0,4194304] 0 2024-09-19T09:02:49.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/280: write d1/d7/fa [2667265,62851] 0 2024-09-19T09:02:49.005 INFO:tasks.workunit.client.0.smithi049.stdout:7/281: chown d1/d1a/f57 50 1 2024-09-19T09:02:49.005 INFO:tasks.workunit.client.1.smithi102.stdout:3/991: mknod d2/d19/d1c/d2f/d5a/d84/d4f/d72/d120/c13e 0 2024-09-19T09:02:49.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/282: fdatasync d1/d8/f1c 0 2024-09-19T09:02:49.008 INFO:tasks.workunit.client.1.smithi102.stdout:5/899: dread d5/d60/db6/dd2/fed [0,4194304] 0 2024-09-19T09:02:49.009 INFO:tasks.workunit.client.1.smithi102.stdout:3/992: creat d2/d1e/d54/f13f x:0 0 0 2024-09-19T09:02:49.011 INFO:tasks.workunit.client.0.smithi049.stdout:7/283: mknod d1/d7/c5f 0 2024-09-19T09:02:49.014 INFO:tasks.workunit.client.1.smithi102.stdout:3/993: rmdir d2/d19/d35 39 2024-09-19T09:02:49.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/241: dwrite d10/f38 [0,4194304] 0 2024-09-19T09:02:49.017 INFO:tasks.workunit.client.1.smithi102.stdout:5/900: rename d5/d7/d1a/d37/d34/d4d/df4 to d5/d7/d1a/d37/d39/d81/dfa/d117 0 2024-09-19T09:02:49.017 INFO:tasks.workunit.client.0.smithi049.stdout:0/265: dread d5/f50 [0,4194304] 0 2024-09-19T09:02:49.018 INFO:tasks.workunit.client.1.smithi102.stdout:5/901: chown d5/d7/d1b/f9e 25676998 1 2024-09-19T09:02:49.018 INFO:tasks.workunit.client.0.smithi049.stdout:7/284: fdatasync d1/d1a/f41 0 2024-09-19T09:02:49.019 INFO:tasks.workunit.client.1.smithi102.stdout:5/902: write d5/d7/d1a/de1/fda [895947,106380] 0 2024-09-19T09:02:49.022 INFO:tasks.workunit.client.0.smithi049.stdout:0/266: chown d5/d10/c32 25 1 2024-09-19T09:02:49.023 INFO:tasks.workunit.client.1.smithi102.stdout:5/903: dread d5/d7/d1a/d37/d39/d81/fbb [0,4194304] 0 2024-09-19T09:02:49.023 INFO:tasks.workunit.client.1.smithi102.stdout:7/940: write d1/d2d/f11d [695452,94132] 0 2024-09-19T09:02:49.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/285: symlink d1/d8/l60 0 2024-09-19T09:02:49.025 INFO:tasks.workunit.client.1.smithi102.stdout:3/994: creat d2/d19/d1c/d2f/d5a/d84/d53/f140 x:0 0 0 2024-09-19T09:02:49.027 INFO:tasks.workunit.client.0.smithi049.stdout:0/267: unlink d5/d10/c14 0 2024-09-19T09:02:49.027 INFO:tasks.workunit.client.0.smithi049.stdout:3/242: dwrite d10/d11/d13/d30/f3c [0,4194304] 0 2024-09-19T09:02:49.028 INFO:tasks.workunit.client.0.smithi049.stdout:0/268: chown d5/d10/d3c 27798413 1 2024-09-19T09:02:49.030 INFO:tasks.workunit.client.1.smithi102.stdout:7/941: mknod d1/d3/d34/d4f/c12c 0 2024-09-19T09:02:49.032 INFO:tasks.workunit.client.1.smithi102.stdout:3/995: unlink d2/d1e/f8c 0 2024-09-19T09:02:49.034 INFO:tasks.workunit.client.1.smithi102.stdout:3/996: chown d2/d19/d47/db/dc3/d10f/f111 3941259 1 2024-09-19T09:02:49.037 INFO:tasks.workunit.client.1.smithi102.stdout:9/902: write d1/d2/d78/f7d [1317387,26497] 0 2024-09-19T09:02:49.038 INFO:tasks.workunit.client.1.smithi102.stdout:7/942: chown d1/d3/d72/f75 419 1 2024-09-19T09:02:49.039 INFO:tasks.workunit.client.0.smithi049.stdout:3/243: mknod d10/c54 0 2024-09-19T09:02:49.041 INFO:tasks.workunit.client.1.smithi102.stdout:8/823: truncate d0/d4f/f65 4490224 0 2024-09-19T09:02:49.042 INFO:tasks.workunit.client.1.smithi102.stdout:8/824: fdatasync d0/db/d1d/f8d 0 2024-09-19T09:02:49.046 INFO:tasks.workunit.client.0.smithi049.stdout:0/269: mknod d5/d10/d3c/c55 0 2024-09-19T09:02:49.050 INFO:tasks.workunit.client.1.smithi102.stdout:8/825: creat d0/db/d104/d106/f110 x:0 0 0 2024-09-19T09:02:49.052 INFO:tasks.workunit.client.1.smithi102.stdout:5/904: dwrite d5/d60/dfd/f100 [0,4194304] 0 2024-09-19T09:02:49.053 INFO:tasks.workunit.client.1.smithi102.stdout:3/997: dread d2/d19/d1c/fe8 [0,4194304] 0 2024-09-19T09:02:49.053 INFO:tasks.workunit.client.0.smithi049.stdout:0/270: dwrite d5/d10/d13/d15/d36/d3d/f33 [0,4194304] 0 2024-09-19T09:02:49.053 INFO:tasks.workunit.client.0.smithi049.stdout:3/244: link d10/d11/d13/c23 d10/d3d/d51/c55 0 2024-09-19T09:02:49.053 INFO:tasks.workunit.client.0.smithi049.stdout:3/245: readlink l8 0 2024-09-19T09:02:49.054 INFO:tasks.workunit.client.1.smithi102.stdout:5/905: read d5/d7/d1a/de1/fda [205203,106683] 0 2024-09-19T09:02:49.054 INFO:tasks.workunit.client.0.smithi049.stdout:0/271: dread - d5/d10/d13/d15/f53 zero size 2024-09-19T09:02:49.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/286: truncate d1/d53/d18/d59/f29 459034 0 2024-09-19T09:02:49.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/287: chown d1/d53/d18/d50/c51 206073 1 2024-09-19T09:02:49.061 INFO:tasks.workunit.client.0.smithi049.stdout:7/288: write d1/d8/d2d/d36/f5c [986039,107251] 0 2024-09-19T09:02:49.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/246: mkdir d10/d11/d13/d56 0 2024-09-19T09:02:49.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/289: fsync d1/d1a/f57 0 2024-09-19T09:02:49.063 INFO:tasks.workunit.client.1.smithi102.stdout:8/826: symlink d0/d5a/l111 0 2024-09-19T09:02:49.066 INFO:tasks.workunit.client.1.smithi102.stdout:1/878: sync 2024-09-19T09:02:49.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/247: rmdir d10/d11/d27/d4f 39 2024-09-19T09:02:49.067 INFO:tasks.workunit.client.1.smithi102.stdout:8/827: dread d0/d10/d21/db3/ffe [0,4194304] 0 2024-09-19T09:02:49.069 INFO:tasks.workunit.client.1.smithi102.stdout:5/906: creat d5/d60/db6/de4/f118 x:0 0 0 2024-09-19T09:02:49.069 INFO:tasks.workunit.client.1.smithi102.stdout:7/943: link d1/d3/d20/d6c/fb0 d1/d3/d34/d4f/f12d 0 2024-09-19T09:02:49.070 INFO:tasks.workunit.client.1.smithi102.stdout:9/903: dwrite d1/d2/d3/d1d/d4f/d6d/fa8 [4194304,4194304] 0 2024-09-19T09:02:49.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/290: link d1/d53/l25 d1/d8/d2d/l61 0 2024-09-19T09:02:49.072 INFO:tasks.workunit.client.1.smithi102.stdout:9/904: read - d1/d2/d3/d6f/d8d/da2/fd9 zero size 2024-09-19T09:02:49.073 INFO:tasks.workunit.client.1.smithi102.stdout:3/998: symlink d2/d19/d35/dce/ddc/l141 0 2024-09-19T09:02:49.075 INFO:tasks.workunit.client.0.smithi049.stdout:3/248: getdents d10/d3d/d46 0 2024-09-19T09:02:49.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/272: dread d5/d10/d13/d15/f43 [0,4194304] 0 2024-09-19T09:02:49.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/273: write d5/d10/d13/d15/f53 [911234,115923] 0 2024-09-19T09:02:49.081 INFO:tasks.workunit.client.1.smithi102.stdout:8/828: creat d0/d10/d21/d39/d50/d63/d83/f112 x:0 0 0 2024-09-19T09:02:49.083 INFO:tasks.workunit.client.0.smithi049.stdout:7/291: mkdir d1/d53/d18/d50/d58/d62 0 2024-09-19T09:02:49.085 INFO:tasks.workunit.client.0.smithi049.stdout:0/274: mknod d5/d10/d13/d30/c56 0 2024-09-19T09:02:49.086 INFO:tasks.workunit.client.1.smithi102.stdout:7/944: dread d1/d4/dca/f4b [0,4194304] 0 2024-09-19T09:02:49.087 INFO:tasks.workunit.client.1.smithi102.stdout:5/907: rename d5/d7/d1a/d37/d34/d73/cc4 to d5/d7/c119 0 2024-09-19T09:02:49.087 INFO:tasks.workunit.client.1.smithi102.stdout:5/908: readlink d5/d60/l9f 0 2024-09-19T09:02:49.088 INFO:tasks.workunit.client.0.smithi049.stdout:3/249: symlink d10/l57 0 2024-09-19T09:02:49.089 INFO:tasks.workunit.client.0.smithi049.stdout:3/250: chown d10/d11/d13/l29 0 1 2024-09-19T09:02:49.090 INFO:tasks.workunit.client.1.smithi102.stdout:9/905: readlink d1/d2/d3/l3d 0 2024-09-19T09:02:49.090 INFO:tasks.workunit.client.0.smithi049.stdout:3/251: chown d10/c54 37931923 1 2024-09-19T09:02:49.090 INFO:tasks.workunit.client.1.smithi102.stdout:9/906: chown d1/d2/d3/f4b 447 1 2024-09-19T09:02:49.091 INFO:tasks.workunit.client.1.smithi102.stdout:3/999: rmdir d2/d19/d47/db/d8b 39 2024-09-19T09:02:49.093 INFO:tasks.workunit.client.1.smithi102.stdout:6/832: sync 2024-09-19T09:02:49.094 INFO:tasks.workunit.client.1.smithi102.stdout:2/817: sync 2024-09-19T09:02:49.094 INFO:tasks.workunit.client.1.smithi102.stdout:8/829: unlink d0/d5a/c6f 0 2024-09-19T09:02:49.096 INFO:tasks.workunit.client.1.smithi102.stdout:1/879: creat dd/d7a/d8c/d8e/d103/f120 x:0 0 0 2024-09-19T09:02:49.096 INFO:tasks.workunit.client.0.smithi049.stdout:0/275: rename d5/d10/d13/d15/f53 to d5/d10/d13/d15/d29/f57 0 2024-09-19T09:02:49.097 INFO:tasks.workunit.client.0.smithi049.stdout:3/252: symlink d10/d11/l58 0 2024-09-19T09:02:49.100 INFO:tasks.workunit.client.1.smithi102.stdout:2/818: dwrite d7/d1a/d56/fb8 [0,4194304] 0 2024-09-19T09:02:49.101 INFO:tasks.workunit.client.1.smithi102.stdout:2/819: read d7/d1a/f49 [845526,88159] 0 2024-09-19T09:02:49.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/276: readlink d5/d10/d13/d15/d36/d3d/l3f 0 2024-09-19T09:02:49.108 INFO:tasks.workunit.client.0.smithi049.stdout:0/277: write d5/fa [2819556,75417] 0 2024-09-19T09:02:49.109 INFO:tasks.workunit.client.1.smithi102.stdout:5/909: getdents d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/d116 0 2024-09-19T09:02:49.110 INFO:tasks.workunit.client.1.smithi102.stdout:7/945: dwrite d1/d4/dca/f87 [0,4194304] 0 2024-09-19T09:02:49.112 INFO:tasks.workunit.client.1.smithi102.stdout:2/820: mknod d7/d1a/d56/c11c 0 2024-09-19T09:02:49.112 INFO:tasks.workunit.client.0.smithi049.stdout:0/278: creat d5/f58 x:0 0 0 2024-09-19T09:02:49.114 INFO:tasks.workunit.client.0.smithi049.stdout:7/292: rename d1/d7/l3d to d1/d7/l63 0 2024-09-19T09:02:49.116 INFO:tasks.workunit.client.0.smithi049.stdout:3/253: getdents d10/d11/d13/d30 0 2024-09-19T09:02:49.118 INFO:tasks.workunit.client.1.smithi102.stdout:8/830: rename d0/db/d1d/f10b to d0/d10/d21/d39/d50/f113 0 2024-09-19T09:02:49.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/279: dread d5/d10/d13/d15/f43 [0,4194304] 0 2024-09-19T09:02:49.119 INFO:tasks.workunit.client.1.smithi102.stdout:5/910: dwrite d5/d7/d1a/d37/d34/d4d/d9c/db8/fef [0,4194304] 0 2024-09-19T09:02:49.120 INFO:tasks.workunit.client.0.smithi049.stdout:0/280: chown d5/d10/d13/d15/d36/f51 521 1 2024-09-19T09:02:49.121 INFO:tasks.workunit.client.0.smithi049.stdout:3/254: chown d10/d11/d27/d4f 1624664229 1 2024-09-19T09:02:49.125 INFO:tasks.workunit.client.1.smithi102.stdout:6/833: getdents d1/d26/d2e/d45/d47/d4d/d35/d79 0 2024-09-19T09:02:49.126 INFO:tasks.workunit.client.0.smithi049.stdout:0/281: rmdir d5/d10/d13/d15/d29/d3b 39 2024-09-19T09:02:49.128 INFO:tasks.workunit.client.1.smithi102.stdout:1/880: dwrite f9 [0,4194304] 0 2024-09-19T09:02:49.128 INFO:tasks.workunit.client.1.smithi102.stdout:9/907: dread d1/d2/d3/fc9 [0,4194304] 0 2024-09-19T09:02:49.129 INFO:tasks.workunit.client.0.smithi049.stdout:3/255: mkdir d10/d11/d27/d4f/d59 0 2024-09-19T09:02:49.131 INFO:tasks.workunit.client.0.smithi049.stdout:3/256: write d10/d11/d27/f2c [3058530,50256] 0 2024-09-19T09:02:49.131 INFO:tasks.workunit.client.1.smithi102.stdout:8/831: mkdir d0/d4f/dc1/d114 0 2024-09-19T09:02:49.132 INFO:tasks.workunit.client.1.smithi102.stdout:8/832: stat d0/d4f/daa/cd7 0 2024-09-19T09:02:49.132 INFO:tasks.workunit.client.0.smithi049.stdout:3/257: chown d10/d3d 76 1 2024-09-19T09:02:49.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/293: creat d1/d7/f64 x:0 0 0 2024-09-19T09:02:49.135 INFO:tasks.workunit.client.0.smithi049.stdout:0/282: dwrite d5/f58 [0,4194304] 0 2024-09-19T09:02:49.139 INFO:tasks.workunit.client.1.smithi102.stdout:7/946: write d1/d2f/f4a [2488405,131042] 0 2024-09-19T09:02:49.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/258: rmdir d10/d11/d13 39 2024-09-19T09:02:49.146 INFO:tasks.workunit.client.1.smithi102.stdout:5/911: write d5/d7/d1b/fa8 [1707391,36062] 0 2024-09-19T09:02:49.146 INFO:tasks.workunit.client.1.smithi102.stdout:6/834: mkdir d1/d26/d2e/d45/dac/db2/d118 0 2024-09-19T09:02:49.146 INFO:tasks.workunit.client.0.smithi049.stdout:0/283: rmdir d5/d10/d3c 39 2024-09-19T09:02:49.148 INFO:tasks.workunit.client.1.smithi102.stdout:1/881: rmdir dd/d7a/d8c/d8e/d103/d78 39 2024-09-19T09:02:49.151 INFO:tasks.workunit.client.0.smithi049.stdout:3/259: symlink d10/d11/d13/d30/l5a 0 2024-09-19T09:02:49.154 INFO:tasks.workunit.client.1.smithi102.stdout:7/947: symlink d1/d4/dca/d52/d7f/da5/df2/df9/l12e 0 2024-09-19T09:02:49.155 INFO:tasks.workunit.client.0.smithi049.stdout:0/284: dwrite d5/d10/d13/d30/f31 [0,4194304] 0 2024-09-19T09:02:49.155 INFO:tasks.workunit.client.0.smithi049.stdout:7/294: write d1/f2 [4200628,78453] 0 2024-09-19T09:02:49.156 INFO:tasks.workunit.client.1.smithi102.stdout:2/821: truncate d7/d50/d64/da1/d115/f6a 3871310 0 2024-09-19T09:02:49.158 INFO:tasks.workunit.client.1.smithi102.stdout:5/912: unlink d5/d7/d1a/d8f/ff0 0 2024-09-19T09:02:49.158 INFO:tasks.workunit.client.0.smithi049.stdout:0/285: fsync d5/d10/d13/d15/d36/f41 0 2024-09-19T09:02:49.160 INFO:tasks.workunit.client.1.smithi102.stdout:6/835: rename d1/d26/d2e/l46 to d1/d26/d4b/l119 0 2024-09-19T09:02:49.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/260: dwrite d10/d11/f3a [4194304,4194304] 0 2024-09-19T09:02:49.162 INFO:tasks.workunit.client.1.smithi102.stdout:8/833: mknod d0/d4f/dc1/d114/c115 0 2024-09-19T09:02:49.162 INFO:tasks.workunit.client.0.smithi049.stdout:0/286: truncate d5/d10/d13/d30/f49 589649 0 2024-09-19T09:02:49.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/261: write d10/d11/d13/f32 [806126,4524] 0 2024-09-19T09:02:49.165 INFO:tasks.workunit.client.0.smithi049.stdout:7/295: rename d1/d53/d18/c40 to d1/d53/d18/d50/d58/d62/c65 0 2024-09-19T09:02:49.166 INFO:tasks.workunit.client.1.smithi102.stdout:7/948: unlink d1/d4/dca/d52/cbb 0 2024-09-19T09:02:49.168 INFO:tasks.workunit.client.1.smithi102.stdout:6/836: dwrite d1/d18/d37/fc8 [0,4194304] 0 2024-09-19T09:02:49.169 INFO:tasks.workunit.client.1.smithi102.stdout:7/949: dread - d1/d4/dca/d52/d7f/da5/de2/df0/f124 zero size 2024-09-19T09:02:49.171 INFO:tasks.workunit.client.1.smithi102.stdout:7/950: write d1/d3/d72/f106 [3555038,94044] 0 2024-09-19T09:02:49.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/287: chown d5/d10/d3c 497053 1 2024-09-19T09:02:49.173 INFO:tasks.workunit.client.1.smithi102.stdout:2/822: unlink d7/d1a/d2b/dae/ff3 0 2024-09-19T09:02:49.176 INFO:tasks.workunit.client.0.smithi049.stdout:7/296: creat d1/d53/d18/d50/d58/d62/f66 x:0 0 0 2024-09-19T09:02:49.177 INFO:tasks.workunit.client.1.smithi102.stdout:1/882: symlink dd/d14/d35/d49/d7d/d11c/l121 0 2024-09-19T09:02:49.178 INFO:tasks.workunit.client.0.smithi049.stdout:0/288: creat d5/d10/d2f/f59 x:0 0 0 2024-09-19T09:02:49.180 INFO:tasks.workunit.client.0.smithi049.stdout:7/297: rmdir d1/d7 39 2024-09-19T09:02:49.181 INFO:tasks.workunit.client.1.smithi102.stdout:8/834: creat d0/d10/d21/d39/d87/f116 x:0 0 0 2024-09-19T09:02:49.182 INFO:tasks.workunit.client.0.smithi049.stdout:0/289: symlink d5/d10/d3c/l5a 0 2024-09-19T09:02:49.185 INFO:tasks.workunit.client.0.smithi049.stdout:7/298: chown d1/d8/d19 629328 1 2024-09-19T09:02:49.185 INFO:tasks.workunit.client.1.smithi102.stdout:7/951: mknod d1/d3/d20/dad/c12f 0 2024-09-19T09:02:49.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/290: fdatasync d5/d10/d13/d15/d36/d3d/f2d 0 2024-09-19T09:02:49.187 INFO:tasks.workunit.client.1.smithi102.stdout:2/823: symlink d7/d11/dc8/l11d 0 2024-09-19T09:02:49.189 INFO:tasks.workunit.client.1.smithi102.stdout:9/908: getdents d1/d2/d3/d1d/d4f/d6d/d81/dd3 0 2024-09-19T09:02:49.190 INFO:tasks.workunit.client.1.smithi102.stdout:6/837: symlink d1/d26/d2e/d45/dac/db2/d118/l11a 0 2024-09-19T09:02:49.191 INFO:tasks.workunit.client.1.smithi102.stdout:2/824: creat d7/d1a/d2b/dab/f11e x:0 0 0 2024-09-19T09:02:49.191 INFO:tasks.workunit.client.1.smithi102.stdout:9/909: read d1/d8/f56 [162578,93846] 0 2024-09-19T09:02:49.191 INFO:tasks.workunit.client.1.smithi102.stdout:5/913: write d5/d7/d1a/d8f/dc0/f92 [3354336,37959] 0 2024-09-19T09:02:49.191 INFO:tasks.workunit.client.1.smithi102.stdout:6/838: readlink d1/d26/d2e/d45/d47/d4d/d35/l6e 0 2024-09-19T09:02:49.193 INFO:tasks.workunit.client.1.smithi102.stdout:7/952: dread d1/d4/dca/f94 [0,4194304] 0 2024-09-19T09:02:49.195 INFO:tasks.workunit.client.1.smithi102.stdout:7/953: write d1/d3/d72/dfb/f12a [459347,99663] 0 2024-09-19T09:02:49.195 INFO:tasks.workunit.client.1.smithi102.stdout:2/825: creat d7/d1a/d2b/d31/d106/d93/dce/f11f x:0 0 0 2024-09-19T09:02:49.197 INFO:tasks.workunit.client.1.smithi102.stdout:6/839: mknod d1/d26/d2e/d45/d47/d4d/d35/d41/da4/c11b 0 2024-09-19T09:02:49.197 INFO:tasks.workunit.client.1.smithi102.stdout:7/954: chown d1/d3/d34/d74 462508674 1 2024-09-19T09:02:49.198 INFO:tasks.workunit.client.1.smithi102.stdout:9/910: link d1/d8/l9b d1/d8/l12c 0 2024-09-19T09:02:49.199 INFO:tasks.workunit.client.1.smithi102.stdout:6/840: dread - d1/d26/d2e/dce/fdd zero size 2024-09-19T09:02:49.200 INFO:tasks.workunit.client.1.smithi102.stdout:1/883: write dd/d7a/d8c/d8e/d103/f39 [376967,88536] 0 2024-09-19T09:02:49.200 INFO:tasks.workunit.client.1.smithi102.stdout:5/914: dwrite d5/d7/d1b/fa8 [0,4194304] 0 2024-09-19T09:02:49.201 INFO:tasks.workunit.client.1.smithi102.stdout:2/826: creat d7/d50/f120 x:0 0 0 2024-09-19T09:02:49.205 INFO:tasks.workunit.client.1.smithi102.stdout:9/911: unlink d1/d2/d78/da0/dc0/cf4 0 2024-09-19T09:02:49.207 INFO:tasks.workunit.client.1.smithi102.stdout:6/841: truncate d1/d26/d2e/dce/fdd 37378 0 2024-09-19T09:02:49.212 INFO:tasks.workunit.client.1.smithi102.stdout:7/955: truncate d1/d2d/f11d 15069 0 2024-09-19T09:02:49.213 INFO:tasks.workunit.client.1.smithi102.stdout:1/884: dwrite dd/d13/f36 [4194304,4194304] 0 2024-09-19T09:02:49.213 INFO:tasks.workunit.client.1.smithi102.stdout:6/842: write d1/d26/d2e/d45/d47/d4d/d35/d79/fc7 [2030991,43506] 0 2024-09-19T09:02:49.217 INFO:tasks.workunit.client.1.smithi102.stdout:9/912: dwrite d1/d2/f4a [0,4194304] 0 2024-09-19T09:02:49.217 INFO:tasks.workunit.client.1.smithi102.stdout:7/956: mknod d1/d3/d34/d4f/c130 0 2024-09-19T09:02:49.219 INFO:tasks.workunit.client.1.smithi102.stdout:7/957: dread - d1/d4/f104 zero size 2024-09-19T09:02:49.225 INFO:tasks.workunit.client.1.smithi102.stdout:5/915: dwrite d5/d7/d1a/d37/d39/f8b [0,4194304] 0 2024-09-19T09:02:49.228 INFO:tasks.workunit.client.1.smithi102.stdout:7/958: stat d1/d3/d72/lf1 0 2024-09-19T09:02:49.228 INFO:tasks.workunit.client.1.smithi102.stdout:2/827: dread d7/d1a/d2b/d31/d51/f55 [0,4194304] 0 2024-09-19T09:02:49.232 INFO:tasks.workunit.client.1.smithi102.stdout:5/916: stat d5/d60/fc3 0 2024-09-19T09:02:49.233 INFO:tasks.workunit.client.1.smithi102.stdout:2/828: chown d7/d50/d64/d7f 520675293 1 2024-09-19T09:02:49.237 INFO:tasks.workunit.client.1.smithi102.stdout:6/843: dwrite d1/d26/d4b/f51 [0,4194304] 0 2024-09-19T09:02:49.239 INFO:tasks.workunit.client.1.smithi102.stdout:7/959: truncate d1/d3/d34/db4/fed 2439371 0 2024-09-19T09:02:49.240 INFO:tasks.workunit.client.1.smithi102.stdout:9/913: dwrite d1/d2/d3/d6f/dcb/fd8 [0,4194304] 0 2024-09-19T09:02:49.240 INFO:tasks.workunit.client.1.smithi102.stdout:1/885: dwrite dd/d14/d35/d49/d7d/d7f/f8b [0,4194304] 0 2024-09-19T09:02:49.242 INFO:tasks.workunit.client.1.smithi102.stdout:1/886: write dd/f1d [692488,30221] 0 2024-09-19T09:02:49.247 INFO:tasks.workunit.client.0.smithi049.stdout:0/291: creat d5/d10/f5b x:0 0 0 2024-09-19T09:02:49.248 INFO:tasks.workunit.client.0.smithi049.stdout:0/292: write d5/d10/d2f/f59 [918702,62018] 0 2024-09-19T09:02:49.249 INFO:tasks.workunit.client.0.smithi049.stdout:0/293: fsync d5/d10/d13/d15/d36/d3d/f24 0 2024-09-19T09:02:49.250 INFO:tasks.workunit.client.1.smithi102.stdout:5/917: write d5/d7/d1a/de1/d78/f9a [4095488,79733] 0 2024-09-19T09:02:49.250 INFO:tasks.workunit.client.1.smithi102.stdout:1/887: readlink dd/d7a/d8c/d8e/d103/ddc/lef 0 2024-09-19T09:02:49.251 INFO:tasks.workunit.client.1.smithi102.stdout:7/960: chown d1/d4/f63 123213434 1 2024-09-19T09:02:49.255 INFO:tasks.workunit.client.1.smithi102.stdout:5/918: readlink d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/lc8 0 2024-09-19T09:02:49.256 INFO:tasks.workunit.client.1.smithi102.stdout:9/914: dwrite d1/d2/d3/fee [0,4194304] 0 2024-09-19T09:02:49.256 INFO:tasks.workunit.client.1.smithi102.stdout:5/919: fsync d5/d7/d1a/f88 0 2024-09-19T09:02:49.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:48 smithi102 ceph-mon[35280]: pgmap v31: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 167 MiB/s wr, 390 op/s 2024-09-19T09:02:49.285 INFO:tasks.workunit.client.1.smithi102.stdout:8/835: sync 2024-09-19T09:02:49.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:48 smithi049 ceph-mon[28158]: pgmap v31: 65 pgs: 65 active+clean; 1.7 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 167 MiB/s wr, 390 op/s 2024-09-19T09:02:49.353 INFO:tasks.workunit.client.0.smithi049.stdout:2/136: sync 2024-09-19T09:02:49.353 INFO:tasks.workunit.client.0.smithi049.stdout:5/127: sync 2024-09-19T09:02:49.353 INFO:tasks.workunit.client.0.smithi049.stdout:8/260: sync 2024-09-19T09:02:49.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/137: dwrite d1/d4/d20/f1c [0,4194304] 0 2024-09-19T09:02:49.359 INFO:tasks.workunit.client.0.smithi049.stdout:2/138: stat d1/d4/d1e/f2f 0 2024-09-19T09:02:49.360 INFO:tasks.workunit.client.0.smithi049.stdout:2/139: truncate d1/d2b/d25/f29 1005035 0 2024-09-19T09:02:49.360 INFO:tasks.workunit.client.0.smithi049.stdout:2/140: chown d1/d4/d20/l27 12 1 2024-09-19T09:02:49.396 INFO:tasks.workunit.client.0.smithi049.stdout:2/141: read - d1/f11 zero size 2024-09-19T09:02:49.396 INFO:tasks.workunit.client.0.smithi049.stdout:7/299: rename d1/d8/l3f to d1/d53/l67 0 2024-09-19T09:02:49.477 INFO:tasks.workunit.client.0.smithi049.stdout:8/261: creat d1/d11/f4d x:0 0 0 2024-09-19T09:02:49.481 INFO:tasks.workunit.client.0.smithi049.stdout:5/128: symlink d3/d5/de/l2a 0 2024-09-19T09:02:49.487 INFO:tasks.workunit.client.1.smithi102.stdout:1/888: read dd/d13/f56 [2106965,13568] 0 2024-09-19T09:02:49.488 INFO:tasks.workunit.client.0.smithi049.stdout:2/142: rename d1/d2b/d25 to d1/d2/d32 0 2024-09-19T09:02:49.493 INFO:tasks.workunit.client.0.smithi049.stdout:5/129: creat d3/d5/d1c/f2b x:0 0 0 2024-09-19T09:02:49.499 INFO:tasks.workunit.client.0.smithi049.stdout:8/262: dread d1/d27/f36 [0,4194304] 0 2024-09-19T09:02:49.501 INFO:tasks.workunit.client.0.smithi049.stdout:8/263: write d1/d27/f47 [1107256,124440] 0 2024-09-19T09:02:49.505 INFO:tasks.workunit.client.0.smithi049.stdout:5/130: symlink d3/d5/l2c 0 2024-09-19T09:02:49.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/131: dread d3/d5/f1f [0,4194304] 0 2024-09-19T09:02:49.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/143: mknod d1/d4/d20/d26/c33 0 2024-09-19T09:02:49.517 INFO:tasks.workunit.client.0.smithi049.stdout:5/132: mkdir d3/d5/d1c/d2d 0 2024-09-19T09:02:49.524 INFO:tasks.workunit.client.0.smithi049.stdout:2/144: dwrite d1/f7 [0,4194304] 0 2024-09-19T09:02:49.525 INFO:tasks.workunit.client.0.smithi049.stdout:2/145: chown d1/d4/f1f 1513 1 2024-09-19T09:02:49.525 INFO:tasks.workunit.client.0.smithi049.stdout:2/146: readlink d1/d4/d20/l31 0 2024-09-19T09:02:49.547 INFO:tasks.workunit.client.0.smithi049.stdout:6/133: sync 2024-09-19T09:02:49.550 INFO:tasks.workunit.client.1.smithi102.stdout:2/829: getdents d7/d1a/d2b/d31 0 2024-09-19T09:02:49.551 INFO:tasks.workunit.client.1.smithi102.stdout:7/961: creat d1/d2f/d103/f131 x:0 0 0 2024-09-19T09:02:49.553 INFO:tasks.workunit.client.0.smithi049.stdout:6/134: rename dc/fd to dc/d12/f29 0 2024-09-19T09:02:49.561 INFO:tasks.workunit.client.1.smithi102.stdout:7/962: link d1/d3/d20/dad/dcd/f108 d1/d3/d72/f132 0 2024-09-19T09:02:49.562 INFO:tasks.workunit.client.1.smithi102.stdout:9/915: dwrite d1/d2/d3/d1d/d4f/d6d/db4/fe1 [0,4194304] 0 2024-09-19T09:02:49.564 INFO:tasks.workunit.client.1.smithi102.stdout:2/830: dwrite d7/d1a/d2b/d31/d51/f55 [0,4194304] 0 2024-09-19T09:02:49.569 INFO:tasks.workunit.client.1.smithi102.stdout:2/831: creat d7/d1a/d56/f121 x:0 0 0 2024-09-19T09:02:49.569 INFO:tasks.workunit.client.0.smithi049.stdout:6/135: dread f9 [0,4194304] 0 2024-09-19T09:02:49.571 INFO:tasks.workunit.client.1.smithi102.stdout:2/832: write d7/d1a/d2b/d31/d106/daf/f9d [8580090,80009] 0 2024-09-19T09:02:49.578 INFO:tasks.workunit.client.1.smithi102.stdout:2/833: creat d7/d11/dc8/f122 x:0 0 0 2024-09-19T09:02:49.579 INFO:tasks.workunit.client.0.smithi049.stdout:6/136: symlink dc/l2a 0 2024-09-19T09:02:49.579 INFO:tasks.workunit.client.0.smithi049.stdout:6/137: chown l2 50394114 1 2024-09-19T09:02:49.579 INFO:tasks.workunit.client.0.smithi049.stdout:6/138: fdatasync f0 0 2024-09-19T09:02:49.580 INFO:tasks.workunit.client.1.smithi102.stdout:2/834: creat d7/d11/f123 x:0 0 0 2024-09-19T09:02:49.580 INFO:tasks.workunit.client.0.smithi049.stdout:6/139: fdatasync f0 0 2024-09-19T09:02:49.593 INFO:tasks.workunit.client.1.smithi102.stdout:5/920: write d5/d7/d1a/f74 [3536498,98735] 0 2024-09-19T09:02:49.594 INFO:tasks.workunit.client.1.smithi102.stdout:5/921: write d5/d60/f85 [3254575,13927] 0 2024-09-19T09:02:49.603 INFO:tasks.workunit.client.1.smithi102.stdout:1/889: sync 2024-09-19T09:02:49.606 INFO:tasks.workunit.client.1.smithi102.stdout:6/844: rename d1/d18/c97 to d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/de8/c11c 0 2024-09-19T09:02:49.606 INFO:tasks.workunit.client.1.smithi102.stdout:6/845: stat d1/c61 0 2024-09-19T09:02:49.608 INFO:tasks.workunit.client.1.smithi102.stdout:8/836: rename d0/d10/d21/d39/d87/fab to d0/db/d104/d106/f117 0 2024-09-19T09:02:49.609 INFO:tasks.workunit.client.1.smithi102.stdout:6/846: mkdir d1/d26/d2e/d45/d47/d4d/d11d 0 2024-09-19T09:02:49.610 INFO:tasks.workunit.client.1.smithi102.stdout:2/835: rename d7/d50/d64/da1/d115/lb5 to d7/d50/d64/da1/dd6/l124 0 2024-09-19T09:02:49.612 INFO:tasks.workunit.client.1.smithi102.stdout:8/837: creat d0/d64/d10c/f118 x:0 0 0 2024-09-19T09:02:49.613 INFO:tasks.workunit.client.1.smithi102.stdout:6/847: truncate d1/d26/d4b/d94/d8a/f80 1639440 0 2024-09-19T09:02:49.614 INFO:tasks.workunit.client.0.smithi049.stdout:8/264: truncate d1/f3d 3764654 0 2024-09-19T09:02:49.615 INFO:tasks.workunit.client.0.smithi049.stdout:8/265: write d1/d11/d2e/d3c/f49 [352068,127040] 0 2024-09-19T09:02:49.615 INFO:tasks.workunit.client.1.smithi102.stdout:6/848: read - d1/d3a/f110 zero size 2024-09-19T09:02:49.617 INFO:tasks.workunit.client.1.smithi102.stdout:2/836: dwrite d7/d50/d64/da1/d115/f17 [12582912,4194304] 0 2024-09-19T09:02:49.619 INFO:tasks.workunit.client.0.smithi049.stdout:8/266: dread d1/d27/f47 [0,4194304] 0 2024-09-19T09:02:49.622 INFO:tasks.workunit.client.1.smithi102.stdout:8/838: link d0/d10/d9b/fc4 d0/d10/d21/d39/d50/d63/d83/dd9/f119 0 2024-09-19T09:02:49.624 INFO:tasks.workunit.client.0.smithi049.stdout:5/133: write d3/f10 [667965,97025] 0 2024-09-19T09:02:49.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/134: write d3/f8 [1419098,32814] 0 2024-09-19T09:02:49.627 INFO:tasks.workunit.client.0.smithi049.stdout:5/135: chown d3/d5/d20/l29 2588785 1 2024-09-19T09:02:49.635 INFO:tasks.workunit.client.0.smithi049.stdout:6/140: rmdir dc/d12 39 2024-09-19T09:02:49.636 INFO:tasks.workunit.client.1.smithi102.stdout:5/922: creat d5/d7/d1a/d37/d34/f11a x:0 0 0 2024-09-19T09:02:49.637 INFO:tasks.workunit.client.1.smithi102.stdout:8/839: rename d0/d10/d21/f24 to d0/d10/d21/d39/d87/f11a 0 2024-09-19T09:02:49.639 INFO:tasks.workunit.client.1.smithi102.stdout:5/923: mkdir d5/d7/d1a/d11b 0 2024-09-19T09:02:49.641 INFO:tasks.workunit.client.1.smithi102.stdout:8/840: rename d0/d10/d21/fe9 to d0/db/d84/f11b 0 2024-09-19T09:02:49.642 INFO:tasks.workunit.client.1.smithi102.stdout:8/841: truncate d0/d10/d21/d39/d87/f116 906137 0 2024-09-19T09:02:49.643 INFO:tasks.workunit.client.0.smithi049.stdout:6/141: dread dc/d12/f29 [0,4194304] 0 2024-09-19T09:02:49.643 INFO:tasks.workunit.client.1.smithi102.stdout:8/842: stat d0/db/d1d/f8d 0 2024-09-19T09:02:49.643 INFO:tasks.workunit.client.1.smithi102.stdout:2/837: dread d7/fcd [0,4194304] 0 2024-09-19T09:02:49.644 INFO:tasks.workunit.client.0.smithi049.stdout:6/142: unlink dc/c24 0 2024-09-19T09:02:49.645 INFO:tasks.workunit.client.1.smithi102.stdout:8/843: fdatasync d0/d10/d21/d39/d50/d63/fb9 0 2024-09-19T09:02:49.646 INFO:tasks.workunit.client.1.smithi102.stdout:2/838: mknod d7/d1a/d2b/dab/de2/df7/c125 0 2024-09-19T09:02:49.648 INFO:tasks.workunit.client.1.smithi102.stdout:2/839: chown d7/d11/cbc 7191444 1 2024-09-19T09:02:49.648 INFO:tasks.workunit.client.0.smithi049.stdout:6/143: unlink dc/l1c 0 2024-09-19T09:02:49.648 INFO:tasks.workunit.client.0.smithi049.stdout:6/144: fsync f0 0 2024-09-19T09:02:49.648 INFO:tasks.workunit.client.1.smithi102.stdout:9/916: dwrite d1/d8/f56 [0,4194304] 0 2024-09-19T09:02:49.650 INFO:tasks.workunit.client.1.smithi102.stdout:2/840: chown d7/d11/c10b 43987 1 2024-09-19T09:02:49.650 INFO:tasks.workunit.client.1.smithi102.stdout:7/963: truncate d1/d3/d34/d4f/fe5 1148778 0 2024-09-19T09:02:49.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/145: rename l5 to dc/d12/l2b 0 2024-09-19T09:02:49.653 INFO:tasks.workunit.client.1.smithi102.stdout:7/964: read d1/d4/d9c/f62 [7051,91199] 0 2024-09-19T09:02:49.653 INFO:tasks.workunit.client.1.smithi102.stdout:9/917: rename d1/f5c to d1/d2/d3/d6f/d8d/f12d 0 2024-09-19T09:02:49.656 INFO:tasks.workunit.client.1.smithi102.stdout:8/844: dwrite d0/db/d1d/f107 [0,4194304] 0 2024-09-19T09:02:49.657 INFO:tasks.workunit.client.1.smithi102.stdout:8/845: dread - d0/db/d1d/f105 zero size 2024-09-19T09:02:49.660 INFO:tasks.workunit.client.1.smithi102.stdout:2/841: symlink d7/d1a/d2b/dae/l126 0 2024-09-19T09:02:49.660 INFO:tasks.workunit.client.1.smithi102.stdout:8/846: read d0/fd [6377504,16048] 0 2024-09-19T09:02:49.660 INFO:tasks.workunit.client.1.smithi102.stdout:7/965: mkdir d1/d4/dca/d52/d7f/da5/de6/d133 0 2024-09-19T09:02:49.661 INFO:tasks.workunit.client.1.smithi102.stdout:7/966: write d1/d3/d72/f109 [115699,71470] 0 2024-09-19T09:02:49.662 INFO:tasks.workunit.client.0.smithi049.stdout:0/294: creat d5/d10/f5c x:0 0 0 2024-09-19T09:02:49.663 INFO:tasks.workunit.client.0.smithi049.stdout:0/295: fdatasync d5/d10/d13/f4f 0 2024-09-19T09:02:49.665 INFO:tasks.workunit.client.0.smithi049.stdout:0/296: write d5/d10/d13/d15/d36/f41 [94827,98890] 0 2024-09-19T09:02:49.665 INFO:tasks.workunit.client.0.smithi049.stdout:7/300: creat d1/f68 x:0 0 0 2024-09-19T09:02:49.666 INFO:tasks.workunit.client.0.smithi049.stdout:7/301: dread - d1/d8/d2d/d31/f47 zero size 2024-09-19T09:02:49.667 INFO:tasks.workunit.client.1.smithi102.stdout:2/842: stat d7/d1a/d2b/d31/d51/d6b/laa 0 2024-09-19T09:02:49.668 INFO:tasks.workunit.client.1.smithi102.stdout:8/847: mkdir d0/db/d29/d11c 0 2024-09-19T09:02:49.670 INFO:tasks.workunit.client.1.smithi102.stdout:7/967: rmdir d1/d4/dca/d52/d7f/da5/de6 39 2024-09-19T09:02:49.672 INFO:tasks.workunit.client.0.smithi049.stdout:0/297: dwrite d5/d10/d13/d15/f18 [0,4194304] 0 2024-09-19T09:02:49.673 INFO:tasks.workunit.client.1.smithi102.stdout:9/918: creat d1/d2/d3/d6f/d8d/da2/db6/d11a/f12e x:0 0 0 2024-09-19T09:02:49.675 INFO:tasks.workunit.client.1.smithi102.stdout:2/843: mknod d7/d1a/d2b/d31/d106/d93/c127 0 2024-09-19T09:02:49.676 INFO:tasks.workunit.client.0.smithi049.stdout:7/302: mknod d1/d8/d2d/d31/c69 0 2024-09-19T09:02:49.677 INFO:tasks.workunit.client.1.smithi102.stdout:8/848: mkdir d0/d10/d21/d39/db8/d109/d11d 0 2024-09-19T09:02:49.677 INFO:tasks.workunit.client.1.smithi102.stdout:8/849: readlink d0/d4f/l6a 0 2024-09-19T09:02:49.678 INFO:tasks.workunit.client.0.smithi049.stdout:0/298: unlink d5/d10/l45 0 2024-09-19T09:02:49.679 INFO:tasks.workunit.client.0.smithi049.stdout:0/299: fdatasync d5/d10/d2f/f39 0 2024-09-19T09:02:49.679 INFO:tasks.workunit.client.0.smithi049.stdout:0/300: chown d5/fa 44 1 2024-09-19T09:02:49.682 INFO:tasks.workunit.client.0.smithi049.stdout:7/303: mknod d1/d8/d2d/c6a 0 2024-09-19T09:02:49.682 INFO:tasks.workunit.client.0.smithi049.stdout:7/304: chown d1/d53/f5d 30 1 2024-09-19T09:02:49.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/301: dread d5/f58 [0,4194304] 0 2024-09-19T09:02:49.688 INFO:tasks.workunit.client.1.smithi102.stdout:8/850: mknod d0/db/d29/db5/c11e 0 2024-09-19T09:02:49.690 INFO:tasks.workunit.client.0.smithi049.stdout:7/305: dread d1/d1a/f41 [0,4194304] 0 2024-09-19T09:02:49.694 INFO:tasks.workunit.client.1.smithi102.stdout:1/890: dwrite dd/d14/dac/fb5 [0,4194304] 0 2024-09-19T09:02:49.695 INFO:tasks.workunit.client.1.smithi102.stdout:8/851: unlink d0/db/d29/f72 0 2024-09-19T09:02:49.696 INFO:tasks.workunit.client.1.smithi102.stdout:9/919: dread d1/d2/d3/d1d/f49 [0,4194304] 0 2024-09-19T09:02:49.697 INFO:tasks.workunit.client.1.smithi102.stdout:8/852: chown d0/db/d1d/l99 61901757 1 2024-09-19T09:02:49.697 INFO:tasks.workunit.client.0.smithi049.stdout:7/306: dwrite d1/d8/fb [0,4194304] 0 2024-09-19T09:02:49.698 INFO:tasks.workunit.client.0.smithi049.stdout:7/307: write d1/d53/f5d [902211,36641] 0 2024-09-19T09:02:49.699 INFO:tasks.workunit.client.0.smithi049.stdout:7/308: dread - d1/d8/d2d/d31/f47 zero size 2024-09-19T09:02:49.706 INFO:tasks.workunit.client.1.smithi102.stdout:9/920: creat d1/d2/d3/d1d/d4f/f12f x:0 0 0 2024-09-19T09:02:49.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/309: dwrite d1/d53/d18/d59/f35 [0,4194304] 0 2024-09-19T09:02:49.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/310: chown d1 4204 1 2024-09-19T09:02:49.711 INFO:tasks.workunit.client.1.smithi102.stdout:8/853: symlink d0/d10/d21/l11f 0 2024-09-19T09:02:49.716 INFO:tasks.workunit.client.0.smithi049.stdout:7/311: truncate d1/d8/d2d/f5a 191157 0 2024-09-19T09:02:49.717 INFO:tasks.workunit.client.1.smithi102.stdout:1/891: creat dd/d7a/d8c/d8e/d103/f122 x:0 0 0 2024-09-19T09:02:49.718 INFO:tasks.workunit.client.1.smithi102.stdout:8/854: creat d0/d10/d21/d39/f120 x:0 0 0 2024-09-19T09:02:49.719 INFO:tasks.workunit.client.0.smithi049.stdout:8/267: dwrite d1/d11/f12 [0,4194304] 0 2024-09-19T09:02:49.719 INFO:tasks.workunit.client.0.smithi049.stdout:5/136: dwrite d3/d5/de/d12/f13 [4194304,4194304] 0 2024-09-19T09:02:49.720 INFO:tasks.workunit.client.1.smithi102.stdout:6/849: getdents d1/d26/d2e/d45/d47/d4d/d35/d79 0 2024-09-19T09:02:49.722 INFO:tasks.workunit.client.1.smithi102.stdout:8/855: dread d0/db/d1d/f107 [0,4194304] 0 2024-09-19T09:02:49.724 INFO:tasks.workunit.client.1.smithi102.stdout:5/924: stat d5/d7/d1a/d37 0 2024-09-19T09:02:49.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/146: rmdir dc 39 2024-09-19T09:02:49.728 INFO:tasks.workunit.client.1.smithi102.stdout:9/921: truncate d1/d2/f37 1616119 0 2024-09-19T09:02:49.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/312: dwrite d1/d7/f14 [0,4194304] 0 2024-09-19T09:02:49.732 INFO:tasks.workunit.client.1.smithi102.stdout:1/892: mkdir dd/d14/d35/d49/d7d/d123 0 2024-09-19T09:02:49.734 INFO:tasks.workunit.client.0.smithi049.stdout:8/268: mkdir d1/d11/d2e/d4e 0 2024-09-19T09:02:49.738 INFO:tasks.workunit.client.1.smithi102.stdout:6/850: read d1/d18/db/f90 [136646,110210] 0 2024-09-19T09:02:49.739 INFO:tasks.workunit.client.1.smithi102.stdout:6/851: chown d1/d26/d2e/d45/d47/d4d/d35/d41/da4/d10c 217014086 1 2024-09-19T09:02:49.739 INFO:tasks.workunit.client.1.smithi102.stdout:8/856: mkdir d0/d10/d9b/d121 0 2024-09-19T09:02:49.742 INFO:tasks.workunit.client.0.smithi049.stdout:8/269: mkdir d1/d11/d4f 0 2024-09-19T09:02:49.743 INFO:tasks.workunit.client.0.smithi049.stdout:8/270: fdatasync d1/d11/f3a 0 2024-09-19T09:02:49.744 INFO:tasks.workunit.client.0.smithi049.stdout:8/271: write d1/d27/f36 [2997952,71439] 0 2024-09-19T09:02:49.745 INFO:tasks.workunit.client.0.smithi049.stdout:8/272: read d1/d27/f47 [878833,97707] 0 2024-09-19T09:02:49.746 INFO:tasks.workunit.client.0.smithi049.stdout:5/137: dread d3/d5/fb [0,4194304] 0 2024-09-19T09:02:49.747 INFO:tasks.workunit.client.0.smithi049.stdout:7/313: truncate d1/d53/d18/d59/f29 573855 0 2024-09-19T09:02:49.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/273: creat d1/d11/d2e/d3c/f50 x:0 0 0 2024-09-19T09:02:49.753 INFO:tasks.workunit.client.1.smithi102.stdout:7/968: dwrite d1/d2d/f97 [0,4194304] 0 2024-09-19T09:02:49.753 INFO:tasks.workunit.client.0.smithi049.stdout:7/314: mkdir d1/d53/d18/d50/d58/d62/d6b 0 2024-09-19T09:02:49.758 INFO:tasks.workunit.client.1.smithi102.stdout:2/844: write d7/fcd [2628434,31776] 0 2024-09-19T09:02:49.758 INFO:tasks.workunit.client.1.smithi102.stdout:8/857: creat d0/d4f/daa/db0/f122 x:0 0 0 2024-09-19T09:02:49.758 INFO:tasks.workunit.client.1.smithi102.stdout:8/858: chown d0/db/d29/db5 4298772 1 2024-09-19T09:02:49.758 INFO:tasks.workunit.client.1.smithi102.stdout:2/845: truncate d7/d11/f123 172701 0 2024-09-19T09:02:49.758 INFO:tasks.workunit.client.1.smithi102.stdout:2/846: read - d7/d1a/d56/db9/f119 zero size 2024-09-19T09:02:49.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/302: truncate d5/d10/d2f/f59 359395 0 2024-09-19T09:02:49.759 INFO:tasks.workunit.client.1.smithi102.stdout:2/847: stat d7/d50/d64/d7f/d83/c96 0 2024-09-19T09:02:49.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/274: mknod d1/d11/d2e/d3c/c51 0 2024-09-19T09:02:49.761 INFO:tasks.workunit.client.0.smithi049.stdout:8/275: truncate d1/f14 2664074 0 2024-09-19T09:02:49.762 INFO:tasks.workunit.client.1.smithi102.stdout:7/969: symlink d1/d3/d20/d6c/l134 0 2024-09-19T09:02:49.762 INFO:tasks.workunit.client.1.smithi102.stdout:6/852: dread d1/d26/d2e/d45/daf/d8d/f9c [0,4194304] 0 2024-09-19T09:02:49.763 INFO:tasks.workunit.client.0.smithi049.stdout:7/315: rmdir d1/d53/d18/d59 39 2024-09-19T09:02:49.763 INFO:tasks.workunit.client.1.smithi102.stdout:1/893: dread f6 [4194304,4194304] 0 2024-09-19T09:02:49.764 INFO:tasks.workunit.client.1.smithi102.stdout:7/970: write d1/d3/d20/dad/f128 [369519,29216] 0 2024-09-19T09:02:49.764 INFO:tasks.workunit.client.1.smithi102.stdout:9/922: link d1/d2/d78/da0/dc0/l126 d1/d2/d3/d6f/d8d/da2/d106/d10e/d111/l130 0 2024-09-19T09:02:49.764 INFO:tasks.workunit.client.0.smithi049.stdout:6/147: link c1 dc/d16/c2c 0 2024-09-19T09:02:49.765 INFO:tasks.workunit.client.1.smithi102.stdout:9/923: chown d1/d2/d3/d6f/dcb/ff6 8999982 1 2024-09-19T09:02:49.766 INFO:tasks.workunit.client.0.smithi049.stdout:6/148: chown dc/l10 1438 1 2024-09-19T09:02:49.766 INFO:tasks.workunit.client.0.smithi049.stdout:0/303: dwrite d5/d10/d13/f1c [0,4194304] 0 2024-09-19T09:02:49.767 INFO:tasks.workunit.client.0.smithi049.stdout:8/276: mknod d1/d11/d2e/d3c/c52 0 2024-09-19T09:02:49.769 INFO:tasks.workunit.client.0.smithi049.stdout:7/316: dread d1/d53/f5d [0,4194304] 0 2024-09-19T09:02:49.769 INFO:tasks.workunit.client.1.smithi102.stdout:2/848: chown d7/d50/d64/da1/d115/f5d 10 1 2024-09-19T09:02:49.770 INFO:tasks.workunit.client.0.smithi049.stdout:7/317: chown d1/d53/d18/c49 410646 1 2024-09-19T09:02:49.771 INFO:tasks.workunit.client.1.smithi102.stdout:6/853: creat d1/d26/d2e/d45/daf/d8d/f11e x:0 0 0 2024-09-19T09:02:49.778 INFO:tasks.workunit.client.1.smithi102.stdout:8/859: dread d0/d10/d21/db3/fdc [0,4194304] 0 2024-09-19T09:02:49.779 INFO:tasks.workunit.client.0.smithi049.stdout:8/277: rename d1/d27/f47 to d1/d27/f53 0 2024-09-19T09:02:49.780 INFO:tasks.workunit.client.1.smithi102.stdout:9/924: write d1/d2/d3/d6f/d8d/da2/d106/d10e/f119 [700539,105306] 0 2024-09-19T09:02:49.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/318: stat d1/d8/d2d/l61 0 2024-09-19T09:02:49.785 INFO:tasks.workunit.client.1.smithi102.stdout:1/894: rename dd/d7a/d8c/d8e/d103/d78/fa7 to dd/d5f/f124 0 2024-09-19T09:02:49.785 INFO:tasks.workunit.client.0.smithi049.stdout:0/304: mknod d5/d10/d2f/d52/c5d 0 2024-09-19T09:02:49.788 INFO:tasks.workunit.client.1.smithi102.stdout:5/925: dwrite d5/d7/d1a/d37/d50/f57 [0,4194304] 0 2024-09-19T09:02:49.790 INFO:tasks.workunit.client.1.smithi102.stdout:8/860: mknod d0/db/d104/c123 0 2024-09-19T09:02:49.791 INFO:tasks.workunit.client.1.smithi102.stdout:2/849: mknod d7/d1a/d2b/d31/d111/c128 0 2024-09-19T09:02:49.792 INFO:tasks.workunit.client.1.smithi102.stdout:1/895: dwrite dd/d14/d35/d49/fec [0,4194304] 0 2024-09-19T09:02:49.803 INFO:tasks.workunit.client.1.smithi102.stdout:5/926: chown d5/d7/d1a/d42/c8e 1493837361 1 2024-09-19T09:02:49.804 INFO:tasks.workunit.client.0.smithi049.stdout:0/305: creat d5/d10/d13/d15/d29/f5e x:0 0 0 2024-09-19T09:02:49.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/278: dread d1/d1a/f3b [0,4194304] 0 2024-09-19T09:02:49.810 INFO:tasks.workunit.client.1.smithi102.stdout:7/971: dwrite d1/d4/f63 [0,4194304] 0 2024-09-19T09:02:49.811 INFO:tasks.workunit.client.0.smithi049.stdout:8/279: readlink d1/la 0 2024-09-19T09:02:49.811 INFO:tasks.workunit.client.1.smithi102.stdout:5/927: creat d5/d7b/ddd/f11c x:0 0 0 2024-09-19T09:02:49.812 INFO:tasks.workunit.client.1.smithi102.stdout:1/896: read dd/d5f/f7c [3085941,68881] 0 2024-09-19T09:02:49.814 INFO:tasks.workunit.client.1.smithi102.stdout:1/897: chown dd/d14/d35/d49/dcb/f6e 6862 1 2024-09-19T09:02:49.814 INFO:tasks.workunit.client.1.smithi102.stdout:8/861: rename d0/d10/cda to d0/d4f/daa/db0/c124 0 2024-09-19T09:02:49.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/306: dwrite d5/d10/d13/f42 [0,4194304] 0 2024-09-19T09:02:49.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/149: dwrite dc/ff [0,4194304] 0 2024-09-19T09:02:49.820 INFO:tasks.workunit.client.1.smithi102.stdout:6/854: getdents d1/d26/d4b/d94/da2 0 2024-09-19T09:02:49.823 INFO:tasks.workunit.client.0.smithi049.stdout:7/319: write d1/d1a/f21 [1217420,90463] 0 2024-09-19T09:02:49.824 INFO:tasks.workunit.client.0.smithi049.stdout:7/320: write d1/d7/f4c [733363,56751] 0 2024-09-19T09:02:49.825 INFO:tasks.workunit.client.1.smithi102.stdout:5/928: creat d5/d23/f11d x:0 0 0 2024-09-19T09:02:49.826 INFO:tasks.workunit.client.0.smithi049.stdout:7/321: dread d1/d8/d2d/f5a [0,4194304] 0 2024-09-19T09:02:49.828 INFO:tasks.workunit.client.0.smithi049.stdout:0/307: fsync d5/d10/d13/d15/d29/f5e 0 2024-09-19T09:02:49.828 INFO:tasks.workunit.client.1.smithi102.stdout:8/862: chown d0/d10/fb4 20093001 1 2024-09-19T09:02:49.829 INFO:tasks.workunit.client.0.smithi049.stdout:6/150: chown dc/d16/c2c 1481902 1 2024-09-19T09:02:49.830 INFO:tasks.workunit.client.1.smithi102.stdout:9/925: truncate d1/d8/d1c/f99 2660263 0 2024-09-19T09:02:49.832 INFO:tasks.workunit.client.1.smithi102.stdout:6/855: truncate d1/d26/d2e/fc4 354776 0 2024-09-19T09:02:49.833 INFO:tasks.workunit.client.1.smithi102.stdout:9/926: read d1/d2/d3/d1d/f49 [2320890,51868] 0 2024-09-19T09:02:49.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/322: rename d1/d8/d2d/d36/f5c to d1/d8/f6c 0 2024-09-19T09:02:49.836 INFO:tasks.workunit.client.1.smithi102.stdout:2/850: dwrite d7/d50/d64/d7f/d83/dc7/fef [0,4194304] 0 2024-09-19T09:02:49.837 INFO:tasks.workunit.client.1.smithi102.stdout:2/851: stat d7/d1a/d56/cc2 0 2024-09-19T09:02:49.838 INFO:tasks.workunit.client.0.smithi049.stdout:0/308: rmdir d5/d10/d13/d15/d36/d3d 39 2024-09-19T09:02:49.840 INFO:tasks.workunit.client.1.smithi102.stdout:8/863: creat d0/db/d29/f125 x:0 0 0 2024-09-19T09:02:49.842 INFO:tasks.workunit.client.0.smithi049.stdout:6/151: creat dc/d16/f2d x:0 0 0 2024-09-19T09:02:49.842 INFO:tasks.workunit.client.1.smithi102.stdout:6/856: chown d1/d18/fc0 1706625 1 2024-09-19T09:02:49.845 INFO:tasks.workunit.client.1.smithi102.stdout:9/927: mknod d1/df3/c131 0 2024-09-19T09:02:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/309: creat d5/d10/d13/d30/f5f x:0 0 0 2024-09-19T09:02:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:6/152: write dc/f19 [161316,105498] 0 2024-09-19T09:02:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/280: dwrite d1/d1a/f29 [0,4194304] 0 2024-09-19T09:02:49.852 INFO:tasks.workunit.client.1.smithi102.stdout:8/864: rename d0/db/d1d/f7d to d0/d10/d9b/f126 0 2024-09-19T09:02:49.855 INFO:tasks.workunit.client.1.smithi102.stdout:6/857: readlink d1/d26/d4b/l119 0 2024-09-19T09:02:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:7/323: dwrite d1/d8/f54 [0,4194304] 0 2024-09-19T09:02:49.859 INFO:tasks.workunit.client.1.smithi102.stdout:8/865: dwrite d0/db/d29/db5/fd1 [0,4194304] 0 2024-09-19T09:02:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/324: write d1/d1a/f41 [1481875,20823] 0 2024-09-19T09:02:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/153: dwrite dc/f19 [4194304,4194304] 0 2024-09-19T09:02:49.863 INFO:tasks.workunit.client.0.smithi049.stdout:6/154: chown dc/d16/l1f 26559697 1 2024-09-19T09:02:49.863 INFO:tasks.workunit.client.0.smithi049.stdout:0/310: write d5/d10/d13/d15/d36/d3d/f33 [3350891,6922] 0 2024-09-19T09:02:49.865 INFO:tasks.workunit.client.1.smithi102.stdout:7/972: dwrite d1/d2f/f56 [4194304,4194304] 0 2024-09-19T09:02:49.865 INFO:tasks.workunit.client.0.smithi049.stdout:8/281: symlink d1/l54 0 2024-09-19T09:02:49.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/325: symlink d1/d53/d18/d50/d58/l6d 0 2024-09-19T09:02:49.867 INFO:tasks.workunit.client.1.smithi102.stdout:1/898: getdents dd/d7a/d8c/d8e/d103 0 2024-09-19T09:02:49.868 INFO:tasks.workunit.client.0.smithi049.stdout:8/282: write d1/d27/f41 [319309,96138] 0 2024-09-19T09:02:49.870 INFO:tasks.workunit.client.1.smithi102.stdout:6/858: symlink d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/l11f 0 2024-09-19T09:02:49.872 INFO:tasks.workunit.client.1.smithi102.stdout:5/929: write d5/d7/d1a/d37/f45 [1213698,28377] 0 2024-09-19T09:02:49.874 INFO:tasks.workunit.client.1.smithi102.stdout:2/852: write d7/d1a/d2b/d31/d106/daf/f73 [817301,81071] 0 2024-09-19T09:02:49.875 INFO:tasks.workunit.client.0.smithi049.stdout:7/326: fdatasync d1/d53/d18/d59/f48 0 2024-09-19T09:02:49.875 INFO:tasks.workunit.client.0.smithi049.stdout:8/283: dread d1/f39 [0,4194304] 0 2024-09-19T09:02:49.877 INFO:tasks.workunit.client.1.smithi102.stdout:8/866: rmdir d0/db/d104/d106 39 2024-09-19T09:02:49.884 INFO:tasks.workunit.client.0.smithi049.stdout:7/327: mkdir d1/d8/d2d/d31/d6e 0 2024-09-19T09:02:49.885 INFO:tasks.workunit.client.0.smithi049.stdout:7/328: fsync d1/d7/fa 0 2024-09-19T09:02:49.886 INFO:tasks.workunit.client.0.smithi049.stdout:7/329: write d1/f68 [230643,100085] 0 2024-09-19T09:02:49.889 INFO:tasks.workunit.client.1.smithi102.stdout:2/853: readlink d7/d50/d64/d7f/l114 0 2024-09-19T09:02:49.891 INFO:tasks.workunit.client.0.smithi049.stdout:8/284: link d1/d1a/f29 d1/d11/d2e/d3c/f55 0 2024-09-19T09:02:49.891 INFO:tasks.workunit.client.0.smithi049.stdout:0/311: dread d5/fa [0,4194304] 0 2024-09-19T09:02:49.891 INFO:tasks.workunit.client.1.smithi102.stdout:8/867: mkdir d0/d10/d21/d39/d50/da2/d127 0 2024-09-19T09:02:49.892 INFO:tasks.workunit.client.1.smithi102.stdout:8/868: chown d0/d10/d21/d39/d50/c75 23287 1 2024-09-19T09:02:49.893 INFO:tasks.workunit.client.1.smithi102.stdout:8/869: write d0/db/d1d/f105 [213733,89817] 0 2024-09-19T09:02:49.893 INFO:tasks.workunit.client.0.smithi049.stdout:0/312: dread d5/d10/d13/d30/f49 [0,4194304] 0 2024-09-19T09:02:49.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/173: sync 2024-09-19T09:02:49.895 INFO:tasks.workunit.client.0.smithi049.stdout:4/199: sync 2024-09-19T09:02:49.895 INFO:tasks.workunit.client.0.smithi049.stdout:3/262: sync 2024-09-19T09:02:49.895 INFO:tasks.workunit.client.0.smithi049.stdout:2/147: sync 2024-09-19T09:02:49.895 INFO:tasks.workunit.client.0.smithi049.stdout:9/219: sync 2024-09-19T09:02:49.896 INFO:tasks.workunit.client.1.smithi102.stdout:7/973: write d1/f125 [321268,81619] 0 2024-09-19T09:02:49.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/148: readlink d1/d4/d20/l27 0 2024-09-19T09:02:49.897 INFO:tasks.workunit.client.0.smithi049.stdout:3/263: truncate d10/f48 867622 0 2024-09-19T09:02:49.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/149: dread - d1/d4/d1e/f2f zero size 2024-09-19T09:02:49.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/150: dread - d1/d2/f24 zero size 2024-09-19T09:02:49.901 INFO:tasks.workunit.client.1.smithi102.stdout:9/928: getdents d1/d2/d3/d6f/dcb 0 2024-09-19T09:02:49.903 INFO:tasks.workunit.client.1.smithi102.stdout:5/930: mknod d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/d116/c11e 0 2024-09-19T09:02:49.904 INFO:tasks.workunit.client.0.smithi049.stdout:9/220: chown d3/l4 160994 1 2024-09-19T09:02:49.905 INFO:tasks.workunit.client.0.smithi049.stdout:9/221: write d3/d14/f3f [401481,89414] 0 2024-09-19T09:02:49.906 INFO:tasks.workunit.client.1.smithi102.stdout:2/854: symlink d7/d1a/d2b/dab/l129 0 2024-09-19T09:02:49.906 INFO:tasks.workunit.client.1.smithi102.stdout:1/899: truncate dd/d14/d35/d49/d7d/d7f/f8b 3794340 0 2024-09-19T09:02:49.907 INFO:tasks.workunit.client.0.smithi049.stdout:4/200: mkdir d4/d34/d3b 0 2024-09-19T09:02:49.910 INFO:tasks.workunit.client.0.smithi049.stdout:1/174: rename d5/d6/dc/f29 to d5/f36 0 2024-09-19T09:02:49.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/285: truncate d1/d1a/f3b 404428 0 2024-09-19T09:02:49.912 INFO:tasks.workunit.client.0.smithi049.stdout:0/313: symlink d5/d10/d13/l60 0 2024-09-19T09:02:49.913 INFO:tasks.workunit.client.1.smithi102.stdout:6/859: dwrite d1/d26/d2e/d45/d47/d4d/f33 [4194304,4194304] 0 2024-09-19T09:02:49.913 INFO:tasks.workunit.client.1.smithi102.stdout:6/860: stat d1/d26/d2e/d45/daf/l5a 0 2024-09-19T09:02:49.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/151: creat d1/d2/f34 x:0 0 0 2024-09-19T09:02:49.916 INFO:tasks.workunit.client.1.smithi102.stdout:6/861: write d1/d26/d2e/d45/daf/d8d/fe2 [2652570,119223] 0 2024-09-19T09:02:49.916 INFO:tasks.workunit.client.1.smithi102.stdout:9/929: creat d1/d2/d78/f132 x:0 0 0 2024-09-19T09:02:49.917 INFO:tasks.workunit.client.1.smithi102.stdout:8/870: write d0/d10/d21/db3/ffe [1148390,1987] 0 2024-09-19T09:02:49.921 INFO:tasks.workunit.client.1.smithi102.stdout:7/974: write d1/d4/dca/d52/d7f/da5/df2/fdc [341191,17841] 0 2024-09-19T09:02:49.926 INFO:tasks.workunit.client.0.smithi049.stdout:8/286: creat d1/d11/d2e/f56 x:0 0 0 2024-09-19T09:02:49.929 INFO:tasks.workunit.client.1.smithi102.stdout:6/862: symlink d1/d26/d2e/d45/dac/db2/df5/l120 0 2024-09-19T09:02:49.930 INFO:tasks.workunit.client.1.smithi102.stdout:6/863: dread - d1/d26/d2e/d45/daf/f114 zero size 2024-09-19T09:02:49.930 INFO:tasks.workunit.client.0.smithi049.stdout:1/175: dwrite d5/d6/fa [0,4194304] 0 2024-09-19T09:02:49.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/152: creat d1/d2b/f35 x:0 0 0 2024-09-19T09:02:49.932 INFO:tasks.workunit.client.0.smithi049.stdout:2/153: fdatasync d1/d2/d32/f29 0 2024-09-19T09:02:49.935 INFO:tasks.workunit.client.0.smithi049.stdout:7/330: link d1/d53/l15 d1/d53/d18/d50/d58/d62/d6b/l6f 0 2024-09-19T09:02:49.935 INFO:tasks.workunit.client.0.smithi049.stdout:2/154: dread - d1/d2b/f1b zero size 2024-09-19T09:02:49.936 INFO:tasks.workunit.client.1.smithi102.stdout:9/930: mkdir d1/d2/d78/df7/dfe/d133 0 2024-09-19T09:02:49.936 INFO:tasks.workunit.client.0.smithi049.stdout:7/331: write d1/d53/d18/d59/f48 [2304125,36409] 0 2024-09-19T09:02:49.937 INFO:tasks.workunit.client.0.smithi049.stdout:4/201: rmdir d4/d15/d19/d1f 39 2024-09-19T09:02:49.939 INFO:tasks.workunit.client.1.smithi102.stdout:2/855: dwrite d7/d1a/d2b/d31/f3c [0,4194304] 0 2024-09-19T09:02:49.940 INFO:tasks.workunit.client.0.smithi049.stdout:8/287: rmdir d1/d11/d3f 39 2024-09-19T09:02:49.940 INFO:tasks.workunit.client.1.smithi102.stdout:2/856: chown d7/d11/l8b 33336187 1 2024-09-19T09:02:49.942 INFO:tasks.workunit.client.0.smithi049.stdout:0/314: unlink d5/d10/d13/d15/d29/d3b/f4a 0 2024-09-19T09:02:49.942 INFO:tasks.workunit.client.0.smithi049.stdout:0/315: chown l0 0 1 2024-09-19T09:02:49.944 INFO:tasks.workunit.client.1.smithi102.stdout:8/871: write d0/d10/d21/d39/d87/fc5 [728002,79650] 0 2024-09-19T09:02:49.944 INFO:tasks.workunit.client.0.smithi049.stdout:1/176: mknod d5/d6/d19/c37 0 2024-09-19T09:02:49.944 INFO:tasks.workunit.client.1.smithi102.stdout:8/872: readlink d0/d5a/l111 0 2024-09-19T09:02:49.945 INFO:tasks.workunit.client.1.smithi102.stdout:8/873: fdatasync d0/d10/d21/d39/f120 0 2024-09-19T09:02:49.946 INFO:tasks.workunit.client.1.smithi102.stdout:7/975: write d1/d3/d20/d6c/fee [4275757,13989] 0 2024-09-19T09:02:49.947 INFO:tasks.workunit.client.0.smithi049.stdout:0/316: dread d5/d10/d13/d30/f31 [0,4194304] 0 2024-09-19T09:02:49.951 INFO:tasks.workunit.client.1.smithi102.stdout:6/864: dwrite d1/d26/d2e/d45/daf/d8d/f9c [0,4194304] 0 2024-09-19T09:02:49.952 INFO:tasks.workunit.client.1.smithi102.stdout:6/865: write d1/d18/db/f10 [7229115,10034] 0 2024-09-19T09:02:49.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/317: dwrite d5/d10/d13/d15/d36/f3a [0,4194304] 0 2024-09-19T09:02:49.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/318: read d5/f50 [2785940,10821] 0 2024-09-19T09:02:50.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/155: mknod d1/d4/d1e/d21/c36 0 2024-09-19T09:02:50.041 INFO:tasks.workunit.client.0.smithi049.stdout:4/202: rename d4/fc to d4/d35/f3c 0 2024-09-19T09:02:50.042 INFO:tasks.workunit.client.1.smithi102.stdout:5/931: creat d5/d7/d1a/d8f/f11f x:0 0 0 2024-09-19T09:02:50.043 INFO:tasks.workunit.client.0.smithi049.stdout:8/288: rmdir d1/d11 39 2024-09-19T09:02:50.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/156: dwrite d1/f11 [0,4194304] 0 2024-09-19T09:02:50.045 INFO:tasks.workunit.client.1.smithi102.stdout:8/874: rmdir d0/d10/d21/d39/d50/d63 39 2024-09-19T09:02:50.045 INFO:tasks.workunit.client.1.smithi102.stdout:1/900: sync 2024-09-19T09:02:50.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/157: chown d1/d2b/f1a 126202 1 2024-09-19T09:02:50.047 INFO:tasks.workunit.client.1.smithi102.stdout:7/976: unlink d1/d4/c29 0 2024-09-19T09:02:50.050 INFO:tasks.workunit.client.0.smithi049.stdout:1/177: fdatasync d5/d6/f1b 0 2024-09-19T09:02:50.051 INFO:tasks.workunit.client.0.smithi049.stdout:1/178: fsync d5/f20 0 2024-09-19T09:02:50.051 INFO:tasks.workunit.client.1.smithi102.stdout:2/857: write d7/d1a/d56/f5c [577074,3333] 0 2024-09-19T09:02:50.051 INFO:tasks.workunit.client.1.smithi102.stdout:6/866: symlink d1/d26/d2e/d45/d47/d4d/d35/d41/l121 0 2024-09-19T09:02:50.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/319: unlink d5/d10/d13/d30/f5f 0 2024-09-19T09:02:50.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/320: chown d5/ff 12 1 2024-09-19T09:02:50.057 INFO:tasks.workunit.client.0.smithi049.stdout:9/222: getdents d3 0 2024-09-19T09:02:50.058 INFO:tasks.workunit.client.0.smithi049.stdout:9/223: dread - d3/d14/f42 zero size 2024-09-19T09:02:50.058 INFO:tasks.workunit.client.0.smithi049.stdout:9/224: chown d3/lc 33 1 2024-09-19T09:02:50.060 INFO:tasks.workunit.client.0.smithi049.stdout:9/225: write d3/d14/f51 [952165,103695] 0 2024-09-19T09:02:50.061 INFO:tasks.workunit.client.0.smithi049.stdout:9/226: read - d3/d14/d34/d44/f4b zero size 2024-09-19T09:02:50.063 INFO:tasks.workunit.client.1.smithi102.stdout:2/858: truncate d7/f42 87680 0 2024-09-19T09:02:50.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/203: write d4/d15/d19/d1f/f2e [677712,39033] 0 2024-09-19T09:02:50.067 INFO:tasks.workunit.client.0.smithi049.stdout:4/204: chown d4/f24 847134 1 2024-09-19T09:02:50.068 INFO:tasks.workunit.client.1.smithi102.stdout:5/932: dwrite d5/d7/f19 [0,4194304] 0 2024-09-19T09:02:50.069 INFO:tasks.workunit.client.1.smithi102.stdout:8/875: mkdir d0/db/d104/d106/d128 0 2024-09-19T09:02:50.069 INFO:tasks.workunit.client.1.smithi102.stdout:2/859: dread d7/d1a/d56/f5c [0,4194304] 0 2024-09-19T09:02:50.070 INFO:tasks.workunit.client.0.smithi049.stdout:9/227: dwrite d3/d22/f3e [0,4194304] 0 2024-09-19T09:02:50.071 INFO:tasks.workunit.client.0.smithi049.stdout:9/228: stat d3/f1f 0 2024-09-19T09:02:50.073 INFO:tasks.workunit.client.1.smithi102.stdout:6/867: mkdir d1/d26/d2e/d45/d47/d4d/d35/d122 0 2024-09-19T09:02:50.074 INFO:tasks.workunit.client.0.smithi049.stdout:7/332: creat d1/d7/f70 x:0 0 0 2024-09-19T09:02:50.074 INFO:tasks.workunit.client.0.smithi049.stdout:5/138: sync 2024-09-19T09:02:50.076 INFO:tasks.workunit.client.1.smithi102.stdout:9/931: link d1/lac d1/d8/d1c/l134 0 2024-09-19T09:02:50.079 INFO:tasks.workunit.client.0.smithi049.stdout:8/289: truncate d1/f9 353176 0 2024-09-19T09:02:50.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/321: dread d5/d10/d13/d15/d36/d3d/f24 [0,4194304] 0 2024-09-19T09:02:50.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/322: dread - d5/d10/d2f/f39 zero size 2024-09-19T09:02:50.081 INFO:tasks.workunit.client.1.smithi102.stdout:8/876: creat d0/db/d104/d106/f129 x:0 0 0 2024-09-19T09:02:50.082 INFO:tasks.workunit.client.1.smithi102.stdout:7/977: link d1/d3/d34/db4/cb6 d1/d4/dca/d52/d7f/da5/df2/df9/c135 0 2024-09-19T09:02:50.083 INFO:tasks.workunit.client.1.smithi102.stdout:7/978: write d1/f125 [3444564,66132] 0 2024-09-19T09:02:50.085 INFO:tasks.workunit.client.0.smithi049.stdout:9/229: symlink d3/d14/d1a/d21/d31/l52 0 2024-09-19T09:02:50.088 INFO:tasks.workunit.client.0.smithi049.stdout:7/333: write d1/d53/d18/f43 [4851575,81207] 0 2024-09-19T09:02:50.089 INFO:tasks.workunit.client.0.smithi049.stdout:7/334: read - d1/d8/f5e zero size 2024-09-19T09:02:50.089 INFO:tasks.workunit.client.1.smithi102.stdout:9/932: readlink d1/lac 0 2024-09-19T09:02:50.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/205: dread d4/f24 [0,4194304] 0 2024-09-19T09:02:50.095 INFO:tasks.workunit.client.1.smithi102.stdout:2/860: mkdir d7/d11/dc8/dfa/d101/d12a 0 2024-09-19T09:02:50.096 INFO:tasks.workunit.client.0.smithi049.stdout:4/206: chown d4/f30 66 1 2024-09-19T09:02:50.098 INFO:tasks.workunit.client.0.smithi049.stdout:0/323: symlink d5/d10/d13/d15/d36/d3d/l61 0 2024-09-19T09:02:50.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/207: write d4/f13 [3580295,31375] 0 2024-09-19T09:02:50.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/179: creat d5/d6/f38 x:0 0 0 2024-09-19T09:02:50.101 INFO:tasks.workunit.client.0.smithi049.stdout:0/324: write d5/d10/d13/f4f [4603741,124755] 0 2024-09-19T09:02:50.101 INFO:tasks.workunit.client.0.smithi049.stdout:5/139: dread d3/d5/de/f1e [0,4194304] 0 2024-09-19T09:02:50.104 INFO:tasks.workunit.client.1.smithi102.stdout:6/868: symlink d1/l123 0 2024-09-19T09:02:50.105 INFO:tasks.workunit.client.1.smithi102.stdout:5/933: write d5/f15 [1908945,20217] 0 2024-09-19T09:02:50.105 INFO:tasks.workunit.client.1.smithi102.stdout:6/869: stat d1/d26/d2e/d45/d47/d4d/d35/f39 0 2024-09-19T09:02:50.107 INFO:tasks.workunit.client.0.smithi049.stdout:8/290: creat d1/d11/d2e/f57 x:0 0 0 2024-09-19T09:02:50.110 INFO:tasks.workunit.client.1.smithi102.stdout:9/933: symlink d1/d2/d78/df7/dfe/d133/l135 0 2024-09-19T09:02:50.111 INFO:tasks.workunit.client.1.smithi102.stdout:5/934: creat d5/d7b/f120 x:0 0 0 2024-09-19T09:02:50.114 INFO:tasks.workunit.client.0.smithi049.stdout:4/208: unlink d4/d15/d19/f2c 0 2024-09-19T09:02:50.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/180: creat d5/d6/d19/f39 x:0 0 0 2024-09-19T09:02:50.117 INFO:tasks.workunit.client.1.smithi102.stdout:9/934: creat d1/df3/f136 x:0 0 0 2024-09-19T09:02:50.117 INFO:tasks.workunit.client.1.smithi102.stdout:5/935: dwrite d5/d7/d1a/d37/d39/f40 [0,4194304] 0 2024-09-19T09:02:50.117 INFO:tasks.workunit.client.1.smithi102.stdout:5/936: chown d5/d60/dfd 6286310 1 2024-09-19T09:02:50.118 INFO:tasks.workunit.client.0.smithi049.stdout:0/325: mknod d5/d10/d2f/d52/c62 0 2024-09-19T09:02:50.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/140: rmdir d3/d5/d1c 39 2024-09-19T09:02:50.121 INFO:tasks.workunit.client.0.smithi049.stdout:5/141: fdatasync d3/d5/de/f23 0 2024-09-19T09:02:50.125 INFO:tasks.workunit.client.1.smithi102.stdout:6/870: mknod d1/d18/d37/c124 0 2024-09-19T09:02:50.126 INFO:tasks.workunit.client.1.smithi102.stdout:9/935: symlink d1/d2/d3/dd0/l137 0 2024-09-19T09:02:50.128 INFO:tasks.workunit.client.1.smithi102.stdout:7/979: dwrite d1/d3/d34/d4f/fe5 [0,4194304] 0 2024-09-19T09:02:50.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/209: mkdir d4/d34/d3d 0 2024-09-19T09:02:50.129 INFO:tasks.workunit.client.1.smithi102.stdout:9/936: write d1/d2/d3/d6f/dcb/ff6 [426249,7539] 0 2024-09-19T09:02:50.131 INFO:tasks.workunit.client.0.smithi049.stdout:1/181: creat d5/d6/d19/d21/f3a x:0 0 0 2024-09-19T09:02:50.133 INFO:tasks.workunit.client.0.smithi049.stdout:1/182: chown d5/d6/d8/d1a 36414 1 2024-09-19T09:02:50.134 INFO:tasks.workunit.client.1.smithi102.stdout:5/937: fsync d5/d7/d1a/fcf 0 2024-09-19T09:02:50.137 INFO:tasks.workunit.client.1.smithi102.stdout:7/980: mkdir d1/d3/d34/d4f/d136 0 2024-09-19T09:02:50.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/183: dread d5/f36 [0,4194304] 0 2024-09-19T09:02:50.138 INFO:tasks.workunit.client.0.smithi049.stdout:9/230: link d3/f28 d3/d14/d34/d4c/f53 0 2024-09-19T09:02:50.139 INFO:tasks.workunit.client.1.smithi102.stdout:6/871: truncate d1/d18/f24 2535916 0 2024-09-19T09:02:50.140 INFO:tasks.workunit.client.0.smithi049.stdout:8/291: link d1/d11/d2e/d3c/f49 d1/d27/f58 0 2024-09-19T09:02:50.141 INFO:tasks.workunit.client.1.smithi102.stdout:6/872: write d1/d26/d2e/d45/daf/f114 [261056,5030] 0 2024-09-19T09:02:50.142 INFO:tasks.workunit.client.0.smithi049.stdout:4/210: mknod d4/d34/c3e 0 2024-09-19T09:02:50.142 INFO:tasks.workunit.client.1.smithi102.stdout:9/937: read d1/d2/d78/f89 [247736,85316] 0 2024-09-19T09:02:50.143 INFO:tasks.workunit.client.1.smithi102.stdout:7/981: mknod d1/d3/d34/d4f/c137 0 2024-09-19T09:02:50.143 INFO:tasks.workunit.client.1.smithi102.stdout:5/938: dwrite d5/d7/d1a/d8f/f11f [0,4194304] 0 2024-09-19T09:02:50.145 INFO:tasks.workunit.client.0.smithi049.stdout:9/231: dwrite d3/d14/d1a/f25 [0,4194304] 0 2024-09-19T09:02:50.146 INFO:tasks.workunit.client.0.smithi049.stdout:0/326: mknod d5/d10/d13/d15/c63 0 2024-09-19T09:02:50.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/232: fdatasync d3/f2c 0 2024-09-19T09:02:50.152 INFO:tasks.workunit.client.1.smithi102.stdout:5/939: dwrite d5/d7/d1b/f6f [0,4194304] 0 2024-09-19T09:02:50.152 INFO:tasks.workunit.client.0.smithi049.stdout:1/184: mkdir d5/d6/d8/d13/d24/d3b 0 2024-09-19T09:02:50.154 INFO:tasks.workunit.client.1.smithi102.stdout:9/938: write d1/d2/d3/d1d/f49 [2038986,120149] 0 2024-09-19T09:02:50.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/211: write d4/f24 [4149840,98847] 0 2024-09-19T09:02:50.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/212: chown d4/f30 3509576 1 2024-09-19T09:02:50.166 INFO:tasks.workunit.client.1.smithi102.stdout:5/940: fdatasync d5/d7/d1a/daa/fd7 0 2024-09-19T09:02:50.167 INFO:tasks.workunit.client.1.smithi102.stdout:1/901: sync 2024-09-19T09:02:50.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/233: rmdir d3/d14/d1a 39 2024-09-19T09:02:50.170 INFO:tasks.workunit.client.0.smithi049.stdout:0/327: unlink d5/d10/f1d 0 2024-09-19T09:02:50.171 INFO:tasks.workunit.client.0.smithi049.stdout:1/185: symlink d5/d6/d8/l3c 0 2024-09-19T09:02:50.173 INFO:tasks.workunit.client.1.smithi102.stdout:7/982: creat d1/d4/f138 x:0 0 0 2024-09-19T09:02:50.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/142: truncate d3/d5/de/f1e 3281024 0 2024-09-19T09:02:50.174 INFO:tasks.workunit.client.0.smithi049.stdout:5/143: chown d3/f10 0 1 2024-09-19T09:02:50.180 INFO:tasks.workunit.client.0.smithi049.stdout:8/292: dwrite d1/f2d [0,4194304] 0 2024-09-19T09:02:50.182 INFO:tasks.workunit.client.0.smithi049.stdout:0/328: mkdir d5/d64 0 2024-09-19T09:02:50.183 INFO:tasks.workunit.client.0.smithi049.stdout:1/186: symlink d5/d6/d19/l3d 0 2024-09-19T09:02:50.184 INFO:tasks.workunit.client.1.smithi102.stdout:5/941: dread d5/d60/fc3 [0,4194304] 0 2024-09-19T09:02:50.185 INFO:tasks.workunit.client.1.smithi102.stdout:5/942: fsync d5/d7/d1a/d37/d39/d4c/f55 0 2024-09-19T09:02:50.185 INFO:tasks.workunit.client.1.smithi102.stdout:5/943: dread - d5/d8d/ffe zero size 2024-09-19T09:02:50.186 INFO:tasks.workunit.client.1.smithi102.stdout:9/939: write d1/d2/f37 [2064372,11727] 0 2024-09-19T09:02:50.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/213: mkdir d4/d15/d19/d32/d3f 0 2024-09-19T09:02:50.190 INFO:tasks.workunit.client.1.smithi102.stdout:6/873: getdents d1/d26/d2e/d45/dac 0 2024-09-19T09:02:50.190 INFO:tasks.workunit.client.0.smithi049.stdout:4/214: chown d4/d15/d19/d1f/f2e 473 1 2024-09-19T09:02:50.191 INFO:tasks.workunit.client.1.smithi102.stdout:7/983: symlink d1/d2f/l139 0 2024-09-19T09:02:50.238 INFO:tasks.workunit.client.1.smithi102.stdout:8/877: sync 2024-09-19T09:02:50.239 INFO:tasks.workunit.client.1.smithi102.stdout:2/861: sync 2024-09-19T09:02:50.242 INFO:tasks.workunit.client.0.smithi049.stdout:6/155: sync 2024-09-19T09:02:50.249 INFO:tasks.workunit.client.0.smithi049.stdout:6/156: dwrite dc/d16/f2d [0,4194304] 0 2024-09-19T09:02:50.261 INFO:tasks.workunit.client.1.smithi102.stdout:1/902: link dd/d14/d35/d49/d62/d6c/l9f dd/d14/d35/d49/d62/d6c/d99/l125 0 2024-09-19T09:02:50.262 INFO:tasks.workunit.client.1.smithi102.stdout:1/903: dread - dd/d7a/da0/fcf zero size 2024-09-19T09:02:50.262 INFO:tasks.workunit.client.1.smithi102.stdout:5/944: mknod d5/d60/db6/c121 0 2024-09-19T09:02:50.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/234: creat d3/d14/f54 x:0 0 0 2024-09-19T09:02:50.263 INFO:tasks.workunit.client.1.smithi102.stdout:5/945: chown d5/d7b/ddd 0 1 2024-09-19T09:02:50.263 INFO:tasks.workunit.client.1.smithi102.stdout:9/940: symlink d1/d2/d3/d1d/d4f/d6d/d81/dd3/l138 0 2024-09-19T09:02:50.264 INFO:tasks.workunit.client.1.smithi102.stdout:5/946: write d5/d7/f19 [12391,33849] 0 2024-09-19T09:02:50.264 INFO:tasks.workunit.client.0.smithi049.stdout:8/293: mknod d1/d11/d4f/c59 0 2024-09-19T09:02:50.265 INFO:tasks.workunit.client.1.smithi102.stdout:6/874: read d1/d26/d2e/dce/fdd [19841,6999] 0 2024-09-19T09:02:50.265 INFO:tasks.workunit.client.1.smithi102.stdout:7/984: chown d1/d3/d20/d6c/fb0 3 1 2024-09-19T09:02:50.268 INFO:tasks.workunit.client.1.smithi102.stdout:8/878: creat d0/d10/d21/d39/f12a x:0 0 0 2024-09-19T09:02:50.269 INFO:tasks.workunit.client.0.smithi049.stdout:8/294: dread d1/d11/d2e/d3c/f55 [0,4194304] 0 2024-09-19T09:02:50.269 INFO:tasks.workunit.client.1.smithi102.stdout:8/879: dread - d0/d10/d9b/fc4 zero size 2024-09-19T09:02:50.270 INFO:tasks.workunit.client.0.smithi049.stdout:5/144: rename d3/d5/l27 to d3/d5/l2e 0 2024-09-19T09:02:50.273 INFO:tasks.workunit.client.1.smithi102.stdout:1/904: rename dd/d14/d35/c57 to dd/d7a/d8c/d8e/d103/ddc/c126 0 2024-09-19T09:02:50.275 INFO:tasks.workunit.client.0.smithi049.stdout:9/235: read d3/f28 [78445,108100] 0 2024-09-19T09:02:50.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/215: link d4/f13 d4/f40 0 2024-09-19T09:02:50.279 INFO:tasks.workunit.client.0.smithi049.stdout:4/216: fdatasync d4/d15/d19/d1f/f26 0 2024-09-19T09:02:50.281 INFO:tasks.workunit.client.0.smithi049.stdout:4/217: write d4/f21 [982052,3682] 0 2024-09-19T09:02:50.282 INFO:tasks.workunit.client.1.smithi102.stdout:5/947: rmdir d5/d8d/d95 39 2024-09-19T09:02:50.282 INFO:tasks.workunit.client.1.smithi102.stdout:9/941: dread d1/d2/d3/d1d/dc7/fcd [0,4194304] 0 2024-09-19T09:02:50.282 INFO:tasks.workunit.client.1.smithi102.stdout:6/875: rmdir d1/d26/d4b/d94/d8a 39 2024-09-19T09:02:50.283 INFO:tasks.workunit.client.0.smithi049.stdout:9/236: dwrite d3/d14/f51 [0,4194304] 0 2024-09-19T09:02:50.283 INFO:tasks.workunit.client.0.smithi049.stdout:0/329: link d5/d10/l4d d5/d10/d3c/l65 0 2024-09-19T09:02:50.283 INFO:tasks.workunit.client.0.smithi049.stdout:4/218: dread - d4/f30 zero size 2024-09-19T09:02:50.284 INFO:tasks.workunit.client.1.smithi102.stdout:7/985: dread d1/d4/dca/d52/f65 [0,4194304] 0 2024-09-19T09:02:50.284 INFO:tasks.workunit.client.1.smithi102.stdout:7/986: fsync d1/d4/f138 0 2024-09-19T09:02:50.286 INFO:tasks.workunit.client.1.smithi102.stdout:7/987: read d1/d4/dca/f7d [1737891,43359] 0 2024-09-19T09:02:50.287 INFO:tasks.workunit.client.1.smithi102.stdout:2/862: write d7/d50/f8a [1975287,117590] 0 2024-09-19T09:02:50.288 INFO:tasks.workunit.client.1.smithi102.stdout:2/863: readlink d7/d1a/d2b/d31/d51/l91 0 2024-09-19T09:02:50.290 INFO:tasks.workunit.client.1.smithi102.stdout:2/864: read d7/d1a/d2b/dab/fdb [1698204,10180] 0 2024-09-19T09:02:50.296 INFO:tasks.workunit.client.1.smithi102.stdout:8/880: dwrite d0/d10/d21/db3/fdc [4194304,4194304] 0 2024-09-19T09:02:50.296 INFO:tasks.workunit.client.1.smithi102.stdout:8/881: readlink d0/d10/d21/d39/l40 0 2024-09-19T09:02:50.297 INFO:tasks.workunit.client.0.smithi049.stdout:9/237: unlink d3/d14/d34/f48 0 2024-09-19T09:02:50.298 INFO:tasks.workunit.client.1.smithi102.stdout:8/882: chown d0/d10/d21/d39/d50/c75 10020328 1 2024-09-19T09:02:50.298 INFO:tasks.workunit.client.1.smithi102.stdout:8/883: dread - d0/db/d104/d106/f129 zero size 2024-09-19T09:02:50.300 INFO:tasks.workunit.client.0.smithi049.stdout:4/219: rename d4/d15/d19/d32 to d4/d34/d3d/d41 0 2024-09-19T09:02:50.300 INFO:tasks.workunit.client.0.smithi049.stdout:4/220: read - d4/f30 zero size 2024-09-19T09:02:50.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/238: rmdir d3 39 2024-09-19T09:02:50.309 INFO:tasks.workunit.client.0.smithi049.stdout:4/221: symlink d4/d15/d19/d1f/l42 0 2024-09-19T09:02:50.311 INFO:tasks.workunit.client.0.smithi049.stdout:5/145: link d3/f10 d3/d5/d1c/d2d/f2f 0 2024-09-19T09:02:50.313 INFO:tasks.workunit.client.0.smithi049.stdout:5/146: read d3/f8 [1068515,29460] 0 2024-09-19T09:02:50.316 INFO:tasks.workunit.client.0.smithi049.stdout:0/330: rename d5/d10/d3c/l65 to d5/d10/d13/d15/d29/d3b/l66 0 2024-09-19T09:02:50.318 INFO:tasks.workunit.client.0.smithi049.stdout:4/222: symlink d4/d15/d19/d1f/l43 0 2024-09-19T09:02:50.321 INFO:tasks.workunit.client.0.smithi049.stdout:8/295: truncate d1/f21 134965 0 2024-09-19T09:02:50.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/223: dread d4/d15/d19/d1f/f2e [0,4194304] 0 2024-09-19T09:02:50.329 INFO:tasks.workunit.client.0.smithi049.stdout:8/296: dwrite d1/d11/f4d [0,4194304] 0 2024-09-19T09:02:50.330 INFO:tasks.workunit.client.0.smithi049.stdout:5/147: dread d3/d5/de/f1e [0,4194304] 0 2024-09-19T09:02:50.330 INFO:tasks.workunit.client.0.smithi049.stdout:9/239: rename d3/l50 to d3/d14/d1a/d21/l55 0 2024-09-19T09:02:50.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/224: symlink d4/d34/d3d/l44 0 2024-09-19T09:02:50.340 INFO:tasks.workunit.client.0.smithi049.stdout:9/240: unlink d3/d22/f38 0 2024-09-19T09:02:50.347 INFO:tasks.workunit.client.0.smithi049.stdout:9/241: creat d3/d14/d34/f56 x:0 0 0 2024-09-19T09:02:50.347 INFO:tasks.workunit.client.0.smithi049.stdout:9/242: chown d3/d22 1866 1 2024-09-19T09:02:50.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/297: creat d1/f5a x:0 0 0 2024-09-19T09:02:50.351 INFO:tasks.workunit.client.0.smithi049.stdout:4/225: dread d4/f5 [0,4194304] 0 2024-09-19T09:02:50.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/298: chown d1/d11/c43 11 1 2024-09-19T09:02:50.352 INFO:tasks.workunit.client.0.smithi049.stdout:0/331: write d5/d10/d13/d30/f49 [287285,55605] 0 2024-09-19T09:02:50.357 INFO:tasks.workunit.client.0.smithi049.stdout:4/226: rename d4/d34/d3d/d41 to d4/d45 0 2024-09-19T09:02:50.358 INFO:tasks.workunit.client.0.smithi049.stdout:8/299: dwrite d1/d11/d2e/f56 [0,4194304] 0 2024-09-19T09:02:50.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/300: chown d1/l54 365935 1 2024-09-19T09:02:50.360 INFO:tasks.workunit.client.0.smithi049.stdout:8/301: dread - d1/d27/f4b zero size 2024-09-19T09:02:50.366 INFO:tasks.workunit.client.0.smithi049.stdout:9/243: unlink d3/d14/d1a/d21/l55 0 2024-09-19T09:02:50.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/302: mkdir d1/d11/d3f/d5b 0 2024-09-19T09:02:50.370 INFO:tasks.workunit.client.0.smithi049.stdout:8/303: write d1/d11/f1b [9068025,63457] 0 2024-09-19T09:02:50.371 INFO:tasks.workunit.client.0.smithi049.stdout:8/304: stat d1/d11/d3f/d5b 0 2024-09-19T09:02:50.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/244: creat d3/d14/d1a/d21/d31/f57 x:0 0 0 2024-09-19T09:02:50.373 INFO:tasks.workunit.client.0.smithi049.stdout:4/227: dread d4/f1e [0,4194304] 0 2024-09-19T09:02:50.376 INFO:tasks.workunit.client.0.smithi049.stdout:8/305: dread d1/d11/f4d [0,4194304] 0 2024-09-19T09:02:50.379 INFO:tasks.workunit.client.0.smithi049.stdout:9/245: chown d3/d14/d1a/d21/d31/c39 20195 1 2024-09-19T09:02:50.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/228: unlink d4/d15/d19/d1f/f26 0 2024-09-19T09:02:50.383 INFO:tasks.workunit.client.0.smithi049.stdout:8/306: dwrite d1/d11/f3a [4194304,4194304] 0 2024-09-19T09:02:50.392 INFO:tasks.workunit.client.0.smithi049.stdout:8/307: dwrite d1/d11/f1b [4194304,4194304] 0 2024-09-19T09:02:50.393 INFO:tasks.workunit.client.1.smithi102.stdout:5/948: mknod d5/d7/d1a/d37/d39/d81/dfa/d117/c122 0 2024-09-19T09:02:50.394 INFO:tasks.workunit.client.1.smithi102.stdout:6/876: truncate d1/d18/d37/fa0 3469123 0 2024-09-19T09:02:50.400 INFO:tasks.workunit.client.1.smithi102.stdout:7/988: chown d1/d2f/fd7 52856 1 2024-09-19T09:02:50.401 INFO:tasks.workunit.client.1.smithi102.stdout:7/989: fsync d1/d4/dca/d52/d7f/da5/de2/df0/f126 0 2024-09-19T09:02:50.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/246: mkdir d3/d14/d34/d44/d4d/d58 0 2024-09-19T09:02:50.402 INFO:tasks.workunit.client.0.smithi049.stdout:9/247: truncate d3/d14/f54 368474 0 2024-09-19T09:02:50.403 INFO:tasks.workunit.client.0.smithi049.stdout:9/248: stat d3/d14/d1a/d21 0 2024-09-19T09:02:50.404 INFO:tasks.workunit.client.0.smithi049.stdout:9/249: chown d3/d14/f42 484 1 2024-09-19T09:02:50.405 INFO:tasks.workunit.client.0.smithi049.stdout:9/250: chown d3/d14/d1a/d21/d31/c39 599 1 2024-09-19T09:02:50.407 INFO:tasks.workunit.client.0.smithi049.stdout:9/251: write d3/d14/f2d [4987821,31506] 0 2024-09-19T09:02:50.411 INFO:tasks.workunit.client.1.smithi102.stdout:8/884: symlink d0/d64/d10c/l12b 0 2024-09-19T09:02:50.412 INFO:tasks.workunit.client.0.smithi049.stdout:9/252: symlink d3/d14/d34/d4c/l59 0 2024-09-19T09:02:50.414 INFO:tasks.workunit.client.1.smithi102.stdout:6/877: stat d1/d26/d2e/d45/d47/d4d/c74 0 2024-09-19T09:02:50.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/253: mknod d3/c5a 0 2024-09-19T09:02:50.417 INFO:tasks.workunit.client.1.smithi102.stdout:5/949: dread d5/d7/d1a/d37/d34/f4e [0,4194304] 0 2024-09-19T09:02:50.420 INFO:tasks.workunit.client.1.smithi102.stdout:2/865: rename d7/d50/d64/da1/d115/f17 to d7/d50/d64/da1/dd6/f12b 0 2024-09-19T09:02:50.421 INFO:tasks.workunit.client.1.smithi102.stdout:8/885: symlink d0/db/d29/d97/l12c 0 2024-09-19T09:02:50.422 INFO:tasks.workunit.client.1.smithi102.stdout:8/886: dread - d0/d10/d21/d39/d50/fb2 zero size 2024-09-19T09:02:50.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/229: truncate d4/f21 2810553 0 2024-09-19T09:02:50.422 INFO:tasks.workunit.client.1.smithi102.stdout:8/887: truncate d0/d10/d9b/fff 724053 0 2024-09-19T09:02:50.423 INFO:tasks.workunit.client.1.smithi102.stdout:6/878: symlink d1/d26/d2e/d45/d47/d4d/d35/d41/l125 0 2024-09-19T09:02:50.423 INFO:tasks.workunit.client.0.smithi049.stdout:9/254: dwrite d3/f17 [4194304,4194304] 0 2024-09-19T09:02:50.424 INFO:tasks.workunit.client.1.smithi102.stdout:7/990: mknod d1/d3/d20/c13a 0 2024-09-19T09:02:50.426 INFO:tasks.workunit.client.1.smithi102.stdout:1/905: getdents dd/d14/d35/ddf 0 2024-09-19T09:02:50.426 INFO:tasks.workunit.client.1.smithi102.stdout:1/906: dread - dd/d14/dac/f107 zero size 2024-09-19T09:02:50.428 INFO:tasks.workunit.client.1.smithi102.stdout:2/866: creat d7/d50/d64/da1/f12c x:0 0 0 2024-09-19T09:02:50.429 INFO:tasks.workunit.client.0.smithi049.stdout:8/308: dwrite d1/d27/f58 [0,4194304] 0 2024-09-19T09:02:50.434 INFO:tasks.workunit.client.1.smithi102.stdout:6/879: mkdir d1/d26/d2e/d45/d47/d4d/d35/d79/d126 0 2024-09-19T09:02:50.434 INFO:tasks.workunit.client.1.smithi102.stdout:9/942: dwrite d1/d8/d1c/f99 [0,4194304] 0 2024-09-19T09:02:50.437 INFO:tasks.workunit.client.1.smithi102.stdout:6/880: chown d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fd0 9365223 1 2024-09-19T09:02:50.438 INFO:tasks.workunit.client.1.smithi102.stdout:1/907: symlink dd/d7a/da0/l127 0 2024-09-19T09:02:50.439 INFO:tasks.workunit.client.0.smithi049.stdout:8/309: dread d1/f9 [0,4194304] 0 2024-09-19T09:02:50.440 INFO:tasks.workunit.client.1.smithi102.stdout:1/908: write dd/d7a/d8c/da6/f114 [794785,33723] 0 2024-09-19T09:02:50.447 INFO:tasks.workunit.client.0.smithi049.stdout:8/310: chown d1/d1a/c26 1812635 1 2024-09-19T09:02:50.448 INFO:tasks.workunit.client.1.smithi102.stdout:5/950: getdents d5/d7/d1a 0 2024-09-19T09:02:50.450 INFO:tasks.workunit.client.1.smithi102.stdout:5/951: read d5/d7/d1a/d37/d34/d4d/d9c/db8/fef [2822568,31658] 0 2024-09-19T09:02:50.450 INFO:tasks.workunit.client.1.smithi102.stdout:9/943: truncate d1/d2/d3/d1d/d4f/f5a 606450 0 2024-09-19T09:02:50.451 INFO:tasks.workunit.client.0.smithi049.stdout:8/311: mknod d1/d1a/c5c 0 2024-09-19T09:02:50.452 INFO:tasks.workunit.client.0.smithi049.stdout:8/312: write d1/d27/f41 [820505,111241] 0 2024-09-19T09:02:50.457 INFO:tasks.workunit.client.1.smithi102.stdout:5/952: dwrite d5/d23/ffc [0,4194304] 0 2024-09-19T09:02:50.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/313: mkdir d1/d11/d2e/d3c/d5d 0 2024-09-19T09:02:50.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/255: write d3/f28 [834964,84051] 0 2024-09-19T09:02:50.460 INFO:tasks.workunit.client.0.smithi049.stdout:8/314: dread d1/d27/f53 [0,4194304] 0 2024-09-19T09:02:50.461 INFO:tasks.workunit.client.0.smithi049.stdout:8/315: stat d1/d27/f58 0 2024-09-19T09:02:50.463 INFO:tasks.workunit.client.1.smithi102.stdout:9/944: fdatasync d1/d2/d3/d1d/d4f/d6d/f9e 0 2024-09-19T09:02:50.469 INFO:tasks.workunit.client.1.smithi102.stdout:7/991: getdents d1/d3/d20/dad 0 2024-09-19T09:02:50.471 INFO:tasks.workunit.client.0.smithi049.stdout:8/316: rename d1/d1a/f48 to d1/d1a/f5e 0 2024-09-19T09:02:50.471 INFO:tasks.workunit.client.1.smithi102.stdout:7/992: write d1/d4/d9c/f89 [4613973,5433] 0 2024-09-19T09:02:50.471 INFO:tasks.workunit.client.1.smithi102.stdout:8/888: dwrite d0/d10/d21/d39/d87/f8c [4194304,4194304] 0 2024-09-19T09:02:50.472 INFO:tasks.workunit.client.1.smithi102.stdout:5/953: truncate d5/d7/d1a/d42/fa9 1762170 0 2024-09-19T09:02:50.472 INFO:tasks.workunit.client.1.smithi102.stdout:6/881: write d1/d18/d37/f7d [21096,104452] 0 2024-09-19T09:02:50.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/256: dread d3/d14/d1a/d21/f2f [0,4194304] 0 2024-09-19T09:02:50.479 INFO:tasks.workunit.client.0.smithi049.stdout:8/317: rename d1/d27/l44 to d1/d1a/l5f 0 2024-09-19T09:02:50.481 INFO:tasks.workunit.client.1.smithi102.stdout:2/867: truncate d7/d11/f8e 1720046 0 2024-09-19T09:02:50.483 INFO:tasks.workunit.client.0.smithi049.stdout:9/257: unlink d3/d14/f2d 0 2024-09-19T09:02:50.491 INFO:tasks.workunit.client.0.smithi049.stdout:9/258: dwrite d3/f43 [0,4194304] 0 2024-09-19T09:02:50.493 INFO:tasks.workunit.client.0.smithi049.stdout:9/259: write d3/d14/d1a/d21/f26 [5114682,27411] 0 2024-09-19T09:02:50.493 INFO:tasks.workunit.client.1.smithi102.stdout:9/945: dread d1/d2/d3/d6f/fc8 [0,4194304] 0 2024-09-19T09:02:50.494 INFO:tasks.workunit.client.1.smithi102.stdout:5/954: symlink d5/d7/d1a/d37/d39/d81/l123 0 2024-09-19T09:02:50.496 INFO:tasks.workunit.client.1.smithi102.stdout:9/946: dread - d1/d2/d3/d6f/d8d/da2/db6/de3/f10b zero size 2024-09-19T09:02:50.498 INFO:tasks.workunit.client.1.smithi102.stdout:7/993: truncate d1/d3/d72/f8b 3054427 0 2024-09-19T09:02:50.500 INFO:tasks.workunit.client.1.smithi102.stdout:2/868: creat d7/d50/d64/da1/f12d x:0 0 0 2024-09-19T09:02:50.501 INFO:tasks.workunit.client.0.smithi049.stdout:9/260: write d3/d14/d1a/d21/f2f [4322424,121700] 0 2024-09-19T09:02:50.503 INFO:tasks.workunit.client.1.smithi102.stdout:5/955: dwrite d5/d7/d1a/d37/d39/f8b [0,4194304] 0 2024-09-19T09:02:50.504 INFO:tasks.workunit.client.1.smithi102.stdout:5/956: write d5/d7/d1a/d37/d39/d4c/f55 [641360,100614] 0 2024-09-19T09:02:50.509 INFO:tasks.workunit.client.1.smithi102.stdout:9/947: unlink d1/d8/f5f 0 2024-09-19T09:02:50.510 INFO:tasks.workunit.client.1.smithi102.stdout:9/948: write d1/d2/d3/d1d/d4f/f11c [14379,123060] 0 2024-09-19T09:02:50.511 INFO:tasks.workunit.client.1.smithi102.stdout:9/949: fdatasync d1/d2/d3/d6f/dcb/ff6 0 2024-09-19T09:02:50.512 INFO:tasks.workunit.client.0.smithi049.stdout:9/261: rename d3/f17 to d3/d14/d34/d44/d4d/d58/f5b 0 2024-09-19T09:02:50.512 INFO:tasks.workunit.client.0.smithi049.stdout:9/262: readlink d3/le 0 2024-09-19T09:02:50.513 INFO:tasks.workunit.client.1.smithi102.stdout:2/869: symlink d7/d1a/d56/db9/l12e 0 2024-09-19T09:02:50.513 INFO:tasks.workunit.client.0.smithi049.stdout:3/264: sync 2024-09-19T09:02:50.514 INFO:tasks.workunit.client.1.smithi102.stdout:2/870: truncate d7/d50/f8a 2464749 0 2024-09-19T09:02:50.519 INFO:tasks.workunit.client.1.smithi102.stdout:6/882: write d1/fcd [1304029,83133] 0 2024-09-19T09:02:50.520 INFO:tasks.workunit.client.1.smithi102.stdout:8/889: write d0/d10/d21/d39/d50/da2/dec/f10d [6610051,51792] 0 2024-09-19T09:02:50.522 INFO:tasks.workunit.client.1.smithi102.stdout:8/890: truncate d0/db/d84/f11b 979602 0 2024-09-19T09:02:50.528 INFO:tasks.workunit.client.1.smithi102.stdout:5/957: dread d5/d7/d1b/f51 [0,4194304] 0 2024-09-19T09:02:50.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/158: sync 2024-09-19T09:02:50.538 INFO:tasks.workunit.client.0.smithi049.stdout:8/318: truncate d1/d11/d2e/d3c/f49 1430580 0 2024-09-19T09:02:50.542 INFO:tasks.workunit.client.1.smithi102.stdout:2/871: symlink d7/d1a/d2b/dae/de5/l12f 0 2024-09-19T09:02:50.548 INFO:tasks.workunit.client.1.smithi102.stdout:2/872: dwrite d7/d1a/d2b/d31/d106/d93/f110 [0,4194304] 0 2024-09-19T09:02:50.550 INFO:tasks.workunit.client.1.smithi102.stdout:6/883: mkdir d1/d26/d2e/d45/dac/db2/df5/d127 0 2024-09-19T09:02:50.552 INFO:tasks.workunit.client.1.smithi102.stdout:6/884: write d1/d18/db/f10 [3422837,105056] 0 2024-09-19T09:02:50.554 INFO:tasks.workunit.client.0.smithi049.stdout:2/159: unlink d1/f12 0 2024-09-19T09:02:50.558 INFO:tasks.workunit.client.0.smithi049.stdout:8/319: rename d1/d1a/f2b to d1/d27/f60 0 2024-09-19T09:02:50.564 INFO:tasks.workunit.client.1.smithi102.stdout:2/873: rename d7/d11/fb2 to d7/d1a/d2b/dab/f130 0 2024-09-19T09:02:50.566 INFO:tasks.workunit.client.0.smithi049.stdout:8/320: dwrite d1/d11/d2e/d3c/f50 [0,4194304] 0 2024-09-19T09:02:50.567 INFO:tasks.workunit.client.0.smithi049.stdout:8/321: chown d1/l54 124 1 2024-09-19T09:02:50.570 INFO:tasks.workunit.client.1.smithi102.stdout:6/885: symlink d1/d26/d2e/d45/dac/db2/df5/l128 0 2024-09-19T09:02:50.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/263: truncate d3/d22/f3e 3192530 0 2024-09-19T09:02:50.571 INFO:tasks.workunit.client.1.smithi102.stdout:6/886: dread - d1/d18/d37/f5b zero size 2024-09-19T09:02:50.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/264: fdatasync f1 0 2024-09-19T09:02:50.574 INFO:tasks.workunit.client.1.smithi102.stdout:7/994: getdents d1/d4 0 2024-09-19T09:02:50.575 INFO:tasks.workunit.client.1.smithi102.stdout:6/887: dread d1/d18/db/f90 [0,4194304] 0 2024-09-19T09:02:50.575 INFO:tasks.workunit.client.0.smithi049.stdout:8/322: mkdir d1/d11/d2e/d4e/d61 0 2024-09-19T09:02:50.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/323: chown d1/d1a/c34 1473538 1 2024-09-19T09:02:50.576 INFO:tasks.workunit.client.0.smithi049.stdout:3/265: truncate d10/d11/d13/d30/f3c 2361238 0 2024-09-19T09:02:50.582 INFO:tasks.workunit.client.0.smithi049.stdout:8/324: rename d1/d1a/l1c to d1/d11/d45/l62 0 2024-09-19T09:02:50.583 INFO:tasks.workunit.client.1.smithi102.stdout:8/891: dwrite d0/d10/d9b/fc4 [0,4194304] 0 2024-09-19T09:02:50.584 INFO:tasks.workunit.client.1.smithi102.stdout:5/958: creat d5/d7/d1a/d8f/f124 x:0 0 0 2024-09-19T09:02:50.585 INFO:tasks.workunit.client.0.smithi049.stdout:9/265: dread d3/d14/f54 [0,4194304] 0 2024-09-19T09:02:50.585 INFO:tasks.workunit.client.1.smithi102.stdout:7/995: creat d1/d2d/f13b x:0 0 0 2024-09-19T09:02:50.587 INFO:tasks.workunit.client.0.smithi049.stdout:3/266: mknod d10/d11/c5b 0 2024-09-19T09:02:50.587 INFO:tasks.workunit.client.1.smithi102.stdout:1/909: sync 2024-09-19T09:02:50.596 INFO:tasks.workunit.client.0.smithi049.stdout:9/266: symlink d3/d22/l5c 0 2024-09-19T09:02:50.598 INFO:tasks.workunit.client.1.smithi102.stdout:2/874: write d7/d1a/d2b/d31/f80 [5349018,7676] 0 2024-09-19T09:02:50.599 INFO:tasks.workunit.client.1.smithi102.stdout:2/875: dread - d7/d50/f120 zero size 2024-09-19T09:02:50.602 INFO:tasks.workunit.client.1.smithi102.stdout:7/996: chown d1/d3/c5b 11817094 1 2024-09-19T09:02:50.603 INFO:tasks.workunit.client.1.smithi102.stdout:8/892: dwrite d0/ff5 [0,4194304] 0 2024-09-19T09:02:50.604 INFO:tasks.workunit.client.1.smithi102.stdout:6/888: mkdir d1/d26/d2e/d45/d47/d4d/d129 0 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 -- 172.21.15.49:0/1033614914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 msgr2=0x7fa1000feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1033614914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa1000feef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009880 tx=0x7fa0fc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 -- 172.21.15.49:0/1033614914 shutdown_connections 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1033614914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1000ffcf0 0x7fa100100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1033614914 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa1000feef0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 -- 172.21.15.49:0/1033614914 >> 172.21.15.49:0/1033614914 conn(0x7fa1000fa280 msgr2=0x7fa1000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 -- 172.21.15.49:0/1033614914 shutdown_connections 2024-09-19T09:02:50.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.604+0000 7fa1086b5640 1 -- 172.21.15.49:0/1033614914 wait complete. 2024-09-19T09:02:50.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.606+0000 7fa1086b5640 1 Processor -- start 2024-09-19T09:02:50.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.606+0000 7fa1086b5640 1 -- start start 2024-09-19T09:02:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa1086b5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa100102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa1086b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1000ffcf0 0x7fa1001010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa1086b5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100101610 con 0x7fa1000feaf0 2024-09-19T09:02:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa1086b5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100101780 con 0x7fa1000ffcf0 2024-09-19T09:02:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa106451640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa100102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa106451640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa100102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38078/0 (socket says 172.21.15.49:38078) 2024-09-19T09:02:50.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa106451640 1 -- 172.21.15.49:0/1304276170 learned_addr learned my addr 172.21.15.49:0/1304276170 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:50.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.607+0000 7fa105c50640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1000ffcf0 0x7fa1001010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.608+0000 7fa106451640 1 -- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1000ffcf0 msgr2=0x7fa1001010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.608+0000 7fa106451640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1000ffcf0 0x7fa1001010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.608+0000 7fa106451640 1 -- 172.21.15.49:0/1304276170 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009490 con 0x7fa1000feaf0 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.608+0000 7fa106451640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa100102a80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009230 tx=0x7fa0fc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.609+0000 7fa0f77fe640 1 -- 172.21.15.49:0/1304276170 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc0053e0 con 0x7fa1000feaf0 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.609+0000 7fa0f77fe640 1 -- 172.21.15.49:0/1304276170 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0fc005540 con 0x7fa1000feaf0 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.609+0000 7fa0f77fe640 1 -- 172.21.15.49:0/1304276170 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc003b90 con 0x7fa1000feaf0 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.609+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc009560 con 0x7fa1000feaf0 2024-09-19T09:02:50.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.609+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa100101ca0 con 0x7fa1000feaf0 2024-09-19T09:02:50.610 INFO:tasks.workunit.client.1.smithi102.stdout:5/959: symlink d5/d7/d1a/d37/d34/l125 0 2024-09-19T09:02:50.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.611+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa100108040 con 0x7fa1000feaf0 2024-09-19T09:02:50.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.611+0000 7fa0f77fe640 1 -- 172.21.15.49:0/1304276170 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fa0fc003d50 con 0x7fa1000feaf0 2024-09-19T09:02:50.611 INFO:tasks.workunit.client.1.smithi102.stdout:2/876: creat d7/d50/d64/da1/d115/f131 x:0 0 0 2024-09-19T09:02:50.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.612+0000 7fa0f77fe640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa0ec06d8e0 0x7fa0ec06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:50.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.612+0000 7fa0f77fe640 1 -- 172.21.15.49:0/1304276170 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa0fc0ae310 con 0x7fa1000feaf0 2024-09-19T09:02:50.612 INFO:tasks.workunit.client.0.smithi049.stdout:8/325: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:02:50.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.612+0000 7fa105c50640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa0ec06d8e0 0x7fa0ec06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:50.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.613+0000 7fa105c50640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa0ec06d8e0 0x7fa0ec06fda0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa100102800 tx=0x7fa0f0005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:50.614 INFO:tasks.workunit.client.0.smithi049.stdout:8/326: write d1/d11/d2e/f56 [2383469,96221] 0 2024-09-19T09:02:50.615 INFO:tasks.workunit.client.0.smithi049.stdout:3/267: chown d10/d11/d13/d30/f3c 15687451 1 2024-09-19T09:02:50.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.620+0000 7fa0f77fe640 1 -- 172.21.15.49:0/1304276170 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fa0fc0779e0 con 0x7fa1000feaf0 2024-09-19T09:02:50.623 INFO:tasks.workunit.client.1.smithi102.stdout:5/960: symlink d5/d7/d1a/daa/l126 0 2024-09-19T09:02:50.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/327: symlink d1/d11/d2e/l63 0 2024-09-19T09:02:50.625 INFO:tasks.workunit.client.1.smithi102.stdout:2/877: symlink d7/d50/d64/d7f/l132 0 2024-09-19T09:02:50.625 INFO:tasks.workunit.client.1.smithi102.stdout:7/997: write d1/d3/f1c [538515,47749] 0 2024-09-19T09:02:50.626 INFO:tasks.workunit.client.0.smithi049.stdout:9/267: write d3/d14/f1e [4106759,108979] 0 2024-09-19T09:02:50.626 INFO:tasks.workunit.client.1.smithi102.stdout:1/910: dwrite dd/d14/d35/f80 [0,4194304] 0 2024-09-19T09:02:50.627 INFO:tasks.workunit.client.1.smithi102.stdout:2/878: stat d7/d1a/d2b/d31/d51/d6b/fbd 0 2024-09-19T09:02:50.628 INFO:tasks.workunit.client.1.smithi102.stdout:1/911: chown dd/d7a/d8c/d8e/d103/d78/l88 5389 1 2024-09-19T09:02:50.629 INFO:tasks.workunit.client.1.smithi102.stdout:5/961: symlink d5/d7/d1a/de1/d78/l127 0 2024-09-19T09:02:50.629 INFO:tasks.workunit.client.1.smithi102.stdout:2/879: truncate d7/d1a/d56/f121 98582 0 2024-09-19T09:02:50.630 INFO:tasks.workunit.client.1.smithi102.stdout:7/998: mkdir d1/d4/d13c 0 2024-09-19T09:02:50.631 INFO:tasks.workunit.client.0.smithi049.stdout:3/268: creat d10/f5c x:0 0 0 2024-09-19T09:02:50.632 INFO:tasks.workunit.client.1.smithi102.stdout:1/912: mknod dd/d66/c128 0 2024-09-19T09:02:50.636 INFO:tasks.workunit.client.0.smithi049.stdout:3/269: symlink d10/d11/d13/l5d 0 2024-09-19T09:02:50.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/270: write d10/f48 [1110039,37859] 0 2024-09-19T09:02:50.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/268: dwrite d3/d14/d34/f56 [0,4194304] 0 2024-09-19T09:02:50.645 INFO:tasks.workunit.client.1.smithi102.stdout:1/913: symlink dd/d7a/d8c/d8e/d103/ddc/l129 0 2024-09-19T09:02:50.645 INFO:tasks.workunit.client.1.smithi102.stdout:7/999: mknod d1/d3/d34/c13d 0 2024-09-19T09:02:50.645 INFO:tasks.workunit.client.1.smithi102.stdout:5/962: link d5/d7/f29 d5/d7/d1a/d37/d34/d4d/d9c/f128 0 2024-09-19T09:02:50.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/269: creat d3/d14/d34/d4c/f5d x:0 0 0 2024-09-19T09:02:50.648 INFO:tasks.workunit.client.0.smithi049.stdout:3/271: dwrite d10/d11/d13/f32 [0,4194304] 0 2024-09-19T09:02:50.648 INFO:tasks.workunit.client.1.smithi102.stdout:2/880: getdents d7/d1a/d2b/dae 0 2024-09-19T09:02:50.651 INFO:tasks.workunit.client.1.smithi102.stdout:1/914: fsync dd/d14/d18/f40 0 2024-09-19T09:02:50.651 INFO:tasks.workunit.client.0.smithi049.stdout:9/270: dread - d3/d14/d1a/d21/d31/f57 zero size 2024-09-19T09:02:50.652 INFO:tasks.workunit.client.1.smithi102.stdout:5/963: mknod d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/de0/c129 0 2024-09-19T09:02:50.653 INFO:tasks.workunit.client.0.smithi049.stdout:3/272: dread d10/f38 [0,4194304] 0 2024-09-19T09:02:50.656 INFO:tasks.workunit.client.1.smithi102.stdout:2/881: dwrite d7/d50/d64/d7f/d83/dc7/f108 [0,4194304] 0 2024-09-19T09:02:50.659 INFO:tasks.workunit.client.1.smithi102.stdout:1/915: unlink f9 0 2024-09-19T09:02:50.660 INFO:tasks.workunit.client.1.smithi102.stdout:8/893: write d0/d10/d21/d39/d50/f113 [3576185,84579] 0 2024-09-19T09:02:50.662 INFO:tasks.workunit.client.1.smithi102.stdout:8/894: read d0/d10/d21/d39/d87/f8c [4418355,99616] 0 2024-09-19T09:02:50.662 INFO:tasks.workunit.client.0.smithi049.stdout:9/271: dwrite d3/d14/f3f [4194304,4194304] 0 2024-09-19T09:02:50.664 INFO:tasks.workunit.client.0.smithi049.stdout:9/272: chown d3/d14/d34/d44/d4d/d58 8131526 1 2024-09-19T09:02:50.667 INFO:tasks.workunit.client.1.smithi102.stdout:2/882: chown d7/d1a/ldc 9706340 1 2024-09-19T09:02:50.668 INFO:tasks.workunit.client.1.smithi102.stdout:2/883: write d7/d1a/d2b/d31/d51/d6b/fbd [1432551,125056] 0 2024-09-19T09:02:50.670 INFO:tasks.workunit.client.1.smithi102.stdout:1/916: creat dd/d66/dea/f12a x:0 0 0 2024-09-19T09:02:50.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/273: truncate d3/d14/d1a/f35 1053971 0 2024-09-19T09:02:50.675 INFO:tasks.workunit.client.1.smithi102.stdout:2/884: creat d7/d1a/d2b/d31/d51/f133 x:0 0 0 2024-09-19T09:02:50.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/274: truncate d3/f1f 785128 0 2024-09-19T09:02:50.679 INFO:tasks.workunit.client.0.smithi049.stdout:9/275: dread d3/d14/d1a/d21/f41 [0,4194304] 0 2024-09-19T09:02:50.682 INFO:tasks.workunit.client.1.smithi102.stdout:8/895: dread d0/db/d104/d106/f117 [0,4194304] 0 2024-09-19T09:02:50.682 INFO:tasks.workunit.client.0.smithi049.stdout:3/273: read d10/d11/d13/f16 [305212,74428] 0 2024-09-19T09:02:50.684 INFO:tasks.workunit.client.1.smithi102.stdout:2/885: symlink d7/d1a/d2b/d31/d51/l134 0 2024-09-19T09:02:50.688 INFO:tasks.workunit.client.0.smithi049.stdout:9/276: creat d3/d14/d34/d44/d4d/f5e x:0 0 0 2024-09-19T09:02:50.689 INFO:tasks.workunit.client.0.smithi049.stdout:9/277: stat d3/d14/d34/d44/d4d/d58 0 2024-09-19T09:02:50.691 INFO:tasks.workunit.client.0.smithi049.stdout:3/274: creat d10/d11/d13/f5e x:0 0 0 2024-09-19T09:02:50.692 INFO:tasks.workunit.client.1.smithi102.stdout:8/896: mkdir d0/dd3/d12d 0 2024-09-19T09:02:50.694 INFO:tasks.workunit.client.1.smithi102.stdout:2/886: symlink d7/d50/d64/d7f/l135 0 2024-09-19T09:02:50.695 INFO:tasks.workunit.client.1.smithi102.stdout:2/887: readlink d7/d1a/d2b/d31/d106/l95 0 2024-09-19T09:02:50.697 INFO:tasks.workunit.client.1.smithi102.stdout:8/897: mknod d0/d10/d21/d39/db8/d109/c12e 0 2024-09-19T09:02:50.699 INFO:tasks.workunit.client.1.smithi102.stdout:2/888: write d7/d1a/d2b/dae/ff9 [143193,49955] 0 2024-09-19T09:02:50.700 INFO:tasks.workunit.client.1.smithi102.stdout:8/898: mknod d0/db/d84/c12f 0 2024-09-19T09:02:50.701 INFO:tasks.workunit.client.0.smithi049.stdout:3/275: creat d10/d11/d27/f5f x:0 0 0 2024-09-19T09:02:50.702 INFO:tasks.workunit.client.1.smithi102.stdout:2/889: creat d7/d1a/d2b/dab/f136 x:0 0 0 2024-09-19T09:02:50.702 INFO:tasks.workunit.client.1.smithi102.stdout:1/917: dwrite dd/d7a/d8c/da6/ff8 [0,4194304] 0 2024-09-19T09:02:50.703 INFO:tasks.workunit.client.0.smithi049.stdout:9/278: write d3/d14/f54 [745019,58381] 0 2024-09-19T09:02:50.704 INFO:tasks.workunit.client.1.smithi102.stdout:2/890: chown d7/d1a/d2b/d31/l59 6 1 2024-09-19T09:02:50.704 INFO:tasks.workunit.client.0.smithi049.stdout:9/279: readlink d3/d14/d1a/d21/d31/l52 0 2024-09-19T09:02:50.707 INFO:tasks.workunit.client.1.smithi102.stdout:8/899: symlink d0/db/d29/db5/l130 0 2024-09-19T09:02:50.707 INFO:tasks.workunit.client.1.smithi102.stdout:8/900: chown d0/d64/d10c/f118 114668 1 2024-09-19T09:02:50.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/280: unlink d3/d14/d34/d4c/f53 0 2024-09-19T09:02:50.709 INFO:tasks.workunit.client.1.smithi102.stdout:8/901: chown d0/db/d84/la0 0 1 2024-09-19T09:02:50.710 INFO:tasks.workunit.client.1.smithi102.stdout:8/902: chown d0/d10/d21/d39/d50/cd8 857 1 2024-09-19T09:02:50.711 INFO:tasks.workunit.client.1.smithi102.stdout:2/891: dwrite d7/d1a/d2b/d31/d51/f55 [0,4194304] 0 2024-09-19T09:02:50.712 INFO:tasks.workunit.client.1.smithi102.stdout:8/903: truncate d0/ff5 4317102 0 2024-09-19T09:02:50.713 INFO:tasks.workunit.client.1.smithi102.stdout:2/892: read - d7/d1a/d2b/dab/f11e zero size 2024-09-19T09:02:50.715 INFO:tasks.workunit.client.0.smithi049.stdout:9/281: rename d3/f2c to d3/d14/d1a/f5f 0 2024-09-19T09:02:50.715 INFO:tasks.workunit.client.0.smithi049.stdout:9/282: chown f1 1408791 1 2024-09-19T09:02:50.717 INFO:tasks.workunit.client.0.smithi049.stdout:3/276: write d10/f38 [3742709,93572] 0 2024-09-19T09:02:50.719 INFO:tasks.workunit.client.0.smithi049.stdout:3/277: truncate d10/d11/d27/f45 360714 0 2024-09-19T09:02:50.722 INFO:tasks.workunit.client.1.smithi102.stdout:2/893: creat d7/d1a/d2b/dae/de5/f137 x:0 0 0 2024-09-19T09:02:50.722 INFO:tasks.workunit.client.0.smithi049.stdout:9/283: read d3/d14/f51 [653101,72971] 0 2024-09-19T09:02:50.722 INFO:tasks.workunit.client.0.smithi049.stdout:9/284: chown d3/d22 169266 1 2024-09-19T09:02:50.724 INFO:tasks.workunit.client.0.smithi049.stdout:3/278: creat d10/d11/d27/d4f/f60 x:0 0 0 2024-09-19T09:02:50.725 INFO:tasks.workunit.client.0.smithi049.stdout:3/279: chown d10/d11/c25 39004654 1 2024-09-19T09:02:50.725 INFO:tasks.workunit.client.1.smithi102.stdout:1/918: write dd/d7a/da0/fcd [355655,72276] 0 2024-09-19T09:02:50.726 INFO:tasks.workunit.client.0.smithi049.stdout:3/280: dread - d10/d11/d27/f5f zero size 2024-09-19T09:02:50.727 INFO:tasks.workunit.client.0.smithi049.stdout:3/281: chown d10/d11/d27/f2c 17401 1 2024-09-19T09:02:50.728 INFO:tasks.workunit.client.0.smithi049.stdout:9/285: unlink d3/c16 0 2024-09-19T09:02:50.730 INFO:tasks.workunit.client.1.smithi102.stdout:8/904: rmdir d0/d10/d21/d39/d50/dd4 0 2024-09-19T09:02:50.733 INFO:tasks.workunit.client.0.smithi049.stdout:3/282: creat d10/d11/d13/d30/f61 x:0 0 0 2024-09-19T09:02:50.735 INFO:tasks.workunit.client.1.smithi102.stdout:2/894: mknod d7/d1a/d2b/dab/de2/df7/d10c/c138 0 2024-09-19T09:02:50.739 INFO:tasks.workunit.client.1.smithi102.stdout:2/895: creat d7/d50/d64/da1/d115/de1/f139 x:0 0 0 2024-09-19T09:02:50.739 INFO:tasks.workunit.client.0.smithi049.stdout:3/283: symlink d10/d11/d27/d4f/d59/l62 0 2024-09-19T09:02:50.740 INFO:tasks.workunit.client.0.smithi049.stdout:9/286: dread d3/f28 [0,4194304] 0 2024-09-19T09:02:50.741 INFO:tasks.workunit.client.1.smithi102.stdout:2/896: mknod d7/d50/d64/da1/c13a 0 2024-09-19T09:02:50.741 INFO:tasks.workunit.client.0.smithi049.stdout:3/284: write d10/d11/f39 [3391974,128117] 0 2024-09-19T09:02:50.744 INFO:tasks.workunit.client.1.smithi102.stdout:8/905: rename d0/d4f to d0/d131 0 2024-09-19T09:02:50.750 INFO:tasks.workunit.client.0.smithi049.stdout:9/287: rename d3/d14/d34/f3d to d3/d14/d1a/d21/d31/f60 0 2024-09-19T09:02:50.752 INFO:tasks.workunit.client.1.smithi102.stdout:8/906: fdatasync d0/d131/f81 0 2024-09-19T09:02:50.753 INFO:tasks.workunit.client.0.smithi049.stdout:3/285: symlink d10/d11/d13/l63 0 2024-09-19T09:02:50.755 INFO:tasks.workunit.client.1.smithi102.stdout:1/919: creat dd/d14/d35/d49/f12b x:0 0 0 2024-09-19T09:02:50.758 INFO:tasks.workunit.client.0.smithi049.stdout:9/288: dwrite d3/d14/f54 [0,4194304] 0 2024-09-19T09:02:50.760 INFO:tasks.workunit.client.0.smithi049.stdout:9/289: write d3/d14/d1a/d21/d31/f57 [68592,124465] 0 2024-09-19T09:02:50.763 INFO:tasks.workunit.client.1.smithi102.stdout:9/950: sync 2024-09-19T09:02:50.764 INFO:tasks.workunit.client.1.smithi102.stdout:2/897: truncate d7/ff 1650122 0 2024-09-19T09:02:50.765 INFO:tasks.workunit.client.0.smithi049.stdout:3/286: mknod d10/d11/c64 0 2024-09-19T09:02:50.765 INFO:tasks.workunit.client.1.smithi102.stdout:9/951: write d1/df3/f136 [887683,76196] 0 2024-09-19T09:02:50.766 INFO:tasks.workunit.client.1.smithi102.stdout:1/920: creat dd/dd5/df1/f12c x:0 0 0 2024-09-19T09:02:50.766 INFO:tasks.workunit.client.1.smithi102.stdout:8/907: truncate d0/d10/d21/d39/d50/d63/fb9 632456 0 2024-09-19T09:02:50.767 INFO:tasks.workunit.client.0.smithi049.stdout:9/290: write d3/d14/d1a/d21/d31/f60 [1046707,105139] 0 2024-09-19T09:02:50.767 INFO:tasks.workunit.client.1.smithi102.stdout:9/952: fsync d1/d2/d78/f7d 0 2024-09-19T09:02:50.768 INFO:tasks.workunit.client.1.smithi102.stdout:1/921: read - dd/d68/f10d zero size 2024-09-19T09:02:50.768 INFO:tasks.workunit.client.1.smithi102.stdout:2/898: fdatasync d7/d50/d64/d7f/fa9 0 2024-09-19T09:02:50.769 INFO:tasks.workunit.client.1.smithi102.stdout:2/899: fdatasync d7/d1a/d2b/f81 0 2024-09-19T09:02:50.769 INFO:tasks.workunit.client.1.smithi102.stdout:8/908: mkdir d0/dd3/d132 0 2024-09-19T09:02:50.770 INFO:tasks.workunit.client.0.smithi049.stdout:9/291: unlink d3/lc 0 2024-09-19T09:02:50.777 INFO:tasks.workunit.client.0.smithi049.stdout:9/292: creat d3/d14/d1a/f61 x:0 0 0 2024-09-19T09:02:50.778 INFO:tasks.workunit.client.1.smithi102.stdout:9/953: rename d1/d2/d3/fee to d1/d2/d3/d1d/dc7/f139 0 2024-09-19T09:02:50.780 INFO:tasks.workunit.client.1.smithi102.stdout:2/900: mkdir d7/d50/d64/d7f/d83/dc7/d13b 0 2024-09-19T09:02:50.781 INFO:tasks.workunit.client.1.smithi102.stdout:2/901: truncate d7/d1a/d2b/dae/ff9 990470 0 2024-09-19T09:02:50.783 INFO:tasks.workunit.client.1.smithi102.stdout:9/954: mkdir d1/d2/d78/da0/dc0/d13a 0 2024-09-19T09:02:50.784 INFO:tasks.workunit.client.0.smithi049.stdout:9/293: dwrite d3/d14/d34/d44/f4b [0,4194304] 0 2024-09-19T09:02:50.789 INFO:tasks.workunit.client.0.smithi049.stdout:3/287: dread fc [0,4194304] 0 2024-09-19T09:02:50.791 INFO:tasks.workunit.client.1.smithi102.stdout:2/902: creat d7/d1a/d2b/dab/de2/d11b/f13c x:0 0 0 2024-09-19T09:02:50.798 INFO:tasks.workunit.client.1.smithi102.stdout:2/903: dwrite d7/d1a/d2b/f82 [0,4194304] 0 2024-09-19T09:02:50.799 INFO:tasks.workunit.client.1.smithi102.stdout:1/922: getdents dd/d14/d35/d49/d62/d6c/d99/db8 0 2024-09-19T09:02:50.801 INFO:tasks.workunit.client.1.smithi102.stdout:8/909: dwrite d0/d10/d21/f2e [0,4194304] 0 2024-09-19T09:02:50.803 INFO:tasks.workunit.client.0.smithi049.stdout:9/294: link d3/d14/d1a/d21/f41 d3/d14/d1a/d21/d31/f62 0 2024-09-19T09:02:50.803 INFO:tasks.workunit.client.1.smithi102.stdout:8/910: write d0/d10/d21/db3/fdc [3248296,94066] 0 2024-09-19T09:02:50.804 INFO:tasks.workunit.client.0.smithi049.stdout:3/288: rmdir d10/d11/d13/d56 0 2024-09-19T09:02:50.810 INFO:tasks.workunit.client.1.smithi102.stdout:1/923: dwrite dd/d14/d35/d49/d62/d9e/dab/de7/df7/f108 [0,4194304] 0 2024-09-19T09:02:50.816 INFO:tasks.workunit.client.0.smithi049.stdout:3/289: dread d10/d11/d13/d30/f31 [0,4194304] 0 2024-09-19T09:02:50.818 INFO:tasks.workunit.client.1.smithi102.stdout:2/904: getdents d7/d1a/d56/db9 0 2024-09-19T09:02:50.818 INFO:tasks.workunit.client.0.smithi049.stdout:9/295: getdents d3/d14/d34/d44/d4d 0 2024-09-19T09:02:50.819 INFO:tasks.workunit.client.1.smithi102.stdout:2/905: write d7/d11/f123 [435591,46169] 0 2024-09-19T09:02:50.819 INFO:tasks.workunit.client.0.smithi049.stdout:9/296: write d3/d14/d1a/f61 [11341,28450] 0 2024-09-19T09:02:50.820 INFO:tasks.workunit.client.1.smithi102.stdout:1/924: mkdir dd/d7a/d8c/d12d 0 2024-09-19T09:02:50.820 INFO:tasks.workunit.client.0.smithi049.stdout:9/297: chown d3/c5a 194374 1 2024-09-19T09:02:50.821 INFO:tasks.workunit.client.1.smithi102.stdout:8/911: getdents d0/d131/dc1 0 2024-09-19T09:02:50.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/290: creat d10/d11/d27/f65 x:0 0 0 2024-09-19T09:02:50.824 INFO:tasks.workunit.client.1.smithi102.stdout:8/912: unlink d0/d10/d21/f25 0 2024-09-19T09:02:50.826 INFO:tasks.workunit.client.1.smithi102.stdout:1/925: truncate dd/d7a/d8c/d8e/d103/d78/fb1 1247314 0 2024-09-19T09:02:50.827 INFO:tasks.workunit.client.0.smithi049.stdout:9/298: rename d3/d14/d1a/c33 to d3/d14/d1a/d21/c63 0 2024-09-19T09:02:50.829 INFO:tasks.workunit.client.1.smithi102.stdout:8/913: creat d0/d64/d10c/f133 x:0 0 0 2024-09-19T09:02:50.829 INFO:tasks.workunit.client.0.smithi049.stdout:3/291: read d10/d11/f39 [1402925,78865] 0 2024-09-19T09:02:50.830 INFO:tasks.workunit.client.0.smithi049.stdout:9/299: mknod d3/d22/c64 0 2024-09-19T09:02:50.831 INFO:tasks.workunit.client.1.smithi102.stdout:8/914: dread - d0/d10/d21/d39/f12a zero size 2024-09-19T09:02:50.831 INFO:tasks.workunit.client.0.smithi049.stdout:9/300: read d3/d14/d1a/f25 [2398391,1731] 0 2024-09-19T09:02:50.832 INFO:tasks.workunit.client.1.smithi102.stdout:2/906: getdents d7/d1a/d56 0 2024-09-19T09:02:50.833 INFO:tasks.workunit.client.0.smithi049.stdout:9/301: fsync d3/d14/d1a/d21/d31/f57 0 2024-09-19T09:02:50.834 INFO:tasks.workunit.client.0.smithi049.stdout:3/292: unlink d10/f1d 0 2024-09-19T09:02:50.842 INFO:tasks.workunit.client.1.smithi102.stdout:8/915: mkdir d0/d10/d21/d39/d50/da2/d127/d134 0 2024-09-19T09:02:50.843 INFO:tasks.workunit.client.1.smithi102.stdout:8/916: readlink d0/d64/l10f 0 2024-09-19T09:02:50.847 INFO:tasks.workunit.client.1.smithi102.stdout:2/907: link d7/d50/d64/da1/d115/f131 d7/d50/d64/da1/dd6/f13d 0 2024-09-19T09:02:50.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/293: dread fd [0,4194304] 0 2024-09-19T09:02:50.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/294: dread - d10/d11/d13/f5e zero size 2024-09-19T09:02:50.851 INFO:tasks.workunit.client.1.smithi102.stdout:8/917: dread - d0/d10/d21/d39/d50/d63/fbc zero size 2024-09-19T09:02:50.852 INFO:tasks.workunit.client.1.smithi102.stdout:1/926: dwrite dd/d68/f9a [0,4194304] 0 2024-09-19T09:02:50.853 INFO:tasks.workunit.client.1.smithi102.stdout:2/908: write d7/d1a/d2b/dab/fdb [14550309,21422] 0 2024-09-19T09:02:50.854 INFO:tasks.workunit.client.1.smithi102.stdout:2/909: read - d7/d1a/d2b/d31/fb0 zero size 2024-09-19T09:02:50.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/302: write d3/f28 [438457,55976] 0 2024-09-19T09:02:50.854 INFO:tasks.workunit.client.0.smithi049.stdout:3/295: write d10/d11/d13/f16 [2473322,111221] 0 2024-09-19T09:02:50.857 INFO:tasks.workunit.client.0.smithi049.stdout:3/296: write d10/d11/d27/f65 [216853,67267] 0 2024-09-19T09:02:50.857 INFO:tasks.workunit.client.1.smithi102.stdout:1/927: mknod dd/d7a/c12e 0 2024-09-19T09:02:50.858 INFO:tasks.workunit.client.0.smithi049.stdout:3/297: fdatasync d10/f15 0 2024-09-19T09:02:50.859 INFO:tasks.workunit.client.1.smithi102.stdout:8/918: fsync d0/d10/d21/d39/d50/d63/d83/dd9/fef 0 2024-09-19T09:02:50.861 INFO:tasks.workunit.client.0.smithi049.stdout:9/303: rename d3/d14/d1a/d21/d31/c46 to d3/d14/d34/c65 0 2024-09-19T09:02:50.863 INFO:tasks.workunit.client.0.smithi049.stdout:9/304: truncate d3/d14/d1a/d21/d31/f60 2042061 0 2024-09-19T09:02:50.864 INFO:tasks.workunit.client.1.smithi102.stdout:1/928: dwrite dd/d66/dea/f102 [0,4194304] 0 2024-09-19T09:02:50.865 INFO:tasks.workunit.client.1.smithi102.stdout:5/964: sync 2024-09-19T09:02:50.865 INFO:tasks.workunit.client.1.smithi102.stdout:6/889: sync 2024-09-19T09:02:50.866 INFO:tasks.workunit.client.1.smithi102.stdout:2/910: rename d7/d1a/d2b/d31/d106/daf/l78 to d7/l13e 0 2024-09-19T09:02:50.868 INFO:tasks.workunit.client.1.smithi102.stdout:1/929: write dd/d13/f36 [8538066,74563] 0 2024-09-19T09:02:50.868 INFO:tasks.workunit.client.1.smithi102.stdout:8/919: dwrite d0/d131/f74 [0,4194304] 0 2024-09-19T09:02:50.871 INFO:tasks.workunit.client.0.smithi049.stdout:9/305: dwrite d3/d14/d1a/d21/d31/f60 [0,4194304] 0 2024-09-19T09:02:50.873 INFO:tasks.workunit.client.1.smithi102.stdout:6/890: dwrite d1/d18/d37/fd5 [0,4194304] 0 2024-09-19T09:02:50.879 INFO:tasks.workunit.client.1.smithi102.stdout:9/955: sync 2024-09-19T09:02:50.885 INFO:tasks.workunit.client.0.smithi049.stdout:9/306: write d3/d14/f24 [1303711,59637] 0 2024-09-19T09:02:50.888 INFO:tasks.workunit.client.0.smithi049.stdout:3/298: getdents d10/d11/d27 0 2024-09-19T09:02:50.890 INFO:tasks.workunit.client.1.smithi102.stdout:1/930: symlink dd/d14/d35/d49/d7d/d7f/l12f 0 2024-09-19T09:02:50.892 INFO:tasks.workunit.client.1.smithi102.stdout:8/920: creat d0/d10/d21/d39/db8/d109/f135 x:0 0 0 2024-09-19T09:02:50.894 INFO:tasks.workunit.client.0.smithi049.stdout:9/307: unlink d3/l23 0 2024-09-19T09:02:50.896 INFO:tasks.workunit.client.1.smithi102.stdout:6/891: truncate d1/d26/d2e/dce/fdd 296569 0 2024-09-19T09:02:50.898 INFO:tasks.workunit.client.1.smithi102.stdout:5/965: creat d5/d8d/d95/f12a x:0 0 0 2024-09-19T09:02:50.899 INFO:tasks.workunit.client.1.smithi102.stdout:2/911: symlink d7/d11/dc8/dfa/l13f 0 2024-09-19T09:02:50.899 INFO:tasks.workunit.client.1.smithi102.stdout:9/956: dread d1/d2/d3/fc9 [0,4194304] 0 2024-09-19T09:02:50.900 INFO:tasks.workunit.client.1.smithi102.stdout:5/966: write d5/d7/d1a/d8f/f11f [2822468,69619] 0 2024-09-19T09:02:50.901 INFO:tasks.workunit.client.1.smithi102.stdout:6/892: rmdir d1/d26/d2e/d45/dac/db2/d118 39 2024-09-19T09:02:50.902 INFO:tasks.workunit.client.0.smithi049.stdout:9/308: dwrite d3/d14/d34/d44/d4d/f5e [0,4194304] 0 2024-09-19T09:02:50.903 INFO:tasks.workunit.client.1.smithi102.stdout:1/931: creat dd/d7a/d8c/d8e/d103/d78/d115/f130 x:0 0 0 2024-09-19T09:02:50.904 INFO:tasks.workunit.client.0.smithi049.stdout:3/299: getdents d10/d11/d13/d30 0 2024-09-19T09:02:50.905 INFO:tasks.workunit.client.1.smithi102.stdout:1/932: write dd/d7a/d8c/d8e/d103/d78/f11a [517152,5389] 0 2024-09-19T09:02:50.905 INFO:tasks.workunit.client.1.smithi102.stdout:9/957: dread d1/d2/d3/d6f/fc8 [0,4194304] 0 2024-09-19T09:02:50.906 INFO:tasks.workunit.client.1.smithi102.stdout:9/958: fsync d1/d2/d3/fa 0 2024-09-19T09:02:50.906 INFO:tasks.workunit.client.1.smithi102.stdout:2/912: write d7/d1a/d2b/dae/de5/f137 [787834,124328] 0 2024-09-19T09:02:50.907 INFO:tasks.workunit.client.1.smithi102.stdout:9/959: stat d1/ffb 0 2024-09-19T09:02:50.907 INFO:tasks.workunit.client.1.smithi102.stdout:5/967: mknod d5/d7/d1a/d37/d34/d4d/d9c/de9/c12b 0 2024-09-19T09:02:50.909 INFO:tasks.workunit.client.0.smithi049.stdout:3/300: rename d10/l47 to d10/d3d/l66 0 2024-09-19T09:02:50.911 INFO:tasks.workunit.client.0.smithi049.stdout:9/309: mkdir d3/d14/d1a/d21/d66 0 2024-09-19T09:02:50.913 INFO:tasks.workunit.client.0.smithi049.stdout:3/301: creat d10/d11/d13/f67 x:0 0 0 2024-09-19T09:02:50.913 INFO:tasks.workunit.client.0.smithi049.stdout:3/302: stat d10/l42 0 2024-09-19T09:02:50.915 INFO:tasks.workunit.client.1.smithi102.stdout:1/933: rename dd/d66/lc5 to dd/d14/d35/d49/d7d/d123/l131 0 2024-09-19T09:02:50.916 INFO:tasks.workunit.client.1.smithi102.stdout:9/960: truncate d1/d2/d7b/f46 1001496 0 2024-09-19T09:02:50.917 INFO:tasks.workunit.client.1.smithi102.stdout:8/921: getdents d0/d10/d21/d39/d50/d63/d83 0 2024-09-19T09:02:50.921 INFO:tasks.workunit.client.1.smithi102.stdout:5/968: rename d5/d7/d1a/d37/d34/d4d/lde to d5/d7/d1a/d37/d34/d4d/d9c/db8/dc6/de0/l12c 0 2024-09-19T09:02:50.923 INFO:tasks.workunit.client.1.smithi102.stdout:2/913: creat d7/d1a/d2b/d31/dde/f140 x:0 0 0 2024-09-19T09:02:50.924 INFO:tasks.workunit.client.0.smithi049.stdout:3/303: getdents d10/d11/d27/d4f/d59 0 2024-09-19T09:02:50.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/304: fdatasync d10/d11/d13/f5e 0 2024-09-19T09:02:50.925 INFO:tasks.workunit.client.1.smithi102.stdout:2/914: chown d7/d1a/d2b/d31/d106/daf/ce6 177220 1 2024-09-19T09:02:50.925 INFO:tasks.workunit.client.1.smithi102.stdout:2/915: truncate d7/d11/f123 515902 0 2024-09-19T09:02:50.926 INFO:tasks.workunit.client.1.smithi102.stdout:2/916: dread - d7/d1a/d56/f109 zero size 2024-09-19T09:02:50.926 INFO:tasks.workunit.client.1.smithi102.stdout:8/922: rename d0/d131/fe6 to d0/d10/d21/d39/d50/da2/d127/f136 0 2024-09-19T09:02:50.926 INFO:tasks.workunit.client.0.smithi049.stdout:7/335: sync 2024-09-19T09:02:50.927 INFO:tasks.workunit.client.1.smithi102.stdout:5/969: unlink d5/d7/d1a/de1/d78/l127 0 2024-09-19T09:02:50.929 INFO:tasks.workunit.client.1.smithi102.stdout:5/970: read d5/d7/d1b/f9e [4959637,15819] 0 2024-09-19T09:02:50.930 INFO:tasks.workunit.client.1.smithi102.stdout:5/971: stat d5/d7/d1a/d37/d34/f106 0 2024-09-19T09:02:50.936 INFO:tasks.workunit.client.1.smithi102.stdout:6/893: dwrite d1/d26/f85 [0,4194304] 0 2024-09-19T09:02:50.945 INFO:tasks.workunit.client.1.smithi102.stdout:6/894: dwrite d1/d26/d2e/d45/daf/d8d/f11e [0,4194304] 0 2024-09-19T09:02:50.947 INFO:tasks.workunit.client.0.smithi049.stdout:3/305: rmdir d10/d11/d27/d52 0 2024-09-19T09:02:50.950 INFO:tasks.workunit.client.1.smithi102.stdout:1/934: creat dd/d14/d35/d49/d62/d6c/d99/f132 x:0 0 0 2024-09-19T09:02:50.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/336: getdents d1 0 2024-09-19T09:02:50.958 INFO:tasks.workunit.client.1.smithi102.stdout:8/923: creat d0/d131/de8/dfa/f137 x:0 0 0 2024-09-19T09:02:50.959 INFO:tasks.workunit.client.0.smithi049.stdout:7/337: write d1/d8/d19/f46 [7006370,127197] 0 2024-09-19T09:02:50.966 INFO:tasks.workunit.client.1.smithi102.stdout:6/895: truncate d1/d26/d2e/d45/daf/d8d/faa 174045 0 2024-09-19T09:02:50.966 INFO:tasks.workunit.client.1.smithi102.stdout:5/972: write d5/d7/d1a/d37/d34/d7f/d91/f108 [267066,120677] 0 2024-09-19T09:02:50.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.970+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1001039b0 con 0x7fa0ec06d8e0 2024-09-19T09:02:50.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.971+0000 7fa0f77fe640 1 -- 172.21.15.49:0/1304276170 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fa1001039b0 con 0x7fa0ec06d8e0 2024-09-19T09:02:50.971 INFO:tasks.workunit.client.1.smithi102.stdout:2/917: mknod d7/d50/c141 0 2024-09-19T09:02:50.971 INFO:tasks.workunit.client.1.smithi102.stdout:9/961: sync 2024-09-19T09:02:50.973 INFO:tasks.workunit.client.1.smithi102.stdout:8/924: read d0/d10/d21/d39/d87/f8c [7493440,69350] 0 2024-09-19T09:02:50.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa0ec06d8e0 msgr2=0x7fa0ec06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa0ec06d8e0 0x7fa0ec06fda0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa100102800 tx=0x7fa0f0005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 msgr2=0x7fa100102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa100102a80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009230 tx=0x7fa0fc0045e0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 shutdown_connections 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa0ec06d8e0 0x7fa0ec06fda0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1000ffcf0 0x7fa1001010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 --2- 172.21.15.49:0/1304276170 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1000feaf0 0x7fa100102a80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 >> 172.21.15.49:0/1304276170 conn(0x7fa1000fa280 msgr2=0x7fa1000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 shutdown_connections 2024-09-19T09:02:50.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:50.974+0000 7fa1086b5640 1 -- 172.21.15.49:0/1304276170 wait complete. 2024-09-19T09:02:50.975 INFO:tasks.workunit.client.1.smithi102.stdout:8/925: chown d0/d10/d21/d39/db8/d109 0 1 2024-09-19T09:02:50.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/306: creat d10/d11/d27/f68 x:0 0 0 2024-09-19T09:02:50.975 INFO:tasks.workunit.client.0.smithi049.stdout:7/338: link d1/d7/c5f d1/d53/c71 0 2024-09-19T09:02:50.976 INFO:tasks.workunit.client.1.smithi102.stdout:9/962: dwrite d1/d2/d3/d1d/d4f/d6d/f118 [0,4194304] 0 2024-09-19T09:02:50.977 INFO:tasks.workunit.client.1.smithi102.stdout:6/896: chown d1/d26/d2e/d45/d47/d4d/d35/d41/l125 4227 1 2024-09-19T09:02:50.977 INFO:tasks.workunit.client.1.smithi102.stdout:5/973: mknod d5/d60/c12d 0 2024-09-19T09:02:50.978 INFO:tasks.workunit.client.1.smithi102.stdout:6/897: chown d1/d26/d4b/d94/fa1 20964415 1 2024-09-19T09:02:50.979 INFO:tasks.workunit.client.1.smithi102.stdout:6/898: write d1/d26/d4b/d94/da2/f115 [500714,65053] 0 2024-09-19T09:02:50.980 INFO:tasks.workunit.client.1.smithi102.stdout:1/935: unlink dd/d14/d18/ldd 0 2024-09-19T09:02:50.983 INFO:tasks.workunit.client.1.smithi102.stdout:2/918: rmdir d7/d1a 39 2024-09-19T09:02:50.985 INFO:tasks.workunit.client.0.smithi049.stdout:7/339: mkdir d1/d8/d2d/d72 0 2024-09-19T09:02:50.986 INFO:tasks.workunit.client.1.smithi102.stdout:6/899: dwrite d1/d18/db/f31 [0,4194304] 0 2024-09-19T09:02:50.988 INFO:tasks.workunit.client.1.smithi102.stdout:9/963: mknod d1/d2/d3/d1d/c13b 0 2024-09-19T09:02:50.988 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:02:50.989 INFO:tasks.workunit.client.1.smithi102.stdout:2/919: write d7/d1a/d2b/dab/fdb [13241713,119618] 0 2024-09-19T09:02:50.991 INFO:tasks.workunit.client.0.smithi049.stdout:3/307: dread d10/d11/d13/f16 [0,4194304] 0 2024-09-19T09:02:50.991 INFO:tasks.workunit.client.0.smithi049.stdout:7/340: mknod d1/d1a/c73 0 2024-09-19T09:02:50.991 INFO:tasks.workunit.client.1.smithi102.stdout:5/974: symlink d5/l12e 0 2024-09-19T09:02:50.995 INFO:tasks.workunit.client.0.smithi049.stdout:7/341: write d1/d8/d19/f46 [3280497,7491] 0 2024-09-19T09:02:50.999 INFO:tasks.workunit.client.0.smithi049.stdout:3/308: dwrite d10/f48 [0,4194304] 0 2024-09-19T09:02:51.001 INFO:tasks.workunit.client.0.smithi049.stdout:3/309: fsync d10/d11/d13/f67 0 2024-09-19T09:02:51.002 INFO:tasks.workunit.client.0.smithi049.stdout:7/342: symlink d1/d8/d19/l74 0 2024-09-19T09:02:51.004 INFO:tasks.workunit.client.1.smithi102.stdout:5/975: read - d5/d7/d1a/d37/d34/d73/fb9 zero size 2024-09-19T09:02:51.005 INFO:tasks.workunit.client.1.smithi102.stdout:9/964: mkdir d1/d2/d78/da0/dc0/d13a/d13c 0 2024-09-19T09:02:51.011 INFO:tasks.workunit.client.1.smithi102.stdout:6/900: creat d1/d26/d2e/d45/d47/d4d/f12a x:0 0 0 2024-09-19T09:02:51.011 INFO:tasks.workunit.client.1.smithi102.stdout:1/936: write dd/d14/d35/d49/d62/d6c/f8a [386153,108401] 0 2024-09-19T09:02:51.013 INFO:tasks.workunit.client.1.smithi102.stdout:5/976: rename d5/d7/d1a/f58 to d5/d7/d1a/d37/d34/d4d/f12f 0 2024-09-19T09:02:51.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/343: fsync d1/d53/d18/d59/f29 0 2024-09-19T09:02:51.016 INFO:tasks.workunit.client.1.smithi102.stdout:9/965: creat d1/d2/d7b/f13d x:0 0 0 2024-09-19T09:02:51.020 INFO:tasks.workunit.client.1.smithi102.stdout:6/901: creat d1/d3a/f12b x:0 0 0 2024-09-19T09:02:51.022 INFO:tasks.workunit.client.1.smithi102.stdout:1/937: rmdir dd/d14/d35/d49/dcb 39 2024-09-19T09:02:51.024 INFO:tasks.workunit.client.0.smithi049.stdout:3/310: dread d10/d3d/d46/f4c [0,4194304] 0 2024-09-19T09:02:51.024 INFO:tasks.workunit.client.1.smithi102.stdout:2/920: dwrite d7/d1a/d56/f97 [0,4194304] 0 2024-09-19T09:02:51.026 INFO:tasks.workunit.client.1.smithi102.stdout:2/921: chown d7/d1a/d2b/dab/de2/df7/d10c 7141 1 2024-09-19T09:02:51.027 INFO:tasks.workunit.client.1.smithi102.stdout:9/966: mkdir d1/d2/d3/d1d/dc7/d13e 0 2024-09-19T09:02:51.027 INFO:tasks.workunit.client.1.smithi102.stdout:9/967: fdatasync d1/d2/d78/f7d 0 2024-09-19T09:02:51.032 INFO:tasks.workunit.client.1.smithi102.stdout:2/922: dwrite d7/d50/d64/d7f/d83/dc7/f108 [0,4194304] 0 2024-09-19T09:02:51.032 INFO:tasks.workunit.client.1.smithi102.stdout:6/902: rmdir d1/d26/d4b 39 2024-09-19T09:02:51.034 INFO:tasks.workunit.client.1.smithi102.stdout:2/923: write d7/d1a/d56/db9/f119 [8977,51136] 0 2024-09-19T09:02:51.036 INFO:tasks.workunit.client.0.smithi049.stdout:7/344: rename d1/d8/d2d/f5a to d1/d53/f75 0 2024-09-19T09:02:51.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/345: write d1/d8/fb [1269005,116579] 0 2024-09-19T09:02:51.039 INFO:tasks.workunit.client.0.smithi049.stdout:3/311: mknod d10/d3d/d51/c69 0 2024-09-19T09:02:51.044 INFO:tasks.workunit.client.1.smithi102.stdout:9/968: unlink d1/d2/d3/d1d/d4f/d6d/lb0 0 2024-09-19T09:02:51.049 INFO:tasks.workunit.client.1.smithi102.stdout:6/903: stat d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/de8/c11c 0 2024-09-19T09:02:51.051 INFO:tasks.workunit.client.1.smithi102.stdout:2/924: mknod d7/d1a/d2b/d31/d111/c142 0 2024-09-19T09:02:51.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/312: dread d10/f34 [0,4194304] 0 2024-09-19T09:02:51.053 INFO:tasks.workunit.client.1.smithi102.stdout:1/938: truncate dd/d5f/f96 320750 0 2024-09-19T09:02:51.055 INFO:tasks.workunit.client.1.smithi102.stdout:9/969: mknod d1/d2/d3/d1d/d4f/d6d/d81/dd3/c13f 0 2024-09-19T09:02:51.057 INFO:tasks.workunit.client.0.smithi049.stdout:3/313: symlink d10/d3d/d46/l6a 0 2024-09-19T09:02:51.057 INFO:tasks.workunit.client.1.smithi102.stdout:8/926: sync 2024-09-19T09:02:51.057 INFO:tasks.workunit.client.1.smithi102.stdout:8/927: readlink d0/db/l32 0 2024-09-19T09:02:51.058 INFO:tasks.workunit.client.1.smithi102.stdout:5/977: unlink d5/d7/d1a/d37/d39/d81/lc9 0 2024-09-19T09:02:51.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/346: getdents d1/d8/d19 0 2024-09-19T09:02:51.060 INFO:tasks.workunit.client.1.smithi102.stdout:6/904: mkdir d1/d3a/d12c 0 2024-09-19T09:02:51.060 INFO:tasks.workunit.client.0.smithi049.stdout:7/347: read d1/f2 [5930042,11012] 0 2024-09-19T09:02:51.061 INFO:tasks.workunit.client.0.smithi049.stdout:3/314: creat d10/d3d/f6b x:0 0 0 2024-09-19T09:02:51.063 INFO:tasks.workunit.client.0.smithi049.stdout:3/315: chown d10/c54 954 1 2024-09-19T09:02:51.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/348: write d1/d53/d18/d59/f33 [2497557,50506] 0 2024-09-19T09:02:51.063 INFO:tasks.workunit.client.0.smithi049.stdout:3/316: chown d10 1319 1 2024-09-19T09:02:51.063 INFO:tasks.workunit.client.1.smithi102.stdout:2/925: rmdir d7/d1a/d2b/d31/d106/d93/dce 39 2024-09-19T09:02:51.066 INFO:tasks.workunit.client.1.smithi102.stdout:9/970: dread - d1/d2/d3/d6f/d8d/fcc zero size 2024-09-19T09:02:51.067 INFO:tasks.workunit.client.1.smithi102.stdout:9/971: chown d1/d2/d3/d6f/d8d/da2/db6/lfc 7245 1 2024-09-19T09:02:51.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/317: dread d10/d11/d13/f18 [0,4194304] 0 2024-09-19T09:02:51.068 INFO:tasks.workunit.client.1.smithi102.stdout:9/972: chown d1/d2/d3/d1d/d4f/d6d/f9e 11248589 1 2024-09-19T09:02:51.069 INFO:tasks.workunit.client.1.smithi102.stdout:8/928: mkdir d0/d10/d21/d39/d50/da2/d127/d138 0 2024-09-19T09:02:51.070 INFO:tasks.workunit.client.1.smithi102.stdout:8/929: chown d0/d10/d21/d39/d50/d63/ff6 8 1 2024-09-19T09:02:51.072 INFO:tasks.workunit.client.0.smithi049.stdout:3/318: symlink d10/d3d/d46/l6c 0 2024-09-19T09:02:51.073 INFO:tasks.workunit.client.1.smithi102.stdout:6/905: mkdir d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/d12d 0 2024-09-19T09:02:51.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/319: dread d10/d11/d13/f14 [4194304,4194304] 0 2024-09-19T09:02:51.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.100+0000 7fa1fbfff640 1 -- 172.21.15.49:0/271121923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f40051f0 con 0x7fa204102fd0 2024-09-19T09:02:51.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.101+0000 7fa20b6a6640 1 -- 172.21.15.49:0/271121923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 msgr2=0x7fa2041053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.101+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/271121923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2041053c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009880 tx=0x7fa1f402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.101+0000 7fa20b6a6640 1 -- 172.21.15.49:0/271121923 shutdown_connections 2024-09-19T09:02:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.101+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/271121923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2041053c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.101+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/271121923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041006a0 0x7fa204102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.101+0000 7fa20b6a6640 1 -- 172.21.15.49:0/271121923 >> 172.21.15.49:0/271121923 conn(0x7fa2040fa280 msgr2=0x7fa2040fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.102+0000 7fa20b6a6640 1 -- 172.21.15.49:0/271121923 shutdown_connections 2024-09-19T09:02:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.102+0000 7fa20b6a6640 1 -- 172.21.15.49:0/271121923 wait complete. 2024-09-19T09:02:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.103+0000 7fa20b6a6640 1 Processor -- start 2024-09-19T09:02:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.103+0000 7fa20b6a6640 1 -- start start 2024-09-19T09:02:51.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.103+0000 7fa20b6a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041006a0 0x7fa204100000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa20b6a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2040fe650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa20b6a6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040feb90 con 0x7fa204102fd0 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa20b6a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040fed00 con 0x7fa2041006a0 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa208c41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2040fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa208c41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2040fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38100/0 (socket says 172.21.15.49:38100) 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa208c41640 1 -- 172.21.15.49:0/2586698559 learned_addr learned my addr 172.21.15.49:0/2586698559 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa209442640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041006a0 0x7fa204100000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa208c41640 1 -- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041006a0 msgr2=0x7fa204100000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa208c41640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041006a0 0x7fa204100000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa208c41640 1 -- 172.21.15.49:0/2586698559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009560 con 0x7fa204102fd0 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.104+0000 7fa208c41640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2040fe650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006010 tx=0x7fa1f4004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.105+0000 7fa1fa7fc640 1 -- 172.21.15.49:0/2586698559 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f4004430 con 0x7fa204102fd0 2024-09-19T09:02:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.105+0000 7fa1fa7fc640 1 -- 172.21.15.49:0/2586698559 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1f4004e80 con 0x7fa204102fd0 2024-09-19T09:02:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.105+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2040fef80 con 0x7fa204102fd0 2024-09-19T09:02:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.105+0000 7fa1fa7fc640 1 -- 172.21.15.49:0/2586698559 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f4031ae0 con 0x7fa204102fd0 2024-09-19T09:02:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.105+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2040ff470 con 0x7fa204102fd0 2024-09-19T09:02:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.106+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2041087d0 con 0x7fa204102fd0 2024-09-19T09:02:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.107+0000 7fa1fa7fc640 1 -- 172.21.15.49:0/2586698559 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fa1f4031c40 con 0x7fa204102fd0 2024-09-19T09:02:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.107+0000 7fa1fa7fc640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa1f006d8a0 0x7fa1f006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.107+0000 7fa1fa7fc640 1 -- 172.21.15.49:0/2586698559 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa1f40ae2a0 con 0x7fa204102fd0 2024-09-19T09:02:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.108+0000 7fa209442640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa1f006d8a0 0x7fa1f006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.108+0000 7fa209442640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa1f006d8a0 0x7fa1f006fd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa20000bbe0 tx=0x7fa20000b390 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.112+0000 7fa1fa7fc640 1 -- 172.21.15.49:0/2586698559 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fa1f40778d0 con 0x7fa204102fd0 2024-09-19T09:02:51.140 INFO:tasks.workunit.client.1.smithi102.stdout:2/926: rmdir d7/d50/d64/da1/d115 39 2024-09-19T09:02:51.173 INFO:tasks.workunit.client.0.smithi049.stdout:3/320: unlink d10/d11/d13/d30/l5a 0 2024-09-19T09:02:51.175 INFO:tasks.workunit.client.1.smithi102.stdout:9/973: fdatasync d1/d8/d1c/ff5 0 2024-09-19T09:02:51.179 INFO:tasks.workunit.client.1.smithi102.stdout:8/930: creat d0/d131/f139 x:0 0 0 2024-09-19T09:02:51.185 INFO:tasks.workunit.client.1.smithi102.stdout:1/939: link f0 dd/d7a/d8c/d8e/d103/ddc/de3/f133 0 2024-09-19T09:02:51.186 INFO:tasks.workunit.client.1.smithi102.stdout:6/906: dwrite d1/d26/d4b/f51 [0,4194304] 0 2024-09-19T09:02:51.191 INFO:tasks.workunit.client.0.smithi049.stdout:3/321: dread d10/d11/f3a [4194304,4194304] 0 2024-09-19T09:02:51.191 INFO:tasks.workunit.client.1.smithi102.stdout:9/974: mknod d1/d2/d3/d6f/d8d/da2/d106/c140 0 2024-09-19T09:02:51.192 INFO:tasks.workunit.client.1.smithi102.stdout:8/931: fdatasync d0/d10/d21/d39/d50/d63/fca 0 2024-09-19T09:02:51.198 INFO:tasks.workunit.client.1.smithi102.stdout:8/932: dread d0/d10/d21/f2e [0,4194304] 0 2024-09-19T09:02:51.198 INFO:tasks.workunit.client.1.smithi102.stdout:9/975: dwrite d1/d2/d3/d6f/dcb/fd8 [0,4194304] 0 2024-09-19T09:02:51.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/322: creat d10/d11/d13/d30/f6d x:0 0 0 2024-09-19T09:02:51.201 INFO:tasks.workunit.client.1.smithi102.stdout:6/907: mkdir d1/d3a/d12e 0 2024-09-19T09:02:51.202 INFO:tasks.workunit.client.0.smithi049.stdout:3/323: creat d10/d11/d13/f6e x:0 0 0 2024-09-19T09:02:51.210 INFO:tasks.workunit.client.1.smithi102.stdout:2/927: rename d7/d50/d64/da1/d115/lb6 to d7/d1a/d2b/d4e/l143 0 2024-09-19T09:02:51.215 INFO:tasks.workunit.client.1.smithi102.stdout:5/978: dwrite d5/d7/d1a/d42/f66 [0,4194304] 0 2024-09-19T09:02:51.217 INFO:tasks.workunit.client.0.smithi049.stdout:3/324: link d10/d11/d13/l29 d10/d11/l6f 0 2024-09-19T09:02:51.218 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:50 smithi049 ceph-mon[28158]: pgmap v32: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 97 MiB/s rd, 263 MiB/s wr, 572 op/s 2024-09-19T09:02:51.220 INFO:tasks.workunit.client.1.smithi102.stdout:9/976: mknod d1/d8/d1c/c141 0 2024-09-19T09:02:51.227 INFO:tasks.workunit.client.1.smithi102.stdout:5/979: symlink d5/d60/dfd/l130 0 2024-09-19T09:02:51.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/325: link d10/d11/d13/f18 d10/f70 0 2024-09-19T09:02:51.231 INFO:tasks.workunit.client.1.smithi102.stdout:1/940: write dd/d7a/d8c/d8e/d103/d78/fb1 [772716,64103] 0 2024-09-19T09:02:51.231 INFO:tasks.workunit.client.1.smithi102.stdout:1/941: readlink dd/d14/d18/l1e 0 2024-09-19T09:02:51.233 INFO:tasks.workunit.client.0.smithi049.stdout:3/326: dread - d10/d11/d27/f43 zero size 2024-09-19T09:02:51.235 INFO:tasks.workunit.client.1.smithi102.stdout:9/977: creat d1/d2/d3/d1d/d4f/d6d/d81/d90/d115/f142 x:0 0 0 2024-09-19T09:02:51.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/327: write d10/d11/d13/f1f [3350349,99148] 0 2024-09-19T09:02:51.235 INFO:tasks.workunit.client.1.smithi102.stdout:9/978: fdatasync d1/d2/d3/d1d/d4f/f100 0 2024-09-19T09:02:51.238 INFO:tasks.workunit.client.1.smithi102.stdout:6/908: rmdir d1/d26/d2e/d45/dac/db2/d107 0 2024-09-19T09:02:51.240 INFO:tasks.workunit.client.0.smithi049.stdout:3/328: dread fc [4194304,4194304] 0 2024-09-19T09:02:51.241 INFO:tasks.workunit.client.1.smithi102.stdout:8/933: link d0/d10/d21/d39/d50/d63/d83/ca1 d0/d131/daa/c13a 0 2024-09-19T09:02:51.241 INFO:tasks.workunit.client.1.smithi102.stdout:1/942: chown dd/f12 0 1 2024-09-19T09:02:51.241 INFO:tasks.workunit.client.1.smithi102.stdout:9/979: write d1/d2/d3/ff2 [2568317,129728] 0 2024-09-19T09:02:51.242 INFO:tasks.workunit.client.1.smithi102.stdout:6/909: mkdir d1/d26/d2e/d45/dac/d12f 0 2024-09-19T09:02:51.242 INFO:tasks.workunit.client.1.smithi102.stdout:5/980: creat d5/f131 x:0 0 0 2024-09-19T09:02:51.247 INFO:tasks.workunit.client.1.smithi102.stdout:2/928: truncate d7/d11/f1c 3861152 0 2024-09-19T09:02:51.248 INFO:tasks.workunit.client.1.smithi102.stdout:2/929: read - d7/d50/d64/da1/f12c zero size 2024-09-19T09:02:51.251 INFO:tasks.workunit.client.1.smithi102.stdout:5/981: creat d5/d60/db6/f132 x:0 0 0 2024-09-19T09:02:51.254 INFO:tasks.workunit.client.1.smithi102.stdout:1/943: dread dd/d14/f2a [0,4194304] 0 2024-09-19T09:02:51.255 INFO:tasks.workunit.client.1.smithi102.stdout:9/980: mkdir d1/d2/d3/d1d/d4f/d6d/d81/d143 0 2024-09-19T09:02:51.256 INFO:tasks.workunit.client.1.smithi102.stdout:8/934: symlink d0/d10/d21/d39/d50/da2/d127/d138/l13b 0 2024-09-19T09:02:51.257 INFO:tasks.workunit.client.1.smithi102.stdout:8/935: write d0/db/d1d/f8d [2338399,53138] 0 2024-09-19T09:02:51.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:50 smithi102 ceph-mon[35280]: pgmap v32: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 97 MiB/s rd, 263 MiB/s wr, 572 op/s 2024-09-19T09:02:51.260 INFO:tasks.workunit.client.1.smithi102.stdout:5/982: mkdir d5/d7/d133 0 2024-09-19T09:02:51.261 INFO:tasks.workunit.client.1.smithi102.stdout:5/983: readlink d5/d7/d1a/d37/d34/d73/lbc 0 2024-09-19T09:02:51.263 INFO:tasks.workunit.client.1.smithi102.stdout:9/981: symlink d1/d2/d3/d6f/d8d/da2/db6/l144 0 2024-09-19T09:02:51.264 INFO:tasks.workunit.client.1.smithi102.stdout:8/936: fsync d0/d10/d21/d39/d50/da2/d127/f136 0 2024-09-19T09:02:51.264 INFO:tasks.workunit.client.0.smithi049.stdout:3/329: dwrite d10/d11/d13/f18 [4194304,4194304] 0 2024-09-19T09:02:51.265 INFO:tasks.workunit.client.1.smithi102.stdout:8/937: write d0/d10/d21/d39/d87/fc5 [31157,91127] 0 2024-09-19T09:02:51.265 INFO:tasks.workunit.client.1.smithi102.stdout:6/910: link d1/d26/d2e/fde d1/d26/d4b/d94/da2/f130 0 2024-09-19T09:02:51.271 INFO:tasks.workunit.client.1.smithi102.stdout:5/984: rmdir d5/d7/d1a/d37/d34 39 2024-09-19T09:02:51.273 INFO:tasks.workunit.client.1.smithi102.stdout:1/944: getdents dd/d14/d35/d49/d62/d6c/d99/db8 0 2024-09-19T09:02:51.274 INFO:tasks.workunit.client.1.smithi102.stdout:1/945: dread - dd/d14/d35/d49/d7d/ffe zero size 2024-09-19T09:02:51.274 INFO:tasks.workunit.client.0.smithi049.stdout:3/330: truncate d10/d11/d27/f65 467386 0 2024-09-19T09:02:51.276 INFO:tasks.workunit.client.0.smithi049.stdout:3/331: write d10/d3d/f6b [566373,101631] 0 2024-09-19T09:02:51.276 INFO:tasks.workunit.client.1.smithi102.stdout:2/930: creat d7/d50/d64/f144 x:0 0 0 2024-09-19T09:02:51.281 INFO:tasks.workunit.client.1.smithi102.stdout:1/946: dwrite dd/f1d [0,4194304] 0 2024-09-19T09:02:51.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/332: rmdir d10/d11/d13/d30 39 2024-09-19T09:02:51.291 INFO:tasks.workunit.client.1.smithi102.stdout:9/982: truncate d1/f45 3164970 0 2024-09-19T09:02:51.293 INFO:tasks.workunit.client.1.smithi102.stdout:2/931: mknod d7/d1a/d2b/d31/d106/c145 0 2024-09-19T09:02:51.294 INFO:tasks.workunit.client.1.smithi102.stdout:2/932: chown d7/d1a/d56/db9/fdd 90119618 1 2024-09-19T09:02:51.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/333: creat d10/d11/d27/f71 x:0 0 0 2024-09-19T09:02:51.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/334: link d10/d11/c35 d10/c72 0 2024-09-19T09:02:51.308 INFO:tasks.workunit.client.0.smithi049.stdout:3/335: dread d10/d11/f3a [4194304,4194304] 0 2024-09-19T09:02:51.309 INFO:tasks.workunit.client.0.smithi049.stdout:3/336: read d10/f38 [3808027,94112] 0 2024-09-19T09:02:51.313 INFO:tasks.workunit.client.1.smithi102.stdout:9/983: dread d1/d2/d3/d6f/f129 [0,4194304] 0 2024-09-19T09:02:51.331 INFO:tasks.workunit.client.0.smithi049.stdout:1/187: sync 2024-09-19T09:02:51.331 INFO:tasks.workunit.client.0.smithi049.stdout:6/157: sync 2024-09-19T09:02:51.334 INFO:tasks.workunit.client.0.smithi049.stdout:3/337: write d10/d11/d13/f28 [2847697,86910] 0 2024-09-19T09:02:51.336 INFO:tasks.workunit.client.0.smithi049.stdout:1/188: truncate d5/d6/d8/d13/f34 870771 0 2024-09-19T09:02:51.339 INFO:tasks.workunit.client.1.smithi102.stdout:1/947: mkdir dd/d14/d35/d49/d62/d9e/d134 0 2024-09-19T09:02:51.341 INFO:tasks.workunit.client.0.smithi049.stdout:6/158: dwrite dc/d12/f1e [0,4194304] 0 2024-09-19T09:02:51.342 INFO:tasks.workunit.client.1.smithi102.stdout:6/911: link d1/d18/f7e d1/d26/d2e/d45/d47/d4d/d35/d41/da4/f131 0 2024-09-19T09:02:51.342 INFO:tasks.workunit.client.1.smithi102.stdout:6/912: dread - d1/d18/fc0 zero size 2024-09-19T09:02:51.343 INFO:tasks.workunit.client.1.smithi102.stdout:9/984: unlink d1/d2/d7b/cbd 0 2024-09-19T09:02:51.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/189: unlink d5/d6/d8/d13/c18 0 2024-09-19T09:02:51.348 INFO:tasks.workunit.client.0.smithi049.stdout:3/338: fsync d10/d11/d13/d30/f40 0 2024-09-19T09:02:51.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/339: fdatasync d10/d11/d13/f28 0 2024-09-19T09:02:51.366 INFO:tasks.workunit.client.0.smithi049.stdout:3/340: truncate d10/d11/d13/d30/f3c 1795965 0 2024-09-19T09:02:51.370 INFO:tasks.workunit.client.0.smithi049.stdout:3/341: dread d10/d3d/d46/f4c [4194304,4194304] 0 2024-09-19T09:02:51.371 INFO:tasks.workunit.client.1.smithi102.stdout:2/933: dwrite d7/d1a/f8f [0,4194304] 0 2024-09-19T09:02:51.373 INFO:tasks.workunit.client.1.smithi102.stdout:8/938: getdents d0/d10/d21/d39/d50/deb 0 2024-09-19T09:02:51.375 INFO:tasks.workunit.client.1.smithi102.stdout:5/985: truncate d5/d7/d1a/d8f/dc0/f92 3274579 0 2024-09-19T09:02:51.375 INFO:tasks.workunit.client.1.smithi102.stdout:8/939: truncate d0/d10/d21/d39/d50/fed 646210 0 2024-09-19T09:02:51.376 INFO:tasks.workunit.client.0.smithi049.stdout:6/159: truncate dc/d16/f2d 1202814 0 2024-09-19T09:02:51.377 INFO:tasks.workunit.client.1.smithi102.stdout:1/948: write dd/d14/f2a [197448,51740] 0 2024-09-19T09:02:51.378 INFO:tasks.workunit.client.1.smithi102.stdout:6/913: symlink d1/d26/d2e/d45/d47/d4d/d129/l132 0 2024-09-19T09:02:51.379 INFO:tasks.workunit.client.1.smithi102.stdout:1/949: readlink dd/d14/d35/d49/d7d/d7f/lb7 0 2024-09-19T09:02:51.381 INFO:tasks.workunit.client.0.smithi049.stdout:3/342: symlink d10/d3d/d51/l73 0 2024-09-19T09:02:51.385 INFO:tasks.workunit.client.0.smithi049.stdout:1/190: getdents d5/d6/d8/d13 0 2024-09-19T09:02:51.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/160: creat dc/d16/f2e x:0 0 0 2024-09-19T09:02:51.389 INFO:tasks.workunit.client.0.smithi049.stdout:3/343: rename fc to d10/d11/d13/d30/f74 0 2024-09-19T09:02:51.393 INFO:tasks.workunit.client.1.smithi102.stdout:5/986: dwrite d5/d7/d1a/f74 [0,4194304] 0 2024-09-19T09:02:51.393 INFO:tasks.workunit.client.1.smithi102.stdout:2/934: dread d7/d50/d64/da1/d115/f9f [0,4194304] 0 2024-09-19T09:02:51.394 INFO:tasks.workunit.client.1.smithi102.stdout:5/987: chown d5/d7/d1a/d37/f45 491439302 1 2024-09-19T09:02:51.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/344: dwrite d10/d11/d13/d30/f40 [0,4194304] 0 2024-09-19T09:02:51.399 INFO:tasks.workunit.client.0.smithi049.stdout:1/191: creat d5/d6/d8/d1a/f3e x:0 0 0 2024-09-19T09:02:51.400 INFO:tasks.workunit.client.1.smithi102.stdout:9/985: dwrite d1/d2/d3/d1d/d4f/f5a [0,4194304] 0 2024-09-19T09:02:51.400 INFO:tasks.workunit.client.1.smithi102.stdout:1/950: fsync dd/d14/d35/d49/dcb/f119 0 2024-09-19T09:02:51.406 INFO:tasks.workunit.client.1.smithi102.stdout:6/914: rename d1/d18/d37/f7d to d1/d26/d2e/d45/d47/d4d/d35/d122/f133 0 2024-09-19T09:02:51.408 INFO:tasks.workunit.client.0.smithi049.stdout:1/192: dwrite d5/d6/f1f [0,4194304] 0 2024-09-19T09:02:51.409 INFO:tasks.workunit.client.0.smithi049.stdout:1/193: read d5/f36 [1010166,44490] 0 2024-09-19T09:02:51.412 INFO:tasks.workunit.client.0.smithi049.stdout:1/194: truncate d5/d6/fa 4918847 0 2024-09-19T09:02:51.412 INFO:tasks.workunit.client.0.smithi049.stdout:3/345: mknod d10/d3d/d46/c75 0 2024-09-19T09:02:51.414 INFO:tasks.workunit.client.0.smithi049.stdout:6/161: mkdir dc/d1b/d20/d2f 0 2024-09-19T09:02:51.414 INFO:tasks.workunit.client.0.smithi049.stdout:1/195: write d5/f36 [1149447,48862] 0 2024-09-19T09:02:51.417 INFO:tasks.workunit.client.0.smithi049.stdout:1/196: dread - d5/d6/f38 zero size 2024-09-19T09:02:51.417 INFO:tasks.workunit.client.0.smithi049.stdout:6/162: symlink dc/d1b/l30 0 2024-09-19T09:02:51.421 INFO:tasks.workunit.client.1.smithi102.stdout:2/935: truncate d7/d11/f43 268674 0 2024-09-19T09:02:51.422 INFO:tasks.workunit.client.1.smithi102.stdout:9/986: mknod d1/d2/d3/d1d/d4f/c145 0 2024-09-19T09:02:51.422 INFO:tasks.workunit.client.1.smithi102.stdout:1/951: readlink dd/d14/l20 0 2024-09-19T09:02:51.424 INFO:tasks.workunit.client.1.smithi102.stdout:1/952: truncate dd/d7a/d8c/da6/f114 1243426 0 2024-09-19T09:02:51.428 INFO:tasks.workunit.client.1.smithi102.stdout:8/940: dread d0/d10/d21/d39/d50/d63/d83/f9e [0,4194304] 0 2024-09-19T09:02:51.431 INFO:tasks.workunit.client.0.smithi049.stdout:6/163: mkdir dc/d1b/d20/d2f/d31 0 2024-09-19T09:02:51.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/148: sync 2024-09-19T09:02:51.436 INFO:tasks.workunit.client.1.smithi102.stdout:5/988: mknod d5/d7/d1a/d37/d34/d7f/c134 0 2024-09-19T09:02:51.436 INFO:tasks.workunit.client.1.smithi102.stdout:2/936: rmdir d7/d50/d64/da1 39 2024-09-19T09:02:51.437 INFO:tasks.workunit.client.1.smithi102.stdout:2/937: stat d7/d1a/d2b/d31/d51/f133 0 2024-09-19T09:02:51.437 INFO:tasks.workunit.client.1.smithi102.stdout:6/915: creat d1/d3a/d12e/f134 x:0 0 0 2024-09-19T09:02:51.443 INFO:tasks.workunit.client.1.smithi102.stdout:9/987: symlink d1/d2/l146 0 2024-09-19T09:02:51.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/197: rmdir d5 39 2024-09-19T09:02:51.454 INFO:tasks.workunit.client.0.smithi049.stdout:1/198: read d5/d6/d8/d13/f22 [464302,96782] 0 2024-09-19T09:02:51.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/199: readlink d5/d6/dc/l17 0 2024-09-19T09:02:51.458 INFO:tasks.workunit.client.0.smithi049.stdout:3/346: truncate d10/d11/d13/d30/f3c 1591614 0 2024-09-19T09:02:51.459 INFO:tasks.workunit.client.1.smithi102.stdout:1/953: rename dd/dd5/df1 to dd/d14/d35/d49/d62/d135 0 2024-09-19T09:02:51.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.458+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2041039d0 con 0x7fa1f006d8a0 2024-09-19T09:02:51.461 INFO:tasks.workunit.client.1.smithi102.stdout:5/989: creat d5/d7/d133/f135 x:0 0 0 2024-09-19T09:02:51.461 INFO:tasks.workunit.client.1.smithi102.stdout:5/990: chown d5 15841355 1 2024-09-19T09:02:51.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.463+0000 7fa1fa7fc640 1 -- 172.21.15.49:0/2586698559 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fa2041039d0 con 0x7fa1f006d8a0 2024-09-19T09:02:51.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/200: fsync d5/d6/f7 0 2024-09-19T09:02:51.463 INFO:tasks.workunit.client.1.smithi102.stdout:9/988: fsync d1/d2/d3/d6f/fc8 0 2024-09-19T09:02:51.464 INFO:tasks.workunit.client.1.smithi102.stdout:9/989: chown d1/d2/d3/d6f/d8d/lc4 271645 1 2024-09-19T09:02:51.465 INFO:tasks.workunit.client.1.smithi102.stdout:9/990: write d1/d2/d3/d6f/d8d/da2/db6/d11a/f12e [368037,125744] 0 2024-09-19T09:02:51.466 INFO:tasks.workunit.client.0.smithi049.stdout:6/164: truncate f3 238598 0 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.467+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa1f006d8a0 msgr2=0x7fa1f006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.467+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa1f006d8a0 0x7fa1f006fd60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa20000bbe0 tx=0x7fa20000b390 comp rx=0 tx=0).stop 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.467+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 msgr2=0x7fa2040fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.467+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2040fe650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006010 tx=0x7fa1f4004c60 comp rx=0 tx=0).stop 2024-09-19T09:02:51.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.468+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 shutdown_connections 2024-09-19T09:02:51.468 INFO:tasks.workunit.client.0.smithi049.stdout:6/165: fsync dc/d12/f14 0 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.468+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fa1f006d8a0 0x7fa1f006fd60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.469+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa204102fd0 0x7fa2040fe650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.469+0000 7fa20b6a6640 1 --2- 172.21.15.49:0/2586698559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041006a0 0x7fa204100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.469+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 >> 172.21.15.49:0/2586698559 conn(0x7fa2040fa280 msgr2=0x7fa2040fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.470+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 shutdown_connections 2024-09-19T09:02:51.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.470+0000 7fa20b6a6640 1 -- 172.21.15.49:0/2586698559 wait complete. 2024-09-19T09:02:51.471 INFO:tasks.workunit.client.1.smithi102.stdout:8/941: dwrite d0/d10/d21/d39/d50/d63/fca [0,4194304] 0 2024-09-19T09:02:51.475 INFO:tasks.workunit.client.0.smithi049.stdout:5/149: dwrite d3/d5/d1c/d2d/f2f [0,4194304] 0 2024-09-19T09:02:51.476 INFO:tasks.workunit.client.0.smithi049.stdout:5/150: fsync d3/d5/de/f23 0 2024-09-19T09:02:51.481 INFO:tasks.workunit.client.1.smithi102.stdout:1/954: dwrite dd/d14/dac/fb5 [0,4194304] 0 2024-09-19T09:02:51.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/201: symlink d5/d6/l3f 0 2024-09-19T09:02:51.482 INFO:tasks.workunit.client.1.smithi102.stdout:1/955: read dd/d14/d35/d49/f106 [302408,101584] 0 2024-09-19T09:02:51.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/166: creat dc/d1b/d20/f32 x:0 0 0 2024-09-19T09:02:51.491 INFO:tasks.workunit.client.1.smithi102.stdout:6/916: creat d1/d18/d37/f135 x:0 0 0 2024-09-19T09:02:51.492 INFO:tasks.workunit.client.0.smithi049.stdout:5/151: symlink d3/d5/d1c/d2d/l30 0 2024-09-19T09:02:51.492 INFO:tasks.workunit.client.0.smithi049.stdout:1/202: creat d5/d6/d8/d1a/f40 x:0 0 0 2024-09-19T09:02:51.493 INFO:tasks.workunit.client.0.smithi049.stdout:6/167: symlink dc/d16/l33 0 2024-09-19T09:02:51.494 INFO:tasks.workunit.client.0.smithi049.stdout:1/203: chown d5/c27 23652 1 2024-09-19T09:02:51.495 INFO:tasks.workunit.client.0.smithi049.stdout:5/152: symlink d3/d5/de/l31 0 2024-09-19T09:02:51.502 INFO:tasks.workunit.client.1.smithi102.stdout:2/938: link d7/c23 d7/d1a/d2b/dae/c146 0 2024-09-19T09:02:51.503 INFO:tasks.workunit.client.1.smithi102.stdout:5/991: rename d5/d23/d10b/c114 to d5/d7/d1a/daa/c136 0 2024-09-19T09:02:51.505 INFO:tasks.workunit.client.1.smithi102.stdout:1/956: dread dd/d14/d35/d49/d7d/ff2 [0,4194304] 0 2024-09-19T09:02:51.506 INFO:tasks.workunit.client.0.smithi049.stdout:6/168: mknod dc/d1b/d20/d2f/d31/c34 0 2024-09-19T09:02:51.508 INFO:tasks.workunit.client.1.smithi102.stdout:9/991: dread d1/d2/d3/d1d/fb1 [0,4194304] 0 2024-09-19T09:02:51.515 INFO:tasks.workunit.client.0.smithi049.stdout:6/169: dread dc/d12/f27 [0,4194304] 0 2024-09-19T09:02:51.515 INFO:tasks.workunit.client.0.smithi049.stdout:1/204: symlink d5/d6/d8/d13/d24/d3b/l41 0 2024-09-19T09:02:51.517 INFO:tasks.workunit.client.0.smithi049.stdout:5/153: creat d3/f32 x:0 0 0 2024-09-19T09:02:51.518 INFO:tasks.workunit.client.0.smithi049.stdout:5/154: chown d3/d5/d20/l29 763 1 2024-09-19T09:02:51.518 INFO:tasks.workunit.client.1.smithi102.stdout:5/992: rename d5/d7/d1a/d37/fcd to d5/d7/d1a/d37/d34/d4d/d9c/db8/f137 0 2024-09-19T09:02:51.519 INFO:tasks.workunit.client.0.smithi049.stdout:5/155: write d3/f32 [238847,91636] 0 2024-09-19T09:02:51.520 INFO:tasks.workunit.client.1.smithi102.stdout:6/917: dread d1/d18/f23 [0,4194304] 0 2024-09-19T09:02:51.521 INFO:tasks.workunit.client.1.smithi102.stdout:1/957: mknod dd/d14/dac/dc2/c136 0 2024-09-19T09:02:51.527 INFO:tasks.workunit.client.0.smithi049.stdout:1/205: creat d5/d6/d19/f42 x:0 0 0 2024-09-19T09:02:51.528 INFO:tasks.workunit.client.1.smithi102.stdout:8/942: dwrite d0/d10/d21/d39/f59 [0,4194304] 0 2024-09-19T09:02:51.529 INFO:tasks.workunit.client.1.smithi102.stdout:9/992: mknod d1/d2/d3/d1d/d4f/d6d/d81/dd3/c147 0 2024-09-19T09:02:51.532 INFO:tasks.workunit.client.1.smithi102.stdout:2/939: symlink d7/d50/d64/da1/d115/l147 0 2024-09-19T09:02:51.537 INFO:tasks.workunit.client.1.smithi102.stdout:5/993: dread d5/d60/db6/dd2/fed [0,4194304] 0 2024-09-19T09:02:51.538 INFO:tasks.workunit.client.1.smithi102.stdout:5/994: dread - d5/d7b/f120 zero size 2024-09-19T09:02:51.538 INFO:tasks.workunit.client.1.smithi102.stdout:8/943: rename d0/d10/d21/d39/f120 to d0/d10/d21/db3/f13c 0 2024-09-19T09:02:51.542 INFO:tasks.workunit.client.0.smithi049.stdout:5/156: dread d3/d5/de/d12/f13 [4194304,4194304] 0 2024-09-19T09:02:51.542 INFO:tasks.workunit.client.1.smithi102.stdout:1/958: dread dd/d14/d18/f37 [0,4194304] 0 2024-09-19T09:02:51.543 INFO:tasks.workunit.client.1.smithi102.stdout:5/995: rmdir d5/d7/d1a/d8f 39 2024-09-19T09:02:51.546 INFO:tasks.workunit.client.1.smithi102.stdout:6/918: creat d1/d26/d2e/d45/d47/d4d/f136 x:0 0 0 2024-09-19T09:02:51.549 INFO:tasks.workunit.client.0.smithi049.stdout:5/157: creat d3/d5/d20/f33 x:0 0 0 2024-09-19T09:02:51.550 INFO:tasks.workunit.client.1.smithi102.stdout:2/940: write d7/d1a/d2b/dae/de5/f137 [489808,85210] 0 2024-09-19T09:02:51.550 INFO:tasks.workunit.client.1.smithi102.stdout:2/941: fsync d7/d1a/f71 0 2024-09-19T09:02:51.552 INFO:tasks.workunit.client.1.smithi102.stdout:8/944: creat d0/d131/de8/dfa/f13d x:0 0 0 2024-09-19T09:02:51.552 INFO:tasks.workunit.client.1.smithi102.stdout:8/945: chown d0/dd3/d12d 125663507 1 2024-09-19T09:02:51.554 INFO:tasks.workunit.client.0.smithi049.stdout:6/170: write dc/d16/f2d [816150,58455] 0 2024-09-19T09:02:51.554 INFO:tasks.workunit.client.0.smithi049.stdout:5/158: read d3/f8 [3862915,13052] 0 2024-09-19T09:02:51.556 INFO:tasks.workunit.client.1.smithi102.stdout:9/993: write d1/d8/f44 [388160,52465] 0 2024-09-19T09:02:51.558 INFO:tasks.workunit.client.1.smithi102.stdout:1/959: mknod dd/d14/d18/c137 0 2024-09-19T09:02:51.559 INFO:tasks.workunit.client.1.smithi102.stdout:8/946: dread d0/d10/d21/d39/d87/fc5 [0,4194304] 0 2024-09-19T09:02:51.560 INFO:tasks.workunit.client.1.smithi102.stdout:8/947: write d0/d10/d21/d39/db8/d109/f135 [567590,121842] 0 2024-09-19T09:02:51.570 INFO:tasks.workunit.client.1.smithi102.stdout:2/942: creat d7/d1a/d2b/dab/de2/df7/d10c/f148 x:0 0 0 2024-09-19T09:02:51.571 INFO:tasks.workunit.client.0.smithi049.stdout:5/159: write d3/d5/fb [2171590,44788] 0 2024-09-19T09:02:51.573 INFO:tasks.workunit.client.1.smithi102.stdout:9/994: rmdir d1/d8/d98/df0 39 2024-09-19T09:02:51.574 INFO:tasks.workunit.client.0.smithi049.stdout:6/171: dwrite dc/d12/f29 [0,4194304] 0 2024-09-19T09:02:51.574 INFO:tasks.workunit.client.1.smithi102.stdout:5/996: chown d5/d7/d1a/d37/d34/d73/fdf 2468 1 2024-09-19T09:02:51.575 INFO:tasks.workunit.client.1.smithi102.stdout:6/919: dread d1/d18/d37/fa0 [0,4194304] 0 2024-09-19T09:02:51.581 INFO:tasks.workunit.client.1.smithi102.stdout:1/960: dread dd/d14/dac/fd8 [0,4194304] 0 2024-09-19T09:02:51.583 INFO:tasks.workunit.client.1.smithi102.stdout:9/995: symlink d1/d2/d3/d1d/d4f/d6d/d81/d90/d115/l148 0 2024-09-19T09:02:51.584 INFO:tasks.workunit.client.1.smithi102.stdout:5/997: dwrite d5/d7/d1b/f46 [4194304,4194304] 0 2024-09-19T09:02:51.585 INFO:tasks.workunit.client.0.smithi049.stdout:5/160: mknod d3/d5/c34 0 2024-09-19T09:02:51.585 INFO:tasks.workunit.client.1.smithi102.stdout:6/920: dwrite d1/d26/d2e/d45/daf/f10d [0,4194304] 0 2024-09-19T09:02:51.586 INFO:tasks.workunit.client.0.smithi049.stdout:6/172: symlink dc/l35 0 2024-09-19T09:02:51.587 INFO:tasks.workunit.client.1.smithi102.stdout:6/921: readlink d1/d26/d2e/d45/daf/d8d/l101 0 2024-09-19T09:02:51.587 INFO:tasks.workunit.client.1.smithi102.stdout:9/996: dread - d1/d2/d3/d6f/d8d/da2/d106/d10e/d111/f11d zero size 2024-09-19T09:02:51.590 INFO:tasks.workunit.client.0.smithi049.stdout:6/173: rename dc/d16/l1f to dc/d16/l36 0 2024-09-19T09:02:51.595 INFO:tasks.workunit.client.1.smithi102.stdout:8/948: dwrite d0/d10/f48 [0,4194304] 0 2024-09-19T09:02:51.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/161: rename d3/d5/de/d12/l1d to d3/d5/l35 0 2024-09-19T09:02:51.599 INFO:tasks.workunit.client.1.smithi102.stdout:6/922: stat d1/d26/d2e/d45/d47/d4d/fbc 0 2024-09-19T09:02:51.602 INFO:tasks.workunit.client.1.smithi102.stdout:8/949: mknod d0/d10/d21/d39/c13e 0 2024-09-19T09:02:51.603 INFO:tasks.workunit.client.1.smithi102.stdout:8/950: stat d0/d10/d21/d39/d50/c7a 0 2024-09-19T09:02:51.603 INFO:tasks.workunit.client.1.smithi102.stdout:8/951: chown d0/d10/ffb 2 1 2024-09-19T09:02:51.606 INFO:tasks.workunit.client.1.smithi102.stdout:1/961: creat dd/d7a/d8c/d8e/d103/d11f/f138 x:0 0 0 2024-09-19T09:02:51.607 INFO:tasks.workunit.client.0.smithi049.stdout:6/174: link dc/c22 dc/d1b/c37 0 2024-09-19T09:02:51.608 INFO:tasks.workunit.client.0.smithi049.stdout:6/175: readlink dc/l2a 0 2024-09-19T09:02:51.609 INFO:tasks.workunit.client.0.smithi049.stdout:6/176: dread - dc/d1b/d20/f32 zero size 2024-09-19T09:02:51.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/162: getdents d3/dc 0 2024-09-19T09:02:51.614 INFO:tasks.workunit.client.1.smithi102.stdout:1/962: rename dd/d66/c89 to dd/d14/d35/d49/df6/c139 0 2024-09-19T09:02:51.615 INFO:tasks.workunit.client.1.smithi102.stdout:6/923: mknod d1/d26/d2e/d45/d47/d4d/dd9/c137 0 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 -- 172.21.15.49:0/4214346105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 msgr2=0x7faf8c102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 --2- 172.21.15.49:0/4214346105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c102a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0097e0 tx=0x7faf7c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 -- 172.21.15.49:0/4214346105 shutdown_connections 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 --2- 172.21.15.49:0/4214346105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c102fb0 0x7faf8c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 --2- 172.21.15.49:0/4214346105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c102a70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 -- 172.21.15.49:0/4214346105 >> 172.21.15.49:0/4214346105 conn(0x7faf8c0fa280 msgr2=0x7faf8c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 -- 172.21.15.49:0/4214346105 shutdown_connections 2024-09-19T09:02:51.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.620+0000 7faf912ae640 1 -- 172.21.15.49:0/4214346105 wait complete. 2024-09-19T09:02:51.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.621+0000 7faf912ae640 1 Processor -- start 2024-09-19T09:02:51.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf912ae640 1 -- start start 2024-09-19T09:02:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf912ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf912ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c102fb0 0x7faf8c195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf912ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c1961a0 con 0x7faf8c102fb0 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf912ae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c196310 con 0x7faf8c100680 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:56286/0 (socket says 172.21.15.49:56286) 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf8affd640 1 -- 172.21.15.49:0/4293133403 learned_addr learned my addr 172.21.15.49:0/4293133403 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.622+0000 7faf8a7fc640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c102fb0 0x7faf8c195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.623+0000 7faf8affd640 1 -- 172.21.15.49:0/4293133403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c102fb0 msgr2=0x7faf8c195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.623+0000 7faf8affd640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c102fb0 0x7faf8c195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.623+0000 7faf8affd640 1 -- 172.21.15.49:0/4293133403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c009490 con 0x7faf8c100680 2024-09-19T09:02:51.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.623+0000 7faf8a7fc640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c102fb0 0x7faf8c195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.624+0000 7faf8affd640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c195690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009900 tx=0x7faf7c030bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.624+0000 7faf73fff640 1 -- 172.21.15.49:0/4293133403 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf7c041070 con 0x7faf8c100680 2024-09-19T09:02:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.624+0000 7faf73fff640 1 -- 172.21.15.49:0/4293133403 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf7c0044f0 con 0x7faf8c100680 2024-09-19T09:02:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.624+0000 7faf73fff640 1 -- 172.21.15.49:0/4293133403 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf7c031400 con 0x7faf8c100680 2024-09-19T09:02:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.624+0000 7faf912ae640 1 -- 172.21.15.49:0/4293133403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c0fe470 con 0x7faf8c100680 2024-09-19T09:02:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.624+0000 7faf912ae640 1 -- 172.21.15.49:0/4293133403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c0fe960 con 0x7faf8c100680 2024-09-19T09:02:51.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.626+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c1002e0 con 0x7faf8c100680 2024-09-19T09:02:51.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.626+0000 7faf73fff640 1 -- 172.21.15.49:0/4293133403 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7faf7c03b890 con 0x7faf8c100680 2024-09-19T09:02:51.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.627+0000 7faf73fff640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7faf7406d8a0 0x7faf7406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.627+0000 7faf73fff640 1 -- 172.21.15.49:0/4293133403 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7faf7c0b1cd0 con 0x7faf8c100680 2024-09-19T09:02:51.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.628+0000 7faf8a7fc640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7faf7406d8a0 0x7faf7406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.628+0000 7faf8a7fc640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7faf7406d8a0 0x7faf7406fd60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faf8c196b40 tx=0x7faf80009260 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.628 INFO:tasks.workunit.client.0.smithi049.stdout:6/177: dread f0 [4194304,4194304] 0 2024-09-19T09:02:51.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.632+0000 7faf73fff640 1 -- 172.21.15.49:0/4293133403 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7faf7c07b250 con 0x7faf8c100680 2024-09-19T09:02:51.723 INFO:tasks.workunit.client.0.smithi049.stdout:5/163: rename d3/d5/d1c/d2d/l30 to d3/d5/d20/l36 0 2024-09-19T09:02:51.725 INFO:tasks.workunit.client.1.smithi102.stdout:5/998: getdents d5/d8d 0 2024-09-19T09:02:51.725 INFO:tasks.workunit.client.1.smithi102.stdout:5/999: chown d5/d7/d1a/d11b 4361789 1 2024-09-19T09:02:51.726 INFO:tasks.workunit.client.1.smithi102.stdout:2/943: truncate d7/d50/d64/d7f/d83/f75 3921577 0 2024-09-19T09:02:51.727 INFO:tasks.workunit.client.0.smithi049.stdout:6/178: rmdir dc/d16 39 2024-09-19T09:02:51.729 INFO:tasks.workunit.client.0.smithi049.stdout:0/332: sync 2024-09-19T09:02:51.729 INFO:tasks.workunit.client.0.smithi049.stdout:8/328: sync 2024-09-19T09:02:51.729 INFO:tasks.workunit.client.0.smithi049.stdout:9/310: sync 2024-09-19T09:02:51.730 INFO:tasks.workunit.client.0.smithi049.stdout:2/160: sync 2024-09-19T09:02:51.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/230: sync 2024-09-19T09:02:51.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/349: sync 2024-09-19T09:02:51.730 INFO:tasks.workunit.client.1.smithi102.stdout:1/963: mknod dd/d7a/d8c/d8e/d103/d11f/c13a 0 2024-09-19T09:02:51.731 INFO:tasks.workunit.client.1.smithi102.stdout:9/997: write d1/d2/d3/f77 [1949411,81777] 0 2024-09-19T09:02:51.734 INFO:tasks.workunit.client.1.smithi102.stdout:6/924: dread d1/d26/d2e/fc4 [0,4194304] 0 2024-09-19T09:02:51.735 INFO:tasks.workunit.client.1.smithi102.stdout:2/944: truncate d7/d50/f99 794271 0 2024-09-19T09:02:51.736 INFO:tasks.workunit.client.1.smithi102.stdout:2/945: stat d7/d1a/d2b/dab/de2/df7/l107 0 2024-09-19T09:02:51.736 INFO:tasks.workunit.client.1.smithi102.stdout:6/925: readlink d1/d26/d2e/d45/d47/d4d/d35/d41/l125 0 2024-09-19T09:02:51.738 INFO:tasks.workunit.client.1.smithi102.stdout:8/952: write d0/d131/f81 [1496791,82547] 0 2024-09-19T09:02:51.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/329: dread d1/d11/d2e/f56 [0,4194304] 0 2024-09-19T09:02:51.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/350: read d1/d53/d18/d59/f29 [284413,55303] 0 2024-09-19T09:02:51.741 INFO:tasks.workunit.client.0.smithi049.stdout:0/333: readlink d5/d10/d13/l38 0 2024-09-19T09:02:51.742 INFO:tasks.workunit.client.1.smithi102.stdout:1/964: dread f6 [0,4194304] 0 2024-09-19T09:02:51.743 INFO:tasks.workunit.client.1.smithi102.stdout:9/998: symlink d1/d2/d3/d6f/d8d/da2/l149 0 2024-09-19T09:02:51.744 INFO:tasks.workunit.client.1.smithi102.stdout:9/999: write d1/df3/f11b [561454,7003] 0 2024-09-19T09:02:51.748 INFO:tasks.workunit.client.0.smithi049.stdout:2/161: rename d1/d4/fc to d1/d2d/f37 0 2024-09-19T09:02:51.751 INFO:tasks.workunit.client.1.smithi102.stdout:2/946: read d7/d1a/d2b/dae/ff9 [46680,62235] 0 2024-09-19T09:02:51.752 INFO:tasks.workunit.client.1.smithi102.stdout:6/926: rename d1/fcd to d1/d18/d37/dda/f138 0 2024-09-19T09:02:51.753 INFO:tasks.workunit.client.1.smithi102.stdout:1/965: mkdir dd/d7a/d8c/d8e/d13b 0 2024-09-19T09:02:51.754 INFO:tasks.workunit.client.0.smithi049.stdout:8/330: chown d1/ff 2 1 2024-09-19T09:02:51.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/311: dread d3/d14/d1a/f61 [0,4194304] 0 2024-09-19T09:02:51.756 INFO:tasks.workunit.client.0.smithi049.stdout:0/334: mkdir d5/d10/d13/d15/d29/d3b/d67 0 2024-09-19T09:02:51.766 INFO:tasks.workunit.client.0.smithi049.stdout:9/312: unlink d3/d14/d1a/f5f 0 2024-09-19T09:02:51.768 INFO:tasks.workunit.client.0.smithi049.stdout:9/313: truncate d3/d14/d34/d4c/f5d 470925 0 2024-09-19T09:02:51.769 INFO:tasks.workunit.client.1.smithi102.stdout:8/953: rename d0/d10/c90 to d0/d131/de8/dfa/c13f 0 2024-09-19T09:02:51.771 INFO:tasks.workunit.client.0.smithi049.stdout:6/179: getdents dc 0 2024-09-19T09:02:51.774 INFO:tasks.workunit.client.1.smithi102.stdout:2/947: link d7/d50/d64/da1/d115/de1/f117 d7/d1a/d2b/dae/de5/f149 0 2024-09-19T09:02:51.775 INFO:tasks.workunit.client.1.smithi102.stdout:2/948: read d7/d50/d64/da1/d115/f4b [684752,13511] 0 2024-09-19T09:02:51.776 INFO:tasks.workunit.client.1.smithi102.stdout:2/949: chown d7/d11/c32 25662 1 2024-09-19T09:02:51.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/351: link d1/d8/d2d/d36/f45 d1/d53/d18/d50/d58/d62/d6b/f76 0 2024-09-19T09:02:51.780 INFO:tasks.workunit.client.0.smithi049.stdout:7/352: stat d1/d8/d2d/d36 0 2024-09-19T09:02:51.784 INFO:tasks.workunit.client.0.smithi049.stdout:9/314: readlink d3/d14/l18 0 2024-09-19T09:02:51.784 INFO:tasks.workunit.client.0.smithi049.stdout:0/335: write d5/d10/d13/d15/f43 [1377332,108305] 0 2024-09-19T09:02:51.786 INFO:tasks.workunit.client.0.smithi049.stdout:9/315: chown d3/d14/d1a/d21/d31/l52 1893984774 1 2024-09-19T09:02:51.789 INFO:tasks.workunit.client.1.smithi102.stdout:8/954: mknod d0/d10/d21/d39/c140 0 2024-09-19T09:02:51.790 INFO:tasks.workunit.client.0.smithi049.stdout:6/180: creat dc/d1b/f38 x:0 0 0 2024-09-19T09:02:51.790 INFO:tasks.workunit.client.0.smithi049.stdout:9/316: dread d3/d14/d34/d4c/f5d [0,4194304] 0 2024-09-19T09:02:51.790 INFO:tasks.workunit.client.1.smithi102.stdout:8/955: read d0/d10/d21/d39/db8/d109/f135 [648419,77859] 0 2024-09-19T09:02:51.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/353: creat d1/d1a/f77 x:0 0 0 2024-09-19T09:02:51.797 INFO:tasks.workunit.client.1.smithi102.stdout:6/927: truncate d1/f1b 98833 0 2024-09-19T09:02:51.800 INFO:tasks.workunit.client.1.smithi102.stdout:1/966: rmdir dd/d7a/d8c/d12d 0 2024-09-19T09:02:51.801 INFO:tasks.workunit.client.1.smithi102.stdout:1/967: write dd/d7a/d8c/da6/ff8 [1681373,121491] 0 2024-09-19T09:02:51.801 INFO:tasks.workunit.client.0.smithi049.stdout:9/317: mkdir d3/d14/d1a/d21/d67 0 2024-09-19T09:02:51.805 INFO:tasks.workunit.client.1.smithi102.stdout:8/956: unlink d0/d10/ff3 0 2024-09-19T09:02:51.806 INFO:tasks.workunit.client.1.smithi102.stdout:8/957: fdatasync d0/d131/f81 0 2024-09-19T09:02:51.816 INFO:tasks.workunit.client.0.smithi049.stdout:7/354: dread d1/d53/d18/f43 [0,4194304] 0 2024-09-19T09:02:51.820 INFO:tasks.workunit.client.0.smithi049.stdout:7/355: fdatasync d1/d1a/f77 0 2024-09-19T09:02:51.820 INFO:tasks.workunit.client.0.smithi049.stdout:0/336: rename d5/d10/d13/f4f to d5/d10/d13/d15/f68 0 2024-09-19T09:02:51.820 INFO:tasks.workunit.client.0.smithi049.stdout:0/337: write d5/d10/d13/d15/d29/d3b/f47 [166922,126237] 0 2024-09-19T09:02:51.825 INFO:tasks.workunit.client.1.smithi102.stdout:8/958: truncate d0/d131/f65 5855622 0 2024-09-19T09:02:51.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/338: dread d5/d10/d13/d15/d36/d3d/f24 [0,4194304] 0 2024-09-19T09:02:51.826 INFO:tasks.workunit.client.1.smithi102.stdout:1/968: write dd/d14/d35/d49/dcb/fd0 [1719445,98488] 0 2024-09-19T09:02:51.827 INFO:tasks.workunit.client.1.smithi102.stdout:2/950: link d7/d50/d64/da1/d115/l147 d7/d50/d64/da1/d115/de1/l14a 0 2024-09-19T09:02:51.828 INFO:tasks.workunit.client.1.smithi102.stdout:2/951: readlink d7/d1a/d2b/dab/de2/df7/l10a 0 2024-09-19T09:02:51.828 INFO:tasks.workunit.client.1.smithi102.stdout:2/952: stat d7/d1a/d2b/d31/d111/c142 0 2024-09-19T09:02:51.829 INFO:tasks.workunit.client.1.smithi102.stdout:6/928: symlink d1/d26/d2e/d45/dac/d12f/l139 0 2024-09-19T09:02:51.830 INFO:tasks.workunit.client.0.smithi049.stdout:6/181: getdents dc/d1b/d20/d2f 0 2024-09-19T09:02:51.834 INFO:tasks.workunit.client.0.smithi049.stdout:9/318: write d3/f1f [445492,129697] 0 2024-09-19T09:02:51.837 INFO:tasks.workunit.client.1.smithi102.stdout:1/969: creat dd/d7a/d8c/d8e/d103/f13c x:0 0 0 2024-09-19T09:02:51.839 INFO:tasks.workunit.client.1.smithi102.stdout:2/953: mkdir d7/d1a/d2b/dab/de2/d11b/d14b 0 2024-09-19T09:02:51.841 INFO:tasks.workunit.client.0.smithi049.stdout:6/182: creat dc/d1b/f39 x:0 0 0 2024-09-19T09:02:51.841 INFO:tasks.workunit.client.0.smithi049.stdout:7/356: dread d1/d1a/f41 [0,4194304] 0 2024-09-19T09:02:51.841 INFO:tasks.workunit.client.1.smithi102.stdout:6/929: write d1/d18/d37/dda/f138 [857589,49648] 0 2024-09-19T09:02:51.844 INFO:tasks.workunit.client.1.smithi102.stdout:2/954: dwrite d7/d1a/d2b/d31/d106/fa6 [0,4194304] 0 2024-09-19T09:02:51.845 INFO:tasks.workunit.client.0.smithi049.stdout:0/339: mkdir d5/d10/d13/d69 0 2024-09-19T09:02:51.847 INFO:tasks.workunit.client.0.smithi049.stdout:0/340: truncate d5/d10/d13/d15/d36/f41 356677 0 2024-09-19T09:02:51.848 INFO:tasks.workunit.client.0.smithi049.stdout:0/341: stat d5/d10/d13/l27 0 2024-09-19T09:02:51.849 INFO:tasks.workunit.client.1.smithi102.stdout:1/970: creat dd/d14/dac/f13d x:0 0 0 2024-09-19T09:02:51.849 INFO:tasks.workunit.client.0.smithi049.stdout:0/342: dread - d5/d10/d2f/f39 zero size 2024-09-19T09:02:51.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/183: rename dc/l26 to dc/d1b/d20/d2f/d31/l3a 0 2024-09-19T09:02:51.851 INFO:tasks.workunit.client.0.smithi049.stdout:0/343: dread - d5/d10/d13/d15/d29/f4b zero size 2024-09-19T09:02:51.854 INFO:tasks.workunit.client.0.smithi049.stdout:7/357: mknod d1/d8/d2d/d31/d6e/c78 0 2024-09-19T09:02:51.854 INFO:tasks.workunit.client.1.smithi102.stdout:8/959: link d0/d64/l2b d0/d64/d10c/l141 0 2024-09-19T09:02:51.855 INFO:tasks.workunit.client.1.smithi102.stdout:8/960: write d0/d10/d21/d39/d50/fed [587733,91417] 0 2024-09-19T09:02:51.857 INFO:tasks.workunit.client.1.smithi102.stdout:1/971: truncate dd/d14/d18/f37 802691 0 2024-09-19T09:02:51.860 INFO:tasks.workunit.client.1.smithi102.stdout:6/930: unlink d1/d18/f7 0 2024-09-19T09:02:51.861 INFO:tasks.workunit.client.1.smithi102.stdout:8/961: dwrite d0/db/d1d/f34 [4194304,4194304] 0 2024-09-19T09:02:51.863 INFO:tasks.workunit.client.1.smithi102.stdout:8/962: write d0/d131/daa/db0/f122 [875926,41629] 0 2024-09-19T09:02:51.864 INFO:tasks.workunit.client.1.smithi102.stdout:8/963: fdatasync d0/db/d1d/f105 0 2024-09-19T09:02:51.868 INFO:tasks.workunit.client.0.smithi049.stdout:9/319: dread f1 [4194304,4194304] 0 2024-09-19T09:02:51.875 INFO:tasks.workunit.client.1.smithi102.stdout:2/955: truncate d7/d1a/d56/db9/fdd 236254 0 2024-09-19T09:02:51.877 INFO:tasks.workunit.client.1.smithi102.stdout:2/956: write d7/d1a/d2b/dab/de2/d11b/f13c [915674,91355] 0 2024-09-19T09:02:51.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/344: rename d5/d10/d13/f4e to d5/d10/d13/d15/d36/f6a 0 2024-09-19T09:02:51.883 INFO:tasks.workunit.client.0.smithi049.stdout:0/345: write d5/d10/f5c [457319,57387] 0 2024-09-19T09:02:51.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/320: write d3/f28 [1756292,113763] 0 2024-09-19T09:02:51.888 INFO:tasks.workunit.client.0.smithi049.stdout:9/321: read f1 [10190886,31820] 0 2024-09-19T09:02:51.891 INFO:tasks.workunit.client.1.smithi102.stdout:1/972: unlink dd/d14/d35/d49/d62/c7e 0 2024-09-19T09:02:51.892 INFO:tasks.workunit.client.0.smithi049.stdout:7/358: link d1/d53/f5d d1/d8/d2d/d31/f79 0 2024-09-19T09:02:51.896 INFO:tasks.workunit.client.1.smithi102.stdout:8/964: mknod d0/d64/d10c/c142 0 2024-09-19T09:02:51.904 INFO:tasks.workunit.client.0.smithi049.stdout:9/322: creat d3/d14/d34/d44/f68 x:0 0 0 2024-09-19T09:02:51.908 INFO:tasks.workunit.client.0.smithi049.stdout:0/346: symlink d5/d10/d13/d69/l6b 0 2024-09-19T09:02:51.910 INFO:tasks.workunit.client.0.smithi049.stdout:6/184: creat dc/d16/f3b x:0 0 0 2024-09-19T09:02:51.910 INFO:tasks.workunit.client.1.smithi102.stdout:8/965: dread d0/db/d1d/fcd [0,4194304] 0 2024-09-19T09:02:51.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/185: truncate dc/d16/f2e 731267 0 2024-09-19T09:02:51.913 INFO:tasks.workunit.client.1.smithi102.stdout:6/931: dwrite d1/d26/d2e/fbe [0,4194304] 0 2024-09-19T09:02:51.913 INFO:tasks.workunit.client.1.smithi102.stdout:2/957: mknod d7/d11/dc8/dfa/d101/d12a/c14c 0 2024-09-19T09:02:51.916 INFO:tasks.workunit.client.1.smithi102.stdout:1/973: mkdir dd/d13/d13e 0 2024-09-19T09:02:51.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.918+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf8c0608f0 con 0x7faf7406d8a0 2024-09-19T09:02:51.919 INFO:tasks.workunit.client.1.smithi102.stdout:8/966: dwrite d0/d131/de8/dfa/f137 [0,4194304] 0 2024-09-19T09:02:51.923 INFO:tasks.workunit.client.1.smithi102.stdout:2/958: rename d7/d1a/d56/l8d to d7/d1a/d2b/d4e/l14d 0 2024-09-19T09:02:51.924 INFO:tasks.workunit.client.1.smithi102.stdout:2/959: chown d7/d1a/d56/c11c 169458 1 2024-09-19T09:02:51.925 INFO:tasks.workunit.client.1.smithi102.stdout:1/974: creat dd/d14/d35/d49/d62/d9e/dab/de7/f13f x:0 0 0 2024-09-19T09:02:51.926 INFO:tasks.workunit.client.1.smithi102.stdout:8/967: mknod d0/db/d1d/c143 0 2024-09-19T09:02:51.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/347: sync 2024-09-19T09:02:51.929 INFO:tasks.workunit.client.0.smithi049.stdout:3/348: chown d10/d11/d13/d30/c33 3736 1 2024-09-19T09:02:51.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.932+0000 7faf73fff640 1 -- 172.21.15.49:0/4293133403 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7faf8c0608f0 con 0x7faf7406d8a0 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (7m) 51s ago 8m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (8m) 51s ago 8m 7968k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (7m) 46s ago 7m 7822k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 51s ago 8m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (7m) 46s ago 7m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (6m) 51s ago 8m 84.0M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:02:51.933 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (3m) 51s ago 3m 78.4M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (2m) 51s ago 2m 108M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (2m) 46s ago 2m 22.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (3m) 46s ago 3m 21.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 starting - - - - 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (73s) 46s ago 7m 483M - 19.1.1-361-g2f599a46 d2baa855c067 83adb7fb6aac 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 51s ago 9m 51.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (7m) 46s ago 7m 43.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (8m) 51s ago 8m 15.7M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (7m) 46s ago 7m 16.7M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 51s ago 6m 64.7M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 51s ago 6m 75.1M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 51s ago 5m 66.5M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:02:51.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (5m) 46s ago 5m 72.9M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:02:51.935 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (4m) 46s ago 4m 71.8M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:02:51.935 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (4m) 46s ago 4m 72.5M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:02:51.935 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 starting - - - - 2024-09-19T09:02:51.935 INFO:tasks.workunit.client.0.smithi049.stdout:6/186: chown dc/d12/l2b 243897 1 2024-09-19T09:02:51.935 INFO:tasks.workunit.client.0.smithi049.stdout:6/187: readlink l2 0 2024-09-19T09:02:51.936 INFO:tasks.workunit.client.0.smithi049.stdout:7/359: write d1/d53/d18/d50/d58/d62/d6b/f76 [941777,123114] 0 2024-09-19T09:02:51.936 INFO:tasks.workunit.client.0.smithi049.stdout:7/360: chown d1/d8/d2d/l61 2027137 1 2024-09-19T09:02:51.936 INFO:tasks.workunit.client.0.smithi049.stdout:9/323: truncate d3/d14/d34/d44/d4d/f5e 668918 0 2024-09-19T09:02:51.937 INFO:tasks.workunit.client.1.smithi102.stdout:2/960: write d7/d50/d64/da1/d115/fff [3767593,125857] 0 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7faf7406d8a0 msgr2=0x7faf7406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7faf7406d8a0 0x7faf7406fd60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faf8c196b40 tx=0x7faf80009260 comp rx=0 tx=0).stop 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 msgr2=0x7faf8c195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c195690 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009900 tx=0x7faf7c030bd0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 shutdown_connections 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7faf7406d8a0 0x7faf7406fd60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf8c102fb0 0x7faf8c195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 --2- 172.21.15.49:0/4293133403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf8c100680 0x7faf8c195690 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.937+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 >> 172.21.15.49:0/4293133403 conn(0x7faf8c0fa280 msgr2=0x7faf8c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.938+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 shutdown_connections 2024-09-19T09:02:51.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:51.938+0000 7faf71ffb640 1 -- 172.21.15.49:0/4293133403 wait complete. 2024-09-19T09:02:51.939 INFO:tasks.workunit.client.1.smithi102.stdout:2/961: write d7/d11/f123 [22114,112601] 0 2024-09-19T09:02:51.939 INFO:tasks.workunit.client.0.smithi049.stdout:9/324: read d3/d14/d1a/d21/f26 [1671360,95751] 0 2024-09-19T09:02:51.940 INFO:tasks.workunit.client.0.smithi049.stdout:0/347: link d5/d10/c32 d5/d10/d13/d15/d36/c6c 0 2024-09-19T09:02:51.941 INFO:tasks.workunit.client.1.smithi102.stdout:8/968: read d0/d64/fc6 [4155031,111635] 0 2024-09-19T09:02:51.942 INFO:tasks.workunit.client.0.smithi049.stdout:3/349: mkdir d10/d3d/d76 0 2024-09-19T09:02:51.942 INFO:tasks.workunit.client.1.smithi102.stdout:6/932: link d1/d26/d2e/d45/d47/d4d/d35/d41/da4/fad d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/d12d/f13a 0 2024-09-19T09:02:51.943 INFO:tasks.workunit.client.0.smithi049.stdout:3/350: chown d10/d11/f1a 108787939 1 2024-09-19T09:02:51.947 INFO:tasks.workunit.client.1.smithi102.stdout:8/969: mkdir d0/d10/d21/d39/d50/d63/d83/d144 0 2024-09-19T09:02:51.947 INFO:tasks.workunit.client.1.smithi102.stdout:8/970: readlink d0/db/l32 0 2024-09-19T09:02:51.947 INFO:tasks.workunit.client.1.smithi102.stdout:8/971: dread - d0/d10/d21/d39/d87/ffd zero size 2024-09-19T09:02:51.949 INFO:tasks.workunit.client.1.smithi102.stdout:6/933: creat d1/d26/d2e/d45/dac/db2/df5/f13b x:0 0 0 2024-09-19T09:02:51.950 INFO:tasks.workunit.client.1.smithi102.stdout:6/934: read d1/d3a/f7c [216815,10248] 0 2024-09-19T09:02:51.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/188: chown dc/d1b/c37 1759 1 2024-09-19T09:02:51.952 INFO:tasks.workunit.client.0.smithi049.stdout:6/189: write dc/d12/f27 [227896,118914] 0 2024-09-19T09:02:51.953 INFO:tasks.workunit.client.0.smithi049.stdout:0/348: fdatasync d5/d10/d13/d15/f68 0 2024-09-19T09:02:51.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/349: write d5/d10/f5c [281099,41008] 0 2024-09-19T09:02:51.955 INFO:tasks.workunit.client.1.smithi102.stdout:8/972: mkdir d0/d5a/d145 0 2024-09-19T09:02:51.963 INFO:tasks.workunit.client.1.smithi102.stdout:2/962: dwrite d7/d1a/d2b/d31/f3e [0,4194304] 0 2024-09-19T09:02:51.964 INFO:tasks.workunit.client.0.smithi049.stdout:7/361: dwrite d1/d8/f1c [0,4194304] 0 2024-09-19T09:02:51.966 INFO:tasks.workunit.client.0.smithi049.stdout:9/325: mkdir d3/d14/d1a/d21/d66/d69 0 2024-09-19T09:02:51.966 INFO:tasks.workunit.client.1.smithi102.stdout:8/973: symlink d0/d10/d21/d39/db8/d109/l146 0 2024-09-19T09:02:51.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/190: rename l2 to dc/d1b/l3c 0 2024-09-19T09:02:51.967 INFO:tasks.workunit.client.1.smithi102.stdout:8/974: chown d0/db/d84/c12f 197019012 1 2024-09-19T09:02:51.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/350: mkdir d5/d10/d2f/d6d 0 2024-09-19T09:02:51.973 INFO:tasks.workunit.client.0.smithi049.stdout:0/351: chown d5/d10/d13/d15/d36/f48 3 1 2024-09-19T09:02:51.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/351: mknod d10/d11/d27/c77 0 2024-09-19T09:02:51.977 INFO:tasks.workunit.client.1.smithi102.stdout:2/963: creat d7/d1a/d56/f14e x:0 0 0 2024-09-19T09:02:51.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/362: creat d1/d8/d2d/d31/f7a x:0 0 0 2024-09-19T09:02:51.981 INFO:tasks.workunit.client.0.smithi049.stdout:9/326: creat d3/d14/d34/d44/f6a x:0 0 0 2024-09-19T09:02:51.984 INFO:tasks.workunit.client.1.smithi102.stdout:8/975: rename d0/db to d0/dd3/d132/d147 0 2024-09-19T09:02:51.986 INFO:tasks.workunit.client.0.smithi049.stdout:6/191: creat dc/d16/f3d x:0 0 0 2024-09-19T09:02:51.986 INFO:tasks.workunit.client.1.smithi102.stdout:2/964: readlink d7/d1a/d2b/d31/l62 0 2024-09-19T09:02:51.988 INFO:tasks.workunit.client.0.smithi049.stdout:7/363: fsync d1/d53/d18/f43 0 2024-09-19T09:02:51.990 INFO:tasks.workunit.client.0.smithi049.stdout:9/327: stat d3/d14/d1a/d21/c63 0 2024-09-19T09:02:51.991 INFO:tasks.workunit.client.0.smithi049.stdout:9/328: fdatasync d3/d14/d34/f37 0 2024-09-19T09:02:52.001 INFO:tasks.workunit.client.1.smithi102.stdout:6/935: write d1/d26/d2e/d45/daf/d8d/faa [938334,91194] 0 2024-09-19T09:02:52.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/192: rename dc/d12/l2b to dc/d1b/d20/d2f/d31/l3e 0 2024-09-19T09:02:52.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/193: readlink dc/d1b/l30 0 2024-09-19T09:02:52.005 INFO:tasks.workunit.client.0.smithi049.stdout:0/352: truncate d5/fa 1832544 0 2024-09-19T09:02:52.006 INFO:tasks.workunit.client.1.smithi102.stdout:8/976: write d0/d10/f2d [10645923,65308] 0 2024-09-19T09:02:52.006 INFO:tasks.workunit.client.0.smithi049.stdout:0/353: dread - d5/d10/d13/d15/d36/f48 zero size 2024-09-19T09:02:52.008 INFO:tasks.workunit.client.1.smithi102.stdout:2/965: dwrite d7/d1a/d2b/d31/d51/d6b/f9c [0,4194304] 0 2024-09-19T09:02:52.010 INFO:tasks.workunit.client.0.smithi049.stdout:0/354: fdatasync d5/d10/d2f/f39 0 2024-09-19T09:02:52.012 INFO:tasks.workunit.client.1.smithi102.stdout:6/936: creat d1/d26/d4b/d94/d8a/f13c x:0 0 0 2024-09-19T09:02:52.013 INFO:tasks.workunit.client.1.smithi102.stdout:6/937: chown d1/d18/d37/f113 108449 1 2024-09-19T09:02:52.019 INFO:tasks.workunit.client.1.smithi102.stdout:8/977: mkdir d0/dd3/d132/d147/d29/d11c/d148 0 2024-09-19T09:02:52.020 INFO:tasks.workunit.client.1.smithi102.stdout:8/978: chown d0/dd3/d132/d147/l32 35736933 1 2024-09-19T09:02:52.021 INFO:tasks.workunit.client.1.smithi102.stdout:6/938: creat d1/d26/d2e/d45/d47/d4d/d129/f13d x:0 0 0 2024-09-19T09:02:52.022 INFO:tasks.workunit.client.1.smithi102.stdout:6/939: rename d1/d26/d2e/d45/dac/d12f to d1/d26/d2e/d45/dac/d12f/d13e 22 2024-09-19T09:02:52.023 INFO:tasks.workunit.client.0.smithi049.stdout:7/364: write d1/d8/d2d/d31/f79 [1083054,50459] 0 2024-09-19T09:02:52.023 INFO:tasks.workunit.client.1.smithi102.stdout:8/979: mknod d0/d10/d21/d39/d50/da2/c149 0 2024-09-19T09:02:52.025 INFO:tasks.workunit.client.0.smithi049.stdout:9/329: dwrite d3/d14/d1a/d21/f26 [4194304,4194304] 0 2024-09-19T09:02:52.027 INFO:tasks.workunit.client.0.smithi049.stdout:0/355: getdents d5/d10/d2f/d52 0 2024-09-19T09:02:52.028 INFO:tasks.workunit.client.1.smithi102.stdout:8/980: fsync d0/d10/d21/db3/fe7 0 2024-09-19T09:02:52.029 INFO:tasks.workunit.client.1.smithi102.stdout:2/966: dwrite d7/d1a/d2b/f4c [0,4194304] 0 2024-09-19T09:02:52.031 INFO:tasks.workunit.client.0.smithi049.stdout:9/330: fsync d3/f43 0 2024-09-19T09:02:52.035 INFO:tasks.workunit.client.1.smithi102.stdout:8/981: mknod d0/d10/d21/d39/d87/c14a 0 2024-09-19T09:02:52.038 INFO:tasks.workunit.client.1.smithi102.stdout:6/940: write d1/d26/d2e/d45/d47/fb7 [132891,110194] 0 2024-09-19T09:02:52.045 INFO:tasks.workunit.client.1.smithi102.stdout:2/967: mknod d7/d50/d64/d7f/d83/dc7/d13b/c14f 0 2024-09-19T09:02:52.047 INFO:tasks.workunit.client.1.smithi102.stdout:6/941: mknod d1/d26/d2e/d70/dca/c13f 0 2024-09-19T09:02:52.048 INFO:tasks.workunit.client.0.smithi049.stdout:0/356: creat d5/d10/d13/d15/d36/f6e x:0 0 0 2024-09-19T09:02:52.050 INFO:tasks.workunit.client.1.smithi102.stdout:8/982: rename d0/d64/d10c/l141 to d0/dd3/d132/d147/d29/l14b 0 2024-09-19T09:02:52.052 INFO:tasks.workunit.client.1.smithi102.stdout:8/983: write d0/dd3/d132/d147/d1d/f34 [2347677,84082] 0 2024-09-19T09:02:52.052 INFO:tasks.workunit.client.1.smithi102.stdout:6/942: dwrite d1/d26/d2e/d45/daf/f10d [0,4194304] 0 2024-09-19T09:02:52.055 INFO:tasks.workunit.client.1.smithi102.stdout:6/943: truncate d1/d26/d2e/d45/d47/fb7 289671 0 2024-09-19T09:02:52.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/357: creat d5/d10/d2f/d52/f6f x:0 0 0 2024-09-19T09:02:52.056 INFO:tasks.workunit.client.1.smithi102.stdout:6/944: dread - d1/d26/d4b/d94/d8a/f111 zero size 2024-09-19T09:02:52.057 INFO:tasks.workunit.client.1.smithi102.stdout:2/968: symlink d7/d1a/d56/d11a/l150 0 2024-09-19T09:02:52.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/358: read d5/d10/d13/d15/d36/d3d/f24 [1123880,3566] 0 2024-09-19T09:02:52.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/365: getdents d1 0 2024-09-19T09:02:52.060 INFO:tasks.workunit.client.1.smithi102.stdout:8/984: creat d0/dd3/d132/d147/d84/f14c x:0 0 0 2024-09-19T09:02:52.066 INFO:tasks.workunit.client.1.smithi102.stdout:8/985: write d0/d131/f76 [1952960,14002] 0 2024-09-19T09:02:52.066 INFO:tasks.workunit.client.1.smithi102.stdout:8/986: readlink d0/d10/d21/d39/db8/d109/l146 0 2024-09-19T09:02:52.068 INFO:tasks.workunit.client.0.smithi049.stdout:9/331: dwrite d3/d14/d1a/f35 [0,4194304] 0 2024-09-19T09:02:52.071 INFO:tasks.workunit.client.1.smithi102.stdout:8/987: dread d0/d10/d21/d39/d50/d63/fca [0,4194304] 0 2024-09-19T09:02:52.073 INFO:tasks.workunit.client.1.smithi102.stdout:6/945: creat d1/d26/d2e/d45/d47/d4d/d35/f140 x:0 0 0 2024-09-19T09:02:52.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/332: mknod d3/d14/d34/d4c/c6b 0 2024-09-19T09:02:52.078 INFO:tasks.workunit.client.0.smithi049.stdout:7/366: getdents d1/d7 0 2024-09-19T09:02:52.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/359: truncate d5/f50 2671745 0 2024-09-19T09:02:52.079 INFO:tasks.workunit.client.1.smithi102.stdout:2/969: truncate d7/d1a/d2b/d31/d106/fa6 14529490 0 2024-09-19T09:02:52.080 INFO:tasks.workunit.client.1.smithi102.stdout:8/988: creat d0/d131/de8/dfa/f14d x:0 0 0 2024-09-19T09:02:52.086 INFO:tasks.workunit.client.1.smithi102.stdout:2/970: creat d7/d50/d64/d7f/f151 x:0 0 0 2024-09-19T09:02:52.087 INFO:tasks.workunit.client.1.smithi102.stdout:2/971: chown d7/d11/c53 0 1 2024-09-19T09:02:52.088 INFO:tasks.workunit.client.1.smithi102.stdout:2/972: write d7/d1a/d2b/f4c [3191307,30942] 0 2024-09-19T09:02:52.090 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:51 smithi049 ceph-mon[28158]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:52.234 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:51 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:52.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:51 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:52.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:51 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.089+0000 7f8acab3c640 1 -- 172.21.15.49:0/1013800278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 msgr2=0x7f8ac4071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.089+0000 7f8acab3c640 1 --2- 172.21.15.49:0/1013800278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 0x7f8ac4071640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009880 tx=0x7f8ab002a4b0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.090+0000 7f8acab3c640 1 -- 172.21.15.49:0/1013800278 shutdown_connections 2024-09-19T09:02:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.090+0000 7f8acab3c640 1 --2- 172.21.15.49:0/1013800278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 0x7f8ac4071640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.090+0000 7f8acab3c640 1 --2- 172.21.15.49:0/1013800278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 0x7f8ac4107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.090+0000 7f8acab3c640 1 -- 172.21.15.49:0/1013800278 >> 172.21.15.49:0/1013800278 conn(0x7f8ac406cc10 msgr2=0x7f8ac406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.091+0000 7f8acab3c640 1 -- 172.21.15.49:0/1013800278 shutdown_connections 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.091+0000 7f8acab3c640 1 -- 172.21.15.49:0/1013800278 wait complete. 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.092+0000 7f8acab3c640 1 Processor -- start 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.092+0000 7f8acab3c640 1 -- start start 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.092+0000 7f8acab3c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 0x7f8ac419afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.092+0000 7f8acab3c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 0x7f8ac419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.092+0000 7f8acab3c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac419baf0 con 0x7f8ac4107710 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.092+0000 7f8acab3c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac419bc60 con 0x7f8ac41080e0 2024-09-19T09:02:52.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac88d8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 0x7f8ac419afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 0x7f8ac419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac88d8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 0x7f8ac419afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38140/0 (socket says 172.21.15.49:38140) 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 0x7f8ac419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:56300/0 (socket says 172.21.15.49:56300) 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac88d8640 1 -- 172.21.15.49:0/2455757159 learned_addr learned my addr 172.21.15.49:0/2455757159 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac88d8640 1 -- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 msgr2=0x7f8ac419b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac88d8640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 0x7f8ac419b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.093+0000 7f8ac88d8640 1 -- 172.21.15.49:0/2455757159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0009560 con 0x7f8ac4107710 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.094+0000 7f8ac88d8640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 0x7f8ac419afe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800e940 tx=0x7f8ab800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.094+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/2455757159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab8009700 con 0x7f8ac4107710 2024-09-19T09:02:52.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.094+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/2455757159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ab800cc90 con 0x7f8ac4107710 2024-09-19T09:02:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.095+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/2455757159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab8010430 con 0x7f8ac4107710 2024-09-19T09:02:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.095+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac41a0730 con 0x7f8ac4107710 2024-09-19T09:02:52.240 INFO:tasks.workunit.client.0.smithi049.stdout:9/333: write d3/d14/d34/d44/d4d/f5e [1563540,115174] 0 2024-09-19T09:02:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.095+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac41a0d00 con 0x7f8ac4107710 2024-09-19T09:02:52.241 INFO:tasks.workunit.client.0.smithi049.stdout:0/360: truncate d5/f58 4183767 0 2024-09-19T09:02:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.097+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/2455757159 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f8ab8003fa0 con 0x7f8ac4107710 2024-09-19T09:02:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.098+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac410da90 con 0x7f8ac4107710 2024-09-19T09:02:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.098+0000 7f8ac1ffb640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f8ab406d9b0 0x7f8ab406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.098+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/2455757159 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8ab8014070 con 0x7f8ac4107710 2024-09-19T09:02:52.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.100+0000 7f8ac3fff640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f8ab406d9b0 0x7f8ab406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.100+0000 7f8ac3fff640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f8ab406d9b0 0x7f8ab406fe70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8ac419c500 tx=0x7f8ab0031400 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.243 INFO:tasks.workunit.client.0.smithi049.stdout:9/334: mkdir d3/d14/d1a/d21/d66/d69/d6c 0 2024-09-19T09:02:52.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.106+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/2455757159 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f8ab8056e10 con 0x7f8ac4107710 2024-09-19T09:02:52.251 INFO:tasks.workunit.client.1.smithi102.stdout:8/989: unlink d0/dd3/d132/d147/d29/d97/c4d 0 2024-09-19T09:02:52.251 INFO:tasks.workunit.client.1.smithi102.stdout:8/990: chown d0/dd3/d132/d147/d104/d106/f110 3039315 1 2024-09-19T09:02:52.251 INFO:tasks.workunit.client.1.smithi102.stdout:8/991: creat d0/d10/d21/d39/d50/da2/d127/d134/f14e x:0 0 0 2024-09-19T09:02:52.252 INFO:tasks.workunit.client.1.smithi102.stdout:1/975: sync 2024-09-19T09:02:52.252 INFO:tasks.workunit.client.1.smithi102.stdout:6/946: getdents d1 0 2024-09-19T09:02:52.252 INFO:tasks.workunit.client.1.smithi102.stdout:1/976: symlink dd/d66/dea/l140 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:8/992: fsync d0/d10/d21/d39/d50/d63/d83/f8a 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:8/993: fsync d0/d131/f81 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:8/994: chown d0/d64/l93 363161 1 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:2/973: truncate d7/f10 1121258 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:6/947: mkdir d1/d26/d2e/d45/d47/d4d/d35/d41/da4/d10c/d141 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:2/974: readlink d7/d1a/d2b/dae/de5/l12f 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:6/948: write d1/d26/d4b/d94/da2/f112 [1022213,89727] 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:1/977: link dd/d14/f2a dd/d14/d35/d49/df6/f141 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:8/995: dread d0/ff5 [0,4194304] 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:8/996: write d0/d10/d9b/fc4 [1578604,5937] 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:2/975: read d7/fa0 [2993634,71671] 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:6/949: mknod d1/d26/d2e/d45/d47/d4d/d11d/c142 0 2024-09-19T09:02:52.253 INFO:tasks.workunit.client.1.smithi102.stdout:6/950: write d1/d3a/ff6 [511135,32155] 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:8/997: creat d0/d10/d21/d39/d50/f14f x:0 0 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:8/998: mknod d0/d10/d21/d39/c150 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:8/999: fsync d0/d10/d21/d39/d50/d63/d83/fd0 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:6/951: dread d1/d26/d2e/d45/d47/fd6 [0,4194304] 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:1/978: getdents dd/d7a/d8c/d8e/d103/d78 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:1/979: truncate dd/f11 1665323 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:6/952: symlink d1/d26/d2e/d45/d47/d4d/d11d/l143 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:2/976: dwrite d7/d1a/d2b/d31/fc1 [0,4194304] 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:1/980: getdents dd/d7a/d8c/d8e/d103/d78/d115 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:6/953: getdents d1/d26/d2e/d45/dac/d12f 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:2/977: dwrite d7/d50/d64/d7f/f151 [0,4194304] 0 2024-09-19T09:02:52.254 INFO:tasks.workunit.client.1.smithi102.stdout:2/978: chown d7/d1a/d2b/d31/c116 19000110 1 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:6/954: dread - d1/d26/d2e/fde zero size 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:1/981: symlink dd/d13/l142 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:1/982: read dd/d14/d18/f3f [6127817,121370] 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:1/983: read - dd/d14/d35/d49/d62/d135/f12c zero size 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:6/955: unlink d1/d26/d2e/d45/d47/d4d/d35/d41/f84 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:2/979: fsync d7/d50/d64/d7f/d83/f76 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:2/980: rename d7/d1a/d2b/d31/d106/d93/lcf to d7/d1a/d2b/d31/d106/daf/l152 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:1/984: write dd/f12 [521724,91336] 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:2/981: fsync d7/d1a/d2b/d31/d51/f133 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.1.smithi102.stdout:2/982: dread d7/d1a/d56/db9/fdd [0,4194304] 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.0.smithi049.stdout:0/361: dwrite d5/d10/d13/d15/f68 [0,4194304] 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.0.smithi049.stdout:9/335: symlink d3/d14/d1a/d21/d66/d69/l6d 0 2024-09-19T09:02:52.255 INFO:tasks.workunit.client.0.smithi049.stdout:0/362: mkdir d5/d10/d13/d69/d70 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:0/363: read - d5/d10/d13/d15/d36/f51 zero size 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:0/364: write d5/d10/d13/d15/f43 [2088226,106657] 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:9/336: symlink d3/d14/l6e 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:0/365: link d5/d10/d13/f42 d5/f71 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:9/337: dread d3/d14/d34/f37 [0,4194304] 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:0/366: dwrite d5/d10/d2f/f39 [0,4194304] 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:0/367: readlink d5/d10/d13/d15/l54 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:9/338: mkdir d3/d22/d6f 0 2024-09-19T09:02:52.256 INFO:tasks.workunit.client.0.smithi049.stdout:0/368: rename d5/d10/c25 to d5/d10/d13/d30/c72 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/339: rename d3/d22/c64 to d3/d14/c70 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/340: write d3/f1f [1723467,95199] 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:0/369: link d5/d10/d13/d15/c34 d5/d10/d13/d15/d36/c73 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/341: creat d3/d14/d1a/d21/d66/d69/d6c/f71 x:0 0 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:0/370: creat d5/d10/d2f/f74 x:0 0 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:0/371: chown d5/d10/d13/d15/d36/d3d/l3f 2425 1 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/342: creat d3/d14/d1a/d21/d66/f72 x:0 0 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:1/206: sync 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/164: sync 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:0/372: mkdir d5/d10/d13/d30/d75 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/343: mkdir d3/d14/d1a/d21/d73 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:1/207: creat d5/d6/d8/d13/d24/f43 x:0 0 0 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/165: dread - d3/d5/de/f1a zero size 2024-09-19T09:02:52.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/166: read d3/d5/de/f1e [2354518,6338] 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:0/373: read d5/d10/d2f/f59 [80764,17330] 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:9/344: mkdir d3/d14/d34/d74 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:0/374: write d5/d10/d13/d30/f49 [1408489,25222] 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:5/167: mknod d3/d5/d1c/c37 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:5/168: write d3/d5/de/f25 [764820,23446] 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:9/345: rename d3/d14/d34/d44/l4f to d3/d14/d1a/d21/d31/l75 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:5/169: mkdir d3/d5/d20/d38 0 2024-09-19T09:02:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:1/208: dwrite d5/d6/d8/f25 [0,4194304] 0 2024-09-19T09:02:52.259 INFO:tasks.workunit.client.1.smithi102.stdout:6/956: truncate d1/d18/db/f31 1120420 0 2024-09-19T09:02:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:51 smithi102 ceph-mon[35280]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:51 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:51 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:02:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:51 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:52.260 INFO:tasks.workunit.client.0.smithi049.stdout:4/231: sync 2024-09-19T09:02:52.260 INFO:tasks.workunit.client.0.smithi049.stdout:2/162: sync 2024-09-19T09:02:52.260 INFO:tasks.workunit.client.0.smithi049.stdout:8/331: sync 2024-09-19T09:02:52.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/170: symlink d3/d5/de/l39 0 2024-09-19T09:02:52.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/171: chown l0 836118063 1 2024-09-19T09:02:52.260 INFO:tasks.workunit.client.0.smithi049.stdout:1/209: creat d5/d6/d8/d13/d24/d2b/f44 x:0 0 0 2024-09-19T09:02:52.261 INFO:tasks.workunit.client.0.smithi049.stdout:5/172: chown d3/d5/de/l39 144 1 2024-09-19T09:02:52.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/210: read - d5/d6/d8/d1a/f3e zero size 2024-09-19T09:02:52.262 INFO:tasks.workunit.client.1.smithi102.stdout:2/983: creat d7/d50/d64/d7f/d83/dc7/f153 x:0 0 0 2024-09-19T09:02:52.263 INFO:tasks.workunit.client.0.smithi049.stdout:5/173: write d3/f6 [3973235,97324] 0 2024-09-19T09:02:52.264 INFO:tasks.workunit.client.0.smithi049.stdout:5/174: read - d3/d5/d1c/f2b zero size 2024-09-19T09:02:52.265 INFO:tasks.workunit.client.0.smithi049.stdout:4/232: fsync d4/f13 0 2024-09-19T09:02:52.266 INFO:tasks.workunit.client.1.smithi102.stdout:1/985: link dd/d14/d35/d49/d62/d6c/l9f dd/d14/d35/d49/dcb/l143 0 2024-09-19T09:02:52.267 INFO:tasks.workunit.client.0.smithi049.stdout:2/163: dread - d1/d4/d1e/d21/f22 zero size 2024-09-19T09:02:52.268 INFO:tasks.workunit.client.0.smithi049.stdout:8/332: rename d1/c25 to d1/d11/d2e/d3c/d5d/c64 0 2024-09-19T09:02:52.268 INFO:tasks.workunit.client.0.smithi049.stdout:0/375: getdents d5/d10/d13/d30 0 2024-09-19T09:02:52.270 INFO:tasks.workunit.client.1.smithi102.stdout:6/957: symlink d1/d26/d2e/d45/dac/db2/df5/d127/l144 0 2024-09-19T09:02:52.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/211: mknod d5/d6/d8/d13/d24/d3b/c45 0 2024-09-19T09:02:52.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/212: chown d5/d6/d8/d13/d24/f43 298572 1 2024-09-19T09:02:52.274 INFO:tasks.workunit.client.1.smithi102.stdout:1/986: mkdir dd/d7a/da0/d144 0 2024-09-19T09:02:52.275 INFO:tasks.workunit.client.0.smithi049.stdout:1/213: stat d5/d6/dc 0 2024-09-19T09:02:52.276 INFO:tasks.workunit.client.1.smithi102.stdout:2/984: symlink d7/d50/l154 0 2024-09-19T09:02:52.279 INFO:tasks.workunit.client.0.smithi049.stdout:5/175: mkdir d3/d5/d1c/d3a 0 2024-09-19T09:02:52.281 INFO:tasks.workunit.client.0.smithi049.stdout:5/176: truncate d3/f32 1021263 0 2024-09-19T09:02:52.281 INFO:tasks.workunit.client.0.smithi049.stdout:9/346: dwrite d3/d22/f3e [0,4194304] 0 2024-09-19T09:02:52.281 INFO:tasks.workunit.client.1.smithi102.stdout:6/958: mknod d1/d26/d2e/d45/d47/d4d/d35/d41/c145 0 2024-09-19T09:02:52.282 INFO:tasks.workunit.client.0.smithi049.stdout:9/347: fdatasync d3/d14/d34/f37 0 2024-09-19T09:02:52.283 INFO:tasks.workunit.client.0.smithi049.stdout:9/348: stat d3/d14/d1a/d21/l29 0 2024-09-19T09:02:52.286 INFO:tasks.workunit.client.0.smithi049.stdout:4/233: creat d4/d34/f46 x:0 0 0 2024-09-19T09:02:52.286 INFO:tasks.workunit.client.1.smithi102.stdout:6/959: dwrite d1/d26/d4b/d94/d8a/f6f [0,4194304] 0 2024-09-19T09:02:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:4/234: chown d4/d45 1550709745 1 2024-09-19T09:02:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:2/164: mkdir d1/d2b/d38 0 2024-09-19T09:02:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:8/333: mkdir d1/d11/d2e/d3c/d5d/d65 0 2024-09-19T09:02:52.293 INFO:tasks.workunit.client.1.smithi102.stdout:2/985: symlink d7/da4/l155 0 2024-09-19T09:02:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:0/376: write d5/d10/d13/d15/d36/f6a [400911,106611] 0 2024-09-19T09:02:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:8/334: write d1/f2d [1272684,83934] 0 2024-09-19T09:02:52.295 INFO:tasks.workunit.client.1.smithi102.stdout:6/960: write d1/d18/d37/dda/fe7 [3716389,44586] 0 2024-09-19T09:02:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:8/335: dread - d1/f5a zero size 2024-09-19T09:02:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/349: rename f1 to d3/d22/d6f/f76 0 2024-09-19T09:02:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:1/214: link d5/f26 d5/d6/d19/d21/f46 0 2024-09-19T09:02:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:9/350: chown d3/d14/d1a/d21/d31/f60 976 1 2024-09-19T09:02:52.309 INFO:tasks.workunit.client.0.smithi049.stdout:4/235: mkdir d4/d45/d3f/d47 0 2024-09-19T09:02:52.309 INFO:tasks.workunit.client.0.smithi049.stdout:4/236: stat d4/f16 0 2024-09-19T09:02:52.312 INFO:tasks.workunit.client.0.smithi049.stdout:1/215: creat d5/d6/d8/d13/d24/f47 x:0 0 0 2024-09-19T09:02:52.316 INFO:tasks.workunit.client.0.smithi049.stdout:9/351: creat d3/d14/d1a/d21/f77 x:0 0 0 2024-09-19T09:02:52.321 INFO:tasks.workunit.client.0.smithi049.stdout:1/216: dwrite d5/d6/d8/d1a/f3e [0,4194304] 0 2024-09-19T09:02:52.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/377: getdents d5/d10/d13/d69/d70 0 2024-09-19T09:02:52.327 INFO:tasks.workunit.client.0.smithi049.stdout:1/217: write d5/d6/d19/d21/f32 [140642,42450] 0 2024-09-19T09:02:52.327 INFO:tasks.workunit.client.0.smithi049.stdout:0/378: chown d5/d64 1 1 2024-09-19T09:02:52.330 INFO:tasks.workunit.client.0.smithi049.stdout:9/352: dwrite d3/d14/f54 [0,4194304] 0 2024-09-19T09:02:52.338 INFO:tasks.workunit.client.0.smithi049.stdout:2/165: dwrite d1/d2b/f1a [0,4194304] 0 2024-09-19T09:02:52.343 INFO:tasks.workunit.client.0.smithi049.stdout:5/177: getdents d3/d5/d1c/d2d 0 2024-09-19T09:02:52.344 INFO:tasks.workunit.client.0.smithi049.stdout:9/353: dread d3/d14/d34/f56 [0,4194304] 0 2024-09-19T09:02:52.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/336: write d1/d1a/f3b [1376529,83201] 0 2024-09-19T09:02:52.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/352: sync 2024-09-19T09:02:52.356 INFO:tasks.workunit.client.0.smithi049.stdout:1/218: rename d5/d6/d8/d13/d24/d2b/f44 to d5/d6/dc/f48 0 2024-09-19T09:02:52.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/166: creat d1/d4/f39 x:0 0 0 2024-09-19T09:02:52.363 INFO:tasks.workunit.client.0.smithi049.stdout:5/178: dread d3/d5/f1f [0,4194304] 0 2024-09-19T09:02:52.364 INFO:tasks.workunit.client.0.smithi049.stdout:5/179: stat d3/d5/d1c/f22 0 2024-09-19T09:02:52.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/337: creat d1/d11/d4f/f66 x:0 0 0 2024-09-19T09:02:52.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/379: getdents d5/d10/d13/d69/d70 0 2024-09-19T09:02:52.382 INFO:tasks.workunit.client.0.smithi049.stdout:1/219: rename d5/d6/dc/f16 to d5/f49 0 2024-09-19T09:02:52.384 INFO:tasks.workunit.client.0.smithi049.stdout:9/354: dwrite d3/d14/d1a/f25 [0,4194304] 0 2024-09-19T09:02:52.384 INFO:tasks.workunit.client.0.smithi049.stdout:0/380: dwrite d5/d10/d13/f1c [0,4194304] 0 2024-09-19T09:02:52.386 INFO:tasks.workunit.client.0.smithi049.stdout:2/167: write d1/d2d/f37 [820547,46084] 0 2024-09-19T09:02:52.387 INFO:tasks.workunit.client.0.smithi049.stdout:9/355: dread - d3/d14/d34/d44/f6a zero size 2024-09-19T09:02:52.389 INFO:tasks.workunit.client.0.smithi049.stdout:5/180: write d3/d5/de/d12/f13 [2835779,67394] 0 2024-09-19T09:02:52.389 INFO:tasks.workunit.client.0.smithi049.stdout:8/338: rmdir d1/d11/d2e/d3c 39 2024-09-19T09:02:52.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/237: getdents d4/d15/d19 0 2024-09-19T09:02:52.391 INFO:tasks.workunit.client.0.smithi049.stdout:4/238: write d4/f6 [2941148,52580] 0 2024-09-19T09:02:52.395 INFO:tasks.workunit.client.0.smithi049.stdout:4/239: chown d4/fe 19794235 1 2024-09-19T09:02:52.395 INFO:tasks.workunit.client.0.smithi049.stdout:1/220: dread d5/f36 [0,4194304] 0 2024-09-19T09:02:52.399 INFO:tasks.workunit.client.0.smithi049.stdout:6/194: sync 2024-09-19T09:02:52.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/367: sync 2024-09-19T09:02:52.400 INFO:tasks.workunit.client.0.smithi049.stdout:4/240: readlink d4/d15/d19/d1f/l42 0 2024-09-19T09:02:52.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/181: dwrite d3/f10 [0,4194304] 0 2024-09-19T09:02:52.403 INFO:tasks.workunit.client.0.smithi049.stdout:7/368: readlink d1/d53/l15 0 2024-09-19T09:02:52.404 INFO:tasks.workunit.client.0.smithi049.stdout:7/369: readlink d1/d53/l15 0 2024-09-19T09:02:52.409 INFO:tasks.workunit.client.0.smithi049.stdout:5/182: read - d3/d5/de/f23 zero size 2024-09-19T09:02:52.415 INFO:tasks.workunit.client.0.smithi049.stdout:6/195: rmdir dc/d1b 39 2024-09-19T09:02:52.417 INFO:tasks.workunit.client.0.smithi049.stdout:2/168: dread d1/d2/f13 [0,4194304] 0 2024-09-19T09:02:52.419 INFO:tasks.workunit.client.0.smithi049.stdout:0/381: mknod d5/d64/c76 0 2024-09-19T09:02:52.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/241: creat d4/d45/f48 x:0 0 0 2024-09-19T09:02:52.425 INFO:tasks.workunit.client.0.smithi049.stdout:9/356: symlink d3/d14/l78 0 2024-09-19T09:02:52.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/382: dwrite d5/d10/d13/d15/d29/d3b/f47 [0,4194304] 0 2024-09-19T09:02:52.435 INFO:tasks.workunit.client.0.smithi049.stdout:5/183: fdatasync d3/f10 0 2024-09-19T09:02:52.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/339: rename d1/d11/d2e/d3c/f50 to d1/d11/d3f/d5b/f67 0 2024-09-19T09:02:52.450 INFO:tasks.workunit.client.0.smithi049.stdout:3/353: dwrite d10/d11/d27/f2e [0,4194304] 0 2024-09-19T09:02:52.454 INFO:tasks.workunit.client.0.smithi049.stdout:3/354: write d10/d11/d13/f32 [1583304,99865] 0 2024-09-19T09:02:52.454 INFO:tasks.workunit.client.0.smithi049.stdout:4/242: unlink d4/f30 0 2024-09-19T09:02:52.455 INFO:tasks.workunit.client.0.smithi049.stdout:3/355: stat d10/d11/c12 0 2024-09-19T09:02:52.460 INFO:tasks.workunit.client.0.smithi049.stdout:7/370: mknod d1/d53/d18/d50/d58/d62/d6b/c7b 0 2024-09-19T09:02:52.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/221: link d5/d6/d19/d21/f46 d5/d6/d8/d13/d24/f4a 0 2024-09-19T09:02:52.472 INFO:tasks.workunit.client.0.smithi049.stdout:5/184: readlink d3/d5/l2e 0 2024-09-19T09:02:52.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/340: chown d1/d1a/l5f 1056177106 1 2024-09-19T09:02:52.479 INFO:tasks.workunit.client.0.smithi049.stdout:6/196: truncate dc/f19 9154622 0 2024-09-19T09:02:52.486 INFO:tasks.workunit.client.1.smithi102.stdout:1/987: truncate dd/d14/f27 3595517 0 2024-09-19T09:02:52.486 INFO:tasks.workunit.client.0.smithi049.stdout:2/169: link f0 d1/d4/d1e/f3a 0 2024-09-19T09:02:52.490 INFO:tasks.workunit.client.1.smithi102.stdout:6/961: write d1/d26/d2e/d45/f55 [390898,107251] 0 2024-09-19T09:02:52.493 INFO:tasks.workunit.client.1.smithi102.stdout:1/988: symlink dd/d14/d35/l145 0 2024-09-19T09:02:52.496 INFO:tasks.workunit.client.1.smithi102.stdout:2/986: dwrite d7/d50/f99 [0,4194304] 0 2024-09-19T09:02:52.497 INFO:tasks.workunit.client.1.smithi102.stdout:2/987: write d7/f10 [3670159,4693] 0 2024-09-19T09:02:52.498 INFO:tasks.workunit.client.0.smithi049.stdout:9/357: link d3/d14/d1a/d21/d31/f60 d3/d14/d34/d44/d4d/d58/f79 0 2024-09-19T09:02:52.499 INFO:tasks.workunit.client.1.smithi102.stdout:6/962: dwrite d1/d26/d4b/d94/f8b [0,4194304] 0 2024-09-19T09:02:52.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/371: fdatasync d1/d53/d18/d59/f2c 0 2024-09-19T09:02:52.505 INFO:tasks.workunit.client.1.smithi102.stdout:1/989: truncate dd/d14/d35/d49/d62/d6c/fd2 534980 0 2024-09-19T09:02:52.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/222: write d5/d6/f1f [3201164,18548] 0 2024-09-19T09:02:52.507 INFO:tasks.workunit.client.0.smithi049.stdout:8/341: creat d1/d27/f68 x:0 0 0 2024-09-19T09:02:52.508 INFO:tasks.workunit.client.0.smithi049.stdout:8/342: chown d1/d11/d3f/c42 6216825 1 2024-09-19T09:02:52.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/343: chown d1/d11/d2e/d3c/d5d/d65 17518911 1 2024-09-19T09:02:52.512 INFO:tasks.workunit.client.1.smithi102.stdout:6/963: rmdir d1/d26/d2e 39 2024-09-19T09:02:52.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/243: link d4/d35/f3c d4/d45/d3f/d47/f49 0 2024-09-19T09:02:52.513 INFO:tasks.workunit.client.0.smithi049.stdout:9/358: creat d3/d22/f7a x:0 0 0 2024-09-19T09:02:52.514 INFO:tasks.workunit.client.0.smithi049.stdout:5/185: mknod d3/d5/d20/d38/c3b 0 2024-09-19T09:02:52.516 INFO:tasks.workunit.client.0.smithi049.stdout:1/223: mknod d5/d6/d8/d13/c4b 0 2024-09-19T09:02:52.518 INFO:tasks.workunit.client.1.smithi102.stdout:1/990: stat dd/d14/l32 0 2024-09-19T09:02:52.519 INFO:tasks.workunit.client.1.smithi102.stdout:1/991: write dd/d14/d18/f3f [3295832,105827] 0 2024-09-19T09:02:52.520 INFO:tasks.workunit.client.1.smithi102.stdout:2/988: fsync d7/d50/f99 0 2024-09-19T09:02:52.523 INFO:tasks.workunit.client.0.smithi049.stdout:2/170: dread d1/d4/fb [0,4194304] 0 2024-09-19T09:02:52.525 INFO:tasks.workunit.client.1.smithi102.stdout:6/964: chown d1/d26/d2e/d45/d47/d4d/d35/d41/c145 30 1 2024-09-19T09:02:52.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/383: dwrite d5/f50 [0,4194304] 0 2024-09-19T09:02:52.527 INFO:tasks.workunit.client.1.smithi102.stdout:1/992: symlink dd/d14/d35/d49/d7d/d7f/l146 0 2024-09-19T09:02:52.529 INFO:tasks.workunit.client.0.smithi049.stdout:6/197: creat dc/d1b/d20/d2f/f3f x:0 0 0 2024-09-19T09:02:52.529 INFO:tasks.workunit.client.0.smithi049.stdout:3/356: creat d10/d11/d27/f78 x:0 0 0 2024-09-19T09:02:52.529 INFO:tasks.workunit.client.1.smithi102.stdout:2/989: fdatasync d7/d1a/d2b/f35 0 2024-09-19T09:02:52.530 INFO:tasks.workunit.client.0.smithi049.stdout:4/244: mkdir d4/d45/d4a 0 2024-09-19T09:02:52.531 INFO:tasks.workunit.client.0.smithi049.stdout:9/359: creat d3/d14/d1a/d21/d66/f7b x:0 0 0 2024-09-19T09:02:52.533 INFO:tasks.workunit.client.1.smithi102.stdout:6/965: mkdir d1/d3a/d12e/d146 0 2024-09-19T09:02:52.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/186: truncate d3/d5/f1b 281058 0 2024-09-19T09:02:52.539 INFO:tasks.workunit.client.1.smithi102.stdout:2/990: rename d7/d1a/d56/db9/l12e to d7/d1a/d2b/d31/d106/daf/l156 0 2024-09-19T09:02:52.543 INFO:tasks.workunit.client.0.smithi049.stdout:6/198: chown dc/d16/c28 180427932 1 2024-09-19T09:02:52.544 INFO:tasks.workunit.client.1.smithi102.stdout:1/993: symlink dd/d7a/d8c/d8e/d103/l147 0 2024-09-19T09:02:52.544 INFO:tasks.workunit.client.0.smithi049.stdout:6/199: fdatasync dc/d1b/d20/d2f/f3f 0 2024-09-19T09:02:52.546 INFO:tasks.workunit.client.0.smithi049.stdout:8/344: fsync d1/d1a/f29 0 2024-09-19T09:02:52.547 INFO:tasks.workunit.client.0.smithi049.stdout:6/200: dread dc/d16/f2e [0,4194304] 0 2024-09-19T09:02:52.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/384: dread d5/fa [0,4194304] 0 2024-09-19T09:02:52.548 INFO:tasks.workunit.client.1.smithi102.stdout:2/991: read d7/d11/f8e [426164,11709] 0 2024-09-19T09:02:52.549 INFO:tasks.workunit.client.0.smithi049.stdout:3/357: mkdir d10/d3d/d79 0 2024-09-19T09:02:52.551 INFO:tasks.workunit.client.0.smithi049.stdout:0/385: write d5/d10/d13/d15/d36/f3a [5186646,79250] 0 2024-09-19T09:02:52.551 INFO:tasks.workunit.client.1.smithi102.stdout:1/994: readlink dd/d68/lfd 0 2024-09-19T09:02:52.553 INFO:tasks.workunit.client.1.smithi102.stdout:2/992: fsync d7/d1a/d56/f98 0 2024-09-19T09:02:52.554 INFO:tasks.workunit.client.1.smithi102.stdout:1/995: dread f6 [0,4194304] 0 2024-09-19T09:02:52.555 INFO:tasks.workunit.client.1.smithi102.stdout:2/993: stat d7/d50/d64/d7f/d83/dc7/fef 0 2024-09-19T09:02:52.556 INFO:tasks.workunit.client.0.smithi049.stdout:9/360: creat d3/d14/d34/d44/d4d/d58/f7c x:0 0 0 2024-09-19T09:02:52.556 INFO:tasks.workunit.client.1.smithi102.stdout:6/966: dread d1/d18/f6a [0,4194304] 0 2024-09-19T09:02:52.557 INFO:tasks.workunit.client.1.smithi102.stdout:6/967: read d1/d26/d2e/d45/daf/d8d/f11e [1408230,81929] 0 2024-09-19T09:02:52.560 INFO:tasks.workunit.client.0.smithi049.stdout:5/187: mkdir d3/d5/d1c/d3c 0 2024-09-19T09:02:52.561 INFO:tasks.workunit.client.1.smithi102.stdout:2/994: dwrite d7/d1a/d2b/dae/de5/f137 [0,4194304] 0 2024-09-19T09:02:52.562 INFO:tasks.workunit.client.0.smithi049.stdout:2/171: link d1/d2b/f1a d1/d4/d1e/d21/f3b 0 2024-09-19T09:02:52.564 INFO:tasks.workunit.client.0.smithi049.stdout:2/172: chown d1/d2/f34 13602 1 2024-09-19T09:02:52.565 INFO:tasks.workunit.client.1.smithi102.stdout:1/996: truncate dd/d14/d18/f40 1226679 0 2024-09-19T09:02:52.569 INFO:tasks.workunit.client.1.smithi102.stdout:6/968: rename d1/d26/d2e/d45/d47/d4d/d35/d41 to d1/d26/d2e/d45/dac/db2/df5/d147 0 2024-09-19T09:02:52.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/224: dwrite d5/f26 [0,4194304] 0 2024-09-19T09:02:52.570 INFO:tasks.workunit.client.1.smithi102.stdout:6/969: readlink d1/d26/d2e/d45/d47/dc3/lc9 0 2024-09-19T09:02:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.573+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ac4111060 con 0x7f8ac4107710 2024-09-19T09:02:52.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/201: symlink dc/d1b/d20/l40 0 2024-09-19T09:02:52.574 INFO:tasks.workunit.client.1.smithi102.stdout:2/995: chown d7/d50/d64/d7f/d83/f75 46256789 1 2024-09-19T09:02:52.574 INFO:tasks.workunit.client.0.smithi049.stdout:8/345: creat d1/d11/d3f/d5b/f69 x:0 0 0 2024-09-19T09:02:52.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.575+0000 7f8ac1ffb640 1 -- 172.21.15.49:0/2455757159 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f8ab805a4d0 con 0x7f8ac4107710 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:02:52.576 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 13, 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:02:52.577 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:02:52.578 INFO:tasks.workunit.client.1.smithi102.stdout:6/970: dread d1/d3a/f98 [0,4194304] 0 2024-09-19T09:02:52.578 INFO:tasks.workunit.client.0.smithi049.stdout:3/358: symlink d10/d3d/d46/l7a 0 2024-09-19T09:02:52.579 INFO:tasks.workunit.client.1.smithi102.stdout:1/997: mkdir dd/d14/d35/d49/d62/d6c/d99/db8/d148 0 2024-09-19T09:02:52.580 INFO:tasks.workunit.client.1.smithi102.stdout:1/998: stat dd/d14/dac 0 2024-09-19T09:02:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.580+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f8ab406d9b0 msgr2=0x7f8ab406fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.580+0000 7f8acab3c640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f8ab406d9b0 0x7f8ab406fe70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8ac419c500 tx=0x7f8ab0031400 comp rx=0 tx=0).stop 2024-09-19T09:02:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.580+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 msgr2=0x7f8ac419afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.580+0000 7f8acab3c640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 0x7f8ac419afe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800e940 tx=0x7f8ab800ee00 comp rx=0 tx=0).stop 2024-09-19T09:02:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.580+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 shutdown_connections 2024-09-19T09:02:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.581+0000 7f8acab3c640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f8ab406d9b0 0x7f8ab406fe70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.581+0000 7f8acab3c640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ac41080e0 0x7f8ac419b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.581+0000 7f8acab3c640 1 --2- 172.21.15.49:0/2455757159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ac4107710 0x7f8ac419afe0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.581+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 >> 172.21.15.49:0/2455757159 conn(0x7f8ac406cc10 msgr2=0x7f8ac410ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.582+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 shutdown_connections 2024-09-19T09:02:52.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.582+0000 7f8acab3c640 1 -- 172.21.15.49:0/2455757159 wait complete. 2024-09-19T09:02:52.587 INFO:tasks.workunit.client.1.smithi102.stdout:2/996: mkdir d7/d50/d64/da1/d115/de1/d157 0 2024-09-19T09:02:52.590 INFO:tasks.workunit.client.1.smithi102.stdout:6/971: rename d1/d26/d4b/d94/da2/cae to d1/d26/d4b/d94/da2/c148 0 2024-09-19T09:02:52.591 INFO:tasks.workunit.client.0.smithi049.stdout:7/372: getdents d1/d53/d18/d50/d58 0 2024-09-19T09:02:52.591 INFO:tasks.workunit.client.1.smithi102.stdout:2/997: fsync d7/d1a/d2b/dae/ff9 0 2024-09-19T09:02:52.592 INFO:tasks.workunit.client.0.smithi049.stdout:9/361: creat d3/d14/d1a/f7d x:0 0 0 2024-09-19T09:02:52.592 INFO:tasks.workunit.client.0.smithi049.stdout:7/373: dread - d1/d53/f5b zero size 2024-09-19T09:02:52.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/374: chown d1/d8/c3a 2 1 2024-09-19T09:02:52.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/375: chown d1/c4b 695 1 2024-09-19T09:02:52.598 INFO:tasks.workunit.client.0.smithi049.stdout:7/376: dread d1/d8/d19/f37 [0,4194304] 0 2024-09-19T09:02:52.598 INFO:tasks.workunit.client.1.smithi102.stdout:2/998: readlink d7/d50/d64/d7f/l112 0 2024-09-19T09:02:52.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/377: chown d1/d53/d18/d59/f29 1 1 2024-09-19T09:02:52.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/173: unlink d1/d4/d1e/f3a 0 2024-09-19T09:02:52.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/174: chown d1/d4/d1e/f28 504 1 2024-09-19T09:02:52.602 INFO:tasks.workunit.client.1.smithi102.stdout:6/972: creat d1/d26/d2e/d45/d47/d4d/d35/d79/ddb/d12d/f149 x:0 0 0 2024-09-19T09:02:52.603 INFO:tasks.workunit.client.0.smithi049.stdout:6/202: readlink dc/l2a 0 2024-09-19T09:02:52.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/225: rmdir d5/d6/d19/d21 39 2024-09-19T09:02:52.607 INFO:tasks.workunit.client.0.smithi049.stdout:1/226: write d5/d6/f38 [7453,91415] 0 2024-09-19T09:02:52.608 INFO:tasks.workunit.client.1.smithi102.stdout:6/973: truncate d1/d26/d2e/fde 512204 0 2024-09-19T09:02:52.613 INFO:tasks.workunit.client.0.smithi049.stdout:8/346: fdatasync d1/d11/f4d 0 2024-09-19T09:02:52.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/386: write d5/d10/d2f/f59 [850141,85798] 0 2024-09-19T09:02:52.613 INFO:tasks.workunit.client.1.smithi102.stdout:6/974: dwrite d1/d18/d37/f113 [0,4194304] 0 2024-09-19T09:02:52.614 INFO:tasks.workunit.client.0.smithi049.stdout:3/359: write d10/d11/d27/f45 [475776,122462] 0 2024-09-19T09:02:52.616 INFO:tasks.workunit.client.1.smithi102.stdout:6/975: dread d1/d18/d37/fa0 [0,4194304] 0 2024-09-19T09:02:52.617 INFO:tasks.workunit.client.1.smithi102.stdout:2/999: truncate d7/d1a/d2b/d31/d51/d6b/f70 849112 0 2024-09-19T09:02:52.623 INFO:tasks.workunit.client.1.smithi102.stdout:6/976: mknod d1/d26/d2e/d45/d47/d4d/d11d/c14a 0 2024-09-19T09:02:52.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/245: link d4/d15/d19/d1f/l42 d4/d45/d4a/l4b 0 2024-09-19T09:02:52.629 INFO:tasks.workunit.client.1.smithi102.stdout:6/977: rename d1/d3a/f5d to d1/d26/d2e/d45/d47/d4d/d35/d122/f14b 0 2024-09-19T09:02:52.629 INFO:tasks.workunit.client.0.smithi049.stdout:9/362: dread d3/d14/d34/d4c/f5d [0,4194304] 0 2024-09-19T09:02:52.630 INFO:tasks.workunit.client.0.smithi049.stdout:7/378: mkdir d1/d53/d18/d50/d7c 0 2024-09-19T09:02:52.630 INFO:tasks.workunit.client.0.smithi049.stdout:2/175: creat d1/d4/f3c x:0 0 0 2024-09-19T09:02:52.631 INFO:tasks.workunit.client.0.smithi049.stdout:1/227: creat d5/d6/d8/d13/d24/f4c x:0 0 0 2024-09-19T09:02:52.635 INFO:tasks.workunit.client.0.smithi049.stdout:0/387: creat d5/d10/d2f/f77 x:0 0 0 2024-09-19T09:02:52.635 INFO:tasks.workunit.client.0.smithi049.stdout:7/379: chown d1/d8/fb 0 1 2024-09-19T09:02:52.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/360: dread d10/d11/d13/f18 [0,4194304] 0 2024-09-19T09:02:52.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/347: creat d1/d11/d2e/d3c/f6a x:0 0 0 2024-09-19T09:02:52.640 INFO:tasks.workunit.client.0.smithi049.stdout:5/188: link d3/cf d3/dc/c3d 0 2024-09-19T09:02:52.644 INFO:tasks.workunit.client.0.smithi049.stdout:1/228: dwrite d5/d6/f1f [0,4194304] 0 2024-09-19T09:02:52.649 INFO:tasks.workunit.client.0.smithi049.stdout:5/189: write d3/f10 [4711536,32313] 0 2024-09-19T09:02:52.654 INFO:tasks.workunit.client.0.smithi049.stdout:4/246: mkdir d4/d4c 0 2024-09-19T09:02:52.655 INFO:tasks.workunit.client.1.smithi102.stdout:6/978: write d1/d18/db/f31 [543946,29304] 0 2024-09-19T09:02:52.656 INFO:tasks.workunit.client.0.smithi049.stdout:0/388: symlink d5/l78 0 2024-09-19T09:02:52.656 INFO:tasks.workunit.client.0.smithi049.stdout:2/176: creat d1/d2/d32/f3d x:0 0 0 2024-09-19T09:02:52.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/229: symlink d5/d6/dc/l4d 0 2024-09-19T09:02:52.659 INFO:tasks.workunit.client.0.smithi049.stdout:5/190: readlink d3/d5/de/l39 0 2024-09-19T09:02:52.659 INFO:tasks.workunit.client.0.smithi049.stdout:6/203: link c7 dc/d1b/d20/c41 0 2024-09-19T09:02:52.661 INFO:tasks.workunit.client.0.smithi049.stdout:1/230: write d5/d6/f38 [639417,87159] 0 2024-09-19T09:02:52.661 INFO:tasks.workunit.client.1.smithi102.stdout:6/979: dwrite d1/d26/d2e/d45/daf/d8d/f9c [4194304,4194304] 0 2024-09-19T09:02:52.662 INFO:tasks.workunit.client.0.smithi049.stdout:7/380: creat d1/d53/d18/d50/d7c/f7d x:0 0 0 2024-09-19T09:02:52.666 INFO:tasks.workunit.client.0.smithi049.stdout:8/348: dread d1/f9 [0,4194304] 0 2024-09-19T09:02:52.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/363: dread d3/d14/d1a/f61 [0,4194304] 0 2024-09-19T09:02:52.668 INFO:tasks.workunit.client.0.smithi049.stdout:2/177: read - d1/d4/f1f zero size 2024-09-19T09:02:52.668 INFO:tasks.workunit.client.0.smithi049.stdout:8/349: write d1/fb [6770193,14769] 0 2024-09-19T09:02:52.669 INFO:tasks.workunit.client.0.smithi049.stdout:3/361: rmdir d10/d11/d27/d4f 39 2024-09-19T09:02:52.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/178: chown d1/d4/d1e/f28 215 1 2024-09-19T09:02:52.677 INFO:tasks.workunit.client.0.smithi049.stdout:7/381: symlink d1/d8/d2d/d31/l7e 0 2024-09-19T09:02:52.678 INFO:tasks.workunit.client.0.smithi049.stdout:0/389: stat d5/d10/d2f/f39 0 2024-09-19T09:02:52.680 INFO:tasks.workunit.client.0.smithi049.stdout:8/350: write d1/d11/d2e/f57 [303811,118393] 0 2024-09-19T09:02:52.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/191: dread d3/f32 [0,4194304] 0 2024-09-19T09:02:52.681 INFO:tasks.workunit.client.1.smithi102.stdout:6/980: rename d1/d26/d4b/d94/d8a/f8f to d1/d3a/d12e/d146/f14c 0 2024-09-19T09:02:52.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/179: mknod d1/d2b/c3e 0 2024-09-19T09:02:52.689 INFO:tasks.workunit.client.0.smithi049.stdout:8/351: rename d1/f33 to d1/d11/d3f/f6b 0 2024-09-19T09:02:52.691 INFO:tasks.workunit.client.1.smithi102.stdout:6/981: dread d1/d18/db/f10 [4194304,4194304] 0 2024-09-19T09:02:52.693 INFO:tasks.workunit.client.1.smithi102.stdout:6/982: dread d1/d18/db/f100 [0,4194304] 0 2024-09-19T09:02:52.695 INFO:tasks.workunit.client.0.smithi049.stdout:9/364: dwrite d3/d14/d34/f56 [0,4194304] 0 2024-09-19T09:02:52.698 INFO:tasks.workunit.client.0.smithi049.stdout:9/365: write d3/d14/f3f [7095930,74665] 0 2024-09-19T09:02:52.701 INFO:tasks.workunit.client.0.smithi049.stdout:1/231: dread d5/f23 [0,4194304] 0 2024-09-19T09:02:52.705 INFO:tasks.workunit.client.0.smithi049.stdout:4/247: link d4/d15/c1a d4/d15/c4d 0 2024-09-19T09:02:52.706 INFO:tasks.workunit.client.0.smithi049.stdout:3/362: dread d10/d11/d13/d30/f74 [4194304,4194304] 0 2024-09-19T09:02:52.707 INFO:tasks.workunit.client.0.smithi049.stdout:3/363: chown d10/f15 1 1 2024-09-19T09:02:52.707 INFO:tasks.workunit.client.0.smithi049.stdout:3/364: stat d10/d11/d13/f14 0 2024-09-19T09:02:52.710 INFO:tasks.workunit.client.1.smithi102.stdout:6/983: truncate d1/d18/f25 2064410 0 2024-09-19T09:02:52.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/365: write d10/d11/d27/f68 [889963,105901] 0 2024-09-19T09:02:52.711 INFO:tasks.workunit.client.1.smithi102.stdout:6/984: fsync d1/d26/d2e/d45/daf/d8d/fe2 0 2024-09-19T09:02:52.712 INFO:tasks.workunit.client.0.smithi049.stdout:9/366: creat d3/d22/d6f/f7e x:0 0 0 2024-09-19T09:02:52.713 INFO:tasks.workunit.client.0.smithi049.stdout:9/367: chown d3/d14/d34/d4c/c6b 0 1 2024-09-19T09:02:52.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/382: getdents d1/d53/d18/d50/d58 0 2024-09-19T09:02:52.718 INFO:tasks.workunit.client.0.smithi049.stdout:0/390: truncate d5/d10/d13/d15/f43 697922 0 2024-09-19T09:02:52.722 INFO:tasks.workunit.client.0.smithi049.stdout:2/180: dwrite d1/d2/f13 [0,4194304] 0 2024-09-19T09:02:52.722 INFO:tasks.workunit.client.0.smithi049.stdout:0/391: chown d5/d10/d13/d30 0 1 2024-09-19T09:02:52.725 INFO:tasks.workunit.client.1.smithi102.stdout:6/985: readlink d1/d26/d2e/d45/dac/db2/df5/d147/l106 0 2024-09-19T09:02:52.726 INFO:tasks.workunit.client.0.smithi049.stdout:0/392: dread - d5/d10/d13/d15/d36/f51 zero size 2024-09-19T09:02:52.728 INFO:tasks.workunit.client.0.smithi049.stdout:9/368: dread d3/d14/f54 [0,4194304] 0 2024-09-19T09:02:52.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/232: dread d5/d6/d8/d13/f22 [0,4194304] 0 2024-09-19T09:02:52.731 INFO:tasks.workunit.client.0.smithi049.stdout:0/393: truncate d5/d10/f5c 823226 0 2024-09-19T09:02:52.731 INFO:tasks.workunit.client.0.smithi049.stdout:4/248: stat d4/d15/d19/d1f/c22 0 2024-09-19T09:02:52.732 INFO:tasks.workunit.client.1.smithi102.stdout:1/999: sync 2024-09-19T09:02:52.733 INFO:tasks.workunit.client.0.smithi049.stdout:9/369: truncate d3/d14/d1a/d21/d66/d69/d6c/f71 880422 0 2024-09-19T09:02:52.735 INFO:tasks.workunit.client.0.smithi049.stdout:7/383: creat d1/d8/d2d/d31/f7f x:0 0 0 2024-09-19T09:02:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.735+0000 7f0fd48f9640 1 -- 172.21.15.49:0/3606965851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd00714a0 msgr2=0x7f0fd00718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.736+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/3606965851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd00714a0 0x7f0fd00718a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009880 tx=0x7f0fc802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.739+0000 7f0fd48f9640 1 -- 172.21.15.49:0/3606965851 shutdown_connections 2024-09-19T09:02:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.739+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/3606965851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd01085c0 0x7f0fd0108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.739+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/3606965851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd00714a0 0x7f0fd00718a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.739+0000 7f0fd48f9640 1 -- 172.21.15.49:0/3606965851 >> 172.21.15.49:0/3606965851 conn(0x7f0fd006cfa0 msgr2=0x7f0fd006f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.740+0000 7f0fd48f9640 1 -- 172.21.15.49:0/3606965851 shutdown_connections 2024-09-19T09:02:52.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.741+0000 7f0fd48f9640 1 -- 172.21.15.49:0/3606965851 wait complete. 2024-09-19T09:02:52.741 INFO:tasks.workunit.client.0.smithi049.stdout:1/233: dread f3 [0,4194304] 0 2024-09-19T09:02:52.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.742+0000 7f0fd48f9640 1 Processor -- start 2024-09-19T09:02:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.742+0000 7f0fd48f9640 1 -- start start 2024-09-19T09:02:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.743+0000 7f0fd48f9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd00714a0 0x7f0fd019f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.743+0000 7f0fd48f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd01085c0 0x7f0fd019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.743+0000 7f0fd48f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd019bcc0 con 0x7f0fd01085c0 2024-09-19T09:02:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.743+0000 7f0fd48f9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd019be30 con 0x7f0fd00714a0 2024-09-19T09:02:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.743+0000 7f0fce59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd00714a0 0x7f0fd019f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.743+0000 7f0fce59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd00714a0 0x7f0fd019f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:56316/0 (socket says 172.21.15.49:56316) 2024-09-19T09:02:52.744 INFO:tasks.workunit.client.1.smithi102.stdout:6/986: link d1/d26/d2e/d45/d47/d4d/d35/d79/cb6 d1/d26/d4b/d94/c14d 0 2024-09-19T09:02:52.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.743+0000 7f0fce59c640 1 -- 172.21.15.49:0/2032581756 learned_addr learned my addr 172.21.15.49:0/2032581756 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.744+0000 7f0fcdd9b640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd01085c0 0x7f0fd019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.745+0000 7f0fce59c640 1 -- 172.21.15.49:0/2032581756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd01085c0 msgr2=0x7f0fd019f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.745+0000 7f0fce59c640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd01085c0 0x7f0fd019f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.745+0000 7f0fce59c640 1 -- 172.21.15.49:0/2032581756 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8009560 con 0x7f0fd00714a0 2024-09-19T09:02:52.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.745+0000 7f0fce59c640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd00714a0 0x7f0fd019f180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8004960 tx=0x7f0fc8004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.746+0000 7f0fbf7fe640 1 -- 172.21.15.49:0/2032581756 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc8004200 con 0x7f0fd00714a0 2024-09-19T09:02:52.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.746+0000 7f0fbf7fe640 1 -- 172.21.15.49:0/2032581756 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fc8005d50 con 0x7f0fd00714a0 2024-09-19T09:02:52.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.746+0000 7f0fbf7fe640 1 -- 172.21.15.49:0/2032581756 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc803ca50 con 0x7f0fd00714a0 2024-09-19T09:02:52.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.747+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd019c0b0 con 0x7f0fd00714a0 2024-09-19T09:02:52.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.747+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd019c620 con 0x7f0fd00714a0 2024-09-19T09:02:52.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.750+0000 7f0fbf7fe640 1 -- 172.21.15.49:0/2032581756 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7f0fc803cbb0 con 0x7f0fd00714a0 2024-09-19T09:02:52.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/352: dwrite d1/d11/d2e/d3c/f55 [0,4194304] 0 2024-09-19T09:02:52.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.751+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd00718a0 con 0x7f0fd00714a0 2024-09-19T09:02:52.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.751+0000 7f0fbf7fe640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f0fb806d9a0 0x7f0fb806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:52.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.751+0000 7f0fbf7fe640 1 -- 172.21.15.49:0/2032581756 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0fc80ae310 con 0x7f0fd00714a0 2024-09-19T09:02:52.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/384: mkdir d1/d8/d80 0 2024-09-19T09:02:52.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.752+0000 7f0fcdd9b640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f0fb806d9a0 0x7f0fb806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:52.752 INFO:tasks.workunit.client.0.smithi049.stdout:2/181: link d1/d4/d20/l27 d1/d4/d20/l3f 0 2024-09-19T09:02:52.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.756+0000 7f0fcdd9b640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f0fb806d9a0 0x7f0fb806fe60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0fd019d100 tx=0x7f0fc4005f90 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:52.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:52.757+0000 7f0fbf7fe640 1 -- 172.21.15.49:0/2032581756 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f0fc8077870 con 0x7f0fd00714a0 2024-09-19T09:02:52.759 INFO:tasks.workunit.client.0.smithi049.stdout:4/249: creat d4/d45/d4a/f4e x:0 0 0 2024-09-19T09:02:52.760 INFO:tasks.workunit.client.1.smithi102.stdout:6/987: link d1/d18/db/c56 d1/d26/d4b/d94/c14e 0 2024-09-19T09:02:52.761 INFO:tasks.workunit.client.0.smithi049.stdout:9/370: truncate d3/d14/d1a/d21/f41 1513789 0 2024-09-19T09:02:52.763 INFO:tasks.workunit.client.0.smithi049.stdout:7/385: rename d1/d8/d2d/f4f to d1/d53/d18/d50/d58/d62/d6b/f81 0 2024-09-19T09:02:52.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/353: dwrite d1/d1a/f5e [0,4194304] 0 2024-09-19T09:02:52.764 INFO:tasks.workunit.client.1.smithi102.stdout:6/988: creat d1/d26/d2e/d45/dac/df1/f14f x:0 0 0 2024-09-19T09:02:52.765 INFO:tasks.workunit.client.1.smithi102.stdout:6/989: chown d1/d26/d2e/d45/d47/d4d/d35/d122/f14b 22568 1 2024-09-19T09:02:52.767 INFO:tasks.workunit.client.1.smithi102.stdout:6/990: rmdir d1/d18/d37 39 2024-09-19T09:02:52.768 INFO:tasks.workunit.client.1.smithi102.stdout:6/991: truncate d1/d26/d2e/d45/d47/d4d/f136 781648 0 2024-09-19T09:02:52.774 INFO:tasks.workunit.client.0.smithi049.stdout:2/182: dwrite d1/d2/d32/f3d [0,4194304] 0 2024-09-19T09:02:52.775 INFO:tasks.workunit.client.1.smithi102.stdout:6/992: mknod d1/d26/d4b/c150 0 2024-09-19T09:02:52.778 INFO:tasks.workunit.client.0.smithi049.stdout:7/386: write d1/d8/fb [6835440,106927] 0 2024-09-19T09:02:52.781 INFO:tasks.workunit.client.0.smithi049.stdout:4/250: dread d4/d15/d19/d1f/f2e [0,4194304] 0 2024-09-19T09:02:52.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/387: fsync d1/d8/fb 0 2024-09-19T09:02:52.784 INFO:tasks.workunit.client.1.smithi102.stdout:6/993: dwrite d1/d26/d2e/d45/d47/d4d/f12a [0,4194304] 0 2024-09-19T09:02:52.797 INFO:tasks.workunit.client.0.smithi049.stdout:2/183: dwrite d1/d2/f24 [0,4194304] 0 2024-09-19T09:02:52.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/371: dwrite d3/d14/d1a/d21/d66/f7b [0,4194304] 0 2024-09-19T09:02:52.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/394: dwrite d5/fd [0,4194304] 0 2024-09-19T09:02:52.800 INFO:tasks.workunit.client.1.smithi102.stdout:6/994: mknod d1/d26/d2e/d45/d47/d4d/d35/c151 0 2024-09-19T09:02:52.804 INFO:tasks.workunit.client.1.smithi102.stdout:6/995: unlink d1/d26/d2e/d45/daf/l59 0 2024-09-19T09:02:52.805 INFO:tasks.workunit.client.0.smithi049.stdout:0/395: dread d5/d10/d13/f1c [0,4194304] 0 2024-09-19T09:02:52.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/251: rmdir d4/d15 39 2024-09-19T09:02:52.805 INFO:tasks.workunit.client.1.smithi102.stdout:6/996: chown d1/d26/d4b/d94/cc6 1270 1 2024-09-19T09:02:52.809 INFO:tasks.workunit.client.0.smithi049.stdout:2/184: truncate d1/d4/fb 1981437 0 2024-09-19T09:02:52.813 INFO:tasks.workunit.client.1.smithi102.stdout:6/997: creat d1/d26/d2e/d45/d47/dc3/f152 x:0 0 0 2024-09-19T09:02:52.814 INFO:tasks.workunit.client.0.smithi049.stdout:2/185: stat d1/d4/d20 0 2024-09-19T09:02:52.814 INFO:tasks.workunit.client.0.smithi049.stdout:2/186: chown d1/d2b/f1b 252 1 2024-09-19T09:02:52.815 INFO:tasks.workunit.client.0.smithi049.stdout:9/372: write d3/d14/f42 [340253,59477] 0 2024-09-19T09:02:52.816 INFO:tasks.workunit.client.1.smithi102.stdout:6/998: chown d1/d26/d2e/d45/d47/d4d/c3f 4 1 2024-09-19T09:02:52.819 INFO:tasks.workunit.client.0.smithi049.stdout:2/187: mknod d1/d4/d1e/d21/c40 0 2024-09-19T09:02:52.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/252: rename d4/d15/d3a to d4/d34/d3d/d4f 0 2024-09-19T09:02:52.821 INFO:tasks.workunit.client.1.smithi102.stdout:6/999: creat d1/d26/d2e/d45/d47/f153 x:0 0 0 2024-09-19T09:02:52.822 INFO:tasks.workunit.client.0.smithi049.stdout:0/396: symlink d5/d10/d13/d30/d75/l79 0 2024-09-19T09:02:52.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/253: truncate d4/d45/d4a/f4e 800789 0 2024-09-19T09:02:52.825 INFO:tasks.workunit.client.0.smithi049.stdout:9/373: symlink d3/d14/d34/d44/l7f 0 2024-09-19T09:02:52.826 INFO:tasks.workunit.client.1.smithi102.stderr:+ rm -rf -- ./tmp.veGdobeYPQ 2024-09-19T09:02:52.827 INFO:tasks.workunit.client.0.smithi049.stdout:0/397: write d5/d10/d13/d15/d36/f41 [1342997,106518] 0 2024-09-19T09:02:52.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/398: write d5/d10/d13/d15/f68 [2288429,126460] 0 2024-09-19T09:02:52.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/354: dread d1/d11/d3f/d5b/f67 [0,4194304] 0 2024-09-19T09:02:52.835 INFO:tasks.workunit.client.0.smithi049.stdout:7/388: truncate d1/d8/d19/f46 1918039 0 2024-09-19T09:02:52.839 INFO:tasks.workunit.client.0.smithi049.stdout:2/188: dread d1/d4/f17 [0,4194304] 0 2024-09-19T09:02:52.843 INFO:tasks.workunit.client.0.smithi049.stdout:0/399: dwrite d5/d10/d13/d15/d36/f3a [0,4194304] 0 2024-09-19T09:02:52.843 INFO:tasks.workunit.client.0.smithi049.stdout:9/374: write d3/d14/d1a/f61 [844603,58860] 0 2024-09-19T09:02:52.848 INFO:tasks.workunit.client.0.smithi049.stdout:4/254: link d4/lf d4/d45/d4a/l50 0 2024-09-19T09:02:52.851 INFO:tasks.workunit.client.0.smithi049.stdout:7/389: dwrite d1/d8/f1c [0,4194304] 0 2024-09-19T09:02:52.851 INFO:tasks.workunit.client.0.smithi049.stdout:9/375: creat d3/d14/d1a/f80 x:0 0 0 2024-09-19T09:02:52.852 INFO:tasks.workunit.client.0.smithi049.stdout:2/189: mkdir d1/d2b/d38/d41 0 2024-09-19T09:02:52.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/355: link d1/d11/l38 d1/d11/l6c 0 2024-09-19T09:02:52.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/376: stat d3/d22/l5c 0 2024-09-19T09:02:52.856 INFO:tasks.workunit.client.0.smithi049.stdout:7/390: rename c0 to d1/d8/d2d/d31/d6e/c82 0 2024-09-19T09:02:52.859 INFO:tasks.workunit.client.0.smithi049.stdout:9/377: chown d3/d14/d34/c65 217969 1 2024-09-19T09:02:52.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/255: rmdir d4/d34/d3b 0 2024-09-19T09:02:52.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/256: write f2 [3571814,49545] 0 2024-09-19T09:02:52.863 INFO:tasks.workunit.client.0.smithi049.stdout:7/391: fsync d1/d8/d19/f55 0 2024-09-19T09:02:52.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/400: fdatasync d5/d10/d13/d15/d36/f3a 0 2024-09-19T09:02:52.866 INFO:tasks.workunit.client.0.smithi049.stdout:9/378: rename d3/d14/f54 to d3/d22/d6f/f81 0 2024-09-19T09:02:52.867 INFO:tasks.workunit.client.0.smithi049.stdout:7/392: truncate d1/d53/d18/d50/d7c/f7d 211967 0 2024-09-19T09:02:52.868 INFO:tasks.workunit.client.0.smithi049.stdout:9/379: readlink d3/d14/l6e 0 2024-09-19T09:02:52.868 INFO:tasks.workunit.client.0.smithi049.stdout:4/257: rmdir d4/d35 39 2024-09-19T09:02:52.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/393: chown d1/d53/d18/d59/f29 50 1 2024-09-19T09:02:52.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/356: link d1/f21 d1/d11/d2e/d3c/d5d/d65/f6d 0 2024-09-19T09:02:52.874 INFO:tasks.workunit.client.0.smithi049.stdout:7/394: mknod d1/d8/c83 0 2024-09-19T09:02:52.879 INFO:tasks.workunit.client.0.smithi049.stdout:8/357: dread d1/d1a/f5e [0,4194304] 0 2024-09-19T09:02:52.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/258: creat d4/d35/f51 x:0 0 0 2024-09-19T09:02:52.886 INFO:tasks.workunit.client.0.smithi049.stdout:7/395: creat d1/d8/f84 x:0 0 0 2024-09-19T09:02:52.891 INFO:tasks.workunit.client.0.smithi049.stdout:8/358: chown d1/d27/f58 29934 1 2024-09-19T09:02:52.893 INFO:tasks.workunit.client.0.smithi049.stdout:8/359: readlink d1/d11/d2e/d3c/l4a 0 2024-09-19T09:02:52.893 INFO:tasks.workunit.client.0.smithi049.stdout:4/259: rename d4/d35/f51 to d4/d35/f52 0 2024-09-19T09:02:52.896 INFO:tasks.workunit.client.0.smithi049.stdout:0/401: getdents d5/d10/d13/d30/d75 0 2024-09-19T09:02:52.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/190: dwrite d1/d4/d1e/d21/f3b [0,4194304] 0 2024-09-19T09:02:52.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/191: dread - d1/d4/f1f zero size 2024-09-19T09:02:52.901 INFO:tasks.workunit.client.0.smithi049.stdout:9/380: write d3/d14/d1a/d21/d31/f60 [4600189,101569] 0 2024-09-19T09:02:52.903 INFO:tasks.workunit.client.0.smithi049.stdout:9/381: read d3/d14/d34/f56 [2547229,33658] 0 2024-09-19T09:02:52.905 INFO:tasks.workunit.client.0.smithi049.stdout:0/402: chown d5/d10/c32 2063192100 1 2024-09-19T09:02:52.905 INFO:tasks.workunit.client.0.smithi049.stdout:4/260: unlink d4/d34/l38 0 2024-09-19T09:02:52.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/403: readlink d5/le 0 2024-09-19T09:02:52.909 INFO:tasks.workunit.client.0.smithi049.stdout:8/360: dwrite d1/d11/d4f/f66 [0,4194304] 0 2024-09-19T09:02:52.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/361: fsync d1/fb 0 2024-09-19T09:02:52.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/396: rename d1/d53/d18/d50/d7c/f7d to d1/d53/f85 0 2024-09-19T09:02:52.912 INFO:tasks.workunit.client.0.smithi049.stdout:2/192: symlink d1/d2b/d38/d41/l42 0 2024-09-19T09:02:52.914 INFO:tasks.workunit.client.0.smithi049.stdout:4/261: symlink d4/d34/d3d/d4f/l53 0 2024-09-19T09:02:52.917 INFO:tasks.workunit.client.0.smithi049.stdout:9/382: unlink d3/d14/d1a/d21/d66/f72 0 2024-09-19T09:02:52.926 INFO:tasks.workunit.client.0.smithi049.stdout:8/362: rename d1/d11/d2e/d3c/c51 to d1/d11/d2e/d3c/c6e 0 2024-09-19T09:02:52.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/404: symlink d5/d10/d13/d15/d36/l7a 0 2024-09-19T09:02:52.929 INFO:tasks.workunit.client.0.smithi049.stdout:0/405: dread - d5/d10/d13/d15/d29/f4b zero size 2024-09-19T09:02:52.931 INFO:tasks.workunit.client.0.smithi049.stdout:9/383: mkdir d3/d22/d6f/d82 0 2024-09-19T09:02:52.935 INFO:tasks.workunit.client.0.smithi049.stdout:7/397: creat d1/d8/d80/f86 x:0 0 0 2024-09-19T09:02:52.937 INFO:tasks.workunit.client.0.smithi049.stdout:0/406: symlink d5/d10/d13/d69/l7b 0 2024-09-19T09:02:52.938 INFO:tasks.workunit.client.0.smithi049.stdout:0/407: chown d5/d10/c35 61 1 2024-09-19T09:02:52.944 INFO:tasks.workunit.client.0.smithi049.stdout:7/398: creat d1/d8/d2d/f87 x:0 0 0 2024-09-19T09:02:52.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/262: link d4/d15/c2a d4/d34/c54 0 2024-09-19T09:02:52.949 INFO:tasks.workunit.client.0.smithi049.stdout:2/193: dwrite d1/d4/f17 [0,4194304] 0 2024-09-19T09:02:52.951 INFO:tasks.workunit.client.0.smithi049.stdout:0/408: rename d5/d10/d2f/f39 to d5/d10/d13/d15/d36/d3d/f7c 0 2024-09-19T09:02:52.961 INFO:tasks.workunit.client.0.smithi049.stdout:8/363: dwrite d1/f39 [4194304,4194304] 0 2024-09-19T09:02:52.963 INFO:tasks.workunit.client.0.smithi049.stdout:7/399: symlink d1/d53/d18/d50/d58/d62/d6b/l88 0 2024-09-19T09:02:52.965 INFO:tasks.workunit.client.0.smithi049.stdout:4/263: mkdir d4/d15/d19/d1f/d55 0 2024-09-19T09:02:52.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/194: mkdir d1/d2b/d43 0 2024-09-19T09:02:52.968 INFO:tasks.workunit.client.0.smithi049.stdout:4/264: readlink d4/d34/d3d/l44 0 2024-09-19T09:02:52.973 INFO:tasks.workunit.client.0.smithi049.stdout:7/400: dwrite d1/d8/f1c [0,4194304] 0 2024-09-19T09:02:52.973 INFO:tasks.workunit.client.0.smithi049.stdout:4/265: write d4/d45/d4a/f4e [1194312,77962] 0 2024-09-19T09:02:52.974 INFO:tasks.workunit.client.0.smithi049.stdout:7/401: stat d1/d8/f6c 0 2024-09-19T09:02:52.976 INFO:tasks.workunit.client.0.smithi049.stdout:9/384: link d3/d14/d1a/d21/d66/d69/l6d d3/d14/d1a/d21/d31/l83 0 2024-09-19T09:02:52.977 INFO:tasks.workunit.client.0.smithi049.stdout:8/364: creat d1/d11/d3f/d5b/f6f x:0 0 0 2024-09-19T09:02:52.978 INFO:tasks.workunit.client.0.smithi049.stdout:8/365: stat d1/d27 0 2024-09-19T09:02:52.978 INFO:tasks.workunit.client.0.smithi049.stdout:8/366: stat d1/d1a/c2c 0 2024-09-19T09:02:52.978 INFO:tasks.workunit.client.0.smithi049.stdout:2/195: symlink d1/d2/d32/l44 0 2024-09-19T09:02:52.982 INFO:tasks.workunit.client.0.smithi049.stdout:0/409: mkdir d5/d10/d7d 0 2024-09-19T09:02:52.983 INFO:tasks.workunit.client.0.smithi049.stdout:4/266: fdatasync d4/f5 0 2024-09-19T09:02:52.984 INFO:tasks.workunit.client.0.smithi049.stdout:7/402: mkdir d1/d8/d89 0 2024-09-19T09:02:52.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/196: mkdir d1/d4/d1e/d45 0 2024-09-19T09:02:52.987 INFO:tasks.workunit.client.0.smithi049.stdout:2/197: stat d1/d2b/f1b 0 2024-09-19T09:02:52.988 INFO:tasks.workunit.client.0.smithi049.stdout:8/367: symlink d1/d11/d2e/d4e/l70 0 2024-09-19T09:02:53.013 INFO:tasks.workunit.client.0.smithi049.stdout:9/385: dread d3/d14/d34/d44/d4d/d58/f79 [0,4194304] 0 2024-09-19T09:02:53.051 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:52 smithi102 ceph-mon[35280]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:53.051 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:52 smithi102 ceph-mon[35280]: pgmap v33: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 63 MiB/s rd, 179 MiB/s wr, 365 op/s 2024-09-19T09:02:53.052 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:52 smithi102 ceph-mon[35280]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:53.052 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:52 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:53.052 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:52 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2455757159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:02:53.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.094+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0fd010ed90 con 0x7f0fd00714a0 2024-09-19T09:02:53.094 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:52 smithi049 ceph-mon[28158]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:53.095 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:52 smithi049 ceph-mon[28158]: pgmap v33: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 63 MiB/s rd, 179 MiB/s wr, 365 op/s 2024-09-19T09:02:53.095 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:52 smithi049 ceph-mon[28158]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:53.095 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:52 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:02:53.095 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:52 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2455757159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:02:53.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.095+0000 7f0fbf7fe640 1 -- 172.21.15.49:0/2032581756 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f0fc803ce60 con 0x7f0fd00714a0 2024-09-19T09:02:53.095 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:02:53.096 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:02:53.097 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:02:53.098 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:02:53.099 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:02:53.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.097+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f0fb806d9a0 msgr2=0x7f0fb806fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.097+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f0fb806d9a0 0x7f0fb806fe60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0fd019d100 tx=0x7f0fc4005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.097+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd00714a0 msgr2=0x7f0fd019f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.097+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd00714a0 0x7f0fd019f180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8004960 tx=0x7f0fc8004c10 comp rx=0 tx=0).stop 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.098+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 shutdown_connections 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.098+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f0fb806d9a0 0x7f0fb806fe60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.098+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fd01085c0 0x7f0fd019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.098+0000 7f0fd48f9640 1 --2- 172.21.15.49:0/2032581756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd00714a0 0x7f0fd019f180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.098+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 >> 172.21.15.49:0/2032581756 conn(0x7f0fd006cfa0 msgr2=0x7f0fd010bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.098+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 shutdown_connections 2024-09-19T09:02:53.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.098+0000 7f0fd48f9640 1 -- 172.21.15.49:0/2032581756 wait complete. 2024-09-19T09:02:53.180 INFO:tasks.workunit.client.0.smithi049.stdout:0/410: symlink d5/d10/d2f/l7e 0 2024-09-19T09:02:53.181 INFO:tasks.workunit.client.0.smithi049.stdout:0/411: fdatasync d5/d10/d13/d15/d36/f51 0 2024-09-19T09:02:53.182 INFO:tasks.workunit.client.0.smithi049.stdout:2/198: creat d1/d4/f46 x:0 0 0 2024-09-19T09:02:53.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/412: dread d5/d10/d13/d15/d36/f6a [0,4194304] 0 2024-09-19T09:02:53.187 INFO:tasks.workunit.client.0.smithi049.stdout:0/413: chown d5/d10/d3c/l5a 109061023 1 2024-09-19T09:02:53.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 -- 172.21.15.49:0/3989011759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 msgr2=0x7fc99c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/3989011759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c072940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009880 tx=0x7fc98c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 -- 172.21.15.49:0/3989011759 shutdown_connections 2024-09-19T09:02:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/3989011759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c072f10 0x7fc99c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/3989011759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c072940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 -- 172.21.15.49:0/3989011759 >> 172.21.15.49:0/3989011759 conn(0x7fc99c0fb360 msgr2=0x7fc99c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 -- 172.21.15.49:0/3989011759 shutdown_connections 2024-09-19T09:02:53.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.188+0000 7fc9a1d55640 1 -- 172.21.15.49:0/3989011759 wait complete. 2024-09-19T09:02:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.189+0000 7fc9a1d55640 1 Processor -- start 2024-09-19T09:02:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.189+0000 7fc9a1d55640 1 -- start start 2024-09-19T09:02:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.189+0000 7fc9a1d55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c072f10 0x7fc99c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.189+0000 7fc9a1d55640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c19c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.189+0000 7fc9a1d55640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c19c840 con 0x7fc99c072f10 2024-09-19T09:02:53.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.189+0000 7fc9a1d55640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c19c9b0 con 0x7fc99c0744e0 2024-09-19T09:02:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c19c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c072f10 0x7fc99c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c19c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:56342/0 (socket says 172.21.15.49:56342) 2024-09-19T09:02:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99affd640 1 -- 172.21.15.49:0/2286836874 learned_addr learned my addr 172.21.15.49:0/2286836874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99affd640 1 -- 172.21.15.49:0/2286836874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c072f10 msgr2=0x7fc99c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99affd640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c072f10 0x7fc99c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99affd640 1 -- 172.21.15.49:0/2286836874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c009560 con 0x7fc99c0744e0 2024-09-19T09:02:53.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/403: mknod d1/d8/d2d/d72/c8a 0 2024-09-19T09:02:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc99affd640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c19c270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b420 tx=0x7fc99000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.190+0000 7fc998ff9640 1 -- 172.21.15.49:0/2286836874 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc990011800 con 0x7fc99c0744e0 2024-09-19T09:02:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.191+0000 7fc998ff9640 1 -- 172.21.15.49:0/2286836874 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc990011e20 con 0x7fc99c0744e0 2024-09-19T09:02:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.191+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c1a1440 con 0x7fc99c0744e0 2024-09-19T09:02:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.191+0000 7fc998ff9640 1 -- 172.21.15.49:0/2286836874 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc99000f2e0 con 0x7fc99c0744e0 2024-09-19T09:02:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.191+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c1a1a10 con 0x7fc99c0744e0 2024-09-19T09:02:53.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.192+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c10edf0 con 0x7fc99c0744e0 2024-09-19T09:02:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.193+0000 7fc998ff9640 1 -- 172.21.15.49:0/2286836874 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fc990011960 con 0x7fc99c0744e0 2024-09-19T09:02:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.193+0000 7fc998ff9640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fc98406d890 0x7fc98406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.193+0000 7fc998ff9640 1 -- 172.21.15.49:0/2286836874 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc99008cb80 con 0x7fc99c0744e0 2024-09-19T09:02:53.193 INFO:tasks.workunit.client.0.smithi049.stdout:4/267: write d4/f21 [3766885,124486] 0 2024-09-19T09:02:53.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.195+0000 7fc99b7fe640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fc98406d890 0x7fc98406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.196+0000 7fc99b7fe640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fc98406d890 0x7fc98406fd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc99c19d210 tx=0x7fc98c0314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.196 INFO:tasks.workunit.client.0.smithi049.stdout:2/199: symlink d1/d2b/d38/l47 0 2024-09-19T09:02:53.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.199+0000 7fc998ff9640 1 -- 172.21.15.49:0/2286836874 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fc990056210 con 0x7fc99c0744e0 2024-09-19T09:02:53.199 INFO:tasks.workunit.client.0.smithi049.stdout:0/414: mkdir d5/d10/d13/d15/d36/d3d/d7f 0 2024-09-19T09:02:53.202 INFO:tasks.workunit.client.0.smithi049.stdout:8/368: dwrite d1/d11/d2e/f56 [4194304,4194304] 0 2024-09-19T09:02:53.205 INFO:tasks.workunit.client.0.smithi049.stdout:2/200: dwrite d1/d4/f17 [0,4194304] 0 2024-09-19T09:02:53.208 INFO:tasks.workunit.client.0.smithi049.stdout:7/404: symlink d1/d53/d18/l8b 0 2024-09-19T09:02:53.208 INFO:tasks.workunit.client.0.smithi049.stdout:2/201: stat d1/d4/ce 0 2024-09-19T09:02:53.211 INFO:tasks.workunit.client.0.smithi049.stdout:2/202: chown d1/d2b/d38/l47 25 1 2024-09-19T09:02:53.219 INFO:tasks.workunit.client.0.smithi049.stdout:8/369: dwrite d1/d11/d2e/f56 [0,4194304] 0 2024-09-19T09:02:53.222 INFO:tasks.workunit.client.0.smithi049.stdout:9/386: getdents d3/d14/d34/d4c 0 2024-09-19T09:02:53.226 INFO:tasks.workunit.client.0.smithi049.stdout:7/405: creat d1/d53/d18/d50/d58/d62/d6b/f8c x:0 0 0 2024-09-19T09:02:53.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/406: write d1/d53/d18/d59/f33 [1742825,21882] 0 2024-09-19T09:02:53.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/268: dwrite d4/d15/f20 [0,4194304] 0 2024-09-19T09:02:53.233 INFO:tasks.workunit.client.0.smithi049.stdout:0/415: link d5/d10/d13/d15/d36/f6e d5/d10/d13/f80 0 2024-09-19T09:02:53.234 INFO:tasks.workunit.client.0.smithi049.stdout:8/370: fdatasync d1/d1a/f29 0 2024-09-19T09:02:53.235 INFO:tasks.workunit.client.0.smithi049.stdout:9/387: mknod d3/d14/d34/d44/d4d/d58/c84 0 2024-09-19T09:02:53.236 INFO:tasks.workunit.client.0.smithi049.stdout:8/371: stat d1/d11/d2e/d3c 0 2024-09-19T09:02:53.237 INFO:tasks.workunit.client.0.smithi049.stdout:9/388: fdatasync d3/d14/f3f 0 2024-09-19T09:02:53.238 INFO:tasks.workunit.client.0.smithi049.stdout:8/372: stat l0 0 2024-09-19T09:02:53.243 INFO:tasks.workunit.client.0.smithi049.stdout:2/203: rmdir d1/d2b/d43 0 2024-09-19T09:02:53.243 INFO:tasks.workunit.client.0.smithi049.stdout:2/204: stat d1/d2b/f1b 0 2024-09-19T09:02:53.244 INFO:tasks.workunit.client.0.smithi049.stdout:0/416: dread d5/d10/d13/d15/d36/d3d/f7c [0,4194304] 0 2024-09-19T09:02:53.244 INFO:tasks.workunit.client.0.smithi049.stdout:2/205: chown d1/d2b/d38/l47 2071475 1 2024-09-19T09:02:53.245 INFO:tasks.workunit.client.0.smithi049.stdout:2/206: read - d1/d4/d1e/d21/f22 zero size 2024-09-19T09:02:53.246 INFO:tasks.workunit.client.0.smithi049.stdout:2/207: fsync d1/f7 0 2024-09-19T09:02:53.250 INFO:tasks.workunit.client.0.smithi049.stdout:9/389: rename d3/d14/d1a/d21/d31/l52 to d3/d14/d1a/d21/d73/l85 0 2024-09-19T09:02:53.255 INFO:tasks.workunit.client.0.smithi049.stdout:0/417: rmdir d5/d64 39 2024-09-19T09:02:53.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/390: dwrite d3/d14/d1a/d21/d66/f7b [0,4194304] 0 2024-09-19T09:02:53.262 INFO:tasks.workunit.client.0.smithi049.stdout:0/418: dread d5/d10/f5c [0,4194304] 0 2024-09-19T09:02:53.262 INFO:tasks.workunit.client.0.smithi049.stdout:4/269: write d4/f40 [2797131,51842] 0 2024-09-19T09:02:53.263 INFO:tasks.workunit.client.0.smithi049.stdout:2/208: unlink d1/l9 0 2024-09-19T09:02:53.266 INFO:tasks.workunit.client.0.smithi049.stdout:7/407: link d1/d53/d18/d59/f2c d1/d53/d18/f8d 0 2024-09-19T09:02:53.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/373: link d1/l1e d1/d11/d3f/l71 0 2024-09-19T09:02:53.272 INFO:tasks.workunit.client.0.smithi049.stdout:8/374: write d1/d11/d2e/d3c/f6a [644637,32674] 0 2024-09-19T09:02:53.275 INFO:tasks.workunit.client.0.smithi049.stdout:9/391: dread d3/d14/d1a/d21/d31/f62 [0,4194304] 0 2024-09-19T09:02:53.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/270: fdatasync d4/f17 0 2024-09-19T09:02:53.283 INFO:tasks.workunit.client.0.smithi049.stdout:0/419: creat d5/d10/d13/d30/d75/f81 x:0 0 0 2024-09-19T09:02:53.283 INFO:tasks.workunit.client.0.smithi049.stdout:4/271: dread d4/d45/d4a/f4e [0,4194304] 0 2024-09-19T09:02:53.285 INFO:tasks.workunit.client.0.smithi049.stdout:4/272: stat d4/d15/d19/f2f 0 2024-09-19T09:02:53.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/408: mknod d1/d8/d2d/d31/c8e 0 2024-09-19T09:02:53.298 INFO:tasks.workunit.client.0.smithi049.stdout:4/273: dread d4/f1e [0,4194304] 0 2024-09-19T09:02:53.299 INFO:tasks.workunit.client.0.smithi049.stdout:2/209: creat d1/d4/d1e/d45/f48 x:0 0 0 2024-09-19T09:02:53.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/375: mknod d1/d11/d2e/d3c/d5d/d65/c72 0 2024-09-19T09:02:53.302 INFO:tasks.workunit.client.0.smithi049.stdout:9/392: symlink d3/d22/d6f/d82/l86 0 2024-09-19T09:02:53.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/420: rename d5/d10/d13/d15/d29/d3b to d5/d10/d82 0 2024-09-19T09:02:53.315 INFO:tasks.workunit.client.0.smithi049.stdout:9/393: dwrite d3/d22/d6f/f76 [8388608,4194304] 0 2024-09-19T09:02:53.317 INFO:tasks.workunit.client.0.smithi049.stdout:0/421: truncate d5/d10/d2f/f77 93144 0 2024-09-19T09:02:53.326 INFO:tasks.workunit.client.0.smithi049.stdout:7/409: rename d1/d53/f75 to d1/d8/d2d/f8f 0 2024-09-19T09:02:53.329 INFO:tasks.workunit.client.0.smithi049.stdout:2/210: dread f0 [0,4194304] 0 2024-09-19T09:02:53.334 INFO:tasks.workunit.client.0.smithi049.stdout:7/410: symlink d1/d53/d18/d59/l90 0 2024-09-19T09:02:53.336 INFO:tasks.workunit.client.0.smithi049.stdout:4/274: link d4/d15/c4d d4/d15/c56 0 2024-09-19T09:02:53.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/211: mkdir d1/d2/d23/d49 0 2024-09-19T09:02:53.342 INFO:tasks.workunit.client.0.smithi049.stdout:2/212: truncate d1/d2b/f35 358685 0 2024-09-19T09:02:53.345 INFO:tasks.workunit.client.0.smithi049.stdout:8/376: rename d1/l2a to d1/d11/d2e/d4e/l73 0 2024-09-19T09:02:53.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/377: fdatasync d1/d27/f41 0 2024-09-19T09:02:53.348 INFO:tasks.workunit.client.0.smithi049.stdout:7/411: mkdir d1/d8/d2d/d36/d91 0 2024-09-19T09:02:53.349 INFO:tasks.workunit.client.0.smithi049.stdout:7/412: chown d1/d53/d18/c49 12907315 1 2024-09-19T09:02:53.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/213: creat d1/d2d/f4a x:0 0 0 2024-09-19T09:02:53.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/394: rename d3/d14/f24 to d3/d14/d34/d74/f87 0 2024-09-19T09:02:53.356 INFO:tasks.workunit.client.0.smithi049.stdout:4/275: mknod d4/c57 0 2024-09-19T09:02:53.357 INFO:tasks.workunit.client.0.smithi049.stdout:7/413: creat d1/d8/d80/f92 x:0 0 0 2024-09-19T09:02:53.357 INFO:tasks.workunit.client.0.smithi049.stdout:9/395: truncate d3/d14/d1a/f7d 584239 0 2024-09-19T09:02:53.358 INFO:tasks.workunit.client.0.smithi049.stdout:7/414: dread - d1/d7/f64 zero size 2024-09-19T09:02:53.359 INFO:tasks.workunit.client.0.smithi049.stdout:2/214: dwrite d1/d2/f34 [0,4194304] 0 2024-09-19T09:02:53.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/422: rename d5/d10/d2f/f59 to d5/d10/d2f/d6d/f83 0 2024-09-19T09:02:53.364 INFO:tasks.workunit.client.0.smithi049.stdout:2/215: write d1/d4/f1f [561524,76236] 0 2024-09-19T09:02:53.365 INFO:tasks.workunit.client.0.smithi049.stdout:2/216: fdatasync d1/d2d/f37 0 2024-09-19T09:02:53.365 INFO:tasks.workunit.client.0.smithi049.stdout:9/396: rmdir d3/d22 39 2024-09-19T09:02:53.366 INFO:tasks.workunit.client.0.smithi049.stdout:2/217: dread - d1/d4/d1e/d21/f22 zero size 2024-09-19T09:02:53.369 INFO:tasks.workunit.client.0.smithi049.stdout:0/423: dread d5/ff [0,4194304] 0 2024-09-19T09:02:53.369 INFO:tasks.workunit.client.0.smithi049.stdout:7/415: creat d1/d8/d2d/f93 x:0 0 0 2024-09-19T09:02:53.374 INFO:tasks.workunit.client.0.smithi049.stdout:8/378: creat d1/d11/f74 x:0 0 0 2024-09-19T09:02:53.377 INFO:tasks.workunit.client.0.smithi049.stdout:0/424: dwrite d5/d10/d13/d15/d36/f41 [0,4194304] 0 2024-09-19T09:02:53.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/218: mknod d1/d2b/d38/d41/c4b 0 2024-09-19T09:02:53.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/219: chown d1/d2b/f1b 191 1 2024-09-19T09:02:53.387 INFO:tasks.workunit.client.0.smithi049.stdout:9/397: dwrite d3/d22/f3e [0,4194304] 0 2024-09-19T09:02:53.389 INFO:tasks.workunit.client.0.smithi049.stdout:4/276: rename d4/c2d to d4/d4c/c58 0 2024-09-19T09:02:53.394 INFO:tasks.workunit.client.0.smithi049.stdout:8/379: readlink d1/d11/l6c 0 2024-09-19T09:02:53.400 INFO:tasks.workunit.client.0.smithi049.stdout:0/425: mknod d5/d10/d3c/c84 0 2024-09-19T09:02:53.402 INFO:tasks.workunit.client.0.smithi049.stdout:8/380: dwrite d1/fb [8388608,4194304] 0 2024-09-19T09:02:53.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/220: rmdir d1/d2/d32 39 2024-09-19T09:02:53.405 INFO:tasks.workunit.client.0.smithi049.stdout:9/398: chown d3/d22/c4a 438346 1 2024-09-19T09:02:53.408 INFO:tasks.workunit.client.0.smithi049.stdout:7/416: truncate d1/d8/d19/f46 1864553 0 2024-09-19T09:02:53.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/381: dread - d1/d11/d3f/f6b zero size 2024-09-19T09:02:53.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/221: dread d1/d2/d32/f29 [0,4194304] 0 2024-09-19T09:02:53.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/399: creat d3/d14/d34/f88 x:0 0 0 2024-09-19T09:02:53.418 INFO:tasks.workunit.client.0.smithi049.stdout:2/222: read - d1/d4/d1e/d21/f22 zero size 2024-09-19T09:02:53.419 INFO:tasks.workunit.client.0.smithi049.stdout:0/426: mkdir d5/d10/d82/d67/d85 0 2024-09-19T09:02:53.419 INFO:tasks.workunit.client.0.smithi049.stdout:0/427: readlink d5/d10/d2f/l7e 0 2024-09-19T09:02:53.420 INFO:tasks.workunit.client.0.smithi049.stdout:7/417: mknod d1/d53/d18/c94 0 2024-09-19T09:02:53.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/400: symlink d3/d14/d1a/l89 0 2024-09-19T09:02:53.423 INFO:tasks.workunit.client.0.smithi049.stdout:2/223: chown d1/d4/fb 4839 1 2024-09-19T09:02:53.425 INFO:tasks.workunit.client.0.smithi049.stdout:8/382: mkdir d1/d75 0 2024-09-19T09:02:53.426 INFO:tasks.workunit.client.0.smithi049.stdout:0/428: truncate d5/fa 270619 0 2024-09-19T09:02:53.428 INFO:tasks.workunit.client.0.smithi049.stdout:7/418: rename d1/d8/d2d/f93 to d1/d8/d2d/d36/d91/f95 0 2024-09-19T09:02:53.429 INFO:tasks.workunit.client.0.smithi049.stdout:0/429: fsync d5/d10/d13/d15/d36/f3a 0 2024-09-19T09:02:53.432 INFO:tasks.workunit.client.0.smithi049.stdout:8/383: creat d1/d11/d3f/d5b/f76 x:0 0 0 2024-09-19T09:02:53.434 INFO:tasks.workunit.client.0.smithi049.stdout:2/224: dwrite d1/d4/d1e/d45/f48 [0,4194304] 0 2024-09-19T09:02:53.434 INFO:tasks.workunit.client.0.smithi049.stdout:7/419: creat d1/d8/d80/f96 x:0 0 0 2024-09-19T09:02:53.436 INFO:tasks.workunit.client.0.smithi049.stdout:2/225: read f0 [804804,76615] 0 2024-09-19T09:02:53.440 INFO:tasks.workunit.client.0.smithi049.stdout:9/401: dread d3/d14/d34/f56 [0,4194304] 0 2024-09-19T09:02:53.444 INFO:tasks.workunit.client.0.smithi049.stdout:0/430: dread d5/d10/d13/d15/d36/f41 [0,4194304] 0 2024-09-19T09:02:53.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/431: chown d5/d10/d2f/d52 48112 1 2024-09-19T09:02:53.445 INFO:tasks.workunit.client.0.smithi049.stdout:2/226: mknod d1/d2b/d38/d41/c4c 0 2024-09-19T09:02:53.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/432: write d5/d10/d13/d15/d29/f4b [928358,18484] 0 2024-09-19T09:02:53.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/402: fsync d3/d14/d34/d74/f87 0 2024-09-19T09:02:53.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/227: dread d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:53.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/403: dread d3/d14/f42 [0,4194304] 0 2024-09-19T09:02:53.455 INFO:tasks.workunit.client.0.smithi049.stdout:8/384: creat d1/f77 x:0 0 0 2024-09-19T09:02:53.455 INFO:tasks.workunit.client.0.smithi049.stdout:9/404: chown d3/d14/d34/f56 32886127 1 2024-09-19T09:02:53.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/385: fdatasync d1/d11/f3a 0 2024-09-19T09:02:53.458 INFO:tasks.workunit.client.0.smithi049.stdout:9/405: chown d3/d14/d1a/d21/f26 14196 1 2024-09-19T09:02:53.460 INFO:tasks.workunit.client.0.smithi049.stdout:4/277: dwrite d4/d35/f3c [0,4194304] 0 2024-09-19T09:02:53.463 INFO:tasks.workunit.client.0.smithi049.stdout:2/228: dread - d1/d4/f2a zero size 2024-09-19T09:02:53.465 INFO:tasks.workunit.client.0.smithi049.stdout:2/229: fdatasync d1/d2/f34 0 2024-09-19T09:02:53.467 INFO:tasks.workunit.client.0.smithi049.stdout:7/420: fsync d1/d8/d2d/d36/d91/f95 0 2024-09-19T09:02:53.473 INFO:tasks.workunit.client.0.smithi049.stdout:0/433: mkdir d5/d86 0 2024-09-19T09:02:53.474 INFO:tasks.workunit.client.0.smithi049.stdout:0/434: dread d5/d10/d2f/f77 [0,4194304] 0 2024-09-19T09:02:53.475 INFO:tasks.workunit.client.0.smithi049.stdout:9/406: mknod d3/d22/d6f/d82/c8a 0 2024-09-19T09:02:53.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/407: fdatasync d3/d14/d34/f37 0 2024-09-19T09:02:53.481 INFO:tasks.workunit.client.0.smithi049.stdout:2/230: mknod d1/d2b/d38/d41/c4d 0 2024-09-19T09:02:53.482 INFO:tasks.workunit.client.0.smithi049.stdout:2/231: dread - d1/d4/f39 zero size 2024-09-19T09:02:53.482 INFO:tasks.workunit.client.0.smithi049.stdout:2/232: chown d1/d2b/f1a 1 1 2024-09-19T09:02:53.483 INFO:tasks.workunit.client.0.smithi049.stdout:2/233: truncate d1/d4/f1f 989373 0 2024-09-19T09:02:53.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/421: readlink d1/d53/l42 0 2024-09-19T09:02:53.487 INFO:tasks.workunit.client.0.smithi049.stdout:7/422: truncate d1/d53/d18/d50/d58/d62/f66 661308 0 2024-09-19T09:02:53.491 INFO:tasks.workunit.client.0.smithi049.stdout:0/435: rename d5/d10/d13/d15/d36/d3d/f2d to d5/d10/d2f/d52/f87 0 2024-09-19T09:02:53.493 INFO:tasks.workunit.client.0.smithi049.stdout:8/386: creat d1/f78 x:0 0 0 2024-09-19T09:02:53.494 INFO:tasks.workunit.client.0.smithi049.stdout:2/234: mknod d1/d4/d1e/d45/c4e 0 2024-09-19T09:02:53.495 INFO:tasks.workunit.client.0.smithi049.stdout:2/235: read - d1/d2b/f1b zero size 2024-09-19T09:02:53.496 INFO:tasks.workunit.client.0.smithi049.stdout:2/236: readlink d1/d4/d20/l31 0 2024-09-19T09:02:53.498 INFO:tasks.workunit.client.0.smithi049.stdout:4/278: creat d4/d15/f59 x:0 0 0 2024-09-19T09:02:53.498 INFO:tasks.workunit.client.0.smithi049.stdout:8/387: dread d1/d11/d2e/d3c/f6a [0,4194304] 0 2024-09-19T09:02:53.500 INFO:tasks.workunit.client.0.smithi049.stdout:7/423: write d1/d8/f6c [1002125,115270] 0 2024-09-19T09:02:53.502 INFO:tasks.workunit.client.0.smithi049.stdout:7/424: fdatasync d1/d7/f70 0 2024-09-19T09:02:53.504 INFO:tasks.workunit.client.0.smithi049.stdout:7/425: fdatasync d1/d8/d80/f86 0 2024-09-19T09:02:53.512 INFO:tasks.workunit.client.0.smithi049.stdout:2/237: mknod d1/d4/d20/d26/c4f 0 2024-09-19T09:02:53.514 INFO:tasks.workunit.client.0.smithi049.stdout:4/279: creat d4/d15/d19/d1f/f5a x:0 0 0 2024-09-19T09:02:53.516 INFO:tasks.workunit.client.0.smithi049.stdout:4/280: write d4/f25 [4448005,53886] 0 2024-09-19T09:02:53.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/388: dread d1/d27/f36 [0,4194304] 0 2024-09-19T09:02:53.517 INFO:tasks.workunit.client.0.smithi049.stdout:4/281: dread - d4/d45/f48 zero size 2024-09-19T09:02:53.521 INFO:tasks.workunit.client.0.smithi049.stdout:7/426: creat d1/d53/d18/d50/d7c/f97 x:0 0 0 2024-09-19T09:02:53.522 INFO:tasks.workunit.client.0.smithi049.stdout:9/408: truncate d3/d14/f1e 6153081 0 2024-09-19T09:02:53.524 INFO:tasks.workunit.client.0.smithi049.stdout:4/282: dwrite d4/f25 [0,4194304] 0 2024-09-19T09:02:53.526 INFO:tasks.workunit.client.0.smithi049.stdout:9/409: fsync d3/d14/d1a/f80 0 2024-09-19T09:02:53.531 INFO:tasks.workunit.client.0.smithi049.stdout:0/436: truncate d5/d10/d2f/d6d/f83 190970 0 2024-09-19T09:02:53.533 INFO:tasks.workunit.client.0.smithi049.stdout:0/437: chown d5/d10/d13/d69/l7b 244625044 1 2024-09-19T09:02:53.535 INFO:tasks.workunit.client.0.smithi049.stdout:0/438: stat d5/d10/d13/d15/d36/f3a 0 2024-09-19T09:02:53.537 INFO:tasks.workunit.client.0.smithi049.stdout:0/439: write d5/d10/d13/d15/f68 [1838905,9326] 0 2024-09-19T09:02:53.540 INFO:tasks.workunit.client.0.smithi049.stdout:4/283: creat d4/d45/d4a/f5b x:0 0 0 2024-09-19T09:02:53.540 INFO:tasks.workunit.client.0.smithi049.stdout:0/440: chown d5/d10/d3c/c55 115952 1 2024-09-19T09:02:53.541 INFO:tasks.workunit.client.0.smithi049.stdout:9/410: mknod d3/d14/d34/d4c/c8b 0 2024-09-19T09:02:53.543 INFO:tasks.workunit.client.0.smithi049.stdout:5/192: sync 2024-09-19T09:02:53.544 INFO:tasks.workunit.client.0.smithi049.stdout:6/204: sync 2024-09-19T09:02:53.546 INFO:tasks.workunit.client.0.smithi049.stdout:9/411: chown d3/d14/d34/d4c/c8b 41 1 2024-09-19T09:02:53.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/389: dread d1/f3d [0,4194304] 0 2024-09-19T09:02:53.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/441: mknod d5/d10/d82/c88 0 2024-09-19T09:02:53.550 INFO:tasks.workunit.client.0.smithi049.stdout:2/238: dwrite d1/d4/f2a [0,4194304] 0 2024-09-19T09:02:53.551 INFO:tasks.workunit.client.0.smithi049.stdout:6/205: write dc/d1b/f39 [636141,66229] 0 2024-09-19T09:02:53.553 INFO:tasks.workunit.client.0.smithi049.stdout:6/206: chown dc/d16/c28 51 1 2024-09-19T09:02:53.556 INFO:tasks.workunit.client.0.smithi049.stdout:6/207: write dc/d1b/f23 [960497,9735] 0 2024-09-19T09:02:53.558 INFO:tasks.workunit.client.0.smithi049.stdout:7/427: truncate d1/d53/d18/d59/f48 330911 0 2024-09-19T09:02:53.561 INFO:tasks.workunit.client.0.smithi049.stdout:5/193: truncate d3/d5/de/f1a 906989 0 2024-09-19T09:02:53.564 INFO:tasks.workunit.client.0.smithi049.stdout:4/284: getdents d4/d45/d3f 0 2024-09-19T09:02:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.566+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc99c102ba0 con 0x7fc98406d890 2024-09-19T09:02:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.568+0000 7fc998ff9640 1 -- 172.21.15.49:0/2286836874 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc99c102ba0 con 0x7fc98406d890 2024-09-19T09:02:53.567 INFO:tasks.workunit.client.0.smithi049.stdout:5/194: dread d3/d5/de/f25 [0,4194304] 0 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "", 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:02:53.568 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:02:53.569 INFO:tasks.workunit.client.0.smithi049.stdout:8/390: rmdir d1/d75 0 2024-09-19T09:02:53.569 INFO:tasks.workunit.client.0.smithi049.stdout:8/391: chown d1/l10 55682855 1 2024-09-19T09:02:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fc98406d890 msgr2=0x7fc98406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fc98406d890 0x7fc98406fd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc99c19d210 tx=0x7fc98c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 msgr2=0x7fc99c19c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c19c270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b420 tx=0x7fc99000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 shutdown_connections 2024-09-19T09:02:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fc98406d890 0x7fc98406fd50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc99c0744e0 0x7fc99c19c270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 --2- 172.21.15.49:0/2286836874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc99c072f10 0x7fc99c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.571+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 >> 172.21.15.49:0/2286836874 conn(0x7fc99c0fb360 msgr2=0x7fc99c101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.572+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 shutdown_connections 2024-09-19T09:02:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.572+0000 7fc9a1d55640 1 -- 172.21.15.49:0/2286836874 wait complete. 2024-09-19T09:02:53.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/285: dread d4/f24 [0,4194304] 0 2024-09-19T09:02:53.579 INFO:tasks.workunit.client.0.smithi049.stdout:5/195: mknod d3/d5/d1c/d2d/c3e 0 2024-09-19T09:02:53.581 INFO:tasks.workunit.client.0.smithi049.stdout:8/392: fdatasync d1/d1a/f29 0 2024-09-19T09:02:53.583 INFO:tasks.workunit.client.0.smithi049.stdout:7/428: dread d1/d53/d18/d59/f48 [0,4194304] 0 2024-09-19T09:02:53.584 INFO:tasks.workunit.client.0.smithi049.stdout:7/429: dread - d1/d8/f84 zero size 2024-09-19T09:02:53.584 INFO:tasks.workunit.client.0.smithi049.stdout:2/239: link d1/d4/d1e/d21/c36 d1/d2/d23/d49/c50 0 2024-09-19T09:02:53.591 INFO:tasks.workunit.client.0.smithi049.stdout:6/208: rename dc/d16/c1d to dc/c42 0 2024-09-19T09:02:53.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/240: creat d1/d4/f51 x:0 0 0 2024-09-19T09:02:53.600 INFO:tasks.workunit.client.0.smithi049.stdout:8/393: write d1/d1a/f5e [3784085,22793] 0 2024-09-19T09:02:53.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/241: chown d1/d4/d20/d26/c4f 266826 1 2024-09-19T09:02:53.603 INFO:tasks.workunit.client.0.smithi049.stdout:2/242: dread - d1/d2/d23/f2c zero size 2024-09-19T09:02:53.604 INFO:tasks.workunit.client.0.smithi049.stdout:0/442: getdents d5/d10/d13/d15/d29 0 2024-09-19T09:02:53.606 INFO:tasks.workunit.client.0.smithi049.stdout:4/286: dread d4/f17 [0,4194304] 0 2024-09-19T09:02:53.607 INFO:tasks.workunit.client.0.smithi049.stdout:4/287: stat f2 0 2024-09-19T09:02:53.608 INFO:tasks.workunit.client.0.smithi049.stdout:5/196: rename d3/d5/l24 to d3/d5/de/d12/l3f 0 2024-09-19T09:02:53.608 INFO:tasks.workunit.client.0.smithi049.stdout:2/243: dread d1/d2/d32/f29 [0,4194304] 0 2024-09-19T09:02:53.609 INFO:tasks.workunit.client.0.smithi049.stdout:4/288: chown d4/d15/d19/d1f/f5a 5265 1 2024-09-19T09:02:53.612 INFO:tasks.workunit.client.0.smithi049.stdout:6/209: creat dc/d12/f43 x:0 0 0 2024-09-19T09:02:53.615 INFO:tasks.workunit.client.0.smithi049.stdout:7/430: creat d1/d53/f98 x:0 0 0 2024-09-19T09:02:53.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/394: dwrite d1/d27/f60 [0,4194304] 0 2024-09-19T09:02:53.618 INFO:tasks.workunit.client.0.smithi049.stdout:2/244: creat d1/d4/d1e/d21/f52 x:0 0 0 2024-09-19T09:02:53.628 INFO:tasks.workunit.client.0.smithi049.stdout:6/210: chown dc/d16/l36 9118 1 2024-09-19T09:02:53.628 INFO:tasks.workunit.client.0.smithi049.stdout:7/431: mkdir d1/d53/d18/d50/d7c/d99 0 2024-09-19T09:02:53.628 INFO:tasks.workunit.client.0.smithi049.stdout:0/443: dwrite d5/d10/d13/d15/d36/f6e [0,4194304] 0 2024-09-19T09:02:53.631 INFO:tasks.workunit.client.0.smithi049.stdout:6/211: truncate dc/d16/f3b 9870 0 2024-09-19T09:02:53.631 INFO:tasks.workunit.client.0.smithi049.stdout:7/432: write d1/f68 [1112634,32582] 0 2024-09-19T09:02:53.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/212: fsync dc/d1b/f23 0 2024-09-19T09:02:53.634 INFO:tasks.workunit.client.0.smithi049.stdout:6/213: truncate dc/d1b/f39 1042049 0 2024-09-19T09:02:53.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/197: creat d3/d5/f40 x:0 0 0 2024-09-19T09:02:53.636 INFO:tasks.workunit.client.0.smithi049.stdout:4/289: rename d4/f16 to d4/d15/f5c 0 2024-09-19T09:02:53.637 INFO:tasks.workunit.client.0.smithi049.stdout:2/245: rmdir d1/d4 39 2024-09-19T09:02:53.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/290: read - d4/d45/d4a/f5b zero size 2024-09-19T09:02:53.644 INFO:tasks.workunit.client.0.smithi049.stdout:7/433: symlink d1/d53/d18/d50/d58/d62/d6b/l9a 0 2024-09-19T09:02:53.646 INFO:tasks.workunit.client.0.smithi049.stdout:6/214: unlink dc/d12/f1e 0 2024-09-19T09:02:53.647 INFO:tasks.workunit.client.0.smithi049.stdout:4/291: dread d4/f21 [0,4194304] 0 2024-09-19T09:02:53.647 INFO:tasks.workunit.client.0.smithi049.stdout:7/434: chown d1/d8/ld 87227291 1 2024-09-19T09:02:53.649 INFO:tasks.workunit.client.0.smithi049.stdout:2/246: dwrite d1/f11 [0,4194304] 0 2024-09-19T09:02:53.654 INFO:tasks.workunit.client.0.smithi049.stdout:0/444: write d5/d10/d13/d15/f1e [1508869,101170] 0 2024-09-19T09:02:53.656 INFO:tasks.workunit.client.0.smithi049.stdout:8/395: rename d1/d11/f12 to d1/d27/f79 0 2024-09-19T09:02:53.658 INFO:tasks.workunit.client.0.smithi049.stdout:8/396: write d1/d11/d2e/f57 [870697,19716] 0 2024-09-19T09:02:53.661 INFO:tasks.workunit.client.0.smithi049.stdout:3/366: sync 2024-09-19T09:02:53.662 INFO:tasks.workunit.client.0.smithi049.stdout:1/234: sync 2024-09-19T09:02:53.663 INFO:tasks.workunit.client.0.smithi049.stdout:5/198: unlink d3/d5/d20/l36 0 2024-09-19T09:02:53.666 INFO:tasks.workunit.client.0.smithi049.stdout:4/292: creat d4/d15/d19/d1f/f5d x:0 0 0 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/993528208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 msgr2=0x7fdc98102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/993528208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98102b30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009880 tx=0x7fdc8002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/993528208 shutdown_connections 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/993528208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc98103070 0x7fdc98105460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/993528208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98102b30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/993528208 >> 172.21.15.49:0/993528208 conn(0x7fdc980fa280 msgr2=0x7fdc980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/993528208 shutdown_connections 2024-09-19T09:02:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.694+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/993528208 wait complete. 2024-09-19T09:02:53.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc9d3fa640 1 Processor -- start 2024-09-19T09:02:53.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc9d3fa640 1 -- start start 2024-09-19T09:02:53.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc9d3fa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc9d3fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc98103070 0x7fdc98195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc9d3fa640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc98196240 con 0x7fdc98100740 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc9d3fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc981963b0 con 0x7fdc98103070 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc96ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc96ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38208/0 (socket says 172.21.15.49:38208) 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc96ffd640 1 -- 172.21.15.49:0/4064810316 learned_addr learned my addr 172.21.15.49:0/4064810316 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.695+0000 7fdc967fc640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc98103070 0x7fdc98195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc96ffd640 1 -- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc98103070 msgr2=0x7fdc98195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc96ffd640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc98103070 0x7fdc98195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc96ffd640 1 -- 172.21.15.49:0/4064810316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80009560 con 0x7fdc98100740 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc96ffd640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98195730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc800099a0 tx=0x7fdc80032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc8ffff640 1 -- 172.21.15.49:0/4064810316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc80005430 con 0x7fdc98100740 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9819adf0 con 0x7fdc98100740 2024-09-19T09:02:53.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9819b2d0 con 0x7fdc98100740 2024-09-19T09:02:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc8ffff640 1 -- 172.21.15.49:0/4064810316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc80032e60 con 0x7fdc98100740 2024-09-19T09:02:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.696+0000 7fdc8ffff640 1 -- 172.21.15.49:0/4064810316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc80003b90 con 0x7fdc98100740 2024-09-19T09:02:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.697+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc98108880 con 0x7fdc98100740 2024-09-19T09:02:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.698+0000 7fdc8ffff640 1 -- 172.21.15.49:0/4064810316 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 91735+0+0 (secure 0 0 0) 0x7fdc800046c0 con 0x7fdc98100740 2024-09-19T09:02:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.698+0000 7fdc8ffff640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fdc8406d890 0x7fdc8406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.698+0000 7fdc8ffff640 1 -- 172.21.15.49:0/4064810316 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdc800ae1a0 con 0x7fdc98100740 2024-09-19T09:02:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.698+0000 7fdc967fc640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fdc8406d890 0x7fdc8406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.699+0000 7fdc967fc640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fdc8406d890 0x7fdc8406fd50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc98196c50 tx=0x7fdc88009110 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:53.707+0000 7fdc8ffff640 1 -- 172.21.15.49:0/4064810316 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fdc80077720 con 0x7fdc98100740 2024-09-19T09:02:53.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/445: read d5/d10/d13/d15/d36/f6a [128140,81445] 0 2024-09-19T09:02:53.746 INFO:tasks.workunit.client.0.smithi049.stdout:0/446: write d5/d10/d2f/f74 [820141,4521] 0 2024-09-19T09:02:53.748 INFO:tasks.workunit.client.0.smithi049.stdout:0/447: dread - d5/d10/d13/d15/d36/f51 zero size 2024-09-19T09:02:53.748 INFO:tasks.workunit.client.0.smithi049.stdout:6/215: dread dc/f19 [4194304,4194304] 0 2024-09-19T09:02:53.752 INFO:tasks.workunit.client.0.smithi049.stdout:8/397: mkdir d1/d11/d2e/d3c/d7a 0 2024-09-19T09:02:53.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/448: dread - d5/d10/d13/d15/d36/f51 zero size 2024-09-19T09:02:53.754 INFO:tasks.workunit.client.0.smithi049.stdout:8/398: chown d1/d11/f1b 4100 1 2024-09-19T09:02:53.755 INFO:tasks.workunit.client.0.smithi049.stdout:2/247: dwrite d1/f15 [0,4194304] 0 2024-09-19T09:02:53.757 INFO:tasks.workunit.client.0.smithi049.stdout:4/293: write d4/d15/d19/f2f [5488949,75889] 0 2024-09-19T09:02:53.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/435: truncate d1/d53/d18/d50/d58/d62/d6b/f76 476022 0 2024-09-19T09:02:53.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/367: mknod d10/d3d/d79/c7b 0 2024-09-19T09:02:53.781 INFO:tasks.workunit.client.0.smithi049.stdout:2/248: mknod d1/d2/d23/c53 0 2024-09-19T09:02:53.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/399: truncate d1/d11/d2e/d3c/f6a 1679071 0 2024-09-19T09:02:53.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/235: creat d5/d6/d19/f4e x:0 0 0 2024-09-19T09:02:53.791 INFO:tasks.workunit.client.0.smithi049.stdout:1/236: chown f3 31918205 1 2024-09-19T09:02:53.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/400: dwrite d1/d11/f74 [0,4194304] 0 2024-09-19T09:02:53.800 INFO:tasks.workunit.client.0.smithi049.stdout:0/449: creat d5/d10/d7d/f89 x:0 0 0 2024-09-19T09:02:53.800 INFO:tasks.workunit.client.0.smithi049.stdout:5/199: creat d3/f41 x:0 0 0 2024-09-19T09:02:53.807 INFO:tasks.workunit.client.0.smithi049.stdout:8/401: rename d1/d11/d2e/d3c/l4a to d1/d11/d45/l7b 0 2024-09-19T09:02:53.807 INFO:tasks.workunit.client.0.smithi049.stdout:8/402: chown d1/l54 38356 1 2024-09-19T09:02:53.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/403: fsync d1/d1a/f3b 0 2024-09-19T09:02:53.816 INFO:tasks.workunit.client.0.smithi049.stdout:3/368: dread f5 [0,4194304] 0 2024-09-19T09:02:53.817 INFO:tasks.workunit.client.0.smithi049.stdout:7/436: creat d1/d53/d18/f9b x:0 0 0 2024-09-19T09:02:53.819 INFO:tasks.workunit.client.0.smithi049.stdout:3/369: write d10/d11/f1a [3537513,97853] 0 2024-09-19T09:02:53.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/437: read - d1/d53/d18/d50/d58/d62/d6b/f8c zero size 2024-09-19T09:02:53.822 INFO:tasks.workunit.client.0.smithi049.stdout:7/438: truncate d1/d1a/f21 1504361 0 2024-09-19T09:02:53.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/294: truncate d4/d15/d19/f2f 7390984 0 2024-09-19T09:02:53.823 INFO:tasks.workunit.client.0.smithi049.stdout:7/439: readlink d1/d53/d18/d50/d58/d62/d6b/l6f 0 2024-09-19T09:02:53.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/450: write d5/d10/d13/d15/d36/f6a [1020743,11886] 0 2024-09-19T09:02:53.829 INFO:tasks.workunit.client.0.smithi049.stdout:2/249: creat d1/d2/f54 x:0 0 0 2024-09-19T09:02:53.832 INFO:tasks.workunit.client.0.smithi049.stdout:8/404: symlink d1/d27/l7c 0 2024-09-19T09:02:53.833 INFO:tasks.workunit.client.0.smithi049.stdout:5/200: dwrite d3/d5/de/f1a [0,4194304] 0 2024-09-19T09:02:53.834 INFO:tasks.workunit.client.0.smithi049.stdout:5/201: readlink d3/d5/l2c 0 2024-09-19T09:02:53.834 INFO:tasks.workunit.client.0.smithi049.stdout:6/216: link dc/d1b/c37 dc/d12/c44 0 2024-09-19T09:02:53.840 INFO:tasks.workunit.client.0.smithi049.stdout:7/440: mkdir d1/d53/d18/d50/d7c/d9c 0 2024-09-19T09:02:53.843 INFO:tasks.workunit.client.0.smithi049.stdout:4/295: truncate d4/d15/f28 1192441 0 2024-09-19T09:02:53.844 INFO:tasks.workunit.client.0.smithi049.stdout:4/296: write d4/f40 [4136415,35207] 0 2024-09-19T09:02:53.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/405: write d1/d11/d3f/d5b/f67 [2060851,51998] 0 2024-09-19T09:02:53.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/202: readlink d3/d5/l35 0 2024-09-19T09:02:53.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/451: write d5/d10/d13/d15/d29/f3e [125394,91703] 0 2024-09-19T09:02:53.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/441: creat d1/d53/d18/d50/d7c/f9d x:0 0 0 2024-09-19T09:02:53.864 INFO:tasks.workunit.client.0.smithi049.stdout:8/406: dwrite d1/f77 [0,4194304] 0 2024-09-19T09:02:53.864 INFO:tasks.workunit.client.0.smithi049.stdout:2/250: mknod d1/d4/d1e/c55 0 2024-09-19T09:02:53.865 INFO:tasks.workunit.client.0.smithi049.stdout:0/452: write d5/d10/d2f/d52/f6f [203908,128475] 0 2024-09-19T09:02:53.871 INFO:tasks.workunit.client.0.smithi049.stdout:5/203: dwrite d3/d5/d1c/d2d/f2f [0,4194304] 0 2024-09-19T09:02:53.872 INFO:tasks.workunit.client.0.smithi049.stdout:7/442: dread d1/d53/d18/d50/d58/d62/f66 [0,4194304] 0 2024-09-19T09:02:53.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/217: mknod dc/c45 0 2024-09-19T09:02:53.882 INFO:tasks.workunit.client.0.smithi049.stdout:2/251: creat d1/d2/d23/f56 x:0 0 0 2024-09-19T09:02:53.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/252: readlink d1/d2/l1d 0 2024-09-19T09:02:53.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/370: getdents d10 0 2024-09-19T09:02:53.892 INFO:tasks.workunit.client.0.smithi049.stdout:5/204: creat d3/dc/f42 x:0 0 0 2024-09-19T09:02:53.895 INFO:tasks.workunit.client.0.smithi049.stdout:4/297: truncate d4/d15/f5c 390388 0 2024-09-19T09:02:53.895 INFO:tasks.workunit.client.0.smithi049.stdout:0/453: dwrite d5/d10/d13/d15/d29/f57 [0,4194304] 0 2024-09-19T09:02:53.898 INFO:tasks.workunit.client.0.smithi049.stdout:6/218: mknod dc/d1b/d20/d2f/c46 0 2024-09-19T09:02:53.900 INFO:tasks.workunit.client.0.smithi049.stdout:6/219: rename dc/d1b to dc/d1b/d20/d2f/d47 22 2024-09-19T09:02:53.903 INFO:tasks.workunit.client.0.smithi049.stdout:8/407: mknod d1/d11/c7d 0 2024-09-19T09:02:53.905 INFO:tasks.workunit.client.0.smithi049.stdout:6/220: stat dc/d1b/d20/d2f/f3f 0 2024-09-19T09:02:53.908 INFO:tasks.workunit.client.0.smithi049.stdout:7/443: dread d1/d7/f14 [0,4194304] 0 2024-09-19T09:02:53.910 INFO:tasks.workunit.client.0.smithi049.stdout:2/253: creat d1/d2d/f57 x:0 0 0 2024-09-19T09:02:53.910 INFO:tasks.workunit.client.0.smithi049.stdout:5/205: dwrite d3/d5/d1c/d2d/f2f [0,4194304] 0 2024-09-19T09:02:53.913 INFO:tasks.workunit.client.0.smithi049.stdout:2/254: chown d1/d2b/f1b 0 1 2024-09-19T09:02:53.913 INFO:tasks.workunit.client.0.smithi049.stdout:2/255: stat d1 0 2024-09-19T09:02:53.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/256: write d1/d2b/f1b [61256,88297] 0 2024-09-19T09:02:53.917 INFO:tasks.workunit.client.0.smithi049.stdout:7/444: write d1/d53/d18/d50/d7c/f97 [1025985,4081] 0 2024-09-19T09:02:53.919 INFO:tasks.workunit.client.0.smithi049.stdout:7/445: chown d1/d8/d80/f96 112280 1 2024-09-19T09:02:53.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/408: dread d1/d11/d3f/d5b/f67 [0,4194304] 0 2024-09-19T09:02:53.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/454: creat d5/d10/d2f/d6d/f8a x:0 0 0 2024-09-19T09:02:53.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/371: dread d10/f48 [0,4194304] 0 2024-09-19T09:02:53.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/455: stat d5/d10/d13/d30/d75 0 2024-09-19T09:02:53.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/372: chown d10/d11/d13/l63 91570855 1 2024-09-19T09:02:53.931 INFO:tasks.workunit.client.0.smithi049.stdout:5/206: mkdir d3/dc/d43 0 2024-09-19T09:02:53.933 INFO:tasks.workunit.client.0.smithi049.stdout:4/298: symlink d4/d15/d19/d1f/d55/l5e 0 2024-09-19T09:02:53.934 INFO:tasks.workunit.client.0.smithi049.stdout:4/299: stat d4/d34/d3d 0 2024-09-19T09:02:53.937 INFO:tasks.workunit.client.0.smithi049.stdout:7/446: mknod d1/d7/c9e 0 2024-09-19T09:02:53.942 INFO:tasks.workunit.client.0.smithi049.stdout:3/373: truncate d10/d11/d13/f18 5950775 0 2024-09-19T09:02:53.948 INFO:tasks.workunit.client.0.smithi049.stdout:7/447: creat d1/d1a/f9f x:0 0 0 2024-09-19T09:02:53.949 INFO:tasks.workunit.client.0.smithi049.stdout:0/456: creat d5/d10/d13/d15/d36/d3d/d7f/f8b x:0 0 0 2024-09-19T09:02:53.953 INFO:tasks.workunit.client.0.smithi049.stdout:3/374: mknod d10/d11/d13/d30/c7c 0 2024-09-19T09:02:53.955 INFO:tasks.workunit.client.0.smithi049.stdout:3/375: write d10/d11/d27/f45 [864332,78597] 0 2024-09-19T09:02:53.958 INFO:tasks.workunit.client.0.smithi049.stdout:4/300: mkdir d4/d45/d3f/d47/d5f 0 2024-09-19T09:02:53.960 INFO:tasks.workunit.client.0.smithi049.stdout:2/257: truncate d1/d4/f2a 18184 0 2024-09-19T09:02:53.964 INFO:tasks.workunit.client.0.smithi049.stdout:5/207: dwrite d3/d5/f1f [0,4194304] 0 2024-09-19T09:02:53.964 INFO:tasks.workunit.client.0.smithi049.stdout:0/457: mkdir d5/d10/d82/d67/d8c 0 2024-09-19T09:02:53.964 INFO:tasks.workunit.client.0.smithi049.stdout:2/258: write d1/d2b/f1b [1007229,51079] 0 2024-09-19T09:02:53.967 INFO:tasks.workunit.client.0.smithi049.stdout:6/221: truncate dc/ff 3003356 0 2024-09-19T09:02:53.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/259: write d1/d2b/f35 [682552,52348] 0 2024-09-19T09:02:53.970 INFO:tasks.workunit.client.0.smithi049.stdout:6/222: truncate dc/d1b/d20/f32 701766 0 2024-09-19T09:02:53.972 INFO:tasks.workunit.client.0.smithi049.stdout:3/376: write d10/d11/f39 [4997452,45693] 0 2024-09-19T09:02:53.973 INFO:tasks.workunit.client.0.smithi049.stdout:2/260: chown d1/d2b/c3e 7 1 2024-09-19T09:02:53.973 INFO:tasks.workunit.client.0.smithi049.stdout:6/223: truncate dc/d1b/d20/f32 1581571 0 2024-09-19T09:02:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:7/448: write d1/d53/d18/f8d [371655,16462] 0 2024-09-19T09:02:53.980 INFO:tasks.workunit.client.0.smithi049.stdout:5/208: creat d3/d5/de/f44 x:0 0 0 2024-09-19T09:02:53.982 INFO:tasks.workunit.client.0.smithi049.stdout:4/301: mknod d4/d45/d3f/d47/d5f/c60 0 2024-09-19T09:02:53.984 INFO:tasks.workunit.client.0.smithi049.stdout:2/261: dwrite d1/d4/f17 [4194304,4194304] 0 2024-09-19T09:02:53.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/209: readlink d3/dc/ld 0 2024-09-19T09:02:53.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/224: truncate dc/d12/f27 1195943 0 2024-09-19T09:02:53.989 INFO:tasks.workunit.client.0.smithi049.stdout:7/449: fdatasync d1/d7/f70 0 2024-09-19T09:02:53.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/210: chown d3/d5/de/f44 35808374 1 2024-09-19T09:02:53.990 INFO:tasks.workunit.client.0.smithi049.stdout:0/458: rename d5/d10/d13/d15/f68 to d5/d10/d13/d15/f8d 0 2024-09-19T09:02:53.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/262: chown d1/d2/d32/l44 6 1 2024-09-19T09:02:53.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/225: write dc/d1b/f39 [190523,109319] 0 2024-09-19T09:02:53.993 INFO:tasks.workunit.client.0.smithi049.stdout:6/226: write dc/d16/f3d [921448,36166] 0 2024-09-19T09:02:54.001 INFO:tasks.workunit.client.0.smithi049.stdout:0/459: dwrite d5/d10/d13/d15/d36/d3d/d7f/f8b [0,4194304] 0 2024-09-19T09:02:54.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/450: mkdir d1/d1a/da0 0 2024-09-19T09:02:54.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/227: creat dc/d16/f48 x:0 0 0 2024-09-19T09:02:54.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/451: dread - d1/d8/d2d/d31/f47 zero size 2024-09-19T09:02:54.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/377: dread d10/d11/d13/d30/f74 [0,4194304] 0 2024-09-19T09:02:54.013 INFO:tasks.workunit.client.0.smithi049.stdout:3/378: fsync d10/d11/d13/f1f 0 2024-09-19T09:02:54.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/228: dread dc/d16/f2e [0,4194304] 0 2024-09-19T09:02:54.017 INFO:tasks.workunit.client.0.smithi049.stdout:7/452: rmdir d1/d8/d2d/d36 39 2024-09-19T09:02:54.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/211: dwrite d3/f8 [0,4194304] 0 2024-09-19T09:02:54.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/302: rename d4/d45/d4a/f5b to d4/d15/f61 0 2024-09-19T09:02:54.023 INFO:tasks.workunit.client.0.smithi049.stdout:0/460: mknod d5/d10/d13/d69/d70/c8e 0 2024-09-19T09:02:54.027 INFO:tasks.workunit.client.0.smithi049.stdout:7/453: dwrite d1/d8/f6c [0,4194304] 0 2024-09-19T09:02:54.029 INFO:tasks.workunit.client.0.smithi049.stdout:5/212: mkdir d3/d5/de/d12/d45 0 2024-09-19T09:02:54.033 INFO:tasks.workunit.client.0.smithi049.stdout:3/379: write d10/d11/f3a [7372554,14641] 0 2024-09-19T09:02:54.034 INFO:tasks.workunit.client.0.smithi049.stdout:4/303: mkdir d4/d34/d3d/d62 0 2024-09-19T09:02:54.037 INFO:tasks.workunit.client.0.smithi049.stdout:5/213: rename d3/d5/de/f25 to d3/d5/d20/d38/f46 0 2024-09-19T09:02:54.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/461: symlink d5/l8f 0 2024-09-19T09:02:54.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/454: truncate d1/d8/d19/f34 2593997 0 2024-09-19T09:02:54.044 INFO:tasks.workunit.client.0.smithi049.stdout:3/380: dread d10/f34 [0,4194304] 0 2024-09-19T09:02:54.045 INFO:tasks.workunit.client.0.smithi049.stdout:4/304: dwrite d4/f40 [4194304,4194304] 0 2024-09-19T09:02:54.047 INFO:tasks.workunit.client.0.smithi049.stdout:0/462: rmdir d5 39 2024-09-19T09:02:54.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/214: creat d3/d5/d1c/d3c/f47 x:0 0 0 2024-09-19T09:02:54.059 INFO:tasks.workunit.client.0.smithi049.stdout:4/305: mknod d4/d34/d3d/d62/c63 0 2024-09-19T09:02:54.062 INFO:tasks.workunit.client.0.smithi049.stdout:0/463: chown d5/f58 5415 1 2024-09-19T09:02:54.063 INFO:tasks.workunit.client.0.smithi049.stdout:0/464: read - d5/d10/d13/d15/d36/f48 zero size 2024-09-19T09:02:54.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/306: creat d4/d34/d3d/d62/f64 x:0 0 0 2024-09-19T09:02:54.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/465: dread d5/d10/d13/d15/d36/d3d/f7c [0,4194304] 0 2024-09-19T09:02:54.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/455: rename d1/d8/d2d/f8f to d1/d8/d2d/d36/d91/fa1 0 2024-09-19T09:02:54.068 INFO:tasks.workunit.client.0.smithi049.stdout:5/215: link d3/d5/d1c/d2d/c3e d3/d5/de/d12/c48 0 2024-09-19T09:02:54.069 INFO:tasks.workunit.client.0.smithi049.stdout:7/456: fsync d1/d53/f5d 0 2024-09-19T09:02:54.070 INFO:tasks.workunit.client.0.smithi049.stdout:5/216: write d3/d5/de/f44 [716584,123740] 0 2024-09-19T09:02:54.075 INFO:tasks.workunit.client.0.smithi049.stdout:0/466: dread d5/d10/d13/d30/f49 [0,4194304] 0 2024-09-19T09:02:54.075 INFO:tasks.workunit.client.0.smithi049.stdout:7/457: creat d1/d8/d2d/d31/d6e/fa2 x:0 0 0 2024-09-19T09:02:54.078 INFO:tasks.workunit.client.0.smithi049.stdout:0/467: dread - d5/d10/d2f/d6d/f8a zero size 2024-09-19T09:02:54.080 INFO:tasks.workunit.client.0.smithi049.stdout:4/307: getdents d4 0 2024-09-19T09:02:54.081 INFO:tasks.workunit.client.0.smithi049.stdout:5/217: dwrite d3/f41 [0,4194304] 0 2024-09-19T09:02:54.081 INFO:tasks.workunit.client.0.smithi049.stdout:7/458: fdatasync d1/d7/fa 0 2024-09-19T09:02:54.083 INFO:tasks.workunit.client.0.smithi049.stdout:7/459: readlink d1/d53/d18/d50/d58/d62/d6b/l6f 0 2024-09-19T09:02:54.083 INFO:tasks.workunit.client.0.smithi049.stdout:4/308: chown d4/c1b 1061 1 2024-09-19T09:02:54.083 INFO:tasks.workunit.client.0.smithi049.stdout:0/468: creat d5/d10/d82/d67/f90 x:0 0 0 2024-09-19T09:02:54.085 INFO:tasks.workunit.client.0.smithi049.stdout:7/460: chown d1/d53/d18/d50/d58/d62/f66 1347 1 2024-09-19T09:02:54.093 INFO:tasks.workunit.client.0.smithi049.stdout:0/469: dwrite d5/d10/d13/d15/d36/d3d/f33 [0,4194304] 0 2024-09-19T09:02:54.095 INFO:tasks.workunit.client.0.smithi049.stdout:7/461: mkdir d1/d8/d2d/d36/da3 0 2024-09-19T09:02:54.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/218: mknod d3/c49 0 2024-09-19T09:02:54.098 INFO:tasks.workunit.client.0.smithi049.stdout:7/462: chown d1/d8/d2d/d36/d91/f95 348270925 1 2024-09-19T09:02:54.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/219: write d3/f10 [2852638,124164] 0 2024-09-19T09:02:54.101 INFO:tasks.workunit.client.0.smithi049.stdout:0/470: fsync d5/f71 0 2024-09-19T09:02:54.102 INFO:tasks.workunit.client.0.smithi049.stdout:0/471: chown d5/d10/d13/d15/d36/d3d 26573369 1 2024-09-19T09:02:54.104 INFO:tasks.workunit.client.0.smithi049.stdout:7/463: unlink d1/d1a/c1e 0 2024-09-19T09:02:54.113 INFO:tasks.workunit.client.0.smithi049.stdout:4/309: truncate d4/d15/f20 2325734 0 2024-09-19T09:02:54.113 INFO:tasks.workunit.client.0.smithi049.stdout:5/220: dread d3/d5/f1b [0,4194304] 0 2024-09-19T09:02:54.121 INFO:tasks.workunit.client.0.smithi049.stdout:7/464: write d1/d8/d19/f55 [470892,113102] 0 2024-09-19T09:02:54.123 INFO:tasks.workunit.client.0.smithi049.stdout:7/465: write d1/d53/d18/d59/f35 [3477881,40130] 0 2024-09-19T09:02:54.127 INFO:tasks.workunit.client.0.smithi049.stdout:0/472: truncate d5/fa 1189026 0 2024-09-19T09:02:54.128 INFO:tasks.workunit.client.0.smithi049.stdout:5/221: mkdir d3/d5/de/d4a 0 2024-09-19T09:02:54.128 INFO:tasks.workunit.client.0.smithi049.stdout:5/222: stat d3/f6 0 2024-09-19T09:02:54.129 INFO:tasks.workunit.client.0.smithi049.stdout:5/223: read - d3/dc/f42 zero size 2024-09-19T09:02:54.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/466: creat d1/d8/d2d/d31/fa4 x:0 0 0 2024-09-19T09:02:54.136 INFO:tasks.workunit.client.0.smithi049.stdout:4/310: fsync d4/d15/d19/f2f 0 2024-09-19T09:02:54.140 INFO:tasks.workunit.client.0.smithi049.stdout:7/467: symlink d1/d1a/la5 0 2024-09-19T09:02:54.143 INFO:tasks.workunit.client.0.smithi049.stdout:0/473: dread d5/d10/d13/d15/d36/d3d/f24 [0,4194304] 0 2024-09-19T09:02:54.147 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:53 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2032581756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:02:54.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.146+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdc98108a60 con 0x7fdc98100740 2024-09-19T09:02:54.148 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:02:54.148 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:02:54.148 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:02:54.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.147+0000 7fdc8ffff640 1 -- 172.21.15.49:0/4064810316 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fdc8007ade0 con 0x7fdc98100740 2024-09-19T09:02:54.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fdc8406d890 msgr2=0x7fdc8406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fdc8406d890 0x7fdc8406fd50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc98196c50 tx=0x7fdc88009110 comp rx=0 tx=0).stop 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 msgr2=0x7fdc98195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98195730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc800099a0 tx=0x7fdc80032cf0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 shutdown_connections 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fdc8406d890 0x7fdc8406fd50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc98103070 0x7fdc98195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 --2- 172.21.15.49:0/4064810316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc98100740 0x7fdc98195730 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 >> 172.21.15.49:0/4064810316 conn(0x7fdc980fa280 msgr2=0x7fdc980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 shutdown_connections 2024-09-19T09:02:54.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:02:54.150+0000 7fdc9d3fa640 1 -- 172.21.15.49:0/4064810316 wait complete. 2024-09-19T09:02:54.152 INFO:tasks.workunit.client.0.smithi049.stdout:7/468: creat d1/d53/d18/d59/fa6 x:0 0 0 2024-09-19T09:02:54.155 INFO:tasks.workunit.client.0.smithi049.stdout:0/474: creat d5/d10/d13/d30/f91 x:0 0 0 2024-09-19T09:02:54.157 INFO:tasks.workunit.client.0.smithi049.stdout:5/224: write d3/d5/d20/d38/f46 [605438,103407] 0 2024-09-19T09:02:54.161 INFO:tasks.workunit.client.0.smithi049.stdout:7/469: fsync d1/d53/d18/f3b 0 2024-09-19T09:02:54.161 INFO:tasks.workunit.client.0.smithi049.stdout:0/475: dread d5/d10/d13/d15/d36/d3d/f33 [0,4194304] 0 2024-09-19T09:02:54.164 INFO:tasks.workunit.client.0.smithi049.stdout:4/311: rename d4/d15/f28 to d4/d15/f65 0 2024-09-19T09:02:54.166 INFO:tasks.workunit.client.0.smithi049.stdout:4/312: write d4/d45/d3f/d47/f49 [1656189,111780] 0 2024-09-19T09:02:54.174 INFO:tasks.workunit.client.0.smithi049.stdout:0/476: symlink d5/d10/d13/d30/l92 0 2024-09-19T09:02:54.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/313: dwrite d4/d15/f59 [0,4194304] 0 2024-09-19T09:02:54.178 INFO:tasks.workunit.client.0.smithi049.stdout:7/470: symlink d1/d53/la7 0 2024-09-19T09:02:54.182 INFO:tasks.workunit.client.0.smithi049.stdout:0/477: dwrite d5/d10/d82/d67/f90 [0,4194304] 0 2024-09-19T09:02:54.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/314: unlink d4/c57 0 2024-09-19T09:02:54.186 INFO:tasks.workunit.client.0.smithi049.stdout:7/471: unlink d1/d1a/f57 0 2024-09-19T09:02:54.193 INFO:tasks.workunit.client.0.smithi049.stdout:5/225: getdents d3/d5/de/d12 0 2024-09-19T09:02:54.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/472: dwrite d1/d8/f54 [4194304,4194304] 0 2024-09-19T09:02:54.202 INFO:tasks.workunit.client.0.smithi049.stdout:5/226: dwrite d3/dc/f42 [0,4194304] 0 2024-09-19T09:02:54.203 INFO:tasks.workunit.client.0.smithi049.stdout:5/227: readlink d3/d5/l2c 0 2024-09-19T09:02:54.204 INFO:tasks.workunit.client.0.smithi049.stdout:5/228: readlink d3/d5/l2c 0 2024-09-19T09:02:54.205 INFO:tasks.workunit.client.0.smithi049.stdout:5/229: dread - d3/d5/d20/f33 zero size 2024-09-19T09:02:54.209 INFO:tasks.workunit.client.0.smithi049.stdout:5/230: dread d3/f41 [0,4194304] 0 2024-09-19T09:02:54.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/412: sync 2024-09-19T09:02:54.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/315: fdatasync d4/d15/f59 0 2024-09-19T09:02:54.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/478: link d5/d10/d13/l27 d5/d10/d13/l93 0 2024-09-19T09:02:54.230 INFO:tasks.workunit.client.0.smithi049.stdout:9/413: dread d3/d14/d34/d44/f4b [0,4194304] 0 2024-09-19T09:02:54.240 INFO:tasks.workunit.client.0.smithi049.stdout:9/414: dread d3/d14/d34/d74/f87 [0,4194304] 0 2024-09-19T09:02:54.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:53 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2032581756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:02:54.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/473: rmdir d1/d8/d2d/d36/da3 0 2024-09-19T09:02:54.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/474: chown d1/c4b 16978532 1 2024-09-19T09:02:54.345 INFO:tasks.workunit.client.0.smithi049.stdout:4/316: mkdir d4/d15/d19/d1f/d55/d66 0 2024-09-19T09:02:54.350 INFO:tasks.workunit.client.0.smithi049.stdout:0/479: mkdir d5/d10/d13/d15/d29/d94 0 2024-09-19T09:02:54.354 INFO:tasks.workunit.client.0.smithi049.stdout:5/231: getdents d3/d5/de/d12/d45 0 2024-09-19T09:02:54.354 INFO:tasks.workunit.client.0.smithi049.stdout:5/232: write d3/d5/d1c/d2d/f2f [5434296,102054] 0 2024-09-19T09:02:54.370 INFO:tasks.workunit.client.0.smithi049.stdout:4/317: link d4/d15/f61 d4/d15/d19/d1f/f67 0 2024-09-19T09:02:54.371 INFO:tasks.workunit.client.0.smithi049.stdout:9/415: link d3/d22/l5c d3/d14/d34/d44/d4d/d58/l8c 0 2024-09-19T09:02:54.376 INFO:tasks.workunit.client.0.smithi049.stdout:5/233: symlink d3/d5/de/d4a/l4b 0 2024-09-19T09:02:54.378 INFO:tasks.workunit.client.0.smithi049.stdout:9/416: symlink d3/d14/d34/d74/l8d 0 2024-09-19T09:02:54.389 INFO:tasks.workunit.client.0.smithi049.stdout:9/417: rename d3/d22 to d3/d14/d1a/d21/d31/d8e 0 2024-09-19T09:02:54.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/480: rmdir d5/d10/d13/d15/d29/d94 0 2024-09-19T09:02:54.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/418: rename d3/d14/d1a/d21/f26 to d3/d14/d1a/d21/d66/f8f 0 2024-09-19T09:02:54.398 INFO:tasks.workunit.client.0.smithi049.stdout:9/419: read d3/d14/d1a/d21/d31/f60 [2677913,125510] 0 2024-09-19T09:02:54.407 INFO:tasks.workunit.client.0.smithi049.stdout:9/420: dwrite d3/d14/d1a/d21/f2f [4194304,4194304] 0 2024-09-19T09:02:54.409 INFO:tasks.workunit.client.0.smithi049.stdout:9/421: chown d3/d14/d1a/d21/f41 2654 1 2024-09-19T09:02:54.481 INFO:tasks.workunit.client.0.smithi049.stdout:8/409: sync 2024-09-19T09:02:54.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/237: sync 2024-09-19T09:02:54.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/234: write d3/d5/d1c/f22 [3392609,39061] 0 2024-09-19T09:02:54.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/235: stat d3/d5/l35 0 2024-09-19T09:02:54.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/481: truncate d5/d10/d13/d15/f1b 7156580 0 2024-09-19T09:02:54.490 INFO:tasks.workunit.client.0.smithi049.stdout:0/482: dread - d5/d10/d13/d30/f91 zero size 2024-09-19T09:02:54.493 INFO:tasks.workunit.client.0.smithi049.stdout:4/318: write d4/f14 [2736532,573] 0 2024-09-19T09:02:54.496 INFO:tasks.workunit.client.0.smithi049.stdout:5/236: dwrite d3/d5/f40 [0,4194304] 0 2024-09-19T09:02:54.500 INFO:tasks.workunit.client.0.smithi049.stdout:8/410: rename d1/d27/f58 to d1/d11/d2e/d3c/d5d/d65/f7e 0 2024-09-19T09:02:54.514 INFO:tasks.workunit.client.0.smithi049.stdout:5/237: mkdir d3/d5/d1c/d4c 0 2024-09-19T09:02:54.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/483: dread d5/f58 [0,4194304] 0 2024-09-19T09:02:54.525 INFO:tasks.workunit.client.0.smithi049.stdout:5/238: creat d3/d5/d20/d38/f4d x:0 0 0 2024-09-19T09:02:54.530 INFO:tasks.workunit.client.0.smithi049.stdout:9/422: getdents d3/d14/d34/d44/d4d/d58 0 2024-09-19T09:02:54.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/239: fsync d3/d5/f1b 0 2024-09-19T09:02:54.541 INFO:tasks.workunit.client.0.smithi049.stdout:0/484: creat d5/d86/f95 x:0 0 0 2024-09-19T09:02:54.542 INFO:tasks.workunit.client.0.smithi049.stdout:0/485: chown d5/d10/d13/l60 6702246 1 2024-09-19T09:02:54.544 INFO:tasks.workunit.client.0.smithi049.stdout:9/423: dwrite d3/d14/d34/d44/f4b [0,4194304] 0 2024-09-19T09:02:54.547 INFO:tasks.workunit.client.0.smithi049.stdout:5/240: symlink d3/d5/d1c/d2d/l4e 0 2024-09-19T09:02:54.550 INFO:tasks.workunit.client.0.smithi049.stdout:5/241: write d3/d5/d20/d38/f4d [998214,101486] 0 2024-09-19T09:02:54.552 INFO:tasks.workunit.client.0.smithi049.stdout:5/242: stat d3/d5/de/f1e 0 2024-09-19T09:02:54.554 INFO:tasks.workunit.client.0.smithi049.stdout:0/486: dwrite d5/d10/d13/d30/f91 [0,4194304] 0 2024-09-19T09:02:54.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/487: dread - d5/d10/d13/d15/d36/f48 zero size 2024-09-19T09:02:54.559 INFO:tasks.workunit.client.0.smithi049.stdout:5/243: unlink d3/dc/ld 0 2024-09-19T09:02:54.563 INFO:tasks.workunit.client.0.smithi049.stdout:9/424: dread d3/d14/d1a/d21/d31/f60 [0,4194304] 0 2024-09-19T09:02:54.568 INFO:tasks.workunit.client.0.smithi049.stdout:0/488: dwrite d5/d10/d13/d15/d29/f4b [0,4194304] 0 2024-09-19T09:02:54.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/489: dread d5/ff [0,4194304] 0 2024-09-19T09:02:54.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/490: link d5/d10/d13/d15/l1f d5/d10/d13/d69/d70/l96 0 2024-09-19T09:02:54.585 INFO:tasks.workunit.client.0.smithi049.stdout:0/491: stat d5/d10/d13/d15/c63 0 2024-09-19T09:02:54.588 INFO:tasks.workunit.client.0.smithi049.stdout:0/492: mkdir d5/d64/d97 0 2024-09-19T09:02:54.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/493: chown d5/d10/d13/d15/f1b 1414 1 2024-09-19T09:02:54.594 INFO:tasks.workunit.client.0.smithi049.stdout:0/494: fsync d5/d10/d2f/d6d/f8a 0 2024-09-19T09:02:54.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/495: mknod d5/d10/d13/c98 0 2024-09-19T09:02:54.600 INFO:tasks.workunit.client.0.smithi049.stdout:0/496: symlink d5/d10/d2f/d52/l99 0 2024-09-19T09:02:54.621 INFO:tasks.workunit.client.0.smithi049.stdout:1/238: symlink d5/d6/d8/d13/d24/l4f 0 2024-09-19T09:02:54.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/263: sync 2024-09-19T09:02:54.666 INFO:tasks.workunit.client.0.smithi049.stdout:2/264: link d1/d2/d23/f2c d1/d4/d20/f58 0 2024-09-19T09:02:54.666 INFO:tasks.workunit.client.0.smithi049.stdout:2/265: chown d1/d2/f34 5177354 1 2024-09-19T09:02:54.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/266: read - d1/d4/f51 zero size 2024-09-19T09:02:54.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/267: dread - d1/d4/f51 zero size 2024-09-19T09:02:54.671 INFO:tasks.workunit.client.0.smithi049.stdout:5/244: truncate d3/dc/f42 823915 0 2024-09-19T09:02:54.677 INFO:tasks.workunit.client.0.smithi049.stdout:5/245: dread d3/f10 [4194304,4194304] 0 2024-09-19T09:02:54.689 INFO:tasks.workunit.client.0.smithi049.stdout:5/246: dread d3/f6 [0,4194304] 0 2024-09-19T09:02:54.689 INFO:tasks.workunit.client.0.smithi049.stdout:4/319: rename d4/d15/f5c to d4/d15/d19/f68 0 2024-09-19T09:02:54.690 INFO:tasks.workunit.client.0.smithi049.stdout:5/247: fsync d3/f6 0 2024-09-19T09:02:54.692 INFO:tasks.workunit.client.0.smithi049.stdout:8/411: rename d1/d11/d3f/d5b/f6f to d1/d11/d2e/d3c/f7f 0 2024-09-19T09:02:54.693 INFO:tasks.workunit.client.0.smithi049.stdout:8/412: chown d1/d27/f53 614 1 2024-09-19T09:02:54.695 INFO:tasks.workunit.client.0.smithi049.stdout:4/320: creat d4/f69 x:0 0 0 2024-09-19T09:02:54.699 INFO:tasks.workunit.client.0.smithi049.stdout:4/321: dread - d4/d45/f48 zero size 2024-09-19T09:02:54.701 INFO:tasks.workunit.client.0.smithi049.stdout:4/322: chown d4/f25 152820162 1 2024-09-19T09:02:54.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/413: getdents d1/d11/d45 0 2024-09-19T09:02:54.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/414: stat d1/d11/f1b 0 2024-09-19T09:02:54.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/415: read - d1/d27/f68 zero size 2024-09-19T09:02:54.706 INFO:tasks.workunit.client.0.smithi049.stdout:8/416: creat d1/d11/d2e/d3c/d7a/f80 x:0 0 0 2024-09-19T09:02:54.709 INFO:tasks.workunit.client.0.smithi049.stdout:8/417: unlink d1/d27/f36 0 2024-09-19T09:02:54.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/418: fsync d1/d11/d2e/d3c/f55 0 2024-09-19T09:02:54.712 INFO:tasks.workunit.client.0.smithi049.stdout:9/425: rename d3/d14/d1a/d21/d66/d69/d6c to d3/d14/d1a/d90 0 2024-09-19T09:02:54.715 INFO:tasks.workunit.client.0.smithi049.stdout:9/426: rmdir d3/d14/d1a/d21/d31/d8e/d6f 39 2024-09-19T09:02:54.718 INFO:tasks.workunit.client.0.smithi049.stdout:0/497: rename d5/d10/d2f/d52 to d5/d10/d13/d15/d29/d9a 0 2024-09-19T09:02:54.719 INFO:tasks.workunit.client.0.smithi049.stdout:0/498: chown d5/ff 44273990 1 2024-09-19T09:02:54.722 INFO:tasks.workunit.client.0.smithi049.stdout:1/239: rename d5/d6/l3f to d5/d6/d8/d1a/l50 0 2024-09-19T09:02:54.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/268: rename d1/d2b/d38/d41/c4d to d1/d4/c59 0 2024-09-19T09:02:54.732 INFO:tasks.workunit.client.0.smithi049.stdout:9/427: rename d3/d14/d34/d44/d4d/f5e to d3/d14/d1a/d21/d67/f91 0 2024-09-19T09:02:54.733 INFO:tasks.workunit.client.0.smithi049.stdout:9/428: chown d3/f43 11 1 2024-09-19T09:02:54.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/499: dread d5/d10/d13/f42 [0,4194304] 0 2024-09-19T09:02:54.734 INFO:tasks.workunit.client.0.smithi049.stdout:2/269: unlink d1/d2b/f35 0 2024-09-19T09:02:54.735 INFO:tasks.workunit.client.0.smithi049.stdout:2/270: fsync d1/d2/f24 0 2024-09-19T09:02:54.739 INFO:tasks.workunit.client.0.smithi049.stdout:4/323: dwrite d4/d15/f20 [0,4194304] 0 2024-09-19T09:02:54.745 INFO:tasks.workunit.client.0.smithi049.stdout:5/248: dwrite d3/d5/d20/f33 [0,4194304] 0 2024-09-19T09:02:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/419: dwrite d1/d11/f4d [0,4194304] 0 2024-09-19T09:02:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:1/240: write d5/f36 [902255,33511] 0 2024-09-19T09:02:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/500: chown d5/d10/d13/d15/c34 3616518 1 2024-09-19T09:02:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:0/501: fdatasync d5/d10/d13/d15/d36/f51 0 2024-09-19T09:02:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:0/502: write d5/d10/f5b [1041138,78231] 0 2024-09-19T09:02:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:6/229: sync 2024-09-19T09:02:54.765 INFO:tasks.workunit.client.0.smithi049.stdout:5/249: fsync d3/d5/de/d12/f13 0 2024-09-19T09:02:54.770 INFO:tasks.workunit.client.0.smithi049.stdout:1/241: write d5/d6/d19/d21/f3a [366717,52464] 0 2024-09-19T09:02:54.770 INFO:tasks.workunit.client.0.smithi049.stdout:6/230: symlink dc/d1b/d20/d2f/l49 0 2024-09-19T09:02:54.770 INFO:tasks.workunit.client.0.smithi049.stdout:2/271: dread d1/d2/f24 [0,4194304] 0 2024-09-19T09:02:54.772 INFO:tasks.workunit.client.0.smithi049.stdout:9/429: creat d3/d14/f92 x:0 0 0 2024-09-19T09:02:54.781 INFO:tasks.workunit.client.0.smithi049.stdout:9/430: dwrite d3/d14/d34/d74/f87 [4194304,4194304] 0 2024-09-19T09:02:54.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/503: rename d5/d10/d3c/c55 to d5/d10/d13/c9b 0 2024-09-19T09:02:54.791 INFO:tasks.workunit.client.0.smithi049.stdout:9/431: stat d3/d14/d1a/d21/d73/l85 0 2024-09-19T09:02:54.792 INFO:tasks.workunit.client.0.smithi049.stdout:0/504: dread d5/d10/d2f/f77 [0,4194304] 0 2024-09-19T09:02:54.793 INFO:tasks.workunit.client.0.smithi049.stdout:6/231: dread dc/d12/f29 [0,4194304] 0 2024-09-19T09:02:54.797 INFO:tasks.workunit.client.0.smithi049.stdout:8/420: mkdir d1/d27/d81 0 2024-09-19T09:02:54.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/421: write d1/d27/f60 [790466,87023] 0 2024-09-19T09:02:54.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/422: dread - d1/d27/f4b zero size 2024-09-19T09:02:54.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/272: truncate d1/d2b/f1b 84172 0 2024-09-19T09:02:54.804 INFO:tasks.workunit.client.0.smithi049.stdout:2/273: dread - d1/d2/d23/f56 zero size 2024-09-19T09:02:54.804 INFO:tasks.workunit.client.0.smithi049.stdout:0/505: rename d5/d10/d13/d15/c2b to d5/d10/d13/d69/d70/c9c 0 2024-09-19T09:02:54.805 INFO:tasks.workunit.client.0.smithi049.stdout:0/506: rename d5 to d5/d10/d82/d67/d8c/d9d 22 2024-09-19T09:02:54.806 INFO:tasks.workunit.client.0.smithi049.stdout:1/242: getdents d5/d6/d8/d1a 0 2024-09-19T09:02:54.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/243: dwrite d5/f49 [0,4194304] 0 2024-09-19T09:02:54.814 INFO:tasks.workunit.client.0.smithi049.stdout:9/432: symlink d3/d14/d1a/d21/d31/d8e/l93 0 2024-09-19T09:02:54.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/244: chown d5/f20 15 1 2024-09-19T09:02:54.822 INFO:tasks.workunit.client.0.smithi049.stdout:0/507: write d5/d10/d13/d15/d29/f57 [108718,78584] 0 2024-09-19T09:02:54.824 INFO:tasks.workunit.client.0.smithi049.stdout:1/245: dwrite d5/d6/d19/f42 [0,4194304] 0 2024-09-19T09:02:54.826 INFO:tasks.workunit.client.0.smithi049.stdout:6/232: write dc/d16/f18 [7835553,82019] 0 2024-09-19T09:02:54.827 INFO:tasks.workunit.client.0.smithi049.stdout:8/423: mkdir d1/d11/d2e/d4e/d82 0 2024-09-19T09:02:54.829 INFO:tasks.workunit.client.0.smithi049.stdout:6/233: truncate dc/d16/f3b 999576 0 2024-09-19T09:02:54.836 INFO:tasks.workunit.client.0.smithi049.stdout:9/433: dwrite d3/d14/d1a/d21/d31/d8e/d6f/f76 [0,4194304] 0 2024-09-19T09:02:54.837 INFO:tasks.workunit.client.0.smithi049.stdout:9/434: write d3/d14/f3f [3943526,53721] 0 2024-09-19T09:02:54.838 INFO:tasks.workunit.client.0.smithi049.stdout:0/508: creat d5/d10/d13/d15/d29/d9a/f9e x:0 0 0 2024-09-19T09:02:54.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/246: dread - d5/d6/d8/d13/d24/f2f zero size 2024-09-19T09:02:54.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/509: chown d5/d10/d13/d15/d29/f5e 411207407 1 2024-09-19T09:02:54.847 INFO:tasks.workunit.client.0.smithi049.stdout:1/247: symlink d5/d6/d8/d13/d24/d2b/l51 0 2024-09-19T09:02:54.847 INFO:tasks.workunit.client.0.smithi049.stdout:0/510: write d5/d10/d7d/f89 [266256,127970] 0 2024-09-19T09:02:54.848 INFO:tasks.workunit.client.0.smithi049.stdout:8/424: getdents d1/d11/d45 0 2024-09-19T09:02:54.849 INFO:tasks.workunit.client.0.smithi049.stdout:0/511: dread - d5/d10/d13/d15/d29/f5e zero size 2024-09-19T09:02:54.852 INFO:tasks.workunit.client.0.smithi049.stdout:9/435: rename d3/d14/d34/d44/d4d/d58 to d3/d14/d1a/d21/d67/d94 0 2024-09-19T09:02:54.853 INFO:tasks.workunit.client.0.smithi049.stdout:2/274: getdents d1/d2/d23 0 2024-09-19T09:02:54.855 INFO:tasks.workunit.client.0.smithi049.stdout:8/425: creat d1/d11/d2e/d3c/f83 x:0 0 0 2024-09-19T09:02:54.858 INFO:tasks.workunit.client.0.smithi049.stdout:9/436: dwrite d3/d14/d34/d44/f4b [0,4194304] 0 2024-09-19T09:02:54.862 INFO:tasks.workunit.client.0.smithi049.stdout:1/248: rename d5/d6/d8/d13/d24/d2b to d5/d6/d19/d21/d52 0 2024-09-19T09:02:54.864 INFO:tasks.workunit.client.0.smithi049.stdout:6/234: write f3 [748948,114046] 0 2024-09-19T09:02:54.871 INFO:tasks.workunit.client.0.smithi049.stdout:0/512: truncate d5/d10/f5b 13612 0 2024-09-19T09:02:54.875 INFO:tasks.workunit.client.0.smithi049.stdout:2/275: dwrite d1/d4/fb [0,4194304] 0 2024-09-19T09:02:54.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/249: link d5/d6/d8/d13/f34 d5/f53 0 2024-09-19T09:02:54.881 INFO:tasks.workunit.client.0.smithi049.stdout:0/513: mkdir d5/d10/d13/d30/d9f 0 2024-09-19T09:02:54.882 INFO:tasks.workunit.client.0.smithi049.stdout:9/437: write d3/d14/f1e [382144,119485] 0 2024-09-19T09:02:54.893 INFO:tasks.workunit.client.0.smithi049.stdout:1/250: truncate d5/f26 4120921 0 2024-09-19T09:02:54.893 INFO:tasks.workunit.client.0.smithi049.stdout:6/235: getdents dc/d1b/d20/d2f 0 2024-09-19T09:02:54.895 INFO:tasks.workunit.client.0.smithi049.stdout:2/276: getdents d1/d4/d1e/d45 0 2024-09-19T09:02:54.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/277: dwrite d1/d2/d23/f56 [0,4194304] 0 2024-09-19T09:02:54.904 INFO:tasks.workunit.client.0.smithi049.stdout:2/278: write d1/f15 [1822618,97422] 0 2024-09-19T09:02:54.909 INFO:tasks.workunit.client.0.smithi049.stdout:6/236: dwrite dc/d16/f2e [0,4194304] 0 2024-09-19T09:02:54.910 INFO:tasks.workunit.client.0.smithi049.stdout:2/279: truncate f0 3298660 0 2024-09-19T09:02:54.913 INFO:tasks.workunit.client.0.smithi049.stdout:6/237: creat dc/d16/f4a x:0 0 0 2024-09-19T09:02:54.921 INFO:tasks.workunit.client.0.smithi049.stdout:6/238: dread dc/d1b/f23 [0,4194304] 0 2024-09-19T09:02:54.927 INFO:tasks.workunit.client.0.smithi049.stdout:2/280: truncate d1/d2/f13 432901 0 2024-09-19T09:02:54.936 INFO:tasks.workunit.client.0.smithi049.stdout:2/281: write d1/d4/d1e/f28 [71278,28270] 0 2024-09-19T09:02:54.939 INFO:tasks.workunit.client.0.smithi049.stdout:2/282: rename d1/d2d/f4a to d1/d4/d1e/d45/f5a 0 2024-09-19T09:02:54.943 INFO:tasks.workunit.client.0.smithi049.stdout:2/283: mknod d1/d2/c5b 0 2024-09-19T09:02:54.946 INFO:tasks.workunit.client.0.smithi049.stdout:2/284: dread d1/d2/f24 [0,4194304] 0 2024-09-19T09:02:54.951 INFO:tasks.workunit.client.0.smithi049.stdout:2/285: dwrite d1/d2/f34 [0,4194304] 0 2024-09-19T09:02:54.955 INFO:tasks.workunit.client.0.smithi049.stdout:2/286: link d1/d4/d1e/f2f d1/d4/d1e/d45/f5c 0 2024-09-19T09:02:54.963 INFO:tasks.workunit.client.0.smithi049.stdout:2/287: dwrite d1/d4/f46 [0,4194304] 0 2024-09-19T09:02:54.971 INFO:tasks.workunit.client.0.smithi049.stdout:2/288: dwrite d1/f11 [4194304,4194304] 0 2024-09-19T09:02:54.973 INFO:tasks.workunit.client.0.smithi049.stdout:2/289: write d1/d2/d23/f56 [4056285,125271] 0 2024-09-19T09:02:54.982 INFO:tasks.workunit.client.0.smithi049.stdout:2/290: rename d1/f14 to d1/d2b/d38/f5d 0 2024-09-19T09:02:54.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/291: write d1/d2/f24 [2928552,49664] 0 2024-09-19T09:02:54.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/292: truncate d1/d2/f13 283124 0 2024-09-19T09:02:54.995 INFO:tasks.workunit.client.0.smithi049.stdout:2/293: link d1/d4/d1e/f2f d1/d2d/f5e 0 2024-09-19T09:02:54.997 INFO:tasks.workunit.client.0.smithi049.stdout:2/294: write d1/d4/d1e/d45/f5a [796189,63821] 0 2024-09-19T09:02:54.999 INFO:tasks.workunit.client.0.smithi049.stdout:2/295: symlink d1/d2/d23/l5f 0 2024-09-19T09:02:55.000 INFO:tasks.workunit.client.0.smithi049.stdout:2/296: write d1/d2/f54 [733613,67296] 0 2024-09-19T09:02:55.003 INFO:tasks.workunit.client.0.smithi049.stdout:2/297: symlink d1/d2/l60 0 2024-09-19T09:02:55.003 INFO:tasks.workunit.client.0.smithi049.stdout:2/298: fdatasync d1/d4/f39 0 2024-09-19T09:02:55.027 INFO:tasks.workunit.client.0.smithi049.stdout:2/299: dwrite d1/d2b/d38/f5d [0,4194304] 0 2024-09-19T09:02:55.033 INFO:tasks.workunit.client.0.smithi049.stdout:2/300: dwrite d1/f11 [4194304,4194304] 0 2024-09-19T09:02:55.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/301: dwrite d1/d2/d23/f2c [0,4194304] 0 2024-09-19T09:02:55.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/302: mkdir d1/d2b/d38/d61 0 2024-09-19T09:02:55.060 INFO:tasks.workunit.client.0.smithi049.stdout:2/303: dwrite d1/f11 [8388608,4194304] 0 2024-09-19T09:02:55.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/304: write d1/d2/d23/f56 [3147191,106907] 0 2024-09-19T09:02:55.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/305: chown d1/d2b/d38 865 1 2024-09-19T09:02:55.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/381: sync 2024-09-19T09:02:55.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/306: rename d1/d2/c18 to d1/d4/c62 0 2024-09-19T09:02:55.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/382: rmdir d10/d11/d27 39 2024-09-19T09:02:55.073 INFO:tasks.workunit.client.0.smithi049.stdout:3/383: read d10/d11/d13/f1f [364992,5194] 0 2024-09-19T09:02:55.076 INFO:tasks.workunit.client.0.smithi049.stdout:2/307: getdents d1/d4/d1e/d21 0 2024-09-19T09:02:55.080 INFO:tasks.workunit.client.0.smithi049.stdout:3/384: dwrite d10/d11/f1a [0,4194304] 0 2024-09-19T09:02:55.081 INFO:tasks.workunit.client.0.smithi049.stdout:2/308: truncate d1/d2d/f5e 18047 0 2024-09-19T09:02:55.082 INFO:tasks.workunit.client.0.smithi049.stdout:2/309: fdatasync d1/d4/d1e/d45/f5a 0 2024-09-19T09:02:55.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/310: creat d1/d2b/d38/d61/f63 x:0 0 0 2024-09-19T09:02:55.089 INFO:tasks.workunit.client.0.smithi049.stdout:3/385: rename f5 to d10/d11/d27/d4f/f7d 0 2024-09-19T09:02:55.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/386: write d10/d11/d27/f65 [513523,75243] 0 2024-09-19T09:02:55.095 INFO:tasks.workunit.client.0.smithi049.stdout:3/387: read d10/d11/d27/f68 [453081,107183] 0 2024-09-19T09:02:55.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/311: dwrite d1/d4/d20/f58 [4194304,4194304] 0 2024-09-19T09:02:55.104 INFO:tasks.workunit.client.0.smithi049.stdout:2/312: creat d1/d2/d32/f64 x:0 0 0 2024-09-19T09:02:55.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/313: symlink d1/d4/d1e/l65 0 2024-09-19T09:02:55.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/314: chown d1/d4/d1e/d21 18817290 1 2024-09-19T09:02:55.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/388: dread d10/d11/d13/d30/f3c [0,4194304] 0 2024-09-19T09:02:55.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/315: dread d1/d4/d1e/d45/f5a [0,4194304] 0 2024-09-19T09:02:55.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/316: readlink d1/d2b/d38/l47 0 2024-09-19T09:02:55.112 INFO:tasks.workunit.client.0.smithi049.stdout:3/389: read d10/f15 [7679698,116795] 0 2024-09-19T09:02:55.119 INFO:tasks.workunit.client.0.smithi049.stdout:2/317: dwrite d1/d2b/d38/f5d [4194304,4194304] 0 2024-09-19T09:02:55.121 INFO:tasks.workunit.client.0.smithi049.stdout:2/318: chown d1/d4/d1e/l65 0 1 2024-09-19T09:02:55.123 INFO:tasks.workunit.client.0.smithi049.stdout:2/319: dread d1/d2/d32/f29 [0,4194304] 0 2024-09-19T09:02:55.123 INFO:tasks.workunit.client.0.smithi049.stdout:3/390: mkdir d10/d11/d13/d7e 0 2024-09-19T09:02:55.125 INFO:tasks.workunit.client.0.smithi049.stdout:3/391: read d10/d11/d13/f16 [3556616,121965] 0 2024-09-19T09:02:55.126 INFO:tasks.workunit.client.0.smithi049.stdout:2/320: creat d1/d4/d1e/f66 x:0 0 0 2024-09-19T09:02:55.131 INFO:tasks.workunit.client.0.smithi049.stdout:2/321: creat d1/d2/f67 x:0 0 0 2024-09-19T09:02:55.134 INFO:tasks.workunit.client.0.smithi049.stdout:2/322: creat d1/d2/d23/f68 x:0 0 0 2024-09-19T09:02:55.135 INFO:tasks.workunit.client.0.smithi049.stdout:2/323: write d1/f11 [11698473,49384] 0 2024-09-19T09:02:55.136 INFO:tasks.workunit.client.0.smithi049.stdout:2/324: dread - d1/d4/f51 zero size 2024-09-19T09:02:55.139 INFO:tasks.workunit.client.0.smithi049.stdout:2/325: symlink d1/d4/d1e/d21/l69 0 2024-09-19T09:02:55.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/392: dread d10/d3d/d46/f4c [0,4194304] 0 2024-09-19T09:02:55.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/326: dread d1/d2/f34 [0,4194304] 0 2024-09-19T09:02:55.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/393: mknod d10/d3d/c7f 0 2024-09-19T09:02:55.157 INFO:tasks.workunit.client.0.smithi049.stdout:2/327: dread d1/d4/f17 [0,4194304] 0 2024-09-19T09:02:55.159 INFO:tasks.workunit.client.0.smithi049.stdout:2/328: write d1/d4/d1e/f28 [1000204,40060] 0 2024-09-19T09:02:55.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/394: dread d10/d11/d13/d30/f3b [0,4194304] 0 2024-09-19T09:02:55.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/395: readlink d10/d11/d13/l63 0 2024-09-19T09:02:55.166 INFO:tasks.workunit.client.0.smithi049.stdout:2/329: link d1/d2/f24 d1/f6a 0 2024-09-19T09:02:55.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/396: dread - d10/d3d/f4a zero size 2024-09-19T09:02:55.169 INFO:tasks.workunit.client.0.smithi049.stdout:2/330: creat d1/d4/d1e/d45/f6b x:0 0 0 2024-09-19T09:02:55.169 INFO:tasks.workunit.client.0.smithi049.stdout:3/397: mkdir d10/d3d/d79/d80 0 2024-09-19T09:02:55.171 INFO:tasks.workunit.client.0.smithi049.stdout:2/331: mkdir d1/d2/d6c 0 2024-09-19T09:02:55.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/398: truncate d10/d11/d27/d4f/f7d 133519 0 2024-09-19T09:02:55.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/399: stat fd 0 2024-09-19T09:02:55.175 INFO:tasks.workunit.client.0.smithi049.stdout:2/332: rename d1/d4/d1e/f2f to d1/d4/d1e/d45/f6d 0 2024-09-19T09:02:55.176 INFO:tasks.workunit.client.0.smithi049.stdout:2/333: chown d1/d2d/f57 642767631 1 2024-09-19T09:02:55.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/400: fdatasync d10/d3d/d46/f4c 0 2024-09-19T09:02:55.181 INFO:tasks.workunit.client.0.smithi049.stdout:3/401: mkdir d10/d11/d27/d4f/d59/d81 0 2024-09-19T09:02:55.185 INFO:tasks.workunit.client.0.smithi049.stdout:2/334: link d1/d4/d1e/d21/l69 d1/d4/l6e 0 2024-09-19T09:02:55.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/335: write d1/d2/d32/f29 [500569,51842] 0 2024-09-19T09:02:55.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/336: dread d1/d2/f24 [0,4194304] 0 2024-09-19T09:02:55.194 INFO:tasks.workunit.client.0.smithi049.stdout:3/402: rename d10/d11/d13/c23 to d10/d11/d27/c82 0 2024-09-19T09:02:55.195 INFO:tasks.workunit.client.0.smithi049.stdout:2/337: mknod d1/d2b/c6f 0 2024-09-19T09:02:55.197 INFO:tasks.workunit.client.0.smithi049.stdout:2/338: write d1/d4/d1e/d45/f6b [45910,46414] 0 2024-09-19T09:02:55.198 INFO:tasks.workunit.client.0.smithi049.stdout:2/339: chown d1/d4/d1e/d45/f48 68 1 2024-09-19T09:02:55.198 INFO:tasks.workunit.client.0.smithi049.stdout:3/403: unlink d10/d11/d13/d30/c33 0 2024-09-19T09:02:55.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/404: chown d10/d11/c1e 5812 1 2024-09-19T09:02:55.202 INFO:tasks.workunit.client.0.smithi049.stdout:2/340: mkdir d1/d2/d70 0 2024-09-19T09:02:55.207 INFO:tasks.workunit.client.0.smithi049.stdout:2/341: dread d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:55.208 INFO:tasks.workunit.client.0.smithi049.stdout:2/342: write d1/d4/f39 [102520,31563] 0 2024-09-19T09:02:55.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/343: write d1/d4/d1e/d45/f48 [5097692,40870] 0 2024-09-19T09:02:55.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/344: mknod d1/d2/d23/d49/c71 0 2024-09-19T09:02:55.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/345: unlink d1/d2d/f5e 0 2024-09-19T09:02:55.221 INFO:tasks.workunit.client.0.smithi049.stdout:2/346: fsync d1/d2/f13 0 2024-09-19T09:02:55.227 INFO:tasks.workunit.client.0.smithi049.stdout:2/347: dwrite d1/d2/d23/f56 [4194304,4194304] 0 2024-09-19T09:02:55.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/348: stat d1/f11 0 2024-09-19T09:02:55.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/349: creat d1/d4/d1e/f72 x:0 0 0 2024-09-19T09:02:55.235 INFO:tasks.workunit.client.0.smithi049.stdout:2/350: rename d1/d2/d23/c53 to d1/d2d/c73 0 2024-09-19T09:02:55.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/351: fdatasync d1/f15 0 2024-09-19T09:02:55.243 INFO:tasks.workunit.client.0.smithi049.stdout:2/352: dwrite d1/d4/d1e/d45/f5a [0,4194304] 0 2024-09-19T09:02:55.249 INFO:tasks.workunit.client.0.smithi049.stdout:2/353: symlink d1/d2b/d38/l74 0 2024-09-19T09:02:55.253 INFO:tasks.workunit.client.0.smithi049.stdout:2/354: mkdir d1/d2/d23/d49/d75 0 2024-09-19T09:02:55.254 INFO:tasks.workunit.client.0.smithi049.stdout:2/355: creat d1/d4/d1e/f76 x:0 0 0 2024-09-19T09:02:55.258 INFO:tasks.workunit.client.0.smithi049.stdout:2/356: rename d1/d2d/f57 to d1/d4/d20/d26/f77 0 2024-09-19T09:02:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:54 smithi102 ceph-mon[35280]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:54 smithi102 ceph-mon[35280]: pgmap v34: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 97 MiB/s rd, 265 MiB/s wr, 556 op/s 2024-09-19T09:02:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:54 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/4064810316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:02:55.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:54 smithi049 ceph-mon[28158]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:55.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:54 smithi049 ceph-mon[28158]: pgmap v34: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 97 MiB/s rd, 265 MiB/s wr, 556 op/s 2024-09-19T09:02:55.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:54 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/4064810316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:02:55.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/475: sync 2024-09-19T09:02:55.692 INFO:tasks.workunit.client.0.smithi049.stdout:7/476: truncate d1/d1a/f41 1258030 0 2024-09-19T09:02:55.695 INFO:tasks.workunit.client.0.smithi049.stdout:7/477: mknod d1/d7/ca8 0 2024-09-19T09:02:55.696 INFO:tasks.workunit.client.0.smithi049.stdout:7/478: dread - d1/d8/d80/f92 zero size 2024-09-19T09:02:55.701 INFO:tasks.workunit.client.0.smithi049.stdout:7/479: dwrite d1/d8/d2d/d31/f79 [0,4194304] 0 2024-09-19T09:02:55.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/480: getdents d1/d8/d2d/d36/d91 0 2024-09-19T09:02:55.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/481: rename d1/d53/d18/d50/d7c/f9d to d1/fa9 0 2024-09-19T09:02:55.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/482: rmdir d1/d53/d18/d50/d58 39 2024-09-19T09:02:55.723 INFO:tasks.workunit.client.0.smithi049.stdout:7/483: mkdir d1/d53/d18/d50/daa 0 2024-09-19T09:02:55.724 INFO:tasks.workunit.client.0.smithi049.stdout:7/484: stat d1/d7/f70 0 2024-09-19T09:02:55.733 INFO:tasks.workunit.client.0.smithi049.stdout:7/485: dwrite d1/d53/d18/d50/d58/d62/d6b/f8c [0,4194304] 0 2024-09-19T09:02:55.734 INFO:tasks.workunit.client.0.smithi049.stdout:7/486: dread - d1/d8/d2d/d31/f7f zero size 2024-09-19T09:02:55.753 INFO:tasks.workunit.client.0.smithi049.stdout:7/487: dread d1/d53/d18/d59/f2c [0,4194304] 0 2024-09-19T09:02:55.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/488: write d1/d7/f14 [719907,21656] 0 2024-09-19T09:02:55.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/489: truncate d1/d53/d18/d50/d58/d62/d6b/f8c 3401879 0 2024-09-19T09:02:55.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/490: readlink d1/d8/d2d/l61 0 2024-09-19T09:02:55.773 INFO:tasks.workunit.client.0.smithi049.stdout:7/491: dwrite d1/d8/d19/f55 [0,4194304] 0 2024-09-19T09:02:55.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/492: fsync d1/d1a/f38 0 2024-09-19T09:02:55.786 INFO:tasks.workunit.client.0.smithi049.stdout:4/324: sync 2024-09-19T09:02:55.791 INFO:tasks.workunit.client.0.smithi049.stdout:4/325: mkdir d4/d34/d3d/d4f/d6a 0 2024-09-19T09:02:55.797 INFO:tasks.workunit.client.0.smithi049.stdout:4/326: chown d4/d35/c39 62330 1 2024-09-19T09:02:55.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/327: link d4/d15/d19/d1f/f67 d4/d45/f6b 0 2024-09-19T09:02:55.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/250: sync 2024-09-19T09:02:55.957 INFO:tasks.workunit.client.0.smithi049.stdout:8/426: sync 2024-09-19T09:02:55.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/427: chown d1 0 1 2024-09-19T09:02:55.958 INFO:tasks.workunit.client.0.smithi049.stdout:5/251: chown d3/d5/de/f1a 65 1 2024-09-19T09:02:55.963 INFO:tasks.workunit.client.0.smithi049.stdout:5/252: symlink d3/d5/d20/d38/l4f 0 2024-09-19T09:02:55.965 INFO:tasks.workunit.client.0.smithi049.stdout:5/253: read d3/f41 [2088639,101568] 0 2024-09-19T09:02:55.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/428: dwrite d1/d11/d2e/d3c/f83 [0,4194304] 0 2024-09-19T09:02:55.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/429: write d1/fb [3928618,41593] 0 2024-09-19T09:02:55.976 INFO:tasks.workunit.client.0.smithi049.stdout:8/430: creat d1/d11/d45/f84 x:0 0 0 2024-09-19T09:02:55.978 INFO:tasks.workunit.client.0.smithi049.stdout:5/254: getdents d3/d5 0 2024-09-19T09:02:55.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/255: link d3/d5/de/l31 d3/dc/l50 0 2024-09-19T09:02:55.993 INFO:tasks.workunit.client.0.smithi049.stdout:5/256: write d3/d5/d20/d38/f4d [1643997,121039] 0 2024-09-19T09:02:55.996 INFO:tasks.workunit.client.0.smithi049.stdout:5/257: symlink d3/d5/de/d4a/l51 0 2024-09-19T09:02:56.001 INFO:tasks.workunit.client.0.smithi049.stdout:8/431: dwrite d1/d11/d2e/d3c/d5d/d65/f7e [0,4194304] 0 2024-09-19T09:02:56.005 INFO:tasks.workunit.client.0.smithi049.stdout:5/258: mknod d3/d5/d1c/d3a/c52 0 2024-09-19T09:02:56.006 INFO:tasks.workunit.client.0.smithi049.stdout:5/259: fdatasync d3/d5/de/d12/f13 0 2024-09-19T09:02:56.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/260: write d3/f32 [629150,46964] 0 2024-09-19T09:02:56.026 INFO:tasks.workunit.client.0.smithi049.stdout:5/261: link d3/d5/de/l21 d3/d5/d20/d38/l53 0 2024-09-19T09:02:56.026 INFO:tasks.workunit.client.0.smithi049.stdout:8/432: dwrite d1/d11/d2e/d3c/f6a [0,4194304] 0 2024-09-19T09:02:56.032 INFO:tasks.workunit.client.0.smithi049.stdout:8/433: creat d1/d11/d2e/d4e/d61/f85 x:0 0 0 2024-09-19T09:02:56.034 INFO:tasks.workunit.client.0.smithi049.stdout:5/262: link d3/d5/d20/d38/f46 d3/d5/de/d12/d45/f54 0 2024-09-19T09:02:56.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/263: write d3/f8 [1686010,128556] 0 2024-09-19T09:02:56.036 INFO:tasks.workunit.client.0.smithi049.stdout:8/434: getdents d1/d27/d81 0 2024-09-19T09:02:56.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/264: mknod d3/dc/c55 0 2024-09-19T09:02:56.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/265: symlink d3/d5/d1c/d3a/l56 0 2024-09-19T09:02:56.043 INFO:tasks.workunit.client.0.smithi049.stdout:8/435: link d1/d11/d3f/d5b/f76 d1/d11/d3f/d5b/f86 0 2024-09-19T09:02:56.044 INFO:tasks.workunit.client.0.smithi049.stdout:8/436: chown d1/d11/d45/f84 1034 1 2024-09-19T09:02:56.046 INFO:tasks.workunit.client.0.smithi049.stdout:8/437: rmdir d1/d27 39 2024-09-19T09:02:56.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/266: dread d3/f10 [0,4194304] 0 2024-09-19T09:02:56.066 INFO:tasks.workunit.client.0.smithi049.stdout:8/438: write d1/d27/f35 [4902955,66801] 0 2024-09-19T09:02:56.066 INFO:tasks.workunit.client.0.smithi049.stdout:5/267: write d3/d5/de/f1e [1216050,40406] 0 2024-09-19T09:02:56.077 INFO:tasks.workunit.client.0.smithi049.stdout:8/439: dwrite d1/d27/f53 [0,4194304] 0 2024-09-19T09:02:56.081 INFO:tasks.workunit.client.0.smithi049.stdout:5/268: dread d3/d5/de/d12/f13 [0,4194304] 0 2024-09-19T09:02:56.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/440: rename d1/d11/d2e/d3c to d1/d11/d4f/d87 0 2024-09-19T09:02:56.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/441: stat d1/d27/l40 0 2024-09-19T09:02:56.085 INFO:tasks.workunit.client.0.smithi049.stdout:5/269: mkdir d3/d5/d20/d57 0 2024-09-19T09:02:56.093 INFO:tasks.workunit.client.0.smithi049.stdout:8/442: rename d1/f21 to d1/d11/d2e/d4e/f88 0 2024-09-19T09:02:56.095 INFO:tasks.workunit.client.0.smithi049.stdout:5/270: mknod d3/d5/d20/d57/c58 0 2024-09-19T09:02:56.095 INFO:tasks.workunit.client.0.smithi049.stdout:5/271: readlink d3/d5/l7 0 2024-09-19T09:02:56.098 INFO:tasks.workunit.client.0.smithi049.stdout:0/514: sync 2024-09-19T09:02:56.098 INFO:tasks.workunit.client.0.smithi049.stdout:9/438: sync 2024-09-19T09:02:56.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/272: rename d3/d5/d20/f33 to d3/d5/d20/f59 0 2024-09-19T09:02:56.099 INFO:tasks.workunit.client.0.smithi049.stdout:9/439: dread - d3/d14/d1a/f80 zero size 2024-09-19T09:02:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:8/443: mkdir d1/d11/d2e/d89 0 2024-09-19T09:02:56.102 INFO:tasks.workunit.client.0.smithi049.stdout:8/444: dread - d1/d11/d3f/d5b/f76 zero size 2024-09-19T09:02:56.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/273: mkdir d3/d5/d20/d38/d5a 0 2024-09-19T09:02:56.111 INFO:tasks.workunit.client.0.smithi049.stdout:0/515: write d5/ff [57224,104325] 0 2024-09-19T09:02:56.112 INFO:tasks.workunit.client.0.smithi049.stdout:5/274: dwrite d3/f32 [0,4194304] 0 2024-09-19T09:02:56.121 INFO:tasks.workunit.client.0.smithi049.stdout:0/516: dread d5/d10/d13/d15/d29/f4b [0,4194304] 0 2024-09-19T09:02:56.122 INFO:tasks.workunit.client.0.smithi049.stdout:0/517: stat d5/d10/d13/d15/d36/d3d/l61 0 2024-09-19T09:02:56.125 INFO:tasks.workunit.client.0.smithi049.stdout:9/440: truncate d3/d14/d1a/d21/d31/d8e/d6f/f76 6314864 0 2024-09-19T09:02:56.133 INFO:tasks.workunit.client.0.smithi049.stdout:5/275: link d3/d5/d1c/d3c/f47 d3/dc/d43/f5b 0 2024-09-19T09:02:56.134 INFO:tasks.workunit.client.0.smithi049.stdout:0/518: chown d5/d10/f5b 58 1 2024-09-19T09:02:56.137 INFO:tasks.workunit.client.0.smithi049.stdout:9/441: creat d3/d14/d34/f95 x:0 0 0 2024-09-19T09:02:56.137 INFO:tasks.workunit.client.0.smithi049.stdout:5/276: dread d3/f10 [0,4194304] 0 2024-09-19T09:02:56.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/445: link d1/d11/d3f/d5b/f67 d1/d11/d4f/d87/d5d/d65/f8a 0 2024-09-19T09:02:56.138 INFO:tasks.workunit.client.0.smithi049.stdout:0/519: dread d5/d10/d7d/f89 [0,4194304] 0 2024-09-19T09:02:56.147 INFO:tasks.workunit.client.0.smithi049.stdout:5/277: fsync d3/d5/d20/f59 0 2024-09-19T09:02:56.151 INFO:tasks.workunit.client.0.smithi049.stdout:8/446: mkdir d1/d1a/d8b 0 2024-09-19T09:02:56.156 INFO:tasks.workunit.client.0.smithi049.stdout:9/442: rename d3/d14/d1a/d21/d67/d94/l8c to d3/d14/d1a/d21/d67/d94/l96 0 2024-09-19T09:02:56.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/447: dread d1/d27/f41 [0,4194304] 0 2024-09-19T09:02:56.164 INFO:tasks.workunit.client.0.smithi049.stdout:0/520: write d5/d10/f5b [313468,120979] 0 2024-09-19T09:02:56.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/448: dwrite d1/d1a/f3b [0,4194304] 0 2024-09-19T09:02:56.166 INFO:tasks.workunit.client.0.smithi049.stdout:9/443: dwrite d3/d14/d1a/d90/f71 [0,4194304] 0 2024-09-19T09:02:56.167 INFO:tasks.workunit.client.0.smithi049.stdout:5/278: getdents d3/d5/d1c/d3c 0 2024-09-19T09:02:56.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/521: creat d5/d86/fa0 x:0 0 0 2024-09-19T09:02:56.174 INFO:tasks.workunit.client.0.smithi049.stdout:5/279: dread d3/f32 [0,4194304] 0 2024-09-19T09:02:56.175 INFO:tasks.workunit.client.0.smithi049.stdout:8/449: mkdir d1/d11/d3f/d8c 0 2024-09-19T09:02:56.175 INFO:tasks.workunit.client.0.smithi049.stdout:5/280: chown d3/d5/c34 2 1 2024-09-19T09:02:56.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/444: symlink d3/d14/d1a/d21/d73/l97 0 2024-09-19T09:02:56.180 INFO:tasks.workunit.client.0.smithi049.stdout:0/522: unlink d5/d10/d7d/f89 0 2024-09-19T09:02:56.180 INFO:tasks.workunit.client.0.smithi049.stdout:0/523: dread - d5/d86/f95 zero size 2024-09-19T09:02:56.181 INFO:tasks.workunit.client.0.smithi049.stdout:8/450: chown d1/d11/d4f/d87/d5d/c64 0 1 2024-09-19T09:02:56.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/445: unlink d3/d14/d1a/d21/d31/l83 0 2024-09-19T09:02:56.187 INFO:tasks.workunit.client.0.smithi049.stdout:0/524: fsync d5/f71 0 2024-09-19T09:02:56.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/281: mknod d3/d5/d1c/d4c/c5c 0 2024-09-19T09:02:56.191 INFO:tasks.workunit.client.0.smithi049.stdout:5/282: readlink d3/d5/de/d4a/l51 0 2024-09-19T09:02:56.192 INFO:tasks.workunit.client.0.smithi049.stdout:9/446: unlink d3/d14/d1a/l89 0 2024-09-19T09:02:56.195 INFO:tasks.workunit.client.0.smithi049.stdout:0/525: mknod d5/d10/d2f/ca1 0 2024-09-19T09:02:56.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/526: rename d5/d10/d13/d30/c72 to d5/d10/d7d/ca2 0 2024-09-19T09:02:56.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/451: dwrite d1/ff [0,4194304] 0 2024-09-19T09:02:56.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/527: creat d5/d10/d13/fa3 x:0 0 0 2024-09-19T09:02:56.212 INFO:tasks.workunit.client.0.smithi049.stdout:0/528: write d5/d10/d13/d15/d29/f5e [1010842,8605] 0 2024-09-19T09:02:56.213 INFO:tasks.workunit.client.0.smithi049.stdout:0/529: read d5/f71 [1707392,87871] 0 2024-09-19T09:02:56.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/283: truncate d3/d5/fb 1807494 0 2024-09-19T09:02:56.216 INFO:tasks.workunit.client.0.smithi049.stdout:9/447: write d3/d14/d1a/d21/d31/d8e/d6f/f76 [5665652,66151] 0 2024-09-19T09:02:56.221 INFO:tasks.workunit.client.0.smithi049.stdout:0/530: truncate d5/d10/d13/d15/f43 1475878 0 2024-09-19T09:02:56.225 INFO:tasks.workunit.client.0.smithi049.stdout:0/531: mknod d5/d86/ca4 0 2024-09-19T09:02:56.231 INFO:tasks.workunit.client.0.smithi049.stdout:5/284: write d3/dc/f42 [582119,5904] 0 2024-09-19T09:02:56.232 INFO:tasks.workunit.client.0.smithi049.stdout:9/448: rmdir d3/d14/d34/d44/d4d 0 2024-09-19T09:02:56.235 INFO:tasks.workunit.client.0.smithi049.stdout:9/449: write d3/d14/f92 [873475,19654] 0 2024-09-19T09:02:56.237 INFO:tasks.workunit.client.0.smithi049.stdout:8/452: dread d1/f77 [0,4194304] 0 2024-09-19T09:02:56.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/285: mkdir d3/d5/d20/d38/d5d 0 2024-09-19T09:02:56.238 INFO:tasks.workunit.client.0.smithi049.stdout:8/453: chown d1/d11/f1b 1650886222 1 2024-09-19T09:02:56.239 INFO:tasks.workunit.client.0.smithi049.stdout:8/454: readlink d1/d11/d2e/l63 0 2024-09-19T09:02:56.240 INFO:tasks.workunit.client.0.smithi049.stdout:0/532: truncate d5/d10/d13/d15/d36/d3d/d7f/f8b 2610138 0 2024-09-19T09:02:56.241 INFO:tasks.workunit.client.0.smithi049.stdout:1/251: sync 2024-09-19T09:02:56.241 INFO:tasks.workunit.client.0.smithi049.stdout:6/239: sync 2024-09-19T09:02:56.241 INFO:tasks.workunit.client.0.smithi049.stdout:5/286: mknod d3/d5/d20/c5e 0 2024-09-19T09:02:56.243 INFO:tasks.workunit.client.0.smithi049.stdout:8/455: rmdir d1/d11/d45 39 2024-09-19T09:02:56.243 INFO:tasks.workunit.client.0.smithi049.stdout:9/450: dwrite d3/f43 [0,4194304] 0 2024-09-19T09:02:56.244 INFO:tasks.workunit.client.0.smithi049.stdout:0/533: chown d5/d10/d13/d69/l7b 50894 1 2024-09-19T09:02:56.249 INFO:tasks.workunit.client.0.smithi049.stdout:0/534: stat d5/d10/d13/d15/d36/c73 0 2024-09-19T09:02:56.249 INFO:tasks.workunit.client.0.smithi049.stdout:6/240: dread dc/d16/f3b [0,4194304] 0 2024-09-19T09:02:56.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/241: fdatasync dc/d1b/f39 0 2024-09-19T09:02:56.253 INFO:tasks.workunit.client.0.smithi049.stdout:1/252: truncate d5/f26 4381792 0 2024-09-19T09:02:56.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/456: dwrite d1/d11/f4d [0,4194304] 0 2024-09-19T09:02:56.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/451: creat d3/d14/d1a/d21/d31/d8e/d6f/f98 x:0 0 0 2024-09-19T09:02:56.262 INFO:tasks.workunit.client.0.smithi049.stdout:5/287: rename d3/d5/de/l2a to d3/d5/de/d12/d45/l5f 0 2024-09-19T09:02:56.264 INFO:tasks.workunit.client.0.smithi049.stdout:8/457: dwrite d1/d11/f3a [0,4194304] 0 2024-09-19T09:02:56.266 INFO:tasks.workunit.client.0.smithi049.stdout:8/458: write d1/ff [5194437,77766] 0 2024-09-19T09:02:56.271 INFO:tasks.workunit.client.0.smithi049.stdout:0/535: unlink d5/f71 0 2024-09-19T09:02:56.271 INFO:tasks.workunit.client.0.smithi049.stdout:8/459: truncate d1/d11/d3f/d5b/f69 256280 0 2024-09-19T09:02:56.278 INFO:tasks.workunit.client.0.smithi049.stdout:1/253: rename d5/d6/d8/f25 to d5/f54 0 2024-09-19T09:02:56.280 INFO:tasks.workunit.client.0.smithi049.stdout:5/288: creat d3/d5/d1c/d2d/f60 x:0 0 0 2024-09-19T09:02:56.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/289: read d3/d5/de/f44 [400136,72476] 0 2024-09-19T09:02:56.284 INFO:tasks.workunit.client.0.smithi049.stdout:6/242: mknod dc/d12/c4b 0 2024-09-19T09:02:56.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/493: sync 2024-09-19T09:02:56.284 INFO:tasks.workunit.client.0.smithi049.stdout:3/405: sync 2024-09-19T09:02:56.284 INFO:tasks.workunit.client.0.smithi049.stdout:4/328: sync 2024-09-19T09:02:56.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/357: sync 2024-09-19T09:02:56.287 INFO:tasks.workunit.client.0.smithi049.stdout:9/452: dread d3/d14/d1a/d21/f2f [0,4194304] 0 2024-09-19T09:02:56.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/494: dread d1/d53/f85 [0,4194304] 0 2024-09-19T09:02:56.290 INFO:tasks.workunit.client.0.smithi049.stdout:8/460: dread d1/d11/d4f/d87/d5d/d65/f6d [0,4194304] 0 2024-09-19T09:02:56.290 INFO:tasks.workunit.client.0.smithi049.stdout:0/536: dread d5/d10/d13/d30/f91 [0,4194304] 0 2024-09-19T09:02:56.322 INFO:tasks.workunit.client.0.smithi049.stdout:1/254: creat d5/d6/d8/d13/f55 x:0 0 0 2024-09-19T09:02:56.335 INFO:tasks.workunit.client.0.smithi049.stdout:3/406: creat d10/d11/d13/d30/f83 x:0 0 0 2024-09-19T09:02:56.336 INFO:tasks.workunit.client.0.smithi049.stdout:3/407: write d10/d11/d13/d30/f83 [515876,48584] 0 2024-09-19T09:02:56.340 INFO:tasks.workunit.client.0.smithi049.stdout:6/243: mkdir dc/d1b/d20/d2f/d4c 0 2024-09-19T09:02:56.342 INFO:tasks.workunit.client.0.smithi049.stdout:4/329: fsync d4/d15/d19/d1f/f2e 0 2024-09-19T09:02:56.343 INFO:tasks.workunit.client.0.smithi049.stdout:4/330: dread - d4/f69 zero size 2024-09-19T09:02:56.343 INFO:tasks.workunit.client.0.smithi049.stdout:4/331: readlink d4/d15/d19/d1f/l43 0 2024-09-19T09:02:56.344 INFO:tasks.workunit.client.0.smithi049.stdout:4/332: write d4/d15/f59 [736837,46287] 0 2024-09-19T09:02:56.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/495: symlink d1/d8/d2d/d36/d91/lab 0 2024-09-19T09:02:56.351 INFO:tasks.workunit.client.0.smithi049.stdout:2/358: write d1/d4/d1e/d21/f22 [423089,130767] 0 2024-09-19T09:02:56.352 INFO:tasks.workunit.client.0.smithi049.stdout:1/255: creat d5/d6/dc/f56 x:0 0 0 2024-09-19T09:02:56.353 INFO:tasks.workunit.client.0.smithi049.stdout:2/359: read d1/d4/f17 [2572861,80603] 0 2024-09-19T09:02:56.355 INFO:tasks.workunit.client.0.smithi049.stdout:2/360: chown d1/d2d/c2e 5 1 2024-09-19T09:02:56.356 INFO:tasks.workunit.client.0.smithi049.stdout:0/537: dwrite d5/d10/d13/d15/f8d [4194304,4194304] 0 2024-09-19T09:02:56.358 INFO:tasks.workunit.client.0.smithi049.stdout:3/408: mkdir d10/d3d/d46/d84 0 2024-09-19T09:02:56.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/496: creat d1/d53/d18/d50/d58/d62/fac x:0 0 0 2024-09-19T09:02:56.363 INFO:tasks.workunit.client.0.smithi049.stdout:8/461: creat d1/d11/d3f/d8c/f8d x:0 0 0 2024-09-19T09:02:56.365 INFO:tasks.workunit.client.0.smithi049.stdout:8/462: write d1/d27/f35 [2042752,122430] 0 2024-09-19T09:02:56.366 INFO:tasks.workunit.client.0.smithi049.stdout:1/256: rename d5/d6/dc/l17 to d5/l57 0 2024-09-19T09:02:56.370 INFO:tasks.workunit.client.0.smithi049.stdout:3/409: fdatasync d10/f38 0 2024-09-19T09:02:56.370 INFO:tasks.workunit.client.0.smithi049.stdout:4/333: dwrite d4/d15/d19/d1f/f2e [0,4194304] 0 2024-09-19T09:02:56.370 INFO:tasks.workunit.client.0.smithi049.stdout:0/538: dread d5/d10/d13/d15/d29/f3e [0,4194304] 0 2024-09-19T09:02:56.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/497: mknod d1/cad 0 2024-09-19T09:02:56.373 INFO:tasks.workunit.client.0.smithi049.stdout:0/539: truncate d5/d10/d2f/d6d/f8a 962465 0 2024-09-19T09:02:56.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/361: rename d1/d4/d1e/l65 to d1/d4/d20/d26/l78 0 2024-09-19T09:02:56.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/244: creat dc/d12/f4d x:0 0 0 2024-09-19T09:02:56.397 INFO:tasks.workunit.client.0.smithi049.stdout:7/498: symlink d1/d8/d2d/d36/lae 0 2024-09-19T09:02:56.397 INFO:tasks.workunit.client.0.smithi049.stdout:7/499: chown d1/d1a/f21 1 1 2024-09-19T09:02:56.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/500: write d1/d7/f70 [715716,19970] 0 2024-09-19T09:02:56.403 INFO:tasks.workunit.client.0.smithi049.stdout:7/501: dread d1/d53/d18/f8d [0,4194304] 0 2024-09-19T09:02:56.405 INFO:tasks.workunit.client.0.smithi049.stdout:8/463: mkdir d1/d1a/d8b/d8e 0 2024-09-19T09:02:56.409 INFO:tasks.workunit.client.0.smithi049.stdout:1/257: write d5/f1e [324564,122196] 0 2024-09-19T09:02:56.413 INFO:tasks.workunit.client.0.smithi049.stdout:0/540: mknod d5/d10/d13/d15/d29/ca5 0 2024-09-19T09:02:56.415 INFO:tasks.workunit.client.0.smithi049.stdout:6/245: dwrite dc/d12/f14 [0,4194304] 0 2024-09-19T09:02:56.425 INFO:tasks.workunit.client.0.smithi049.stdout:6/246: dwrite dc/d12/f14 [4194304,4194304] 0 2024-09-19T09:02:56.430 INFO:tasks.workunit.client.0.smithi049.stdout:4/334: truncate d4/f1e 1535856 0 2024-09-19T09:02:56.431 INFO:tasks.workunit.client.0.smithi049.stdout:4/335: write d4/d15/f59 [3707031,56068] 0 2024-09-19T09:02:56.437 INFO:tasks.workunit.client.0.smithi049.stdout:1/258: rmdir d5/d6/d8/d13/d24 39 2024-09-19T09:02:56.438 INFO:tasks.workunit.client.0.smithi049.stdout:0/541: dread d5/d10/d82/d67/f90 [0,4194304] 0 2024-09-19T09:02:56.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/502: symlink d1/d53/d18/d50/laf 0 2024-09-19T09:02:56.445 INFO:tasks.workunit.client.0.smithi049.stdout:7/503: stat d1/d53/d18/d50/d7c/d9c 0 2024-09-19T09:02:56.447 INFO:tasks.workunit.client.0.smithi049.stdout:8/464: mknod d1/d11/c8f 0 2024-09-19T09:02:56.448 INFO:tasks.workunit.client.0.smithi049.stdout:8/465: write d1/d1a/f5e [413311,64592] 0 2024-09-19T09:02:56.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/410: truncate d10/d11/f3a 7366359 0 2024-09-19T09:02:56.450 INFO:tasks.workunit.client.0.smithi049.stdout:8/466: write d1/d11/f4d [3187304,110275] 0 2024-09-19T09:02:56.452 INFO:tasks.workunit.client.0.smithi049.stdout:6/247: rename dc/d1b/d20/d2f/d31/c34 to dc/d1b/d20/c4e 0 2024-09-19T09:02:56.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/259: creat d5/d6/d19/d21/f58 x:0 0 0 2024-09-19T09:02:56.459 INFO:tasks.workunit.client.0.smithi049.stdout:2/362: dwrite d1/d4/d1e/d45/f6d [0,4194304] 0 2024-09-19T09:02:56.466 INFO:tasks.workunit.client.0.smithi049.stdout:1/260: dwrite d5/d6/f1f [0,4194304] 0 2024-09-19T09:02:56.477 INFO:tasks.workunit.client.0.smithi049.stdout:6/248: creat dc/d1b/d20/d2f/d31/f4f x:0 0 0 2024-09-19T09:02:56.480 INFO:tasks.workunit.client.0.smithi049.stdout:4/336: mkdir d4/d6c 0 2024-09-19T09:02:56.483 INFO:tasks.workunit.client.0.smithi049.stdout:4/337: chown d4/d45/d3f/d47/d5f 13376117 1 2024-09-19T09:02:56.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/467: dwrite d1/d27/f79 [0,4194304] 0 2024-09-19T09:02:56.492 INFO:tasks.workunit.client.0.smithi049.stdout:7/504: dread d1/f2 [0,4194304] 0 2024-09-19T09:02:56.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/363: creat d1/d4/d1e/d21/f79 x:0 0 0 2024-09-19T09:02:56.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/249: dwrite dc/d1b/f23 [0,4194304] 0 2024-09-19T09:02:56.496 INFO:tasks.workunit.client.0.smithi049.stdout:6/250: stat dc/d1b/f38 0 2024-09-19T09:02:56.501 INFO:tasks.workunit.client.0.smithi049.stdout:0/542: link d5/d10/d13/d30/d75/f81 d5/d10/d82/d67/d85/fa6 0 2024-09-19T09:02:56.502 INFO:tasks.workunit.client.0.smithi049.stdout:1/261: mknod d5/d6/d8/c59 0 2024-09-19T09:02:56.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/411: creat d10/d11/d13/d7e/f85 x:0 0 0 2024-09-19T09:02:56.509 INFO:tasks.workunit.client.0.smithi049.stdout:0/543: dwrite d5/fd [0,4194304] 0 2024-09-19T09:02:56.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/468: symlink d1/d11/d4f/l90 0 2024-09-19T09:02:56.511 INFO:tasks.workunit.client.0.smithi049.stdout:1/262: dwrite d5/f36 [0,4194304] 0 2024-09-19T09:02:56.512 INFO:tasks.workunit.client.0.smithi049.stdout:8/469: stat d1/d11/d3f/d5b/f69 0 2024-09-19T09:02:56.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/364: unlink d1/d4/d1e/d45/f5a 0 2024-09-19T09:02:56.523 INFO:tasks.workunit.client.0.smithi049.stdout:6/251: fdatasync dc/f19 0 2024-09-19T09:02:56.526 INFO:tasks.workunit.client.0.smithi049.stdout:2/365: dread d1/f6a [0,4194304] 0 2024-09-19T09:02:56.527 INFO:tasks.workunit.client.0.smithi049.stdout:4/338: symlink d4/l6d 0 2024-09-19T09:02:56.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/339: readlink d4/d34/d3d/d4f/l53 0 2024-09-19T09:02:56.529 INFO:tasks.workunit.client.0.smithi049.stdout:4/340: readlink d4/d34/d3d/d4f/l53 0 2024-09-19T09:02:56.529 INFO:tasks.workunit.client.0.smithi049.stdout:3/412: rmdir d10/d3d 39 2024-09-19T09:02:56.533 INFO:tasks.workunit.client.0.smithi049.stdout:0/544: unlink d5/d64/c76 0 2024-09-19T09:02:56.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/341: dread f2 [0,4194304] 0 2024-09-19T09:02:56.543 INFO:tasks.workunit.client.0.smithi049.stdout:6/252: creat dc/d1b/d20/d2f/f50 x:0 0 0 2024-09-19T09:02:56.550 INFO:tasks.workunit.client.0.smithi049.stdout:6/253: dwrite f0 [0,4194304] 0 2024-09-19T09:02:56.552 INFO:tasks.workunit.client.0.smithi049.stdout:0/545: mknod d5/d10/d2f/ca7 0 2024-09-19T09:02:56.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/470: dread d1/d11/d4f/d87/d5d/d65/f8a [0,4194304] 0 2024-09-19T09:02:56.554 INFO:tasks.workunit.client.0.smithi049.stdout:1/263: symlink d5/d6/d19/d30/l5a 0 2024-09-19T09:02:56.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/546: truncate d5/d10/d13/f80 5034089 0 2024-09-19T09:02:56.560 INFO:tasks.workunit.client.0.smithi049.stdout:6/254: creat dc/d1b/d20/d2f/f51 x:0 0 0 2024-09-19T09:02:56.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/342: creat d4/d4c/f6e x:0 0 0 2024-09-19T09:02:56.562 INFO:tasks.workunit.client.0.smithi049.stdout:8/471: chown d1/l18 1 1 2024-09-19T09:02:56.564 INFO:tasks.workunit.client.0.smithi049.stdout:8/472: truncate d1/d11/d4f/f66 4515909 0 2024-09-19T09:02:56.565 INFO:tasks.workunit.client.0.smithi049.stdout:3/413: rmdir d10/d11/d27/d4f 39 2024-09-19T09:02:56.570 INFO:tasks.workunit.client.0.smithi049.stdout:4/343: read d4/fe [357901,32594] 0 2024-09-19T09:02:56.575 INFO:tasks.workunit.client.0.smithi049.stdout:1/264: rename d5/d6/d8/d13/d24/f47 to d5/d6/f5b 0 2024-09-19T09:02:56.575 INFO:tasks.workunit.client.0.smithi049.stdout:7/505: dwrite d1/d53/d18/f3b [0,4194304] 0 2024-09-19T09:02:56.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/255: link dc/c45 dc/d1b/d20/d2f/c52 0 2024-09-19T09:02:56.575 INFO:tasks.workunit.client.0.smithi049.stdout:0/547: dwrite d5/d10/d13/d30/f91 [0,4194304] 0 2024-09-19T09:02:56.583 INFO:tasks.workunit.client.0.smithi049.stdout:3/414: truncate d10/d11/d13/d30/f3b 2849754 0 2024-09-19T09:02:56.587 INFO:tasks.workunit.client.0.smithi049.stdout:7/506: dread - d1/d7/f64 zero size 2024-09-19T09:02:56.587 INFO:tasks.workunit.client.0.smithi049.stdout:0/548: dwrite d5/ff [0,4194304] 0 2024-09-19T09:02:56.587 INFO:tasks.workunit.client.0.smithi049.stdout:7/507: dread - d1/d53/f5b zero size 2024-09-19T09:02:56.587 INFO:tasks.workunit.client.0.smithi049.stdout:1/265: creat d5/d6/d8/d1a/f5c x:0 0 0 2024-09-19T09:02:56.588 INFO:tasks.workunit.client.0.smithi049.stdout:8/473: link d1/d11/d3f/d5b/f86 d1/d11/d45/f91 0 2024-09-19T09:02:56.589 INFO:tasks.workunit.client.0.smithi049.stdout:6/256: mkdir dc/d1b/d20/d2f/d53 0 2024-09-19T09:02:56.589 INFO:tasks.workunit.client.0.smithi049.stdout:1/266: truncate d5/d6/f5b 301168 0 2024-09-19T09:02:56.594 INFO:tasks.workunit.client.0.smithi049.stdout:1/267: fsync d5/d6/dc/f56 0 2024-09-19T09:02:56.595 INFO:tasks.workunit.client.0.smithi049.stdout:8/474: fsync d1/d11/d2e/d4e/f88 0 2024-09-19T09:02:56.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/475: chown d1/d11/f3a 5410 1 2024-09-19T09:02:56.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/415: creat d10/d11/d27/d4f/f86 x:0 0 0 2024-09-19T09:02:56.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/549: symlink d5/d10/d13/d15/d29/la8 0 2024-09-19T09:02:56.605 INFO:tasks.workunit.client.0.smithi049.stdout:7/508: link d1/d8/d2d/d36/d91/f95 d1/d53/d18/d50/d7c/fb0 0 2024-09-19T09:02:56.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/268: creat d5/d6/d8/f5d x:0 0 0 2024-09-19T09:02:56.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/269: readlink d5/d6/d8/d1a/l1d 0 2024-09-19T09:02:56.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/476: symlink d1/d11/d4f/l92 0 2024-09-19T09:02:56.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/270: stat d5/d6/d19/d21/f32 0 2024-09-19T09:02:56.609 INFO:tasks.workunit.client.0.smithi049.stdout:3/416: chown d10/d3d/d46 1837923 1 2024-09-19T09:02:56.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/550: unlink d5/d10/f5c 0 2024-09-19T09:02:56.619 INFO:tasks.workunit.client.0.smithi049.stdout:7/509: dread - d1/d53/d18/d50/d58/d62/d6b/f81 zero size 2024-09-19T09:02:56.622 INFO:tasks.workunit.client.0.smithi049.stdout:3/417: mkdir d10/d3d/d79/d87 0 2024-09-19T09:02:56.625 INFO:tasks.workunit.client.0.smithi049.stdout:0/551: readlink d5/d10/d13/d15/d36/d3d/l2c 0 2024-09-19T09:02:56.626 INFO:tasks.workunit.client.0.smithi049.stdout:0/552: fsync d5/ff 0 2024-09-19T09:02:56.627 INFO:tasks.workunit.client.0.smithi049.stdout:0/553: fsync d5/d10/d13/fa3 0 2024-09-19T09:02:56.635 INFO:tasks.workunit.client.0.smithi049.stdout:1/271: rename f3 to d5/d6/d8/d13/d24/d3b/f5e 0 2024-09-19T09:02:56.647 INFO:tasks.workunit.client.0.smithi049.stdout:2/366: dwrite f0 [0,4194304] 0 2024-09-19T09:02:56.649 INFO:tasks.workunit.client.0.smithi049.stdout:7/510: rename d1/d53/d18/f9b to d1/d53/d18/d50/daa/fb1 0 2024-09-19T09:02:56.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/272: dread d5/f23 [0,4194304] 0 2024-09-19T09:02:56.659 INFO:tasks.workunit.client.0.smithi049.stdout:8/477: getdents d1/d11 0 2024-09-19T09:02:56.661 INFO:tasks.workunit.client.0.smithi049.stdout:6/257: write dc/ff [1684731,29749] 0 2024-09-19T09:02:56.665 INFO:tasks.workunit.client.0.smithi049.stdout:2/367: chown d1/d4/d20/d26/l78 12679575 1 2024-09-19T09:02:56.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/478: dwrite d1/d1a/f29 [0,4194304] 0 2024-09-19T09:02:56.679 INFO:tasks.workunit.client.0.smithi049.stdout:6/258: mknod dc/d16/c54 0 2024-09-19T09:02:56.680 INFO:tasks.workunit.client.0.smithi049.stdout:2/368: dwrite d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:56.687 INFO:tasks.workunit.client.0.smithi049.stdout:0/554: link d5/d10/d13/d15/l1f d5/d10/d13/d30/d75/la9 0 2024-09-19T09:02:56.693 INFO:tasks.workunit.client.0.smithi049.stdout:3/418: rename d10/d3d/d46/l6c to d10/l88 0 2024-09-19T09:02:56.694 INFO:tasks.workunit.client.0.smithi049.stdout:7/511: dwrite d1/d1a/f38 [0,4194304] 0 2024-09-19T09:02:56.697 INFO:tasks.workunit.client.0.smithi049.stdout:2/369: mknod d1/d2b/c7a 0 2024-09-19T09:02:56.699 INFO:tasks.workunit.client.0.smithi049.stdout:1/273: truncate d5/f26 4370509 0 2024-09-19T09:02:56.702 INFO:tasks.workunit.client.0.smithi049.stdout:0/555: dwrite d5/d10/d13/d15/d29/f57 [0,4194304] 0 2024-09-19T09:02:56.704 INFO:tasks.workunit.client.0.smithi049.stdout:2/370: write d1/d4/fb [2071440,5035] 0 2024-09-19T09:02:56.705 INFO:tasks.workunit.client.0.smithi049.stdout:8/479: rmdir d1/d27/d81 0 2024-09-19T09:02:56.711 INFO:tasks.workunit.client.0.smithi049.stdout:6/259: link dc/d1b/c37 dc/d1b/c55 0 2024-09-19T09:02:56.711 INFO:tasks.workunit.client.0.smithi049.stdout:1/274: mknod d5/d6/d19/d21/d52/c5f 0 2024-09-19T09:02:56.713 INFO:tasks.workunit.client.0.smithi049.stdout:8/480: dwrite d1/d11/f1b [8388608,4194304] 0 2024-09-19T09:02:56.721 INFO:tasks.workunit.client.0.smithi049.stdout:1/275: write d5/f49 [1780755,102567] 0 2024-09-19T09:02:56.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/260: truncate dc/d1b/d20/d2f/f3f 342059 0 2024-09-19T09:02:56.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/261: read dc/d12/f27 [906431,13607] 0 2024-09-19T09:02:56.726 INFO:tasks.workunit.client.0.smithi049.stdout:3/419: creat d10/d11/d27/f89 x:0 0 0 2024-09-19T09:02:56.729 INFO:tasks.workunit.client.0.smithi049.stdout:8/481: unlink d1/d1a/l20 0 2024-09-19T09:02:56.730 INFO:tasks.workunit.client.0.smithi049.stdout:2/371: symlink d1/l7b 0 2024-09-19T09:02:56.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/276: rename d5/d6/dc/c1c to d5/c60 0 2024-09-19T09:02:56.739 INFO:tasks.workunit.client.0.smithi049.stdout:2/372: dwrite d1/d4/f39 [0,4194304] 0 2024-09-19T09:02:56.739 INFO:tasks.workunit.client.0.smithi049.stdout:0/556: dwrite d5/d10/d13/f1c [0,4194304] 0 2024-09-19T09:02:56.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/262: symlink dc/d1b/l56 0 2024-09-19T09:02:56.743 INFO:tasks.workunit.client.0.smithi049.stdout:1/277: chown d5/d6/f1b 28087 1 2024-09-19T09:02:56.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/512: link d1/d8/d19/f34 d1/d53/d18/d59/fb2 0 2024-09-19T09:02:56.750 INFO:tasks.workunit.client.0.smithi049.stdout:6/263: dread dc/d16/f18 [4194304,4194304] 0 2024-09-19T09:02:56.753 INFO:tasks.workunit.client.0.smithi049.stdout:3/420: creat d10/d3d/d79/d80/f8a x:0 0 0 2024-09-19T09:02:56.754 INFO:tasks.workunit.client.0.smithi049.stdout:3/421: dread - d10/d3d/f4a zero size 2024-09-19T09:02:56.754 INFO:tasks.workunit.client.0.smithi049.stdout:0/557: mkdir d5/d10/d2f/d6d/daa 0 2024-09-19T09:02:56.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/482: dwrite d1/f9 [0,4194304] 0 2024-09-19T09:02:56.766 INFO:tasks.workunit.client.0.smithi049.stdout:6/264: rmdir dc/d16 39 2024-09-19T09:02:56.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/513: dread d1/d1a/f21 [0,4194304] 0 2024-09-19T09:02:56.769 INFO:tasks.workunit.client.0.smithi049.stdout:7/514: fsync d1/d8/f1c 0 2024-09-19T09:02:56.770 INFO:tasks.workunit.client.0.smithi049.stdout:8/483: dread d1/d11/d3f/d5b/f69 [0,4194304] 0 2024-09-19T09:02:56.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/373: dread d1/f7 [0,4194304] 0 2024-09-19T09:02:56.772 INFO:tasks.workunit.client.0.smithi049.stdout:6/265: write dc/d12/f4d [944617,17471] 0 2024-09-19T09:02:56.773 INFO:tasks.workunit.client.0.smithi049.stdout:7/515: stat d1/d8/d2d/d36 0 2024-09-19T09:02:56.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/516: dread - d1/d8/d80/f86 zero size 2024-09-19T09:02:56.774 INFO:tasks.workunit.client.0.smithi049.stdout:2/374: write d1/d2/f54 [285321,109975] 0 2024-09-19T09:02:56.776 INFO:tasks.workunit.client.0.smithi049.stdout:7/517: fdatasync d1/d7/f14 0 2024-09-19T09:02:56.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/518: fsync d1/d53/f98 0 2024-09-19T09:02:56.778 INFO:tasks.workunit.client.0.smithi049.stdout:3/422: fdatasync d10/d11/d13/f14 0 2024-09-19T09:02:56.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/519: fsync d1/d8/d2d/f87 0 2024-09-19T09:02:56.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/278: creat d5/d6/d19/f61 x:0 0 0 2024-09-19T09:02:56.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/484: readlink d1/l3e 0 2024-09-19T09:02:56.791 INFO:tasks.workunit.client.0.smithi049.stdout:2/375: mkdir d1/d2b/d7c 0 2024-09-19T09:02:56.791 INFO:tasks.workunit.client.0.smithi049.stdout:1/279: dwrite d5/d6/dc/f56 [0,4194304] 0 2024-09-19T09:02:56.802 INFO:tasks.workunit.client.0.smithi049.stdout:6/266: link dc/d1b/f23 dc/d1b/f57 0 2024-09-19T09:02:56.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/376: rmdir d1/d2/d23 39 2024-09-19T09:02:56.810 INFO:tasks.workunit.client.0.smithi049.stdout:3/423: creat d10/d3d/d76/f8b x:0 0 0 2024-09-19T09:02:56.814 INFO:tasks.workunit.client.0.smithi049.stdout:8/485: getdents d1/d11/d2e/d4e/d82 0 2024-09-19T09:02:56.814 INFO:tasks.workunit.client.0.smithi049.stdout:7/520: write d1/d53/d18/d50/d58/d62/d6b/f81 [317095,95852] 0 2024-09-19T09:02:56.817 INFO:tasks.workunit.client.0.smithi049.stdout:6/267: mknod dc/d1b/c58 0 2024-09-19T09:02:56.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/268: dread dc/d1b/d20/d2f/f3f [0,4194304] 0 2024-09-19T09:02:56.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/377: rename d1/d2b/d38/d61 to d1/d2b/d38/d41/d7d 0 2024-09-19T09:02:56.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/486: dwrite d1/d11/d4f/d87/f6a [0,4194304] 0 2024-09-19T09:02:56.827 INFO:tasks.workunit.client.0.smithi049.stdout:3/424: dread d10/d11/d27/d4f/f7d [0,4194304] 0 2024-09-19T09:02:56.830 INFO:tasks.workunit.client.0.smithi049.stdout:2/378: dwrite d1/d4/f39 [0,4194304] 0 2024-09-19T09:02:56.839 INFO:tasks.workunit.client.0.smithi049.stdout:6/269: unlink dc/d1b/d20/d2f/f50 0 2024-09-19T09:02:56.839 INFO:tasks.workunit.client.0.smithi049.stdout:3/425: dread d10/d11/d27/f68 [0,4194304] 0 2024-09-19T09:02:56.841 INFO:tasks.workunit.client.0.smithi049.stdout:1/280: write d5/d6/d19/d21/f46 [2238257,53264] 0 2024-09-19T09:02:56.843 INFO:tasks.workunit.client.0.smithi049.stdout:7/521: truncate d1/d53/d18/d59/f48 2141826 0 2024-09-19T09:02:56.843 INFO:tasks.workunit.client.0.smithi049.stdout:8/487: mknod d1/d1a/d8b/c93 0 2024-09-19T09:02:56.846 INFO:tasks.workunit.client.0.smithi049.stdout:3/426: unlink d10/d11/d27/f71 0 2024-09-19T09:02:56.847 INFO:tasks.workunit.client.0.smithi049.stdout:1/281: rmdir d5/d6/d8/d13 39 2024-09-19T09:02:56.848 INFO:tasks.workunit.client.0.smithi049.stdout:2/379: symlink d1/d2/l7e 0 2024-09-19T09:02:56.852 INFO:tasks.workunit.client.0.smithi049.stdout:6/270: dwrite dc/d1b/d20/d2f/d31/f4f [0,4194304] 0 2024-09-19T09:02:56.854 INFO:tasks.workunit.client.0.smithi049.stdout:8/488: rename d1/d11/c43 to d1/d11/d4f/d87/d5d/d65/c94 0 2024-09-19T09:02:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:2/380: dread d1/f6a [0,4194304] 0 2024-09-19T09:02:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/427: dwrite d10/d11/d13/d30/f83 [0,4194304] 0 2024-09-19T09:02:56.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/282: dwrite d5/f26 [4194304,4194304] 0 2024-09-19T09:02:56.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/271: truncate dc/f19 3164942 0 2024-09-19T09:02:56.877 INFO:tasks.workunit.client.0.smithi049.stdout:7/522: dread d1/d8/fb [0,4194304] 0 2024-09-19T09:02:56.879 INFO:tasks.workunit.client.0.smithi049.stdout:7/523: readlink d1/d8/l60 0 2024-09-19T09:02:56.884 INFO:tasks.workunit.client.0.smithi049.stdout:2/381: creat d1/d4/d1e/d45/f7f x:0 0 0 2024-09-19T09:02:56.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/272: dread - dc/d1b/d20/d2f/f51 zero size 2024-09-19T09:02:56.885 INFO:tasks.workunit.client.0.smithi049.stdout:8/489: chown d1/d11/d4f/d87/d5d/d65/f6d 2436561 1 2024-09-19T09:02:56.896 INFO:tasks.workunit.client.0.smithi049.stdout:6/273: dwrite dc/d12/f15 [4194304,4194304] 0 2024-09-19T09:02:56.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/382: creat d1/d2/d23/f80 x:0 0 0 2024-09-19T09:02:56.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/383: stat d1/d2b/d38/d41/d7d/f63 0 2024-09-19T09:02:56.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/428: truncate fd 5089016 0 2024-09-19T09:02:56.901 INFO:tasks.workunit.client.0.smithi049.stdout:8/490: mknod d1/d11/d2e/d4e/c95 0 2024-09-19T09:02:56.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/524: link d1/d8/d2d/d31/f47 d1/d53/d18/d50/d7c/fb3 0 2024-09-19T09:02:56.907 INFO:tasks.workunit.client.0.smithi049.stdout:6/274: mknod dc/d1b/d20/d2f/d31/c59 0 2024-09-19T09:02:56.908 INFO:tasks.workunit.client.0.smithi049.stdout:2/384: creat d1/d4/d20/f81 x:0 0 0 2024-09-19T09:02:56.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/429: readlink d10/d11/l6f 0 2024-09-19T09:02:56.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/491: dwrite d1/d1a/f29 [0,4194304] 0 2024-09-19T09:02:56.911 INFO:tasks.workunit.client.0.smithi049.stdout:2/385: fsync d1/d4/d1e/d21/f52 0 2024-09-19T09:02:56.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/525: unlink d1/d53/la7 0 2024-09-19T09:02:56.914 INFO:tasks.workunit.client.0.smithi049.stdout:7/526: stat d1/d8/d89 0 2024-09-19T09:02:56.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/527: write d1/d8/d80/f86 [595069,24552] 0 2024-09-19T09:02:56.917 INFO:tasks.workunit.client.0.smithi049.stdout:3/430: rename d10/d3d/d46/f4c to d10/d3d/f8c 0 2024-09-19T09:02:56.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/275: dread f9 [0,4194304] 0 2024-09-19T09:02:56.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/492: truncate d1/d11/d3f/d5b/f67 366158 0 2024-09-19T09:02:56.922 INFO:tasks.workunit.client.0.smithi049.stdout:3/431: truncate d10/f34 2125535 0 2024-09-19T09:02:56.924 INFO:tasks.workunit.client.0.smithi049.stdout:6/276: rmdir dc/d12 39 2024-09-19T09:02:56.926 INFO:tasks.workunit.client.0.smithi049.stdout:3/432: rmdir d10/d11/d13 39 2024-09-19T09:02:56.931 INFO:tasks.workunit.client.0.smithi049.stdout:6/277: dwrite f3 [0,4194304] 0 2024-09-19T09:02:56.933 INFO:tasks.workunit.client.0.smithi049.stdout:2/386: dread d1/d2/d32/f3d [0,4194304] 0 2024-09-19T09:02:56.940 INFO:tasks.workunit.client.0.smithi049.stdout:6/278: readlink dc/l10 0 2024-09-19T09:02:56.942 INFO:tasks.workunit.client.0.smithi049.stdout:2/387: write d1/d2/d32/f3d [1320402,30635] 0 2024-09-19T09:02:56.945 INFO:tasks.workunit.client.0.smithi049.stdout:8/493: getdents d1/d11/d3f 0 2024-09-19T09:02:56.947 INFO:tasks.workunit.client.0.smithi049.stdout:7/528: dread d1/d8/f1c [0,4194304] 0 2024-09-19T09:02:56.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/279: unlink dc/d1b/d20/d2f/d31/f4f 0 2024-09-19T09:02:56.952 INFO:tasks.workunit.client.0.smithi049.stdout:7/529: dread d1/d8/d80/f86 [0,4194304] 0 2024-09-19T09:02:56.959 INFO:tasks.workunit.client.0.smithi049.stdout:3/433: write d10/f70 [2609970,128626] 0 2024-09-19T09:02:56.961 INFO:tasks.workunit.client.0.smithi049.stdout:2/388: mknod d1/d2/d70/c82 0 2024-09-19T09:02:56.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/280: read dc/d12/f29 [2178639,105981] 0 2024-09-19T09:02:56.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/281: truncate dc/d1b/f38 1026423 0 2024-09-19T09:02:56.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/290: sync 2024-09-19T09:02:56.968 INFO:tasks.workunit.client.0.smithi049.stdout:5/291: write d3/d5/d20/f59 [4607789,68503] 0 2024-09-19T09:02:56.974 INFO:tasks.workunit.client.0.smithi049.stdout:3/434: mknod d10/d3d/d79/d80/c8d 0 2024-09-19T09:02:56.974 INFO:tasks.workunit.client.0.smithi049.stdout:8/494: dwrite d1/d11/d3f/d5b/f69 [0,4194304] 0 2024-09-19T09:02:56.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/435: write d10/d11/d27/f43 [178031,12575] 0 2024-09-19T09:02:56.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/436: write d10/d11/d27/f65 [836629,83992] 0 2024-09-19T09:02:56.985 INFO:tasks.workunit.client.0.smithi049.stdout:2/389: link d1/d4/d1e/d45/f5c d1/d2/d32/f83 0 2024-09-19T09:02:56.988 INFO:tasks.workunit.client.0.smithi049.stdout:7/530: write d1/d53/d18/d50/d58/d62/d6b/f8c [2017857,69152] 0 2024-09-19T09:02:56.989 INFO:tasks.workunit.client.0.smithi049.stdout:6/282: mkdir dc/d12/d5a 0 2024-09-19T09:02:56.991 INFO:tasks.workunit.client.0.smithi049.stdout:8/495: rmdir d1/d11/d45 39 2024-09-19T09:02:56.993 INFO:tasks.workunit.client.0.smithi049.stdout:3/437: read d10/d11/d13/f14 [629398,74448] 0 2024-09-19T09:02:56.996 INFO:tasks.workunit.client.0.smithi049.stdout:7/531: creat d1/d8/d2d/d72/fb4 x:0 0 0 2024-09-19T09:02:56.996 INFO:tasks.workunit.client.0.smithi049.stdout:7/532: stat d1/f68 0 2024-09-19T09:02:56.996 INFO:tasks.workunit.client.0.smithi049.stdout:2/390: creat d1/d2/d23/d49/d75/f84 x:0 0 0 2024-09-19T09:02:57.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/283: truncate dc/f19 3175359 0 2024-09-19T09:02:57.002 INFO:tasks.workunit.client.0.smithi049.stdout:7/533: rename d1/d53/d18/d59/f33 to d1/d8/d2d/d36/d91/fb5 0 2024-09-19T09:02:57.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/534: dread - d1/fa9 zero size 2024-09-19T09:02:57.005 INFO:tasks.workunit.client.0.smithi049.stdout:2/391: dwrite d1/d4/d1e/d45/f6b [0,4194304] 0 2024-09-19T09:02:57.005 INFO:tasks.workunit.client.0.smithi049.stdout:8/496: chown d1/d11/d2e/d89 48 1 2024-09-19T09:02:57.006 INFO:tasks.workunit.client.0.smithi049.stdout:6/284: write dc/d12/f29 [599182,94017] 0 2024-09-19T09:02:57.006 INFO:tasks.workunit.client.0.smithi049.stdout:3/438: getdents d10/d3d/d79/d87 0 2024-09-19T09:02:57.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/535: chown d1/d1a/f77 123 1 2024-09-19T09:02:57.008 INFO:tasks.workunit.client.0.smithi049.stdout:7/536: write d1/d1a/f9f [1034724,60182] 0 2024-09-19T09:02:57.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/392: rmdir d1/d2/d70 39 2024-09-19T09:02:57.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/285: readlink dc/d16/l33 0 2024-09-19T09:02:57.014 INFO:tasks.workunit.client.0.smithi049.stdout:2/393: write d1/d2/d23/d49/d75/f84 [932157,54129] 0 2024-09-19T09:02:57.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/439: write d10/d11/d13/f14 [6088557,33159] 0 2024-09-19T09:02:57.026 INFO:tasks.workunit.client.0.smithi049.stdout:8/497: dread d1/f2d [0,4194304] 0 2024-09-19T09:02:57.026 INFO:tasks.workunit.client.0.smithi049.stdout:6/286: write dc/d1b/f23 [4617281,13374] 0 2024-09-19T09:02:57.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/287: chown dc/d1b/d20/d2f/d31 1355 1 2024-09-19T09:02:57.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/537: creat d1/d53/d18/fb6 x:0 0 0 2024-09-19T09:02:57.032 INFO:tasks.workunit.client.0.smithi049.stdout:7/538: dread - d1/d53/d18/d50/d58/d62/fac zero size 2024-09-19T09:02:57.033 INFO:tasks.workunit.client.0.smithi049.stdout:2/394: getdents d1/d4/d20/d26 0 2024-09-19T09:02:57.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/539: creat d1/d8/d2d/d36/fb7 x:0 0 0 2024-09-19T09:02:57.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/395: creat d1/d2b/d38/f85 x:0 0 0 2024-09-19T09:02:57.041 INFO:tasks.workunit.client.0.smithi049.stdout:7/540: symlink d1/d1a/lb8 0 2024-09-19T09:02:57.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/541: fsync d1/d7/f14 0 2024-09-19T09:02:57.045 INFO:tasks.workunit.client.0.smithi049.stdout:8/498: dread d1/d11/d4f/d87/f83 [0,4194304] 0 2024-09-19T09:02:57.048 INFO:tasks.workunit.client.0.smithi049.stdout:8/499: read d1/d11/d2e/d4e/f88 [4551,3886] 0 2024-09-19T09:02:57.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/396: dwrite d1/d2b/d38/f85 [0,4194304] 0 2024-09-19T09:02:57.050 INFO:tasks.workunit.client.0.smithi049.stdout:8/500: write d1/d27/f41 [332078,121372] 0 2024-09-19T09:02:57.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/397: creat d1/d4/d1e/d45/f86 x:0 0 0 2024-09-19T09:02:57.057 INFO:tasks.workunit.client.0.smithi049.stdout:8/501: creat d1/d11/f96 x:0 0 0 2024-09-19T09:02:57.059 INFO:tasks.workunit.client.0.smithi049.stdout:2/398: symlink d1/d4/d20/l87 0 2024-09-19T09:02:57.061 INFO:tasks.workunit.client.0.smithi049.stdout:7/542: dread d1/d53/d18/f43 [0,4194304] 0 2024-09-19T09:02:57.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/502: truncate d1/d11/d4f/d87/d5d/d65/f8a 1398267 0 2024-09-19T09:02:57.064 INFO:tasks.workunit.client.0.smithi049.stdout:7/543: symlink d1/d8/d80/lb9 0 2024-09-19T09:02:57.066 INFO:tasks.workunit.client.0.smithi049.stdout:8/503: symlink d1/d11/d4f/d87/l97 0 2024-09-19T09:02:57.068 INFO:tasks.workunit.client.0.smithi049.stdout:8/504: write d1/f77 [3508220,113427] 0 2024-09-19T09:02:57.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/544: creat d1/d53/d18/d50/d7c/d9c/fba x:0 0 0 2024-09-19T09:02:57.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/505: symlink d1/d1a/d8b/d8e/l98 0 2024-09-19T09:02:57.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/506: truncate d1/d11/f96 701119 0 2024-09-19T09:02:57.073 INFO:tasks.workunit.client.0.smithi049.stdout:8/507: fsync d1/d27/f41 0 2024-09-19T09:02:57.074 INFO:tasks.workunit.client.0.smithi049.stdout:8/508: write d1/d11/d4f/f66 [1469672,101956] 0 2024-09-19T09:02:57.082 INFO:tasks.workunit.client.0.smithi049.stdout:8/509: dwrite d1/f2d [0,4194304] 0 2024-09-19T09:02:57.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/510: chown d1/d11/d4f/f66 14 1 2024-09-19T09:02:57.084 INFO:tasks.workunit.client.0.smithi049.stdout:8/511: chown d1/d27/f68 42656 1 2024-09-19T09:02:57.093 INFO:tasks.workunit.client.0.smithi049.stdout:8/512: dwrite d1/d27/f41 [0,4194304] 0 2024-09-19T09:02:57.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/399: dread d1/d2/f13 [4194304,4194304] 0 2024-09-19T09:02:57.097 INFO:tasks.workunit.client.0.smithi049.stdout:7/545: dread d1/d7/fa [0,4194304] 0 2024-09-19T09:02:57.100 INFO:tasks.workunit.client.0.smithi049.stdout:7/546: fdatasync d1/d53/f5d 0 2024-09-19T09:02:57.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/513: dwrite d1/d27/f4b [0,4194304] 0 2024-09-19T09:02:57.109 INFO:tasks.workunit.client.0.smithi049.stdout:2/400: creat d1/d2/f88 x:0 0 0 2024-09-19T09:02:57.109 INFO:tasks.workunit.client.0.smithi049.stdout:7/547: creat d1/d1a/da0/fbb x:0 0 0 2024-09-19T09:02:57.113 INFO:tasks.workunit.client.0.smithi049.stdout:7/548: write d1/d8/d2d/d31/f7f [907127,73028] 0 2024-09-19T09:02:57.119 INFO:tasks.workunit.client.0.smithi049.stdout:7/549: symlink d1/d53/d18/d50/d58/d62/d6b/lbc 0 2024-09-19T09:02:57.121 INFO:tasks.workunit.client.0.smithi049.stdout:2/401: dwrite d1/d4/d1e/d21/f22 [0,4194304] 0 2024-09-19T09:02:57.123 INFO:tasks.workunit.client.0.smithi049.stdout:2/402: fsync d1/d4/d1e/d45/f6b 0 2024-09-19T09:02:57.136 INFO:tasks.workunit.client.0.smithi049.stdout:2/403: rename d1/d2/c5b to d1/d4/d1e/d21/c89 0 2024-09-19T09:02:57.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/514: dread d1/d11/d4f/d87/d5d/d65/f7e [0,4194304] 0 2024-09-19T09:02:57.138 INFO:tasks.workunit.client.0.smithi049.stdout:2/404: truncate d1/d4/d1e/d45/f86 833584 0 2024-09-19T09:02:57.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/550: getdents d1/d8/d2d/d36/d91 0 2024-09-19T09:02:57.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/453: sync 2024-09-19T09:02:57.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/405: rename d1/d4/d1e/d45/f6b to d1/d4/d20/d26/f8a 0 2024-09-19T09:02:57.145 INFO:tasks.workunit.client.0.smithi049.stdout:7/551: creat d1/d53/d18/d50/d7c/fbd x:0 0 0 2024-09-19T09:02:57.148 INFO:tasks.workunit.client.0.smithi049.stdout:2/406: unlink d1/d4/f51 0 2024-09-19T09:02:57.149 INFO:tasks.workunit.client.0.smithi049.stdout:9/454: creat d3/d14/d34/d74/f99 x:0 0 0 2024-09-19T09:02:57.156 INFO:tasks.workunit.client.0.smithi049.stdout:9/455: creat d3/d14/d34/d44/f9a x:0 0 0 2024-09-19T09:02:57.158 INFO:tasks.workunit.client.0.smithi049.stdout:7/552: dwrite d1/fa9 [0,4194304] 0 2024-09-19T09:02:57.160 INFO:tasks.workunit.client.0.smithi049.stdout:2/407: mknod d1/d2b/d7c/c8b 0 2024-09-19T09:02:57.164 INFO:tasks.workunit.client.0.smithi049.stdout:2/408: write d1/d2/d23/f2c [8750191,93423] 0 2024-09-19T09:02:57.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/456: dwrite d3/d14/d34/f95 [0,4194304] 0 2024-09-19T09:02:57.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/457: write d3/d14/d1a/d21/d31/d8e/f3e [2675902,33156] 0 2024-09-19T09:02:57.177 INFO:tasks.workunit.client.0.smithi049.stdout:2/409: dwrite d1/d2/d32/f3d [0,4194304] 0 2024-09-19T09:02:57.181 INFO:tasks.workunit.client.0.smithi049.stdout:8/515: dwrite d1/f23 [0,4194304] 0 2024-09-19T09:02:57.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/410: chown d1/d2/d23/d49/d75/f84 4795 1 2024-09-19T09:02:57.182 INFO:tasks.workunit.client.0.smithi049.stdout:2/411: dread - d1/d4/d20/f81 zero size 2024-09-19T09:02:57.186 INFO:tasks.workunit.client.0.smithi049.stdout:2/412: write f0 [5227417,67301] 0 2024-09-19T09:02:57.186 INFO:tasks.workunit.client.0.smithi049.stdout:8/516: rmdir d1/d11/d2e 39 2024-09-19T09:02:57.189 INFO:tasks.workunit.client.0.smithi049.stdout:2/413: mkdir d1/d4/d1e/d21/d8c 0 2024-09-19T09:02:57.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/458: rmdir d3/d14/d34/d44 39 2024-09-19T09:02:57.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/414: chown d1/d4/d20/l87 20 1 2024-09-19T09:02:57.193 INFO:tasks.workunit.client.0.smithi049.stdout:9/459: fdatasync d3/d14/d1a/d21/d31/f60 0 2024-09-19T09:02:57.195 INFO:tasks.workunit.client.0.smithi049.stdout:2/415: symlink d1/d2/d32/l8d 0 2024-09-19T09:02:57.195 INFO:tasks.workunit.client.0.smithi049.stdout:9/460: dread - d3/d14/d1a/d21/d31/d8e/d6f/f7e zero size 2024-09-19T09:02:57.198 INFO:tasks.workunit.client.0.smithi049.stdout:9/461: write d3/d14/d1a/d21/d31/d8e/f3e [4874680,49119] 0 2024-09-19T09:02:57.201 INFO:tasks.workunit.client.0.smithi049.stdout:9/462: mkdir d3/d9b 0 2024-09-19T09:02:57.203 INFO:tasks.workunit.client.0.smithi049.stdout:2/416: dwrite d1/d2/d32/f64 [0,4194304] 0 2024-09-19T09:02:57.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/463: mkdir d3/d14/d34/d4c/d9c 0 2024-09-19T09:02:57.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/417: link d1/d2b/d38/f85 d1/d4/d1e/d21/d8c/f8e 0 2024-09-19T09:02:57.213 INFO:tasks.workunit.client.0.smithi049.stdout:2/418: dread - d1/d2/f88 zero size 2024-09-19T09:02:57.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/419: creat d1/d2/d23/f8f x:0 0 0 2024-09-19T09:02:57.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/420: fsync d1/f7 0 2024-09-19T09:02:57.216 INFO:tasks.workunit.client.0.smithi049.stdout:9/464: rename d3/d14/d1a/d21/d31/d8e/l5c to d3/d14/d34/l9d 0 2024-09-19T09:02:57.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/421: chown d1/d4/d1e/d21/d8c 6 1 2024-09-19T09:02:57.217 INFO:tasks.workunit.client.0.smithi049.stdout:9/465: chown d3/d14/d1a/f35 11203 1 2024-09-19T09:02:57.217 INFO:tasks.workunit.client.0.smithi049.stdout:2/422: write d1/d4/d1e/d21/f52 [53215,61761] 0 2024-09-19T09:02:57.257 INFO:tasks.workunit.client.0.smithi049.stdout:2/423: getdents d1/d2/d32 0 2024-09-19T09:02:57.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:56 smithi102 ceph-mon[35280]: pgmap v35: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 182 MiB/s wr, 373 op/s 2024-09-19T09:02:57.259 INFO:tasks.workunit.client.0.smithi049.stdout:2/424: chown d1/d4/d1e/d21 131160 1 2024-09-19T09:02:57.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/466: dwrite d3/d14/d1a/d21/f77 [0,4194304] 0 2024-09-19T09:02:57.261 INFO:tasks.workunit.client.0.smithi049.stdout:2/425: chown d1/d2d/f37 272327 1 2024-09-19T09:02:57.262 INFO:tasks.workunit.client.0.smithi049.stdout:2/426: write d1/d2/f67 [174788,106083] 0 2024-09-19T09:02:57.267 INFO:tasks.workunit.client.0.smithi049.stdout:2/427: mknod d1/d4/d20/c90 0 2024-09-19T09:02:57.271 INFO:tasks.workunit.client.0.smithi049.stdout:9/467: mkdir d3/d9b/d9e 0 2024-09-19T09:02:57.272 INFO:tasks.workunit.client.0.smithi049.stdout:2/428: unlink d1/d2/l60 0 2024-09-19T09:02:57.275 INFO:tasks.workunit.client.0.smithi049.stdout:2/429: mknod d1/d2/d23/d49/c91 0 2024-09-19T09:02:57.276 INFO:tasks.workunit.client.0.smithi049.stdout:2/430: chown d1/d2b/d7c 0 1 2024-09-19T09:02:57.281 INFO:tasks.workunit.client.0.smithi049.stdout:9/468: rename d3/d14/d1a/d21/d31/d8e/d6f to d3/d14/d34/d9f 0 2024-09-19T09:02:57.283 INFO:tasks.workunit.client.0.smithi049.stdout:2/431: dwrite d1/d4/d20/f81 [0,4194304] 0 2024-09-19T09:02:57.284 INFO:tasks.workunit.client.0.smithi049.stdout:9/469: write d3/d14/d1a/f80 [31707,18891] 0 2024-09-19T09:02:57.286 INFO:tasks.workunit.client.0.smithi049.stdout:9/470: truncate d3/d14/d34/d74/f99 563793 0 2024-09-19T09:02:57.290 INFO:tasks.workunit.client.0.smithi049.stdout:2/432: mkdir d1/d4/d20/d92 0 2024-09-19T09:02:57.292 INFO:tasks.workunit.client.0.smithi049.stdout:9/471: mknod d3/d14/d1a/ca0 0 2024-09-19T09:02:57.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/433: dwrite d1/d2/d23/f80 [0,4194304] 0 2024-09-19T09:02:57.299 INFO:tasks.workunit.client.0.smithi049.stdout:2/434: fdatasync d1/d2/d32/f64 0 2024-09-19T09:02:57.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:56 smithi049 ceph-mon[28158]: pgmap v35: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 182 MiB/s wr, 373 op/s 2024-09-19T09:02:57.305 INFO:tasks.workunit.client.0.smithi049.stdout:9/472: unlink d3/l9 0 2024-09-19T09:02:57.305 INFO:tasks.workunit.client.0.smithi049.stdout:2/435: dread d1/d4/d1e/d45/f48 [4194304,4194304] 0 2024-09-19T09:02:57.307 INFO:tasks.workunit.client.0.smithi049.stdout:2/436: truncate d1/d2/f67 1089867 0 2024-09-19T09:02:57.313 INFO:tasks.workunit.client.0.smithi049.stdout:9/473: rename d3/d14/d34/c4e to d3/d14/d1a/d21/ca1 0 2024-09-19T09:02:57.316 INFO:tasks.workunit.client.0.smithi049.stdout:2/437: creat d1/d2b/d38/f93 x:0 0 0 2024-09-19T09:02:57.321 INFO:tasks.workunit.client.0.smithi049.stdout:2/438: creat d1/d2/d32/f94 x:0 0 0 2024-09-19T09:02:57.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/474: mknod d3/d14/d34/ca2 0 2024-09-19T09:02:57.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/439: dread d1/f6a [0,4194304] 0 2024-09-19T09:02:57.336 INFO:tasks.workunit.client.0.smithi049.stdout:2/440: truncate d1/d2/d23/f80 641145 0 2024-09-19T09:02:57.337 INFO:tasks.workunit.client.0.smithi049.stdout:2/441: readlink d1/d4/d20/l31 0 2024-09-19T09:02:57.339 INFO:tasks.workunit.client.0.smithi049.stdout:9/475: creat d3/fa3 x:0 0 0 2024-09-19T09:02:57.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/442: creat d1/d4/d20/f95 x:0 0 0 2024-09-19T09:02:57.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/443: chown d1/d4/d1e/d21/c40 650115 1 2024-09-19T09:02:57.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/476: fdatasync d3/d14/d1a/d21/f2f 0 2024-09-19T09:02:57.344 INFO:tasks.workunit.client.0.smithi049.stdout:2/444: symlink d1/d2/d23/d49/d75/l96 0 2024-09-19T09:02:57.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/445: write d1/d4/d1e/d21/f52 [990671,58831] 0 2024-09-19T09:02:57.349 INFO:tasks.workunit.client.0.smithi049.stdout:9/477: dread d3/d14/d1a/f61 [0,4194304] 0 2024-09-19T09:02:57.353 INFO:tasks.workunit.client.0.smithi049.stdout:9/478: dread d3/d14/d34/f95 [0,4194304] 0 2024-09-19T09:02:57.360 INFO:tasks.workunit.client.0.smithi049.stdout:2/446: dread d1/d2b/d38/f5d [0,4194304] 0 2024-09-19T09:02:57.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/479: creat d3/d14/d34/fa4 x:0 0 0 2024-09-19T09:02:57.364 INFO:tasks.workunit.client.0.smithi049.stdout:2/447: creat d1/d2b/d38/d41/d7d/f97 x:0 0 0 2024-09-19T09:02:57.379 INFO:tasks.workunit.client.0.smithi049.stdout:9/480: dread d3/d14/d1a/f35 [0,4194304] 0 2024-09-19T09:02:57.381 INFO:tasks.workunit.client.0.smithi049.stdout:9/481: read d3/d14/f3f [6645498,65468] 0 2024-09-19T09:02:57.388 INFO:tasks.workunit.client.0.smithi049.stdout:9/482: truncate d3/f28 407443 0 2024-09-19T09:02:57.391 INFO:tasks.workunit.client.0.smithi049.stdout:9/483: symlink d3/d9b/d9e/la5 0 2024-09-19T09:02:57.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/448: write d1/d4/d20/f1c [1207623,93562] 0 2024-09-19T09:02:57.394 INFO:tasks.workunit.client.0.smithi049.stdout:9/484: creat d3/d14/d1a/d90/fa6 x:0 0 0 2024-09-19T09:02:57.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/449: rmdir d1/d2b/d38/d41 39 2024-09-19T09:02:57.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/485: mknod d3/d14/d1a/d21/d67/d94/ca7 0 2024-09-19T09:02:57.399 INFO:tasks.workunit.client.0.smithi049.stdout:9/486: chown d3/d14/d34/d9f/f81 0 1 2024-09-19T09:02:57.400 INFO:tasks.workunit.client.0.smithi049.stdout:2/450: dread d1/d2/d23/d49/d75/f84 [0,4194304] 0 2024-09-19T09:02:57.403 INFO:tasks.workunit.client.0.smithi049.stdout:2/451: readlink d1/d4/d1e/d21/l69 0 2024-09-19T09:02:57.406 INFO:tasks.workunit.client.0.smithi049.stdout:9/487: dwrite d3/f1f [0,4194304] 0 2024-09-19T09:02:57.406 INFO:tasks.workunit.client.0.smithi049.stdout:2/452: creat d1/d4/d1e/d21/f98 x:0 0 0 2024-09-19T09:02:57.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/453: symlink d1/d2/d6c/l99 0 2024-09-19T09:02:57.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/454: stat d1/d2 0 2024-09-19T09:02:57.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/488: rmdir d3/d14/d1a 39 2024-09-19T09:02:57.423 INFO:tasks.workunit.client.0.smithi049.stdout:2/455: creat d1/d2/d70/f9a x:0 0 0 2024-09-19T09:02:57.425 INFO:tasks.workunit.client.0.smithi049.stdout:9/489: symlink d3/d14/d1a/d21/d31/d8e/la8 0 2024-09-19T09:02:57.428 INFO:tasks.workunit.client.0.smithi049.stdout:9/490: rename d3/d14/f42 to d3/d14/d1a/d21/d31/fa9 0 2024-09-19T09:02:57.429 INFO:tasks.workunit.client.0.smithi049.stdout:2/456: creat d1/f9b x:0 0 0 2024-09-19T09:02:57.432 INFO:tasks.workunit.client.0.smithi049.stdout:9/491: creat d3/d14/faa x:0 0 0 2024-09-19T09:02:57.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/457: rename d1/d2/f13 to d1/f9c 0 2024-09-19T09:02:57.435 INFO:tasks.workunit.client.0.smithi049.stdout:9/492: unlink d3/d14/d1a/d21/c63 0 2024-09-19T09:02:57.436 INFO:tasks.workunit.client.0.smithi049.stdout:9/493: dread - d3/d14/d1a/d90/fa6 zero size 2024-09-19T09:02:57.437 INFO:tasks.workunit.client.0.smithi049.stdout:2/458: dread d1/d2/f24 [0,4194304] 0 2024-09-19T09:02:57.443 INFO:tasks.workunit.client.0.smithi049.stdout:9/494: creat d3/d14/d1a/d21/d31/d8e/fab x:0 0 0 2024-09-19T09:02:57.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/495: truncate d3/d14/d34/d74/f99 1384287 0 2024-09-19T09:02:57.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/496: symlink d3/d9b/lac 0 2024-09-19T09:02:57.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/497: creat d3/d14/d1a/d21/fad x:0 0 0 2024-09-19T09:02:57.456 INFO:tasks.workunit.client.0.smithi049.stdout:9/498: fsync d3/d14/faa 0 2024-09-19T09:02:57.457 INFO:tasks.workunit.client.0.smithi049.stdout:9/499: fsync d3/d14/d1a/d90/f71 0 2024-09-19T09:02:57.460 INFO:tasks.workunit.client.0.smithi049.stdout:2/459: truncate d1/f11 10856098 0 2024-09-19T09:02:57.462 INFO:tasks.workunit.client.0.smithi049.stdout:9/500: mkdir d3/d14/d1a/d90/dae 0 2024-09-19T09:02:57.462 INFO:tasks.workunit.client.0.smithi049.stdout:2/460: read d1/d2d/f37 [1513445,114762] 0 2024-09-19T09:02:57.465 INFO:tasks.workunit.client.0.smithi049.stdout:9/501: mkdir d3/d14/d1a/d21/d67/daf 0 2024-09-19T09:02:57.466 INFO:tasks.workunit.client.0.smithi049.stdout:2/461: symlink d1/d4/d1e/l9d 0 2024-09-19T09:02:57.467 INFO:tasks.workunit.client.0.smithi049.stdout:2/462: read - d1/d4/d20/f95 zero size 2024-09-19T09:02:57.470 INFO:tasks.workunit.client.0.smithi049.stdout:9/502: unlink d3/d14/d34/fa4 0 2024-09-19T09:02:57.470 INFO:tasks.workunit.client.0.smithi049.stdout:9/503: truncate d3/d14/faa 382030 0 2024-09-19T09:02:57.472 INFO:tasks.workunit.client.0.smithi049.stdout:9/504: fsync d3/d14/d1a/d21/d66/f7b 0 2024-09-19T09:02:57.473 INFO:tasks.workunit.client.0.smithi049.stdout:2/463: dread d1/d4/f2a [0,4194304] 0 2024-09-19T09:02:57.480 INFO:tasks.workunit.client.0.smithi049.stdout:2/464: rename d1/d2b/c3e to d1/d2b/d38/d41/d7d/c9e 0 2024-09-19T09:02:57.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/505: dwrite d3/d14/d1a/d21/d66/f8f [0,4194304] 0 2024-09-19T09:02:57.500 INFO:tasks.workunit.client.0.smithi049.stdout:2/465: getdents d1/d2b/d38/d41/d7d 0 2024-09-19T09:02:57.504 INFO:tasks.workunit.client.0.smithi049.stdout:2/466: unlink d1/d4/d1e/f66 0 2024-09-19T09:02:57.508 INFO:tasks.workunit.client.0.smithi049.stdout:2/467: mkdir d1/d4/d1e/d9f 0 2024-09-19T09:02:57.510 INFO:tasks.workunit.client.0.smithi049.stdout:9/506: dwrite d3/d14/d34/d9f/f81 [0,4194304] 0 2024-09-19T09:02:57.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/468: readlink d1/d4/d20/l31 0 2024-09-19T09:02:57.514 INFO:tasks.workunit.client.0.smithi049.stdout:2/469: creat d1/d2/d6c/fa0 x:0 0 0 2024-09-19T09:02:57.517 INFO:tasks.workunit.client.0.smithi049.stdout:9/507: rename d3/d14/d1a/d21/d31/f60 to d3/d9b/d9e/fb0 0 2024-09-19T09:02:57.518 INFO:tasks.workunit.client.0.smithi049.stdout:9/508: stat d3/d14/d34/d9f/f7e 0 2024-09-19T09:02:57.519 INFO:tasks.workunit.client.0.smithi049.stdout:9/509: stat d3/d14/l6e 0 2024-09-19T09:02:57.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/470: link d1/d2/d23/f8f d1/d2/d70/fa1 0 2024-09-19T09:02:57.524 INFO:tasks.workunit.client.0.smithi049.stdout:9/510: rename d3/d14/d1a/d21/d66/d69 to d3/d14/d34/d9f/d82/db1 0 2024-09-19T09:02:57.526 INFO:tasks.workunit.client.0.smithi049.stdout:2/471: symlink d1/d4/d1e/d21/d8c/la2 0 2024-09-19T09:02:57.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/511: symlink d3/d14/d34/d9f/lb2 0 2024-09-19T09:02:57.528 INFO:tasks.workunit.client.0.smithi049.stdout:2/472: write d1/d2/d23/f2c [9272074,128046] 0 2024-09-19T09:02:57.529 INFO:tasks.workunit.client.0.smithi049.stdout:9/512: readlink d3/d14/d34/d4c/l59 0 2024-09-19T09:02:57.533 INFO:tasks.workunit.client.0.smithi049.stdout:9/513: creat d3/d14/d1a/fb3 x:0 0 0 2024-09-19T09:02:57.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/514: chown d3/d9b/d9e/fb0 998069606 1 2024-09-19T09:02:57.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/473: rename d1/d2b/d7c/c8b to d1/d2b/d38/d41/ca3 0 2024-09-19T09:02:57.540 INFO:tasks.workunit.client.0.smithi049.stdout:9/515: write d3/fa3 [995,101137] 0 2024-09-19T09:02:57.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/516: truncate d3/d14/d1a/f7d 1458860 0 2024-09-19T09:02:57.566 INFO:tasks.workunit.client.0.smithi049.stdout:9/517: dread d3/d14/d1a/d21/d67/d94/f79 [0,4194304] 0 2024-09-19T09:02:57.574 INFO:tasks.workunit.client.0.smithi049.stdout:9/518: dwrite d3/d14/d34/f88 [0,4194304] 0 2024-09-19T09:02:57.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/519: chown d3/d14/d34/d44/l47 281901011 1 2024-09-19T09:02:57.587 INFO:tasks.workunit.client.0.smithi049.stdout:9/520: creat d3/d14/d34/d4c/fb4 x:0 0 0 2024-09-19T09:02:57.594 INFO:tasks.workunit.client.0.smithi049.stdout:9/521: link d3/d14/d1a/d21/f77 d3/d14/d1a/d21/fb5 0 2024-09-19T09:02:57.595 INFO:tasks.workunit.client.0.smithi049.stdout:9/522: chown d3/d14/d1a/f35 65079 1 2024-09-19T09:02:57.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/474: truncate d1/d2/d32/f3d 3719593 0 2024-09-19T09:02:57.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/475: rmdir d1/d4/d1e/d21/d8c 39 2024-09-19T09:02:57.622 INFO:tasks.workunit.client.0.smithi049.stdout:9/523: dwrite d3/d14/d1a/d21/f41 [0,4194304] 0 2024-09-19T09:02:57.627 INFO:tasks.workunit.client.0.smithi049.stdout:9/524: creat d3/d14/d1a/d21/d31/fb6 x:0 0 0 2024-09-19T09:02:57.630 INFO:tasks.workunit.client.0.smithi049.stdout:2/476: dread d1/d4/d1e/d45/f6d [0,4194304] 0 2024-09-19T09:02:57.633 INFO:tasks.workunit.client.0.smithi049.stdout:2/477: write d1/d2b/d38/d41/d7d/f63 [851636,107262] 0 2024-09-19T09:02:57.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/478: read d1/d4/d1e/d45/f5c [1855716,109325] 0 2024-09-19T09:02:57.636 INFO:tasks.workunit.client.0.smithi049.stdout:2/479: write d1/d2/d70/f9a [10932,101146] 0 2024-09-19T09:02:57.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/525: rename d3/d14/d1a/d21/d31/fa9 to d3/d14/d1a/d21/fb7 0 2024-09-19T09:02:57.638 INFO:tasks.workunit.client.0.smithi049.stdout:2/480: write d1/d2/f88 [28440,21384] 0 2024-09-19T09:02:57.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/526: mkdir d3/d14/d1a/d21/d73/db8 0 2024-09-19T09:02:57.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/481: dread d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:57.647 INFO:tasks.workunit.client.0.smithi049.stdout:2/482: write d1/d4/d1e/f76 [362478,39763] 0 2024-09-19T09:02:57.649 INFO:tasks.workunit.client.0.smithi049.stdout:2/483: stat d1/d2/d23/d49/d75/l96 0 2024-09-19T09:02:57.649 INFO:tasks.workunit.client.0.smithi049.stdout:9/527: mknod d3/d14/d1a/d21/d73/cb9 0 2024-09-19T09:02:57.651 INFO:tasks.workunit.client.0.smithi049.stdout:2/484: write d1/d4/d1e/d45/f86 [227491,6791] 0 2024-09-19T09:02:57.652 INFO:tasks.workunit.client.0.smithi049.stdout:2/485: write d1/d4/d20/f95 [836543,11575] 0 2024-09-19T09:02:57.660 INFO:tasks.workunit.client.0.smithi049.stdout:2/486: dread d1/d4/d1e/d21/d8c/f8e [0,4194304] 0 2024-09-19T09:02:57.661 INFO:tasks.workunit.client.0.smithi049.stdout:2/487: stat d1/d2/d23/d49/d75/l96 0 2024-09-19T09:02:57.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/528: dread d3/d14/f1e [0,4194304] 0 2024-09-19T09:02:57.669 INFO:tasks.workunit.client.0.smithi049.stdout:2/488: dwrite d1/d2/d32/f83 [0,4194304] 0 2024-09-19T09:02:57.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/529: rename d3/d14/d34/f37 to d3/d14/d1a/d21/d31/fba 0 2024-09-19T09:02:57.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/530: mkdir d3/dbb 0 2024-09-19T09:02:57.678 INFO:tasks.workunit.client.0.smithi049.stdout:9/531: chown d3/d14/d1a/d21/d67/d94/f7c 10137 1 2024-09-19T09:02:57.678 INFO:tasks.workunit.client.0.smithi049.stdout:9/532: stat d3/d14/l6e 0 2024-09-19T09:02:57.748 INFO:tasks.workunit.client.0.smithi049.stdout:0/558: sync 2024-09-19T09:02:57.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/344: sync 2024-09-19T09:02:57.793 INFO:tasks.workunit.client.0.smithi049.stdout:4/345: readlink d4/l36 0 2024-09-19T09:02:57.796 INFO:tasks.workunit.client.0.smithi049.stdout:2/489: dwrite d1/d2b/f1b [0,4194304] 0 2024-09-19T09:02:57.797 INFO:tasks.workunit.client.0.smithi049.stdout:4/346: creat d4/d34/f6f x:0 0 0 2024-09-19T09:02:57.798 INFO:tasks.workunit.client.0.smithi049.stdout:2/490: fsync d1/d4/f39 0 2024-09-19T09:02:57.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/491: dread d1/d2b/f1b [0,4194304] 0 2024-09-19T09:02:57.814 INFO:tasks.workunit.client.0.smithi049.stdout:2/492: getdents d1/d4 0 2024-09-19T09:02:57.814 INFO:tasks.workunit.client.0.smithi049.stdout:9/533: truncate d3/d14/d34/d9f/f76 243432 0 2024-09-19T09:02:57.814 INFO:tasks.workunit.client.0.smithi049.stdout:0/559: dwrite d5/d10/d13/d15/f43 [0,4194304] 0 2024-09-19T09:02:57.818 INFO:tasks.workunit.client.0.smithi049.stdout:2/493: creat d1/d2d/fa4 x:0 0 0 2024-09-19T09:02:57.824 INFO:tasks.workunit.client.0.smithi049.stdout:2/494: unlink d1/d2b/c6f 0 2024-09-19T09:02:57.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/560: mkdir d5/dab 0 2024-09-19T09:02:57.827 INFO:tasks.workunit.client.0.smithi049.stdout:9/534: dwrite d3/d14/d1a/f7d [0,4194304] 0 2024-09-19T09:02:57.830 INFO:tasks.workunit.client.0.smithi049.stdout:4/347: dwrite d4/f1e [0,4194304] 0 2024-09-19T09:02:57.840 INFO:tasks.workunit.client.0.smithi049.stdout:9/535: unlink d3/d14/d1a/ca0 0 2024-09-19T09:02:57.843 INFO:tasks.workunit.client.0.smithi049.stdout:0/561: dwrite d5/d10/d13/d15/f1e [4194304,4194304] 0 2024-09-19T09:02:57.847 INFO:tasks.workunit.client.0.smithi049.stdout:4/348: truncate d4/d45/f6b 513121 0 2024-09-19T09:02:57.850 INFO:tasks.workunit.client.0.smithi049.stdout:2/495: write d1/d2/f24 [3445160,797] 0 2024-09-19T09:02:57.851 INFO:tasks.workunit.client.0.smithi049.stdout:9/536: symlink d3/d14/lbc 0 2024-09-19T09:02:57.853 INFO:tasks.workunit.client.0.smithi049.stdout:4/349: mkdir d4/d34/d3d/d4f/d70 0 2024-09-19T09:02:57.854 INFO:tasks.workunit.client.0.smithi049.stdout:4/350: chown d4/d15/f20 9032 1 2024-09-19T09:02:57.857 INFO:tasks.workunit.client.0.smithi049.stdout:9/537: rename d3/f1f to d3/d14/d34/d4c/d9c/fbd 0 2024-09-19T09:02:57.862 INFO:tasks.workunit.client.0.smithi049.stdout:9/538: dread d3/d14/d1a/d21/fb5 [0,4194304] 0 2024-09-19T09:02:57.873 INFO:tasks.workunit.client.0.smithi049.stdout:2/496: write d1/d4/f2a [508892,119497] 0 2024-09-19T09:02:57.874 INFO:tasks.workunit.client.0.smithi049.stdout:0/562: truncate d5/d10/d13/d15/d36/f41 2419381 0 2024-09-19T09:02:57.875 INFO:tasks.workunit.client.0.smithi049.stdout:0/563: readlink d5/d10/d3c/l5a 0 2024-09-19T09:02:57.878 INFO:tasks.workunit.client.0.smithi049.stdout:9/539: getdents d3/d14/d34 0 2024-09-19T09:02:57.879 INFO:tasks.workunit.client.0.smithi049.stdout:2/497: dwrite d1/d2b/d38/d41/d7d/f63 [0,4194304] 0 2024-09-19T09:02:57.883 INFO:tasks.workunit.client.0.smithi049.stdout:9/540: unlink d3/d14/d1a/d21/d67/d94/ca7 0 2024-09-19T09:02:57.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/351: write d4/d15/d19/d1f/f67 [714788,35476] 0 2024-09-19T09:02:57.885 INFO:tasks.workunit.client.0.smithi049.stdout:2/498: mkdir d1/d2/d23/d49/d75/da5 0 2024-09-19T09:02:57.889 INFO:tasks.workunit.client.0.smithi049.stdout:4/352: readlink d4/lf 0 2024-09-19T09:02:57.889 INFO:tasks.workunit.client.0.smithi049.stdout:0/564: link d5/d10/d13/d30/c56 d5/d10/d13/d69/cac 0 2024-09-19T09:02:57.891 INFO:tasks.workunit.client.0.smithi049.stdout:2/499: creat d1/d2b/d38/d41/fa6 x:0 0 0 2024-09-19T09:02:57.893 INFO:tasks.workunit.client.0.smithi049.stdout:2/500: dread d1/d2/d70/f9a [0,4194304] 0 2024-09-19T09:02:57.894 INFO:tasks.workunit.client.0.smithi049.stdout:2/501: write d1/d4/f39 [1597639,100164] 0 2024-09-19T09:02:57.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/541: getdents d3/d14/d34/d9f 0 2024-09-19T09:02:57.898 INFO:tasks.workunit.client.0.smithi049.stdout:9/542: chown d3/d14/d1a/f25 425 1 2024-09-19T09:02:57.907 INFO:tasks.workunit.client.0.smithi049.stdout:2/502: creat d1/d2b/d38/d41/fa7 x:0 0 0 2024-09-19T09:02:57.907 INFO:tasks.workunit.client.0.smithi049.stdout:2/503: fdatasync d1/d2/d23/f2c 0 2024-09-19T09:02:57.908 INFO:tasks.workunit.client.0.smithi049.stdout:2/504: read d1/f6a [3783109,88863] 0 2024-09-19T09:02:57.908 INFO:tasks.workunit.client.0.smithi049.stdout:2/505: chown d1/d4/d1e/d9f 50540006 1 2024-09-19T09:02:57.909 INFO:tasks.workunit.client.0.smithi049.stdout:9/543: rename d3/d14/d1a/d21/d67/daf to d3/d9b/d9e/dbe 0 2024-09-19T09:02:57.914 INFO:tasks.workunit.client.0.smithi049.stdout:1/283: sync 2024-09-19T09:02:57.915 INFO:tasks.workunit.client.0.smithi049.stdout:1/284: write d5/d6/d19/f42 [2978155,118983] 0 2024-09-19T09:02:57.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/565: dwrite d5/d10/d13/d15/d36/d3d/d7f/f8b [0,4194304] 0 2024-09-19T09:02:57.922 INFO:tasks.workunit.client.0.smithi049.stdout:4/353: truncate d4/d45/f6b 631876 0 2024-09-19T09:02:57.924 INFO:tasks.workunit.client.0.smithi049.stdout:1/285: truncate d5/d6/fa 3012108 0 2024-09-19T09:02:57.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/506: link d1/d2b/f1b d1/d4/d1e/d21/fa8 0 2024-09-19T09:02:57.927 INFO:tasks.workunit.client.0.smithi049.stdout:2/507: truncate d1/d4/d1e/f72 199896 0 2024-09-19T09:02:57.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/354: creat d4/d15/d19/d1f/f71 x:0 0 0 2024-09-19T09:02:57.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/508: fdatasync d1/d4/d1e/f28 0 2024-09-19T09:02:57.930 INFO:tasks.workunit.client.0.smithi049.stdout:1/286: unlink d5/d6/d19/d21/c28 0 2024-09-19T09:02:57.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/509: chown d1/d2d/c73 12 1 2024-09-19T09:02:57.938 INFO:tasks.workunit.client.0.smithi049.stdout:9/544: rmdir d3/d9b/d9e/dbe 0 2024-09-19T09:02:57.942 INFO:tasks.workunit.client.0.smithi049.stdout:2/510: symlink d1/la9 0 2024-09-19T09:02:57.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/355: dread d4/d15/f61 [0,4194304] 0 2024-09-19T09:02:57.946 INFO:tasks.workunit.client.0.smithi049.stdout:9/545: dwrite d3/d14/d1a/d21/d66/f8f [4194304,4194304] 0 2024-09-19T09:02:57.947 INFO:tasks.workunit.client.0.smithi049.stdout:2/511: truncate d1/d2b/d38/f93 628440 0 2024-09-19T09:02:57.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/356: fsync d4/d15/d19/d1f/f5a 0 2024-09-19T09:02:57.948 INFO:tasks.workunit.client.0.smithi049.stdout:9/546: chown d3/d14/d1a/d21/fb5 5 1 2024-09-19T09:02:57.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/287: getdents d5/d6/d19/d30 0 2024-09-19T09:02:57.954 INFO:tasks.workunit.client.0.smithi049.stdout:1/288: write d5/d6/d19/d21/f3a [466741,34254] 0 2024-09-19T09:02:57.956 INFO:tasks.workunit.client.0.smithi049.stdout:2/512: creat d1/d4/d1e/d45/faa x:0 0 0 2024-09-19T09:02:57.958 INFO:tasks.workunit.client.0.smithi049.stdout:4/357: rmdir d4/d15/d19/d1f 39 2024-09-19T09:02:57.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/358: chown d4/d35/c39 152 1 2024-09-19T09:02:57.962 INFO:tasks.workunit.client.0.smithi049.stdout:9/547: mknod d3/d14/d1a/d90/cbf 0 2024-09-19T09:02:57.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/513: creat d1/d4/d1e/d45/fab x:0 0 0 2024-09-19T09:02:57.969 INFO:tasks.workunit.client.0.smithi049.stdout:4/359: rmdir d4/d45/d3f/d47 39 2024-09-19T09:02:57.971 INFO:tasks.workunit.client.0.smithi049.stdout:9/548: write d3/d14/d1a/d21/d67/d94/f5b [8306948,11278] 0 2024-09-19T09:02:57.972 INFO:tasks.workunit.client.0.smithi049.stdout:9/549: write d3/d14/d1a/d21/fad [63890,39551] 0 2024-09-19T09:02:57.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/514: creat d1/d2/d70/fac x:0 0 0 2024-09-19T09:02:57.976 INFO:tasks.workunit.client.0.smithi049.stdout:1/289: creat d5/d6/d8/f62 x:0 0 0 2024-09-19T09:02:57.978 INFO:tasks.workunit.client.0.smithi049.stdout:1/290: truncate d5/d6/f1f 4808248 0 2024-09-19T09:02:57.979 INFO:tasks.workunit.client.0.smithi049.stdout:9/550: dread d3/d14/d1a/f7d [0,4194304] 0 2024-09-19T09:02:57.980 INFO:tasks.workunit.client.0.smithi049.stdout:2/515: link d1/d2b/d38/f93 d1/d4/d1e/fad 0 2024-09-19T09:02:57.981 INFO:tasks.workunit.client.0.smithi049.stdout:9/551: dread - d3/d14/d1a/d21/d31/d8e/f7a zero size 2024-09-19T09:02:57.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/516: truncate d1/d4/d1e/d21/f98 476747 0 2024-09-19T09:02:57.984 INFO:tasks.workunit.client.0.smithi049.stdout:2/517: fdatasync d1/d4/d1e/d21/f79 0 2024-09-19T09:02:57.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/360: dread f2 [0,4194304] 0 2024-09-19T09:02:57.990 INFO:tasks.workunit.client.0.smithi049.stdout:4/361: mknod d4/d35/c72 0 2024-09-19T09:02:57.990 INFO:tasks.workunit.client.0.smithi049.stdout:9/552: link d3/d14/lbc d3/d9b/lc0 0 2024-09-19T09:02:57.991 INFO:tasks.workunit.client.0.smithi049.stdout:2/518: mkdir d1/d4/d1e/d21/dae 0 2024-09-19T09:02:57.993 INFO:tasks.workunit.client.0.smithi049.stdout:2/519: chown d1/d4/d20/c90 4485969 1 2024-09-19T09:02:57.997 INFO:tasks.workunit.client.0.smithi049.stdout:4/362: rename d4/f14 to d4/d4c/f73 0 2024-09-19T09:02:57.998 INFO:tasks.workunit.client.0.smithi049.stdout:2/520: symlink d1/d2/d6c/laf 0 2024-09-19T09:02:58.002 INFO:tasks.workunit.client.0.smithi049.stdout:2/521: dread d1/d4/d1e/d21/f52 [0,4194304] 0 2024-09-19T09:02:58.004 INFO:tasks.workunit.client.0.smithi049.stdout:4/363: mkdir d4/d6c/d74 0 2024-09-19T09:02:58.005 INFO:tasks.workunit.client.0.smithi049.stdout:9/553: truncate d3/d14/d34/f95 879641 0 2024-09-19T09:02:58.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/522: unlink d1/d2/d23/d49/c91 0 2024-09-19T09:02:58.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/554: dread d3/d14/d1a/d21/d66/f8f [0,4194304] 0 2024-09-19T09:02:58.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/364: symlink d4/d45/d3f/d47/l75 0 2024-09-19T09:02:58.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/365: truncate d4/d4c/f6e 1016008 0 2024-09-19T09:02:58.015 INFO:tasks.workunit.client.0.smithi049.stdout:2/523: dwrite f0 [4194304,4194304] 0 2024-09-19T09:02:58.016 INFO:tasks.workunit.client.0.smithi049.stdout:2/524: fsync d1/d4/f2a 0 2024-09-19T09:02:58.016 INFO:tasks.workunit.client.0.smithi049.stdout:4/366: chown d4/d45/d3f/d47/f49 422 1 2024-09-19T09:02:58.021 INFO:tasks.workunit.client.0.smithi049.stdout:2/525: symlink d1/d2d/lb0 0 2024-09-19T09:02:58.023 INFO:tasks.workunit.client.0.smithi049.stdout:4/367: mkdir d4/d34/d3d/d62/d76 0 2024-09-19T09:02:58.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/368: write d4/d15/f20 [1732903,31720] 0 2024-09-19T09:02:58.026 INFO:tasks.workunit.client.0.smithi049.stdout:2/526: fsync d1/d4/d1e/d45/f48 0 2024-09-19T09:02:58.027 INFO:tasks.workunit.client.0.smithi049.stdout:2/527: stat d1/d2/d70/fa1 0 2024-09-19T09:02:58.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/555: write d3/d14/d1a/f35 [4926599,118080] 0 2024-09-19T09:02:58.032 INFO:tasks.workunit.client.0.smithi049.stdout:2/528: rename d1/d4/f46 to d1/d4/d1e/d9f/fb1 0 2024-09-19T09:02:58.036 INFO:tasks.workunit.client.0.smithi049.stdout:9/556: rename d3/d14/d1a/d21/f77 to d3/d14/d34/d4c/fc1 0 2024-09-19T09:02:58.037 INFO:tasks.workunit.client.0.smithi049.stdout:9/557: dread - d3/d14/d34/d9f/f7e zero size 2024-09-19T09:02:58.038 INFO:tasks.workunit.client.0.smithi049.stdout:9/558: write d3/d14/d1a/d90/fa6 [293962,110362] 0 2024-09-19T09:02:58.041 INFO:tasks.workunit.client.0.smithi049.stdout:2/529: rename d1/d2b/f1b to d1/d2/d6c/fb2 0 2024-09-19T09:02:58.044 INFO:tasks.workunit.client.0.smithi049.stdout:2/530: fdatasync d1/d2/d70/fa1 0 2024-09-19T09:02:58.048 INFO:tasks.workunit.client.0.smithi049.stdout:2/531: dread d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:58.050 INFO:tasks.workunit.client.0.smithi049.stdout:9/559: rename d3/d9b to d3/d14/d1a/d21/d31/d8e/dc2 0 2024-09-19T09:02:58.050 INFO:tasks.workunit.client.0.smithi049.stdout:9/560: dread - d3/d14/d1a/fb3 zero size 2024-09-19T09:02:58.054 INFO:tasks.workunit.client.0.smithi049.stdout:9/561: mknod d3/d14/d1a/d21/d31/d8e/dc2/cc3 0 2024-09-19T09:02:58.058 INFO:tasks.workunit.client.0.smithi049.stdout:9/562: symlink d3/d14/d34/d9f/d82/db1/lc4 0 2024-09-19T09:02:58.063 INFO:tasks.workunit.client.0.smithi049.stdout:2/532: dwrite d1/d2/d6c/fb2 [0,4194304] 0 2024-09-19T09:02:58.067 INFO:tasks.workunit.client.0.smithi049.stdout:9/563: dwrite d3/d14/d34/d4c/d9c/fbd [0,4194304] 0 2024-09-19T09:02:58.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/533: rename d1/d2b/d38 to d1/d4/d1e/d9f/db3 0 2024-09-19T09:02:58.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/534: read d1/d4/d20/d26/f8a [3133741,20343] 0 2024-09-19T09:02:58.075 INFO:tasks.workunit.client.0.smithi049.stdout:2/535: dread d1/d2/f88 [0,4194304] 0 2024-09-19T09:02:58.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/536: mknod d1/d4/d1e/d9f/db3/d41/cb4 0 2024-09-19T09:02:58.082 INFO:tasks.workunit.client.0.smithi049.stdout:2/537: mknod d1/d4/d1e/d9f/db3/cb5 0 2024-09-19T09:02:58.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/538: dread d1/d2d/f37 [0,4194304] 0 2024-09-19T09:02:58.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/539: readlink d1/l7b 0 2024-09-19T09:02:58.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/540: stat d1/d4/d1e/d9f/db3/f85 0 2024-09-19T09:02:58.089 INFO:tasks.workunit.client.0.smithi049.stdout:9/564: truncate d3/d14/d1a/f7d 1297574 0 2024-09-19T09:02:58.091 INFO:tasks.workunit.client.0.smithi049.stdout:2/541: mknod d1/d4/d20/d92/cb6 0 2024-09-19T09:02:58.093 INFO:tasks.workunit.client.0.smithi049.stdout:9/565: mkdir d3/d14/d1a/d21/d73/db8/dc5 0 2024-09-19T09:02:58.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/542: write d1/d4/d1e/d9f/db3/f5d [7102874,60906] 0 2024-09-19T09:02:58.096 INFO:tasks.workunit.client.0.smithi049.stdout:9/566: read d3/d14/d1a/d21/fb5 [3966090,60176] 0 2024-09-19T09:02:58.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/543: mkdir d1/d4/d1e/d9f/db7 0 2024-09-19T09:02:58.099 INFO:tasks.workunit.client.0.smithi049.stdout:2/544: mknod d1/d4/d1e/cb8 0 2024-09-19T09:02:58.101 INFO:tasks.workunit.client.0.smithi049.stdout:2/545: chown d1/d4/d20 29391 1 2024-09-19T09:02:58.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/567: dwrite d3/d14/d1a/d21/d31/d8e/fab [0,4194304] 0 2024-09-19T09:02:58.105 INFO:tasks.workunit.client.0.smithi049.stdout:2/546: symlink d1/d4/d20/lb9 0 2024-09-19T09:02:58.108 INFO:tasks.workunit.client.0.smithi049.stdout:9/568: rename d3/d14/f3f to d3/d14/d1a/d21/d66/fc6 0 2024-09-19T09:02:58.113 INFO:tasks.workunit.client.0.smithi049.stdout:2/547: dwrite d1/f15 [4194304,4194304] 0 2024-09-19T09:02:58.115 INFO:tasks.workunit.client.0.smithi049.stdout:9/569: unlink d3/d14/d1a/d21/ca1 0 2024-09-19T09:02:58.123 INFO:tasks.workunit.client.0.smithi049.stdout:9/570: symlink d3/dbb/lc7 0 2024-09-19T09:02:58.127 INFO:tasks.workunit.client.0.smithi049.stdout:2/548: dwrite d1/d2/d32/f29 [0,4194304] 0 2024-09-19T09:02:58.140 INFO:tasks.workunit.client.0.smithi049.stdout:9/571: symlink d3/d14/d34/d74/lc8 0 2024-09-19T09:02:58.140 INFO:tasks.workunit.client.0.smithi049.stdout:2/549: truncate d1/f6a 3187574 0 2024-09-19T09:02:58.153 INFO:tasks.workunit.client.0.smithi049.stdout:2/550: dread d1/f11 [0,4194304] 0 2024-09-19T09:02:58.154 INFO:tasks.workunit.client.0.smithi049.stdout:2/551: stat d1/d4/d1e/d45/f7f 0 2024-09-19T09:02:58.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/552: unlink d1/d4/d1e/fad 0 2024-09-19T09:02:58.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/572: dread d3/d14/d1a/d90/f71 [0,4194304] 0 2024-09-19T09:02:58.159 INFO:tasks.workunit.client.0.smithi049.stdout:2/553: mkdir d1/d4/d20/d92/dba 0 2024-09-19T09:02:58.160 INFO:tasks.workunit.client.0.smithi049.stdout:9/573: write d3/d14/d1a/d21/f2f [4805579,108918] 0 2024-09-19T09:02:58.161 INFO:tasks.workunit.client.0.smithi049.stdout:2/554: truncate d1/f9b 903946 0 2024-09-19T09:02:58.162 INFO:tasks.workunit.client.0.smithi049.stdout:2/555: chown d1/d2b/f1a 435669719 1 2024-09-19T09:02:58.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/556: write d1/d4/d1e/d21/d8c/f8e [3413565,64872] 0 2024-09-19T09:02:58.176 INFO:tasks.workunit.client.0.smithi049.stdout:2/557: write d1/d4/d20/d26/f8a [3356689,69611] 0 2024-09-19T09:02:58.183 INFO:tasks.workunit.client.0.smithi049.stdout:2/558: dwrite d1/d4/d1e/d9f/db3/d41/fa7 [0,4194304] 0 2024-09-19T09:02:58.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/559: rename d1/d4/d1e/d45/f7f to d1/d4/d1e/d9f/fbb 0 2024-09-19T09:02:58.190 INFO:tasks.workunit.client.0.smithi049.stdout:2/560: creat d1/d4/d1e/d45/fbc x:0 0 0 2024-09-19T09:02:58.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/561: dread d1/d2b/f1a [0,4194304] 0 2024-09-19T09:02:58.211 INFO:tasks.workunit.client.0.smithi049.stdout:2/562: fdatasync d1/d2/f67 0 2024-09-19T09:02:58.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/563: chown d1/d4/d1e/f72 10 1 2024-09-19T09:02:58.213 INFO:tasks.workunit.client.0.smithi049.stdout:2/564: write d1/d2/d32/f29 [1063911,82882] 0 2024-09-19T09:02:58.227 INFO:tasks.workunit.client.0.smithi049.stdout:2/565: dread d1/d4/f39 [0,4194304] 0 2024-09-19T09:02:58.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/566: write d1/d2/d23/f56 [7715945,34022] 0 2024-09-19T09:02:58.233 INFO:tasks.workunit.client.0.smithi049.stdout:2/567: creat d1/d4/d1e/d21/dae/fbd x:0 0 0 2024-09-19T09:02:58.237 INFO:tasks.workunit.client.0.smithi049.stdout:2/568: symlink d1/d2/lbe 0 2024-09-19T09:02:58.244 INFO:tasks.workunit.client.0.smithi049.stdout:2/569: rename d1/d4/d1e/d21/dae/fbd to d1/d4/d1e/d21/fbf 0 2024-09-19T09:02:58.247 INFO:tasks.workunit.client.0.smithi049.stdout:2/570: rename d1/d4/d1e/d9f/db3/d41/d7d/f97 to d1/d4/d1e/d9f/fc0 0 2024-09-19T09:02:58.250 INFO:tasks.workunit.client.0.smithi049.stdout:2/571: rmdir d1/d4/d1e/d9f/db3/d41 39 2024-09-19T09:02:58.251 INFO:tasks.workunit.client.0.smithi049.stdout:2/572: dread - d1/d4/d1e/d9f/db3/d41/fa6 zero size 2024-09-19T09:02:58.272 INFO:tasks.workunit.client.0.smithi049.stdout:5/292: sync 2024-09-19T09:02:58.272 INFO:tasks.workunit.client.0.smithi049.stdout:5/293: readlink l0 0 2024-09-19T09:02:58.276 INFO:tasks.workunit.client.0.smithi049.stdout:5/294: rename d3/d5/de/d12/c48 to d3/d5/de/d4a/c61 0 2024-09-19T09:02:58.277 INFO:tasks.workunit.client.0.smithi049.stdout:5/295: write d3/d5/d20/f59 [2571527,18613] 0 2024-09-19T09:02:58.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/296: dwrite d3/d5/f1f [0,4194304] 0 2024-09-19T09:02:58.294 INFO:tasks.workunit.client.0.smithi049.stdout:5/297: creat d3/f62 x:0 0 0 2024-09-19T09:02:58.296 INFO:tasks.workunit.client.0.smithi049.stdout:5/298: mkdir d3/d5/d1c/d4c/d63 0 2024-09-19T09:02:58.299 INFO:tasks.workunit.client.0.smithi049.stdout:5/299: unlink d3/d5/de/d12/f13 0 2024-09-19T09:02:58.299 INFO:tasks.workunit.client.0.smithi049.stdout:5/300: fdatasync d3/f6 0 2024-09-19T09:02:58.299 INFO:tasks.workunit.client.0.smithi049.stdout:5/301: chown d3/dc/c55 97 1 2024-09-19T09:02:58.300 INFO:tasks.workunit.client.0.smithi049.stdout:5/302: stat d3/d5/d20/d38/d5a 0 2024-09-19T09:02:58.303 INFO:tasks.workunit.client.0.smithi049.stdout:5/303: unlink d3/d5/d20/d38/l53 0 2024-09-19T09:02:58.305 INFO:tasks.workunit.client.0.smithi049.stdout:5/304: mknod d3/d5/d20/d57/c64 0 2024-09-19T09:02:58.306 INFO:tasks.workunit.client.0.smithi049.stdout:5/305: rmdir d3/d5/de 39 2024-09-19T09:02:58.309 INFO:tasks.workunit.client.0.smithi049.stdout:5/306: truncate d3/f6 3088865 0 2024-09-19T09:02:58.329 INFO:tasks.workunit.client.0.smithi049.stdout:5/307: truncate d3/d5/f1f 425509 0 2024-09-19T09:02:58.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/308: dread d3/d5/de/d12/d45/f54 [0,4194304] 0 2024-09-19T09:02:58.343 INFO:tasks.workunit.client.0.smithi049.stdout:5/309: truncate d3/d5/f1b 949680 0 2024-09-19T09:02:58.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/310: readlink d3/d5/l2c 0 2024-09-19T09:02:58.347 INFO:tasks.workunit.client.0.smithi049.stdout:5/311: write d3/d5/d1c/d2d/f60 [58011,125211] 0 2024-09-19T09:02:58.350 INFO:tasks.workunit.client.0.smithi049.stdout:5/312: mknod d3/d5/d1c/d4c/c65 0 2024-09-19T09:02:58.352 INFO:tasks.workunit.client.0.smithi049.stdout:5/313: fdatasync d3/d5/de/f15 0 2024-09-19T09:02:58.358 INFO:tasks.workunit.client.0.smithi049.stdout:5/314: dwrite d3/f62 [0,4194304] 0 2024-09-19T09:02:58.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/315: dread - d3/d5/d1c/d3c/f47 zero size 2024-09-19T09:02:58.365 INFO:tasks.workunit.client.0.smithi049.stdout:5/316: dwrite d3/f62 [0,4194304] 0 2024-09-19T09:02:58.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/317: dwrite d3/d5/f1b [0,4194304] 0 2024-09-19T09:02:58.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/318: dwrite d3/d5/f1f [0,4194304] 0 2024-09-19T09:02:58.406 INFO:tasks.workunit.client.0.smithi049.stdout:5/319: dwrite d3/f8 [0,4194304] 0 2024-09-19T09:02:58.415 INFO:tasks.workunit.client.0.smithi049.stdout:5/320: dwrite d3/f10 [0,4194304] 0 2024-09-19T09:02:58.423 INFO:tasks.workunit.client.0.smithi049.stdout:5/321: dwrite d3/f41 [0,4194304] 0 2024-09-19T09:02:58.427 INFO:tasks.workunit.client.0.smithi049.stdout:5/322: write d3/d5/d20/d38/f4d [650519,22970] 0 2024-09-19T09:02:58.430 INFO:tasks.workunit.client.0.smithi049.stdout:5/323: mknod d3/d5/de/d12/c66 0 2024-09-19T09:02:58.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/324: chown d3/f10 123 1 2024-09-19T09:02:58.438 INFO:tasks.workunit.client.0.smithi049.stdout:5/325: fdatasync d3/f41 0 2024-09-19T09:02:58.440 INFO:tasks.workunit.client.0.smithi049.stdout:5/326: symlink d3/l67 0 2024-09-19T09:02:58.442 INFO:tasks.workunit.client.0.smithi049.stdout:5/327: truncate d3/d5/de/f15 5784405 0 2024-09-19T09:02:58.443 INFO:tasks.workunit.client.0.smithi049.stdout:5/328: write d3/f41 [3763137,123435] 0 2024-09-19T09:02:58.456 INFO:tasks.workunit.client.0.smithi049.stdout:5/329: truncate d3/d5/f40 3238766 0 2024-09-19T09:02:58.473 INFO:tasks.workunit.client.0.smithi049.stdout:5/330: dwrite d3/d5/de/f15 [4194304,4194304] 0 2024-09-19T09:02:58.474 INFO:tasks.workunit.client.0.smithi049.stdout:5/331: write d3/f8 [3850515,122431] 0 2024-09-19T09:02:58.481 INFO:tasks.workunit.client.0.smithi049.stdout:5/332: dwrite d3/d5/de/f1a [0,4194304] 0 2024-09-19T09:02:58.482 INFO:tasks.workunit.client.0.smithi049.stdout:5/333: chown d3/d5/d20/c5e 4989792 1 2024-09-19T09:02:58.484 INFO:tasks.workunit.client.0.smithi049.stdout:5/334: chown d3/d5/de 141 1 2024-09-19T09:02:58.485 INFO:tasks.workunit.client.0.smithi049.stdout:5/335: fdatasync d3/dc/f42 0 2024-09-19T09:02:58.489 INFO:tasks.workunit.client.0.smithi049.stdout:5/336: creat d3/d5/de/d4a/f68 x:0 0 0 2024-09-19T09:02:58.492 INFO:tasks.workunit.client.0.smithi049.stdout:5/337: rename d3/d5/d20/d57/c64 to d3/d5/d1c/d3c/c69 0 2024-09-19T09:02:58.505 INFO:tasks.workunit.client.0.smithi049.stdout:5/338: truncate d3/d5/f1f 1569890 0 2024-09-19T09:02:58.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/339: unlink d3/d5/f40 0 2024-09-19T09:02:58.514 INFO:tasks.workunit.client.0.smithi049.stdout:5/340: dwrite d3/d5/d1c/f22 [4194304,4194304] 0 2024-09-19T09:02:58.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/341: rename d3/d5/fb to d3/dc/d43/f6a 0 2024-09-19T09:02:58.528 INFO:tasks.workunit.client.0.smithi049.stdout:5/342: creat d3/d5/d1c/d4c/d63/f6b x:0 0 0 2024-09-19T09:02:58.529 INFO:tasks.workunit.client.0.smithi049.stdout:5/343: readlink d3/d5/l11 0 2024-09-19T09:02:58.531 INFO:tasks.workunit.client.0.smithi049.stdout:5/344: readlink d3/d5/de/d12/d45/l5f 0 2024-09-19T09:02:58.575 INFO:tasks.workunit.client.0.smithi049.stdout:5/345: truncate d3/d5/d1c/f22 4485067 0 2024-09-19T09:02:58.576 INFO:tasks.workunit.client.0.smithi049.stdout:5/346: write d3/f10 [896623,39688] 0 2024-09-19T09:02:58.577 INFO:tasks.workunit.client.0.smithi049.stdout:5/347: chown d3/d5/d20/d38/c3b 11885126 1 2024-09-19T09:02:58.580 INFO:tasks.workunit.client.0.smithi049.stdout:5/348: read - d3/d5/de/f23 zero size 2024-09-19T09:02:58.581 INFO:tasks.workunit.client.0.smithi049.stdout:5/349: dread - d3/d5/d1c/f2b zero size 2024-09-19T09:02:58.592 INFO:tasks.workunit.client.0.smithi049.stdout:5/350: write d3/d5/d1c/d3c/f47 [839419,19183] 0 2024-09-19T09:02:58.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/351: rename d3/d5/d1c/d3c to d3/d6c 0 2024-09-19T09:02:58.599 INFO:tasks.workunit.client.0.smithi049.stdout:5/352: mkdir d3/d6c/d6d 0 2024-09-19T09:02:58.600 INFO:tasks.workunit.client.0.smithi049.stdout:5/353: dread - d3/d5/de/f23 zero size 2024-09-19T09:02:58.607 INFO:tasks.workunit.client.0.smithi049.stdout:5/354: dwrite d3/d5/d1c/d2d/f2f [4194304,4194304] 0 2024-09-19T09:02:58.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/355: fsync d3/d5/d1c/d2d/f60 0 2024-09-19T09:02:58.610 INFO:tasks.workunit.client.0.smithi049.stdout:5/356: write d3/d5/d1c/d2d/f60 [74357,64155] 0 2024-09-19T09:02:58.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/357: write d3/d5/de/d4a/f68 [698875,34085] 0 2024-09-19T09:02:58.613 INFO:tasks.workunit.client.0.smithi049.stdout:5/358: write d3/dc/f42 [1208226,20254] 0 2024-09-19T09:02:58.617 INFO:tasks.workunit.client.0.smithi049.stdout:5/359: mknod d3/d5/d1c/d4c/d63/c6e 0 2024-09-19T09:02:58.624 INFO:tasks.workunit.client.0.smithi049.stdout:5/360: dread d3/d5/d20/d38/f4d [0,4194304] 0 2024-09-19T09:02:58.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/361: chown d3/d5/d1c/d2d/l4e 3758 1 2024-09-19T09:02:58.626 INFO:tasks.workunit.client.0.smithi049.stdout:5/362: read d3/d5/d20/d38/f4d [662067,2747] 0 2024-09-19T09:02:58.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/363: dwrite d3/d5/d1c/d4c/d63/f6b [0,4194304] 0 2024-09-19T09:02:58.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/364: write d3/dc/f42 [1197151,130795] 0 2024-09-19T09:02:58.639 INFO:tasks.workunit.client.0.smithi049.stdout:5/365: creat d3/d5/de/d12/f6f x:0 0 0 2024-09-19T09:02:58.646 INFO:tasks.workunit.client.0.smithi049.stdout:5/366: dwrite d3/d5/d1c/d4c/d63/f6b [0,4194304] 0 2024-09-19T09:02:58.648 INFO:tasks.workunit.client.0.smithi049.stdout:3/440: sync 2024-09-19T09:02:58.650 INFO:tasks.workunit.client.0.smithi049.stdout:3/441: stat l9 0 2024-09-19T09:02:58.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/367: dread d3/d6c/f47 [0,4194304] 0 2024-09-19T09:02:58.653 INFO:tasks.workunit.client.0.smithi049.stdout:5/368: chown d3/dc/c55 0 1 2024-09-19T09:02:58.661 INFO:tasks.workunit.client.0.smithi049.stdout:5/369: getdents d3/d5/de/d4a 0 2024-09-19T09:02:58.663 INFO:tasks.workunit.client.0.smithi049.stdout:5/370: read d3/d5/d1c/d4c/d63/f6b [1412027,78664] 0 2024-09-19T09:02:58.664 INFO:tasks.workunit.client.0.smithi049.stdout:3/442: dwrite d10/d11/d13/d30/f40 [4194304,4194304] 0 2024-09-19T09:02:58.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/371: dread - d3/d5/d1c/f2b zero size 2024-09-19T09:02:58.666 INFO:tasks.workunit.client.0.smithi049.stdout:3/443: fdatasync d10/d3d/d79/d80/f8a 0 2024-09-19T09:02:58.673 INFO:tasks.workunit.client.0.smithi049.stdout:5/372: getdents d3/d5/de/d4a 0 2024-09-19T09:02:58.676 INFO:tasks.workunit.client.0.smithi049.stdout:3/444: rename d10/d11/d13/l29 to d10/d11/l8e 0 2024-09-19T09:02:58.681 INFO:tasks.workunit.client.0.smithi049.stdout:5/373: symlink d3/d5/d20/d38/d5d/l70 0 2024-09-19T09:02:58.682 INFO:tasks.workunit.client.0.smithi049.stdout:5/374: write d3/d5/f1b [2718221,4039] 0 2024-09-19T09:02:58.685 INFO:tasks.workunit.client.0.smithi049.stdout:5/375: mknod d3/d5/de/d4a/c71 0 2024-09-19T09:02:58.693 INFO:tasks.workunit.client.0.smithi049.stdout:3/445: dwrite d10/d11/d13/f5e [0,4194304] 0 2024-09-19T09:02:58.694 INFO:tasks.workunit.client.0.smithi049.stdout:5/376: getdents d3/d5/de/d4a 0 2024-09-19T09:02:58.698 INFO:tasks.workunit.client.0.smithi049.stdout:3/446: creat d10/d3d/d46/d84/f8f x:0 0 0 2024-09-19T09:02:58.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/377: truncate d3/d5/de/f44 1852266 0 2024-09-19T09:02:58.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/378: dread d3/d5/d20/d38/f46 [0,4194304] 0 2024-09-19T09:02:58.702 INFO:tasks.workunit.client.0.smithi049.stdout:5/379: fdatasync d3/d5/d1c/d2d/f2f 0 2024-09-19T09:02:58.708 INFO:tasks.workunit.client.0.smithi049.stdout:5/380: dwrite d3/d5/d1c/d2d/f2f [4194304,4194304] 0 2024-09-19T09:02:58.711 INFO:tasks.workunit.client.0.smithi049.stdout:5/381: mkdir d3/d5/d20/d57/d72 0 2024-09-19T09:02:58.711 INFO:tasks.workunit.client.0.smithi049.stdout:5/382: read - d3/d5/d1c/f2b zero size 2024-09-19T09:02:58.711 INFO:tasks.workunit.client.0.smithi049.stdout:5/383: chown d3/cf 0 1 2024-09-19T09:02:58.713 INFO:tasks.workunit.client.0.smithi049.stdout:5/384: dread d3/d5/de/d12/d45/f54 [0,4194304] 0 2024-09-19T09:02:58.715 INFO:tasks.workunit.client.0.smithi049.stdout:5/385: write d3/d5/d20/d38/f4d [2716229,110559] 0 2024-09-19T09:02:58.718 INFO:tasks.workunit.client.0.smithi049.stdout:5/386: creat d3/d5/d20/d38/d5d/f73 x:0 0 0 2024-09-19T09:02:58.720 INFO:tasks.workunit.client.0.smithi049.stdout:5/387: read d3/d5/d1c/f22 [554288,110448] 0 2024-09-19T09:02:58.721 INFO:tasks.workunit.client.0.smithi049.stdout:5/388: write d3/f8 [4176681,45801] 0 2024-09-19T09:02:58.730 INFO:tasks.workunit.client.0.smithi049.stdout:5/389: truncate d3/d5/d1c/d2d/f2f 5554017 0 2024-09-19T09:02:58.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/390: rename d3/d5/de/d12/d45/l5f to d3/d5/d20/d38/d5a/l74 0 2024-09-19T09:02:58.736 INFO:tasks.workunit.client.0.smithi049.stdout:5/391: mknod d3/d5/c75 0 2024-09-19T09:02:58.737 INFO:tasks.workunit.client.0.smithi049.stdout:5/392: creat d3/d5/d20/f76 x:0 0 0 2024-09-19T09:02:58.743 INFO:tasks.workunit.client.0.smithi049.stdout:5/393: getdents d3/dc 0 2024-09-19T09:02:58.744 INFO:tasks.workunit.client.0.smithi049.stdout:5/394: write d3/d5/de/d4a/f68 [498968,35161] 0 2024-09-19T09:02:58.750 INFO:tasks.workunit.client.0.smithi049.stdout:5/395: dwrite d3/d5/f1b [0,4194304] 0 2024-09-19T09:02:58.754 INFO:tasks.workunit.client.0.smithi049.stdout:5/396: dread d3/f10 [0,4194304] 0 2024-09-19T09:02:58.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/397: creat d3/d5/d1c/d2d/f77 x:0 0 0 2024-09-19T09:02:58.762 INFO:tasks.workunit.client.0.smithi049.stdout:5/398: creat d3/f78 x:0 0 0 2024-09-19T09:02:58.765 INFO:tasks.workunit.client.0.smithi049.stdout:5/399: unlink d3/d5/de/l31 0 2024-09-19T09:02:58.776 INFO:tasks.workunit.client.0.smithi049.stdout:5/400: truncate d3/d5/d20/f59 1323884 0 2024-09-19T09:02:58.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/288: sync 2024-09-19T09:02:58.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/289: fsync dc/d12/f29 0 2024-09-19T09:02:58.975 INFO:tasks.workunit.client.0.smithi049.stdout:6/290: readlink dc/d1b/d20/d2f/l49 0 2024-09-19T09:02:58.975 INFO:tasks.workunit.client.0.smithi049.stdout:6/291: dread - dc/d1b/d20/d2f/f51 zero size 2024-09-19T09:02:58.977 INFO:tasks.workunit.client.0.smithi049.stdout:6/292: creat dc/d1b/f5b x:0 0 0 2024-09-19T09:02:58.977 INFO:tasks.workunit.client.0.smithi049.stdout:6/293: write dc/d1b/f57 [1053913,36889] 0 2024-09-19T09:02:58.982 INFO:tasks.workunit.client.0.smithi049.stdout:6/294: dread f9 [0,4194304] 0 2024-09-19T09:02:59.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/295: write dc/d16/f2d [1241604,104591] 0 2024-09-19T09:02:59.010 INFO:tasks.workunit.client.0.smithi049.stdout:6/296: creat dc/d1b/d20/d2f/f5c x:0 0 0 2024-09-19T09:02:59.010 INFO:tasks.workunit.client.0.smithi049.stdout:6/297: chown dc/l10 295713440 1 2024-09-19T09:02:59.013 INFO:tasks.workunit.client.0.smithi049.stdout:6/298: creat dc/d1b/d20/d2f/d31/f5d x:0 0 0 2024-09-19T09:02:59.017 INFO:tasks.workunit.client.0.smithi049.stdout:6/299: rename dc/d1b/f23 to dc/d1b/d20/d2f/d4c/f5e 0 2024-09-19T09:02:59.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/300: write dc/d16/f3b [1761692,8911] 0 2024-09-19T09:02:59.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/301: dwrite dc/d16/f2e [0,4194304] 0 2024-09-19T09:02:59.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/302: chown dc/d1b/d20/l40 793174 1 2024-09-19T09:02:59.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/303: dwrite f3 [0,4194304] 0 2024-09-19T09:02:59.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/304: dread - dc/d16/f48 zero size 2024-09-19T09:02:59.050 INFO:tasks.workunit.client.0.smithi049.stdout:6/305: mknod dc/d1b/d20/c5f 0 2024-09-19T09:02:59.053 INFO:tasks.workunit.client.0.smithi049.stdout:6/306: creat dc/d12/d5a/f60 x:0 0 0 2024-09-19T09:02:59.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/307: write dc/d12/d5a/f60 [1038566,52782] 0 2024-09-19T09:02:59.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/308: dwrite dc/d12/f4d [0,4194304] 0 2024-09-19T09:02:59.071 INFO:tasks.workunit.client.0.smithi049.stdout:6/309: dwrite dc/d1b/f57 [0,4194304] 0 2024-09-19T09:02:59.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/310: stat dc/c22 0 2024-09-19T09:02:59.087 INFO:tasks.workunit.client.0.smithi049.stdout:6/311: dwrite f9 [0,4194304] 0 2024-09-19T09:02:59.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/312: read f3 [54538,40828] 0 2024-09-19T09:02:59.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/313: symlink dc/d1b/d20/d2f/d31/l61 0 2024-09-19T09:02:59.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/314: chown dc/d1b/d20/d2f/d4c/f5e 1 1 2024-09-19T09:02:59.096 INFO:tasks.workunit.client.0.smithi049.stdout:6/315: link dc/d12/d5a/f60 dc/d12/d5a/f62 0 2024-09-19T09:02:59.102 INFO:tasks.workunit.client.0.smithi049.stdout:6/316: rename c7 to dc/d1b/d20/d2f/d53/c63 0 2024-09-19T09:02:59.115 INFO:tasks.workunit.client.0.smithi049.stdout:6/317: dwrite dc/d1b/d20/d2f/f3f [0,4194304] 0 2024-09-19T09:02:59.118 INFO:tasks.workunit.client.0.smithi049.stdout:6/318: creat dc/d12/d5a/f64 x:0 0 0 2024-09-19T09:02:59.121 INFO:tasks.workunit.client.0.smithi049.stdout:6/319: creat dc/d1b/d20/d2f/d31/f65 x:0 0 0 2024-09-19T09:02:59.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/320: dread dc/d1b/f38 [0,4194304] 0 2024-09-19T09:02:59.131 INFO:tasks.workunit.client.0.smithi049.stdout:8/517: sync 2024-09-19T09:02:59.131 INFO:tasks.workunit.client.0.smithi049.stdout:7/553: sync 2024-09-19T09:02:59.137 INFO:tasks.workunit.client.0.smithi049.stdout:7/554: dwrite d1/d7/fa [0,4194304] 0 2024-09-19T09:02:59.148 INFO:tasks.workunit.client.0.smithi049.stdout:6/321: chown dc/d1b/d20/d2f/d31/l3a 2 1 2024-09-19T09:02:59.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/518: write d1/d11/d4f/d87/f49 [1904930,39045] 0 2024-09-19T09:02:59.153 INFO:tasks.workunit.client.0.smithi049.stdout:6/322: chown dc/d1b/d20/c4e 2090201 1 2024-09-19T09:02:59.154 INFO:tasks.workunit.client.0.smithi049.stdout:6/323: dread - dc/d1b/d20/d2f/f5c zero size 2024-09-19T09:02:59.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/324: truncate dc/d1b/d20/d2f/f51 130863 0 2024-09-19T09:02:59.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/519: unlink d1/d11/d2e/l63 0 2024-09-19T09:02:59.157 INFO:tasks.workunit.client.0.smithi049.stdout:6/325: creat dc/d1b/d20/d2f/f66 x:0 0 0 2024-09-19T09:02:59.158 INFO:tasks.workunit.client.0.smithi049.stdout:8/520: chown d1/f3d 1 1 2024-09-19T09:02:59.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/326: write dc/d12/f4d [2601160,81655] 0 2024-09-19T09:02:59.161 INFO:tasks.workunit.client.0.smithi049.stdout:8/521: mkdir d1/d11/d4f/d87/d5d/d65/d99 0 2024-09-19T09:02:59.162 INFO:tasks.workunit.client.0.smithi049.stdout:8/522: write d1/d1a/f29 [428026,22043] 0 2024-09-19T09:02:59.164 INFO:tasks.workunit.client.0.smithi049.stdout:6/327: link dc/d16/f2d dc/d1b/f67 0 2024-09-19T09:02:59.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/523: rmdir d1/d11/d45 39 2024-09-19T09:02:59.169 INFO:tasks.workunit.client.0.smithi049.stdout:8/524: creat d1/d11/d3f/d5b/f9a x:0 0 0 2024-09-19T09:02:59.175 INFO:tasks.workunit.client.0.smithi049.stdout:7/555: dwrite d1/d53/d18/d59/f29 [0,4194304] 0 2024-09-19T09:02:59.176 INFO:tasks.workunit.client.0.smithi049.stdout:7/556: dread - d1/d53/f5b zero size 2024-09-19T09:02:59.179 INFO:tasks.workunit.client.0.smithi049.stdout:7/557: write d1/d7/f70 [1083624,13712] 0 2024-09-19T09:02:59.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/558: chown d1/d8/d2d/d72/c8a 28321769 1 2024-09-19T09:02:59.182 INFO:tasks.workunit.client.0.smithi049.stdout:6/328: dwrite dc/d12/f4d [4194304,4194304] 0 2024-09-19T09:02:59.184 INFO:tasks.workunit.client.0.smithi049.stdout:6/329: truncate dc/d12/f15 8551154 0 2024-09-19T09:02:59.185 INFO:tasks.workunit.client.0.smithi049.stdout:6/330: dread - dc/d12/d5a/f64 zero size 2024-09-19T09:02:59.190 INFO:tasks.workunit.client.0.smithi049.stdout:8/525: write d1/f39 [2885826,114632] 0 2024-09-19T09:02:59.194 INFO:tasks.workunit.client.0.smithi049.stdout:8/526: rename d1/l1e to d1/d27/l9b 0 2024-09-19T09:02:59.196 INFO:tasks.workunit.client.0.smithi049.stdout:8/527: creat d1/d11/d3f/f9c x:0 0 0 2024-09-19T09:02:59.198 INFO:tasks.workunit.client.0.smithi049.stdout:6/331: write dc/d16/f2d [370576,129224] 0 2024-09-19T09:02:59.199 INFO:tasks.workunit.client.0.smithi049.stdout:8/528: write d1/d1a/f3b [1490215,51968] 0 2024-09-19T09:02:59.202 INFO:tasks.workunit.client.0.smithi049.stdout:6/332: mknod dc/d12/d5a/c68 0 2024-09-19T09:02:59.203 INFO:tasks.workunit.client.0.smithi049.stdout:8/529: mkdir d1/d11/d4f/d9d 0 2024-09-19T09:02:59.204 INFO:tasks.workunit.client.0.smithi049.stdout:7/559: dwrite d1/d53/d18/d59/f48 [0,4194304] 0 2024-09-19T09:02:59.205 INFO:tasks.workunit.client.0.smithi049.stdout:6/333: write dc/d1b/d20/d2f/f51 [277459,124640] 0 2024-09-19T09:02:59.206 INFO:tasks.workunit.client.0.smithi049.stdout:7/560: chown d1/d53/d18/d50/d7c/fbd 32752159 1 2024-09-19T09:02:59.208 INFO:tasks.workunit.client.0.smithi049.stdout:7/561: write d1/d53/d18/d59/fa6 [108089,79854] 0 2024-09-19T09:02:59.210 INFO:tasks.workunit.client.0.smithi049.stdout:6/334: creat dc/d1b/d20/d2f/d31/f69 x:0 0 0 2024-09-19T09:02:59.211 INFO:tasks.workunit.client.0.smithi049.stdout:6/335: symlink dc/d16/l6a 0 2024-09-19T09:02:59.212 INFO:tasks.workunit.client.0.smithi049.stdout:6/336: dread - dc/d16/f4a zero size 2024-09-19T09:02:59.222 INFO:tasks.workunit.client.0.smithi049.stdout:6/337: getdents dc/d1b/d20/d2f 0 2024-09-19T09:02:59.230 INFO:tasks.workunit.client.0.smithi049.stdout:6/338: truncate dc/d1b/d20/d2f/f3f 3766172 0 2024-09-19T09:02:59.233 INFO:tasks.workunit.client.0.smithi049.stdout:8/530: dread d1/d11/d4f/d87/f83 [0,4194304] 0 2024-09-19T09:02:59.237 INFO:tasks.workunit.client.0.smithi049.stdout:8/531: truncate d1/d11/d3f/d8c/f8d 846099 0 2024-09-19T09:02:59.238 INFO:tasks.workunit.client.0.smithi049.stdout:6/339: dwrite dc/d1b/d20/d2f/d31/f65 [0,4194304] 0 2024-09-19T09:02:59.246 INFO:tasks.workunit.client.0.smithi049.stdout:8/532: symlink d1/d11/d4f/d9d/l9e 0 2024-09-19T09:02:59.247 INFO:tasks.workunit.client.0.smithi049.stdout:6/340: dwrite dc/d16/f4a [0,4194304] 0 2024-09-19T09:02:59.255 INFO:tasks.workunit.client.0.smithi049.stdout:6/341: dwrite dc/d16/f3b [0,4194304] 0 2024-09-19T09:02:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:58 smithi102 ceph-mon[35280]: pgmap v36: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 182 MiB/s wr, 373 op/s 2024-09-19T09:02:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:58 smithi102 ceph-mon[35280]: Standby manager daemon smithi049.qdvksw restarted 2024-09-19T09:02:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:58 smithi102 ceph-mon[35280]: Standby manager daemon smithi049.qdvksw started 2024-09-19T09:02:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:58 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/crt"}]: dispatch 2024-09-19T09:02:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:58 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:02:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:58 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/key"}]: dispatch 2024-09-19T09:02:59.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:02:58 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:02:59.269 INFO:tasks.workunit.client.0.smithi049.stdout:6/342: fsync dc/d1b/d20/d2f/d31/f65 0 2024-09-19T09:02:59.270 INFO:tasks.workunit.client.0.smithi049.stdout:6/343: rmdir dc 39 2024-09-19T09:02:59.277 INFO:tasks.workunit.client.0.smithi049.stdout:6/344: dwrite dc/d12/f29 [0,4194304] 0 2024-09-19T09:02:59.277 INFO:tasks.workunit.client.0.smithi049.stdout:8/533: truncate d1/d11/d4f/d87/d5d/d65/f7e 2760050 0 2024-09-19T09:02:59.278 INFO:tasks.workunit.client.0.smithi049.stdout:6/345: readlink dc/d1b/d20/d2f/d31/l61 0 2024-09-19T09:02:59.280 INFO:tasks.workunit.client.0.smithi049.stdout:6/346: read dc/d16/f3b [3302902,98705] 0 2024-09-19T09:02:59.281 INFO:tasks.workunit.client.0.smithi049.stdout:8/534: mkdir d1/d11/d2e/d4e/d61/d9f 0 2024-09-19T09:02:59.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/535: mknod d1/d11/d4f/d87/d5d/ca0 0 2024-09-19T09:02:59.289 INFO:tasks.workunit.client.0.smithi049.stdout:2/573: sync 2024-09-19T09:02:59.289 INFO:tasks.workunit.client.0.smithi049.stdout:9/574: sync 2024-09-19T09:02:59.289 INFO:tasks.workunit.client.0.smithi049.stdout:4/369: sync 2024-09-19T09:02:59.289 INFO:tasks.workunit.client.0.smithi049.stdout:1/291: sync 2024-09-19T09:02:59.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/401: sync 2024-09-19T09:02:59.290 INFO:tasks.workunit.client.0.smithi049.stdout:0/566: sync 2024-09-19T09:02:59.290 INFO:tasks.workunit.client.0.smithi049.stdout:3/447: sync 2024-09-19T09:02:59.291 INFO:tasks.workunit.client.0.smithi049.stdout:0/567: chown d5/d10/d2f/ca1 50438196 1 2024-09-19T09:02:59.292 INFO:tasks.workunit.client.0.smithi049.stdout:9/575: truncate d3/d14/d1a/fb3 609372 0 2024-09-19T09:02:59.293 INFO:tasks.workunit.client.0.smithi049.stdout:1/292: unlink d5/f53 0 2024-09-19T09:02:59.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/574: creat d1/d2/d23/d49/d75/fc1 x:0 0 0 2024-09-19T09:02:59.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/536: creat d1/d11/d45/fa1 x:0 0 0 2024-09-19T09:02:59.301 INFO:tasks.workunit.client.0.smithi049.stdout:6/347: dwrite dc/d12/f14 [8388608,4194304] 0 2024-09-19T09:02:59.301 INFO:tasks.workunit.client.0.smithi049.stdout:2/575: write d1/d4/d1e/d9f/db3/f5d [2584873,110798] 0 2024-09-19T09:02:59.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:58 smithi049 ceph-mon[28158]: pgmap v36: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 182 MiB/s wr, 373 op/s 2024-09-19T09:02:59.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:58 smithi049 ceph-mon[28158]: Standby manager daemon smithi049.qdvksw restarted 2024-09-19T09:02:59.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:58 smithi049 ceph-mon[28158]: Standby manager daemon smithi049.qdvksw started 2024-09-19T09:02:59.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:58 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/crt"}]: dispatch 2024-09-19T09:02:59.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:58 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:02:59.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:58 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.qdvksw/key"}]: dispatch 2024-09-19T09:02:59.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:02:58 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:02:59.304 INFO:tasks.workunit.client.0.smithi049.stdout:0/568: rmdir d5/d10/d13 39 2024-09-19T09:02:59.307 INFO:tasks.workunit.client.0.smithi049.stdout:4/370: mkdir d4/d15/d19/d1f/d77 0 2024-09-19T09:02:59.310 INFO:tasks.workunit.client.0.smithi049.stdout:1/293: dread d5/d6/d19/d21/f32 [0,4194304] 0 2024-09-19T09:02:59.313 INFO:tasks.workunit.client.0.smithi049.stdout:6/348: dwrite dc/d1b/d20/d2f/d4c/f5e [4194304,4194304] 0 2024-09-19T09:02:59.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/537: write d1/d11/d4f/d87/f7f [1038146,35289] 0 2024-09-19T09:02:59.317 INFO:tasks.workunit.client.0.smithi049.stdout:9/576: dread d3/d14/d1a/d21/d31/fba [0,4194304] 0 2024-09-19T09:02:59.318 INFO:tasks.workunit.client.0.smithi049.stdout:9/577: chown d3/d14/d34/d74/f87 2 1 2024-09-19T09:02:59.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/576: truncate d1/d4/d1e/d45/f48 514598 0 2024-09-19T09:02:59.322 INFO:tasks.workunit.client.0.smithi049.stdout:3/448: dwrite d10/d11/d13/d30/f74 [4194304,4194304] 0 2024-09-19T09:02:59.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/578: chown d3/d14/d1a/d21/d31/d8e/fab 238 1 2024-09-19T09:02:59.323 INFO:tasks.workunit.client.0.smithi049.stdout:5/402: mknod d3/dc/d43/c79 0 2024-09-19T09:02:59.323 INFO:tasks.workunit.client.0.smithi049.stdout:3/449: chown d10/d3d/d79/d80/f8a 0 1 2024-09-19T09:02:59.327 INFO:tasks.workunit.client.0.smithi049.stdout:1/294: mkdir d5/d6/d19/d30/d63 0 2024-09-19T09:02:59.328 INFO:tasks.workunit.client.0.smithi049.stdout:1/295: read - d5/d6/d8/f5d zero size 2024-09-19T09:02:59.329 INFO:tasks.workunit.client.0.smithi049.stdout:6/349: mkdir dc/d1b/d20/d2f/d6b 0 2024-09-19T09:02:59.331 INFO:tasks.workunit.client.0.smithi049.stdout:6/350: write dc/d12/d5a/f64 [199782,49702] 0 2024-09-19T09:02:59.332 INFO:tasks.workunit.client.0.smithi049.stdout:2/577: truncate d1/d2d/f37 2890409 0 2024-09-19T09:02:59.334 INFO:tasks.workunit.client.0.smithi049.stdout:5/403: mkdir d3/d5/de/d12/d45/d7a 0 2024-09-19T09:02:59.336 INFO:tasks.workunit.client.0.smithi049.stdout:1/296: chown d5/d6/d8/d13/d24/f2f 107364580 1 2024-09-19T09:02:59.337 INFO:tasks.workunit.client.0.smithi049.stdout:0/569: creat d5/d10/d13/d30/d9f/fad x:0 0 0 2024-09-19T09:02:59.338 INFO:tasks.workunit.client.0.smithi049.stdout:0/570: chown d5/d10/d13/d15/d29/d9a/c62 4 1 2024-09-19T09:02:59.339 INFO:tasks.workunit.client.0.smithi049.stdout:0/571: read d5/d10/d13/f1c [1030941,61646] 0 2024-09-19T09:02:59.343 INFO:tasks.workunit.client.0.smithi049.stdout:1/297: mkdir d5/d6/d19/d30/d64 0 2024-09-19T09:02:59.345 INFO:tasks.workunit.client.0.smithi049.stdout:6/351: link dc/d1b/d20/d2f/f66 dc/d1b/d20/f6c 0 2024-09-19T09:02:59.346 INFO:tasks.workunit.client.0.smithi049.stdout:6/352: write f0 [3925539,6454] 0 2024-09-19T09:02:59.348 INFO:tasks.workunit.client.0.smithi049.stdout:6/353: chown dc/d12/f27 1188650 1 2024-09-19T09:02:59.348 INFO:tasks.workunit.client.0.smithi049.stdout:6/354: stat dc/d1b/c58 0 2024-09-19T09:02:59.355 INFO:tasks.workunit.client.0.smithi049.stdout:6/355: dwrite dc/d1b/f39 [0,4194304] 0 2024-09-19T09:02:59.359 INFO:tasks.workunit.client.0.smithi049.stdout:9/579: truncate d3/d14/d34/d4c/d9c/fbd 2739333 0 2024-09-19T09:02:59.362 INFO:tasks.workunit.client.0.smithi049.stdout:2/578: write d1/d2/d32/f3d [3420484,92026] 0 2024-09-19T09:02:59.363 INFO:tasks.workunit.client.0.smithi049.stdout:2/579: readlink d1/d2/l1d 0 2024-09-19T09:02:59.365 INFO:tasks.workunit.client.0.smithi049.stdout:6/356: creat dc/d1b/d20/d2f/d4c/f6d x:0 0 0 2024-09-19T09:02:59.367 INFO:tasks.workunit.client.0.smithi049.stdout:0/572: creat d5/d10/fae x:0 0 0 2024-09-19T09:02:59.368 INFO:tasks.workunit.client.0.smithi049.stdout:5/404: rename d3/d5/l7 to d3/d5/l7b 0 2024-09-19T09:02:59.369 INFO:tasks.workunit.client.0.smithi049.stdout:0/573: fdatasync d5/d10/d13/d15/f8d 0 2024-09-19T09:02:59.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/538: dwrite d1/d11/d4f/d87/f49 [0,4194304] 0 2024-09-19T09:02:59.369 INFO:tasks.workunit.client.0.smithi049.stdout:5/405: readlink d3/d5/d20/l29 0 2024-09-19T09:02:59.370 INFO:tasks.workunit.client.0.smithi049.stdout:8/539: dread - d1/d11/d3f/f6b zero size 2024-09-19T09:02:59.378 INFO:tasks.workunit.client.0.smithi049.stdout:1/298: truncate d5/f36 3864424 0 2024-09-19T09:02:59.379 INFO:tasks.workunit.client.0.smithi049.stdout:5/406: write d3/d6c/f47 [512468,12545] 0 2024-09-19T09:02:59.381 INFO:tasks.workunit.client.0.smithi049.stdout:8/540: unlink d1/d27/l7c 0 2024-09-19T09:02:59.386 INFO:tasks.workunit.client.0.smithi049.stdout:2/580: write d1/d2/d70/f9a [89862,4559] 0 2024-09-19T09:02:59.387 INFO:tasks.workunit.client.0.smithi049.stdout:5/407: dwrite d3/dc/d43/f5b [0,4194304] 0 2024-09-19T09:02:59.390 INFO:tasks.workunit.client.0.smithi049.stdout:1/299: unlink d5/d6/d19/l3d 0 2024-09-19T09:02:59.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/574: truncate d5/d10/d13/d15/d36/d3d/f24 1673699 0 2024-09-19T09:02:59.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/357: dwrite dc/d1b/d20/d2f/f66 [0,4194304] 0 2024-09-19T09:02:59.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/541: creat d1/d1a/fa2 x:0 0 0 2024-09-19T09:02:59.402 INFO:tasks.workunit.client.0.smithi049.stdout:9/580: getdents d3/dbb 0 2024-09-19T09:02:59.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/581: readlink d1/d4/d20/l27 0 2024-09-19T09:02:59.403 INFO:tasks.workunit.client.0.smithi049.stdout:2/582: chown d1/d2/d32/l44 1821223301 1 2024-09-19T09:02:59.405 INFO:tasks.workunit.client.0.smithi049.stdout:6/358: dread dc/d1b/f39 [0,4194304] 0 2024-09-19T09:02:59.405 INFO:tasks.workunit.client.0.smithi049.stdout:9/581: truncate d3/d14/d34/d44/f9a 278824 0 2024-09-19T09:02:59.473 INFO:tasks.workunit.client.0.smithi049.stdout:1/300: creat d5/d6/d19/d30/f65 x:0 0 0 2024-09-19T09:02:59.477 INFO:tasks.workunit.client.0.smithi049.stdout:1/301: dread d5/d6/d19/d21/f3a [0,4194304] 0 2024-09-19T09:02:59.490 INFO:tasks.workunit.client.0.smithi049.stdout:1/302: dread d5/f49 [0,4194304] 0 2024-09-19T09:02:59.492 INFO:tasks.workunit.client.0.smithi049.stdout:2/583: creat d1/d4/d20/d92/fc2 x:0 0 0 2024-09-19T09:02:59.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/584: dread d1/d4/d1e/d9f/db3/d41/d7d/f63 [0,4194304] 0 2024-09-19T09:02:59.517 INFO:tasks.workunit.client.0.smithi049.stdout:0/575: unlink d5/d10/d13/d15/d29/d9a/f87 0 2024-09-19T09:02:59.524 INFO:tasks.workunit.client.0.smithi049.stdout:0/576: dwrite d5/d10/fae [0,4194304] 0 2024-09-19T09:02:59.533 INFO:tasks.workunit.client.0.smithi049.stdout:0/577: dwrite d5/ff [0,4194304] 0 2024-09-19T09:02:59.533 INFO:tasks.workunit.client.0.smithi049.stdout:0/578: chown d5/d10 77568430 1 2024-09-19T09:02:59.539 INFO:tasks.workunit.client.0.smithi049.stdout:2/585: mkdir d1/d2b/d7c/dc3 0 2024-09-19T09:02:59.560 INFO:tasks.workunit.client.0.smithi049.stdout:2/586: link d1/d4/d20/d92/fc2 d1/d4/d1e/d9f/db7/fc4 0 2024-09-19T09:02:59.593 INFO:tasks.workunit.client.0.smithi049.stdout:5/408: write d3/d5/d1c/f2b [18062,31180] 0 2024-09-19T09:02:59.600 INFO:tasks.workunit.client.0.smithi049.stdout:5/409: getdents d3 0 2024-09-19T09:02:59.607 INFO:tasks.workunit.client.0.smithi049.stdout:5/410: dwrite d3/d5/d1c/d2d/f60 [0,4194304] 0 2024-09-19T09:02:59.613 INFO:tasks.workunit.client.0.smithi049.stdout:5/411: dread d3/d5/d20/d38/f4d [0,4194304] 0 2024-09-19T09:02:59.618 INFO:tasks.workunit.client.0.smithi049.stdout:5/412: mkdir d3/d5/d1c/d4c/d7c 0 2024-09-19T09:02:59.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/359: write dc/d1b/d20/f32 [2520535,110173] 0 2024-09-19T09:02:59.652 INFO:tasks.workunit.client.0.smithi049.stdout:0/579: unlink d5/fd 0 2024-09-19T09:02:59.655 INFO:tasks.workunit.client.0.smithi049.stdout:0/580: creat d5/d10/d2f/faf x:0 0 0 2024-09-19T09:02:59.659 INFO:tasks.workunit.client.0.smithi049.stdout:0/581: creat d5/d10/d13/d30/d9f/fb0 x:0 0 0 2024-09-19T09:02:59.662 INFO:tasks.workunit.client.0.smithi049.stdout:1/303: truncate d5/f23 661777 0 2024-09-19T09:02:59.668 INFO:tasks.workunit.client.0.smithi049.stdout:0/582: creat d5/fb1 x:0 0 0 2024-09-19T09:02:59.670 INFO:tasks.workunit.client.0.smithi049.stdout:0/583: read - d5/d10/d13/d30/d75/f81 zero size 2024-09-19T09:02:59.671 INFO:tasks.workunit.client.0.smithi049.stdout:1/304: dwrite d5/d6/d8/d13/f55 [0,4194304] 0 2024-09-19T09:02:59.674 INFO:tasks.workunit.client.0.smithi049.stdout:0/584: write d5/d86/f95 [894307,117365] 0 2024-09-19T09:02:59.679 INFO:tasks.workunit.client.0.smithi049.stdout:0/585: write d5/d10/d13/d30/f31 [3750530,117640] 0 2024-09-19T09:02:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/587: creat d1/fc5 x:0 0 0 2024-09-19T09:02:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:2/588: rmdir d1/d4/d1e/d9f 39 2024-09-19T09:02:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:2/589: creat d1/d4/d20/fc6 x:0 0 0 2024-09-19T09:02:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/582: write d3/d14/d34/d4c/d9c/fbd [1156040,78363] 0 2024-09-19T09:02:59.731 INFO:tasks.workunit.client.0.smithi049.stdout:8/542: symlink d1/la3 0 2024-09-19T09:02:59.735 INFO:tasks.workunit.client.0.smithi049.stdout:2/590: dread d1/d4/d1e/d9f/db3/f85 [0,4194304] 0 2024-09-19T09:02:59.735 INFO:tasks.workunit.client.0.smithi049.stdout:9/583: link d3/d14/d1a/d21/d66/fc6 d3/d14/d34/d9f/fc9 0 2024-09-19T09:02:59.737 INFO:tasks.workunit.client.0.smithi049.stdout:9/584: fdatasync d3/d14/faa 0 2024-09-19T09:02:59.739 INFO:tasks.workunit.client.0.smithi049.stdout:2/591: mkdir d1/d4/d20/dc7 0 2024-09-19T09:02:59.741 INFO:tasks.workunit.client.0.smithi049.stdout:8/543: dwrite d1/d11/d4f/d87/d5d/d65/f7e [0,4194304] 0 2024-09-19T09:02:59.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/585: rename d3/d14/d34/d4c/c8b to d3/d14/d1a/d90/dae/cca 0 2024-09-19T09:02:59.746 INFO:tasks.workunit.client.0.smithi049.stdout:2/592: fdatasync d1/f6a 0 2024-09-19T09:02:59.750 INFO:tasks.workunit.client.0.smithi049.stdout:9/586: rmdir d3/d14/d34 39 2024-09-19T09:02:59.751 INFO:tasks.workunit.client.0.smithi049.stdout:9/587: chown d3 1 1 2024-09-19T09:02:59.756 INFO:tasks.workunit.client.0.smithi049.stdout:2/593: dwrite d1/d2/d23/f56 [4194304,4194304] 0 2024-09-19T09:02:59.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/594: dwrite d1/d4/f17 [0,4194304] 0 2024-09-19T09:02:59.772 INFO:tasks.workunit.client.0.smithi049.stdout:0/586: dwrite d5/d10/d13/d15/d36/d3d/f7c [0,4194304] 0 2024-09-19T09:02:59.774 INFO:tasks.workunit.client.0.smithi049.stdout:0/587: write d5/d86/f95 [724047,103274] 0 2024-09-19T09:02:59.787 INFO:tasks.workunit.client.0.smithi049.stdout:0/588: mknod d5/d10/d13/d15/d29/cb2 0 2024-09-19T09:02:59.788 INFO:tasks.workunit.client.0.smithi049.stdout:0/589: fdatasync d5/d10/d13/f80 0 2024-09-19T09:02:59.789 INFO:tasks.workunit.client.0.smithi049.stdout:0/590: chown d5/d10/d82/c88 14 1 2024-09-19T09:02:59.792 INFO:tasks.workunit.client.0.smithi049.stdout:0/591: mknod d5/d64/d97/cb3 0 2024-09-19T09:02:59.793 INFO:tasks.workunit.client.0.smithi049.stdout:1/305: write d5/f23 [571281,112925] 0 2024-09-19T09:02:59.794 INFO:tasks.workunit.client.0.smithi049.stdout:9/588: truncate d3/d14/d1a/fb3 509770 0 2024-09-19T09:02:59.795 INFO:tasks.workunit.client.0.smithi049.stdout:0/592: chown d5/d10/d13/d15/d36/c73 3 1 2024-09-19T09:02:59.804 INFO:tasks.workunit.client.0.smithi049.stdout:2/595: dread d1/d4/d20/d26/f8a [0,4194304] 0 2024-09-19T09:02:59.805 INFO:tasks.workunit.client.0.smithi049.stdout:1/306: dwrite d5/d6/d19/f42 [0,4194304] 0 2024-09-19T09:02:59.807 INFO:tasks.workunit.client.0.smithi049.stdout:9/589: dwrite d3/d14/d34/f88 [0,4194304] 0 2024-09-19T09:02:59.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/307: unlink d5/d6/d19/d21/f58 0 2024-09-19T09:02:59.821 INFO:tasks.workunit.client.0.smithi049.stdout:0/593: dwrite d5/d10/d13/d15/d29/f4b [0,4194304] 0 2024-09-19T09:02:59.823 INFO:tasks.workunit.client.0.smithi049.stdout:1/308: symlink d5/d6/d8/d13/d24/l66 0 2024-09-19T09:02:59.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/594: mkdir d5/d10/d82/d67/d85/db4 0 2024-09-19T09:02:59.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/309: creat d5/f67 x:0 0 0 2024-09-19T09:02:59.829 INFO:tasks.workunit.client.0.smithi049.stdout:1/310: creat d5/d6/d19/d30/d63/f68 x:0 0 0 2024-09-19T09:02:59.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/311: write d5/d6/d19/d21/f46 [2271350,70755] 0 2024-09-19T09:02:59.832 INFO:tasks.workunit.client.0.smithi049.stdout:1/312: write d5/f23 [452209,57980] 0 2024-09-19T09:02:59.834 INFO:tasks.workunit.client.0.smithi049.stdout:1/313: mkdir d5/d6/dc/d69 0 2024-09-19T09:02:59.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/314: unlink d5/d6/d8/d1a/f40 0 2024-09-19T09:02:59.837 INFO:tasks.workunit.client.0.smithi049.stdout:2/596: dread d1/d2/d32/f83 [0,4194304] 0 2024-09-19T09:02:59.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/315: symlink d5/d6/dc/l6a 0 2024-09-19T09:02:59.841 INFO:tasks.workunit.client.0.smithi049.stdout:2/597: getdents d1/d4/d1e/d9f 0 2024-09-19T09:02:59.842 INFO:tasks.workunit.client.0.smithi049.stdout:2/598: chown d1/d4/d1e/d9f/fb1 168128 1 2024-09-19T09:02:59.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/590: dread d3/f43 [0,4194304] 0 2024-09-19T09:02:59.848 INFO:tasks.workunit.client.0.smithi049.stdout:9/591: write d3/d14/d1a/d21/f2f [4218549,126555] 0 2024-09-19T09:02:59.852 INFO:tasks.workunit.client.0.smithi049.stdout:9/592: rename d3/d14/d1a/d21/d31/l3a to d3/d14/d34/d9f/d82/lcb 0 2024-09-19T09:02:59.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/599: truncate f0 8279767 0 2024-09-19T09:02:59.858 INFO:tasks.workunit.client.0.smithi049.stdout:9/593: dwrite d3/d14/d34/f88 [0,4194304] 0 2024-09-19T09:02:59.860 INFO:tasks.workunit.client.0.smithi049.stdout:9/594: read d3/fa3 [16172,89861] 0 2024-09-19T09:02:59.861 INFO:tasks.workunit.client.0.smithi049.stdout:2/600: rmdir d1/d2/d32 39 2024-09-19T09:02:59.862 INFO:tasks.workunit.client.0.smithi049.stdout:9/595: dread d3/d14/faa [0,4194304] 0 2024-09-19T09:02:59.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/596: creat d3/dbb/fcc x:0 0 0 2024-09-19T09:02:59.870 INFO:tasks.workunit.client.0.smithi049.stdout:2/601: truncate d1/d2/f67 792643 0 2024-09-19T09:02:59.874 INFO:tasks.workunit.client.0.smithi049.stdout:2/602: mkdir d1/d4/d20/dc8 0 2024-09-19T09:02:59.880 INFO:tasks.workunit.client.0.smithi049.stdout:9/597: dread d3/d14/d34/f56 [0,4194304] 0 2024-09-19T09:02:59.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/603: dread d1/d2/d32/f83 [0,4194304] 0 2024-09-19T09:02:59.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/604: mknod d1/d4/d1e/d21/dae/cc9 0 2024-09-19T09:02:59.884 INFO:tasks.workunit.client.0.smithi049.stdout:9/598: fdatasync d3/d14/d34/f95 0 2024-09-19T09:02:59.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/605: rmdir d1/d4/d20/d92 39 2024-09-19T09:02:59.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/599: rmdir d3/d14/d1a/d21/d31/d8e/dc2/d9e 39 2024-09-19T09:02:59.895 INFO:tasks.workunit.client.0.smithi049.stdout:9/600: write d3/fa3 [661794,59774] 0 2024-09-19T09:02:59.895 INFO:tasks.workunit.client.0.smithi049.stdout:2/606: write d1/d2/f67 [1133195,3348] 0 2024-09-19T09:02:59.897 INFO:tasks.workunit.client.0.smithi049.stdout:2/607: readlink d1/d4/d1e/d21/l69 0 2024-09-19T09:02:59.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/608: dread - d1/d4/f3c zero size 2024-09-19T09:02:59.905 INFO:tasks.workunit.client.0.smithi049.stdout:2/609: getdents d1/d2 0 2024-09-19T09:02:59.906 INFO:tasks.workunit.client.0.smithi049.stdout:9/601: dread d3/d14/d1a/f35 [0,4194304] 0 2024-09-19T09:02:59.907 INFO:tasks.workunit.client.0.smithi049.stdout:2/610: chown d1/d2/d23/f80 2 1 2024-09-19T09:02:59.909 INFO:tasks.workunit.client.0.smithi049.stdout:9/602: mkdir d3/d14/d1a/d21/dcd 0 2024-09-19T09:02:59.911 INFO:tasks.workunit.client.0.smithi049.stdout:9/603: write d3/d14/d34/d44/f4b [3806884,44916] 0 2024-09-19T09:02:59.914 INFO:tasks.workunit.client.0.smithi049.stdout:9/604: creat d3/d14/d1a/d21/d31/fce x:0 0 0 2024-09-19T09:02:59.917 INFO:tasks.workunit.client.0.smithi049.stdout:9/605: dread d3/f43 [0,4194304] 0 2024-09-19T09:02:59.922 INFO:tasks.workunit.client.0.smithi049.stdout:2/611: dwrite d1/f11 [0,4194304] 0 2024-09-19T09:02:59.927 INFO:tasks.workunit.client.0.smithi049.stdout:9/606: dwrite d3/d14/d1a/f80 [0,4194304] 0 2024-09-19T09:02:59.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/607: mknod d3/d14/d1a/d21/dcd/ccf 0 2024-09-19T09:02:59.941 INFO:tasks.workunit.client.0.smithi049.stdout:2/612: dread d1/d2/f24 [0,4194304] 0 2024-09-19T09:02:59.943 INFO:tasks.workunit.client.0.smithi049.stdout:2/613: dread - d1/d4/d1e/d21/fbf zero size 2024-09-19T09:02:59.945 INFO:tasks.workunit.client.0.smithi049.stdout:9/608: dwrite d3/d14/d1a/f25 [4194304,4194304] 0 2024-09-19T09:02:59.949 INFO:tasks.workunit.client.0.smithi049.stdout:2/614: unlink d1/d4/d1e/d9f/db3/d41/d7d/f63 0 2024-09-19T09:02:59.952 INFO:tasks.workunit.client.0.smithi049.stdout:9/609: mkdir d3/d14/d34/d9f/d82/dd0 0 2024-09-19T09:02:59.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/615: mkdir d1/d2/d23/dca 0 2024-09-19T09:02:59.960 INFO:tasks.workunit.client.0.smithi049.stdout:2/616: dwrite d1/d4/d20/f58 [0,4194304] 0 2024-09-19T09:02:59.961 INFO:tasks.workunit.client.0.smithi049.stdout:2/617: chown d1/d4/f1f 252456781 1 2024-09-19T09:02:59.964 INFO:tasks.workunit.client.0.smithi049.stdout:9/610: write d3/d14/d1a/d21/fb5 [1278362,7262] 0 2024-09-19T09:02:59.969 INFO:tasks.workunit.client.0.smithi049.stdout:2/618: dwrite d1/d4/d20/f81 [0,4194304] 0 2024-09-19T09:02:59.970 INFO:tasks.workunit.client.0.smithi049.stdout:9/611: creat d3/d14/d1a/d21/d67/d94/fd1 x:0 0 0 2024-09-19T09:02:59.977 INFO:tasks.workunit.client.0.smithi049.stdout:9/612: creat d3/d14/d1a/d21/d31/d8e/dc2/d9e/fd2 x:0 0 0 2024-09-19T09:02:59.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/619: dwrite d1/d2/d23/d49/d75/f84 [0,4194304] 0 2024-09-19T09:02:59.987 INFO:tasks.workunit.client.0.smithi049.stdout:2/620: stat d1/d4/d1e/d21/c36 0 2024-09-19T09:02:59.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/613: dwrite d3/fa3 [0,4194304] 0 2024-09-19T09:02:59.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/621: dread - d1/d2/d6c/fa0 zero size 2024-09-19T09:02:59.991 INFO:tasks.workunit.client.0.smithi049.stdout:9/614: rmdir d3/d14/d34/d44 39 2024-09-19T09:03:00.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/615: dwrite d3/d14/d1a/d21/d31/fb6 [0,4194304] 0 2024-09-19T09:03:00.008 INFO:tasks.workunit.client.0.smithi049.stdout:2/622: truncate d1/d4/d20/d26/f8a 1821841 0 2024-09-19T09:03:00.010 INFO:tasks.workunit.client.0.smithi049.stdout:9/616: dwrite d3/d14/d1a/d21/d31/fb6 [0,4194304] 0 2024-09-19T09:03:00.016 INFO:tasks.workunit.client.0.smithi049.stdout:2/623: link d1/d4/d20/f58 d1/d2/d23/dca/fcb 0 2024-09-19T09:03:00.018 INFO:tasks.workunit.client.0.smithi049.stdout:9/617: mknod d3/d14/d34/d9f/d82/dd0/cd3 0 2024-09-19T09:03:00.022 INFO:tasks.workunit.client.0.smithi049.stdout:9/618: write d3/d14/d1a/d21/d67/d94/f79 [3018189,9867] 0 2024-09-19T09:03:00.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/619: write d3/dbb/fcc [57912,111891] 0 2024-09-19T09:03:00.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/620: chown d3/d14/d34/d4c/d9c/fbd 0 1 2024-09-19T09:03:00.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/621: fsync d3/d14/d34/f56 0 2024-09-19T09:03:00.071 INFO:tasks.workunit.client.0.smithi049.stdout:2/624: truncate d1/d4/d20/f1c 3846869 0 2024-09-19T09:03:00.077 INFO:tasks.workunit.client.0.smithi049.stdout:9/622: dwrite d3/d14/f1e [4194304,4194304] 0 2024-09-19T09:03:00.079 INFO:tasks.workunit.client.0.smithi049.stdout:7/562: sync 2024-09-19T09:03:00.080 INFO:tasks.workunit.client.0.smithi049.stdout:7/563: readlink d1/d53/l4a 0 2024-09-19T09:03:00.085 INFO:tasks.workunit.client.0.smithi049.stdout:9/623: rename d3/d14/d1a/d21/dcd to d3/d14/d34/d9f/d82/dd0/dd4 0 2024-09-19T09:03:00.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/625: write d1/d4/d1e/d45/f48 [1333585,82335] 0 2024-09-19T09:03:00.088 INFO:tasks.workunit.client.0.smithi049.stdout:9/624: write d3/d14/d1a/d21/f41 [4739936,130235] 0 2024-09-19T09:03:00.092 INFO:tasks.workunit.client.0.smithi049.stdout:2/626: mknod d1/ccc 0 2024-09-19T09:03:00.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/627: read d1/d4/d1e/d9f/db3/d41/fa7 [243509,126614] 0 2024-09-19T09:03:00.101 INFO:tasks.workunit.client.0.smithi049.stdout:7/564: dread d1/d7/f14 [0,4194304] 0 2024-09-19T09:03:00.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/625: truncate d3/d14/d1a/d21/d31/f62 3242702 0 2024-09-19T09:03:00.111 INFO:tasks.workunit.client.0.smithi049.stdout:7/565: truncate d1/d53/f3e 1294203 0 2024-09-19T09:03:00.111 INFO:tasks.workunit.client.0.smithi049.stdout:9/626: dwrite d3/d14/d34/d74/f87 [4194304,4194304] 0 2024-09-19T09:03:00.119 INFO:tasks.workunit.client.0.smithi049.stdout:9/627: dwrite d3/dbb/fcc [0,4194304] 0 2024-09-19T09:03:00.119 INFO:tasks.workunit.client.0.smithi049.stdout:7/566: getdents d1/d53/d18/d50/d7c/d9c 0 2024-09-19T09:03:00.122 INFO:tasks.workunit.client.0.smithi049.stdout:7/567: mknod d1/cbe 0 2024-09-19T09:03:00.124 INFO:tasks.workunit.client.0.smithi049.stdout:7/568: dread - d1/d8/d2d/d36/fb7 zero size 2024-09-19T09:03:00.134 INFO:tasks.workunit.client.0.smithi049.stdout:9/628: dwrite d3/d14/d1a/d21/d31/fba [0,4194304] 0 2024-09-19T09:03:00.141 INFO:tasks.workunit.client.0.smithi049.stdout:7/569: dwrite d1/d8/d80/f96 [0,4194304] 0 2024-09-19T09:03:00.149 INFO:tasks.workunit.client.0.smithi049.stdout:9/629: dread d3/d14/d1a/d21/f2f [0,4194304] 0 2024-09-19T09:03:00.165 INFO:tasks.workunit.client.0.smithi049.stdout:7/570: write d1/d8/d19/f46 [21752,18186] 0 2024-09-19T09:03:00.168 INFO:tasks.workunit.client.0.smithi049.stdout:9/630: write d3/d14/d34/f56 [1102325,96412] 0 2024-09-19T09:03:00.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/631: readlink d3/d14/d34/d9f/d82/db1/l6d 0 2024-09-19T09:03:00.170 INFO:tasks.workunit.client.0.smithi049.stdout:9/632: chown d3/d14/d34/d4c/fb4 9 1 2024-09-19T09:03:00.171 INFO:tasks.workunit.client.0.smithi049.stdout:7/571: write d1/d8/d2d/d36/d91/fa1 [273054,93648] 0 2024-09-19T09:03:00.178 INFO:tasks.workunit.client.0.smithi049.stdout:7/572: creat d1/d53/d18/fbf x:0 0 0 2024-09-19T09:03:00.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/633: dwrite d3/d14/d1a/d21/d67/d94/f7c [0,4194304] 0 2024-09-19T09:03:00.181 INFO:tasks.workunit.client.0.smithi049.stdout:7/573: mknod d1/d53/d18/d50/d58/d62/cc0 0 2024-09-19T09:03:00.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/574: mkdir d1/d8/d89/dc1 0 2024-09-19T09:03:00.194 INFO:tasks.workunit.client.0.smithi049.stdout:7/575: dwrite d1/d8/d2d/d72/fb4 [0,4194304] 0 2024-09-19T09:03:00.199 INFO:tasks.workunit.client.0.smithi049.stdout:9/634: dread d3/d14/d1a/d21/d31/f62 [0,4194304] 0 2024-09-19T09:03:00.201 INFO:tasks.workunit.client.0.smithi049.stdout:7/576: rmdir d1/d8/d89/dc1 0 2024-09-19T09:03:00.202 INFO:tasks.workunit.client.0.smithi049.stdout:7/577: stat d1/d8/d2d/d31/l7e 0 2024-09-19T09:03:00.202 INFO:tasks.workunit.client.0.smithi049.stdout:9/635: symlink d3/d14/d34/d9f/d82/db1/ld5 0 2024-09-19T09:03:00.209 INFO:tasks.workunit.client.0.smithi049.stdout:9/636: dwrite d3/d14/d1a/d21/d31/d8e/dc2/d9e/fd2 [0,4194304] 0 2024-09-19T09:03:00.211 INFO:tasks.workunit.client.0.smithi049.stdout:9/637: fsync d3/d14/d1a/d90/f71 0 2024-09-19T09:03:00.214 INFO:tasks.workunit.client.0.smithi049.stdout:9/638: symlink d3/d14/d1a/d21/d67/ld6 0 2024-09-19T09:03:00.225 INFO:tasks.workunit.client.0.smithi049.stdout:7/578: dwrite d1/d8/d2d/d31/fa4 [0,4194304] 0 2024-09-19T09:03:00.226 INFO:tasks.workunit.client.0.smithi049.stdout:7/579: chown d1/d8/d2d 4536958 1 2024-09-19T09:03:00.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/580: dread - d1/d8/f5e zero size 2024-09-19T09:03:00.231 INFO:tasks.workunit.client.0.smithi049.stdout:7/581: truncate d1/d8/d2d/d36/fb7 208859 0 2024-09-19T09:03:00.238 INFO:tasks.workunit.client.0.smithi049.stdout:7/582: dwrite d1/d8/d2d/d31/fa4 [0,4194304] 0 2024-09-19T09:03:00.241 INFO:tasks.workunit.client.0.smithi049.stdout:7/583: mknod d1/d53/d18/d50/d58/d62/d6b/cc2 0 2024-09-19T09:03:00.246 INFO:tasks.workunit.client.0.smithi049.stdout:7/584: rename d1/d53/d18/d50/d58/d62/d6b/l9a to d1/d53/d18/d50/d7c/d99/lc3 0 2024-09-19T09:03:00.246 INFO:tasks.workunit.client.0.smithi049.stdout:9/639: dread d3/d14/f1e [0,4194304] 0 2024-09-19T09:03:00.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/640: creat d3/d14/d1a/d21/d67/fd7 x:0 0 0 2024-09-19T09:03:00.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/585: rename d1/d8/f54 to d1/d53/d18/d50/daa/fc4 0 2024-09-19T09:03:00.256 INFO:tasks.workunit.client.0.smithi049.stdout:9/641: dwrite d3/d14/d34/f56 [0,4194304] 0 2024-09-19T09:03:00.261 INFO:tasks.workunit.client.0.smithi049.stdout:9/642: fsync d3/f43 0 2024-09-19T09:03:00.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/643: dread d3/d14/d34/d74/f99 [0,4194304] 0 2024-09-19T09:03:00.264 INFO:tasks.workunit.client.0.smithi049.stdout:7/586: write d1/f68 [1627795,18451] 0 2024-09-19T09:03:00.265 INFO:tasks.workunit.client.0.smithi049.stdout:7/587: fdatasync d1/d53/f5d 0 2024-09-19T09:03:00.266 INFO:tasks.workunit.client.0.smithi049.stdout:7/588: chown d1/d53/d18/fb6 556 1 2024-09-19T09:03:00.270 INFO:tasks.workunit.client.0.smithi049.stdout:9/644: dwrite d3/d14/d1a/d21/d67/d94/f5b [4194304,4194304] 0 2024-09-19T09:03:00.275 INFO:tasks.workunit.client.0.smithi049.stdout:7/589: dwrite d1/d8/d19/f46 [0,4194304] 0 2024-09-19T09:03:00.275 INFO:tasks.workunit.client.0.smithi049.stdout:9/645: rename d3/d14/d1a/f61 to d3/d14/d1a/d21/d67/d94/fd8 0 2024-09-19T09:03:00.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/590: dread d1/d53/d18/d59/fa6 [0,4194304] 0 2024-09-19T09:03:00.279 INFO:tasks.workunit.client.0.smithi049.stdout:9/646: mknod d3/d14/d34/cd9 0 2024-09-19T09:03:00.280 INFO:tasks.workunit.client.0.smithi049.stdout:7/591: dread - d1/d53/d18/fb6 zero size 2024-09-19T09:03:00.283 INFO:tasks.workunit.client.0.smithi049.stdout:9/647: creat d3/d14/d34/d9f/d82/dd0/dd4/fda x:0 0 0 2024-09-19T09:03:00.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/592: symlink d1/d8/d2d/d31/d6e/lc5 0 2024-09-19T09:03:00.286 INFO:tasks.workunit.client.0.smithi049.stdout:9/648: mknod d3/d14/d34/d9f/cdb 0 2024-09-19T09:03:00.292 INFO:tasks.workunit.client.0.smithi049.stdout:9/649: read d3/d14/f51 [3288181,39960] 0 2024-09-19T09:03:00.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/650: fsync d3/d14/d1a/d21/d31/d8e/fab 0 2024-09-19T09:03:00.298 INFO:tasks.workunit.client.0.smithi049.stdout:9/651: rename d3/d14/lbc to d3/d14/d34/d9f/d82/dd0/ldc 0 2024-09-19T09:03:00.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:00 smithi049 ceph-mon[28158]: mgrmap e26: smithi102.csalqv(active, since 67s), standbys: smithi049.qdvksw 2024-09-19T09:03:00.307 INFO:tasks.workunit.client.0.smithi049.stdout:7/593: write d1/d8/d2d/d36/d91/f95 [1046826,130518] 0 2024-09-19T09:03:00.314 INFO:tasks.workunit.client.0.smithi049.stdout:7/594: getdents d1/d53/d18 0 2024-09-19T09:03:00.325 INFO:tasks.workunit.client.0.smithi049.stdout:7/595: dread d1/d53/d18/d50/d7c/fb3 [0,4194304] 0 2024-09-19T09:03:00.326 INFO:tasks.workunit.client.0.smithi049.stdout:7/596: write d1/d53/d18/d50/d7c/fbd [514840,51923] 0 2024-09-19T09:03:00.332 INFO:tasks.workunit.client.0.smithi049.stdout:7/597: rename d1/d7 to d1/d53/dc6 0 2024-09-19T09:03:00.334 INFO:tasks.workunit.client.0.smithi049.stdout:7/598: symlink d1/d8/d2d/d31/d6e/lc7 0 2024-09-19T09:03:00.337 INFO:tasks.workunit.client.0.smithi049.stdout:7/599: creat d1/fc8 x:0 0 0 2024-09-19T09:03:00.340 INFO:tasks.workunit.client.0.smithi049.stdout:7/600: truncate d1/f2 10572789 0 2024-09-19T09:03:00.341 INFO:tasks.workunit.client.0.smithi049.stdout:7/601: mknod d1/d53/d18/d59/cc9 0 2024-09-19T09:03:00.347 INFO:tasks.workunit.client.0.smithi049.stdout:7/602: dwrite d1/f68 [0,4194304] 0 2024-09-19T09:03:00.353 INFO:tasks.workunit.client.0.smithi049.stdout:7/603: dread d1/d1a/f9f [0,4194304] 0 2024-09-19T09:03:00.360 INFO:tasks.workunit.client.0.smithi049.stdout:7/604: dwrite d1/d53/d18/d59/f2c [4194304,4194304] 0 2024-09-19T09:03:00.363 INFO:tasks.workunit.client.0.smithi049.stdout:7/605: mknod d1/d53/d18/d59/cca 0 2024-09-19T09:03:00.367 INFO:tasks.workunit.client.0.smithi049.stdout:7/606: fdatasync d1/d53/d18/f3b 0 2024-09-19T09:03:00.372 INFO:tasks.workunit.client.0.smithi049.stdout:7/607: dread d1/d53/f3e [0,4194304] 0 2024-09-19T09:03:00.374 INFO:tasks.workunit.client.0.smithi049.stdout:7/608: creat d1/d1a/fcb x:0 0 0 2024-09-19T09:03:00.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/609: creat d1/d8/d2d/d31/fcc x:0 0 0 2024-09-19T09:03:00.377 INFO:tasks.workunit.client.0.smithi049.stdout:7/610: chown d1/d8/d2d/d31/c8e 6 1 2024-09-19T09:03:00.379 INFO:tasks.workunit.client.0.smithi049.stdout:7/611: unlink d1/d8/d2d/d31/d6e/fa2 0 2024-09-19T09:03:00.379 INFO:tasks.workunit.client.0.smithi049.stdout:7/612: stat d1/d1a 0 2024-09-19T09:03:00.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/613: dread d1/d8/d19/f34 [0,4194304] 0 2024-09-19T09:03:00.391 INFO:tasks.workunit.client.0.smithi049.stdout:7/614: dread - d1/d53/d18/d50/daa/fb1 zero size 2024-09-19T09:03:00.396 INFO:tasks.workunit.client.0.smithi049.stdout:7/615: rename d1/d8/d2d/d31/d6e/c82 to d1/d53/d18/d50/d58/ccd 0 2024-09-19T09:03:00.407 INFO:tasks.workunit.client.0.smithi049.stdout:7/616: dread d1/f2 [4194304,4194304] 0 2024-09-19T09:03:00.427 INFO:tasks.workunit.client.0.smithi049.stdout:7/617: dwrite d1/d53/f3e [0,4194304] 0 2024-09-19T09:03:00.446 INFO:tasks.workunit.client.0.smithi049.stdout:7/618: dread d1/d53/dc6/fa [0,4194304] 0 2024-09-19T09:03:00.449 INFO:tasks.workunit.client.0.smithi049.stdout:7/619: rename d1/d53/d18/d50/d58/d62/d6b/l6f to d1/d53/d18/d50/d7c/d99/lce 0 2024-09-19T09:03:00.450 INFO:tasks.workunit.client.0.smithi049.stdout:7/620: rmdir d1/d53/d18/d50/d7c/d99 39 2024-09-19T09:03:00.452 INFO:tasks.workunit.client.0.smithi049.stdout:7/621: write d1/d53/d18/d50/d58/d62/fac [979747,110103] 0 2024-09-19T09:03:00.454 INFO:tasks.workunit.client.0.smithi049.stdout:7/622: mknod d1/d8/d2d/d72/ccf 0 2024-09-19T09:03:00.455 INFO:tasks.workunit.client.0.smithi049.stdout:7/623: symlink d1/d53/d18/d59/ld0 0 2024-09-19T09:03:00.457 INFO:tasks.workunit.client.0.smithi049.stdout:7/624: symlink d1/d8/d2d/d36/ld1 0 2024-09-19T09:03:00.458 INFO:tasks.workunit.client.0.smithi049.stdout:7/625: write d1/d8/d2d/f87 [785893,22287] 0 2024-09-19T09:03:00.458 INFO:tasks.workunit.client.0.smithi049.stdout:7/626: chown d1/f2 1197 1 2024-09-19T09:03:00.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/627: creat d1/d53/d18/fd2 x:0 0 0 2024-09-19T09:03:00.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/628: stat d1/d8/f1c 0 2024-09-19T09:03:00.464 INFO:tasks.workunit.client.0.smithi049.stdout:7/629: rename d1/d53/d18/d50/d58 to d1/d1a/da0/dd3 0 2024-09-19T09:03:00.466 INFO:tasks.workunit.client.0.smithi049.stdout:7/630: creat d1/d8/d2d/d36/fd4 x:0 0 0 2024-09-19T09:03:00.471 INFO:tasks.workunit.client.0.smithi049.stdout:7/631: dread d1/d8/d2d/d36/d91/f95 [0,4194304] 0 2024-09-19T09:03:00.472 INFO:tasks.workunit.client.0.smithi049.stdout:7/632: write d1/d1a/da0/dd3/d62/fac [1846884,78207] 0 2024-09-19T09:03:00.475 INFO:tasks.workunit.client.0.smithi049.stdout:7/633: creat d1/d8/d2d/d36/d91/fd5 x:0 0 0 2024-09-19T09:03:00.476 INFO:tasks.workunit.client.0.smithi049.stdout:7/634: symlink d1/d53/ld6 0 2024-09-19T09:03:00.481 INFO:tasks.workunit.client.0.smithi049.stdout:7/635: dwrite d1/d1a/da0/dd3/d62/d6b/f8c [0,4194304] 0 2024-09-19T09:03:00.482 INFO:tasks.workunit.client.0.smithi049.stdout:7/636: stat d1/d8/d2d/d36/fb7 0 2024-09-19T09:03:00.485 INFO:tasks.workunit.client.0.smithi049.stdout:7/637: mknod d1/d53/d18/d50/cd7 0 2024-09-19T09:03:00.489 INFO:tasks.workunit.client.0.smithi049.stdout:7/638: mkdir d1/d53/dc6/dd8 0 2024-09-19T09:03:00.491 INFO:tasks.workunit.client.0.smithi049.stdout:7/639: fsync d1/d53/d18/d59/fb2 0 2024-09-19T09:03:00.495 INFO:tasks.workunit.client.0.smithi049.stdout:7/640: mkdir d1/d8/d2d/dd9 0 2024-09-19T09:03:00.495 INFO:tasks.workunit.client.0.smithi049.stdout:7/641: chown d1/d53/d18/f43 37 1 2024-09-19T09:03:00.497 INFO:tasks.workunit.client.0.smithi049.stdout:7/642: mkdir d1/d8/dda 0 2024-09-19T09:03:00.497 INFO:tasks.workunit.client.0.smithi049.stdout:7/643: chown d1/d8/d2d/d36 432947 1 2024-09-19T09:03:00.499 INFO:tasks.workunit.client.0.smithi049.stdout:7/644: creat d1/d53/d18/d59/fdb x:0 0 0 2024-09-19T09:03:00.500 INFO:tasks.workunit.client.0.smithi049.stdout:7/645: rmdir d1/d8/d19 39 2024-09-19T09:03:00.502 INFO:tasks.workunit.client.0.smithi049.stdout:7/646: creat d1/d8/d2d/dd9/fdc x:0 0 0 2024-09-19T09:03:00.505 INFO:tasks.workunit.client.0.smithi049.stdout:7/647: dread d1/d8/f30 [0,4194304] 0 2024-09-19T09:03:00.505 INFO:tasks.workunit.client.0.smithi049.stdout:7/648: dread - d1/d8/d2d/d36/d91/fd5 zero size 2024-09-19T09:03:00.506 INFO:tasks.workunit.client.0.smithi049.stdout:7/649: stat d1/d53/d18/d50/cd7 0 2024-09-19T09:03:00.507 INFO:tasks.workunit.client.0.smithi049.stdout:7/650: chown d1/d53/d18/d50/daa 26764 1 2024-09-19T09:03:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:00 smithi102 ceph-mon[35280]: mgrmap e26: smithi102.csalqv(active, since 67s), standbys: smithi049.qdvksw 2024-09-19T09:03:00.508 INFO:tasks.workunit.client.0.smithi049.stdout:7/651: creat d1/d1a/da0/dd3/d62/fdd x:0 0 0 2024-09-19T09:03:00.522 INFO:tasks.workunit.client.0.smithi049.stdout:7/652: creat d1/d53/d18/d50/fde x:0 0 0 2024-09-19T09:03:00.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/653: dread d1/d8/f30 [0,4194304] 0 2024-09-19T09:03:00.535 INFO:tasks.workunit.client.0.smithi049.stdout:7/654: getdents d1/d1a/da0/dd3/d62 0 2024-09-19T09:03:00.539 INFO:tasks.workunit.client.0.smithi049.stdout:7/655: creat d1/d8/d2d/fdf x:0 0 0 2024-09-19T09:03:00.541 INFO:tasks.workunit.client.0.smithi049.stdout:7/656: symlink d1/d8/d80/le0 0 2024-09-19T09:03:00.543 INFO:tasks.workunit.client.0.smithi049.stdout:7/657: mknod d1/ce1 0 2024-09-19T09:03:00.543 INFO:tasks.workunit.client.0.smithi049.stdout:7/658: fdatasync d1/d53/d18/fb6 0 2024-09-19T09:03:00.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/659: getdents d1/d8/dda 0 2024-09-19T09:03:00.547 INFO:tasks.workunit.client.0.smithi049.stdout:7/660: symlink d1/le2 0 2024-09-19T09:03:00.558 INFO:tasks.workunit.client.0.smithi049.stdout:7/661: link d1/d53/l15 d1/d8/d2d/d36/le3 0 2024-09-19T09:03:00.560 INFO:tasks.workunit.client.0.smithi049.stdout:7/662: creat d1/d53/d18/fe4 x:0 0 0 2024-09-19T09:03:00.561 INFO:tasks.workunit.client.0.smithi049.stdout:7/663: chown d1/d53/d18/d50/c51 2640985 1 2024-09-19T09:03:00.565 INFO:tasks.workunit.client.0.smithi049.stdout:7/664: mknod d1/d53/ce5 0 2024-09-19T09:03:00.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/665: dwrite d1/d8/d2d/f87 [0,4194304] 0 2024-09-19T09:03:00.574 INFO:tasks.workunit.client.0.smithi049.stdout:7/666: chown d1/d8/d19/f55 575301 1 2024-09-19T09:03:00.577 INFO:tasks.workunit.client.0.smithi049.stdout:7/667: link d1/f68 d1/d8/d2d/d36/d91/fe6 0 2024-09-19T09:03:00.582 INFO:tasks.workunit.client.0.smithi049.stdout:7/668: fdatasync d1/d53/dc6/f4c 0 2024-09-19T09:03:00.591 INFO:tasks.workunit.client.0.smithi049.stdout:7/669: rename d1/d53/d18 to d1/d1a/de7 0 2024-09-19T09:03:00.592 INFO:tasks.workunit.client.0.smithi049.stdout:7/670: fsync d1/d1a/f38 0 2024-09-19T09:03:00.611 INFO:tasks.workunit.client.0.smithi049.stdout:7/671: write d1/d53/dc6/f4c [1707535,47747] 0 2024-09-19T09:03:00.617 INFO:tasks.workunit.client.0.smithi049.stdout:7/672: rename d1/d53/dc6/fa to d1/d8/d2d/d72/fe8 0 2024-09-19T09:03:00.622 INFO:tasks.workunit.client.0.smithi049.stdout:7/673: dread d1/d1a/de7/d50/d7c/fb3 [0,4194304] 0 2024-09-19T09:03:00.627 INFO:tasks.workunit.client.0.smithi049.stdout:7/674: mknod d1/d8/d2d/d31/d6e/ce9 0 2024-09-19T09:03:00.633 INFO:tasks.workunit.client.0.smithi049.stdout:7/675: rename d1/d1a/de7/d50/c51 to d1/d8/d2d/dd9/cea 0 2024-09-19T09:03:00.642 INFO:tasks.workunit.client.0.smithi049.stdout:7/676: dwrite d1/d1a/de7/d50/daa/fb1 [0,4194304] 0 2024-09-19T09:03:00.646 INFO:tasks.workunit.client.0.smithi049.stdout:7/677: symlink d1/d8/d19/leb 0 2024-09-19T09:03:00.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/678: link d1/d53/dc6/l63 d1/d1a/de7/d50/d7c/d9c/lec 0 2024-09-19T09:03:00.656 INFO:tasks.workunit.client.0.smithi049.stdout:7/679: read - d1/d1a/fcb zero size 2024-09-19T09:03:00.659 INFO:tasks.workunit.client.0.smithi049.stdout:7/680: unlink d1/d1a/da0/dd3/d62/c65 0 2024-09-19T09:03:00.677 INFO:tasks.workunit.client.0.smithi049.stdout:7/681: dwrite d1/d1a/de7/d59/f35 [0,4194304] 0 2024-09-19T09:03:00.688 INFO:tasks.workunit.client.0.smithi049.stdout:7/682: dwrite d1/d1a/f77 [0,4194304] 0 2024-09-19T09:03:00.690 INFO:tasks.workunit.client.0.smithi049.stdout:7/683: rmdir d1/d1a/de7/d50 39 2024-09-19T09:03:00.691 INFO:tasks.workunit.client.0.smithi049.stdout:7/684: readlink d1/d1a/la5 0 2024-09-19T09:03:01.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/371: sync 2024-09-19T09:03:01.090 INFO:tasks.workunit.client.0.smithi049.stdout:4/372: write d4/d45/d3f/d47/f49 [4384991,55824] 0 2024-09-19T09:03:01.093 INFO:tasks.workunit.client.0.smithi049.stdout:4/373: creat d4/d15/d19/d1f/d55/f78 x:0 0 0 2024-09-19T09:03:01.093 INFO:tasks.workunit.client.0.smithi049.stdout:4/374: stat d4/d15/d19/d1f/f5a 0 2024-09-19T09:03:01.096 INFO:tasks.workunit.client.0.smithi049.stdout:4/375: dread d4/d15/f61 [0,4194304] 0 2024-09-19T09:03:01.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/376: write d4/f21 [671388,97604] 0 2024-09-19T09:03:01.104 INFO:tasks.workunit.client.0.smithi049.stdout:4/377: chown d4/d15/d19/f68 560 1 2024-09-19T09:03:01.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/378: rename d4/d34/f6f to d4/d34/f79 0 2024-09-19T09:03:01.110 INFO:tasks.workunit.client.0.smithi049.stdout:4/379: mkdir d4/d6c/d7a 0 2024-09-19T09:03:01.111 INFO:tasks.workunit.client.0.smithi049.stdout:4/380: truncate d4/d45/d4a/f4e 1774576 0 2024-09-19T09:03:01.114 INFO:tasks.workunit.client.0.smithi049.stdout:4/381: mkdir d4/d15/d19/d7b 0 2024-09-19T09:03:01.131 INFO:tasks.workunit.client.0.smithi049.stdout:4/382: dwrite d4/d45/d4a/f4e [0,4194304] 0 2024-09-19T09:03:01.136 INFO:tasks.workunit.client.0.smithi049.stdout:4/383: dread d4/d15/d19/f68 [0,4194304] 0 2024-09-19T09:03:01.154 INFO:tasks.workunit.client.0.smithi049.stdout:4/384: dread d4/f6 [0,4194304] 0 2024-09-19T09:03:01.162 INFO:tasks.workunit.client.0.smithi049.stdout:4/385: dwrite d4/f6 [0,4194304] 0 2024-09-19T09:03:01.164 INFO:tasks.workunit.client.0.smithi049.stdout:4/386: read d4/d15/f59 [3601097,44254] 0 2024-09-19T09:03:01.166 INFO:tasks.workunit.client.0.smithi049.stdout:4/387: truncate d4/d34/f46 286470 0 2024-09-19T09:03:01.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/388: rename d4/fe to d4/d15/f7c 0 2024-09-19T09:03:01.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/389: symlink d4/d34/d3d/d62/l7d 0 2024-09-19T09:03:01.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/390: rename d4/l6d to d4/l7e 0 2024-09-19T09:03:01.179 INFO:tasks.workunit.client.0.smithi049.stdout:4/391: mkdir d4/d15/d19/d1f/d55/d7f 0 2024-09-19T09:03:01.181 INFO:tasks.workunit.client.0.smithi049.stdout:4/392: dread d4/f17 [4194304,4194304] 0 2024-09-19T09:03:01.186 INFO:tasks.workunit.client.0.smithi049.stdout:4/393: rename d4/d4c/c58 to d4/d45/d3f/c80 0 2024-09-19T09:03:01.187 INFO:tasks.workunit.client.0.smithi049.stdout:4/394: write d4/d4c/f73 [405353,127995] 0 2024-09-19T09:03:01.212 INFO:tasks.workunit.client.0.smithi049.stdout:4/395: dwrite d4/d15/d19/d1f/f67 [0,4194304] 0 2024-09-19T09:03:01.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/396: dread - d4/d45/f48 zero size 2024-09-19T09:03:01.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/397: creat d4/d45/d3f/d47/f81 x:0 0 0 2024-09-19T09:03:01.221 INFO:tasks.workunit.client.0.smithi049.stdout:4/398: mknod d4/d34/d3d/c82 0 2024-09-19T09:03:01.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/399: dread d4/f25 [0,4194304] 0 2024-09-19T09:03:01.246 INFO:tasks.workunit.client.0.smithi049.stdout:4/400: link d4/d15/d19/f68 d4/d15/f83 0 2024-09-19T09:03:01.249 INFO:tasks.workunit.client.0.smithi049.stdout:4/401: write d4/f17 [2406756,75900] 0 2024-09-19T09:03:01.254 INFO:tasks.workunit.client.0.smithi049.stdout:4/402: getdents d4 0 2024-09-19T09:03:01.259 INFO:tasks.workunit.client.0.smithi049.stdout:4/403: dwrite d4/f24 [0,4194304] 0 2024-09-19T09:03:01.260 INFO:tasks.workunit.client.0.smithi049.stdout:4/404: read - d4/d15/d19/d1f/f5d zero size 2024-09-19T09:03:01.261 INFO:tasks.workunit.client.0.smithi049.stdout:3/450: sync 2024-09-19T09:03:01.261 INFO:tasks.workunit.client.0.smithi049.stdout:5/413: sync 2024-09-19T09:03:01.261 INFO:tasks.workunit.client.0.smithi049.stdout:6/360: sync 2024-09-19T09:03:01.265 INFO:tasks.workunit.client.0.smithi049.stdout:5/414: mkdir d3/d5/de/d12/d7d 0 2024-09-19T09:03:01.266 INFO:tasks.workunit.client.0.smithi049.stdout:3/451: mknod d10/c90 0 2024-09-19T09:03:01.267 INFO:tasks.workunit.client.0.smithi049.stdout:6/361: mkdir dc/d12/d6e 0 2024-09-19T09:03:01.269 INFO:tasks.workunit.client.0.smithi049.stdout:5/415: fdatasync d3/d5/d1c/f22 0 2024-09-19T09:03:01.271 INFO:tasks.workunit.client.0.smithi049.stdout:6/362: mkdir dc/d1b/d6f 0 2024-09-19T09:03:01.274 INFO:tasks.workunit.client.0.smithi049.stdout:5/416: mknod d3/d5/d1c/d2d/c7e 0 2024-09-19T09:03:01.276 INFO:tasks.workunit.client.0.smithi049.stdout:3/452: symlink d10/d11/d13/l91 0 2024-09-19T09:03:01.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/405: dwrite d4/f13 [0,4194304] 0 2024-09-19T09:03:01.277 INFO:tasks.workunit.client.0.smithi049.stdout:6/363: truncate dc/d16/f3b 638785 0 2024-09-19T09:03:01.281 INFO:tasks.workunit.client.0.smithi049.stdout:5/417: mknod d3/d5/d1c/d4c/c7f 0 2024-09-19T09:03:01.284 INFO:tasks.workunit.client.0.smithi049.stdout:4/406: dread d4/d45/d4a/f4e [0,4194304] 0 2024-09-19T09:03:01.287 INFO:tasks.workunit.client.0.smithi049.stdout:6/364: link dc/d1b/d20/d2f/f5c dc/d16/f70 0 2024-09-19T09:03:01.291 INFO:tasks.workunit.client.0.smithi049.stdout:5/418: read d3/dc/d43/f6a [1533808,26296] 0 2024-09-19T09:03:01.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/453: creat d10/f92 x:0 0 0 2024-09-19T09:03:01.294 INFO:tasks.workunit.client.0.smithi049.stdout:4/407: rmdir d4/d45/d3f 39 2024-09-19T09:03:01.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/365: dwrite dc/d1b/d20/d2f/d4c/f6d [0,4194304] 0 2024-09-19T09:03:01.301 INFO:tasks.workunit.client.0.smithi049.stdout:3/454: creat d10/d3d/d79/d80/f93 x:0 0 0 2024-09-19T09:03:01.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:01 smithi049 ceph-mon[28158]: pgmap v37: 65 pgs: 65 active+clean; 2.8 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 85 MiB/s rd, 230 MiB/s wr, 501 op/s 2024-09-19T09:03:01.302 INFO:tasks.workunit.client.0.smithi049.stdout:3/455: chown d10/d11/d13/d30/f6d 5 1 2024-09-19T09:03:01.304 INFO:tasks.workunit.client.0.smithi049.stdout:6/366: dread dc/d16/f2d [0,4194304] 0 2024-09-19T09:03:01.305 INFO:tasks.workunit.client.0.smithi049.stdout:4/408: mkdir d4/d35/d84 0 2024-09-19T09:03:01.309 INFO:tasks.workunit.client.0.smithi049.stdout:4/409: dread d4/d45/d4a/f4e [0,4194304] 0 2024-09-19T09:03:01.309 INFO:tasks.workunit.client.0.smithi049.stdout:3/456: creat d10/d3d/f94 x:0 0 0 2024-09-19T09:03:01.315 INFO:tasks.workunit.client.0.smithi049.stdout:4/410: dwrite d4/f1e [0,4194304] 0 2024-09-19T09:03:01.315 INFO:tasks.workunit.client.0.smithi049.stdout:5/419: creat d3/d5/f80 x:0 0 0 2024-09-19T09:03:01.318 INFO:tasks.workunit.client.0.smithi049.stdout:5/420: write d3/d5/de/d4a/f68 [855223,116959] 0 2024-09-19T09:03:01.319 INFO:tasks.workunit.client.0.smithi049.stdout:3/457: mkdir d10/d3d/d95 0 2024-09-19T09:03:01.321 INFO:tasks.workunit.client.0.smithi049.stdout:0/595: sync 2024-09-19T09:03:01.321 INFO:tasks.workunit.client.0.smithi049.stdout:2/628: sync 2024-09-19T09:03:01.321 INFO:tasks.workunit.client.0.smithi049.stdout:8/544: sync 2024-09-19T09:03:01.321 INFO:tasks.workunit.client.0.smithi049.stdout:9/652: sync 2024-09-19T09:03:01.321 INFO:tasks.workunit.client.0.smithi049.stdout:1/316: sync 2024-09-19T09:03:01.321 INFO:tasks.workunit.client.0.smithi049.stdout:7/685: sync 2024-09-19T09:03:01.324 INFO:tasks.workunit.client.0.smithi049.stdout:4/411: rename d4/d15/d19/d1f/f2e to d4/d34/d3d/d4f/d6a/f85 0 2024-09-19T09:03:01.337 INFO:tasks.workunit.client.0.smithi049.stdout:5/421: dwrite d3/d5/d20/d38/d5d/f73 [0,4194304] 0 2024-09-19T09:03:01.337 INFO:tasks.workunit.client.0.smithi049.stdout:8/545: creat d1/d11/d3f/d8c/fa4 x:0 0 0 2024-09-19T09:03:01.341 INFO:tasks.workunit.client.0.smithi049.stdout:9/653: dwrite d3/d14/d1a/f25 [4194304,4194304] 0 2024-09-19T09:03:01.342 INFO:tasks.workunit.client.0.smithi049.stdout:3/458: symlink d10/l96 0 2024-09-19T09:03:01.344 INFO:tasks.workunit.client.0.smithi049.stdout:4/412: dread d4/d15/f61 [0,4194304] 0 2024-09-19T09:03:01.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/629: dwrite d1/d4/d20/f81 [0,4194304] 0 2024-09-19T09:03:01.350 INFO:tasks.workunit.client.0.smithi049.stdout:0/596: rmdir d5/d10/d13/d15/d29/d9a 39 2024-09-19T09:03:01.352 INFO:tasks.workunit.client.0.smithi049.stdout:5/422: write d3/d5/de/d12/f6f [812843,93487] 0 2024-09-19T09:03:01.357 INFO:tasks.workunit.client.0.smithi049.stdout:1/317: truncate d5/d6/d8/d1a/f3e 2956039 0 2024-09-19T09:03:01.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/630: read d1/d4/d1e/d9f/db3/f5d [2741106,29848] 0 2024-09-19T09:03:01.357 INFO:tasks.workunit.client.0.smithi049.stdout:6/367: dwrite dc/d12/f43 [0,4194304] 0 2024-09-19T09:03:01.360 INFO:tasks.workunit.client.0.smithi049.stdout:8/546: dwrite d1/f39 [4194304,4194304] 0 2024-09-19T09:03:01.364 INFO:tasks.workunit.client.0.smithi049.stdout:8/547: dread d1/d11/d3f/d8c/f8d [0,4194304] 0 2024-09-19T09:03:01.364 INFO:tasks.workunit.client.0.smithi049.stdout:7/686: rename d1/d1a/de7/d50/daa/fb1 to d1/fed 0 2024-09-19T09:03:01.365 INFO:tasks.workunit.client.0.smithi049.stdout:3/459: chown d10/d11/c35 220696 1 2024-09-19T09:03:01.367 INFO:tasks.workunit.client.0.smithi049.stdout:3/460: write d10/f70 [991325,2208] 0 2024-09-19T09:03:01.368 INFO:tasks.workunit.client.0.smithi049.stdout:0/597: dread d5/d86/f95 [0,4194304] 0 2024-09-19T09:03:01.380 INFO:tasks.workunit.client.0.smithi049.stdout:8/548: dread d1/f3d [0,4194304] 0 2024-09-19T09:03:01.381 INFO:tasks.workunit.client.0.smithi049.stdout:1/318: fdatasync d5/d6/f1b 0 2024-09-19T09:03:01.384 INFO:tasks.workunit.client.0.smithi049.stdout:5/423: truncate d3/d5/d20/d38/f46 1565578 0 2024-09-19T09:03:01.384 INFO:tasks.workunit.client.0.smithi049.stdout:1/319: write d5/d6/d19/d30/f65 [154637,21562] 0 2024-09-19T09:03:01.385 INFO:tasks.workunit.client.0.smithi049.stdout:1/320: chown d5/f23 5725053 1 2024-09-19T09:03:01.387 INFO:tasks.workunit.client.0.smithi049.stdout:9/654: fsync d3/f28 0 2024-09-19T09:03:01.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/631: write d1/d4/d1e/d45/f6d [3910618,119452] 0 2024-09-19T09:03:01.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/687: unlink d1/d1a/f77 0 2024-09-19T09:03:01.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/368: write dc/d16/f70 [65057,67365] 0 2024-09-19T09:03:01.400 INFO:tasks.workunit.client.0.smithi049.stdout:4/413: mknod d4/d15/d19/d1f/d77/c86 0 2024-09-19T09:03:01.403 INFO:tasks.workunit.client.0.smithi049.stdout:0/598: rename d5/d10/d2f/l7e to d5/d10/d82/lb5 0 2024-09-19T09:03:01.404 INFO:tasks.workunit.client.0.smithi049.stdout:0/599: chown d5/d10/d82/d67 50 1 2024-09-19T09:03:01.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/549: truncate d1/d11/d45/f84 146150 0 2024-09-19T09:03:01.407 INFO:tasks.workunit.client.0.smithi049.stdout:1/321: rmdir d5/d6/d8/d13/d24/d3b 39 2024-09-19T09:03:01.408 INFO:tasks.workunit.client.0.smithi049.stdout:1/322: chown d5/d6/d8/d13/f12 29 1 2024-09-19T09:03:01.409 INFO:tasks.workunit.client.0.smithi049.stdout:1/323: dread - d5/d6/d19/f61 zero size 2024-09-19T09:03:01.410 INFO:tasks.workunit.client.0.smithi049.stdout:1/324: stat d5/d6/d19/d21/f46 0 2024-09-19T09:03:01.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/655: mkdir d3/d14/d34/d9f/d82/dd0/ddd 0 2024-09-19T09:03:01.414 INFO:tasks.workunit.client.0.smithi049.stdout:2/632: mknod d1/d4/d1e/d21/d8c/ccd 0 2024-09-19T09:03:01.417 INFO:tasks.workunit.client.0.smithi049.stdout:6/369: mknod dc/d12/d5a/c71 0 2024-09-19T09:03:01.420 INFO:tasks.workunit.client.0.smithi049.stdout:7/688: fsync d1/d8/d2d/d31/f7a 0 2024-09-19T09:03:01.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/461: mknod d10/d11/d27/d4f/d59/d81/c97 0 2024-09-19T09:03:01.425 INFO:tasks.workunit.client.0.smithi049.stdout:0/600: symlink d5/d10/d2f/lb6 0 2024-09-19T09:03:01.427 INFO:tasks.workunit.client.0.smithi049.stdout:8/550: unlink d1/d11/f96 0 2024-09-19T09:03:01.431 INFO:tasks.workunit.client.0.smithi049.stdout:2/633: creat d1/d2/d23/fce x:0 0 0 2024-09-19T09:03:01.432 INFO:tasks.workunit.client.0.smithi049.stdout:2/634: fdatasync d1/d4/d20/f81 0 2024-09-19T09:03:01.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/635: write d1/d2/d32/f94 [277495,101034] 0 2024-09-19T09:03:01.434 INFO:tasks.workunit.client.0.smithi049.stdout:7/689: fdatasync d1/fed 0 2024-09-19T09:03:01.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/462: fsync d10/d11/d13/f1f 0 2024-09-19T09:03:01.439 INFO:tasks.workunit.client.0.smithi049.stdout:1/325: write d5/d6/f1f [4769783,94279] 0 2024-09-19T09:03:01.439 INFO:tasks.workunit.client.0.smithi049.stdout:3/463: readlink d10/d11/d27/d4f/d59/l62 0 2024-09-19T09:03:01.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/601: rename d5/d10/d82/c88 to d5/d10/d82/cb7 0 2024-09-19T09:03:01.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/602: stat d5 0 2024-09-19T09:03:01.444 INFO:tasks.workunit.client.0.smithi049.stdout:4/414: truncate d4/f40 8108184 0 2024-09-19T09:03:01.446 INFO:tasks.workunit.client.0.smithi049.stdout:9/656: dwrite d3/d14/d1a/d21/d31/f62 [0,4194304] 0 2024-09-19T09:03:01.449 INFO:tasks.workunit.client.0.smithi049.stdout:2/636: symlink d1/d2/d23/lcf 0 2024-09-19T09:03:01.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/637: read - d1/d4/d1e/d9f/db7/fc4 zero size 2024-09-19T09:03:01.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/326: mknod d5/c6b 0 2024-09-19T09:03:01.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/603: creat d5/d86/fb8 x:0 0 0 2024-09-19T09:03:01.453 INFO:tasks.workunit.client.0.smithi049.stdout:1/327: stat d5/d6/d8/c59 0 2024-09-19T09:03:01.454 INFO:tasks.workunit.client.0.smithi049.stdout:0/604: write d5/d10/d13/f80 [2065950,106267] 0 2024-09-19T09:03:01.455 INFO:tasks.workunit.client.0.smithi049.stdout:9/657: rmdir d3/d14/d1a/d21/d31 39 2024-09-19T09:03:01.456 INFO:tasks.workunit.client.0.smithi049.stdout:1/328: dread d5/d6/d19/d21/f32 [0,4194304] 0 2024-09-19T09:03:01.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/690: rename d1/d53/l67 to d1/d8/d89/lee 0 2024-09-19T09:03:01.460 INFO:tasks.workunit.client.0.smithi049.stdout:2/638: mknod d1/d4/d20/d26/cd0 0 2024-09-19T09:03:01.463 INFO:tasks.workunit.client.0.smithi049.stdout:8/551: creat d1/fa5 x:0 0 0 2024-09-19T09:03:01.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/552: chown d1/l18 4 1 2024-09-19T09:03:01.465 INFO:tasks.workunit.client.0.smithi049.stdout:7/691: dwrite d1/d1a/de7/d59/f48 [0,4194304] 0 2024-09-19T09:03:01.469 INFO:tasks.workunit.client.0.smithi049.stdout:1/329: mknod d5/d6/dc/c6c 0 2024-09-19T09:03:01.470 INFO:tasks.workunit.client.0.smithi049.stdout:1/330: readlink d5/d6/d8/d13/d24/l4f 0 2024-09-19T09:03:01.472 INFO:tasks.workunit.client.0.smithi049.stdout:1/331: chown d5/d6/d19/d30/f65 154 1 2024-09-19T09:03:01.473 INFO:tasks.workunit.client.0.smithi049.stdout:2/639: symlink d1/d4/d1e/d9f/db3/d41/d7d/ld1 0 2024-09-19T09:03:01.475 INFO:tasks.workunit.client.0.smithi049.stdout:0/605: mknod d5/d10/cb9 0 2024-09-19T09:03:01.479 INFO:tasks.workunit.client.0.smithi049.stdout:3/464: write d10/f38 [2935499,32849] 0 2024-09-19T09:03:01.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/332: truncate d5/d6/f7 3151525 0 2024-09-19T09:03:01.482 INFO:tasks.workunit.client.0.smithi049.stdout:1/333: chown d5/d6/d19/d21/d52/c5f 47246819 1 2024-09-19T09:03:01.487 INFO:tasks.workunit.client.0.smithi049.stdout:7/692: link d1/d53/f3e d1/d8/dda/fef 0 2024-09-19T09:03:01.489 INFO:tasks.workunit.client.0.smithi049.stdout:9/658: write d3/d14/d1a/d21/d66/fc6 [831878,128755] 0 2024-09-19T09:03:01.490 INFO:tasks.workunit.client.0.smithi049.stdout:3/465: dread - d10/d11/d13/f6e zero size 2024-09-19T09:03:01.492 INFO:tasks.workunit.client.0.smithi049.stdout:8/553: dwrite d1/d11/d2e/f56 [0,4194304] 0 2024-09-19T09:03:01.494 INFO:tasks.workunit.client.0.smithi049.stdout:1/334: mknod d5/d6/dc/c6d 0 2024-09-19T09:03:01.497 INFO:tasks.workunit.client.0.smithi049.stdout:9/659: truncate d3/d14/d1a/d21/d67/fd7 526459 0 2024-09-19T09:03:01.499 INFO:tasks.workunit.client.0.smithi049.stdout:3/466: creat d10/d11/d27/d4f/d59/d81/f98 x:0 0 0 2024-09-19T09:03:01.500 INFO:tasks.workunit.client.0.smithi049.stdout:1/335: rmdir d5/d6/d8 39 2024-09-19T09:03:01.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/693: symlink d1/d8/d2d/lf0 0 2024-09-19T09:03:01.504 INFO:tasks.workunit.client.0.smithi049.stdout:2/640: dwrite d1/d2/f24 [0,4194304] 0 2024-09-19T09:03:01.507 INFO:tasks.workunit.client.0.smithi049.stdout:2/641: write d1/d2/d70/f9a [994217,5014] 0 2024-09-19T09:03:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:01 smithi102 ceph-mon[35280]: pgmap v37: 65 pgs: 65 active+clean; 2.8 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 85 MiB/s rd, 230 MiB/s wr, 501 op/s 2024-09-19T09:03:01.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/554: dwrite d1/d1a/fa2 [0,4194304] 0 2024-09-19T09:03:01.510 INFO:tasks.workunit.client.0.smithi049.stdout:0/606: getdents d5/d10/d7d 0 2024-09-19T09:03:01.519 INFO:tasks.workunit.client.0.smithi049.stdout:3/467: dread d10/d11/f36 [0,4194304] 0 2024-09-19T09:03:01.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/694: rmdir d1/d8/d2d 39 2024-09-19T09:03:01.523 INFO:tasks.workunit.client.0.smithi049.stdout:9/660: dread d3/d14/d34/d4c/fc1 [0,4194304] 0 2024-09-19T09:03:01.528 INFO:tasks.workunit.client.0.smithi049.stdout:3/468: dwrite d10/d3d/d46/d84/f8f [0,4194304] 0 2024-09-19T09:03:01.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/555: symlink d1/d11/d4f/la6 0 2024-09-19T09:03:01.537 INFO:tasks.workunit.client.0.smithi049.stdout:1/336: dwrite d5/f20 [0,4194304] 0 2024-09-19T09:03:01.538 INFO:tasks.workunit.client.0.smithi049.stdout:0/607: mknod d5/d10/d13/d30/d9f/cba 0 2024-09-19T09:03:01.542 INFO:tasks.workunit.client.0.smithi049.stdout:7/695: rmdir d1/d53 39 2024-09-19T09:03:01.545 INFO:tasks.workunit.client.0.smithi049.stdout:9/661: creat d3/d14/d1a/d21/d67/d94/fde x:0 0 0 2024-09-19T09:03:01.547 INFO:tasks.workunit.client.0.smithi049.stdout:3/469: creat d10/d11/d27/d4f/f99 x:0 0 0 2024-09-19T09:03:01.547 INFO:tasks.workunit.client.0.smithi049.stdout:9/662: chown d3/d14/d1a/d21/d67/d94/fde 116 1 2024-09-19T09:03:01.549 INFO:tasks.workunit.client.0.smithi049.stdout:9/663: chown d3/d14/d34/d9f/d82/db1/l6d 291 1 2024-09-19T09:03:01.549 INFO:tasks.workunit.client.0.smithi049.stdout:2/642: creat d1/d4/d20/d92/fd2 x:0 0 0 2024-09-19T09:03:01.550 INFO:tasks.workunit.client.0.smithi049.stdout:9/664: chown d3/d14/d1a/d90 2312484 1 2024-09-19T09:03:01.550 INFO:tasks.workunit.client.0.smithi049.stdout:2/643: read - d1/d4/d1e/d21/fbf zero size 2024-09-19T09:03:01.554 INFO:tasks.workunit.client.0.smithi049.stdout:8/556: truncate d1/d11/d2e/d4e/d61/f85 753197 0 2024-09-19T09:03:01.556 INFO:tasks.workunit.client.0.smithi049.stdout:3/470: truncate d10/d11/d13/f32 2381786 0 2024-09-19T09:03:01.557 INFO:tasks.workunit.client.0.smithi049.stdout:9/665: symlink d3/d14/d1a/d21/d73/ldf 0 2024-09-19T09:03:01.559 INFO:tasks.workunit.client.0.smithi049.stdout:2/644: creat d1/d4/d1e/d9f/fd3 x:0 0 0 2024-09-19T09:03:01.561 INFO:tasks.workunit.client.0.smithi049.stdout:2/645: write d1/d2/d23/d49/d75/fc1 [800337,30115] 0 2024-09-19T09:03:01.563 INFO:tasks.workunit.client.0.smithi049.stdout:0/608: mkdir d5/d10/d82/d67/d85/db4/dbb 0 2024-09-19T09:03:01.569 INFO:tasks.workunit.client.0.smithi049.stdout:9/666: fdatasync d3/d14/d34/d44/f9a 0 2024-09-19T09:03:01.572 INFO:tasks.workunit.client.0.smithi049.stdout:2/646: mkdir d1/d2/d6c/dd4 0 2024-09-19T09:03:01.574 INFO:tasks.workunit.client.0.smithi049.stdout:2/647: chown d1/d4/d1e/d21/f3b 3129957 1 2024-09-19T09:03:01.574 INFO:tasks.workunit.client.0.smithi049.stdout:2/648: dread - d1/d4/d1e/d9f/db7/fc4 zero size 2024-09-19T09:03:01.577 INFO:tasks.workunit.client.0.smithi049.stdout:3/471: creat d10/d3d/d79/d87/f9a x:0 0 0 2024-09-19T09:03:01.579 INFO:tasks.workunit.client.0.smithi049.stdout:1/337: creat d5/d6/d8/d13/f6e x:0 0 0 2024-09-19T09:03:01.584 INFO:tasks.workunit.client.0.smithi049.stdout:2/649: mkdir d1/d2/d6c/dd5 0 2024-09-19T09:03:01.586 INFO:tasks.workunit.client.0.smithi049.stdout:3/472: unlink d10/f92 0 2024-09-19T09:03:01.587 INFO:tasks.workunit.client.0.smithi049.stdout:3/473: truncate d10/d11/d27/f68 1125530 0 2024-09-19T09:03:01.588 INFO:tasks.workunit.client.0.smithi049.stdout:1/338: rmdir d5/d6/d19/d30 39 2024-09-19T09:03:01.591 INFO:tasks.workunit.client.0.smithi049.stdout:8/557: dread d1/d11/d2e/d4e/d61/f85 [0,4194304] 0 2024-09-19T09:03:01.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/339: unlink d5/d6/dc/f48 0 2024-09-19T09:03:01.598 INFO:tasks.workunit.client.0.smithi049.stdout:9/667: link d3/d14/d34/d74/l8d d3/d14/d1a/d21/d73/le0 0 2024-09-19T09:03:01.605 INFO:tasks.workunit.client.0.smithi049.stdout:9/668: dwrite d3/d14/d34/d9f/f81 [0,4194304] 0 2024-09-19T09:03:01.605 INFO:tasks.workunit.client.0.smithi049.stdout:3/474: dread d10/d11/d13/f28 [0,4194304] 0 2024-09-19T09:03:01.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/669: fdatasync d3/d14/d34/f88 0 2024-09-19T09:03:01.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/558: mknod d1/d11/d2e/ca7 0 2024-09-19T09:03:01.608 INFO:tasks.workunit.client.0.smithi049.stdout:7/696: write d1/d1a/da0/dd3/d62/d6b/f76 [649798,58062] 0 2024-09-19T09:03:01.609 INFO:tasks.workunit.client.0.smithi049.stdout:8/559: chown d1/d1a/c26 31 1 2024-09-19T09:03:01.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/475: truncate fe 132344 0 2024-09-19T09:03:01.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/670: rmdir d3/d14/d34/d9f/d82/db1 39 2024-09-19T09:03:01.614 INFO:tasks.workunit.client.0.smithi049.stdout:9/671: truncate d3/d14/d1a/d90/fa6 961753 0 2024-09-19T09:03:01.616 INFO:tasks.workunit.client.0.smithi049.stdout:1/340: rename d5/f23 to d5/d6/f6f 0 2024-09-19T09:03:01.618 INFO:tasks.workunit.client.0.smithi049.stdout:7/697: unlink d1/d1a/de7/d50/d7c/fb3 0 2024-09-19T09:03:01.619 INFO:tasks.workunit.client.0.smithi049.stdout:1/341: write d5/d6/d8/d13/f55 [1307487,60859] 0 2024-09-19T09:03:01.624 INFO:tasks.workunit.client.0.smithi049.stdout:9/672: dwrite d3/d14/d1a/f80 [4194304,4194304] 0 2024-09-19T09:03:01.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/560: rename d1/d11/d2e/d4e/d61/f85 to d1/d11/d3f/d5b/fa8 0 2024-09-19T09:03:01.628 INFO:tasks.workunit.client.0.smithi049.stdout:8/561: chown d1/f77 14919 1 2024-09-19T09:03:01.629 INFO:tasks.workunit.client.0.smithi049.stdout:8/562: dread - d1/d11/d3f/d5b/f9a zero size 2024-09-19T09:03:01.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/673: symlink d3/d14/d1a/d90/dae/le1 0 2024-09-19T09:03:01.649 INFO:tasks.workunit.client.0.smithi049.stdout:3/476: dread d10/f48 [0,4194304] 0 2024-09-19T09:03:01.651 INFO:tasks.workunit.client.0.smithi049.stdout:8/563: rename d1/d11/d3f/d5b/f67 to d1/d11/d3f/fa9 0 2024-09-19T09:03:01.654 INFO:tasks.workunit.client.0.smithi049.stdout:9/674: symlink d3/d14/d1a/d21/d67/le2 0 2024-09-19T09:03:01.655 INFO:tasks.workunit.client.0.smithi049.stdout:0/609: dwrite d5/d10/d13/f42 [0,4194304] 0 2024-09-19T09:03:01.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/342: creat d5/d6/f70 x:0 0 0 2024-09-19T09:03:01.657 INFO:tasks.workunit.client.0.smithi049.stdout:0/610: dread - d5/d10/d2f/faf zero size 2024-09-19T09:03:01.662 INFO:tasks.workunit.client.0.smithi049.stdout:2/650: write d1/d2/d23/f2c [2222765,21560] 0 2024-09-19T09:03:01.665 INFO:tasks.workunit.client.0.smithi049.stdout:8/564: creat d1/d11/d3f/d5b/faa x:0 0 0 2024-09-19T09:03:01.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/675: symlink d3/d14/d34/d44/le3 0 2024-09-19T09:03:01.669 INFO:tasks.workunit.client.0.smithi049.stdout:3/477: dread d10/d3d/f8c [4194304,4194304] 0 2024-09-19T09:03:01.681 INFO:tasks.workunit.client.0.smithi049.stdout:1/343: mkdir d5/d6/d19/d30/d64/d71 0 2024-09-19T09:03:01.684 INFO:tasks.workunit.client.0.smithi049.stdout:3/478: rename d10/d3d/d79/d87/f9a to d10/d11/d13/d30/f9b 0 2024-09-19T09:03:01.687 INFO:tasks.workunit.client.0.smithi049.stdout:9/676: mkdir d3/d14/d34/d9f/d82/db1/de4 0 2024-09-19T09:03:01.692 INFO:tasks.workunit.client.0.smithi049.stdout:3/479: creat d10/d11/d13/d30/f9c x:0 0 0 2024-09-19T09:03:01.694 INFO:tasks.workunit.client.0.smithi049.stdout:9/677: mknod d3/d14/d1a/d21/d67/ce5 0 2024-09-19T09:03:01.697 INFO:tasks.workunit.client.0.smithi049.stdout:9/678: read d3/d14/d1a/d90/f71 [1468756,67989] 0 2024-09-19T09:03:01.700 INFO:tasks.workunit.client.0.smithi049.stdout:9/679: readlink d3/d14/d1a/d21/d31/d8e/l93 0 2024-09-19T09:03:01.703 INFO:tasks.workunit.client.0.smithi049.stdout:7/698: dwrite d1/d1a/de7/d50/d7c/f97 [0,4194304] 0 2024-09-19T09:03:01.705 INFO:tasks.workunit.client.0.smithi049.stdout:7/699: dread - d1/d1a/da0/dd3/d62/fdd zero size 2024-09-19T09:03:01.711 INFO:tasks.workunit.client.0.smithi049.stdout:9/680: rename d3/d14/d34/d44/l47 to d3/d14/d1a/le6 0 2024-09-19T09:03:01.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/700: creat d1/d1a/da0/dd3/d62/d6b/ff1 x:0 0 0 2024-09-19T09:03:01.714 INFO:tasks.workunit.client.0.smithi049.stdout:0/611: write d5/d10/d13/d15/f1b [7593100,77644] 0 2024-09-19T09:03:01.715 INFO:tasks.workunit.client.0.smithi049.stdout:2/651: write d1/d4/d20/d26/f8a [317996,52062] 0 2024-09-19T09:03:01.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/612: chown d5/d10/d13/d30 49113828 1 2024-09-19T09:03:01.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/701: mkdir d1/d8/df2 0 2024-09-19T09:03:01.723 INFO:tasks.workunit.client.0.smithi049.stdout:2/652: symlink d1/d4/d1e/d9f/db3/d41/ld6 0 2024-09-19T09:03:01.723 INFO:tasks.workunit.client.0.smithi049.stdout:8/565: dwrite d1/d11/d45/f84 [0,4194304] 0 2024-09-19T09:03:01.726 INFO:tasks.workunit.client.0.smithi049.stdout:9/681: rename d3/d14/d1a/d21/d73/l97 to d3/d14/le7 0 2024-09-19T09:03:01.733 INFO:tasks.workunit.client.0.smithi049.stdout:1/344: dwrite d5/d6/d8/d13/f34 [0,4194304] 0 2024-09-19T09:03:01.735 INFO:tasks.workunit.client.0.smithi049.stdout:1/345: chown d5/d6/d19/d30/d64/d71 12419916 1 2024-09-19T09:03:01.736 INFO:tasks.workunit.client.0.smithi049.stdout:8/566: unlink d1/d1a/fa2 0 2024-09-19T09:03:01.740 INFO:tasks.workunit.client.0.smithi049.stdout:9/682: stat d3/l2a 0 2024-09-19T09:03:01.742 INFO:tasks.workunit.client.0.smithi049.stdout:9/683: readlink d3/d14/d34/d4c/l59 0 2024-09-19T09:03:01.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/613: dread d5/d10/d82/d67/f90 [0,4194304] 0 2024-09-19T09:03:01.746 INFO:tasks.workunit.client.0.smithi049.stdout:3/480: rmdir d10/d3d/d79/d87 0 2024-09-19T09:03:01.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/567: dwrite d1/ff [0,4194304] 0 2024-09-19T09:03:01.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/702: rename d1/d8/d19/f55 to d1/d1a/de7/d50/d7c/d9c/ff3 0 2024-09-19T09:03:01.758 INFO:tasks.workunit.client.0.smithi049.stdout:9/684: truncate d3/d14/d34/d44/f6a 198103 0 2024-09-19T09:03:01.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/568: mknod d1/d11/d2e/d4e/cab 0 2024-09-19T09:03:01.761 INFO:tasks.workunit.client.0.smithi049.stdout:8/569: write d1/d11/d4f/d87/f6a [2328312,123865] 0 2024-09-19T09:03:01.761 INFO:tasks.workunit.client.0.smithi049.stdout:2/653: rmdir d1/d2/d6c/dd4 0 2024-09-19T09:03:01.762 INFO:tasks.workunit.client.0.smithi049.stdout:8/570: fdatasync d1/d11/d4f/d87/f55 0 2024-09-19T09:03:01.764 INFO:tasks.workunit.client.0.smithi049.stdout:1/346: rename d5/d6/d8/d13/d24/f4c to d5/d6/d19/d21/f72 0 2024-09-19T09:03:01.765 INFO:tasks.workunit.client.0.smithi049.stdout:7/703: creat d1/d1a/de7/d59/ff4 x:0 0 0 2024-09-19T09:03:01.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/654: symlink d1/d2/d70/ld7 0 2024-09-19T09:03:01.777 INFO:tasks.workunit.client.0.smithi049.stdout:3/481: write fd [5270345,34312] 0 2024-09-19T09:03:01.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/614: write d5/d10/d13/d15/d36/f41 [1121162,35271] 0 2024-09-19T09:03:01.781 INFO:tasks.workunit.client.0.smithi049.stdout:9/685: truncate d3/f43 1757727 0 2024-09-19T09:03:01.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/655: mkdir d1/d4/dd8 0 2024-09-19T09:03:01.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/571: rename d1/lc to d1/d11/d4f/d87/d5d/lac 0 2024-09-19T09:03:01.788 INFO:tasks.workunit.client.0.smithi049.stdout:1/347: mkdir d5/d6/d73 0 2024-09-19T09:03:01.790 INFO:tasks.workunit.client.0.smithi049.stdout:3/482: mknod d10/d3d/c9d 0 2024-09-19T09:03:01.793 INFO:tasks.workunit.client.0.smithi049.stdout:9/686: creat d3/d14/d34/d9f/d82/db1/fe8 x:0 0 0 2024-09-19T09:03:01.796 INFO:tasks.workunit.client.0.smithi049.stdout:1/348: dwrite d5/d6/d8/d13/d24/f4a [4194304,4194304] 0 2024-09-19T09:03:01.797 INFO:tasks.workunit.client.0.smithi049.stdout:7/704: symlink d1/d53/lf5 0 2024-09-19T09:03:01.797 INFO:tasks.workunit.client.0.smithi049.stdout:1/349: chown d5/d6/d19/f42 106789165 1 2024-09-19T09:03:01.800 INFO:tasks.workunit.client.0.smithi049.stdout:3/483: unlink d10/d3d/d46/l7a 0 2024-09-19T09:03:01.801 INFO:tasks.workunit.client.0.smithi049.stdout:0/615: unlink d5/d10/d13/d30/d75/la9 0 2024-09-19T09:03:01.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/656: creat d1/d4/d1e/d9f/db7/fd9 x:0 0 0 2024-09-19T09:03:01.805 INFO:tasks.workunit.client.0.smithi049.stdout:8/572: mknod d1/d11/cad 0 2024-09-19T09:03:01.808 INFO:tasks.workunit.client.0.smithi049.stdout:0/616: dread d5/d10/d13/d15/d29/f5e [0,4194304] 0 2024-09-19T09:03:01.808 INFO:tasks.workunit.client.0.smithi049.stdout:0/617: write d5/d10/d13/d15/d36/f6e [366559,66639] 0 2024-09-19T09:03:01.811 INFO:tasks.workunit.client.0.smithi049.stdout:3/484: creat d10/d3d/d79/d80/f9e x:0 0 0 2024-09-19T09:03:01.815 INFO:tasks.workunit.client.0.smithi049.stdout:2/657: rename d1/d4/d1e/d21/fbf to d1/d4/d1e/d21/d8c/fda 0 2024-09-19T09:03:01.815 INFO:tasks.workunit.client.0.smithi049.stdout:2/658: stat d1/d2/d6c/dd5 0 2024-09-19T09:03:01.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/573: readlink d1/d11/l2f 0 2024-09-19T09:03:01.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/705: symlink d1/d53/dc6/dd8/lf6 0 2024-09-19T09:03:01.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/618: creat d5/d10/d82/fbc x:0 0 0 2024-09-19T09:03:01.826 INFO:tasks.workunit.client.0.smithi049.stdout:8/574: dwrite d1/d11/d4f/d87/d5d/d65/f7e [4194304,4194304] 0 2024-09-19T09:03:01.828 INFO:tasks.workunit.client.0.smithi049.stdout:9/687: truncate d3/d14/d1a/d21/d66/f8f 3038879 0 2024-09-19T09:03:01.829 INFO:tasks.workunit.client.0.smithi049.stdout:1/350: dwrite d5/d6/d8/f2a [0,4194304] 0 2024-09-19T09:03:01.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/485: rmdir d10/d3d/d51 39 2024-09-19T09:03:01.831 INFO:tasks.workunit.client.0.smithi049.stdout:1/351: dread d5/d6/f5b [0,4194304] 0 2024-09-19T09:03:01.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/659: mkdir d1/d4/d20/d92/dba/ddb 0 2024-09-19T09:03:01.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/352: chown d5/d6/f7 120 1 2024-09-19T09:03:01.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/353: chown d5 672128 1 2024-09-19T09:03:01.841 INFO:tasks.workunit.client.0.smithi049.stdout:0/619: creat d5/d10/d82/d67/d85/db4/dbb/fbd x:0 0 0 2024-09-19T09:03:01.842 INFO:tasks.workunit.client.0.smithi049.stdout:9/688: symlink d3/d14/d1a/d21/d31/d8e/le9 0 2024-09-19T09:03:01.843 INFO:tasks.workunit.client.0.smithi049.stdout:7/706: link d1/d1a/da0/dd3/d62/d6b/c7b d1/d8/df2/cf7 0 2024-09-19T09:03:01.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/620: readlink d5/d10/d13/d15/d29/la8 0 2024-09-19T09:03:01.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/575: getdents d1/d11/d3f/d5b 0 2024-09-19T09:03:01.849 INFO:tasks.workunit.client.0.smithi049.stdout:2/660: dwrite d1/d4/d1e/d9f/db3/d41/fa6 [0,4194304] 0 2024-09-19T09:03:01.849 INFO:tasks.workunit.client.0.smithi049.stdout:9/689: fdatasync d3/d14/d1a/d21/f2f 0 2024-09-19T09:03:01.852 INFO:tasks.workunit.client.0.smithi049.stdout:7/707: dread d1/d8/d19/f34 [0,4194304] 0 2024-09-19T09:03:01.854 INFO:tasks.workunit.client.0.smithi049.stdout:0/621: mkdir d5/d10/d2f/d6d/dbe 0 2024-09-19T09:03:01.855 INFO:tasks.workunit.client.0.smithi049.stdout:0/622: read - d5/d86/fa0 zero size 2024-09-19T09:03:01.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/354: rename d5/d6/d8/d13/d24/l4f to d5/d6/l74 0 2024-09-19T09:03:01.863 INFO:tasks.workunit.client.0.smithi049.stdout:7/708: creat d1/d8/d89/ff8 x:0 0 0 2024-09-19T09:03:01.867 INFO:tasks.workunit.client.0.smithi049.stdout:2/661: dwrite d1/d4/d1e/d9f/db3/d41/fa7 [0,4194304] 0 2024-09-19T09:03:01.869 INFO:tasks.workunit.client.0.smithi049.stdout:2/662: dread d1/d4/d1e/d21/f98 [0,4194304] 0 2024-09-19T09:03:01.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/355: dread - d5/d6/d19/f39 zero size 2024-09-19T09:03:01.871 INFO:tasks.workunit.client.0.smithi049.stdout:8/576: link d1/d11/d4f/d87/f6a d1/d11/d3f/d8c/fae 0 2024-09-19T09:03:01.877 INFO:tasks.workunit.client.0.smithi049.stdout:7/709: symlink d1/d1a/de7/d59/lf9 0 2024-09-19T09:03:01.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/663: dwrite d1/d4/d20/fc6 [0,4194304] 0 2024-09-19T09:03:01.880 INFO:tasks.workunit.client.0.smithi049.stdout:3/486: dread fd [0,4194304] 0 2024-09-19T09:03:01.887 INFO:tasks.workunit.client.0.smithi049.stdout:0/623: dread d5/d10/d13/d15/d29/d9a/f6f [0,4194304] 0 2024-09-19T09:03:01.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/690: creat d3/d14/d1a/d21/d31/d8e/dc2/fea x:0 0 0 2024-09-19T09:03:01.891 INFO:tasks.workunit.client.0.smithi049.stdout:8/577: mknod d1/d11/d2e/d4e/d61/d9f/caf 0 2024-09-19T09:03:01.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/487: symlink d10/d11/d27/d4f/d59/l9f 0 2024-09-19T09:03:01.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/578: mkdir d1/d1a/db0 0 2024-09-19T09:03:01.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/664: dwrite d1/d4/d1e/d45/faa [0,4194304] 0 2024-09-19T09:03:01.906 INFO:tasks.workunit.client.0.smithi049.stdout:2/665: chown d1/d4/d20/d92/dba 1276 1 2024-09-19T09:03:01.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/624: dwrite d5/d10/fae [0,4194304] 0 2024-09-19T09:03:01.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/710: dread d1/d1a/f38 [0,4194304] 0 2024-09-19T09:03:01.907 INFO:tasks.workunit.client.0.smithi049.stdout:1/356: dread d5/d6/fa [0,4194304] 0 2024-09-19T09:03:01.911 INFO:tasks.workunit.client.0.smithi049.stdout:3/488: mknod d10/d11/d13/d30/ca0 0 2024-09-19T09:03:01.916 INFO:tasks.workunit.client.0.smithi049.stdout:8/579: symlink d1/d27/lb1 0 2024-09-19T09:03:01.918 INFO:tasks.workunit.client.0.smithi049.stdout:2/666: symlink d1/d2b/ldc 0 2024-09-19T09:03:01.924 INFO:tasks.workunit.client.0.smithi049.stdout:3/489: creat d10/d11/d27/d4f/fa1 x:0 0 0 2024-09-19T09:03:01.925 INFO:tasks.workunit.client.0.smithi049.stdout:2/667: mknod d1/d4/d1e/d9f/db3/d41/d7d/cdd 0 2024-09-19T09:03:01.927 INFO:tasks.workunit.client.0.smithi049.stdout:9/691: creat d3/d14/d1a/d21/d31/d8e/dc2/feb x:0 0 0 2024-09-19T09:03:01.931 INFO:tasks.workunit.client.0.smithi049.stdout:3/490: unlink d10/d11/c1e 0 2024-09-19T09:03:01.931 INFO:tasks.workunit.client.0.smithi049.stdout:8/580: fdatasync d1/d11/f74 0 2024-09-19T09:03:01.934 INFO:tasks.workunit.client.0.smithi049.stdout:7/711: link d1/fed d1/d1a/de7/d50/d7c/d99/ffa 0 2024-09-19T09:03:01.935 INFO:tasks.workunit.client.0.smithi049.stdout:3/491: write d10/d11/d27/d4f/f86 [357494,100840] 0 2024-09-19T09:03:01.936 INFO:tasks.workunit.client.0.smithi049.stdout:8/581: read d1/d11/f74 [3141437,7056] 0 2024-09-19T09:03:01.938 INFO:tasks.workunit.client.0.smithi049.stdout:9/692: dwrite d3/d14/d34/d9f/f7e [0,4194304] 0 2024-09-19T09:03:01.942 INFO:tasks.workunit.client.0.smithi049.stdout:0/625: link d5/le d5/d10/d82/d67/d85/db4/lbf 0 2024-09-19T09:03:01.948 INFO:tasks.workunit.client.0.smithi049.stdout:7/712: write d1/d8/d2d/d36/f45 [177454,126502] 0 2024-09-19T09:03:01.950 INFO:tasks.workunit.client.0.smithi049.stdout:8/582: mknod d1/d11/d3f/d5b/cb2 0 2024-09-19T09:03:01.953 INFO:tasks.workunit.client.0.smithi049.stdout:9/693: unlink d3/d14/d34/d4c/f5d 0 2024-09-19T09:03:01.954 INFO:tasks.workunit.client.0.smithi049.stdout:1/357: truncate d5/d6/d8/d13/d24/d3b/f5e 1417557 0 2024-09-19T09:03:01.958 INFO:tasks.workunit.client.0.smithi049.stdout:3/492: mknod d10/d11/d27/ca2 0 2024-09-19T09:03:01.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/713: symlink d1/d8/d2d/d36/lfb 0 2024-09-19T09:03:01.959 INFO:tasks.workunit.client.0.smithi049.stdout:7/714: stat d1/d8/d19/l74 0 2024-09-19T09:03:01.965 INFO:tasks.workunit.client.0.smithi049.stdout:1/358: readlink d5/d6/l74 0 2024-09-19T09:03:01.968 INFO:tasks.workunit.client.0.smithi049.stdout:2/668: getdents d1/d4/d20/d92 0 2024-09-19T09:03:01.974 INFO:tasks.workunit.client.0.smithi049.stdout:3/493: dwrite d10/f34 [0,4194304] 0 2024-09-19T09:03:01.976 INFO:tasks.workunit.client.0.smithi049.stdout:8/583: write d1/d11/d45/f91 [631307,105493] 0 2024-09-19T09:03:01.979 INFO:tasks.workunit.client.0.smithi049.stdout:8/584: read d1/d11/d2e/f56 [7590346,45525] 0 2024-09-19T09:03:01.980 INFO:tasks.workunit.client.0.smithi049.stdout:8/585: chown d1/d11/d3f/d8c/fa4 0 1 2024-09-19T09:03:01.980 INFO:tasks.workunit.client.0.smithi049.stdout:1/359: write d5/d6/d8/d13/d24/f43 [531829,117917] 0 2024-09-19T09:03:01.985 INFO:tasks.workunit.client.0.smithi049.stdout:0/626: rename d5/d10/d82/d67/d85/db4/lbf to d5/d10/d13/lc0 0 2024-09-19T09:03:01.986 INFO:tasks.workunit.client.0.smithi049.stdout:3/494: fdatasync fd 0 2024-09-19T09:03:01.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/424: sync 2024-09-19T09:03:01.989 INFO:tasks.workunit.client.0.smithi049.stdout:0/627: read d5/d10/d13/d15/f43 [708763,24786] 0 2024-09-19T09:03:01.989 INFO:tasks.workunit.client.0.smithi049.stdout:9/694: getdents d3/d14/d1a/d21 0 2024-09-19T09:03:01.993 INFO:tasks.workunit.client.0.smithi049.stdout:9/695: write d3/d14/d1a/d21/d31/d8e/dc2/feb [296171,116970] 0 2024-09-19T09:03:01.994 INFO:tasks.workunit.client.0.smithi049.stdout:3/495: mkdir d10/d3d/d76/da3 0 2024-09-19T09:03:02.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/696: read d3/d14/d1a/d21/d31/d8e/fab [3960194,4231] 0 2024-09-19T09:03:02.001 INFO:tasks.workunit.client.0.smithi049.stdout:5/425: dwrite d3/d5/de/f1a [4194304,4194304] 0 2024-09-19T09:03:02.001 INFO:tasks.workunit.client.0.smithi049.stdout:0/628: dwrite d5/d10/d2f/d6d/f8a [0,4194304] 0 2024-09-19T09:03:02.005 INFO:tasks.workunit.client.0.smithi049.stdout:7/715: rename d1/d8/d2d/dd9/cea to d1/d1a/de7/d59/cfc 0 2024-09-19T09:03:02.008 INFO:tasks.workunit.client.0.smithi049.stdout:3/496: creat d10/d3d/d79/fa4 x:0 0 0 2024-09-19T09:03:02.009 INFO:tasks.workunit.client.0.smithi049.stdout:1/360: link d5/d6/f10 d5/d6/d8/d1a/f75 0 2024-09-19T09:03:02.009 INFO:tasks.workunit.client.0.smithi049.stdout:0/629: readlink d5/d10/d13/l38 0 2024-09-19T09:03:02.010 INFO:tasks.workunit.client.0.smithi049.stdout:5/426: truncate d3/dc/d43/f6a 1786060 0 2024-09-19T09:03:02.011 INFO:tasks.workunit.client.0.smithi049.stdout:9/697: truncate d3/d14/d34/d9f/f76 716004 0 2024-09-19T09:03:02.013 INFO:tasks.workunit.client.0.smithi049.stdout:7/716: unlink d1/d53/f98 0 2024-09-19T09:03:02.016 INFO:tasks.workunit.client.0.smithi049.stdout:2/669: rename d1/d2/f34 to d1/d4/d1e/d9f/db3/d41/fde 0 2024-09-19T09:03:02.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/630: creat d5/d10/d13/d15/d36/d3d/fc1 x:0 0 0 2024-09-19T09:03:02.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/427: readlink d3/d5/l19 0 2024-09-19T09:03:02.027 INFO:tasks.workunit.client.0.smithi049.stdout:8/586: rename d1/d11/d2e/d4e/d61/d9f/caf to d1/d11/d2e/d4e/cb3 0 2024-09-19T09:03:02.028 INFO:tasks.workunit.client.0.smithi049.stdout:1/361: dread d5/d6/d19/d21/f46 [0,4194304] 0 2024-09-19T09:03:02.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/362: fsync d5/d6/d8/d13/f55 0 2024-09-19T09:03:02.031 INFO:tasks.workunit.client.0.smithi049.stdout:3/497: rename d10/c90 to d10/d3d/d46/ca5 0 2024-09-19T09:03:02.035 INFO:tasks.workunit.client.0.smithi049.stdout:2/670: dread d1/f11 [0,4194304] 0 2024-09-19T09:03:02.036 INFO:tasks.workunit.client.0.smithi049.stdout:0/631: creat d5/d10/d13/d15/d36/fc2 x:0 0 0 2024-09-19T09:03:02.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/370: sync 2024-09-19T09:03:02.037 INFO:tasks.workunit.client.0.smithi049.stdout:4/415: sync 2024-09-19T09:03:02.038 INFO:tasks.workunit.client.0.smithi049.stdout:8/587: dread d1/d11/d3f/fa9 [0,4194304] 0 2024-09-19T09:03:02.044 INFO:tasks.workunit.client.0.smithi049.stdout:9/698: rename d3/d14/d34/d9f/d82 to d3/dbb/dec 0 2024-09-19T09:03:02.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/717: write d1/d8/fb [4325085,117013] 0 2024-09-19T09:03:02.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/718: write d1/d1a/de7/fe4 [133844,87347] 0 2024-09-19T09:03:02.047 INFO:tasks.workunit.client.0.smithi049.stdout:7/719: chown d1/d8/d2d/d72 75862 1 2024-09-19T09:03:02.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/371: creat dc/d1b/d20/f72 x:0 0 0 2024-09-19T09:03:02.055 INFO:tasks.workunit.client.0.smithi049.stdout:6/372: fsync dc/d16/f70 0 2024-09-19T09:03:02.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/373: dread - dc/d1b/d20/d2f/d31/f69 zero size 2024-09-19T09:03:02.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/374: chown dc/d1b/d20/d2f/l49 248 1 2024-09-19T09:03:02.060 INFO:tasks.workunit.client.0.smithi049.stdout:9/699: creat d3/d14/d1a/d21/d67/fed x:0 0 0 2024-09-19T09:03:02.062 INFO:tasks.workunit.client.0.smithi049.stdout:4/416: write f2 [4381753,94980] 0 2024-09-19T09:03:02.065 INFO:tasks.workunit.client.0.smithi049.stdout:8/588: write d1/d27/f60 [405782,21536] 0 2024-09-19T09:03:02.066 INFO:tasks.workunit.client.0.smithi049.stdout:8/589: chown d1/d11/cad 654382 1 2024-09-19T09:03:02.066 INFO:tasks.workunit.client.0.smithi049.stdout:0/632: creat d5/d10/d2f/d6d/dbe/fc3 x:0 0 0 2024-09-19T09:03:02.070 INFO:tasks.workunit.client.0.smithi049.stdout:5/428: rename d3/d5/l35 to d3/d5/d20/d38/d5a/l81 0 2024-09-19T09:03:02.071 INFO:tasks.workunit.client.0.smithi049.stdout:9/700: write d3/d14/d1a/f35 [2934765,90833] 0 2024-09-19T09:03:02.073 INFO:tasks.workunit.client.0.smithi049.stdout:4/417: fdatasync d4/d15/f59 0 2024-09-19T09:03:02.074 INFO:tasks.workunit.client.0.smithi049.stdout:4/418: write d4/d35/f3c [4333934,110759] 0 2024-09-19T09:03:02.075 INFO:tasks.workunit.client.0.smithi049.stdout:2/671: symlink d1/d2/d6c/ldf 0 2024-09-19T09:03:02.076 INFO:tasks.workunit.client.0.smithi049.stdout:4/419: write d4/d4c/f73 [3851149,17476] 0 2024-09-19T09:03:02.076 INFO:tasks.workunit.client.0.smithi049.stdout:0/633: fsync d5/d10/d13/d15/f18 0 2024-09-19T09:03:02.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/375: mkdir dc/d1b/d20/d2f/d6b/d73 0 2024-09-19T09:03:02.080 INFO:tasks.workunit.client.0.smithi049.stdout:6/376: write dc/d16/f2e [943853,21521] 0 2024-09-19T09:03:02.083 INFO:tasks.workunit.client.0.smithi049.stdout:5/429: creat d3/dc/d43/f82 x:0 0 0 2024-09-19T09:03:02.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/590: dread d1/d11/d4f/d87/f83 [0,4194304] 0 2024-09-19T09:03:02.083 INFO:tasks.workunit.client.0.smithi049.stdout:3/498: link d10/d11/d13/f6e d10/d3d/fa6 0 2024-09-19T09:03:02.087 INFO:tasks.workunit.client.0.smithi049.stdout:9/701: creat d3/d14/d1a/d21/d73/fee x:0 0 0 2024-09-19T09:03:02.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/363: rename d5/d6/d8/d1a/f75 to d5/d6/d19/d21/d52/f76 0 2024-09-19T09:03:02.095 INFO:tasks.workunit.client.0.smithi049.stdout:1/364: write d5/d6/d19/d30/f65 [934404,116053] 0 2024-09-19T09:03:02.101 INFO:tasks.workunit.client.0.smithi049.stdout:2/672: mkdir d1/d2/d70/de0 0 2024-09-19T09:03:02.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/420: unlink d4/d45/d3f/d47/d5f/c60 0 2024-09-19T09:03:02.103 INFO:tasks.workunit.client.0.smithi049.stdout:1/365: dwrite d5/d6/d8/d13/f6e [0,4194304] 0 2024-09-19T09:03:02.104 INFO:tasks.workunit.client.0.smithi049.stdout:2/673: readlink d1/d4/d1e/d9f/db3/d41/d7d/ld1 0 2024-09-19T09:03:02.105 INFO:tasks.workunit.client.0.smithi049.stdout:0/634: mkdir d5/d10/d13/dc4 0 2024-09-19T09:03:02.107 INFO:tasks.workunit.client.0.smithi049.stdout:5/430: rename d3/d5/de/d12/l3f to d3/d5/d20/d57/d72/l83 0 2024-09-19T09:03:02.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/377: link dc/d1b/d20/f32 dc/d1b/d6f/f74 0 2024-09-19T09:03:02.112 INFO:tasks.workunit.client.0.smithi049.stdout:9/702: truncate d3/d14/d34/d9f/f76 104150 0 2024-09-19T09:03:02.115 INFO:tasks.workunit.client.0.smithi049.stdout:2/674: dwrite d1/f9b [0,4194304] 0 2024-09-19T09:03:02.122 INFO:tasks.workunit.client.0.smithi049.stdout:0/635: creat d5/d10/d82/d67/d85/fc5 x:0 0 0 2024-09-19T09:03:02.124 INFO:tasks.workunit.client.0.smithi049.stdout:5/431: rmdir d3/d6c 39 2024-09-19T09:03:02.130 INFO:tasks.workunit.client.0.smithi049.stdout:6/378: symlink dc/d16/l75 0 2024-09-19T09:03:02.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/703: creat d3/d14/d34/d9f/fef x:0 0 0 2024-09-19T09:03:02.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/591: truncate d1/d11/f3a 8337084 0 2024-09-19T09:03:02.286 INFO:tasks.workunit.client.0.smithi049.stdout:3/499: getdents d10/d11/d27/d4f/d59 0 2024-09-19T09:03:02.288 INFO:tasks.workunit.client.0.smithi049.stdout:4/421: write d4/d15/f83 [36573,44136] 0 2024-09-19T09:03:02.290 INFO:tasks.workunit.client.0.smithi049.stdout:1/366: write d5/d6/f10 [4822799,2443] 0 2024-09-19T09:03:02.294 INFO:tasks.workunit.client.0.smithi049.stdout:8/592: dwrite d1/d11/d3f/f9c [0,4194304] 0 2024-09-19T09:03:02.295 INFO:tasks.workunit.client.0.smithi049.stdout:0/636: dwrite d5/d10/d13/d15/f43 [0,4194304] 0 2024-09-19T09:03:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:8/593: chown d1/d27/f4b 2 1 2024-09-19T09:03:02.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/379: getdents dc/d1b/d20/d2f/d6b/d73 0 2024-09-19T09:03:02.332 INFO:tasks.workunit.client.0.smithi049.stdout:3/500: creat d10/d11/d13/d30/fa7 x:0 0 0 2024-09-19T09:03:02.333 INFO:tasks.workunit.client.0.smithi049.stdout:1/367: mknod d5/d6/d19/d30/d63/c77 0 2024-09-19T09:03:02.334 INFO:tasks.workunit.client.0.smithi049.stdout:0/637: creat d5/d10/d2f/d6d/fc6 x:0 0 0 2024-09-19T09:03:02.335 INFO:tasks.workunit.client.0.smithi049.stdout:0/638: chown d5/d10/d13/f42 23 1 2024-09-19T09:03:02.336 INFO:tasks.workunit.client.0.smithi049.stdout:9/704: symlink d3/d14/d1a/d21/d73/db8/dc5/lf0 0 2024-09-19T09:03:02.339 INFO:tasks.workunit.client.0.smithi049.stdout:5/432: creat d3/d5/d1c/d2d/f84 x:0 0 0 2024-09-19T09:03:02.343 INFO:tasks.workunit.client.0.smithi049.stdout:2/675: link d1/d2/d6c/laf d1/d2/le1 0 2024-09-19T09:03:02.345 INFO:tasks.workunit.client.0.smithi049.stdout:6/380: creat dc/d12/d6e/f76 x:0 0 0 2024-09-19T09:03:02.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/705: dwrite d3/d14/d1a/d21/d31/fb6 [4194304,4194304] 0 2024-09-19T09:03:02.347 INFO:tasks.workunit.client.0.smithi049.stdout:9/706: dread - d3/d14/d1a/d21/d31/d8e/f7a zero size 2024-09-19T09:03:02.349 INFO:tasks.workunit.client.0.smithi049.stdout:1/368: unlink d5/l57 0 2024-09-19T09:03:02.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/594: dread d1/d11/f4d [0,4194304] 0 2024-09-19T09:03:02.351 INFO:tasks.workunit.client.0.smithi049.stdout:0/639: getdents d5/d10/d13/dc4 0 2024-09-19T09:03:02.356 INFO:tasks.workunit.client.0.smithi049.stdout:6/381: creat dc/d1b/f77 x:0 0 0 2024-09-19T09:03:02.358 INFO:tasks.workunit.client.0.smithi049.stdout:5/433: creat d3/d6c/f85 x:0 0 0 2024-09-19T09:03:02.359 INFO:tasks.workunit.client.0.smithi049.stdout:9/707: stat d3/c27 0 2024-09-19T09:03:02.360 INFO:tasks.workunit.client.0.smithi049.stdout:1/369: fdatasync d5/d6/fa 0 2024-09-19T09:03:02.361 INFO:tasks.workunit.client.0.smithi049.stdout:1/370: chown d5/d6/dc 19 1 2024-09-19T09:03:02.363 INFO:tasks.workunit.client.0.smithi049.stdout:8/595: creat d1/d11/d2e/d4e/d61/d9f/fb4 x:0 0 0 2024-09-19T09:03:02.363 INFO:tasks.workunit.client.0.smithi049.stdout:8/596: stat d1/d27/lb1 0 2024-09-19T09:03:02.366 INFO:tasks.workunit.client.0.smithi049.stdout:0/640: unlink d5/d10/d13/d15/d36/f41 0 2024-09-19T09:03:02.367 INFO:tasks.workunit.client.0.smithi049.stdout:0/641: fdatasync d5/d10/d13/f80 0 2024-09-19T09:03:02.372 INFO:tasks.workunit.client.0.smithi049.stdout:6/382: mkdir dc/d1b/d78 0 2024-09-19T09:03:02.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/708: creat d3/d14/d1a/d21/d67/d94/ff1 x:0 0 0 2024-09-19T09:03:02.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/371: mkdir d5/d6/d8/d1a/d78 0 2024-09-19T09:03:02.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/372: dread - d5/d6/d8/f62 zero size 2024-09-19T09:03:02.381 INFO:tasks.workunit.client.0.smithi049.stdout:3/501: link d10/d11/l8e d10/d11/d27/d4f/d59/la8 0 2024-09-19T09:03:02.385 INFO:tasks.workunit.client.0.smithi049.stdout:0/642: symlink d5/d10/d82/d67/d85/db4/lc7 0 2024-09-19T09:03:02.388 INFO:tasks.workunit.client.0.smithi049.stdout:5/434: symlink d3/d5/de/d12/d45/d7a/l86 0 2024-09-19T09:03:02.390 INFO:tasks.workunit.client.0.smithi049.stdout:8/597: mkdir d1/d11/d2e/db5 0 2024-09-19T09:03:02.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/435: stat d3/d5/de/d12/d45/d7a/l86 0 2024-09-19T09:03:02.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/676: dwrite f0 [0,4194304] 0 2024-09-19T09:03:02.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/643: rmdir d5/d10/d3c 39 2024-09-19T09:03:02.394 INFO:tasks.workunit.client.0.smithi049.stdout:6/383: mknod dc/d12/c79 0 2024-09-19T09:03:02.395 INFO:tasks.workunit.client.0.smithi049.stdout:0/644: dread - d5/d10/d2f/faf zero size 2024-09-19T09:03:02.396 INFO:tasks.workunit.client.0.smithi049.stdout:9/709: rename d3/f43 to d3/dbb/dec/dd0/dd4/ff2 0 2024-09-19T09:03:02.397 INFO:tasks.workunit.client.0.smithi049.stdout:6/384: chown dc/d16 1 1 2024-09-19T09:03:02.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/502: link d10/d3d/d79/d80/f9e d10/d3d/d79/d80/fa9 0 2024-09-19T09:03:02.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/598: rmdir d1/d1a/d8b/d8e 39 2024-09-19T09:03:02.403 INFO:tasks.workunit.client.0.smithi049.stdout:1/373: dwrite d5/f54 [0,4194304] 0 2024-09-19T09:03:02.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/599: chown d1/d11/d2e/d4e/d61/d9f/fb4 1 1 2024-09-19T09:03:02.408 INFO:tasks.workunit.client.0.smithi049.stdout:1/374: readlink d5/d6/d19/d30/l5a 0 2024-09-19T09:03:02.409 INFO:tasks.workunit.client.0.smithi049.stdout:5/436: truncate d3/f6 2585633 0 2024-09-19T09:03:02.411 INFO:tasks.workunit.client.0.smithi049.stdout:0/645: creat d5/d10/d13/dc4/fc8 x:0 0 0 2024-09-19T09:03:02.412 INFO:tasks.workunit.client.0.smithi049.stdout:9/710: symlink d3/d14/lf3 0 2024-09-19T09:03:02.412 INFO:tasks.workunit.client.0.smithi049.stdout:6/385: dread dc/d12/f43 [0,4194304] 0 2024-09-19T09:03:02.415 INFO:tasks.workunit.client.0.smithi049.stdout:2/677: dwrite d1/d4/d20/d92/fd2 [0,4194304] 0 2024-09-19T09:03:02.419 INFO:tasks.workunit.client.0.smithi049.stdout:2/678: readlink d1/d2/d6c/ldf 0 2024-09-19T09:03:02.424 INFO:tasks.workunit.client.0.smithi049.stdout:6/386: symlink dc/d12/d5a/l7a 0 2024-09-19T09:03:02.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/503: creat d10/d3d/faa x:0 0 0 2024-09-19T09:03:02.425 INFO:tasks.workunit.client.0.smithi049.stdout:2/679: dread - d1/d2/d70/fa1 zero size 2024-09-19T09:03:02.427 INFO:tasks.workunit.client.0.smithi049.stdout:1/375: dwrite d5/d6/d8/f62 [0,4194304] 0 2024-09-19T09:03:02.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/600: dwrite d1/d11/d4f/d87/d5d/d65/f7e [0,4194304] 0 2024-09-19T09:03:02.428 INFO:tasks.workunit.client.0.smithi049.stdout:9/711: rename d3/fa3 to d3/d14/d1a/d21/d31/d8e/dc2/d9e/ff4 0 2024-09-19T09:03:02.428 INFO:tasks.workunit.client.0.smithi049.stdout:2/680: dread - d1/d2/d70/fac zero size 2024-09-19T09:03:02.429 INFO:tasks.workunit.client.0.smithi049.stdout:6/387: write dc/d12/f15 [3691219,62388] 0 2024-09-19T09:03:02.441 INFO:tasks.workunit.client.0.smithi049.stdout:6/388: readlink dc/d1b/d20/d2f/d31/l3e 0 2024-09-19T09:03:02.447 INFO:tasks.workunit.client.0.smithi049.stdout:5/437: getdents d3/d5/d20/d38/d5a 0 2024-09-19T09:03:02.449 INFO:tasks.workunit.client.0.smithi049.stdout:6/389: mknod dc/d1b/d20/d2f/c7b 0 2024-09-19T09:03:02.451 INFO:tasks.workunit.client.0.smithi049.stdout:9/712: mkdir d3/d14/d1a/d21/d31/d8e/df5 0 2024-09-19T09:03:02.454 INFO:tasks.workunit.client.0.smithi049.stdout:1/376: rmdir d5/d6/dc/d69 0 2024-09-19T09:03:02.455 INFO:tasks.workunit.client.0.smithi049.stdout:5/438: creat d3/d5/de/f87 x:0 0 0 2024-09-19T09:03:02.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/377: chown d5/d6/d8/d13/d24/d3b/l41 192526 1 2024-09-19T09:03:02.456 INFO:tasks.workunit.client.0.smithi049.stdout:1/378: readlink d5/d6/d8/d1a/l50 0 2024-09-19T09:03:02.459 INFO:tasks.workunit.client.0.smithi049.stdout:3/504: getdents d10/d11 0 2024-09-19T09:03:02.460 INFO:tasks.workunit.client.0.smithi049.stdout:5/439: chown d3/d5/f1f 11639 1 2024-09-19T09:03:02.463 INFO:tasks.workunit.client.0.smithi049.stdout:9/713: fsync d3/dbb/dec/dd0/dd4/ff2 0 2024-09-19T09:03:02.470 INFO:tasks.workunit.client.0.smithi049.stdout:9/714: symlink d3/d14/d34/d74/lf6 0 2024-09-19T09:03:02.480 INFO:tasks.workunit.client.0.smithi049.stdout:9/715: symlink d3/d14/d1a/d21/d31/d8e/dc2/d9e/lf7 0 2024-09-19T09:03:02.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/390: dwrite dc/d16/f3b [0,4194304] 0 2024-09-19T09:03:02.485 INFO:tasks.workunit.client.0.smithi049.stdout:1/379: dwrite d5/d6/f38 [0,4194304] 0 2024-09-19T09:03:02.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/505: dwrite d10/d11/d27/d4f/f60 [0,4194304] 0 2024-09-19T09:03:02.490 INFO:tasks.workunit.client.0.smithi049.stdout:1/380: stat d5/d6 0 2024-09-19T09:03:02.490 INFO:tasks.workunit.client.0.smithi049.stdout:5/440: dwrite d3/d5/d1c/f22 [4194304,4194304] 0 2024-09-19T09:03:02.510 INFO:tasks.workunit.client.0.smithi049.stdout:6/391: creat dc/d1b/d78/f7c x:0 0 0 2024-09-19T09:03:02.510 INFO:tasks.workunit.client.0.smithi049.stdout:9/716: write d3/d14/f92 [46787,110234] 0 2024-09-19T09:03:02.513 INFO:tasks.workunit.client.0.smithi049.stdout:3/506: write d10/d11/d13/d30/f6d [485951,25742] 0 2024-09-19T09:03:02.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/381: symlink d5/d6/d8/d13/d24/l79 0 2024-09-19T09:03:02.514 INFO:tasks.workunit.client.0.smithi049.stdout:5/441: mkdir d3/d5/de/d12/d7d/d88 0 2024-09-19T09:03:02.515 INFO:tasks.workunit.client.0.smithi049.stdout:1/382: write d5/d6/d19/f42 [841859,93134] 0 2024-09-19T09:03:02.522 INFO:tasks.workunit.client.0.smithi049.stdout:3/507: rename d10/d11/c25 to d10/d3d/d79/d80/cab 0 2024-09-19T09:03:02.524 INFO:tasks.workunit.client.0.smithi049.stdout:1/383: fdatasync d5/d6/f7 0 2024-09-19T09:03:02.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/392: write dc/d16/f3d [132652,108209] 0 2024-09-19T09:03:02.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/717: truncate d3/d14/faa 306903 0 2024-09-19T09:03:02.529 INFO:tasks.workunit.client.0.smithi049.stdout:3/508: mkdir d10/d3d/d76/dac 0 2024-09-19T09:03:02.530 INFO:tasks.workunit.client.0.smithi049.stdout:1/384: dread d5/d6/d8/d13/d24/f43 [0,4194304] 0 2024-09-19T09:03:02.542 INFO:tasks.workunit.client.0.smithi049.stdout:5/442: dread d3/f62 [0,4194304] 0 2024-09-19T09:03:02.547 INFO:tasks.workunit.client.0.smithi049.stdout:1/385: rename d5/f20 to d5/f7a 0 2024-09-19T09:03:02.549 INFO:tasks.workunit.client.0.smithi049.stdout:6/393: write dc/d12/f27 [462382,10671] 0 2024-09-19T09:03:02.550 INFO:tasks.workunit.client.0.smithi049.stdout:6/394: write dc/d1b/f77 [31595,97699] 0 2024-09-19T09:03:02.552 INFO:tasks.workunit.client.0.smithi049.stdout:5/443: rmdir d3 39 2024-09-19T09:03:02.556 INFO:tasks.workunit.client.0.smithi049.stdout:3/509: truncate d10/d11/d27/f68 1180259 0 2024-09-19T09:03:02.558 INFO:tasks.workunit.client.0.smithi049.stdout:6/395: mknod dc/d1b/d20/d2f/c7d 0 2024-09-19T09:03:02.560 INFO:tasks.workunit.client.0.smithi049.stdout:9/718: dwrite d3/d14/f51 [0,4194304] 0 2024-09-19T09:03:02.560 INFO:tasks.workunit.client.0.smithi049.stdout:5/444: fdatasync d3/d6c/f85 0 2024-09-19T09:03:02.568 INFO:tasks.workunit.client.0.smithi049.stdout:3/510: mkdir d10/d3d/d76/dac/dad 0 2024-09-19T09:03:02.573 INFO:tasks.workunit.client.0.smithi049.stdout:1/386: rename d5/c60 to d5/d6/d19/c7b 0 2024-09-19T09:03:02.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/396: dwrite dc/d12/f4d [0,4194304] 0 2024-09-19T09:03:02.576 INFO:tasks.workunit.client.0.smithi049.stdout:3/511: unlink d10/d3d/c9d 0 2024-09-19T09:03:02.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/719: dwrite d3/d14/d34/d9f/f7e [4194304,4194304] 0 2024-09-19T09:03:02.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/387: write d5/d6/d8/f5d [1013324,109501] 0 2024-09-19T09:03:02.582 INFO:tasks.workunit.client.0.smithi049.stdout:6/397: write dc/d1b/d20/d2f/d4c/f5e [7908560,84897] 0 2024-09-19T09:03:02.586 INFO:tasks.workunit.client.0.smithi049.stdout:3/512: read d10/d11/d27/d4f/f60 [1937159,125101] 0 2024-09-19T09:03:02.589 INFO:tasks.workunit.client.0.smithi049.stdout:9/720: dread d3/d14/d1a/d90/fa6 [0,4194304] 0 2024-09-19T09:03:02.589 INFO:tasks.workunit.client.0.smithi049.stdout:3/513: chown d10/d3d/d79/d80/fa9 180804499 1 2024-09-19T09:03:02.593 INFO:tasks.workunit.client.0.smithi049.stdout:5/445: dread d3/d5/de/f1a [0,4194304] 0 2024-09-19T09:03:02.596 INFO:tasks.workunit.client.0.smithi049.stdout:6/398: mknod dc/d1b/d20/d2f/d4c/c7e 0 2024-09-19T09:03:02.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/388: dwrite d5/d6/d19/f61 [0,4194304] 0 2024-09-19T09:03:02.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/514: dread - d10/d11/d27/f89 zero size 2024-09-19T09:03:02.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/721: dwrite d3/d14/d1a/d21/d31/f62 [0,4194304] 0 2024-09-19T09:03:02.604 INFO:tasks.workunit.client.0.smithi049.stdout:5/446: read d3/f32 [4142285,37126] 0 2024-09-19T09:03:02.605 INFO:tasks.workunit.client.0.smithi049.stdout:5/447: read - d3/d5/de/f23 zero size 2024-09-19T09:03:02.606 INFO:tasks.workunit.client.0.smithi049.stdout:5/448: dread - d3/d6c/f85 zero size 2024-09-19T09:03:02.607 INFO:tasks.workunit.client.0.smithi049.stdout:3/515: mknod d10/d11/d27/d4f/d59/d81/cae 0 2024-09-19T09:03:02.613 INFO:tasks.workunit.client.0.smithi049.stdout:5/449: fsync d3/dc/d43/f82 0 2024-09-19T09:03:02.615 INFO:tasks.workunit.client.0.smithi049.stdout:5/450: write d3/d5/f1b [5014798,49157] 0 2024-09-19T09:03:02.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/722: rename d3/d14/d1a/le6 to d3/d14/d34/d9f/lf8 0 2024-09-19T09:03:02.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/389: creat d5/d6/d8/d13/f7c x:0 0 0 2024-09-19T09:03:02.619 INFO:tasks.workunit.client.0.smithi049.stdout:1/390: write d5/d6/d8/f2a [3830232,50086] 0 2024-09-19T09:03:02.620 INFO:tasks.workunit.client.0.smithi049.stdout:3/516: mkdir d10/d3d/d76/dac/dad/daf 0 2024-09-19T09:03:02.620 INFO:tasks.workunit.client.0.smithi049.stdout:1/391: stat d5/d6/dc/f56 0 2024-09-19T09:03:02.622 INFO:tasks.workunit.client.0.smithi049.stdout:5/451: mkdir d3/d5/d1c/d2d/d89 0 2024-09-19T09:03:02.625 INFO:tasks.workunit.client.0.smithi049.stdout:9/723: mknod d3/dbb/dec/dd0/dd4/cf9 0 2024-09-19T09:03:02.627 INFO:tasks.workunit.client.0.smithi049.stdout:9/724: readlink d3/d14/d1a/d21/d73/l85 0 2024-09-19T09:03:02.629 INFO:tasks.workunit.client.0.smithi049.stdout:9/725: write d3/d14/d1a/d21/d67/d94/fde [974614,46014] 0 2024-09-19T09:03:02.637 INFO:tasks.workunit.client.0.smithi049.stdout:9/726: creat d3/d14/d1a/d21/d73/db8/ffa x:0 0 0 2024-09-19T09:03:02.642 INFO:tasks.workunit.client.0.smithi049.stdout:5/452: getdents d3/d5/d1c 0 2024-09-19T09:03:02.644 INFO:tasks.workunit.client.0.smithi049.stdout:9/727: mknod d3/d14/d1a/d21/d67/cfb 0 2024-09-19T09:03:02.647 INFO:tasks.workunit.client.0.smithi049.stdout:9/728: mknod d3/dbb/dec/db1/cfc 0 2024-09-19T09:03:02.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/453: truncate d3/d5/d20/d38/f46 988166 0 2024-09-19T09:03:02.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/729: rename d3/d14/d1a/d21/d73/fee to d3/d14/d34/d4c/d9c/ffd 0 2024-09-19T09:03:02.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/730: readlink d3/dbb/dec/db1/lc4 0 2024-09-19T09:03:02.678 INFO:tasks.workunit.client.0.smithi049.stdout:9/731: readlink d3/d14/d1a/d21/d31/d8e/dc2/d9e/lf7 0 2024-09-19T09:03:02.680 INFO:tasks.workunit.client.0.smithi049.stdout:9/732: read - d3/dbb/dec/dd0/dd4/fda zero size 2024-09-19T09:03:02.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/454: fsync d3/d5/de/f44 0 2024-09-19T09:03:02.682 INFO:tasks.workunit.client.0.smithi049.stdout:5/455: fdatasync d3/d6c/f85 0 2024-09-19T09:03:02.687 INFO:tasks.workunit.client.0.smithi049.stdout:9/733: dwrite d3/d14/d1a/f80 [0,4194304] 0 2024-09-19T09:03:02.698 INFO:tasks.workunit.client.0.smithi049.stdout:5/456: dwrite d3/f78 [0,4194304] 0 2024-09-19T09:03:02.704 INFO:tasks.workunit.client.0.smithi049.stdout:5/457: unlink d3/d5/d20/d38/d5d/f73 0 2024-09-19T09:03:02.708 INFO:tasks.workunit.client.0.smithi049.stdout:5/458: mknod d3/d5/d20/d57/d72/c8a 0 2024-09-19T09:03:02.710 INFO:tasks.workunit.client.0.smithi049.stdout:6/399: write dc/ff [1292911,119632] 0 2024-09-19T09:03:02.711 INFO:tasks.workunit.client.0.smithi049.stdout:6/400: stat dc/d1b/c55 0 2024-09-19T09:03:02.713 INFO:tasks.workunit.client.0.smithi049.stdout:5/459: mkdir d3/d5/d20/d38/d5a/d8b 0 2024-09-19T09:03:02.714 INFO:tasks.workunit.client.0.smithi049.stdout:9/734: dread d3/d14/d34/d4c/fc1 [0,4194304] 0 2024-09-19T09:03:02.715 INFO:tasks.workunit.client.0.smithi049.stdout:6/401: mkdir dc/d1b/d20/d7f 0 2024-09-19T09:03:02.717 INFO:tasks.workunit.client.0.smithi049.stdout:5/460: fdatasync d3/d5/d1c/d4c/d63/f6b 0 2024-09-19T09:03:02.718 INFO:tasks.workunit.client.0.smithi049.stdout:5/461: stat d3/d5/d1c/d4c/c5c 0 2024-09-19T09:03:02.724 INFO:tasks.workunit.client.0.smithi049.stdout:6/402: mkdir dc/d12/d80 0 2024-09-19T09:03:02.725 INFO:tasks.workunit.client.0.smithi049.stdout:6/403: chown dc/d12/d5a/l7a 6373509 1 2024-09-19T09:03:02.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/462: creat d3/d5/de/d4a/f8c x:0 0 0 2024-09-19T09:03:02.730 INFO:tasks.workunit.client.0.smithi049.stdout:3/517: truncate d10/d11/d13/d30/f40 4755729 0 2024-09-19T09:03:02.735 INFO:tasks.workunit.client.0.smithi049.stdout:5/463: mkdir d3/d5/de/d12/d45/d8d 0 2024-09-19T09:03:02.738 INFO:tasks.workunit.client.0.smithi049.stdout:5/464: stat d3/d5/d20/d38/l4f 0 2024-09-19T09:03:02.739 INFO:tasks.workunit.client.0.smithi049.stdout:3/518: dwrite d10/d11/d27/d4f/d59/d81/f98 [0,4194304] 0 2024-09-19T09:03:02.746 INFO:tasks.workunit.client.0.smithi049.stdout:9/735: getdents d3/d14/d1a/d21/d31/d8e/dc2/d9e 0 2024-09-19T09:03:02.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/465: mknod d3/d6c/c8e 0 2024-09-19T09:03:02.750 INFO:tasks.workunit.client.0.smithi049.stdout:3/519: creat d10/d3d/d76/fb0 x:0 0 0 2024-09-19T09:03:02.754 INFO:tasks.workunit.client.0.smithi049.stdout:5/466: mkdir d3/d5/d1c/d3a/d8f 0 2024-09-19T09:03:02.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/736: mknod d3/dbb/dec/db1/de4/cfe 0 2024-09-19T09:03:02.756 INFO:tasks.workunit.client.0.smithi049.stdout:5/467: truncate d3/d5/de/d4a/f8c 100662 0 2024-09-19T09:03:02.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/520: symlink d10/d11/d27/d4f/d59/lb1 0 2024-09-19T09:03:02.758 INFO:tasks.workunit.client.0.smithi049.stdout:9/737: truncate d3/d14/d1a/d21/d31/d8e/dc2/d9e/fd2 4697062 0 2024-09-19T09:03:02.759 INFO:tasks.workunit.client.0.smithi049.stdout:9/738: readlink d3/dbb/dec/db1/ld5 0 2024-09-19T09:03:02.762 INFO:tasks.workunit.client.0.smithi049.stdout:6/404: rename dc/d12 to dc/d1b/d20/d81 0 2024-09-19T09:03:02.763 INFO:tasks.workunit.client.0.smithi049.stdout:7/720: sync 2024-09-19T09:03:02.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/422: sync 2024-09-19T09:03:02.770 INFO:tasks.workunit.client.0.smithi049.stdout:9/739: dwrite d3/d14/d1a/d21/d67/fed [0,4194304] 0 2024-09-19T09:03:02.783 INFO:tasks.workunit.client.0.smithi049.stdout:4/423: fdatasync d4/d34/f46 0 2024-09-19T09:03:02.784 INFO:tasks.workunit.client.0.smithi049.stdout:5/468: truncate d3/dc/f42 1248954 0 2024-09-19T09:03:02.786 INFO:tasks.workunit.client.0.smithi049.stdout:7/721: link d1/d8/d2d/d36/fd4 d1/d8/d80/ffd 0 2024-09-19T09:03:02.787 INFO:tasks.workunit.client.0.smithi049.stdout:3/521: dwrite d10/d11/d27/f89 [0,4194304] 0 2024-09-19T09:03:02.787 INFO:tasks.workunit.client.0.smithi049.stdout:9/740: getdents d3/d14/d1a/d21/d31/d8e/dc2/d9e 0 2024-09-19T09:03:02.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/741: dread - d3/d14/d34/d4c/d9c/ffd zero size 2024-09-19T09:03:02.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/469: mkdir d3/d5/d20/d57/d90 0 2024-09-19T09:03:02.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/405: dwrite dc/d1b/d20/d81/d5a/f60 [0,4194304] 0 2024-09-19T09:03:02.796 INFO:tasks.workunit.client.0.smithi049.stdout:7/722: readlink d1/d53/l15 0 2024-09-19T09:03:02.799 INFO:tasks.workunit.client.0.smithi049.stdout:6/406: write dc/d1b/d20/d81/d5a/f64 [1022793,2210] 0 2024-09-19T09:03:02.800 INFO:tasks.workunit.client.0.smithi049.stdout:3/522: creat d10/d3d/d76/fb2 x:0 0 0 2024-09-19T09:03:02.801 INFO:tasks.workunit.client.0.smithi049.stdout:3/523: chown d10/d11/d13/l63 50362703 1 2024-09-19T09:03:02.805 INFO:tasks.workunit.client.0.smithi049.stdout:5/470: symlink d3/d5/d1c/d4c/d63/l91 0 2024-09-19T09:03:02.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/471: chown d3/d5/d1c/d3a/c52 15699 1 2024-09-19T09:03:02.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/424: dwrite d4/f5 [0,4194304] 0 2024-09-19T09:03:02.809 INFO:tasks.workunit.client.0.smithi049.stdout:7/723: mkdir d1/d8/d2d/d31/d6e/dfe 0 2024-09-19T09:03:02.810 INFO:tasks.workunit.client.0.smithi049.stdout:7/724: readlink d1/d8/d2d/d31/d6e/lc7 0 2024-09-19T09:03:02.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/725: fsync d1/d53/dc6/f14 0 2024-09-19T09:03:02.812 INFO:tasks.workunit.client.0.smithi049.stdout:6/407: rename f0 to dc/d1b/d20/d2f/d6b/d73/f82 0 2024-09-19T09:03:02.814 INFO:tasks.workunit.client.0.smithi049.stdout:7/726: truncate d1/d1a/da0/dd3/d62/fdd 946049 0 2024-09-19T09:03:02.816 INFO:tasks.workunit.client.0.smithi049.stdout:3/524: stat d10/d11/d13/c37 0 2024-09-19T09:03:02.817 INFO:tasks.workunit.client.0.smithi049.stdout:3/525: write d10/d11/d13/d30/f9c [50153,129197] 0 2024-09-19T09:03:02.820 INFO:tasks.workunit.client.0.smithi049.stdout:5/472: rmdir d3/d5/d1c/d2d 39 2024-09-19T09:03:02.825 INFO:tasks.workunit.client.0.smithi049.stdout:9/742: truncate d3/d14/d1a/d21/d31/d8e/f3e 3855843 0 2024-09-19T09:03:02.826 INFO:tasks.workunit.client.0.smithi049.stdout:6/408: mknod dc/d1b/d78/c83 0 2024-09-19T09:03:02.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/425: mknod d4/d15/c87 0 2024-09-19T09:03:02.836 INFO:tasks.workunit.client.0.smithi049.stdout:6/409: mknod dc/d1b/d20/d81/d5a/c84 0 2024-09-19T09:03:02.844 INFO:tasks.workunit.client.0.smithi049.stdout:4/426: truncate d4/d45/f6b 3703682 0 2024-09-19T09:03:02.845 INFO:tasks.workunit.client.0.smithi049.stdout:5/473: dread d3/f41 [0,4194304] 0 2024-09-19T09:03:02.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/727: dwrite d1/d8/dda/fef [0,4194304] 0 2024-09-19T09:03:02.849 INFO:tasks.workunit.client.0.smithi049.stdout:5/474: dread - d3/d5/d20/f76 zero size 2024-09-19T09:03:02.852 INFO:tasks.workunit.client.0.smithi049.stdout:5/475: readlink d3/d5/de/d4a/l4b 0 2024-09-19T09:03:02.854 INFO:tasks.workunit.client.0.smithi049.stdout:4/427: write d4/d34/d3d/d4f/d6a/f85 [4570204,66310] 0 2024-09-19T09:03:02.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/526: dwrite d10/d11/f1a [0,4194304] 0 2024-09-19T09:03:02.856 INFO:tasks.workunit.client.0.smithi049.stdout:7/728: creat d1/d8/d2d/fff x:0 0 0 2024-09-19T09:03:02.857 INFO:tasks.workunit.client.0.smithi049.stdout:4/428: chown d4/d34/d3d/d4f 146 1 2024-09-19T09:03:02.858 INFO:tasks.workunit.client.0.smithi049.stdout:9/743: dwrite d3/d14/faa [0,4194304] 0 2024-09-19T09:03:02.860 INFO:tasks.workunit.client.0.smithi049.stdout:5/476: creat d3/d6c/d6d/f92 x:0 0 0 2024-09-19T09:03:02.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/429: chown d4/d45 281 1 2024-09-19T09:03:02.861 INFO:tasks.workunit.client.0.smithi049.stdout:5/477: chown d3/d5/de/f87 1965 1 2024-09-19T09:03:02.862 INFO:tasks.workunit.client.0.smithi049.stdout:9/744: read d3/d14/d1a/d21/d31/fb6 [6500799,51484] 0 2024-09-19T09:03:02.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/478: readlink d3/d5/l2c 0 2024-09-19T09:03:02.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/430: rmdir d4/d15/d19 39 2024-09-19T09:03:02.868 INFO:tasks.workunit.client.0.smithi049.stdout:9/745: truncate d3/d14/d34/d4c/fb4 564274 0 2024-09-19T09:03:02.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/729: creat d1/d1a/da0/f100 x:0 0 0 2024-09-19T09:03:02.872 INFO:tasks.workunit.client.0.smithi049.stdout:9/746: mkdir d3/d14/d1a/d21/d31/dff 0 2024-09-19T09:03:02.874 INFO:tasks.workunit.client.0.smithi049.stdout:9/747: mkdir d3/dbb/dec/dd0/d100 0 2024-09-19T09:03:02.875 INFO:tasks.workunit.client.0.smithi049.stdout:9/748: write d3/d14/d34/d9f/fef [704343,107468] 0 2024-09-19T09:03:02.883 INFO:tasks.workunit.client.0.smithi049.stdout:4/431: write d4/d15/d19/d1f/f67 [3659764,83099] 0 2024-09-19T09:03:02.887 INFO:tasks.workunit.client.0.smithi049.stdout:5/479: dread d3/dc/f42 [0,4194304] 0 2024-09-19T09:03:02.890 INFO:tasks.workunit.client.0.smithi049.stdout:4/432: dwrite d4/d15/f7c [0,4194304] 0 2024-09-19T09:03:02.892 INFO:tasks.workunit.client.0.smithi049.stdout:3/527: write d10/d11/d13/f6e [556053,121976] 0 2024-09-19T09:03:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:4/433: unlink d4/d4c/f73 0 2024-09-19T09:03:02.900 INFO:tasks.workunit.client.0.smithi049.stdout:9/749: dread d3/d14/d1a/d21/d67/d94/f79 [0,4194304] 0 2024-09-19T09:03:02.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/528: truncate d10/f5c 920735 0 2024-09-19T09:03:02.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/529: chown d10/c54 510378415 1 2024-09-19T09:03:02.903 INFO:tasks.workunit.client.0.smithi049.stdout:9/750: fdatasync d3/d14/d1a/d21/d31/d8e/dc2/d9e/ff4 0 2024-09-19T09:03:02.905 INFO:tasks.workunit.client.0.smithi049.stdout:3/530: creat d10/d3d/d79/fb3 x:0 0 0 2024-09-19T09:03:02.907 INFO:tasks.workunit.client.0.smithi049.stdout:9/751: read d3/d14/d1a/d21/d31/d8e/dc2/d9e/fd2 [2012367,54213] 0 2024-09-19T09:03:02.908 INFO:tasks.workunit.client.0.smithi049.stdout:9/752: fdatasync d3/d14/d34/d9f/f81 0 2024-09-19T09:03:02.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/531: creat d10/d3d/d46/fb4 x:0 0 0 2024-09-19T09:03:02.911 INFO:tasks.workunit.client.0.smithi049.stdout:4/434: dread d4/d15/d19/f2f [4194304,4194304] 0 2024-09-19T09:03:02.914 INFO:tasks.workunit.client.0.smithi049.stdout:3/532: read d10/d11/d13/f18 [2440379,69570] 0 2024-09-19T09:03:02.915 INFO:tasks.workunit.client.0.smithi049.stdout:4/435: unlink d4/d45/f48 0 2024-09-19T09:03:02.916 INFO:tasks.workunit.client.0.smithi049.stdout:3/533: rename d10/d3d/d76/dac/dad to d10/d3d/d76/dac/dad/daf/db5 22 2024-09-19T09:03:02.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/753: truncate d3/d14/d34/d9f/f76 433811 0 2024-09-19T09:03:02.921 INFO:tasks.workunit.client.0.smithi049.stdout:5/480: dread d3/d5/f1b [0,4194304] 0 2024-09-19T09:03:02.922 INFO:tasks.workunit.client.0.smithi049.stdout:3/534: mknod d10/d3d/d76/dac/dad/daf/cb6 0 2024-09-19T09:03:02.925 INFO:tasks.workunit.client.0.smithi049.stdout:5/481: mknod d3/d5/d20/d38/d5a/d8b/c93 0 2024-09-19T09:03:02.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/535: mkdir d10/d3d/d76/da3/db7 0 2024-09-19T09:03:02.929 INFO:tasks.workunit.client.0.smithi049.stdout:5/482: truncate d3/f6 1732059 0 2024-09-19T09:03:02.931 INFO:tasks.workunit.client.0.smithi049.stdout:4/436: dwrite d4/f25 [0,4194304] 0 2024-09-19T09:03:02.933 INFO:tasks.workunit.client.0.smithi049.stdout:3/536: mkdir d10/db8 0 2024-09-19T09:03:02.934 INFO:tasks.workunit.client.0.smithi049.stdout:5/483: fdatasync d3/f32 0 2024-09-19T09:03:02.937 INFO:tasks.workunit.client.0.smithi049.stdout:5/484: dread - d3/d5/d20/f76 zero size 2024-09-19T09:03:02.940 INFO:tasks.workunit.client.0.smithi049.stdout:4/437: dwrite d4/d45/d3f/d47/f49 [0,4194304] 0 2024-09-19T09:03:02.942 INFO:tasks.workunit.client.0.smithi049.stdout:9/754: dread d3/d14/d34/d9f/f81 [0,4194304] 0 2024-09-19T09:03:02.943 INFO:tasks.workunit.client.0.smithi049.stdout:3/537: rename d10/d11/d13/f1f to d10/d3d/d76/da3/fb9 0 2024-09-19T09:03:02.945 INFO:tasks.workunit.client.0.smithi049.stdout:5/485: mknod d3/d5/d20/d57/c94 0 2024-09-19T09:03:02.949 INFO:tasks.workunit.client.0.smithi049.stdout:9/755: write d3/d14/d1a/d21/d67/d94/f79 [731808,59939] 0 2024-09-19T09:03:02.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/486: truncate d3/d5/de/f1e 1212822 0 2024-09-19T09:03:02.954 INFO:tasks.workunit.client.0.smithi049.stdout:4/438: symlink d4/d34/d3d/d4f/d70/l88 0 2024-09-19T09:03:02.955 INFO:tasks.workunit.client.0.smithi049.stdout:4/439: chown d4/f21 2242044 1 2024-09-19T09:03:02.956 INFO:tasks.workunit.client.0.smithi049.stdout:3/538: fdatasync d10/d11/d13/d30/f40 0 2024-09-19T09:03:02.969 INFO:tasks.workunit.client.0.smithi049.stdout:3/539: rename d10/l17 to d10/d3d/d51/lba 0 2024-09-19T09:03:02.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/487: getdents d3/d5/d20 0 2024-09-19T09:03:02.973 INFO:tasks.workunit.client.0.smithi049.stdout:9/756: write d3/d14/d34/d9f/f98 [461791,19648] 0 2024-09-19T09:03:02.973 INFO:tasks.workunit.client.0.smithi049.stdout:3/540: mknod d10/d3d/d79/d80/cbb 0 2024-09-19T09:03:02.975 INFO:tasks.workunit.client.0.smithi049.stdout:9/757: write d3/d14/d1a/d21/f41 [5138665,111928] 0 2024-09-19T09:03:02.977 INFO:tasks.workunit.client.0.smithi049.stdout:4/440: truncate d4/d15/f83 4032146 0 2024-09-19T09:03:02.978 INFO:tasks.workunit.client.0.smithi049.stdout:9/758: write d3/dbb/dec/dd0/dd4/fda [780634,86656] 0 2024-09-19T09:03:02.979 INFO:tasks.workunit.client.0.smithi049.stdout:5/488: creat d3/d5/d20/d57/f95 x:0 0 0 2024-09-19T09:03:02.980 INFO:tasks.workunit.client.0.smithi049.stdout:5/489: chown d3/d5/d1c/d4c 0 1 2024-09-19T09:03:02.981 INFO:tasks.workunit.client.0.smithi049.stdout:4/441: unlink d4/d35/c39 0 2024-09-19T09:03:02.983 INFO:tasks.workunit.client.0.smithi049.stdout:3/541: mkdir d10/d11/d13/dbc 0 2024-09-19T09:03:02.984 INFO:tasks.workunit.client.0.smithi049.stdout:9/759: rename d3/d14/d1a/d21/d67/f91 to d3/d14/d1a/d21/d66/f101 0 2024-09-19T09:03:02.987 INFO:tasks.workunit.client.0.smithi049.stdout:5/490: rmdir d3/d5/d1c/d2d 39 2024-09-19T09:03:02.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/491: chown d3/dc/l50 101617655 1 2024-09-19T09:03:02.992 INFO:tasks.workunit.client.0.smithi049.stdout:3/542: dwrite d10/d11/d27/d4f/d59/d81/f98 [0,4194304] 0 2024-09-19T09:03:02.995 INFO:tasks.workunit.client.0.smithi049.stdout:9/760: dwrite d3/d14/d1a/d21/d31/fba [0,4194304] 0 2024-09-19T09:03:02.996 INFO:tasks.workunit.client.0.smithi049.stdout:5/492: rmdir d3/d5/d1c 39 2024-09-19T09:03:02.998 INFO:tasks.workunit.client.0.smithi049.stdout:3/543: rmdir d10/d11/d27/d4f 39 2024-09-19T09:03:03.005 INFO:tasks.workunit.client.0.smithi049.stdout:9/761: dread d3/d14/d1a/d21/d31/d8e/dc2/d9e/fb0 [0,4194304] 0 2024-09-19T09:03:03.007 INFO:tasks.workunit.client.0.smithi049.stdout:5/493: write d3/d5/d1c/f22 [2303397,12180] 0 2024-09-19T09:03:03.014 INFO:tasks.workunit.client.0.smithi049.stdout:3/544: creat d10/d3d/d76/da3/db7/fbd x:0 0 0 2024-09-19T09:03:03.014 INFO:tasks.workunit.client.0.smithi049.stdout:9/762: dwrite d3/d14/d34/d9f/f81 [0,4194304] 0 2024-09-19T09:03:03.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/494: mknod d3/d5/d20/d57/d72/c96 0 2024-09-19T09:03:03.018 INFO:tasks.workunit.client.0.smithi049.stdout:3/545: rmdir d10/d11/d13/d30 39 2024-09-19T09:03:03.019 INFO:tasks.workunit.client.0.smithi049.stdout:3/546: stat d10/d3d/d79/fb3 0 2024-09-19T09:03:03.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/763: mknod d3/d14/d1a/d21/c102 0 2024-09-19T09:03:03.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/495: mkdir d3/d5/de/d12/d97 0 2024-09-19T09:03:03.022 INFO:tasks.workunit.client.0.smithi049.stdout:9/764: chown d3/dbb/dec/dd0/dd4/ff2 225555885 1 2024-09-19T09:03:03.024 INFO:tasks.workunit.client.0.smithi049.stdout:5/496: write d3/d5/d1c/d2d/f60 [1231179,37210] 0 2024-09-19T09:03:03.025 INFO:tasks.workunit.client.0.smithi049.stdout:9/765: mknod d3/dbb/dec/db1/de4/c103 0 2024-09-19T09:03:03.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/766: write d3/d14/d1a/f25 [785066,128014] 0 2024-09-19T09:03:03.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/497: dwrite d3/d5/f80 [0,4194304] 0 2024-09-19T09:03:03.037 INFO:tasks.workunit.client.0.smithi049.stdout:5/498: symlink d3/d5/d20/l98 0 2024-09-19T09:03:03.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/499: mknod d3/d5/de/d12/d97/c99 0 2024-09-19T09:03:03.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/767: rename d3/d14/d1a/d21/fad to d3/dbb/dec/dd0/f104 0 2024-09-19T09:03:03.047 INFO:tasks.workunit.client.0.smithi049.stdout:5/500: write d3/d5/d1c/d2d/f2f [6405366,83919] 0 2024-09-19T09:03:03.048 INFO:tasks.workunit.client.0.smithi049.stdout:5/501: chown d3/f32 451 1 2024-09-19T09:03:03.052 INFO:tasks.workunit.client.0.smithi049.stdout:5/502: creat d3/dc/f9a x:0 0 0 2024-09-19T09:03:03.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/503: readlink d3/d5/l7b 0 2024-09-19T09:03:03.054 INFO:tasks.workunit.client.0.smithi049.stdout:5/504: mknod d3/dc/d43/c9b 0 2024-09-19T09:03:03.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/505: mkdir d3/d5/d20/d38/d9c 0 2024-09-19T09:03:03.058 INFO:tasks.workunit.client.0.smithi049.stdout:9/768: rmdir d3/dbb 39 2024-09-19T09:03:03.058 INFO:tasks.workunit.client.0.smithi049.stdout:5/506: write d3/dc/d43/f82 [220328,87108] 0 2024-09-19T09:03:03.064 INFO:tasks.workunit.client.0.smithi049.stdout:5/507: creat d3/d6c/f9d x:0 0 0 2024-09-19T09:03:03.064 INFO:tasks.workunit.client.0.smithi049.stdout:5/508: fdatasync d3/d5/de/f87 0 2024-09-19T09:03:03.067 INFO:tasks.workunit.client.0.smithi049.stdout:9/769: mkdir d3/d14/d1a/d21/d73/d105 0 2024-09-19T09:03:03.070 INFO:tasks.workunit.client.0.smithi049.stdout:5/509: mknod d3/d5/d20/d38/d9c/c9e 0 2024-09-19T09:03:03.074 INFO:tasks.workunit.client.0.smithi049.stdout:9/770: fdatasync d3/d14/d1a/f7d 0 2024-09-19T09:03:03.079 INFO:tasks.workunit.client.0.smithi049.stdout:9/771: unlink d3/d14/d1a/d21/d73/ldf 0 2024-09-19T09:03:03.083 INFO:tasks.workunit.client.0.smithi049.stdout:9/772: getdents d3/d14/d1a/d21/d31/d8e/dc2/d9e 0 2024-09-19T09:03:03.085 INFO:tasks.workunit.client.0.smithi049.stdout:9/773: stat d3/d14/d1a/d21/d67/d94/f5b 0 2024-09-19T09:03:03.089 INFO:tasks.workunit.client.0.smithi049.stdout:9/774: symlink d3/d14/d1a/d21/d31/dff/l106 0 2024-09-19T09:03:03.090 INFO:tasks.workunit.client.0.smithi049.stdout:9/775: chown d3/d14/l78 4 1 2024-09-19T09:03:03.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/510: dwrite d3/d5/de/d12/d45/f54 [0,4194304] 0 2024-09-19T09:03:03.094 INFO:tasks.workunit.client.0.smithi049.stdout:9/776: rename d3/dbb/dec/dd0 to d3/dbb/dec/dd0/d107 22 2024-09-19T09:03:03.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/646: sync 2024-09-19T09:03:03.097 INFO:tasks.workunit.client.0.smithi049.stdout:8/601: sync 2024-09-19T09:03:03.098 INFO:tasks.workunit.client.0.smithi049.stdout:9/777: symlink d3/d14/d34/d74/l108 0 2024-09-19T09:03:03.101 INFO:tasks.workunit.client.0.smithi049.stdout:5/511: dwrite d3/d5/de/d12/d45/f54 [0,4194304] 0 2024-09-19T09:03:03.104 INFO:tasks.workunit.client.0.smithi049.stdout:9/778: symlink d3/l109 0 2024-09-19T09:03:03.108 INFO:tasks.workunit.client.0.smithi049.stdout:9/779: creat d3/d14/d1a/d21/d67/f10a x:0 0 0 2024-09-19T09:03:03.109 INFO:tasks.workunit.client.0.smithi049.stdout:0/647: dwrite d5/d10/d82/fbc [0,4194304] 0 2024-09-19T09:03:03.111 INFO:tasks.workunit.client.0.smithi049.stdout:0/648: readlink d5/d10/d13/d15/d36/d3d/l2c 0 2024-09-19T09:03:03.114 INFO:tasks.workunit.client.0.smithi049.stdout:5/512: getdents d3/d5/de/d12 0 2024-09-19T09:03:03.119 INFO:tasks.workunit.client.0.smithi049.stdout:9/780: truncate d3/d14/d1a/d21/d66/f8f 3757548 0 2024-09-19T09:03:03.120 INFO:tasks.workunit.client.0.smithi049.stdout:0/649: link d5/d64/d97/cb3 d5/d10/d7d/cc9 0 2024-09-19T09:03:03.122 INFO:tasks.workunit.client.0.smithi049.stdout:9/781: write d3/d14/d34/d9f/f7e [5300490,54618] 0 2024-09-19T09:03:03.122 INFO:tasks.workunit.client.0.smithi049.stdout:5/513: dwrite d3/f41 [0,4194304] 0 2024-09-19T09:03:03.128 INFO:tasks.workunit.client.0.smithi049.stdout:0/650: dread d5/d10/f5b [0,4194304] 0 2024-09-19T09:03:03.130 INFO:tasks.workunit.client.0.smithi049.stdout:8/602: write d1/d11/d4f/d87/f6a [3430125,38526] 0 2024-09-19T09:03:03.131 INFO:tasks.workunit.client.0.smithi049.stdout:5/514: mknod d3/d5/de/c9f 0 2024-09-19T09:03:03.134 INFO:tasks.workunit.client.0.smithi049.stdout:0/651: creat d5/d10/d2f/d6d/dbe/fca x:0 0 0 2024-09-19T09:03:03.135 INFO:tasks.workunit.client.0.smithi049.stdout:8/603: rmdir d1/d11/d2e/d4e 39 2024-09-19T09:03:03.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/604: dread d1/d11/d3f/fa9 [0,4194304] 0 2024-09-19T09:03:03.144 INFO:tasks.workunit.client.0.smithi049.stdout:9/782: write d3/d14/d34/f95 [1659812,79264] 0 2024-09-19T09:03:03.151 INFO:tasks.workunit.client.0.smithi049.stdout:5/515: dwrite d3/d5/f1f [0,4194304] 0 2024-09-19T09:03:03.164 INFO:tasks.workunit.client.0.smithi049.stdout:0/652: rename d5/d10/d13/d15/d29/f5e to d5/fcb 0 2024-09-19T09:03:03.165 INFO:tasks.workunit.client.0.smithi049.stdout:0/653: fsync d5/d10/fae 0 2024-09-19T09:03:03.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/783: dwrite d3/d14/d34/d4c/fc1 [0,4194304] 0 2024-09-19T09:03:03.173 INFO:tasks.workunit.client.0.smithi049.stdout:9/784: read d3/d14/d1a/d21/d67/d94/f5b [2379002,38439] 0 2024-09-19T09:03:03.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/785: fdatasync d3/d14/d34/d44/f4b 0 2024-09-19T09:03:03.179 INFO:tasks.workunit.client.0.smithi049.stdout:8/605: getdents d1/d1a/d8b 0 2024-09-19T09:03:03.185 INFO:tasks.workunit.client.0.smithi049.stdout:0/654: getdents d5/d10/d2f/d6d 0 2024-09-19T09:03:03.186 INFO:tasks.workunit.client.0.smithi049.stdout:8/606: symlink d1/d11/d4f/d87/lb6 0 2024-09-19T09:03:03.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/786: dread d3/d14/d1a/d21/d31/d8e/dc2/d9e/fb0 [0,4194304] 0 2024-09-19T09:03:03.188 INFO:tasks.workunit.client.0.smithi049.stdout:9/787: fdatasync d3/d14/d34/d44/f4b 0 2024-09-19T09:03:03.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/788: chown d3/dbb/dec/dd0/ddd 19 1 2024-09-19T09:03:03.193 INFO:tasks.workunit.client.0.smithi049.stdout:9/789: rmdir d3/d14/d34/d9f 39 2024-09-19T09:03:03.194 INFO:tasks.workunit.client.0.smithi049.stdout:9/790: stat d3/d14/d1a/d21/d31/d8e/la8 0 2024-09-19T09:03:03.195 INFO:tasks.workunit.client.0.smithi049.stdout:9/791: fdatasync d3/dbb/dec/dd0/dd4/fda 0 2024-09-19T09:03:03.196 INFO:tasks.workunit.client.0.smithi049.stdout:8/607: mknod d1/d11/d2e/d4e/d82/cb7 0 2024-09-19T09:03:03.197 INFO:tasks.workunit.client.0.smithi049.stdout:8/608: chown d1/d11/d4f/d87/f83 77013910 1 2024-09-19T09:03:03.198 INFO:tasks.workunit.client.0.smithi049.stdout:5/516: truncate d3/f78 2463919 0 2024-09-19T09:03:03.199 INFO:tasks.workunit.client.0.smithi049.stdout:9/792: fdatasync d3/f28 0 2024-09-19T09:03:03.204 INFO:tasks.workunit.client.0.smithi049.stdout:0/655: write d5/d10/d13/d15/d29/d9a/f6f [1162614,122069] 0 2024-09-19T09:03:03.205 INFO:tasks.workunit.client.0.smithi049.stdout:9/793: creat d3/d14/d1a/f10b x:0 0 0 2024-09-19T09:03:03.210 INFO:tasks.workunit.client.0.smithi049.stdout:9/794: dread d3/d14/d1a/d21/d31/fba [0,4194304] 0 2024-09-19T09:03:03.212 INFO:tasks.workunit.client.0.smithi049.stdout:0/656: creat d5/d10/d13/d15/d29/d9a/fcc x:0 0 0 2024-09-19T09:03:03.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/517: write d3/d5/de/f23 [809735,68875] 0 2024-09-19T09:03:03.213 INFO:tasks.workunit.client.0.smithi049.stdout:8/609: creat d1/fb8 x:0 0 0 2024-09-19T09:03:03.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/657: stat d5/d10/d13/d15/d29/d9a 0 2024-09-19T09:03:03.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/518: dwrite d3/d5/f80 [0,4194304] 0 2024-09-19T09:03:03.223 INFO:tasks.workunit.client.0.smithi049.stdout:0/658: mkdir d5/d10/d13/dc4/dcd 0 2024-09-19T09:03:03.224 INFO:tasks.workunit.client.0.smithi049.stdout:9/795: dread d3/d14/d1a/f35 [0,4194304] 0 2024-09-19T09:03:03.229 INFO:tasks.workunit.client.0.smithi049.stdout:5/519: mkdir d3/d5/d1c/d4c/da0 0 2024-09-19T09:03:03.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/610: write d1/d11/d2e/f56 [3829760,63779] 0 2024-09-19T09:03:03.231 INFO:tasks.workunit.client.0.smithi049.stdout:9/796: fdatasync d3/d14/d1a/d21/d31/d8e/dc2/d9e/fd2 0 2024-09-19T09:03:03.233 INFO:tasks.workunit.client.0.smithi049.stdout:5/520: mkdir d3/d6c/d6d/da1 0 2024-09-19T09:03:03.236 INFO:tasks.workunit.client.0.smithi049.stdout:8/611: creat d1/d11/d3f/d5b/fb9 x:0 0 0 2024-09-19T09:03:03.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/521: mknod d3/d5/d20/ca2 0 2024-09-19T09:03:03.243 INFO:tasks.workunit.client.0.smithi049.stdout:5/522: dread d3/d5/de/d4a/f68 [0,4194304] 0 2024-09-19T09:03:03.246 INFO:tasks.workunit.client.0.smithi049.stdout:0/659: dread d5/d10/d13/d15/d29/f57 [0,4194304] 0 2024-09-19T09:03:03.246 INFO:tasks.workunit.client.0.smithi049.stdout:5/523: creat d3/d5/de/d12/fa3 x:0 0 0 2024-09-19T09:03:03.249 INFO:tasks.workunit.client.0.smithi049.stdout:5/524: symlink d3/d5/d20/d38/la4 0 2024-09-19T09:03:03.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/525: fdatasync d3/dc/d43/f5b 0 2024-09-19T09:03:03.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/612: write d1/d11/d3f/d5b/fa8 [277262,57336] 0 2024-09-19T09:03:03.252 INFO:tasks.workunit.client.0.smithi049.stdout:5/526: chown d3/c4 66843769 1 2024-09-19T09:03:03.253 INFO:tasks.workunit.client.0.smithi049.stdout:9/797: truncate d3/d14/d1a/d21/d67/d94/fde 773890 0 2024-09-19T09:03:03.255 INFO:tasks.workunit.client.0.smithi049.stdout:5/527: truncate d3/d5/d1c/d2d/f77 277573 0 2024-09-19T09:03:03.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:03 smithi102 ceph-mon[35280]: pgmap v38: 65 pgs: 65 active+clean; 2.8 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 55 MiB/s rd, 134 MiB/s wr, 319 op/s 2024-09-19T09:03:03.259 INFO:tasks.workunit.client.0.smithi049.stdout:5/528: chown d3/d5/d1c/d3a/l56 521112 1 2024-09-19T09:03:03.261 INFO:tasks.workunit.client.0.smithi049.stdout:9/798: symlink d3/d14/d1a/d21/d73/d105/l10c 0 2024-09-19T09:03:03.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/613: dwrite d1/d11/d3f/d8c/fa4 [0,4194304] 0 2024-09-19T09:03:03.265 INFO:tasks.workunit.client.0.smithi049.stdout:9/799: chown d3/d14/d1a/d21/d31/c39 24250270 1 2024-09-19T09:03:03.265 INFO:tasks.workunit.client.0.smithi049.stdout:0/660: dwrite d5/d86/f95 [0,4194304] 0 2024-09-19T09:03:03.271 INFO:tasks.workunit.client.0.smithi049.stdout:0/661: truncate d5/d10/d2f/d6d/dbe/fc3 219077 0 2024-09-19T09:03:03.274 INFO:tasks.workunit.client.0.smithi049.stdout:9/800: creat d3/d14/d1a/d21/d31/d8e/df5/f10d x:0 0 0 2024-09-19T09:03:03.275 INFO:tasks.workunit.client.0.smithi049.stdout:5/529: dwrite d3/f62 [0,4194304] 0 2024-09-19T09:03:03.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/662: mknod d5/d10/d2f/cce 0 2024-09-19T09:03:03.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/801: read - d3/d14/d1a/d21/d67/d94/fd1 zero size 2024-09-19T09:03:03.281 INFO:tasks.workunit.client.0.smithi049.stdout:5/530: symlink d3/d6c/d6d/la5 0 2024-09-19T09:03:03.282 INFO:tasks.workunit.client.0.smithi049.stdout:0/663: fdatasync d5/f50 0 2024-09-19T09:03:03.284 INFO:tasks.workunit.client.0.smithi049.stdout:9/802: read d3/d14/d1a/d21/d31/fba [1740243,39749] 0 2024-09-19T09:03:03.285 INFO:tasks.workunit.client.0.smithi049.stdout:0/664: read d5/d10/d2f/d6d/f8a [3927684,101394] 0 2024-09-19T09:03:03.287 INFO:tasks.workunit.client.0.smithi049.stdout:5/531: symlink d3/d5/d20/d38/d5a/d8b/la6 0 2024-09-19T09:03:03.288 INFO:tasks.workunit.client.0.smithi049.stdout:5/532: chown d3/d5/de/d12/d45/f54 7 1 2024-09-19T09:03:03.289 INFO:tasks.workunit.client.0.smithi049.stdout:0/665: mkdir d5/d10/d13/d30/d9f/dcf 0 2024-09-19T09:03:03.290 INFO:tasks.workunit.client.0.smithi049.stdout:9/803: rename d3/dbb/dec/db1/cfc to d3/d14/d1a/d21/d73/db8/dc5/c10e 0 2024-09-19T09:03:03.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/614: dread d1/f23 [0,4194304] 0 2024-09-19T09:03:03.296 INFO:tasks.workunit.client.0.smithi049.stdout:5/533: getdents d3/d5/de/d12/d7d/d88 0 2024-09-19T09:03:03.298 INFO:tasks.workunit.client.0.smithi049.stdout:5/534: write d3/f41 [325648,81591] 0 2024-09-19T09:03:03.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/804: dwrite d3/d14/d34/d9f/fc9 [4194304,4194304] 0 2024-09-19T09:03:03.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:03 smithi049 ceph-mon[28158]: pgmap v38: 65 pgs: 65 active+clean; 2.8 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 55 MiB/s rd, 134 MiB/s wr, 319 op/s 2024-09-19T09:03:03.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/805: write d3/d14/d34/d9f/f81 [1177598,92444] 0 2024-09-19T09:03:03.304 INFO:tasks.workunit.client.0.smithi049.stdout:1/392: sync 2024-09-19T09:03:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:1/393: readlink d5/d6/d19/d30/l5a 0 2024-09-19T09:03:03.311 INFO:tasks.workunit.client.0.smithi049.stdout:8/615: fdatasync d1/f5a 0 2024-09-19T09:03:03.312 INFO:tasks.workunit.client.0.smithi049.stdout:9/806: mkdir d3/d14/d1a/d21/d66/d10f 0 2024-09-19T09:03:03.313 INFO:tasks.workunit.client.0.smithi049.stdout:1/394: rmdir d5/d6/d19/d21/d52 39 2024-09-19T09:03:03.315 INFO:tasks.workunit.client.0.smithi049.stdout:0/666: getdents d5/d10/d3c 0 2024-09-19T09:03:03.318 INFO:tasks.workunit.client.0.smithi049.stdout:5/535: link d3/d5/de/d12/f6f d3/d5/d20/d57/d72/fa7 0 2024-09-19T09:03:03.322 INFO:tasks.workunit.client.0.smithi049.stdout:5/536: dread d3/d5/de/f1a [4194304,4194304] 0 2024-09-19T09:03:03.324 INFO:tasks.workunit.client.0.smithi049.stdout:9/807: truncate d3/d14/d1a/f7d 1410998 0 2024-09-19T09:03:03.327 INFO:tasks.workunit.client.0.smithi049.stdout:8/616: link d1/d11/d3f/d5b/fa8 d1/d11/d3f/d5b/fba 0 2024-09-19T09:03:03.328 INFO:tasks.workunit.client.0.smithi049.stdout:5/537: readlink d3/l14 0 2024-09-19T09:03:03.329 INFO:tasks.workunit.client.0.smithi049.stdout:5/538: write d3/d6c/d6d/f92 [243819,40648] 0 2024-09-19T09:03:03.333 INFO:tasks.workunit.client.0.smithi049.stdout:9/808: chown d3/d14/d1a/d21/fb7 8026711 1 2024-09-19T09:03:03.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/667: symlink d5/d10/d13/ld0 0 2024-09-19T09:03:03.443 INFO:tasks.workunit.client.0.smithi049.stdout:9/809: readlink d3/d14/l78 0 2024-09-19T09:03:03.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/668: read d5/d10/d82/fbc [1314220,88544] 0 2024-09-19T09:03:03.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/810: chown d3/dbb/dec/db1/de4 523834 1 2024-09-19T09:03:03.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/539: write d3/d5/d20/f59 [1714375,14781] 0 2024-09-19T09:03:03.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/395: getdents d5/d6/d8/d13 0 2024-09-19T09:03:03.447 INFO:tasks.workunit.client.0.smithi049.stdout:0/669: write d5/fb1 [414921,29352] 0 2024-09-19T09:03:03.450 INFO:tasks.workunit.client.0.smithi049.stdout:0/670: read - d5/d10/d82/d67/d85/db4/dbb/fbd zero size 2024-09-19T09:03:03.456 INFO:tasks.workunit.client.0.smithi049.stdout:9/811: dwrite d3/d14/d1a/d21/d67/d94/f7c [0,4194304] 0 2024-09-19T09:03:03.457 INFO:tasks.workunit.client.0.smithi049.stdout:1/396: creat d5/d6/d19/d21/d52/f7d x:0 0 0 2024-09-19T09:03:03.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/617: dwrite d1/fb [8388608,4194304] 0 2024-09-19T09:03:03.459 INFO:tasks.workunit.client.0.smithi049.stdout:5/540: creat d3/d5/de/d12/d45/d8d/fa8 x:0 0 0 2024-09-19T09:03:03.460 INFO:tasks.workunit.client.0.smithi049.stdout:0/671: mknod d5/d10/d13/d30/d9f/dcf/cd1 0 2024-09-19T09:03:03.462 INFO:tasks.workunit.client.0.smithi049.stdout:9/812: rmdir d3/d14/d1a/d21/d66 39 2024-09-19T09:03:03.465 INFO:tasks.workunit.client.0.smithi049.stdout:0/672: truncate d5/d10/d82/d67/d85/fc5 334628 0 2024-09-19T09:03:03.468 INFO:tasks.workunit.client.0.smithi049.stdout:5/541: rename d3/d5/f80 to d3/d5/d20/d38/d5a/fa9 0 2024-09-19T09:03:03.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/397: mkdir d5/d6/d8/d13/d24/d7e 0 2024-09-19T09:03:03.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/673: unlink d5/d10/d13/fa3 0 2024-09-19T09:03:03.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/618: dwrite d1/d11/d4f/d87/f83 [4194304,4194304] 0 2024-09-19T09:03:03.479 INFO:tasks.workunit.client.0.smithi049.stdout:8/619: read d1/d11/d3f/d8c/f8d [318206,40161] 0 2024-09-19T09:03:03.479 INFO:tasks.workunit.client.0.smithi049.stdout:9/813: getdents d3/d14/d1a/d90 0 2024-09-19T09:03:03.480 INFO:tasks.workunit.client.0.smithi049.stdout:1/398: mkdir d5/d6/d8/d13/d24/d7e/d7f 0 2024-09-19T09:03:03.481 INFO:tasks.workunit.client.0.smithi049.stdout:8/620: write d1/d1a/f3b [193415,29843] 0 2024-09-19T09:03:03.485 INFO:tasks.workunit.client.0.smithi049.stdout:1/399: creat d5/f80 x:0 0 0 2024-09-19T09:03:03.485 INFO:tasks.workunit.client.0.smithi049.stdout:1/400: stat d5/d6/f6f 0 2024-09-19T09:03:03.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/674: getdents d5 0 2024-09-19T09:03:03.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/675: truncate d5/d10/d13/dc4/fc8 650760 0 2024-09-19T09:03:03.488 INFO:tasks.workunit.client.0.smithi049.stdout:5/542: rmdir d3/d5 39 2024-09-19T09:03:03.499 INFO:tasks.workunit.client.0.smithi049.stdout:0/676: dread d5/d10/d13/f42 [0,4194304] 0 2024-09-19T09:03:03.500 INFO:tasks.workunit.client.0.smithi049.stdout:8/621: link d1/d11/d45/f91 d1/d11/d2e/d89/fbb 0 2024-09-19T09:03:03.500 INFO:tasks.workunit.client.0.smithi049.stdout:1/401: write d5/d6/d19/d21/f46 [1703407,15406] 0 2024-09-19T09:03:03.503 INFO:tasks.workunit.client.0.smithi049.stdout:9/814: truncate d3/d14/d1a/d21/d67/fed 3077922 0 2024-09-19T09:03:03.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/402: mknod d5/d6/d8/d13/d24/d7e/c81 0 2024-09-19T09:03:03.510 INFO:tasks.workunit.client.0.smithi049.stdout:9/815: rename d3/d14/d34/d9f/lb2 to d3/d14/d34/d4c/d9c/l110 0 2024-09-19T09:03:03.511 INFO:tasks.workunit.client.0.smithi049.stdout:8/622: symlink d1/d11/lbc 0 2024-09-19T09:03:03.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/623: creat d1/d11/d4f/d87/d7a/fbd x:0 0 0 2024-09-19T09:03:03.517 INFO:tasks.workunit.client.0.smithi049.stdout:8/624: chown d1/d11/d3f/d8c/fa4 473257889 1 2024-09-19T09:03:03.520 INFO:tasks.workunit.client.0.smithi049.stdout:0/677: dread d5/d10/d13/f1c [0,4194304] 0 2024-09-19T09:03:03.521 INFO:tasks.workunit.client.0.smithi049.stdout:9/816: creat d3/d14/d1a/d21/d66/f111 x:0 0 0 2024-09-19T09:03:03.523 INFO:tasks.workunit.client.0.smithi049.stdout:8/625: symlink d1/d11/d2e/d4e/lbe 0 2024-09-19T09:03:03.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/543: truncate d3/f8 2815704 0 2024-09-19T09:03:03.526 INFO:tasks.workunit.client.0.smithi049.stdout:9/817: creat d3/d14/d34/d9f/f112 x:0 0 0 2024-09-19T09:03:03.527 INFO:tasks.workunit.client.0.smithi049.stdout:0/678: mkdir d5/d10/d13/dc4/dcd/dd2 0 2024-09-19T09:03:03.529 INFO:tasks.workunit.client.0.smithi049.stdout:1/403: write d5/d6/d19/d21/f72 [453365,19269] 0 2024-09-19T09:03:03.530 INFO:tasks.workunit.client.0.smithi049.stdout:9/818: dread d3/d14/f51 [0,4194304] 0 2024-09-19T09:03:03.537 INFO:tasks.workunit.client.0.smithi049.stdout:0/679: dread d5/d10/d2f/f74 [0,4194304] 0 2024-09-19T09:03:03.540 INFO:tasks.workunit.client.0.smithi049.stdout:1/404: dread d5/d6/fa [0,4194304] 0 2024-09-19T09:03:03.541 INFO:tasks.workunit.client.0.smithi049.stdout:1/405: write d5/f67 [979708,8674] 0 2024-09-19T09:03:03.542 INFO:tasks.workunit.client.0.smithi049.stdout:1/406: chown d5/d6/d8/d13/d24 121550 1 2024-09-19T09:03:03.543 INFO:tasks.workunit.client.0.smithi049.stdout:1/407: dread - d5/f80 zero size 2024-09-19T09:03:03.544 INFO:tasks.workunit.client.0.smithi049.stdout:2/681: sync 2024-09-19T09:03:03.544 INFO:tasks.workunit.client.0.smithi049.stdout:9/819: symlink d3/d14/d1a/d21/d73/d105/l113 0 2024-09-19T09:03:03.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/626: link d1/d1a/l5f d1/d11/d4f/d87/d5d/d65/d99/lbf 0 2024-09-19T09:03:03.548 INFO:tasks.workunit.client.0.smithi049.stdout:8/627: chown d1/d11/d2e/d89 16282 1 2024-09-19T09:03:03.554 INFO:tasks.workunit.client.0.smithi049.stdout:9/820: rmdir d3 39 2024-09-19T09:03:03.556 INFO:tasks.workunit.client.0.smithi049.stdout:2/682: stat d1/d2/d23/f8f 0 2024-09-19T09:03:03.558 INFO:tasks.workunit.client.0.smithi049.stdout:1/408: mkdir d5/d6/d82 0 2024-09-19T09:03:03.559 INFO:tasks.workunit.client.0.smithi049.stdout:5/544: dread d3/f8 [0,4194304] 0 2024-09-19T09:03:03.559 INFO:tasks.workunit.client.0.smithi049.stdout:1/409: dread d5/d6/f5b [0,4194304] 0 2024-09-19T09:03:03.564 INFO:tasks.workunit.client.0.smithi049.stdout:0/680: write d5/d10/d13/d15/d36/f6a [841640,39726] 0 2024-09-19T09:03:03.566 INFO:tasks.workunit.client.0.smithi049.stdout:0/681: dread d5/d10/d2f/f77 [0,4194304] 0 2024-09-19T09:03:03.566 INFO:tasks.workunit.client.0.smithi049.stdout:1/410: rename d5/d6/d19/d21/d52/c5f to d5/d6/d19/d30/d64/c83 0 2024-09-19T09:03:03.566 INFO:tasks.workunit.client.0.smithi049.stdout:0/682: stat d5/fb1 0 2024-09-19T09:03:03.567 INFO:tasks.workunit.client.0.smithi049.stdout:2/683: mkdir d1/d2/d6c/dd5/de2 0 2024-09-19T09:03:03.567 INFO:tasks.workunit.client.0.smithi049.stdout:2/684: readlink d1/l7b 0 2024-09-19T09:03:03.568 INFO:tasks.workunit.client.0.smithi049.stdout:8/628: creat d1/d11/fc0 x:0 0 0 2024-09-19T09:03:03.568 INFO:tasks.workunit.client.0.smithi049.stdout:2/685: chown d1/d2/d23/d49 924252613 1 2024-09-19T09:03:03.570 INFO:tasks.workunit.client.0.smithi049.stdout:9/821: rename d3/d14/d1a/d21/d31/d8e/dc2/feb to d3/d14/d34/d9f/f114 0 2024-09-19T09:03:03.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/822: write d3/d14/d1a/d21/d66/fc6 [4625505,80683] 0 2024-09-19T09:03:03.579 INFO:tasks.workunit.client.0.smithi049.stdout:2/686: mknod d1/d2/d70/ce3 0 2024-09-19T09:03:03.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/823: write d3/d14/d1a/d21/f2f [1795464,640] 0 2024-09-19T09:03:03.587 INFO:tasks.workunit.client.0.smithi049.stdout:9/824: fsync d3/d14/d34/d9f/f76 0 2024-09-19T09:03:03.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/825: fdatasync d3/d14/d1a/f25 0 2024-09-19T09:03:03.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/826: mknod d3/c115 0 2024-09-19T09:03:03.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/683: write d5/d10/d13/d15/d29/d9a/f9e [163245,31360] 0 2024-09-19T09:03:03.594 INFO:tasks.workunit.client.0.smithi049.stdout:5/545: truncate d3/d5/de/f15 3343305 0 2024-09-19T09:03:03.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/687: dread d1/d4/d1e/d21/f3b [0,4194304] 0 2024-09-19T09:03:03.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/684: write d5/d10/d13/d15/d29/d9a/f6f [285244,60014] 0 2024-09-19T09:03:03.601 INFO:tasks.workunit.client.0.smithi049.stdout:1/411: dwrite d5/d6/d19/f39 [0,4194304] 0 2024-09-19T09:03:03.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/546: rename d3/dc/c55 to d3/d5/d20/caa 0 2024-09-19T09:03:03.605 INFO:tasks.workunit.client.0.smithi049.stdout:1/412: chown d5/d6/d19/f42 61 1 2024-09-19T09:03:03.607 INFO:tasks.workunit.client.0.smithi049.stdout:2/688: mkdir d1/d2/d70/de4 0 2024-09-19T09:03:03.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/629: dwrite d1/d11/d3f/d5b/f69 [4194304,4194304] 0 2024-09-19T09:03:03.611 INFO:tasks.workunit.client.0.smithi049.stdout:0/685: dwrite d5/d10/d13/d15/d36/f6e [0,4194304] 0 2024-09-19T09:03:03.614 INFO:tasks.workunit.client.0.smithi049.stdout:1/413: mknod d5/d6/d19/d30/d63/c84 0 2024-09-19T09:03:03.617 INFO:tasks.workunit.client.0.smithi049.stdout:2/689: read d1/d4/d20/f1c [3454270,15203] 0 2024-09-19T09:03:03.621 INFO:tasks.workunit.client.0.smithi049.stdout:0/686: dwrite d5/d86/fb8 [0,4194304] 0 2024-09-19T09:03:03.624 INFO:tasks.workunit.client.0.smithi049.stdout:1/414: creat d5/d6/d19/d21/d52/f85 x:0 0 0 2024-09-19T09:03:03.625 INFO:tasks.workunit.client.0.smithi049.stdout:0/687: write d5/d10/d13/d15/d36/f6a [1924945,79982] 0 2024-09-19T09:03:03.626 INFO:tasks.workunit.client.0.smithi049.stdout:1/415: read d5/d6/d19/d21/d52/f76 [3168611,57556] 0 2024-09-19T09:03:03.626 INFO:tasks.workunit.client.0.smithi049.stdout:5/547: link d3/d5/d20/c5e d3/d5/de/cab 0 2024-09-19T09:03:03.628 INFO:tasks.workunit.client.0.smithi049.stdout:2/690: fdatasync d1/d4/d1e/d21/f22 0 2024-09-19T09:03:03.630 INFO:tasks.workunit.client.0.smithi049.stdout:2/691: chown d1/d4/d1e/d9f/fd3 4502 1 2024-09-19T09:03:03.630 INFO:tasks.workunit.client.0.smithi049.stdout:0/688: dread d5/d10/f5b [0,4194304] 0 2024-09-19T09:03:03.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/410: sync 2024-09-19T09:03:03.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/730: sync 2024-09-19T09:03:03.632 INFO:tasks.workunit.client.0.smithi049.stdout:4/442: sync 2024-09-19T09:03:03.632 INFO:tasks.workunit.client.0.smithi049.stdout:3/547: sync 2024-09-19T09:03:03.637 INFO:tasks.workunit.client.0.smithi049.stdout:1/416: mknod d5/d6/dc/c86 0 2024-09-19T09:03:03.638 INFO:tasks.workunit.client.0.smithi049.stdout:2/692: mkdir d1/d4/d1e/d21/dae/de5 0 2024-09-19T09:03:03.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/827: write d3/d14/d1a/d21/d67/fed [557099,103800] 0 2024-09-19T09:03:03.640 INFO:tasks.workunit.client.0.smithi049.stdout:3/548: chown d10/f48 12917591 1 2024-09-19T09:03:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:1/417: chown d5/d6/d8/d13/f55 17 1 2024-09-19T09:03:03.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/548: creat d3/d5/d1c/d3a/d8f/fac x:0 0 0 2024-09-19T09:03:03.653 INFO:tasks.workunit.client.0.smithi049.stdout:0/689: dwrite d5/d10/d13/d30/d9f/fad [0,4194304] 0 2024-09-19T09:03:03.655 INFO:tasks.workunit.client.0.smithi049.stdout:4/443: mkdir d4/d6c/d7a/d89 0 2024-09-19T09:03:03.665 INFO:tasks.workunit.client.0.smithi049.stdout:2/693: mknod d1/d4/d1e/d9f/db3/ce6 0 2024-09-19T09:03:03.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/444: fsync d4/d34/f79 0 2024-09-19T09:03:03.675 INFO:tasks.workunit.client.0.smithi049.stdout:5/549: dwrite d3/dc/d43/f82 [0,4194304] 0 2024-09-19T09:03:03.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/418: dwrite d5/d6/f6f [0,4194304] 0 2024-09-19T09:03:03.680 INFO:tasks.workunit.client.0.smithi049.stdout:3/549: dread d10/f38 [0,4194304] 0 2024-09-19T09:03:03.681 INFO:tasks.workunit.client.0.smithi049.stdout:7/731: write d1/d1a/de7/d50/d7c/d9c/fba [897993,66974] 0 2024-09-19T09:03:03.682 INFO:tasks.workunit.client.0.smithi049.stdout:6/411: dread dc/d16/f4a [0,4194304] 0 2024-09-19T09:03:03.684 INFO:tasks.workunit.client.0.smithi049.stdout:1/419: fsync d5/d6/d19/d30/f65 0 2024-09-19T09:03:03.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/550: fsync d3/d5/d20/d57/f95 0 2024-09-19T09:03:03.689 INFO:tasks.workunit.client.0.smithi049.stdout:8/630: dwrite d1/d27/f4b [0,4194304] 0 2024-09-19T09:03:03.693 INFO:tasks.workunit.client.0.smithi049.stdout:6/412: fdatasync dc/d1b/d20/d2f/d31/f69 0 2024-09-19T09:03:03.697 INFO:tasks.workunit.client.0.smithi049.stdout:7/732: mknod d1/d1a/da0/dd3/c101 0 2024-09-19T09:03:03.697 INFO:tasks.workunit.client.0.smithi049.stdout:8/631: stat d1/d11/l6c 0 2024-09-19T09:03:03.697 INFO:tasks.workunit.client.0.smithi049.stdout:8/632: stat d1/d11/d2e/c4c 0 2024-09-19T09:03:03.701 INFO:tasks.workunit.client.0.smithi049.stdout:6/413: truncate dc/d16/f48 775169 0 2024-09-19T09:03:03.701 INFO:tasks.workunit.client.0.smithi049.stdout:7/733: chown d1/d8/fb 1084583928 1 2024-09-19T09:03:03.703 INFO:tasks.workunit.client.0.smithi049.stdout:5/551: symlink d3/d5/d1c/d4c/d7c/lad 0 2024-09-19T09:03:03.705 INFO:tasks.workunit.client.0.smithi049.stdout:2/694: write d1/d4/d1e/d45/f86 [1356505,530] 0 2024-09-19T09:03:03.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/828: dread d3/d14/f1e [4194304,4194304] 0 2024-09-19T09:03:03.707 INFO:tasks.workunit.client.0.smithi049.stdout:8/633: creat d1/d11/d2e/d4e/d61/fc1 x:0 0 0 2024-09-19T09:03:03.709 INFO:tasks.workunit.client.0.smithi049.stdout:4/445: write d4/d15/d19/d1f/f71 [1003243,34070] 0 2024-09-19T09:03:03.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/734: mknod d1/d8/d19/c102 0 2024-09-19T09:03:03.716 INFO:tasks.workunit.client.0.smithi049.stdout:4/446: write d4/d35/f3c [4027479,46038] 0 2024-09-19T09:03:03.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/690: dread d5/d10/d13/d15/d36/f3a [0,4194304] 0 2024-09-19T09:03:03.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/550: rename d10/d11/d13/d30/ca0 to d10/d11/d13/d30/cbe 0 2024-09-19T09:03:03.717 INFO:tasks.workunit.client.0.smithi049.stdout:2/695: mknod d1/d2b/d7c/dc3/ce7 0 2024-09-19T09:03:03.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/447: stat d4/f21 0 2024-09-19T09:03:03.723 INFO:tasks.workunit.client.0.smithi049.stdout:4/448: chown d4/d6c/d74 16811886 1 2024-09-19T09:03:03.726 INFO:tasks.workunit.client.0.smithi049.stdout:3/551: dread - d10/d11/d27/f5f zero size 2024-09-19T09:03:03.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/735: mknod d1/d1a/de7/d50/d7c/c103 0 2024-09-19T09:03:03.730 INFO:tasks.workunit.client.0.smithi049.stdout:0/691: stat d5/d10/d13/d15/d36/d3d/d7f 0 2024-09-19T09:03:03.734 INFO:tasks.workunit.client.0.smithi049.stdout:6/414: dwrite dc/d1b/d20/d81/f43 [0,4194304] 0 2024-09-19T09:03:03.738 INFO:tasks.workunit.client.0.smithi049.stdout:5/552: dwrite d3/d5/d20/d38/f4d [0,4194304] 0 2024-09-19T09:03:03.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/634: dwrite d1/d11/d2e/f56 [0,4194304] 0 2024-09-19T09:03:03.743 INFO:tasks.workunit.client.0.smithi049.stdout:9/829: dwrite d3/d14/d34/f88 [4194304,4194304] 0 2024-09-19T09:03:03.745 INFO:tasks.workunit.client.0.smithi049.stdout:1/420: dread d5/d6/d8/d13/f55 [0,4194304] 0 2024-09-19T09:03:03.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/635: mkdir d1/d1a/dc2 0 2024-09-19T09:03:03.752 INFO:tasks.workunit.client.0.smithi049.stdout:5/553: write d3/d6c/d6d/f92 [1204263,116556] 0 2024-09-19T09:03:03.754 INFO:tasks.workunit.client.0.smithi049.stdout:8/636: fdatasync d1/d11/d4f/d87/d5d/d65/f7e 0 2024-09-19T09:03:03.760 INFO:tasks.workunit.client.0.smithi049.stdout:3/552: write d10/d11/d27/f78 [59943,74515] 0 2024-09-19T09:03:03.762 INFO:tasks.workunit.client.0.smithi049.stdout:7/736: rename d1/d8/d2d/d36/ld1 to d1/d1a/de7/d50/d7c/d9c/l104 0 2024-09-19T09:03:03.762 INFO:tasks.workunit.client.0.smithi049.stdout:8/637: dread - d1/d11/d2e/d4e/d61/d9f/fb4 zero size 2024-09-19T09:03:03.762 INFO:tasks.workunit.client.0.smithi049.stdout:2/696: dread d1/f11 [4194304,4194304] 0 2024-09-19T09:03:03.762 INFO:tasks.workunit.client.0.smithi049.stdout:0/692: dread d5/d10/d13/d15/d29/d9a/f6f [0,4194304] 0 2024-09-19T09:03:03.764 INFO:tasks.workunit.client.0.smithi049.stdout:6/415: unlink dc/d1b/d20/d2f/d53/c63 0 2024-09-19T09:03:03.767 INFO:tasks.workunit.client.0.smithi049.stdout:9/830: mkdir d3/d14/d1a/d116 0 2024-09-19T09:03:03.769 INFO:tasks.workunit.client.0.smithi049.stdout:6/416: stat dc/d1b/d20/d81/f29 0 2024-09-19T09:03:03.771 INFO:tasks.workunit.client.0.smithi049.stdout:4/449: dwrite d4/f13 [4194304,4194304] 0 2024-09-19T09:03:03.771 INFO:tasks.workunit.client.0.smithi049.stdout:5/554: dwrite d3/dc/d43/f82 [0,4194304] 0 2024-09-19T09:03:03.773 INFO:tasks.workunit.client.0.smithi049.stdout:7/737: mkdir d1/d8/d2d/d72/d105 0 2024-09-19T09:03:03.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/450: chown d4/d34/d3d/d62/l7d 209 1 2024-09-19T09:03:03.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/553: creat d10/d11/d13/d7e/fbf x:0 0 0 2024-09-19T09:03:03.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/638: mkdir d1/d11/d2e/d4e/d61/d9f/dc3 0 2024-09-19T09:03:03.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/697: mknod d1/d2/d6c/dd5/ce8 0 2024-09-19T09:03:03.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/831: rmdir d3/d14/d1a/d21/d66 39 2024-09-19T09:03:03.791 INFO:tasks.workunit.client.0.smithi049.stdout:7/738: symlink d1/d1a/de7/d59/l106 0 2024-09-19T09:03:03.793 INFO:tasks.workunit.client.0.smithi049.stdout:7/739: write d1/d1a/de7/f8d [4041702,86821] 0 2024-09-19T09:03:03.801 INFO:tasks.workunit.client.0.smithi049.stdout:8/639: dread d1/d11/d2e/f57 [0,4194304] 0 2024-09-19T09:03:03.803 INFO:tasks.workunit.client.0.smithi049.stdout:4/451: dread d4/f5 [0,4194304] 0 2024-09-19T09:03:03.804 INFO:tasks.workunit.client.0.smithi049.stdout:1/421: link d5/d6/d8/d1a/f3e d5/d6/d19/d30/d64/d71/f87 0 2024-09-19T09:03:03.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/452: dread - d4/d15/d19/d1f/f5d zero size 2024-09-19T09:03:03.808 INFO:tasks.workunit.client.0.smithi049.stdout:9/832: mkdir d3/d14/d34/d9f/d117 0 2024-09-19T09:03:03.810 INFO:tasks.workunit.client.0.smithi049.stdout:9/833: write d3/d14/d1a/d21/d31/f62 [2078305,21674] 0 2024-09-19T09:03:03.811 INFO:tasks.workunit.client.0.smithi049.stdout:2/698: write d1/d4/d1e/d21/f22 [432243,128355] 0 2024-09-19T09:03:03.812 INFO:tasks.workunit.client.0.smithi049.stdout:5/555: mknod d3/d5/d1c/d2d/d89/cae 0 2024-09-19T09:03:03.813 INFO:tasks.workunit.client.0.smithi049.stdout:3/554: dwrite d10/d3d/d76/f8b [0,4194304] 0 2024-09-19T09:03:03.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/640: creat d1/d11/d2e/d4e/d61/d9f/fc4 x:0 0 0 2024-09-19T09:03:03.817 INFO:tasks.workunit.client.0.smithi049.stdout:4/453: creat d4/d4c/f8a x:0 0 0 2024-09-19T09:03:03.817 INFO:tasks.workunit.client.0.smithi049.stdout:0/693: getdents d5/d10/d2f/d6d 0 2024-09-19T09:03:03.820 INFO:tasks.workunit.client.0.smithi049.stdout:4/454: stat d4/d15/d19/d1f/d55/f78 0 2024-09-19T09:03:03.822 INFO:tasks.workunit.client.0.smithi049.stdout:6/417: getdents dc/d1b/d20/d2f/d6b 0 2024-09-19T09:03:03.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/694: unlink d5/d10/d2f/f77 0 2024-09-19T09:03:03.824 INFO:tasks.workunit.client.0.smithi049.stdout:3/555: dread d10/d3d/fa6 [0,4194304] 0 2024-09-19T09:03:03.825 INFO:tasks.workunit.client.0.smithi049.stdout:3/556: stat d10/d3d/d76/fb0 0 2024-09-19T09:03:03.825 INFO:tasks.workunit.client.0.smithi049.stdout:4/455: chown d4/d15/c56 2758 1 2024-09-19T09:03:03.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/695: chown d5/d10/d3c/l5a 1 1 2024-09-19T09:03:03.827 INFO:tasks.workunit.client.0.smithi049.stdout:0/696: write d5/fb1 [403441,51425] 0 2024-09-19T09:03:03.828 INFO:tasks.workunit.client.0.smithi049.stdout:7/740: creat d1/d1a/de7/d50/d7c/f107 x:0 0 0 2024-09-19T09:03:03.828 INFO:tasks.workunit.client.0.smithi049.stdout:4/456: readlink d4/d15/d19/d1f/l42 0 2024-09-19T09:03:03.828 INFO:tasks.workunit.client.0.smithi049.stdout:8/641: truncate d1/f78 5257 0 2024-09-19T09:03:03.832 INFO:tasks.workunit.client.0.smithi049.stdout:2/699: link d1/d4/fb d1/d2d/fe9 0 2024-09-19T09:03:03.837 INFO:tasks.workunit.client.0.smithi049.stdout:3/557: dwrite d10/d11/d27/f78 [0,4194304] 0 2024-09-19T09:03:03.840 INFO:tasks.workunit.client.0.smithi049.stdout:9/834: truncate d3/d14/d34/f95 1623767 0 2024-09-19T09:03:03.843 INFO:tasks.workunit.client.0.smithi049.stdout:8/642: unlink d1/d11/f3a 0 2024-09-19T09:03:03.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/697: mkdir d5/d10/d2f/d6d/daa/dd3 0 2024-09-19T09:03:03.845 INFO:tasks.workunit.client.0.smithi049.stdout:7/741: link d1/d8/d2d/d36/d91/f95 d1/d1a/da0/dd3/d62/f108 0 2024-09-19T09:03:03.848 INFO:tasks.workunit.client.0.smithi049.stdout:8/643: write d1/fa5 [283828,23235] 0 2024-09-19T09:03:03.849 INFO:tasks.workunit.client.0.smithi049.stdout:3/558: symlink d10/d11/d27/lc0 0 2024-09-19T09:03:03.853 INFO:tasks.workunit.client.0.smithi049.stdout:4/457: dread d4/d45/f6b [0,4194304] 0 2024-09-19T09:03:03.853 INFO:tasks.workunit.client.0.smithi049.stdout:2/700: creat d1/d4/d20/fea x:0 0 0 2024-09-19T09:03:03.854 INFO:tasks.workunit.client.0.smithi049.stdout:3/559: dread - d10/d11/d27/f5f zero size 2024-09-19T09:03:03.855 INFO:tasks.workunit.client.0.smithi049.stdout:8/644: read d1/d11/d2e/d89/fbb [263451,113738] 0 2024-09-19T09:03:03.855 INFO:tasks.workunit.client.0.smithi049.stdout:9/835: dwrite d3/d14/d1a/d21/d31/d8e/f7a [0,4194304] 0 2024-09-19T09:03:03.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/701: dread - d1/d4/d1e/d9f/fc0 zero size 2024-09-19T09:03:03.857 INFO:tasks.workunit.client.0.smithi049.stdout:0/698: read - d5/d10/d82/f46 zero size 2024-09-19T09:03:03.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/645: read d1/d11/d4f/d87/d5d/d65/f8a [612106,45451] 0 2024-09-19T09:03:03.862 INFO:tasks.workunit.client.0.smithi049.stdout:3/560: truncate d10/d3d/d76/da3/db7/fbd 665873 0 2024-09-19T09:03:03.863 INFO:tasks.workunit.client.0.smithi049.stdout:8/646: dread - d1/d11/d3f/d5b/faa zero size 2024-09-19T09:03:03.867 INFO:tasks.workunit.client.0.smithi049.stdout:0/699: mkdir d5/d10/d2f/dd4 0 2024-09-19T09:03:03.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/561: mkdir d10/d3d/d79/dc1 0 2024-09-19T09:03:03.874 INFO:tasks.workunit.client.0.smithi049.stdout:2/702: creat d1/d4/d20/dc7/feb x:0 0 0 2024-09-19T09:03:03.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/458: write d4/d15/f20 [1743054,55906] 0 2024-09-19T09:03:03.876 INFO:tasks.workunit.client.0.smithi049.stdout:6/418: dwrite dc/d1b/d20/d2f/f3f [0,4194304] 0 2024-09-19T09:03:03.878 INFO:tasks.workunit.client.0.smithi049.stdout:8/647: truncate d1/d11/f74 3790250 0 2024-09-19T09:03:03.880 INFO:tasks.workunit.client.0.smithi049.stdout:9/836: mknod d3/d14/d1a/d21/d66/d10f/c118 0 2024-09-19T09:03:03.886 INFO:tasks.workunit.client.0.smithi049.stdout:4/459: dwrite d4/f25 [0,4194304] 0 2024-09-19T09:03:03.889 INFO:tasks.workunit.client.0.smithi049.stdout:2/703: creat d1/d2/d6c/dd5/fec x:0 0 0 2024-09-19T09:03:03.889 INFO:tasks.workunit.client.0.smithi049.stdout:0/700: write d5/d10/d82/d67/f90 [402875,27439] 0 2024-09-19T09:03:03.891 INFO:tasks.workunit.client.0.smithi049.stdout:2/704: stat d1/d2/d23/lcf 0 2024-09-19T09:03:03.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/742: truncate d1/d1a/de7/d50/d7c/d9c/fba 828884 0 2024-09-19T09:03:03.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/562: symlink d10/lc2 0 2024-09-19T09:03:03.896 INFO:tasks.workunit.client.0.smithi049.stdout:8/648: write d1/d11/d3f/fa9 [1578617,14890] 0 2024-09-19T09:03:03.897 INFO:tasks.workunit.client.0.smithi049.stdout:0/701: fdatasync d5/fcb 0 2024-09-19T09:03:03.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/702: read d5/d86/f95 [3757489,100119] 0 2024-09-19T09:03:03.899 INFO:tasks.workunit.client.0.smithi049.stdout:2/705: dread - d1/d2/d23/f68 zero size 2024-09-19T09:03:03.900 INFO:tasks.workunit.client.0.smithi049.stdout:7/743: mknod d1/d8/d80/c109 0 2024-09-19T09:03:03.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/460: mkdir d4/d6c/d74/d8b 0 2024-09-19T09:03:03.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/563: truncate d10/d11/d27/f2e 2373599 0 2024-09-19T09:03:03.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/564: chown d10/db8 82727 1 2024-09-19T09:03:03.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/649: rename d1/f5a to d1/d11/d2e/d4e/d61/fc5 0 2024-09-19T09:03:03.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/706: mkdir d1/d4/d1e/d21/dae/ded 0 2024-09-19T09:03:03.919 INFO:tasks.workunit.client.0.smithi049.stdout:8/650: dwrite d1/d11/d3f/fa9 [0,4194304] 0 2024-09-19T09:03:03.919 INFO:tasks.workunit.client.0.smithi049.stdout:4/461: write d4/d45/d4a/f4e [2445591,17017] 0 2024-09-19T09:03:03.924 INFO:tasks.workunit.client.0.smithi049.stdout:9/837: dread d3/d14/d1a/d21/f41 [0,4194304] 0 2024-09-19T09:03:03.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/419: link dc/d1b/d20/d2f/d31/f5d dc/d1b/d20/d81/f85 0 2024-09-19T09:03:03.929 INFO:tasks.workunit.client.0.smithi049.stdout:0/703: symlink d5/d10/ld5 0 2024-09-19T09:03:03.930 INFO:tasks.workunit.client.0.smithi049.stdout:7/744: mkdir d1/d8/d2d/d31/d6e/dfe/d10a 0 2024-09-19T09:03:03.930 INFO:tasks.workunit.client.0.smithi049.stdout:0/704: read - d5/d10/d2f/d6d/fc6 zero size 2024-09-19T09:03:03.933 INFO:tasks.workunit.client.0.smithi049.stdout:0/705: write d5/d10/d13/d15/d29/d9a/f9e [114641,20408] 0 2024-09-19T09:03:03.934 INFO:tasks.workunit.client.0.smithi049.stdout:0/706: chown d5/d10/d13/d15/d29/cb2 1775767 1 2024-09-19T09:03:03.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/707: rename d1/d4/d20/d92/dba/ddb to d1/d2/d6c/dd5/de2/dee 0 2024-09-19T09:03:03.936 INFO:tasks.workunit.client.0.smithi049.stdout:3/565: symlink d10/d3d/d79/dc1/lc3 0 2024-09-19T09:03:03.938 INFO:tasks.workunit.client.0.smithi049.stdout:9/838: creat d3/d14/d34/d9f/f119 x:0 0 0 2024-09-19T09:03:03.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/420: symlink dc/d1b/d20/d2f/d6b/l86 0 2024-09-19T09:03:03.943 INFO:tasks.workunit.client.0.smithi049.stdout:7/745: creat d1/d8/d2d/d36/d91/f10b x:0 0 0 2024-09-19T09:03:03.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/421: truncate dc/d1b/d20/d81/f85 934756 0 2024-09-19T09:03:03.945 INFO:tasks.workunit.client.0.smithi049.stdout:7/746: dread - d1/d8/d2d/d36/d91/f10b zero size 2024-09-19T09:03:03.945 INFO:tasks.workunit.client.0.smithi049.stdout:8/651: dread d1/d11/d4f/d87/d5d/d65/f7e [0,4194304] 0 2024-09-19T09:03:03.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/422: read dc/d1b/f57 [3433668,56578] 0 2024-09-19T09:03:03.947 INFO:tasks.workunit.client.0.smithi049.stdout:0/707: creat d5/d10/d13/d15/d29/d9a/fd6 x:0 0 0 2024-09-19T09:03:03.948 INFO:tasks.workunit.client.0.smithi049.stdout:2/708: write d1/d4/d1e/d9f/fb1 [812619,86132] 0 2024-09-19T09:03:03.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/462: creat d4/d15/d19/d1f/d55/d7f/f8c x:0 0 0 2024-09-19T09:03:03.951 INFO:tasks.workunit.client.0.smithi049.stdout:2/709: write d1/d4/d20/fc6 [4427455,21247] 0 2024-09-19T09:03:03.957 INFO:tasks.workunit.client.0.smithi049.stdout:0/708: chown d5/d10/d13/d15/d36/d3d/d7f/f8b 14157739 1 2024-09-19T09:03:03.959 INFO:tasks.workunit.client.0.smithi049.stdout:2/710: symlink d1/d2/d23/lef 0 2024-09-19T09:03:03.962 INFO:tasks.workunit.client.0.smithi049.stdout:2/711: readlink d1/d2/d23/lef 0 2024-09-19T09:03:03.964 INFO:tasks.workunit.client.0.smithi049.stdout:6/423: dwrite dc/d1b/d20/d2f/d31/f65 [4194304,4194304] 0 2024-09-19T09:03:03.966 INFO:tasks.workunit.client.0.smithi049.stdout:3/566: dwrite d10/d11/d13/f6e [0,4194304] 0 2024-09-19T09:03:03.967 INFO:tasks.workunit.client.0.smithi049.stdout:3/567: chown d10/d3d/d76 376557 1 2024-09-19T09:03:03.967 INFO:tasks.workunit.client.0.smithi049.stdout:8/652: link d1/d11/d3f/d5b/faa d1/d27/fc6 0 2024-09-19T09:03:03.968 INFO:tasks.workunit.client.0.smithi049.stdout:7/747: symlink d1/d8/d2d/l10c 0 2024-09-19T09:03:03.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/712: rename d1/d2/d23/d49/c71 to d1/d4/d20/d92/cf0 0 2024-09-19T09:03:03.975 INFO:tasks.workunit.client.0.smithi049.stdout:6/424: read dc/d16/f70 [118306,61338] 0 2024-09-19T09:03:03.975 INFO:tasks.workunit.client.0.smithi049.stdout:8/653: symlink d1/d11/d3f/d5b/lc7 0 2024-09-19T09:03:03.977 INFO:tasks.workunit.client.0.smithi049.stdout:6/425: read dc/d1b/d20/d2f/f3f [846392,44514] 0 2024-09-19T09:03:03.981 INFO:tasks.workunit.client.0.smithi049.stdout:2/713: symlink d1/d4/d1e/d9f/db3/d41/d7d/lf1 0 2024-09-19T09:03:03.981 INFO:tasks.workunit.client.0.smithi049.stdout:9/839: write d3/d14/d34/f95 [1509420,10304] 0 2024-09-19T09:03:03.985 INFO:tasks.workunit.client.0.smithi049.stdout:7/748: dread d1/d8/d2d/d31/f7f [0,4194304] 0 2024-09-19T09:03:03.988 INFO:tasks.workunit.client.0.smithi049.stdout:4/463: dwrite d4/d15/d19/d1f/f5d [0,4194304] 0 2024-09-19T09:03:03.991 INFO:tasks.workunit.client.0.smithi049.stdout:9/840: mknod d3/d14/d1a/d90/c11a 0 2024-09-19T09:03:03.995 INFO:tasks.workunit.client.0.smithi049.stdout:2/714: creat d1/d2/d70/de4/ff2 x:0 0 0 2024-09-19T09:03:03.999 INFO:tasks.workunit.client.0.smithi049.stdout:6/426: rename dc/d1b/d20/d81/d5a/f62 to dc/d1b/d20/f87 0 2024-09-19T09:03:04.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/749: creat d1/d8/d2d/d31/d6e/dfe/d10a/f10d x:0 0 0 2024-09-19T09:03:04.003 INFO:tasks.workunit.client.0.smithi049.stdout:3/568: dread d10/d11/d13/f18 [0,4194304] 0 2024-09-19T09:03:04.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/715: mkdir d1/d2/d70/df3 0 2024-09-19T09:03:04.006 INFO:tasks.workunit.client.0.smithi049.stdout:2/716: chown d1/d4/d1e/d21/f3b 67146 1 2024-09-19T09:03:04.009 INFO:tasks.workunit.client.0.smithi049.stdout:4/464: rename d4/d15/d19/d1f/d77/c86 to d4/d15/d19/d1f/d55/d66/c8d 0 2024-09-19T09:03:04.010 INFO:tasks.workunit.client.0.smithi049.stdout:2/717: truncate d1/d2/d70/de4/ff2 43472 0 2024-09-19T09:03:04.010 INFO:tasks.workunit.client.0.smithi049.stdout:6/427: rmdir dc/d1b/d20 39 2024-09-19T09:03:04.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/465: chown d4/d35 218026780 1 2024-09-19T09:03:04.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/750: mkdir d1/d1a/da0/dd3/d62/d6b/d10e 0 2024-09-19T09:03:04.014 INFO:tasks.workunit.client.0.smithi049.stdout:8/654: dwrite d1/d11/d3f/f6b [0,4194304] 0 2024-09-19T09:03:04.017 INFO:tasks.workunit.client.0.smithi049.stdout:7/751: write d1/d1a/de7/d50/d7c/fbd [1143375,70083] 0 2024-09-19T09:03:04.021 INFO:tasks.workunit.client.0.smithi049.stdout:7/752: fdatasync d1/d8/d2d/d36/d91/fd5 0 2024-09-19T09:03:04.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/428: mkdir dc/d16/d88 0 2024-09-19T09:03:04.025 INFO:tasks.workunit.client.0.smithi049.stdout:9/841: dwrite d3/d14/d1a/d21/d31/fb6 [8388608,4194304] 0 2024-09-19T09:03:04.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/569: mknod d10/d11/d13/dbc/cc4 0 2024-09-19T09:03:04.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/655: unlink d1/d11/d3f/d8c/fa4 0 2024-09-19T09:03:04.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/429: chown dc/d1b/d20/d2f/d4c/f6d 638058 1 2024-09-19T09:03:04.038 INFO:tasks.workunit.client.0.smithi049.stdout:4/466: fdatasync d4/d15/d19/f68 0 2024-09-19T09:03:04.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/753: creat d1/d8/dda/f10f x:0 0 0 2024-09-19T09:03:04.047 INFO:tasks.workunit.client.0.smithi049.stdout:6/430: creat dc/d1b/d20/d2f/d6b/f89 x:0 0 0 2024-09-19T09:03:04.051 INFO:tasks.workunit.client.0.smithi049.stdout:9/842: mkdir d3/dbb/dec/d11b 0 2024-09-19T09:03:04.051 INFO:tasks.workunit.client.0.smithi049.stdout:4/467: dread d4/d15/f7c [0,4194304] 0 2024-09-19T09:03:04.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/431: dwrite dc/d16/f18 [8388608,4194304] 0 2024-09-19T09:03:04.057 INFO:tasks.workunit.client.0.smithi049.stdout:3/570: write d10/d11/d13/f28 [4745563,49866] 0 2024-09-19T09:03:04.059 INFO:tasks.workunit.client.0.smithi049.stdout:8/656: write d1/d11/d2e/d4e/f88 [938585,130917] 0 2024-09-19T09:03:04.060 INFO:tasks.workunit.client.0.smithi049.stdout:7/754: creat d1/d1a/da0/dd3/d62/f110 x:0 0 0 2024-09-19T09:03:04.063 INFO:tasks.workunit.client.0.smithi049.stdout:2/718: getdents d1/d4/d20/dc7 0 2024-09-19T09:03:04.067 INFO:tasks.workunit.client.0.smithi049.stdout:6/432: creat dc/d1b/d20/d2f/d53/f8a x:0 0 0 2024-09-19T09:03:04.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/755: creat d1/d8/dda/f111 x:0 0 0 2024-09-19T09:03:04.070 INFO:tasks.workunit.client.0.smithi049.stdout:7/756: stat d1/d8/d2d/d31/d6e/lc7 0 2024-09-19T09:03:04.073 INFO:tasks.workunit.client.0.smithi049.stdout:8/657: rmdir d1/d1a/d8b/d8e 39 2024-09-19T09:03:04.073 INFO:tasks.workunit.client.0.smithi049.stdout:8/658: chown d1/d11/d4f/d87/f83 25415 1 2024-09-19T09:03:04.078 INFO:tasks.workunit.client.0.smithi049.stdout:7/757: symlink d1/d1a/da0/l112 0 2024-09-19T09:03:04.081 INFO:tasks.workunit.client.0.smithi049.stdout:4/468: rename d4/f40 to d4/d45/f8e 0 2024-09-19T09:03:04.085 INFO:tasks.workunit.client.0.smithi049.stdout:7/758: fdatasync d1/d1a/da0/dd3/d62/fac 0 2024-09-19T09:03:04.089 INFO:tasks.workunit.client.0.smithi049.stdout:8/659: dwrite d1/d11/d3f/d8c/fae [0,4194304] 0 2024-09-19T09:03:04.091 INFO:tasks.workunit.client.0.smithi049.stdout:9/843: dread d3/d14/d1a/d21/f2f [4194304,4194304] 0 2024-09-19T09:03:04.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/719: dwrite d1/d2/d32/f29 [0,4194304] 0 2024-09-19T09:03:04.094 INFO:tasks.workunit.client.0.smithi049.stdout:6/433: dwrite dc/d1b/d20/d2f/d6b/d73/f82 [8388608,4194304] 0 2024-09-19T09:03:04.100 INFO:tasks.workunit.client.0.smithi049.stdout:7/759: unlink d1/d8/d2d/fff 0 2024-09-19T09:03:04.103 INFO:tasks.workunit.client.0.smithi049.stdout:9/844: read d3/dbb/fcc [2691092,52772] 0 2024-09-19T09:03:04.110 INFO:tasks.workunit.client.0.smithi049.stdout:4/469: dread d4/d15/f83 [0,4194304] 0 2024-09-19T09:03:04.114 INFO:tasks.workunit.client.0.smithi049.stdout:2/720: creat d1/d2/d6c/dd5/de2/dee/ff4 x:0 0 0 2024-09-19T09:03:04.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/434: dwrite dc/d16/f70 [0,4194304] 0 2024-09-19T09:03:04.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/845: mknod d3/d14/d34/d4c/d9c/c11c 0 2024-09-19T09:03:04.118 INFO:tasks.workunit.client.0.smithi049.stdout:4/470: truncate d4/d15/d19/f2f 5492485 0 2024-09-19T09:03:04.122 INFO:tasks.workunit.client.0.smithi049.stdout:7/760: dread d1/d1a/de7/d50/d7c/fbd [0,4194304] 0 2024-09-19T09:03:04.122 INFO:tasks.workunit.client.0.smithi049.stdout:9/846: read d3/d14/d34/d9f/f98 [212775,34918] 0 2024-09-19T09:03:04.124 INFO:tasks.workunit.client.0.smithi049.stdout:8/660: rename d1/d1a/d8b/c93 to d1/d11/d2e/d4e/d82/cc8 0 2024-09-19T09:03:04.129 INFO:tasks.workunit.client.0.smithi049.stdout:2/721: rmdir d1/d4/dd8 0 2024-09-19T09:03:04.131 INFO:tasks.workunit.client.0.smithi049.stdout:2/722: fsync d1/d2/d23/dca/fcb 0 2024-09-19T09:03:04.134 INFO:tasks.workunit.client.0.smithi049.stdout:7/761: dwrite d1/d1a/da0/dd3/d62/d6b/f76 [0,4194304] 0 2024-09-19T09:03:04.137 INFO:tasks.workunit.client.0.smithi049.stdout:2/723: mknod d1/d2d/cf5 0 2024-09-19T09:03:04.140 INFO:tasks.workunit.client.0.smithi049.stdout:7/762: fdatasync d1/d1a/da0/dd3/d62/d6b/ff1 0 2024-09-19T09:03:04.152 INFO:tasks.workunit.client.0.smithi049.stdout:8/661: write d1/d11/d3f/d5b/fa8 [599099,42177] 0 2024-09-19T09:03:04.154 INFO:tasks.workunit.client.0.smithi049.stdout:6/435: dread dc/d16/f3b [0,4194304] 0 2024-09-19T09:03:04.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/724: dread d1/d4/d20/f95 [0,4194304] 0 2024-09-19T09:03:04.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/662: stat d1/d11/d2e/d4e/d61/d9f/dc3 0 2024-09-19T09:03:04.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/436: readlink dc/d1b/d20/d2f/l49 0 2024-09-19T09:03:04.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/471: dwrite d4/f69 [0,4194304] 0 2024-09-19T09:03:04.159 INFO:tasks.workunit.client.0.smithi049.stdout:2/725: chown d1/d2/d23/dca/fcb 43306852 1 2024-09-19T09:03:04.160 INFO:tasks.workunit.client.0.smithi049.stdout:7/763: truncate d1/d1a/de7/d50/d7c/d9c/ff3 2639633 0 2024-09-19T09:03:04.166 INFO:tasks.workunit.client.0.smithi049.stdout:7/764: mknod d1/d53/dc6/dd8/c113 0 2024-09-19T09:03:04.168 INFO:tasks.workunit.client.0.smithi049.stdout:8/663: creat d1/d11/d2e/db5/fc9 x:0 0 0 2024-09-19T09:03:04.170 INFO:tasks.workunit.client.0.smithi049.stdout:2/726: rename d1/d4/d20/d26/f8a to d1/d2/d6c/dd5/de2/ff6 0 2024-09-19T09:03:04.174 INFO:tasks.workunit.client.0.smithi049.stdout:8/664: fsync d1/d27/f68 0 2024-09-19T09:03:04.175 INFO:tasks.workunit.client.0.smithi049.stdout:7/765: dwrite d1/d8/d2d/d72/fb4 [4194304,4194304] 0 2024-09-19T09:03:04.185 INFO:tasks.workunit.client.0.smithi049.stdout:7/766: dwrite d1/d8/d89/ff8 [0,4194304] 0 2024-09-19T09:03:04.189 INFO:tasks.workunit.client.0.smithi049.stdout:7/767: write d1/d8/d2d/dd9/fdc [1029529,128604] 0 2024-09-19T09:03:04.191 INFO:tasks.workunit.client.0.smithi049.stdout:6/437: dwrite dc/d1b/d20/d2f/d4c/f5e [0,4194304] 0 2024-09-19T09:03:04.199 INFO:tasks.workunit.client.0.smithi049.stdout:7/768: mknod d1/d8/d2d/d31/d6e/dfe/c114 0 2024-09-19T09:03:04.202 INFO:tasks.workunit.client.0.smithi049.stdout:6/438: dwrite dc/d1b/f57 [0,4194304] 0 2024-09-19T09:03:04.204 INFO:tasks.workunit.client.0.smithi049.stdout:7/769: rmdir d1/d1a/da0/dd3/d62/d6b 39 2024-09-19T09:03:04.208 INFO:tasks.workunit.client.0.smithi049.stdout:8/665: dwrite d1/d27/f68 [0,4194304] 0 2024-09-19T09:03:04.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/439: symlink dc/d1b/d20/d2f/d53/l8b 0 2024-09-19T09:03:04.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/666: fsync d1/d11/d3f/d5b/fa8 0 2024-09-19T09:03:04.211 INFO:tasks.workunit.client.0.smithi049.stdout:7/770: mkdir d1/d1a/da0/dd3/d62/d6b/d115 0 2024-09-19T09:03:04.221 INFO:tasks.workunit.client.0.smithi049.stdout:7/771: mkdir d1/d8/d19/d116 0 2024-09-19T09:03:04.221 INFO:tasks.workunit.client.0.smithi049.stdout:2/727: dread d1/d2/d23/f56 [4194304,4194304] 0 2024-09-19T09:03:04.221 INFO:tasks.workunit.client.0.smithi049.stdout:6/440: creat dc/d1b/d20/d7f/f8c x:0 0 0 2024-09-19T09:03:04.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/772: creat d1/d8/d2d/d31/d6e/dfe/f117 x:0 0 0 2024-09-19T09:03:04.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/773: chown d1/d1a/de7/f8d 1503 1 2024-09-19T09:03:04.230 INFO:tasks.workunit.client.0.smithi049.stdout:6/441: mknod dc/d1b/d6f/c8d 0 2024-09-19T09:03:04.230 INFO:tasks.workunit.client.0.smithi049.stdout:7/774: chown d1/d53/l25 53333918 1 2024-09-19T09:03:04.235 INFO:tasks.workunit.client.0.smithi049.stdout:6/442: creat dc/d16/d88/f8e x:0 0 0 2024-09-19T09:03:04.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/775: truncate d1/d1a/de7/d50/d7c/d9c/ff3 3394643 0 2024-09-19T09:03:04.238 INFO:tasks.workunit.client.0.smithi049.stdout:7/776: stat d1/d1a/da0/dd3/d62/cc0 0 2024-09-19T09:03:04.239 INFO:tasks.workunit.client.0.smithi049.stdout:6/443: symlink dc/l8f 0 2024-09-19T09:03:04.241 INFO:tasks.workunit.client.0.smithi049.stdout:7/777: dread - d1/d1a/da0/dd3/d62/d6b/ff1 zero size 2024-09-19T09:03:04.242 INFO:tasks.workunit.client.0.smithi049.stdout:8/667: dwrite d1/f3d [0,4194304] 0 2024-09-19T09:03:04.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/444: write dc/d16/f2e [19225,115086] 0 2024-09-19T09:03:04.247 INFO:tasks.workunit.client.0.smithi049.stdout:7/778: write d1/d53/dc6/f4c [2093221,46772] 0 2024-09-19T09:03:04.250 INFO:tasks.workunit.client.0.smithi049.stdout:7/779: chown d1/d8/d2d/d36/d91 6175 1 2024-09-19T09:03:04.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/668: creat d1/d11/d2e/d4e/d61/d9f/fca x:0 0 0 2024-09-19T09:03:04.252 INFO:tasks.workunit.client.0.smithi049.stdout:2/728: dwrite d1/d4/d1e/d9f/db3/f5d [8388608,4194304] 0 2024-09-19T09:03:04.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/669: fsync d1/d11/d4f/d87/f49 0 2024-09-19T09:03:04.255 INFO:tasks.workunit.client.0.smithi049.stdout:6/445: mknod dc/d1b/d20/d81/c90 0 2024-09-19T09:03:04.257 INFO:tasks.workunit.client.0.smithi049.stdout:2/729: symlink d1/d2/d6c/dd5/lf7 0 2024-09-19T09:03:04.257 INFO:tasks.workunit.client.0.smithi049.stdout:6/446: read dc/d1b/d20/d81/f85 [46851,72288] 0 2024-09-19T09:03:04.261 INFO:tasks.workunit.client.0.smithi049.stdout:7/780: mknod d1/d8/d2d/d72/d105/c118 0 2024-09-19T09:03:04.261 INFO:tasks.workunit.client.0.smithi049.stdout:6/447: chown dc/d16/d88 23751 1 2024-09-19T09:03:04.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/670: rename d1/d11/d3f to d1/d11/d4f/d87/d5d/dcb 0 2024-09-19T09:03:04.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/730: dread d1/d2/f88 [0,4194304] 0 2024-09-19T09:03:04.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/781: creat d1/d8/d89/f119 x:0 0 0 2024-09-19T09:03:04.321 INFO:tasks.workunit.client.0.smithi049.stdout:2/731: write d1/d2d/fa4 [511370,108076] 0 2024-09-19T09:03:04.324 INFO:tasks.workunit.client.0.smithi049.stdout:7/782: rmdir d1/d8/d19/d116 0 2024-09-19T09:03:04.324 INFO:tasks.workunit.client.0.smithi049.stdout:6/448: link dc/d16/f2d dc/d1b/d20/f91 0 2024-09-19T09:03:04.326 INFO:tasks.workunit.client.0.smithi049.stdout:8/671: dwrite d1/f78 [0,4194304] 0 2024-09-19T09:03:04.327 INFO:tasks.workunit.client.0.smithi049.stdout:2/732: mkdir d1/d4/d1e/d21/dae/ded/df8 0 2024-09-19T09:03:04.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/783: symlink d1/d8/d19/l11a 0 2024-09-19T09:03:04.335 INFO:tasks.workunit.client.0.smithi049.stdout:2/733: fsync d1/d2/f67 0 2024-09-19T09:03:04.336 INFO:tasks.workunit.client.0.smithi049.stdout:7/784: dwrite d1/d8/d2d/dd9/fdc [0,4194304] 0 2024-09-19T09:03:04.338 INFO:tasks.workunit.client.0.smithi049.stdout:6/449: write dc/d1b/d20/d81/f85 [275053,28622] 0 2024-09-19T09:03:04.342 INFO:tasks.workunit.client.0.smithi049.stdout:8/672: unlink d1/d11/d4f/d87/d5d/d65/c94 0 2024-09-19T09:03:04.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/785: creat d1/d53/dc6/dd8/f11b x:0 0 0 2024-09-19T09:03:04.346 INFO:tasks.workunit.client.0.smithi049.stdout:6/450: dread dc/d1b/d20/d81/d5a/f64 [0,4194304] 0 2024-09-19T09:03:04.346 INFO:tasks.workunit.client.0.smithi049.stdout:7/786: write d1/d8/d80/f96 [4976929,72261] 0 2024-09-19T09:03:04.348 INFO:tasks.workunit.client.0.smithi049.stdout:6/451: dread - dc/d1b/d20/d81/d6e/f76 zero size 2024-09-19T09:03:04.349 INFO:tasks.workunit.client.0.smithi049.stdout:7/787: chown d1/d8/d2d/d36/f45 27 1 2024-09-19T09:03:04.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/734: rename d1/d4/d20/l31 to d1/d4/d20/lf9 0 2024-09-19T09:03:04.350 INFO:tasks.workunit.client.0.smithi049.stdout:6/452: chown dc/d16/f2e 2245 1 2024-09-19T09:03:04.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/788: chown d1/d1a/f9f 848170 1 2024-09-19T09:03:04.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/673: truncate d1/d11/f74 272875 0 2024-09-19T09:03:04.352 INFO:tasks.workunit.client.0.smithi049.stdout:2/735: mknod d1/d2b/d7c/dc3/cfa 0 2024-09-19T09:03:04.358 INFO:tasks.workunit.client.0.smithi049.stdout:7/789: creat d1/d8/d2d/f11c x:0 0 0 2024-09-19T09:03:04.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/453: dwrite dc/d1b/d20/d2f/d31/f5d [0,4194304] 0 2024-09-19T09:03:04.361 INFO:tasks.workunit.client.0.smithi049.stdout:2/736: rename d1/d4/d1e/d9f/fbb to d1/d4/d1e/d21/ffb 0 2024-09-19T09:03:04.364 INFO:tasks.workunit.client.0.smithi049.stdout:6/454: dread dc/d16/f70 [0,4194304] 0 2024-09-19T09:03:04.366 INFO:tasks.workunit.client.0.smithi049.stdout:7/790: rename d1/d1a/de7/d50/d7c to d1/d8/d2d/d72/d11d 0 2024-09-19T09:03:04.366 INFO:tasks.workunit.client.0.smithi049.stdout:7/791: fdatasync d1/d8/dda/f111 0 2024-09-19T09:03:04.371 INFO:tasks.workunit.client.0.smithi049.stdout:2/737: unlink d1/d2b/d7c/dc3/cfa 0 2024-09-19T09:03:04.373 INFO:tasks.workunit.client.0.smithi049.stdout:6/455: write dc/d1b/d20/d81/d5a/f64 [1104155,77465] 0 2024-09-19T09:03:04.374 INFO:tasks.workunit.client.0.smithi049.stdout:7/792: dwrite d1/d8/fb [8388608,4194304] 0 2024-09-19T09:03:04.375 INFO:tasks.workunit.client.0.smithi049.stdout:2/738: fdatasync d1/f11 0 2024-09-19T09:03:04.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/456: truncate dc/d1b/d20/f72 445578 0 2024-09-19T09:03:04.379 INFO:tasks.workunit.client.0.smithi049.stdout:7/793: write d1/d8/d2d/d72/fe8 [1793732,35548] 0 2024-09-19T09:03:04.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/739: mknod d1/d4/d1e/d45/cfc 0 2024-09-19T09:03:04.386 INFO:tasks.workunit.client.0.smithi049.stdout:7/794: mknod d1/d53/dc6/c11e 0 2024-09-19T09:03:04.386 INFO:tasks.workunit.client.0.smithi049.stdout:2/740: dwrite d1/d2/d32/f3d [0,4194304] 0 2024-09-19T09:03:04.388 INFO:tasks.workunit.client.0.smithi049.stdout:7/795: chown d1/d1a/fcb 1198 1 2024-09-19T09:03:04.390 INFO:tasks.workunit.client.0.smithi049.stdout:6/457: getdents dc/d1b 0 2024-09-19T09:03:04.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/796: dwrite d1/d8/d2d/d72/d11d/f107 [0,4194304] 0 2024-09-19T09:03:04.407 INFO:tasks.workunit.client.0.smithi049.stdout:2/741: dread d1/d4/fb [0,4194304] 0 2024-09-19T09:03:04.407 INFO:tasks.workunit.client.0.smithi049.stdout:2/742: chown d1/d2/d23 200 1 2024-09-19T09:03:04.435 INFO:tasks.workunit.client.0.smithi049.stdout:7/797: rename d1/d53/dc6/c9e to d1/c11f 0 2024-09-19T09:03:04.450 INFO:tasks.workunit.client.0.smithi049.stdout:6/458: write dc/d1b/d20/f32 [3418166,125845] 0 2024-09-19T09:03:04.458 INFO:tasks.workunit.client.0.smithi049.stdout:6/459: dwrite dc/d1b/d20/d81/f4d [4194304,4194304] 0 2024-09-19T09:03:04.464 INFO:tasks.workunit.client.0.smithi049.stdout:6/460: getdents dc/d1b/d20/d2f/d4c 0 2024-09-19T09:03:04.468 INFO:tasks.workunit.client.0.smithi049.stdout:6/461: mknod dc/d16/d88/c92 0 2024-09-19T09:03:04.468 INFO:tasks.workunit.client.0.smithi049.stdout:6/462: fdatasync dc/d1b/d20/d7f/f8c 0 2024-09-19T09:03:04.491 INFO:tasks.workunit.client.0.smithi049.stdout:6/463: dread dc/ff [0,4194304] 0 2024-09-19T09:03:04.493 INFO:tasks.workunit.client.0.smithi049.stdout:6/464: truncate f9 3291667 0 2024-09-19T09:03:04.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/465: creat dc/d1b/d78/f93 x:0 0 0 2024-09-19T09:03:04.496 INFO:tasks.workunit.client.0.smithi049.stdout:6/466: truncate dc/d1b/d20/d2f/d31/f69 1028587 0 2024-09-19T09:03:04.504 INFO:tasks.workunit.client.0.smithi049.stdout:6/467: link dc/d1b/d20/d2f/d31/l3e dc/d1b/d20/d2f/d6b/d73/l94 0 2024-09-19T09:03:04.513 INFO:tasks.workunit.client.0.smithi049.stdout:6/468: dread dc/f19 [0,4194304] 0 2024-09-19T09:03:04.513 INFO:tasks.workunit.client.0.smithi049.stdout:6/469: stat dc/d16/d88 0 2024-09-19T09:03:04.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/470: chown dc/d1b/d20/d2f/d6b/d73/l94 399 1 2024-09-19T09:03:04.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/471: readlink dc/l10 0 2024-09-19T09:03:04.536 INFO:tasks.workunit.client.0.smithi049.stdout:6/472: truncate dc/ff 1857070 0 2024-09-19T09:03:04.541 INFO:tasks.workunit.client.0.smithi049.stdout:6/473: dread dc/d1b/d20/d81/f27 [0,4194304] 0 2024-09-19T09:03:04.543 INFO:tasks.workunit.client.0.smithi049.stdout:6/474: read dc/d1b/f77 [30496,52132] 0 2024-09-19T09:03:05.025 INFO:tasks.workunit.client.0.smithi049.stdout:5/556: sync 2024-09-19T09:03:05.025 INFO:tasks.workunit.client.0.smithi049.stdout:1/422: sync 2024-09-19T09:03:05.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/423: fsync d5/d6/dc/f56 0 2024-09-19T09:03:05.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/557: dwrite d3/dc/f9a [0,4194304] 0 2024-09-19T09:03:05.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/424: dwrite d5/d6/f70 [0,4194304] 0 2024-09-19T09:03:05.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/558: creat d3/dc/faf x:0 0 0 2024-09-19T09:03:05.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/559: fsync d3/d5/d1c/d3a/d8f/fac 0 2024-09-19T09:03:05.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/425: mknod d5/d6/d8/d13/d24/c88 0 2024-09-19T09:03:05.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/560: symlink d3/d5/d1c/d3a/d8f/lb0 0 2024-09-19T09:03:05.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/426: symlink d5/d6/d19/l89 0 2024-09-19T09:03:05.052 INFO:tasks.workunit.client.0.smithi049.stdout:1/427: link d5/d6/d19/d30/l5a d5/d6/d8/d1a/d78/l8a 0 2024-09-19T09:03:05.062 INFO:tasks.workunit.client.0.smithi049.stdout:1/428: rename d5/d6/f70 to d5/d6/d8/d13/d24/f8b 0 2024-09-19T09:03:05.065 INFO:tasks.workunit.client.0.smithi049.stdout:5/561: truncate d3/d5/d20/d38/d5a/fa9 817532 0 2024-09-19T09:03:05.066 INFO:tasks.workunit.client.0.smithi049.stdout:5/562: rename d3 to d3/d5/d20/d38/d9c/db1 22 2024-09-19T09:03:05.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/429: link d5/d6/d8/d13/f7c d5/d6/d8/f8c 0 2024-09-19T09:03:05.074 INFO:tasks.workunit.client.0.smithi049.stdout:1/430: rename d5/f67 to d5/d6/d8/d1a/d78/f8d 0 2024-09-19T09:03:05.077 INFO:tasks.workunit.client.0.smithi049.stdout:5/563: dread d3/f8 [0,4194304] 0 2024-09-19T09:03:05.079 INFO:tasks.workunit.client.0.smithi049.stdout:5/564: write d3/d5/d20/d38/f4d [2667295,5635] 0 2024-09-19T09:03:05.079 INFO:tasks.workunit.client.0.smithi049.stdout:1/431: creat d5/d6/d19/f8e x:0 0 0 2024-09-19T09:03:05.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/565: fsync d3/f62 0 2024-09-19T09:03:05.084 INFO:tasks.workunit.client.0.smithi049.stdout:5/566: unlink d3/d5/de/d12/d45/d8d/fa8 0 2024-09-19T09:03:05.085 INFO:tasks.workunit.client.0.smithi049.stdout:5/567: chown d3/d5/de/l39 191469 1 2024-09-19T09:03:05.085 INFO:tasks.workunit.client.0.smithi049.stdout:1/432: truncate d5/d6/d19/d21/f32 538774 0 2024-09-19T09:03:05.087 INFO:tasks.workunit.client.0.smithi049.stdout:5/568: dread d3/d5/d1c/f2b [0,4194304] 0 2024-09-19T09:03:05.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/569: fsync d3/d5/de/f87 0 2024-09-19T09:03:05.090 INFO:tasks.workunit.client.0.smithi049.stdout:5/570: read d3/d5/d20/d57/d72/fa7 [36162,67901] 0 2024-09-19T09:03:05.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/571: chown d3/d5/d20/d57/f95 1 1 2024-09-19T09:03:05.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/433: truncate d5/d6/dc/f56 1662973 0 2024-09-19T09:03:05.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/434: chown d5/d6/d8/d13/f34 85982 1 2024-09-19T09:03:05.098 INFO:tasks.workunit.client.0.smithi049.stdout:1/435: dwrite d5/d6/d19/d21/d52/f85 [0,4194304] 0 2024-09-19T09:03:05.101 INFO:tasks.workunit.client.0.smithi049.stdout:1/436: read d5/d6/f6f [3941666,56385] 0 2024-09-19T09:03:05.102 INFO:tasks.workunit.client.0.smithi049.stdout:5/572: mknod d3/d5/cb2 0 2024-09-19T09:03:05.116 INFO:tasks.workunit.client.0.smithi049.stdout:5/573: getdents d3/d5/de 0 2024-09-19T09:03:05.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/437: dread d5/d6/d8/f2a [0,4194304] 0 2024-09-19T09:03:05.128 INFO:tasks.workunit.client.0.smithi049.stdout:5/574: dread d3/d5/f1f [0,4194304] 0 2024-09-19T09:03:05.128 INFO:tasks.workunit.client.0.smithi049.stdout:1/438: symlink d5/d6/d19/d30/d63/l8f 0 2024-09-19T09:03:05.129 INFO:tasks.workunit.client.0.smithi049.stdout:1/439: fdatasync d5/d6/d19/f39 0 2024-09-19T09:03:05.129 INFO:tasks.workunit.client.0.smithi049.stdout:5/575: chown d3/d5/d1c/d2d/d89/cae 428134527 1 2024-09-19T09:03:05.131 INFO:tasks.workunit.client.0.smithi049.stdout:5/576: mknod d3/d5/d1c/d3a/d8f/cb3 0 2024-09-19T09:03:05.161 INFO:tasks.workunit.client.0.smithi049.stdout:0/709: sync 2024-09-19T09:03:05.195 INFO:tasks.workunit.client.0.smithi049.stdout:1/440: creat d5/d6/d19/f90 x:0 0 0 2024-09-19T09:03:05.196 INFO:tasks.workunit.client.0.smithi049.stdout:0/710: fdatasync d5/d10/d82/d67/f90 0 2024-09-19T09:03:05.197 INFO:tasks.workunit.client.0.smithi049.stdout:5/577: read d3/d5/de/f1e [589007,29300] 0 2024-09-19T09:03:05.197 INFO:tasks.workunit.client.0.smithi049.stdout:1/441: stat d5/d6/d19/d21/d52/f85 0 2024-09-19T09:03:05.274 INFO:tasks.workunit.client.0.smithi049.stdout:5/578: chown d3/d6c/c69 1617047399 1 2024-09-19T09:03:05.275 INFO:tasks.workunit.client.0.smithi049.stdout:1/442: mknod d5/d6/d82/c91 0 2024-09-19T09:03:05.276 INFO:tasks.workunit.client.0.smithi049.stdout:5/579: dread d3/d5/d1c/f2b [0,4194304] 0 2024-09-19T09:03:05.278 INFO:tasks.workunit.client.0.smithi049.stdout:5/580: dread - d3/d5/d1c/d3a/d8f/fac zero size 2024-09-19T09:03:05.279 INFO:tasks.workunit.client.0.smithi049.stdout:0/711: dwrite d5/d10/d13/d15/f1b [4194304,4194304] 0 2024-09-19T09:03:05.281 INFO:tasks.workunit.client.0.smithi049.stdout:1/443: rename d5/d6/d19/c7b to d5/d6/d8/d1a/c92 0 2024-09-19T09:03:05.287 INFO:tasks.workunit.client.0.smithi049.stdout:1/444: truncate d5/d6/f1b 2539555 0 2024-09-19T09:03:05.292 INFO:tasks.workunit.client.0.smithi049.stdout:5/581: dread d3/dc/d43/f6a [0,4194304] 0 2024-09-19T09:03:05.293 INFO:tasks.workunit.client.0.smithi049.stdout:0/712: write d5/d10/d82/f47 [158794,81883] 0 2024-09-19T09:03:05.294 INFO:tasks.workunit.client.0.smithi049.stdout:1/445: symlink d5/d6/d8/d13/d24/l93 0 2024-09-19T09:03:05.295 INFO:tasks.workunit.client.0.smithi049.stdout:1/446: chown d5/f49 4 1 2024-09-19T09:03:05.297 INFO:tasks.workunit.client.0.smithi049.stdout:5/582: mkdir d3/d5/d1c/db4 0 2024-09-19T09:03:05.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/713: rename d5/d10/d13/d15/d29/d9a/c5d to d5/dab/cd7 0 2024-09-19T09:03:05.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/714: stat d5/d10/d2f/lb6 0 2024-09-19T09:03:05.300 INFO:tasks.workunit.client.0.smithi049.stdout:1/447: mkdir d5/d6/d19/d21/d52/d94 0 2024-09-19T09:03:05.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/715: dread d5/d10/d2f/d6d/f83 [0,4194304] 0 2024-09-19T09:03:05.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:05 smithi049 ceph-mon[28158]: pgmap v39: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 188 MiB/s wr, 464 op/s 2024-09-19T09:03:05.302 INFO:tasks.workunit.client.0.smithi049.stdout:0/716: dread - d5/d10/d13/d15/d36/fc2 zero size 2024-09-19T09:03:05.302 INFO:tasks.workunit.client.0.smithi049.stdout:1/448: fsync d5/d6/d8/d13/d24/f43 0 2024-09-19T09:03:05.312 INFO:tasks.workunit.client.0.smithi049.stdout:1/449: getdents d5/d6 0 2024-09-19T09:03:05.315 INFO:tasks.workunit.client.0.smithi049.stdout:1/450: rename d5/d6/dc/c86 to d5/d6/d19/d30/c95 0 2024-09-19T09:03:05.320 INFO:tasks.workunit.client.0.smithi049.stdout:0/717: dread d5/d10/d13/d30/f31 [0,4194304] 0 2024-09-19T09:03:05.322 INFO:tasks.workunit.client.0.smithi049.stdout:5/583: dwrite d3/f6 [0,4194304] 0 2024-09-19T09:03:05.323 INFO:tasks.workunit.client.0.smithi049.stdout:5/584: fsync d3/d5/de/f87 0 2024-09-19T09:03:05.325 INFO:tasks.workunit.client.0.smithi049.stdout:5/585: chown d3/d5/de/cab 56 1 2024-09-19T09:03:05.330 INFO:tasks.workunit.client.0.smithi049.stdout:5/586: symlink d3/d5/de/d12/d45/lb5 0 2024-09-19T09:03:05.332 INFO:tasks.workunit.client.0.smithi049.stdout:0/718: write d5/f58 [2095890,8585] 0 2024-09-19T09:03:05.334 INFO:tasks.workunit.client.0.smithi049.stdout:5/587: getdents d3/d6c/d6d/da1 0 2024-09-19T09:03:05.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/588: readlink d3/d5/l2c 0 2024-09-19T09:03:05.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/589: fdatasync d3/d5/d1c/d2d/f77 0 2024-09-19T09:03:05.336 INFO:tasks.workunit.client.0.smithi049.stdout:0/719: read - d5/d10/d13/d15/d36/f51 zero size 2024-09-19T09:03:05.338 INFO:tasks.workunit.client.0.smithi049.stdout:0/720: creat d5/d86/fd8 x:0 0 0 2024-09-19T09:03:05.339 INFO:tasks.workunit.client.0.smithi049.stdout:5/590: mkdir d3/d5/d20/d38/d5a/db6 0 2024-09-19T09:03:05.341 INFO:tasks.workunit.client.0.smithi049.stdout:5/591: symlink d3/d6c/d6d/lb7 0 2024-09-19T09:03:05.346 INFO:tasks.workunit.client.0.smithi049.stdout:0/721: dwrite d5/d10/d13/f42 [4194304,4194304] 0 2024-09-19T09:03:05.348 INFO:tasks.workunit.client.0.smithi049.stdout:5/592: dwrite d3/d5/d1c/d2d/f60 [0,4194304] 0 2024-09-19T09:03:05.351 INFO:tasks.workunit.client.0.smithi049.stdout:0/722: creat d5/fd9 x:0 0 0 2024-09-19T09:03:05.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/593: dwrite d3/dc/f9a [0,4194304] 0 2024-09-19T09:03:05.368 INFO:tasks.workunit.client.0.smithi049.stdout:5/594: dread d3/d5/d20/d38/d5a/fa9 [0,4194304] 0 2024-09-19T09:03:05.371 INFO:tasks.workunit.client.0.smithi049.stdout:0/723: mkdir d5/dab/dda 0 2024-09-19T09:03:05.372 INFO:tasks.workunit.client.0.smithi049.stdout:5/595: creat d3/d6c/d6d/da1/fb8 x:0 0 0 2024-09-19T09:03:05.373 INFO:tasks.workunit.client.0.smithi049.stdout:5/596: chown d3/d5/d1c/d2d/d89 103 1 2024-09-19T09:03:05.374 INFO:tasks.workunit.client.0.smithi049.stdout:5/597: chown d3/d5/d20/d38 192 1 2024-09-19T09:03:05.374 INFO:tasks.workunit.client.0.smithi049.stdout:0/724: dread - d5/d10/d13/d15/d36/d3d/fc1 zero size 2024-09-19T09:03:05.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/598: symlink d3/d5/d20/lb9 0 2024-09-19T09:03:05.377 INFO:tasks.workunit.client.0.smithi049.stdout:5/599: dread d3/d5/d1c/d2d/f77 [0,4194304] 0 2024-09-19T09:03:05.383 INFO:tasks.workunit.client.0.smithi049.stdout:5/600: dwrite d3/d5/d20/f76 [0,4194304] 0 2024-09-19T09:03:05.388 INFO:tasks.workunit.client.0.smithi049.stdout:5/601: truncate d3/dc/d43/f5b 1488418 0 2024-09-19T09:03:05.395 INFO:tasks.workunit.client.0.smithi049.stdout:5/602: dwrite d3/d5/d1c/d2d/f60 [0,4194304] 0 2024-09-19T09:03:05.400 INFO:tasks.workunit.client.0.smithi049.stdout:5/603: dread d3/d5/d20/f76 [0,4194304] 0 2024-09-19T09:03:05.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/604: chown d3/d5/d20/f59 13674 1 2024-09-19T09:03:05.408 INFO:tasks.workunit.client.0.smithi049.stdout:0/725: dread d5/f58 [0,4194304] 0 2024-09-19T09:03:05.415 INFO:tasks.workunit.client.0.smithi049.stdout:0/726: dwrite d5/d10/d13/d15/d36/f6a [0,4194304] 0 2024-09-19T09:03:05.416 INFO:tasks.workunit.client.0.smithi049.stdout:5/605: dread d3/d5/d20/d38/f4d [0,4194304] 0 2024-09-19T09:03:05.418 INFO:tasks.workunit.client.0.smithi049.stdout:0/727: mkdir d5/d10/d13/dc4/dcd/ddb 0 2024-09-19T09:03:05.420 INFO:tasks.workunit.client.0.smithi049.stdout:5/606: mknod d3/d5/cba 0 2024-09-19T09:03:05.423 INFO:tasks.workunit.client.0.smithi049.stdout:5/607: creat d3/d5/d20/d38/d9c/fbb x:0 0 0 2024-09-19T09:03:05.431 INFO:tasks.workunit.client.0.smithi049.stdout:0/728: write d5/d10/d13/d30/f49 [1894961,68055] 0 2024-09-19T09:03:05.433 INFO:tasks.workunit.client.0.smithi049.stdout:0/729: stat d5/d10/d13/d15/d29/la8 0 2024-09-19T09:03:05.434 INFO:tasks.workunit.client.0.smithi049.stdout:0/730: read d5/d10/d13/f42 [2012634,108813] 0 2024-09-19T09:03:05.444 INFO:tasks.workunit.client.0.smithi049.stdout:0/731: dwrite d5/d10/d13/d15/d36/d3d/d7f/f8b [0,4194304] 0 2024-09-19T09:03:05.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/732: readlink d5/d10/d13/d15/l1f 0 2024-09-19T09:03:05.447 INFO:tasks.workunit.client.0.smithi049.stdout:0/733: write d5/fd9 [1026069,86906] 0 2024-09-19T09:03:05.470 INFO:tasks.workunit.client.0.smithi049.stdout:4/472: sync 2024-09-19T09:03:05.471 INFO:tasks.workunit.client.0.smithi049.stdout:3/571: sync 2024-09-19T09:03:05.471 INFO:tasks.workunit.client.0.smithi049.stdout:9/847: sync 2024-09-19T09:03:05.471 INFO:tasks.workunit.client.0.smithi049.stdout:9/848: chown d3/dbb/dec/dd0/ddd 11215287 1 2024-09-19T09:03:05.472 INFO:tasks.workunit.client.0.smithi049.stdout:3/572: read d10/d3d/d76/da3/db7/fbd [116511,11178] 0 2024-09-19T09:03:05.475 INFO:tasks.workunit.client.0.smithi049.stdout:0/734: dread d5/d10/d2f/d6d/f8a [0,4194304] 0 2024-09-19T09:03:05.477 INFO:tasks.workunit.client.0.smithi049.stdout:4/473: unlink d4/f17 0 2024-09-19T09:03:05.478 INFO:tasks.workunit.client.0.smithi049.stdout:4/474: write d4/d15/f59 [3826566,24726] 0 2024-09-19T09:03:05.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/475: stat d4/d34 0 2024-09-19T09:03:05.484 INFO:tasks.workunit.client.0.smithi049.stdout:0/735: mkdir d5/d10/d13/d15/d29/d9a/ddc 0 2024-09-19T09:03:05.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/736: dread - d5/d10/d13/d15/d29/d9a/fcc zero size 2024-09-19T09:03:05.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/476: rmdir d4/d15/d19 39 2024-09-19T09:03:05.490 INFO:tasks.workunit.client.0.smithi049.stdout:9/849: dread d3/d14/d1a/d21/d31/d8e/f7a [0,4194304] 0 2024-09-19T09:03:05.494 INFO:tasks.workunit.client.0.smithi049.stdout:0/737: symlink d5/d64/ldd 0 2024-09-19T09:03:05.500 INFO:tasks.workunit.client.0.smithi049.stdout:3/573: dwrite d10/d11/d27/f2c [0,4194304] 0 2024-09-19T09:03:05.501 INFO:tasks.workunit.client.0.smithi049.stdout:4/477: link d4/d15/c87 d4/d6c/d74/d8b/c8f 0 2024-09-19T09:03:05.505 INFO:tasks.workunit.client.0.smithi049.stdout:3/574: creat d10/d3d/d76/dac/dad/fc5 x:0 0 0 2024-09-19T09:03:05.506 INFO:tasks.workunit.client.0.smithi049.stdout:0/738: mkdir d5/d10/d13/dc4/dcd/ddb/dde 0 2024-09-19T09:03:05.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:05 smithi102 ceph-mon[35280]: pgmap v39: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 188 MiB/s wr, 464 op/s 2024-09-19T09:03:05.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/850: link d3/d14/d34/d44/le3 d3/d14/d34/d74/l11d 0 2024-09-19T09:03:05.509 INFO:tasks.workunit.client.0.smithi049.stdout:9/851: fsync d3/d14/d1a/d21/d73/db8/ffa 0 2024-09-19T09:03:05.510 INFO:tasks.workunit.client.0.smithi049.stdout:9/852: chown d3/dbb/dec/db1/ld5 103321237 1 2024-09-19T09:03:05.511 INFO:tasks.workunit.client.0.smithi049.stdout:0/739: mknod d5/d10/d82/cdf 0 2024-09-19T09:03:05.514 INFO:tasks.workunit.client.0.smithi049.stdout:4/478: creat d4/d15/d19/d1f/d55/f90 x:0 0 0 2024-09-19T09:03:05.517 INFO:tasks.workunit.client.0.smithi049.stdout:9/853: symlink d3/dbb/dec/dd0/d100/l11e 0 2024-09-19T09:03:05.521 INFO:tasks.workunit.client.0.smithi049.stdout:4/479: creat d4/d34/f91 x:0 0 0 2024-09-19T09:03:05.522 INFO:tasks.workunit.client.0.smithi049.stdout:3/575: rmdir d10/d3d/d76/dac/dad 39 2024-09-19T09:03:05.523 INFO:tasks.workunit.client.0.smithi049.stdout:0/740: getdents d5/d10/d2f/d6d/daa/dd3 0 2024-09-19T09:03:05.523 INFO:tasks.workunit.client.0.smithi049.stdout:3/576: write d10/d3d/d76/fb2 [303234,52684] 0 2024-09-19T09:03:05.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/854: fdatasync d3/d14/d1a/d21/d67/d94/fd8 0 2024-09-19T09:03:05.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/480: dwrite d4/d15/f20 [0,4194304] 0 2024-09-19T09:03:05.532 INFO:tasks.workunit.client.0.smithi049.stdout:0/741: rename d5/d10/d13/d15/f1e to d5/d10/d82/d67/fe0 0 2024-09-19T09:03:05.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/855: creat d3/d14/d1a/d21/d73/d105/f11f x:0 0 0 2024-09-19T09:03:05.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/674: sync 2024-09-19T09:03:05.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/481: write d4/d45/f6b [3061862,125580] 0 2024-09-19T09:03:05.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/482: chown d4/d6c/d74/d8b 8 1 2024-09-19T09:03:05.562 INFO:tasks.workunit.client.0.smithi049.stdout:4/483: dread - d4/d45/d3f/d47/f81 zero size 2024-09-19T09:03:05.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/856: write d3/d14/f1e [7711091,73407] 0 2024-09-19T09:03:05.566 INFO:tasks.workunit.client.0.smithi049.stdout:8/675: truncate d1/d11/d45/fa1 391971 0 2024-09-19T09:03:05.569 INFO:tasks.workunit.client.0.smithi049.stdout:4/484: mkdir d4/d92 0 2024-09-19T09:03:05.570 INFO:tasks.workunit.client.0.smithi049.stdout:3/577: write d10/d11/d27/f2e [826153,46644] 0 2024-09-19T09:03:05.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/578: dread - d10/d3d/f94 zero size 2024-09-19T09:03:05.574 INFO:tasks.workunit.client.0.smithi049.stdout:8/676: creat d1/d11/d4f/d87/d5d/dcb/d8c/fcc x:0 0 0 2024-09-19T09:03:05.577 INFO:tasks.workunit.client.0.smithi049.stdout:3/579: creat d10/d3d/d79/fc6 x:0 0 0 2024-09-19T09:03:05.579 INFO:tasks.workunit.client.0.smithi049.stdout:3/580: stat d10/d3d/c4e 0 2024-09-19T09:03:05.580 INFO:tasks.workunit.client.0.smithi049.stdout:0/742: dwrite d5/d10/d13/d30/d75/f81 [0,4194304] 0 2024-09-19T09:03:05.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/857: unlink d3/d14/d34/d74/l8d 0 2024-09-19T09:03:05.586 INFO:tasks.workunit.client.0.smithi049.stdout:4/485: dread d4/f21 [0,4194304] 0 2024-09-19T09:03:05.587 INFO:tasks.workunit.client.0.smithi049.stdout:8/677: creat d1/d11/d4f/d87/d5d/d65/fcd x:0 0 0 2024-09-19T09:03:05.589 INFO:tasks.workunit.client.0.smithi049.stdout:3/581: mkdir d10/d3d/d46/d84/dc7 0 2024-09-19T09:03:05.590 INFO:tasks.workunit.client.0.smithi049.stdout:9/858: mkdir d3/dbb/dec/db1/d120 0 2024-09-19T09:03:05.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/743: truncate d5/d10/d13/d15/d36/d3d/f33 865153 0 2024-09-19T09:03:05.594 INFO:tasks.workunit.client.0.smithi049.stdout:0/744: dread d5/d10/d82/d67/d85/fc5 [0,4194304] 0 2024-09-19T09:03:05.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/486: creat d4/f93 x:0 0 0 2024-09-19T09:03:05.597 INFO:tasks.workunit.client.0.smithi049.stdout:8/678: symlink d1/d11/d2e/d4e/lce 0 2024-09-19T09:03:05.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/679: write d1/d11/d4f/d87/f6a [962311,42471] 0 2024-09-19T09:03:05.600 INFO:tasks.workunit.client.0.smithi049.stdout:4/487: dread d4/f69 [0,4194304] 0 2024-09-19T09:03:05.601 INFO:tasks.workunit.client.0.smithi049.stdout:4/488: readlink d4/d34/d3d/l44 0 2024-09-19T09:03:05.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/680: dwrite d1/d11/d4f/d87/d5d/dcb/d5b/fb9 [0,4194304] 0 2024-09-19T09:03:05.612 INFO:tasks.workunit.client.0.smithi049.stdout:4/489: unlink d4/f6 0 2024-09-19T09:03:05.619 INFO:tasks.workunit.client.0.smithi049.stdout:8/681: mknod d1/d11/d2e/d4e/d61/d9f/ccf 0 2024-09-19T09:03:05.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/490: rmdir d4/d34/d3d/d4f 39 2024-09-19T09:03:05.630 INFO:tasks.workunit.client.0.smithi049.stdout:3/582: getdents d10/d3d/d46/d84 0 2024-09-19T09:03:05.634 INFO:tasks.workunit.client.0.smithi049.stdout:4/491: mkdir d4/d6c/d74/d8b/d94 0 2024-09-19T09:03:05.636 INFO:tasks.workunit.client.0.smithi049.stdout:3/583: creat d10/d3d/d76/dac/dad/fc8 x:0 0 0 2024-09-19T09:03:05.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/682: dread d1/f39 [0,4194304] 0 2024-09-19T09:03:05.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/584: fdatasync d10/d11/d13/d30/f61 0 2024-09-19T09:03:05.646 INFO:tasks.workunit.client.0.smithi049.stdout:8/683: dwrite d1/d11/d4f/d87/d5d/dcb/d5b/f69 [0,4194304] 0 2024-09-19T09:03:05.649 INFO:tasks.workunit.client.0.smithi049.stdout:9/859: dwrite d3/d14/d1a/d21/d66/f8f [0,4194304] 0 2024-09-19T09:03:05.649 INFO:tasks.workunit.client.0.smithi049.stdout:0/745: write d5/fa [94155,22004] 0 2024-09-19T09:03:05.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/585: link d10/d3d/d46/ca5 d10/d3d/d76/dac/cc9 0 2024-09-19T09:03:05.653 INFO:tasks.workunit.client.0.smithi049.stdout:0/746: read d5/d10/d13/d30/d75/f81 [3299674,53097] 0 2024-09-19T09:03:05.655 INFO:tasks.workunit.client.0.smithi049.stdout:8/684: creat d1/d11/d4f/d87/d5d/dcb/d5b/fd0 x:0 0 0 2024-09-19T09:03:05.660 INFO:tasks.workunit.client.0.smithi049.stdout:0/747: mknod d5/d10/d13/dc4/dcd/ddb/ce1 0 2024-09-19T09:03:05.665 INFO:tasks.workunit.client.0.smithi049.stdout:3/586: mknod d10/d11/d27/d4f/cca 0 2024-09-19T09:03:05.674 INFO:tasks.workunit.client.0.smithi049.stdout:3/587: mknod d10/d3d/d95/ccb 0 2024-09-19T09:03:05.678 INFO:tasks.workunit.client.0.smithi049.stdout:3/588: creat d10/d3d/d95/fcc x:0 0 0 2024-09-19T09:03:05.684 INFO:tasks.workunit.client.0.smithi049.stdout:3/589: unlink d10/d11/d13/d30/cbe 0 2024-09-19T09:03:05.689 INFO:tasks.workunit.client.0.smithi049.stdout:3/590: rename d10/d3d/d79/d80 to d10/d11/d13/dbc/dcd 0 2024-09-19T09:03:05.690 INFO:tasks.workunit.client.0.smithi049.stdout:3/591: stat l9 0 2024-09-19T09:03:05.692 INFO:tasks.workunit.client.0.smithi049.stdout:4/492: truncate d4/d45/f8e 6188832 0 2024-09-19T09:03:05.692 INFO:tasks.workunit.client.0.smithi049.stdout:4/493: chown d4/d6c/d74 4024262 1 2024-09-19T09:03:05.693 INFO:tasks.workunit.client.0.smithi049.stdout:4/494: chown d4/d15/f20 150468 1 2024-09-19T09:03:05.699 INFO:tasks.workunit.client.0.smithi049.stdout:3/592: getdents d10/d3d/d79/dc1 0 2024-09-19T09:03:05.707 INFO:tasks.workunit.client.0.smithi049.stdout:3/593: unlink d10/d11/f3a 0 2024-09-19T09:03:05.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/594: rename d10/d3d/d76/dac/dad/fc5 to d10/d3d/d76/dac/fce 0 2024-09-19T09:03:05.719 INFO:tasks.workunit.client.0.smithi049.stdout:8/685: write d1/f77 [1009393,6499] 0 2024-09-19T09:03:05.721 INFO:tasks.workunit.client.0.smithi049.stdout:3/595: creat d10/d11/d27/d4f/d59/d81/fcf x:0 0 0 2024-09-19T09:03:05.723 INFO:tasks.workunit.client.0.smithi049.stdout:9/860: truncate d3/d14/d34/f88 6290111 0 2024-09-19T09:03:05.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/596: dwrite d10/d3d/fa6 [0,4194304] 0 2024-09-19T09:03:05.729 INFO:tasks.workunit.client.0.smithi049.stdout:9/861: rmdir d3/dbb 39 2024-09-19T09:03:05.730 INFO:tasks.workunit.client.0.smithi049.stdout:0/748: dwrite d5/d10/d13/f1c [0,4194304] 0 2024-09-19T09:03:05.731 INFO:tasks.workunit.client.0.smithi049.stdout:9/862: fdatasync d3/d14/d34/d9f/f119 0 2024-09-19T09:03:05.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/597: mkdir d10/d11/d13/d7e/dd0 0 2024-09-19T09:03:05.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/686: link d1/d11/d4f/d87/d5d/dcb/d5b/cb2 d1/d11/d2e/db5/cd1 0 2024-09-19T09:03:05.736 INFO:tasks.workunit.client.0.smithi049.stdout:8/687: fdatasync d1/fb8 0 2024-09-19T09:03:05.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/749: chown d5/d86 6475 1 2024-09-19T09:03:05.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/688: write d1/d11/d4f/d87/d5d/dcb/d8c/fae [828309,38182] 0 2024-09-19T09:03:05.740 INFO:tasks.workunit.client.0.smithi049.stdout:9/863: mknod d3/d14/d1a/d21/d31/d8e/df5/c121 0 2024-09-19T09:03:05.741 INFO:tasks.workunit.client.0.smithi049.stdout:3/598: mknod d10/d3d/d76/dac/dad/cd1 0 2024-09-19T09:03:05.742 INFO:tasks.workunit.client.0.smithi049.stdout:9/864: write d3/d14/d1a/d21/d67/fd7 [834952,62238] 0 2024-09-19T09:03:05.743 INFO:tasks.workunit.client.0.smithi049.stdout:4/495: write d4/d15/d19/f68 [4410870,43280] 0 2024-09-19T09:03:05.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/496: write d4/d34/f91 [830681,15015] 0 2024-09-19T09:03:05.746 INFO:tasks.workunit.client.0.smithi049.stdout:2/743: sync 2024-09-19T09:03:05.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/689: readlink d1/d11/d45/l62 0 2024-09-19T09:03:05.746 INFO:tasks.workunit.client.0.smithi049.stdout:6/475: sync 2024-09-19T09:03:05.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/798: sync 2024-09-19T09:03:05.746 INFO:tasks.workunit.client.0.smithi049.stdout:1/451: sync 2024-09-19T09:03:05.746 INFO:tasks.workunit.client.0.smithi049.stdout:5/608: sync 2024-09-19T09:03:05.747 INFO:tasks.workunit.client.0.smithi049.stdout:4/497: chown d4/d15/c56 0 1 2024-09-19T09:03:05.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/609: chown d3/d5/de/d12/d45 576471 1 2024-09-19T09:03:05.749 INFO:tasks.workunit.client.0.smithi049.stdout:4/498: chown d4/d15/d19 32 1 2024-09-19T09:03:05.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/865: stat d3/dbb/dec/db1/d120 0 2024-09-19T09:03:05.756 INFO:tasks.workunit.client.0.smithi049.stdout:9/866: fdatasync d3/d14/d34/f56 0 2024-09-19T09:03:05.757 INFO:tasks.workunit.client.0.smithi049.stdout:0/750: creat d5/d10/d13/dc4/dcd/ddb/dde/fe2 x:0 0 0 2024-09-19T09:03:05.759 INFO:tasks.workunit.client.0.smithi049.stdout:6/476: creat dc/d1b/d20/d2f/d53/f95 x:0 0 0 2024-09-19T09:03:05.761 INFO:tasks.workunit.client.0.smithi049.stdout:7/799: creat d1/d8/d2d/d72/d105/f120 x:0 0 0 2024-09-19T09:03:05.761 INFO:tasks.workunit.client.0.smithi049.stdout:3/599: dread d10/d11/d27/f65 [0,4194304] 0 2024-09-19T09:03:05.765 INFO:tasks.workunit.client.0.smithi049.stdout:6/477: dread dc/d16/f3b [0,4194304] 0 2024-09-19T09:03:05.768 INFO:tasks.workunit.client.0.smithi049.stdout:0/751: fdatasync d5/d10/d13/d30/d9f/fb0 0 2024-09-19T09:03:05.768 INFO:tasks.workunit.client.0.smithi049.stdout:4/499: dread d4/f69 [0,4194304] 0 2024-09-19T09:03:05.770 INFO:tasks.workunit.client.0.smithi049.stdout:6/478: chown dc/d16/l33 24586190 1 2024-09-19T09:03:05.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/610: dwrite d3/d5/de/d4a/f68 [0,4194304] 0 2024-09-19T09:03:05.773 INFO:tasks.workunit.client.0.smithi049.stdout:1/452: write d5/d6/f10 [632597,96778] 0 2024-09-19T09:03:05.780 INFO:tasks.workunit.client.0.smithi049.stdout:1/453: write d5/d6/d19/d21/d52/f76 [1801038,24534] 0 2024-09-19T09:03:05.781 INFO:tasks.workunit.client.0.smithi049.stdout:4/500: dwrite d4/d34/f79 [0,4194304] 0 2024-09-19T09:03:05.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/454: dread - d5/d6/d8/f8c zero size 2024-09-19T09:03:05.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/455: stat d5/d6/f5b 0 2024-09-19T09:03:05.788 INFO:tasks.workunit.client.0.smithi049.stdout:2/744: creat d1/d2/ffd x:0 0 0 2024-09-19T09:03:05.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/745: stat d1/d2/d23/lcf 0 2024-09-19T09:03:05.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/867: truncate d3/d14/d1a/f7d 1888366 0 2024-09-19T09:03:05.790 INFO:tasks.workunit.client.0.smithi049.stdout:4/501: dwrite d4/d15/f59 [0,4194304] 0 2024-09-19T09:03:05.791 INFO:tasks.workunit.client.0.smithi049.stdout:0/752: stat d5/d10/l4d 0 2024-09-19T09:03:05.791 INFO:tasks.workunit.client.0.smithi049.stdout:9/868: fdatasync d3/d14/f1e 0 2024-09-19T09:03:05.793 INFO:tasks.workunit.client.0.smithi049.stdout:9/869: dread - d3/d14/d34/d9f/f119 zero size 2024-09-19T09:03:05.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/502: dwrite d4/d45/d3f/d47/f49 [0,4194304] 0 2024-09-19T09:03:05.804 INFO:tasks.workunit.client.0.smithi049.stdout:7/800: dwrite d1/d1a/de7/d59/fb2 [0,4194304] 0 2024-09-19T09:03:05.805 INFO:tasks.workunit.client.0.smithi049.stdout:3/600: dread d10/d11/d13/f32 [0,4194304] 0 2024-09-19T09:03:05.810 INFO:tasks.workunit.client.0.smithi049.stdout:8/690: getdents d1/d11/d2e/d4e 0 2024-09-19T09:03:05.811 INFO:tasks.workunit.client.0.smithi049.stdout:2/746: rmdir d1/d2b/d7c 39 2024-09-19T09:03:05.818 INFO:tasks.workunit.client.0.smithi049.stdout:9/870: rename d3/d14/d34/f95 to d3/d14/d1a/d21/d67/d94/f122 0 2024-09-19T09:03:05.818 INFO:tasks.workunit.client.0.smithi049.stdout:9/871: stat d3/d14/d1a/f10b 0 2024-09-19T09:03:05.819 INFO:tasks.workunit.client.0.smithi049.stdout:1/456: mkdir d5/d6/d8/d13/d24/d96 0 2024-09-19T09:03:05.820 INFO:tasks.workunit.client.0.smithi049.stdout:7/801: symlink d1/d8/d89/l121 0 2024-09-19T09:03:05.820 INFO:tasks.workunit.client.0.smithi049.stdout:3/601: symlink d10/d3d/d76/da3/db7/ld2 0 2024-09-19T09:03:05.822 INFO:tasks.workunit.client.0.smithi049.stdout:0/753: mknod d5/d10/ce3 0 2024-09-19T09:03:05.824 INFO:tasks.workunit.client.0.smithi049.stdout:9/872: mknod d3/dbb/dec/dd0/c123 0 2024-09-19T09:03:05.824 INFO:tasks.workunit.client.0.smithi049.stdout:2/747: getdents d1/d4/d20/dc8 0 2024-09-19T09:03:05.825 INFO:tasks.workunit.client.0.smithi049.stdout:5/611: getdents d3/d5/d1c/d4c 0 2024-09-19T09:03:05.825 INFO:tasks.workunit.client.0.smithi049.stdout:3/602: write d10/d11/d27/d4f/d59/d81/fcf [473366,102589] 0 2024-09-19T09:03:05.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/457: symlink d5/d6/d8/l97 0 2024-09-19T09:03:05.829 INFO:tasks.workunit.client.0.smithi049.stdout:0/754: read d5/d10/d13/d15/d29/f57 [1959062,67621] 0 2024-09-19T09:03:05.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/603: creat d10/d3d/fd3 x:0 0 0 2024-09-19T09:03:05.832 INFO:tasks.workunit.client.0.smithi049.stdout:7/802: dwrite d1/d8/d2d/d31/f79 [4194304,4194304] 0 2024-09-19T09:03:05.833 INFO:tasks.workunit.client.0.smithi049.stdout:2/748: rename d1/f11 to d1/d4/d1e/d9f/db7/ffe 0 2024-09-19T09:03:05.840 INFO:tasks.workunit.client.0.smithi049.stdout:1/458: symlink d5/d6/d19/l98 0 2024-09-19T09:03:05.841 INFO:tasks.workunit.client.0.smithi049.stdout:9/873: dwrite d3/d14/d1a/d21/d31/d8e/dc2/d9e/ff4 [0,4194304] 0 2024-09-19T09:03:05.841 INFO:tasks.workunit.client.0.smithi049.stdout:1/459: dread - d5/f80 zero size 2024-09-19T09:03:05.845 INFO:tasks.workunit.client.0.smithi049.stdout:7/803: unlink d1/d1a/de7/d59/lf9 0 2024-09-19T09:03:05.845 INFO:tasks.workunit.client.0.smithi049.stdout:3/604: mknod d10/d3d/d76/dac/dad/daf/cd4 0 2024-09-19T09:03:05.849 INFO:tasks.workunit.client.0.smithi049.stdout:2/749: symlink d1/d2/d70/de4/lff 0 2024-09-19T09:03:05.851 INFO:tasks.workunit.client.0.smithi049.stdout:5/612: dread d3/d5/d20/f59 [0,4194304] 0 2024-09-19T09:03:05.855 INFO:tasks.workunit.client.0.smithi049.stdout:0/755: dread d5/d10/d13/d15/d36/d3d/f24 [0,4194304] 0 2024-09-19T09:03:05.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/503: dwrite d4/d34/d3d/d62/f64 [0,4194304] 0 2024-09-19T09:03:05.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/504: fdatasync d4/d34/f79 0 2024-09-19T09:03:05.858 INFO:tasks.workunit.client.0.smithi049.stdout:7/804: mkdir d1/d8/d2d/d31/d122 0 2024-09-19T09:03:05.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/805: chown d1/d53 49602344 1 2024-09-19T09:03:05.861 INFO:tasks.workunit.client.0.smithi049.stdout:1/460: dread d5/f49 [0,4194304] 0 2024-09-19T09:03:05.863 INFO:tasks.workunit.client.0.smithi049.stdout:1/461: chown d5/c6b 7 1 2024-09-19T09:03:05.863 INFO:tasks.workunit.client.0.smithi049.stdout:8/691: truncate d1/d11/f1b 7691193 0 2024-09-19T09:03:05.868 INFO:tasks.workunit.client.0.smithi049.stdout:5/613: unlink d3/d5/d20/c5e 0 2024-09-19T09:03:05.871 INFO:tasks.workunit.client.0.smithi049.stdout:8/692: dwrite d1/ff [4194304,4194304] 0 2024-09-19T09:03:05.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/693: read - d1/d11/d4f/d87/d5d/dcb/d5b/faa zero size 2024-09-19T09:03:05.877 INFO:tasks.workunit.client.0.smithi049.stdout:0/756: creat d5/d10/d2f/d6d/daa/fe4 x:0 0 0 2024-09-19T09:03:05.880 INFO:tasks.workunit.client.0.smithi049.stdout:9/874: write d3/d14/d34/f88 [3547923,38855] 0 2024-09-19T09:03:05.885 INFO:tasks.workunit.client.0.smithi049.stdout:3/605: dwrite d10/d3d/f4a [0,4194304] 0 2024-09-19T09:03:05.888 INFO:tasks.workunit.client.0.smithi049.stdout:3/606: write d10/d3d/d76/fb0 [68105,29851] 0 2024-09-19T09:03:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:0/757: mknod d5/d64/ce5 0 2024-09-19T09:03:05.893 INFO:tasks.workunit.client.0.smithi049.stdout:7/806: mknod d1/d8/d2d/d72/d11d/c123 0 2024-09-19T09:03:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/807: chown d1/ce1 3214 1 2024-09-19T09:03:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/808: chown d1/d1a/de7/d50/fde 22173344 1 2024-09-19T09:03:05.896 INFO:tasks.workunit.client.0.smithi049.stdout:9/875: rmdir d3/dbb/dec/dd0/dd4 39 2024-09-19T09:03:05.899 INFO:tasks.workunit.client.0.smithi049.stdout:2/750: rename d1/d4/d20/c90 to d1/d2b/c100 0 2024-09-19T09:03:05.900 INFO:tasks.workunit.client.0.smithi049.stdout:5/614: mkdir d3/d5/d20/d57/d90/dbc 0 2024-09-19T09:03:05.904 INFO:tasks.workunit.client.0.smithi049.stdout:0/758: rmdir d5/d64 39 2024-09-19T09:03:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:7/809: mknod d1/d8/d80/c124 0 2024-09-19T09:03:05.906 INFO:tasks.workunit.client.0.smithi049.stdout:9/876: creat d3/d14/d1a/d21/d31/d8e/df5/f124 x:0 0 0 2024-09-19T09:03:05.907 INFO:tasks.workunit.client.0.smithi049.stdout:4/505: rename d4/d34/c3e to d4/d15/d19/d1f/d77/c95 0 2024-09-19T09:03:05.912 INFO:tasks.workunit.client.0.smithi049.stdout:2/751: creat d1/d4/d1e/d9f/db3/d41/f101 x:0 0 0 2024-09-19T09:03:05.913 INFO:tasks.workunit.client.0.smithi049.stdout:3/607: unlink d10/d11/d27/d4f/d59/la8 0 2024-09-19T09:03:05.915 INFO:tasks.workunit.client.0.smithi049.stdout:7/810: fdatasync d1/d8/d80/f92 0 2024-09-19T09:03:05.918 INFO:tasks.workunit.client.0.smithi049.stdout:1/462: rename d5/d6/d19/f8e to d5/d6/d8/d13/d24/d3b/f99 0 2024-09-19T09:03:05.924 INFO:tasks.workunit.client.0.smithi049.stdout:3/608: creat d10/d11/d27/d4f/d59/d81/fd5 x:0 0 0 2024-09-19T09:03:05.927 INFO:tasks.workunit.client.0.smithi049.stdout:1/463: dwrite d5/d6/d19/d21/f46 [0,4194304] 0 2024-09-19T09:03:05.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/759: chown d5/d10/c32 3412 1 2024-09-19T09:03:05.929 INFO:tasks.workunit.client.0.smithi049.stdout:7/811: dread d1/d1a/de7/f8d [4194304,4194304] 0 2024-09-19T09:03:05.930 INFO:tasks.workunit.client.0.smithi049.stdout:7/812: fdatasync d1/d1a/de7/f3b 0 2024-09-19T09:03:05.932 INFO:tasks.workunit.client.0.smithi049.stdout:7/813: write d1/d1a/de7/f8d [4509416,8013] 0 2024-09-19T09:03:05.932 INFO:tasks.workunit.client.0.smithi049.stdout:9/877: mkdir d3/d14/d34/d125 0 2024-09-19T09:03:05.937 INFO:tasks.workunit.client.0.smithi049.stdout:2/752: write d1/d2/d23/f8f [198395,72365] 0 2024-09-19T09:03:05.941 INFO:tasks.workunit.client.0.smithi049.stdout:4/506: rename d4/d34/d3d/d62/l7d to d4/d34/d3d/d4f/d6a/l96 0 2024-09-19T09:03:05.941 INFO:tasks.workunit.client.0.smithi049.stdout:4/507: chown d4/d34/d3d/d62 1015 1 2024-09-19T09:03:05.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/508: truncate d4/f5 4800470 0 2024-09-19T09:03:05.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/760: read d5/d10/d13/d30/f91 [131720,105303] 0 2024-09-19T09:03:05.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/753: rename d1/d4/d1e/d45/fab to d1/d4/d1e/d9f/db3/d41/d7d/f102 0 2024-09-19T09:03:05.951 INFO:tasks.workunit.client.0.smithi049.stdout:2/754: write d1/d4/d1e/d45/faa [5046156,54013] 0 2024-09-19T09:03:05.955 INFO:tasks.workunit.client.0.smithi049.stdout:4/509: creat d4/d15/d19/d1f/d55/f97 x:0 0 0 2024-09-19T09:03:05.958 INFO:tasks.workunit.client.0.smithi049.stdout:9/878: write d3/d14/d1a/d21/d31/d8e/dc2/d9e/fd2 [2956634,53062] 0 2024-09-19T09:03:05.961 INFO:tasks.workunit.client.0.smithi049.stdout:1/464: dwrite d5/d6/f7 [0,4194304] 0 2024-09-19T09:03:05.966 INFO:tasks.workunit.client.0.smithi049.stdout:4/510: rename d4/d15/d19/d1f/f5d to d4/d34/d3d/d62/f98 0 2024-09-19T09:03:05.967 INFO:tasks.workunit.client.0.smithi049.stdout:7/814: link d1/d8/f5e d1/d8/df2/f125 0 2024-09-19T09:03:05.969 INFO:tasks.workunit.client.0.smithi049.stdout:7/815: fsync d1/d1a/de7/d50/fde 0 2024-09-19T09:03:05.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/879: readlink d3/d14/d34/d9f/lf8 0 2024-09-19T09:03:05.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/761: dwrite d5/d10/d13/d15/d36/f3a [0,4194304] 0 2024-09-19T09:03:05.970 INFO:tasks.workunit.client.0.smithi049.stdout:2/755: write d1/d4/d1e/d21/d8c/f8e [1976317,101559] 0 2024-09-19T09:03:05.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/762: chown d5/d10/d13/d15/l1f 0 1 2024-09-19T09:03:05.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/609: getdents d10/d11/d27/d4f/d59 0 2024-09-19T09:03:05.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/756: stat d1/d4/d1e/d21/dae/de5 0 2024-09-19T09:03:05.975 INFO:tasks.workunit.client.0.smithi049.stdout:0/763: chown d5/d10/d13/d15/d29 639152 1 2024-09-19T09:03:05.976 INFO:tasks.workunit.client.0.smithi049.stdout:4/511: chown d4/d15/f65 22234115 1 2024-09-19T09:03:05.978 INFO:tasks.workunit.client.0.smithi049.stdout:9/880: fsync d3/d14/d1a/d90/fa6 0 2024-09-19T09:03:05.981 INFO:tasks.workunit.client.0.smithi049.stdout:2/757: creat d1/d4/d1e/d21/dae/f103 x:0 0 0 2024-09-19T09:03:05.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/758: write d1/d4/d20/fc6 [1921573,109004] 0 2024-09-19T09:03:05.985 INFO:tasks.workunit.client.0.smithi049.stdout:0/764: mknod d5/d10/d13/d30/d75/ce6 0 2024-09-19T09:03:05.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/512: fsync d4/f69 0 2024-09-19T09:03:05.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/465: write d5/d6/f6f [410065,66651] 0 2024-09-19T09:03:05.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/881: dwrite d3/d14/d34/d4c/fb4 [0,4194304] 0 2024-09-19T09:03:05.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/466: stat d5/d6/d82/c91 0 2024-09-19T09:03:05.989 INFO:tasks.workunit.client.0.smithi049.stdout:7/816: symlink d1/d8/d2d/d72/d11d/l126 0 2024-09-19T09:03:05.991 INFO:tasks.workunit.client.0.smithi049.stdout:9/882: readlink d3/dbb/dec/db1/ld5 0 2024-09-19T09:03:05.999 INFO:tasks.workunit.client.0.smithi049.stdout:3/610: dwrite d10/d3d/f6b [0,4194304] 0 2024-09-19T09:03:06.000 INFO:tasks.workunit.client.0.smithi049.stdout:0/765: creat d5/d10/d2f/fe7 x:0 0 0 2024-09-19T09:03:06.001 INFO:tasks.workunit.client.0.smithi049.stdout:4/513: creat d4/d6c/d74/f99 x:0 0 0 2024-09-19T09:03:06.003 INFO:tasks.workunit.client.0.smithi049.stdout:0/766: dread - d5/d10/d13/dc4/dcd/ddb/dde/fe2 zero size 2024-09-19T09:03:06.004 INFO:tasks.workunit.client.0.smithi049.stdout:0/767: fsync d5/d10/d13/d15/f1b 0 2024-09-19T09:03:06.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/817: rmdir d1/d8/d2d/d72/d11d 39 2024-09-19T09:03:06.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/514: unlink d4/f24 0 2024-09-19T09:03:06.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/818: mkdir d1/d1a/d127 0 2024-09-19T09:03:06.023 INFO:tasks.workunit.client.0.smithi049.stdout:9/883: link d3/d14/d1a/d21/d66/f8f d3/d14/d1a/d21/d31/d8e/dc2/d9e/f126 0 2024-09-19T09:03:06.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/515: dread d4/d15/f61 [0,4194304] 0 2024-09-19T09:03:06.024 INFO:tasks.workunit.client.0.smithi049.stdout:3/611: dread - d10/d11/d13/d7e/f85 zero size 2024-09-19T09:03:06.032 INFO:tasks.workunit.client.0.smithi049.stdout:3/612: chown d10/d3d/c4b 17 1 2024-09-19T09:03:06.033 INFO:tasks.workunit.client.0.smithi049.stdout:0/768: truncate d5/d10/d13/dc4/fc8 172316 0 2024-09-19T09:03:06.033 INFO:tasks.workunit.client.0.smithi049.stdout:9/884: mknod d3/d14/d1a/d21/d66/d10f/c127 0 2024-09-19T09:03:06.035 INFO:tasks.workunit.client.0.smithi049.stdout:9/885: write d3/d14/d1a/f80 [5907476,76158] 0 2024-09-19T09:03:06.035 INFO:tasks.workunit.client.0.smithi049.stdout:3/613: dread d10/d3d/d76/fb2 [0,4194304] 0 2024-09-19T09:03:06.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/467: getdents d5/d6/d19/d21/d52 0 2024-09-19T09:03:06.048 INFO:tasks.workunit.client.0.smithi049.stdout:9/886: readlink d3/d14/d1a/d21/d31/d8e/dc2/lc0 0 2024-09-19T09:03:06.051 INFO:tasks.workunit.client.0.smithi049.stdout:7/819: creat d1/d53/f128 x:0 0 0 2024-09-19T09:03:06.052 INFO:tasks.workunit.client.0.smithi049.stdout:7/820: stat d1/d1a/da0/dd3/c101 0 2024-09-19T09:03:06.052 INFO:tasks.workunit.client.0.smithi049.stdout:7/821: dread - d1/d53/f128 zero size 2024-09-19T09:03:06.053 INFO:tasks.workunit.client.0.smithi049.stdout:4/516: truncate d4/d15/d19/d1f/f71 621386 0 2024-09-19T09:03:06.056 INFO:tasks.workunit.client.0.smithi049.stdout:3/614: truncate d10/f5c 1809499 0 2024-09-19T09:03:06.059 INFO:tasks.workunit.client.0.smithi049.stdout:9/887: creat d3/d14/d1a/d21/d66/d10f/f128 x:0 0 0 2024-09-19T09:03:06.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/822: dwrite d1/d1a/de7/fe4 [0,4194304] 0 2024-09-19T09:03:06.061 INFO:tasks.workunit.client.0.smithi049.stdout:7/823: dread - d1/d53/f128 zero size 2024-09-19T09:03:06.064 INFO:tasks.workunit.client.0.smithi049.stdout:7/824: truncate d1/fc8 333397 0 2024-09-19T09:03:06.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/769: write d5/ff [4059490,2337] 0 2024-09-19T09:03:06.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/888: symlink d3/d14/d1a/d21/d31/d8e/df5/l129 0 2024-09-19T09:03:06.073 INFO:tasks.workunit.client.0.smithi049.stdout:4/517: write d4/d15/f20 [5086337,4320] 0 2024-09-19T09:03:06.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/770: rename d5/d10/d13/d15/c34 to d5/d10/d13/d15/d36/d3d/ce8 0 2024-09-19T09:03:06.077 INFO:tasks.workunit.client.0.smithi049.stdout:1/468: dwrite d5/d6/dc/f56 [0,4194304] 0 2024-09-19T09:03:06.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/771: read d5/d10/d13/f42 [2429041,98948] 0 2024-09-19T09:03:06.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/518: symlink d4/d15/d19/d1f/l9a 0 2024-09-19T09:03:06.089 INFO:tasks.workunit.client.0.smithi049.stdout:3/615: link d10/d11/d13/dbc/dcd/f93 d10/d3d/d51/fd6 0 2024-09-19T09:03:06.090 INFO:tasks.workunit.client.0.smithi049.stdout:3/616: stat d10/d3d/d79/fc6 0 2024-09-19T09:03:06.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/469: dread d5/d6/f1b [0,4194304] 0 2024-09-19T09:03:06.098 INFO:tasks.workunit.client.0.smithi049.stdout:1/470: dread d5/d6/d19/d21/f46 [0,4194304] 0 2024-09-19T09:03:06.098 INFO:tasks.workunit.client.0.smithi049.stdout:9/889: link d3/d14/d34/cd9 d3/d14/d34/d74/c12a 0 2024-09-19T09:03:06.104 INFO:tasks.workunit.client.0.smithi049.stdout:3/617: mkdir d10/d11/dd7 0 2024-09-19T09:03:06.106 INFO:tasks.workunit.client.0.smithi049.stdout:9/890: creat d3/d14/d1a/d21/d31/f12b x:0 0 0 2024-09-19T09:03:06.106 INFO:tasks.workunit.client.0.smithi049.stdout:7/825: write d1/d8/d2d/d72/d11d/d9c/ff3 [901510,52610] 0 2024-09-19T09:03:06.107 INFO:tasks.workunit.client.0.smithi049.stdout:7/826: chown d1/d8/dda 17727842 1 2024-09-19T09:03:06.109 INFO:tasks.workunit.client.0.smithi049.stdout:4/519: rename d4/f13 to d4/d34/d3d/d4f/d6a/f9b 0 2024-09-19T09:03:06.115 INFO:tasks.workunit.client.0.smithi049.stdout:4/520: creat d4/d15/d19/d1f/d55/d66/f9c x:0 0 0 2024-09-19T09:03:06.120 INFO:tasks.workunit.client.0.smithi049.stdout:3/618: dread d10/f34 [0,4194304] 0 2024-09-19T09:03:06.121 INFO:tasks.workunit.client.0.smithi049.stdout:9/891: mknod d3/d14/d1a/d21/d73/d105/c12c 0 2024-09-19T09:03:06.127 INFO:tasks.workunit.client.0.smithi049.stdout:7/827: getdents d1/d53 0 2024-09-19T09:03:06.131 INFO:tasks.workunit.client.0.smithi049.stdout:4/521: write d4/d15/d19/d1f/f71 [515906,53786] 0 2024-09-19T09:03:06.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/828: mknod d1/d53/c129 0 2024-09-19T09:03:06.137 INFO:tasks.workunit.client.0.smithi049.stdout:9/892: dread d3/d14/d34/d9f/f7e [0,4194304] 0 2024-09-19T09:03:06.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/619: dread d10/d11/d13/d30/f74 [0,4194304] 0 2024-09-19T09:03:06.147 INFO:tasks.workunit.client.0.smithi049.stdout:9/893: dread d3/d14/d1a/d21/d66/f101 [0,4194304] 0 2024-09-19T09:03:06.147 INFO:tasks.workunit.client.0.smithi049.stdout:7/829: link d1/d53/dc6/f64 d1/d8/d2d/d72/d11d/d9c/f12a 0 2024-09-19T09:03:06.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/620: truncate d10/d11/d27/f78 3927464 0 2024-09-19T09:03:06.159 INFO:tasks.workunit.client.0.smithi049.stdout:3/621: dread - d10/d11/d13/d30/f61 zero size 2024-09-19T09:03:06.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/622: write d10/d11/d27/f2c [2596973,129748] 0 2024-09-19T09:03:06.164 INFO:tasks.workunit.client.0.smithi049.stdout:9/894: dread d3/d14/d34/d9f/f81 [0,4194304] 0 2024-09-19T09:03:06.166 INFO:tasks.workunit.client.0.smithi049.stdout:7/830: dread d1/d8/d2d/d36/d91/fb5 [0,4194304] 0 2024-09-19T09:03:06.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/895: mkdir d3/d14/d34/d44/d12d 0 2024-09-19T09:03:06.168 INFO:tasks.workunit.client.0.smithi049.stdout:7/831: mknod d1/d53/dc6/c12b 0 2024-09-19T09:03:06.168 INFO:tasks.workunit.client.0.smithi049.stdout:9/896: truncate d3/d14/f92 1260650 0 2024-09-19T09:03:06.173 INFO:tasks.workunit.client.0.smithi049.stdout:7/832: creat d1/d8/d2d/d72/f12c x:0 0 0 2024-09-19T09:03:06.175 INFO:tasks.workunit.client.0.smithi049.stdout:7/833: creat d1/d1a/de7/d50/daa/f12d x:0 0 0 2024-09-19T09:03:06.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/897: link d3/d14/d34/d4c/d9c/l110 d3/d14/d1a/d21/d67/d94/l12e 0 2024-09-19T09:03:06.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/898: rename d3/dbb/dec/dd0/dd4 to d3/d14/d1a/d21/d73/d12f 0 2024-09-19T09:03:06.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/834: dread d1/d53/dc6/f14 [0,4194304] 0 2024-09-19T09:03:06.189 INFO:tasks.workunit.client.0.smithi049.stdout:9/899: mkdir d3/d130 0 2024-09-19T09:03:06.191 INFO:tasks.workunit.client.0.smithi049.stdout:9/900: write d3/d14/d1a/d21/d66/fc6 [1085144,53830] 0 2024-09-19T09:03:06.194 INFO:tasks.workunit.client.0.smithi049.stdout:7/835: dread d1/d53/dc6/f4c [0,4194304] 0 2024-09-19T09:03:06.199 INFO:tasks.workunit.client.0.smithi049.stdout:9/901: symlink d3/d14/d1a/l131 0 2024-09-19T09:03:06.199 INFO:tasks.workunit.client.0.smithi049.stdout:7/836: stat d1/d1a 0 2024-09-19T09:03:06.200 INFO:tasks.workunit.client.0.smithi049.stdout:9/902: read d3/d14/d34/d4c/fb4 [2473713,75615] 0 2024-09-19T09:03:06.201 INFO:tasks.workunit.client.0.smithi049.stdout:7/837: chown d1/d8/d2d/d31/d6e/dfe/d10a/f10d 1412877149 1 2024-09-19T09:03:06.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/903: rmdir d3/dbb/dec 39 2024-09-19T09:03:06.214 INFO:tasks.workunit.client.0.smithi049.stdout:9/904: rmdir d3/d14/d34/d4c/d9c 39 2024-09-19T09:03:06.228 INFO:tasks.workunit.client.0.smithi049.stdout:9/905: dread d3/d14/d1a/d21/d67/d94/f5b [0,4194304] 0 2024-09-19T09:03:06.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/838: truncate d1/d8/d2d/d72/d11d/f107 125615 0 2024-09-19T09:03:06.232 INFO:tasks.workunit.client.0.smithi049.stdout:7/839: mknod d1/d1a/c12e 0 2024-09-19T09:03:06.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/906: link d3/d14/d34/d4c/d9c/fbd d3/d14/d34/d125/f132 0 2024-09-19T09:03:06.243 INFO:tasks.workunit.client.0.smithi049.stdout:9/907: readlink d3/dbb/lc7 0 2024-09-19T09:03:06.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/840: dwrite d1/d8/f1c [0,4194304] 0 2024-09-19T09:03:06.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/908: truncate d3/d14/d34/f88 1294344 0 2024-09-19T09:03:06.259 INFO:tasks.workunit.client.0.smithi049.stdout:7/841: creat d1/d8/d2d/d31/d6e/f12f x:0 0 0 2024-09-19T09:03:06.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/909: read d3/d14/f92 [820832,67198] 0 2024-09-19T09:03:06.262 INFO:tasks.workunit.client.0.smithi049.stdout:7/842: rmdir d1/d8/d2d/dd9 39 2024-09-19T09:03:06.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/910: chown d3/d14/d1a/d21/d31/d8e/la8 67131839 1 2024-09-19T09:03:06.270 INFO:tasks.workunit.client.0.smithi049.stdout:7/843: dwrite d1/d8/d2d/d31/d6e/f12f [0,4194304] 0 2024-09-19T09:03:06.289 INFO:tasks.workunit.client.0.smithi049.stdout:9/911: dwrite d3/f28 [0,4194304] 0 2024-09-19T09:03:06.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/912: truncate d3/d14/d34/f56 780506 0 2024-09-19T09:03:06.299 INFO:tasks.workunit.client.0.smithi049.stdout:9/913: truncate d3/d14/f1e 6089927 0 2024-09-19T09:03:06.314 INFO:tasks.workunit.client.0.smithi049.stdout:9/914: dread d3/d14/d1a/d21/d67/d94/f7c [0,4194304] 0 2024-09-19T09:03:06.315 INFO:tasks.workunit.client.0.smithi049.stdout:9/915: chown d3/l4 2050747 1 2024-09-19T09:03:06.317 INFO:tasks.workunit.client.0.smithi049.stdout:9/916: read d3/d14/d34/d74/f87 [401940,34161] 0 2024-09-19T09:03:06.323 INFO:tasks.workunit.client.0.smithi049.stdout:9/917: dwrite d3/d14/d1a/d21/d67/f10a [0,4194304] 0 2024-09-19T09:03:06.328 INFO:tasks.workunit.client.0.smithi049.stdout:9/918: creat d3/d14/d1a/d21/f133 x:0 0 0 2024-09-19T09:03:06.330 INFO:tasks.workunit.client.0.smithi049.stdout:9/919: chown d3/dbb/dec/dd0/ldc 17410576 1 2024-09-19T09:03:06.336 INFO:tasks.workunit.client.0.smithi049.stdout:9/920: dwrite d3/d14/d1a/d21/d31/d8e/df5/f124 [0,4194304] 0 2024-09-19T09:03:06.340 INFO:tasks.workunit.client.0.smithi049.stdout:9/921: rename d3/c27 to d3/d14/d34/d74/c134 0 2024-09-19T09:03:06.344 INFO:tasks.workunit.client.0.smithi049.stdout:9/922: creat d3/d14/d34/f135 x:0 0 0 2024-09-19T09:03:06.360 INFO:tasks.workunit.client.0.smithi049.stdout:9/923: dread d3/d14/d1a/d21/d31/d8e/f3e [0,4194304] 0 2024-09-19T09:03:06.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/924: write d3/d14/f92 [369970,126321] 0 2024-09-19T09:03:06.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/925: fdatasync d3/d14/d1a/d21/d73/d105/f11f 0 2024-09-19T09:03:06.378 INFO:tasks.workunit.client.0.smithi049.stdout:9/926: mkdir d3/d14/d1a/d21/d73/db8/dc5/d136 0 2024-09-19T09:03:06.381 INFO:tasks.workunit.client.0.smithi049.stdout:9/927: rename d3/d14/le7 to d3/dbb/dec/db1/d120/l137 0 2024-09-19T09:03:06.382 INFO:tasks.workunit.client.0.smithi049.stdout:9/928: fdatasync d3/d14/d1a/d21/d67/fd7 0 2024-09-19T09:03:06.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/929: symlink d3/d14/d1a/d21/d31/d8e/l138 0 2024-09-19T09:03:06.391 INFO:tasks.workunit.client.0.smithi049.stdout:9/930: dwrite d3/d14/f92 [0,4194304] 0 2024-09-19T09:03:06.395 INFO:tasks.workunit.client.0.smithi049.stdout:9/931: mknod d3/d14/d34/d9f/d117/c139 0 2024-09-19T09:03:06.398 INFO:tasks.workunit.client.0.smithi049.stdout:9/932: fdatasync d3/d14/d1a/d21/d67/d94/fde 0 2024-09-19T09:03:06.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/933: creat d3/d14/d1a/d21/d66/d10f/f13a x:0 0 0 2024-09-19T09:03:06.404 INFO:tasks.workunit.client.0.smithi049.stdout:9/934: creat d3/f13b x:0 0 0 2024-09-19T09:03:06.407 INFO:tasks.workunit.client.0.smithi049.stdout:9/935: chown d3/d14/d1a/d21/c45 195 1 2024-09-19T09:03:06.409 INFO:tasks.workunit.client.0.smithi049.stdout:9/936: truncate d3/d14/d1a/d21/d66/d10f/f13a 236777 0 2024-09-19T09:03:06.410 INFO:tasks.workunit.client.0.smithi049.stdout:9/937: write d3/d14/d34/d44/f4b [3650764,79369] 0 2024-09-19T09:03:06.412 INFO:tasks.workunit.client.0.smithi049.stdout:9/938: symlink d3/d14/l13c 0 2024-09-19T09:03:06.415 INFO:tasks.workunit.client.0.smithi049.stdout:9/939: creat d3/d14/d34/d4c/d9c/f13d x:0 0 0 2024-09-19T09:03:06.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/940: getdents d3/d14/d1a 0 2024-09-19T09:03:06.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/941: write d3/d14/d1a/f25 [7020894,24392] 0 2024-09-19T09:03:06.423 INFO:tasks.workunit.client.0.smithi049.stdout:9/942: creat d3/d14/d34/d4c/d9c/f13e x:0 0 0 2024-09-19T09:03:06.423 INFO:tasks.workunit.client.0.smithi049.stdout:9/943: truncate d3/f13b 796611 0 2024-09-19T09:03:06.425 INFO:tasks.workunit.client.0.smithi049.stdout:9/944: unlink d3/d14/d34/c40 0 2024-09-19T09:03:06.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/945: truncate d3/d14/f92 5150394 0 2024-09-19T09:03:06.438 INFO:tasks.workunit.client.0.smithi049.stdout:9/946: rmdir d3/d14/d34 39 2024-09-19T09:03:06.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/947: dread d3/d14/d1a/d21/d31/d8e/fab [0,4194304] 0 2024-09-19T09:03:06.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/948: stat d3/d14/d1a/d21/d66 0 2024-09-19T09:03:06.454 INFO:tasks.workunit.client.0.smithi049.stdout:9/949: truncate d3/d14/d1a/d21/d66/f111 896600 0 2024-09-19T09:03:06.461 INFO:tasks.workunit.client.0.smithi049.stdout:9/950: dwrite d3/d14/d34/d4c/d9c/f13e [0,4194304] 0 2024-09-19T09:03:06.463 INFO:tasks.workunit.client.0.smithi049.stdout:9/951: mkdir d3/d14/d1a/d21/d67/d94/d13f 0 2024-09-19T09:03:06.466 INFO:tasks.workunit.client.0.smithi049.stdout:9/952: write d3/d14/d1a/d21/d31/d8e/dc2/d9e/fd2 [2353273,102979] 0 2024-09-19T09:03:06.467 INFO:tasks.workunit.client.0.smithi049.stdout:9/953: readlink d3/d14/d1a/d21/d67/ld6 0 2024-09-19T09:03:06.471 INFO:tasks.workunit.client.0.smithi049.stdout:9/954: unlink d3/dbb/dec/db1/de4/cfe 0 2024-09-19T09:03:06.478 INFO:tasks.workunit.client.0.smithi049.stdout:9/955: dwrite d3/d14/d34/d9f/f98 [0,4194304] 0 2024-09-19T09:03:06.491 INFO:tasks.workunit.client.0.smithi049.stdout:9/956: truncate d3/d14/d1a/d21/d67/fed 1866378 0 2024-09-19T09:03:06.503 INFO:tasks.workunit.client.0.smithi049.stdout:9/957: dwrite d3/d14/d34/d125/f132 [0,4194304] 0 2024-09-19T09:03:06.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/958: creat d3/dbb/dec/dd0/ddd/f140 x:0 0 0 2024-09-19T09:03:06.511 INFO:tasks.workunit.client.0.smithi049.stdout:9/959: mkdir d3/d14/d1a/d21/d73/db8/dc5/d141 0 2024-09-19T09:03:06.514 INFO:tasks.workunit.client.0.smithi049.stdout:9/960: rename d3/d14/d1a/d21/d73/d105/l113 to d3/d14/d1a/d21/d67/d94/d13f/l142 0 2024-09-19T09:03:06.521 INFO:tasks.workunit.client.0.smithi049.stdout:9/961: dwrite d3/d14/d1a/d21/d31/fb6 [0,4194304] 0 2024-09-19T09:03:06.522 INFO:tasks.workunit.client.0.smithi049.stdout:9/962: chown d3/d14/d1a/d90/cbf 239884 1 2024-09-19T09:03:06.533 INFO:tasks.workunit.client.0.smithi049.stdout:9/963: link d3/d14/c2e d3/d14/d1a/d21/d73/db8/dc5/d136/c143 0 2024-09-19T09:03:06.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/964: write d3/d14/d1a/d21/d67/f10a [2366987,1031] 0 2024-09-19T09:03:06.538 INFO:tasks.workunit.client.0.smithi049.stdout:9/965: mkdir d3/dbb/dec/dd0/d144 0 2024-09-19T09:03:06.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/966: dread d3/d14/d1a/d21/d67/fd7 [0,4194304] 0 2024-09-19T09:03:06.546 INFO:tasks.workunit.client.0.smithi049.stdout:9/967: unlink d3/c5a 0 2024-09-19T09:03:06.550 INFO:tasks.workunit.client.0.smithi049.stdout:9/968: getdents d3/dbb/dec/db1/de4 0 2024-09-19T09:03:06.552 INFO:tasks.workunit.client.0.smithi049.stdout:9/969: creat d3/d14/d1a/d21/d67/d94/f145 x:0 0 0 2024-09-19T09:03:06.554 INFO:tasks.workunit.client.0.smithi049.stdout:9/970: mkdir d3/d14/d34/d9f/d146 0 2024-09-19T09:03:06.556 INFO:tasks.workunit.client.0.smithi049.stdout:9/971: unlink d3/d14/d1a/d21/d67/ce5 0 2024-09-19T09:03:06.558 INFO:tasks.workunit.client.0.smithi049.stdout:9/972: mkdir d3/d14/d34/d125/d147 0 2024-09-19T09:03:06.580 INFO:tasks.workunit.client.0.smithi049.stdout:6/479: sync 2024-09-19T09:03:06.582 INFO:tasks.workunit.client.0.smithi049.stdout:6/480: write dc/d16/f3d [1131272,95763] 0 2024-09-19T09:03:06.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/973: dwrite d3/d14/d34/d44/f6a [0,4194304] 0 2024-09-19T09:03:06.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/481: fsync dc/d1b/d20/d2f/d6b/f89 0 2024-09-19T09:03:06.585 INFO:tasks.workunit.client.0.smithi049.stdout:9/974: dread - d3/d14/d34/d4c/d9c/f13d zero size 2024-09-19T09:03:06.588 INFO:tasks.workunit.client.0.smithi049.stdout:6/482: read f3 [1896229,17679] 0 2024-09-19T09:03:06.592 INFO:tasks.workunit.client.0.smithi049.stdout:9/975: link d3/d14/d34/d74/f99 d3/d14/d34/f148 0 2024-09-19T09:03:06.598 INFO:tasks.workunit.client.0.smithi049.stdout:9/976: dread d3/d14/d34/d9f/fef [0,4194304] 0 2024-09-19T09:03:06.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/977: readlink d3/l3b 0 2024-09-19T09:03:06.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/978: truncate d3/d14/d1a/d90/f71 2667334 0 2024-09-19T09:03:06.608 INFO:tasks.workunit.client.0.smithi049.stdout:6/483: dread f3 [0,4194304] 0 2024-09-19T09:03:06.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/979: write d3/d14/d1a/d21/d31/d8e/dc2/fea [522663,34153] 0 2024-09-19T09:03:06.609 INFO:tasks.workunit.client.0.smithi049.stdout:6/484: chown dc/l35 482677 1 2024-09-19T09:03:06.612 INFO:tasks.workunit.client.0.smithi049.stdout:6/485: rmdir dc/d1b/d20/d2f/d53 39 2024-09-19T09:03:06.613 INFO:tasks.workunit.client.0.smithi049.stdout:6/486: chown dc/d1b/d20/d2f/d31/f65 51784529 1 2024-09-19T09:03:06.615 INFO:tasks.workunit.client.0.smithi049.stdout:6/487: creat dc/d1b/d6f/f96 x:0 0 0 2024-09-19T09:03:06.621 INFO:tasks.workunit.client.0.smithi049.stdout:6/488: dwrite dc/d16/d88/f8e [0,4194304] 0 2024-09-19T09:03:06.638 INFO:tasks.workunit.client.0.smithi049.stdout:9/980: truncate d3/d14/d1a/d21/d67/d94/f122 1614065 0 2024-09-19T09:03:06.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/981: stat d3/dbb/dec/l86 0 2024-09-19T09:03:06.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/982: rmdir d3/dbb 39 2024-09-19T09:03:06.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/983: dread - d3/d14/d34/f135 zero size 2024-09-19T09:03:06.648 INFO:tasks.workunit.client.0.smithi049.stdout:6/489: write dc/d1b/d20/d2f/f66 [1334765,88515] 0 2024-09-19T09:03:06.654 INFO:tasks.workunit.client.0.smithi049.stdout:6/490: symlink dc/d1b/d20/d2f/d4c/l97 0 2024-09-19T09:03:06.656 INFO:tasks.workunit.client.0.smithi049.stdout:9/984: rename d3/d14/d1a/d21/d66/f8f to d3/dbb/dec/db1/de4/f149 0 2024-09-19T09:03:06.670 INFO:tasks.workunit.client.0.smithi049.stdout:9/985: write d3/d14/d1a/d21/d31/f57 [1031387,97060] 0 2024-09-19T09:03:06.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/986: symlink d3/dbb/dec/dd0/d144/l14a 0 2024-09-19T09:03:06.679 INFO:tasks.workunit.client.0.smithi049.stdout:9/987: mknod d3/d14/d34/d4c/c14b 0 2024-09-19T09:03:06.681 INFO:tasks.workunit.client.0.smithi049.stdout:9/988: write d3/d14/d34/d9f/f119 [451244,27782] 0 2024-09-19T09:03:06.688 INFO:tasks.workunit.client.0.smithi049.stdout:6/491: dread dc/d1b/d20/d2f/d31/f5d [0,4194304] 0 2024-09-19T09:03:06.694 INFO:tasks.workunit.client.0.smithi049.stdout:9/989: link d3/d14/d34/cd9 d3/d14/d34/d9f/d117/c14c 0 2024-09-19T09:03:06.694 INFO:tasks.workunit.client.0.smithi049.stdout:6/492: truncate dc/d1b/d20/d2f/d53/f95 212479 0 2024-09-19T09:03:06.701 INFO:tasks.workunit.client.0.smithi049.stdout:6/493: dread dc/d1b/d20/d81/f27 [0,4194304] 0 2024-09-19T09:03:06.701 INFO:tasks.workunit.client.0.smithi049.stdout:9/990: dwrite d3/d14/d1a/f80 [0,4194304] 0 2024-09-19T09:03:06.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/494: symlink dc/d1b/l98 0 2024-09-19T09:03:06.728 INFO:tasks.workunit.client.0.smithi049.stdout:9/991: write d3/d14/d1a/d90/f71 [2796026,118493] 0 2024-09-19T09:03:06.731 INFO:tasks.workunit.client.0.smithi049.stdout:6/495: rmdir dc/d1b/d20/d81/d5a 39 2024-09-19T09:03:06.740 INFO:tasks.workunit.client.0.smithi049.stdout:9/992: dwrite d3/d14/d1a/d21/fb5 [4194304,4194304] 0 2024-09-19T09:03:06.744 INFO:tasks.workunit.client.0.smithi049.stdout:6/496: dwrite dc/d1b/d20/d2f/d53/f95 [0,4194304] 0 2024-09-19T09:03:06.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/993: fdatasync d3/d14/d1a/d21/d31/d8e/df5/f124 0 2024-09-19T09:03:06.754 INFO:tasks.workunit.client.0.smithi049.stdout:6/497: symlink dc/l99 0 2024-09-19T09:03:06.756 INFO:tasks.workunit.client.0.smithi049.stdout:6/498: write dc/d16/f3b [4511089,78348] 0 2024-09-19T09:03:06.757 INFO:tasks.workunit.client.0.smithi049.stdout:6/499: readlink dc/d1b/d20/d2f/d4c/l97 0 2024-09-19T09:03:06.761 INFO:tasks.workunit.client.0.smithi049.stdout:9/994: write d3/d14/d34/d9f/f76 [832531,76418] 0 2024-09-19T09:03:06.765 INFO:tasks.workunit.client.0.smithi049.stdout:6/500: dwrite dc/d1b/d78/f7c [0,4194304] 0 2024-09-19T09:03:06.767 INFO:tasks.workunit.client.0.smithi049.stdout:9/995: rename d3/d14/l13c to d3/d14/d1a/d21/d66/l14d 0 2024-09-19T09:03:06.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/501: rename dc/d1b/f5b to dc/d1b/d20/d81/d5a/f9a 0 2024-09-19T09:03:06.922 INFO:tasks.workunit.client.0.smithi049.stdout:9/996: rmdir d3/dbb/dec/db1/d120 39 2024-09-19T09:03:06.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/997: dread d3/d14/d1a/d21/d31/d8e/df5/f124 [0,4194304] 0 2024-09-19T09:03:06.927 INFO:tasks.workunit.client.0.smithi049.stdout:9/998: chown d3/d14/d1a/d90 911582 1 2024-09-19T09:03:06.928 INFO:tasks.workunit.client.0.smithi049.stdout:9/999: chown d3/d14/d1a/d21/d31/d8e/df5/l129 473950871 1 2024-09-19T09:03:06.930 INFO:tasks.workunit.client.0.smithi049.stdout:6/502: mknod dc/d1b/d20/d2f/d6b/d73/c9b 0 2024-09-19T09:03:06.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/503: dread f9 [0,4194304] 0 2024-09-19T09:03:06.945 INFO:tasks.workunit.client.0.smithi049.stdout:6/504: fdatasync dc/d1b/d20/d2f/d6b/d73/f82 0 2024-09-19T09:03:06.948 INFO:tasks.workunit.client.0.smithi049.stdout:6/505: symlink dc/d1b/d20/l9c 0 2024-09-19T09:03:06.950 INFO:tasks.workunit.client.0.smithi049.stdout:6/506: stat dc/d1b/d20/f6c 0 2024-09-19T09:03:06.952 INFO:tasks.workunit.client.0.smithi049.stdout:6/507: write dc/d16/f70 [1956465,100888] 0 2024-09-19T09:03:06.954 INFO:tasks.workunit.client.0.smithi049.stdout:6/508: mknod dc/d1b/d20/d81/c9d 0 2024-09-19T09:03:06.955 INFO:tasks.workunit.client.0.smithi049.stdout:6/509: stat dc/d1b/d20/d2f/d31/f65 0 2024-09-19T09:03:06.958 INFO:tasks.workunit.client.0.smithi049.stdout:6/510: mknod dc/d1b/d20/d81/c9e 0 2024-09-19T09:03:06.959 INFO:tasks.workunit.client.0.smithi049.stdout:6/511: fdatasync dc/d1b/d20/d81/f27 0 2024-09-19T09:03:06.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/512: write dc/d1b/d20/d2f/d31/f65 [2470429,34682] 0 2024-09-19T09:03:06.962 INFO:tasks.workunit.client.0.smithi049.stdout:6/513: rmdir dc 39 2024-09-19T09:03:06.963 INFO:tasks.workunit.client.0.smithi049.stdout:6/514: fsync dc/d1b/d20/d2f/d53/f8a 0 2024-09-19T09:03:06.964 INFO:tasks.workunit.client.0.smithi049.stdout:6/515: write dc/d1b/d20/d81/f4d [7514150,111220] 0 2024-09-19T09:03:06.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/516: readlink dc/l35 0 2024-09-19T09:03:06.968 INFO:tasks.workunit.client.0.smithi049.stdout:6/517: creat dc/d1b/d20/d81/d5a/f9f x:0 0 0 2024-09-19T09:03:06.969 INFO:tasks.workunit.client.0.smithi049.stdout:6/518: write dc/d1b/d20/d2f/d31/f69 [1196782,104783] 0 2024-09-19T09:03:06.971 INFO:tasks.workunit.client.0.smithi049.stdout:6/519: symlink dc/d1b/d20/d7f/la0 0 2024-09-19T09:03:07.065 INFO:tasks.workunit.client.0.smithi049.stdout:8/694: sync 2024-09-19T09:03:07.068 INFO:tasks.workunit.client.0.smithi049.stdout:8/695: getdents d1/d1a/db0 0 2024-09-19T09:03:07.070 INFO:tasks.workunit.client.0.smithi049.stdout:8/696: mknod d1/d11/d45/cd2 0 2024-09-19T09:03:07.073 INFO:tasks.workunit.client.0.smithi049.stdout:8/697: mkdir d1/d11/d2e/dd3 0 2024-09-19T09:03:07.074 INFO:tasks.workunit.client.0.smithi049.stdout:8/698: truncate d1/d11/fc0 373952 0 2024-09-19T09:03:07.075 INFO:tasks.workunit.client.0.smithi049.stdout:8/699: read d1/d11/d4f/d87/d5d/dcb/d5b/fa8 [143423,79645] 0 2024-09-19T09:03:07.077 INFO:tasks.workunit.client.0.smithi049.stdout:8/700: creat d1/d11/d4f/d87/d5d/d65/fd4 x:0 0 0 2024-09-19T09:03:07.078 INFO:tasks.workunit.client.0.smithi049.stdout:8/701: write d1/d11/d4f/d87/d5d/d65/f7e [7411306,25373] 0 2024-09-19T09:03:07.081 INFO:tasks.workunit.client.0.smithi049.stdout:8/702: mkdir d1/d1a/db0/dd5 0 2024-09-19T09:03:07.092 INFO:tasks.workunit.client.0.smithi049.stdout:8/703: dread d1/d27/f79 [0,4194304] 0 2024-09-19T09:03:07.098 INFO:tasks.workunit.client.0.smithi049.stdout:8/704: dwrite d1/d11/d4f/d87/d5d/dcb/d8c/fcc [0,4194304] 0 2024-09-19T09:03:07.100 INFO:tasks.workunit.client.0.smithi049.stdout:8/705: chown d1/d11/d2e/d4e/cab 7190937 1 2024-09-19T09:03:07.101 INFO:tasks.workunit.client.0.smithi049.stdout:8/706: fsync d1/d11/d2e/d4e/d61/d9f/fb4 0 2024-09-19T09:03:07.103 INFO:tasks.workunit.client.0.smithi049.stdout:8/707: creat d1/d11/d4f/d87/d5d/dcb/d5b/fd6 x:0 0 0 2024-09-19T09:03:07.105 INFO:tasks.workunit.client.0.smithi049.stdout:8/708: creat d1/d11/d2e/d4e/d61/fd7 x:0 0 0 2024-09-19T09:03:07.107 INFO:tasks.workunit.client.0.smithi049.stdout:8/709: dread d1/d11/d45/fa1 [0,4194304] 0 2024-09-19T09:03:07.108 INFO:tasks.workunit.client.0.smithi049.stdout:8/710: chown d1/d27/f60 221901 1 2024-09-19T09:03:07.112 INFO:tasks.workunit.client.0.smithi049.stdout:8/711: dread d1/d11/f74 [0,4194304] 0 2024-09-19T09:03:07.183 INFO:tasks.workunit.client.0.smithi049.stdout:8/712: unlink d1/d11/d4f/la6 0 2024-09-19T09:03:07.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/713: fsync d1/d27/fc6 0 2024-09-19T09:03:07.186 INFO:tasks.workunit.client.0.smithi049.stdout:8/714: write d1/d11/d4f/d87/d5d/d65/fcd [858433,52657] 0 2024-09-19T09:03:07.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/715: dread d1/d27/f35 [4194304,4194304] 0 2024-09-19T09:03:07.192 INFO:tasks.workunit.client.0.smithi049.stdout:8/716: getdents d1/d1a/db0/dd5 0 2024-09-19T09:03:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:8/717: dwrite d1/d11/d4f/d87/d5d/d65/f7e [0,4194304] 0 2024-09-19T09:03:07.226 INFO:tasks.workunit.client.0.smithi049.stdout:8/718: dread d1/d11/d4f/d87/d5d/dcb/d5b/fb9 [0,4194304] 0 2024-09-19T09:03:07.227 INFO:tasks.workunit.client.0.smithi049.stdout:8/719: write d1/d11/fc0 [1020450,111766] 0 2024-09-19T09:03:07.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/615: sync 2024-09-19T09:03:07.238 INFO:tasks.workunit.client.0.smithi049.stdout:5/616: mkdir d3/d5/de/d4a/dbd 0 2024-09-19T09:03:07.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/617: rename d3/f78 to d3/fbe 0 2024-09-19T09:03:07.244 INFO:tasks.workunit.client.0.smithi049.stdout:5/618: mkdir d3/d5/d1c/d3a/d8f/dbf 0 2024-09-19T09:03:07.245 INFO:tasks.workunit.client.0.smithi049.stdout:5/619: chown d3/d5/d1c/d3a/d8f/lb0 3003718 1 2024-09-19T09:03:07.248 INFO:tasks.workunit.client.0.smithi049.stdout:5/620: truncate d3/d5/d20/d38/d5a/fa9 1116893 0 2024-09-19T09:03:07.248 INFO:tasks.workunit.client.0.smithi049.stdout:5/621: read - d3/d5/d1c/d3a/d8f/fac zero size 2024-09-19T09:03:07.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/622: write d3/d5/de/f23 [621928,98346] 0 2024-09-19T09:03:07.251 INFO:tasks.workunit.client.0.smithi049.stdout:5/623: chown d3/d5/d20/d57/d72/fa7 80 1 2024-09-19T09:03:07.252 INFO:tasks.workunit.client.0.smithi049.stdout:5/624: read - d3/d5/d20/d57/f95 zero size 2024-09-19T09:03:07.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/625: write d3/d6c/f85 [59958,42212] 0 2024-09-19T09:03:07.258 INFO:tasks.workunit.client.0.smithi049.stdout:5/626: creat d3/d5/d1c/d3a/d8f/dbf/fc0 x:0 0 0 2024-09-19T09:03:07.258 INFO:tasks.workunit.client.0.smithi049.stdout:8/720: write d1/d11/f4d [3834552,48304] 0 2024-09-19T09:03:07.259 INFO:tasks.workunit.client.0.smithi049.stdout:8/721: chown d1/d11/l2f 5616 1 2024-09-19T09:03:07.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/627: chown d3/d5/de/l39 55 1 2024-09-19T09:03:07.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/722: mkdir d1/d11/d2e/d4e/d82/dd8 0 2024-09-19T09:03:07.269 INFO:tasks.workunit.client.0.smithi049.stdout:8/723: getdents d1 0 2024-09-19T09:03:07.269 INFO:tasks.workunit.client.0.smithi049.stdout:8/724: chown d1/d1a 8482 1 2024-09-19T09:03:07.275 INFO:tasks.workunit.client.0.smithi049.stdout:8/725: write d1/d11/d4f/d87/d7a/f80 [285144,109983] 0 2024-09-19T09:03:07.276 INFO:tasks.workunit.client.0.smithi049.stdout:5/628: dwrite d3/d5/d1c/f2b [0,4194304] 0 2024-09-19T09:03:07.277 INFO:tasks.workunit.client.0.smithi049.stdout:8/726: stat d1/d11/d4f/d87/l97 0 2024-09-19T09:03:07.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/727: fsync d1/d11/d2e/d4e/d61/d9f/fc4 0 2024-09-19T09:03:07.281 INFO:tasks.workunit.client.0.smithi049.stdout:8/728: creat d1/d11/d4f/d87/d5d/dcb/fd9 x:0 0 0 2024-09-19T09:03:07.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/629: creat d3/dc/fc1 x:0 0 0 2024-09-19T09:03:07.283 INFO:tasks.workunit.client.0.smithi049.stdout:2/759: sync 2024-09-19T09:03:07.284 INFO:tasks.workunit.client.0.smithi049.stdout:0/772: sync 2024-09-19T09:03:07.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/471: sync 2024-09-19T09:03:07.285 INFO:tasks.workunit.client.0.smithi049.stdout:2/760: fdatasync d1/d4/d20/fc6 0 2024-09-19T09:03:07.287 INFO:tasks.workunit.client.0.smithi049.stdout:5/630: mknod d3/d5/d20/d38/d9c/cc2 0 2024-09-19T09:03:07.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/729: rmdir d1/d11/d4f 39 2024-09-19T09:03:07.288 INFO:tasks.workunit.client.0.smithi049.stdout:5/631: write d3/dc/faf [88730,29218] 0 2024-09-19T09:03:07.289 INFO:tasks.workunit.client.0.smithi049.stdout:8/730: dread - d1/d11/d2e/d4e/d61/d9f/fc4 zero size 2024-09-19T09:03:07.291 INFO:tasks.workunit.client.0.smithi049.stdout:1/472: mknod d5/d6/dc/c9a 0 2024-09-19T09:03:07.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/761: dread d1/d4/d1e/d9f/db3/f93 [0,4194304] 0 2024-09-19T09:03:07.294 INFO:tasks.workunit.client.0.smithi049.stdout:5/632: creat d3/d5/d1c/d2d/fc3 x:0 0 0 2024-09-19T09:03:07.295 INFO:tasks.workunit.client.0.smithi049.stdout:5/633: fdatasync d3/d5/d20/d38/f46 0 2024-09-19T09:03:07.296 INFO:tasks.workunit.client.0.smithi049.stdout:8/731: unlink d1/d11/d2e/c4c 0 2024-09-19T09:03:07.297 INFO:tasks.workunit.client.0.smithi049.stdout:8/732: write d1/f78 [4771803,130281] 0 2024-09-19T09:03:07.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/762: mknod d1/d4/d20/dc7/c104 0 2024-09-19T09:03:07.301 INFO:tasks.workunit.client.0.smithi049.stdout:1/473: symlink d5/d6/d19/d21/d52/d94/l9b 0 2024-09-19T09:03:07.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:07 smithi049 ceph-mon[28158]: pgmap v40: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 102 MiB/s wr, 273 op/s 2024-09-19T09:03:07.302 INFO:tasks.workunit.client.0.smithi049.stdout:8/733: mkdir d1/d11/d2e/d4e/d61/d9f/dda 0 2024-09-19T09:03:07.303 INFO:tasks.workunit.client.0.smithi049.stdout:2/763: mknod d1/d4/d1e/d9f/db3/d41/c105 0 2024-09-19T09:03:07.305 INFO:tasks.workunit.client.0.smithi049.stdout:5/634: mkdir d3/dc/dc4 0 2024-09-19T09:03:07.306 INFO:tasks.workunit.client.0.smithi049.stdout:5/635: stat d3/d5/d20/d57/c94 0 2024-09-19T09:03:07.313 INFO:tasks.workunit.client.0.smithi049.stdout:5/636: mknod d3/d5/d1c/d3a/d8f/cc5 0 2024-09-19T09:03:07.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/773: link d5/d10/d82/cb7 d5/d10/d13/d15/ce9 0 2024-09-19T09:03:07.315 INFO:tasks.workunit.client.0.smithi049.stdout:1/474: symlink d5/d6/d8/d13/d24/l9c 0 2024-09-19T09:03:07.317 INFO:tasks.workunit.client.0.smithi049.stdout:8/734: creat d1/d11/d4f/fdb x:0 0 0 2024-09-19T09:03:07.317 INFO:tasks.workunit.client.0.smithi049.stdout:1/475: stat d5/d6/d8/d13/d24/l9c 0 2024-09-19T09:03:07.318 INFO:tasks.workunit.client.0.smithi049.stdout:0/774: mknod d5/d10/d82/d67/cea 0 2024-09-19T09:03:07.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/764: dread d1/d2/d23/f2c [4194304,4194304] 0 2024-09-19T09:03:07.321 INFO:tasks.workunit.client.0.smithi049.stdout:8/735: fsync d1/d11/d45/fa1 0 2024-09-19T09:03:07.323 INFO:tasks.workunit.client.0.smithi049.stdout:1/476: unlink d5/d6/d19/d21/f32 0 2024-09-19T09:03:07.328 INFO:tasks.workunit.client.0.smithi049.stdout:8/736: mknod d1/d11/d4f/d87/cdc 0 2024-09-19T09:03:07.329 INFO:tasks.workunit.client.0.smithi049.stdout:5/637: link d3/d5/d20/l98 d3/d5/de/lc6 0 2024-09-19T09:03:07.330 INFO:tasks.workunit.client.0.smithi049.stdout:2/765: symlink d1/d4/d20/l106 0 2024-09-19T09:03:07.331 INFO:tasks.workunit.client.0.smithi049.stdout:0/775: symlink d5/d10/d2f/d6d/daa/dd3/leb 0 2024-09-19T09:03:07.333 INFO:tasks.workunit.client.0.smithi049.stdout:8/737: symlink d1/d1a/dc2/ldd 0 2024-09-19T09:03:07.334 INFO:tasks.workunit.client.0.smithi049.stdout:0/776: chown d5/d10/d82/d67/d85/db4/lc7 1318288 1 2024-09-19T09:03:07.340 INFO:tasks.workunit.client.0.smithi049.stdout:6/520: sync 2024-09-19T09:03:07.340 INFO:tasks.workunit.client.0.smithi049.stdout:4/522: sync 2024-09-19T09:03:07.340 INFO:tasks.workunit.client.0.smithi049.stdout:7/844: sync 2024-09-19T09:03:07.340 INFO:tasks.workunit.client.0.smithi049.stdout:3/623: sync 2024-09-19T09:03:07.342 INFO:tasks.workunit.client.0.smithi049.stdout:1/477: getdents d5/d6/dc 0 2024-09-19T09:03:07.347 INFO:tasks.workunit.client.0.smithi049.stdout:7/845: fsync d1/d53/f3e 0 2024-09-19T09:03:07.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/523: write d4/d15/d19/d1f/d55/f90 [44254,105411] 0 2024-09-19T09:03:07.349 INFO:tasks.workunit.client.0.smithi049.stdout:8/738: dwrite d1/f39 [4194304,4194304] 0 2024-09-19T09:03:07.354 INFO:tasks.workunit.client.0.smithi049.stdout:1/478: read d5/d6/f38 [2877080,84835] 0 2024-09-19T09:03:07.354 INFO:tasks.workunit.client.0.smithi049.stdout:5/638: dread d3/d5/f1b [0,4194304] 0 2024-09-19T09:03:07.355 INFO:tasks.workunit.client.0.smithi049.stdout:5/639: stat d3/f41 0 2024-09-19T09:03:07.355 INFO:tasks.workunit.client.0.smithi049.stdout:0/777: dwrite d5/d86/fb8 [0,4194304] 0 2024-09-19T09:03:07.359 INFO:tasks.workunit.client.0.smithi049.stdout:2/766: dread d1/d2/d23/dca/fcb [0,4194304] 0 2024-09-19T09:03:07.366 INFO:tasks.workunit.client.0.smithi049.stdout:8/739: dwrite d1/d11/d4f/fdb [0,4194304] 0 2024-09-19T09:03:07.366 INFO:tasks.workunit.client.0.smithi049.stdout:1/479: dread d5/f26 [0,4194304] 0 2024-09-19T09:03:07.374 INFO:tasks.workunit.client.0.smithi049.stdout:5/640: rmdir d3/d6c 39 2024-09-19T09:03:07.376 INFO:tasks.workunit.client.0.smithi049.stdout:1/480: dwrite d5/d6/f6f [0,4194304] 0 2024-09-19T09:03:07.382 INFO:tasks.workunit.client.0.smithi049.stdout:8/740: symlink d1/d11/d4f/d9d/lde 0 2024-09-19T09:03:07.383 INFO:tasks.workunit.client.0.smithi049.stdout:7/846: truncate d1/d53/f3e 186739 0 2024-09-19T09:03:07.386 INFO:tasks.workunit.client.0.smithi049.stdout:3/624: dwrite d10/d3d/d76/da3/fb9 [0,4194304] 0 2024-09-19T09:03:07.389 INFO:tasks.workunit.client.0.smithi049.stdout:1/481: rename d5/d6/d8/d13/d24/c88 to d5/d6/d82/c9d 0 2024-09-19T09:03:07.389 INFO:tasks.workunit.client.0.smithi049.stdout:3/625: read d10/d3d/d76/da3/fb9 [508281,106097] 0 2024-09-19T09:03:07.390 INFO:tasks.workunit.client.0.smithi049.stdout:6/521: getdents dc/d1b/d20/d2f 0 2024-09-19T09:03:07.395 INFO:tasks.workunit.client.0.smithi049.stdout:2/767: dread d1/d4/d20/f1c [0,4194304] 0 2024-09-19T09:03:07.395 INFO:tasks.workunit.client.0.smithi049.stdout:6/522: creat dc/d1b/d20/d2f/d53/fa1 x:0 0 0 2024-09-19T09:03:07.396 INFO:tasks.workunit.client.0.smithi049.stdout:2/768: write d1/d2/d23/f2c [3362280,105324] 0 2024-09-19T09:03:07.397 INFO:tasks.workunit.client.0.smithi049.stdout:6/523: chown dc/d1b/d20/d81/c79 20865 1 2024-09-19T09:03:07.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/524: fdatasync dc/d1b/d20/d7f/f8c 0 2024-09-19T09:03:07.398 INFO:tasks.workunit.client.0.smithi049.stdout:5/641: rename d3/dc/c17 to d3/d5/d20/d38/d9c/cc7 0 2024-09-19T09:03:07.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/778: write d5/d10/d13/d15/d29/f4b [406181,74409] 0 2024-09-19T09:03:07.400 INFO:tasks.workunit.client.0.smithi049.stdout:2/769: dread - d1/fc5 zero size 2024-09-19T09:03:07.400 INFO:tasks.workunit.client.0.smithi049.stdout:0/779: stat d5/d10/cb9 0 2024-09-19T09:03:07.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/642: dread - d3/d5/d1c/d3a/d8f/dbf/fc0 zero size 2024-09-19T09:03:07.402 INFO:tasks.workunit.client.0.smithi049.stdout:0/780: chown d5/d10/d2f/ca7 3 1 2024-09-19T09:03:07.402 INFO:tasks.workunit.client.0.smithi049.stdout:5/643: chown d3/d5/d1c/d2d/d89 74377 1 2024-09-19T09:03:07.404 INFO:tasks.workunit.client.0.smithi049.stdout:5/644: chown d3/d5/d20/d38/f4d 4514 1 2024-09-19T09:03:07.404 INFO:tasks.workunit.client.0.smithi049.stdout:8/741: rename d1/d11/f4d to d1/d27/fdf 0 2024-09-19T09:03:07.405 INFO:tasks.workunit.client.0.smithi049.stdout:4/524: write d4/d45/f8e [4230641,6760] 0 2024-09-19T09:03:07.410 INFO:tasks.workunit.client.0.smithi049.stdout:3/626: write d10/d3d/d46/d84/f8f [1810311,116028] 0 2024-09-19T09:03:07.412 INFO:tasks.workunit.client.0.smithi049.stdout:7/847: dwrite d1/d8/d2d/d72/d11d/f97 [0,4194304] 0 2024-09-19T09:03:07.417 INFO:tasks.workunit.client.0.smithi049.stdout:1/482: rename d5/d6/dc/l4d to d5/d6/d8/d13/d24/d7e/l9e 0 2024-09-19T09:03:07.419 INFO:tasks.workunit.client.0.smithi049.stdout:6/525: dread dc/ff [0,4194304] 0 2024-09-19T09:03:07.421 INFO:tasks.workunit.client.0.smithi049.stdout:7/848: dwrite d1/d1a/de7/d50/fde [0,4194304] 0 2024-09-19T09:03:07.422 INFO:tasks.workunit.client.0.smithi049.stdout:2/770: write d1/d4/d1e/d9f/db3/d41/fa6 [4547081,16276] 0 2024-09-19T09:03:07.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/849: dread - d1/d53/dc6/dd8/f11b zero size 2024-09-19T09:03:07.423 INFO:tasks.workunit.client.0.smithi049.stdout:2/771: readlink d1/d2/d32/l8d 0 2024-09-19T09:03:07.425 INFO:tasks.workunit.client.0.smithi049.stdout:4/525: creat d4/d45/d4a/f9d x:0 0 0 2024-09-19T09:03:07.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/781: mknod d5/d10/d13/dc4/dcd/dd2/cec 0 2024-09-19T09:03:07.428 INFO:tasks.workunit.client.0.smithi049.stdout:5/645: symlink d3/d5/de/d4a/dbd/lc8 0 2024-09-19T09:03:07.430 INFO:tasks.workunit.client.0.smithi049.stdout:0/782: write d5/d10/d13/d15/f43 [3437624,11600] 0 2024-09-19T09:03:07.430 INFO:tasks.workunit.client.0.smithi049.stdout:1/483: fsync d5/d6/f5b 0 2024-09-19T09:03:07.431 INFO:tasks.workunit.client.0.smithi049.stdout:1/484: write d5/d6/f10 [5148780,117837] 0 2024-09-19T09:03:07.432 INFO:tasks.workunit.client.0.smithi049.stdout:8/742: mknod d1/d11/d2e/d4e/d82/dd8/ce0 0 2024-09-19T09:03:07.436 INFO:tasks.workunit.client.0.smithi049.stdout:4/526: creat d4/d15/d19/d1f/d55/d66/f9e x:0 0 0 2024-09-19T09:03:07.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/527: readlink d4/d45/d3f/d47/l75 0 2024-09-19T09:03:07.440 INFO:tasks.workunit.client.0.smithi049.stdout:5/646: creat d3/d5/d1c/d4c/d63/fc9 x:0 0 0 2024-09-19T09:03:07.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/783: rmdir d5/d10/d3c 39 2024-09-19T09:03:07.444 INFO:tasks.workunit.client.0.smithi049.stdout:7/850: mknod d1/d1a/d127/c130 0 2024-09-19T09:03:07.449 INFO:tasks.workunit.client.0.smithi049.stdout:6/526: write dc/d1b/d20/f91 [1418316,111039] 0 2024-09-19T09:03:07.451 INFO:tasks.workunit.client.0.smithi049.stdout:6/527: write dc/d1b/d20/d2f/f5c [4245889,67401] 0 2024-09-19T09:03:07.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/485: mkdir d5/d6/d8/d13/d24/d9f 0 2024-09-19T09:03:07.454 INFO:tasks.workunit.client.0.smithi049.stdout:1/486: write d5/d6/d19/f61 [1400088,26576] 0 2024-09-19T09:03:07.455 INFO:tasks.workunit.client.0.smithi049.stdout:2/772: creat d1/f107 x:0 0 0 2024-09-19T09:03:07.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/851: mkdir d1/d8/d2d/d72/d11d/d9c/d131 0 2024-09-19T09:03:07.456 INFO:tasks.workunit.client.0.smithi049.stdout:2/773: chown d1/d2/d32/f94 1743 1 2024-09-19T09:03:07.458 INFO:tasks.workunit.client.0.smithi049.stdout:4/528: dread d4/f69 [0,4194304] 0 2024-09-19T09:03:07.458 INFO:tasks.workunit.client.0.smithi049.stdout:4/529: chown d4/d34/d3d/d4f 26 1 2024-09-19T09:03:07.460 INFO:tasks.workunit.client.0.smithi049.stdout:0/784: rename d5/d10/d2f/d6d/dbe/fc3 to d5/d64/d97/fed 0 2024-09-19T09:03:07.463 INFO:tasks.workunit.client.0.smithi049.stdout:6/528: symlink dc/d16/d88/la2 0 2024-09-19T09:03:07.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/647: creat d3/dc/fca x:0 0 0 2024-09-19T09:03:07.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/530: rmdir d4/d15 39 2024-09-19T09:03:07.479 INFO:tasks.workunit.client.0.smithi049.stdout:8/743: getdents d1/d11/d2e/d4e 0 2024-09-19T09:03:07.481 INFO:tasks.workunit.client.0.smithi049.stdout:8/744: truncate d1/d11/d2e/d4e/d61/d9f/fb4 237644 0 2024-09-19T09:03:07.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/852: write d1/d1a/f38 [1382741,7678] 0 2024-09-19T09:03:07.485 INFO:tasks.workunit.client.0.smithi049.stdout:1/487: mkdir d5/d6/d73/da0 0 2024-09-19T09:03:07.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/774: dwrite d1/d4/d1e/d9f/fd3 [0,4194304] 0 2024-09-19T09:03:07.493 INFO:tasks.workunit.client.0.smithi049.stdout:8/745: fdatasync d1/d1a/f29 0 2024-09-19T09:03:07.495 INFO:tasks.workunit.client.0.smithi049.stdout:2/775: truncate d1/f107 373815 0 2024-09-19T09:03:07.502 INFO:tasks.workunit.client.0.smithi049.stdout:8/746: dwrite d1/d27/f4b [0,4194304] 0 2024-09-19T09:03:07.504 INFO:tasks.workunit.client.0.smithi049.stdout:8/747: chown d1/d1a/d8b 420067060 1 2024-09-19T09:03:07.504 INFO:tasks.workunit.client.0.smithi049.stdout:7/853: dread d1/d1a/de7/fe4 [0,4194304] 0 2024-09-19T09:03:07.504 INFO:tasks.workunit.client.0.smithi049.stdout:6/529: truncate dc/d16/f70 387058 0 2024-09-19T09:03:07.505 INFO:tasks.workunit.client.0.smithi049.stdout:7/854: stat d1/d8/d80/f92 0 2024-09-19T09:03:07.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/488: dread d5/d6/d19/f42 [0,4194304] 0 2024-09-19T09:03:07.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:07 smithi102 ceph-mon[35280]: pgmap v40: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 102 MiB/s wr, 273 op/s 2024-09-19T09:03:07.511 INFO:tasks.workunit.client.0.smithi049.stdout:4/531: creat d4/d15/d19/d1f/d77/f9f x:0 0 0 2024-09-19T09:03:07.515 INFO:tasks.workunit.client.0.smithi049.stdout:2/776: creat d1/d2/d6c/dd5/de2/dee/f108 x:0 0 0 2024-09-19T09:03:07.519 INFO:tasks.workunit.client.0.smithi049.stdout:5/648: creat d3/d5/de/d12/d7d/d88/fcb x:0 0 0 2024-09-19T09:03:07.521 INFO:tasks.workunit.client.0.smithi049.stdout:8/748: dwrite d1/d11/d4f/d87/d5d/dcb/fa9 [0,4194304] 0 2024-09-19T09:03:07.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/530: dwrite dc/d1b/d20/d81/f27 [0,4194304] 0 2024-09-19T09:03:07.523 INFO:tasks.workunit.client.0.smithi049.stdout:7/855: dwrite d1/d1a/da0/dd3/d62/d6b/ff1 [0,4194304] 0 2024-09-19T09:03:07.524 INFO:tasks.workunit.client.0.smithi049.stdout:4/532: mkdir d4/d34/da0 0 2024-09-19T09:03:07.524 INFO:tasks.workunit.client.0.smithi049.stdout:1/489: mknod d5/d6/d8/d13/ca1 0 2024-09-19T09:03:07.533 INFO:tasks.workunit.client.0.smithi049.stdout:0/785: link d5/f50 d5/fee 0 2024-09-19T09:03:07.534 INFO:tasks.workunit.client.0.smithi049.stdout:5/649: mkdir d3/d5/d1c/d4c/d7c/dcc 0 2024-09-19T09:03:07.535 INFO:tasks.workunit.client.0.smithi049.stdout:6/531: symlink dc/d1b/d20/d2f/d6b/d73/la3 0 2024-09-19T09:03:07.537 INFO:tasks.workunit.client.0.smithi049.stdout:1/490: rename d5/d6/dc/f56 to d5/d6/d19/d30/d63/fa2 0 2024-09-19T09:03:07.540 INFO:tasks.workunit.client.0.smithi049.stdout:0/786: symlink d5/d10/d13/d15/d36/d3d/lef 0 2024-09-19T09:03:07.543 INFO:tasks.workunit.client.0.smithi049.stdout:4/533: dwrite d4/f25 [0,4194304] 0 2024-09-19T09:03:07.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/787: truncate d5/d10/d82/d67/d85/db4/dbb/fbd 435276 0 2024-09-19T09:03:07.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/534: symlink d4/d15/d19/d1f/d55/d7f/la1 0 2024-09-19T09:03:07.555 INFO:tasks.workunit.client.0.smithi049.stdout:8/749: getdents d1/d11/d4f/d87/d5d/d65 0 2024-09-19T09:03:07.558 INFO:tasks.workunit.client.0.smithi049.stdout:0/788: mknod d5/d10/d13/d15/d36/cf0 0 2024-09-19T09:03:07.560 INFO:tasks.workunit.client.0.smithi049.stdout:8/750: truncate d1/f9 1192020 0 2024-09-19T09:03:07.561 INFO:tasks.workunit.client.0.smithi049.stdout:1/491: rename d5/d6/f1f to d5/d6/d8/d13/d24/d7e/fa3 0 2024-09-19T09:03:07.565 INFO:tasks.workunit.client.0.smithi049.stdout:4/535: rename d4/d34/d3d/d4f/d6a to d4/d6c/da2 0 2024-09-19T09:03:07.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/777: write d1/d2/d23/f68 [228347,71066] 0 2024-09-19T09:03:07.580 INFO:tasks.workunit.client.0.smithi049.stdout:7/856: truncate d1/d8/d2d/d36/d91/fb5 3264071 0 2024-09-19T09:03:07.581 INFO:tasks.workunit.client.0.smithi049.stdout:4/536: mkdir d4/d34/d3d/d62/d76/da3 0 2024-09-19T09:03:07.582 INFO:tasks.workunit.client.0.smithi049.stdout:1/492: creat d5/d6/d19/fa4 x:0 0 0 2024-09-19T09:03:07.583 INFO:tasks.workunit.client.0.smithi049.stdout:5/650: write d3/d5/de/f1e [752076,116312] 0 2024-09-19T09:03:07.586 INFO:tasks.workunit.client.0.smithi049.stdout:7/857: truncate d1/d8/d2d/f87 3127568 0 2024-09-19T09:03:07.589 INFO:tasks.workunit.client.0.smithi049.stdout:4/537: chown d4/d45/d3f/c80 0 1 2024-09-19T09:03:07.589 INFO:tasks.workunit.client.0.smithi049.stdout:7/858: write d1/d8/d2d/d36/f45 [1211036,94987] 0 2024-09-19T09:03:07.592 INFO:tasks.workunit.client.0.smithi049.stdout:5/651: unlink d3/dc/d43/c79 0 2024-09-19T09:03:07.593 INFO:tasks.workunit.client.0.smithi049.stdout:8/751: dread d1/d11/d4f/d87/d5d/dcb/f6b [0,4194304] 0 2024-09-19T09:03:07.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/789: dwrite d5/d10/d13/d15/d29/f3e [0,4194304] 0 2024-09-19T09:03:07.600 INFO:tasks.workunit.client.0.smithi049.stdout:7/859: dwrite d1/d8/d2d/d36/f45 [0,4194304] 0 2024-09-19T09:03:07.602 INFO:tasks.workunit.client.0.smithi049.stdout:7/860: dread - d1/d8/d80/ffd zero size 2024-09-19T09:03:07.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/493: symlink d5/d6/d8/d13/d24/la5 0 2024-09-19T09:03:07.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/494: chown d5/d6/d8/d13/d24/d7e/d7f 259 1 2024-09-19T09:03:07.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/652: mkdir d3/d5/d1c/d3a/d8f/dbf/dcd 0 2024-09-19T09:03:07.611 INFO:tasks.workunit.client.0.smithi049.stdout:8/752: dread - d1/d11/d2e/d4e/d61/fc5 zero size 2024-09-19T09:03:07.611 INFO:tasks.workunit.client.0.smithi049.stdout:4/538: symlink d4/la4 0 2024-09-19T09:03:07.614 INFO:tasks.workunit.client.0.smithi049.stdout:8/753: chown d1/d11/d2e/d4e/d61/d9f/dc3 0 1 2024-09-19T09:03:07.617 INFO:tasks.workunit.client.0.smithi049.stdout:7/861: creat d1/d8/d2d/d72/d11d/d99/f132 x:0 0 0 2024-09-19T09:03:07.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/495: mkdir d5/d6/d19/d21/d52/da6 0 2024-09-19T09:03:07.618 INFO:tasks.workunit.client.0.smithi049.stdout:2/778: dwrite d1/d2/d32/f64 [0,4194304] 0 2024-09-19T09:03:07.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/790: link d5/d10/fae d5/d10/d13/d30/d75/ff1 0 2024-09-19T09:03:07.621 INFO:tasks.workunit.client.0.smithi049.stdout:6/532: dwrite dc/d1b/d20/d2f/f5c [0,4194304] 0 2024-09-19T09:03:07.622 INFO:tasks.workunit.client.0.smithi049.stdout:8/754: symlink d1/d27/le1 0 2024-09-19T09:03:07.623 INFO:tasks.workunit.client.0.smithi049.stdout:6/533: fsync dc/d1b/d20/d2f/d6b/f89 0 2024-09-19T09:03:07.627 INFO:tasks.workunit.client.0.smithi049.stdout:1/496: unlink d5/d6/d8/f62 0 2024-09-19T09:03:07.629 INFO:tasks.workunit.client.0.smithi049.stdout:0/791: chown d5/fcb 125444192 1 2024-09-19T09:03:07.634 INFO:tasks.workunit.client.0.smithi049.stdout:6/534: creat dc/d1b/d20/d2f/d6b/d73/fa4 x:0 0 0 2024-09-19T09:03:07.640 INFO:tasks.workunit.client.0.smithi049.stdout:0/792: dread d5/fa [0,4194304] 0 2024-09-19T09:03:07.644 INFO:tasks.workunit.client.0.smithi049.stdout:0/793: symlink d5/d10/d13/d15/d29/d9a/ddc/lf2 0 2024-09-19T09:03:07.644 INFO:tasks.workunit.client.0.smithi049.stdout:1/497: dread d5/d6/d19/d30/d63/fa2 [0,4194304] 0 2024-09-19T09:03:07.646 INFO:tasks.workunit.client.0.smithi049.stdout:0/794: truncate d5/d10/d2f/d6d/dbe/fca 479132 0 2024-09-19T09:03:07.650 INFO:tasks.workunit.client.0.smithi049.stdout:0/795: rename d5/d10/d13/d15/d29/f4b to d5/d10/d2f/ff3 0 2024-09-19T09:03:07.651 INFO:tasks.workunit.client.0.smithi049.stdout:0/796: chown d5/d86/ca4 117530 1 2024-09-19T09:03:07.653 INFO:tasks.workunit.client.0.smithi049.stdout:0/797: truncate d5/d86/fa0 399827 0 2024-09-19T09:03:07.656 INFO:tasks.workunit.client.0.smithi049.stdout:0/798: truncate d5/d10/d82/f46 957862 0 2024-09-19T09:03:07.660 INFO:tasks.workunit.client.0.smithi049.stdout:0/799: rename d5/d10/d3c/c84 to d5/d10/d13/d69/cf4 0 2024-09-19T09:03:07.662 INFO:tasks.workunit.client.0.smithi049.stdout:7/862: write d1/d1a/de7/d59/ff4 [765526,23856] 0 2024-09-19T09:03:07.664 INFO:tasks.workunit.client.0.smithi049.stdout:2/779: write d1/f15 [8210185,117509] 0 2024-09-19T09:03:07.664 INFO:tasks.workunit.client.0.smithi049.stdout:6/535: dread dc/d1b/f39 [0,4194304] 0 2024-09-19T09:03:07.667 INFO:tasks.workunit.client.0.smithi049.stdout:4/539: dwrite d4/d15/d19/d1f/f67 [0,4194304] 0 2024-09-19T09:03:07.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/540: fdatasync d4/d45/d4a/f4e 0 2024-09-19T09:03:07.672 INFO:tasks.workunit.client.0.smithi049.stdout:2/780: unlink d1/d4/d1e/d45/f6d 0 2024-09-19T09:03:07.672 INFO:tasks.workunit.client.0.smithi049.stdout:7/863: symlink d1/d1a/de7/d50/l133 0 2024-09-19T09:03:07.673 INFO:tasks.workunit.client.0.smithi049.stdout:4/541: chown d4/d45/f8e 105796906 1 2024-09-19T09:03:07.676 INFO:tasks.workunit.client.0.smithi049.stdout:8/755: dwrite d1/d27/f35 [0,4194304] 0 2024-09-19T09:03:07.681 INFO:tasks.workunit.client.0.smithi049.stdout:6/536: dwrite dc/d1b/d78/f93 [0,4194304] 0 2024-09-19T09:03:07.683 INFO:tasks.workunit.client.0.smithi049.stdout:6/537: chown dc/d16/l33 19115378 1 2024-09-19T09:03:07.684 INFO:tasks.workunit.client.0.smithi049.stdout:7/864: creat d1/d53/dc6/dd8/f134 x:0 0 0 2024-09-19T09:03:07.685 INFO:tasks.workunit.client.0.smithi049.stdout:4/542: creat d4/d45/d3f/d47/fa5 x:0 0 0 2024-09-19T09:03:07.687 INFO:tasks.workunit.client.0.smithi049.stdout:8/756: symlink d1/d11/d2e/d4e/d61/le2 0 2024-09-19T09:03:07.687 INFO:tasks.workunit.client.0.smithi049.stdout:4/543: write d4/d15/d19/d1f/d55/f90 [942426,77787] 0 2024-09-19T09:03:07.691 INFO:tasks.workunit.client.0.smithi049.stdout:1/498: write d5/d6/f38 [4023873,8251] 0 2024-09-19T09:03:07.691 INFO:tasks.workunit.client.0.smithi049.stdout:7/865: dread - d1/d53/f5b zero size 2024-09-19T09:03:07.698 INFO:tasks.workunit.client.0.smithi049.stdout:6/538: symlink dc/d1b/d20/d81/d80/la5 0 2024-09-19T09:03:07.704 INFO:tasks.workunit.client.0.smithi049.stdout:2/781: link d1/d2/d6c/laf d1/d4/d20/d26/l109 0 2024-09-19T09:03:07.709 INFO:tasks.workunit.client.0.smithi049.stdout:6/539: mkdir dc/d1b/d20/d2f/da6 0 2024-09-19T09:03:07.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/866: dread d1/d1a/f38 [0,4194304] 0 2024-09-19T09:03:07.714 INFO:tasks.workunit.client.0.smithi049.stdout:2/782: mknod d1/d4/d1e/d9f/c10a 0 2024-09-19T09:03:07.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/867: write d1/d8/d2d/d72/d11d/d9c/ff3 [2089906,7458] 0 2024-09-19T09:03:07.716 INFO:tasks.workunit.client.0.smithi049.stdout:7/868: fdatasync d1/fc8 0 2024-09-19T09:03:07.720 INFO:tasks.workunit.client.0.smithi049.stdout:6/540: dwrite dc/d1b/d20/d2f/d6b/f89 [0,4194304] 0 2024-09-19T09:03:07.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/541: symlink dc/d16/la7 0 2024-09-19T09:03:07.753 INFO:tasks.workunit.client.0.smithi049.stdout:2/783: dread d1/d4/f39 [0,4194304] 0 2024-09-19T09:03:07.761 INFO:tasks.workunit.client.0.smithi049.stdout:6/542: creat dc/d1b/fa8 x:0 0 0 2024-09-19T09:03:07.770 INFO:tasks.workunit.client.0.smithi049.stdout:6/543: getdents dc/d16/d88 0 2024-09-19T09:03:07.775 INFO:tasks.workunit.client.0.smithi049.stdout:1/499: dwrite d5/d6/d8/d1a/f3e [0,4194304] 0 2024-09-19T09:03:07.778 INFO:tasks.workunit.client.0.smithi049.stdout:8/757: dwrite d1/d11/f1b [0,4194304] 0 2024-09-19T09:03:07.782 INFO:tasks.workunit.client.0.smithi049.stdout:6/544: write dc/d1b/d6f/f74 [2240297,45525] 0 2024-09-19T09:03:07.785 INFO:tasks.workunit.client.0.smithi049.stdout:4/544: dwrite d4/d4c/f6e [0,4194304] 0 2024-09-19T09:03:07.795 INFO:tasks.workunit.client.0.smithi049.stdout:7/869: write d1/d1a/da0/fbb [172047,67489] 0 2024-09-19T09:03:07.799 INFO:tasks.workunit.client.0.smithi049.stdout:6/545: write dc/d1b/d20/d2f/d31/f65 [6330358,112051] 0 2024-09-19T09:03:07.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/500: mkdir d5/d6/d19/d21/d52/da6/da7 0 2024-09-19T09:03:07.801 INFO:tasks.workunit.client.0.smithi049.stdout:2/784: truncate d1/d4/d20/d92/fd2 2958816 0 2024-09-19T09:03:07.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/785: stat d1/d4/d1e/d9f/db3/ce6 0 2024-09-19T09:03:07.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/545: rmdir d4/d45/d3f/d47 39 2024-09-19T09:03:07.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/786: write d1/f15 [5819416,94680] 0 2024-09-19T09:03:07.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/758: creat d1/d11/d2e/d4e/d61/d9f/dc3/fe3 x:0 0 0 2024-09-19T09:03:07.811 INFO:tasks.workunit.client.0.smithi049.stdout:1/501: dwrite d5/d6/d19/d21/d52/f76 [4194304,4194304] 0 2024-09-19T09:03:07.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/502: stat d5/d6/d8/d13/ca1 0 2024-09-19T09:03:07.813 INFO:tasks.workunit.client.0.smithi049.stdout:6/546: rmdir dc/d1b/d20/d81/d5a 39 2024-09-19T09:03:07.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/503: chown d5/d6/d8/d1a/d78 256 1 2024-09-19T09:03:07.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/870: write d1/d8/d2d/d72/d11d/d99/ffa [5146452,47804] 0 2024-09-19T09:03:07.822 INFO:tasks.workunit.client.0.smithi049.stdout:2/787: unlink d1/d4/d1e/f28 0 2024-09-19T09:03:07.823 INFO:tasks.workunit.client.0.smithi049.stdout:2/788: chown d1/d4/d1e/d21/c36 1 1 2024-09-19T09:03:07.826 INFO:tasks.workunit.client.0.smithi049.stdout:6/547: rmdir dc/d1b/d20/d2f/d31 39 2024-09-19T09:03:07.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/504: rmdir d5/d6/d19/d30 39 2024-09-19T09:03:07.828 INFO:tasks.workunit.client.0.smithi049.stdout:4/546: creat d4/d45/d3f/d47/fa6 x:0 0 0 2024-09-19T09:03:07.830 INFO:tasks.workunit.client.0.smithi049.stdout:7/871: symlink d1/d1a/de7/d50/daa/l135 0 2024-09-19T09:03:07.830 INFO:tasks.workunit.client.0.smithi049.stdout:2/789: symlink d1/d4/d1e/d9f/db7/l10b 0 2024-09-19T09:03:07.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/872: dread - d1/d8/d2d/d72/d105/f120 zero size 2024-09-19T09:03:07.831 INFO:tasks.workunit.client.0.smithi049.stdout:2/790: chown d1/d4/d1e/d9f/db7 173763699 1 2024-09-19T09:03:07.834 INFO:tasks.workunit.client.0.smithi049.stdout:8/759: link d1/l54 d1/d11/d4f/d9d/le4 0 2024-09-19T09:03:07.836 INFO:tasks.workunit.client.0.smithi049.stdout:6/548: creat dc/d1b/d20/d2f/da6/fa9 x:0 0 0 2024-09-19T09:03:07.837 INFO:tasks.workunit.client.0.smithi049.stdout:7/873: fsync d1/d8/d19/f46 0 2024-09-19T09:03:07.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/760: mkdir d1/d11/d2e/d4e/d61/de5 0 2024-09-19T09:03:07.841 INFO:tasks.workunit.client.0.smithi049.stdout:6/549: write dc/d1b/d20/d2f/d6b/f89 [2491946,14403] 0 2024-09-19T09:03:07.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/505: dwrite d5/d6/d19/d30/f65 [0,4194304] 0 2024-09-19T09:03:07.843 INFO:tasks.workunit.client.0.smithi049.stdout:6/550: readlink dc/d16/l6a 0 2024-09-19T09:03:07.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/761: write d1/d11/d4f/d87/d5d/dcb/d5b/f69 [9394360,79740] 0 2024-09-19T09:03:07.849 INFO:tasks.workunit.client.0.smithi049.stdout:1/506: mkdir d5/d6/d73/da8 0 2024-09-19T09:03:07.855 INFO:tasks.workunit.client.0.smithi049.stdout:2/791: dread d1/f6a [0,4194304] 0 2024-09-19T09:03:07.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/547: dwrite d4/f1e [4194304,4194304] 0 2024-09-19T09:03:07.856 INFO:tasks.workunit.client.0.smithi049.stdout:7/874: rename d1/d8/d2d/d31/l7e to d1/d8/d2d/d72/d11d/d9c/l136 0 2024-09-19T09:03:07.857 INFO:tasks.workunit.client.0.smithi049.stdout:2/792: stat d1/d4/d1e/d21/f52 0 2024-09-19T09:03:07.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/548: write d4/d34/f79 [1445749,126688] 0 2024-09-19T09:03:07.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/507: creat d5/d6/d19/d21/d52/fa9 x:0 0 0 2024-09-19T09:03:07.863 INFO:tasks.workunit.client.0.smithi049.stdout:2/793: mkdir d1/d2/d23/d10c 0 2024-09-19T09:03:07.866 INFO:tasks.workunit.client.0.smithi049.stdout:4/549: mknod d4/d15/d19/d1f/ca7 0 2024-09-19T09:03:07.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/551: truncate dc/d1b/d20/d81/d5a/f9a 451648 0 2024-09-19T09:03:07.871 INFO:tasks.workunit.client.0.smithi049.stdout:6/552: dread dc/d16/f70 [0,4194304] 0 2024-09-19T09:03:07.873 INFO:tasks.workunit.client.0.smithi049.stdout:6/553: write dc/d1b/d20/d2f/d4c/f5e [859043,31508] 0 2024-09-19T09:03:07.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/508: write d5/d6/d8/d13/f12 [114839,90398] 0 2024-09-19T09:03:07.876 INFO:tasks.workunit.client.0.smithi049.stdout:7/875: link d1/d1a/da0/dd3/d62/cc0 d1/d1a/de7/d59/c137 0 2024-09-19T09:03:07.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/794: write d1/d4/f3c [32536,94966] 0 2024-09-19T09:03:07.879 INFO:tasks.workunit.client.0.smithi049.stdout:1/509: write d5/d6/d19/d21/d52/f85 [3209599,88628] 0 2024-09-19T09:03:07.881 INFO:tasks.workunit.client.0.smithi049.stdout:4/550: rename d4/f21 to d4/d34/d3d/d62/fa8 0 2024-09-19T09:03:07.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/795: symlink d1/d4/d1e/d9f/db3/d41/l10d 0 2024-09-19T09:03:07.883 INFO:tasks.workunit.client.0.smithi049.stdout:1/510: truncate d5/d6/d8/d13/d24/f2f 454093 0 2024-09-19T09:03:07.887 INFO:tasks.workunit.client.0.smithi049.stdout:6/554: mknod dc/d1b/caa 0 2024-09-19T09:03:07.887 INFO:tasks.workunit.client.0.smithi049.stdout:7/876: mkdir d1/d8/d2d/d72/d11d/d9c/d131/d138 0 2024-09-19T09:03:07.889 INFO:tasks.workunit.client.0.smithi049.stdout:4/551: symlink d4/d15/la9 0 2024-09-19T09:03:07.891 INFO:tasks.workunit.client.0.smithi049.stdout:2/796: rename d1/d4/d20/d92/cb6 to d1/d2/d70/de4/c10e 0 2024-09-19T09:03:07.892 INFO:tasks.workunit.client.0.smithi049.stdout:6/555: mkdir dc/d1b/d20/d81/d80/dab 0 2024-09-19T09:03:07.896 INFO:tasks.workunit.client.0.smithi049.stdout:4/552: mkdir d4/d15/d19/d1f/daa 0 2024-09-19T09:03:07.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/877: dread d1/d8/d2d/d31/f47 [0,4194304] 0 2024-09-19T09:03:07.897 INFO:tasks.workunit.client.0.smithi049.stdout:4/553: write d4/d45/d4a/f9d [127909,36862] 0 2024-09-19T09:03:07.897 INFO:tasks.workunit.client.0.smithi049.stdout:1/511: write d5/f1e [1446036,646] 0 2024-09-19T09:03:07.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/797: fsync d1/d4/d1e/d9f/db3/d41/fde 0 2024-09-19T09:03:07.901 INFO:tasks.workunit.client.0.smithi049.stdout:2/798: chown d1/d2d/fa4 17118 1 2024-09-19T09:03:07.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/554: truncate d4/d15/f65 886543 0 2024-09-19T09:03:07.904 INFO:tasks.workunit.client.0.smithi049.stdout:4/555: fsync d4/d15/f61 0 2024-09-19T09:03:07.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/512: mknod d5/d6/d19/d21/d52/caa 0 2024-09-19T09:03:07.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/513: readlink d5/d6/d8/d13/d24/l66 0 2024-09-19T09:03:07.907 INFO:tasks.workunit.client.0.smithi049.stdout:1/514: read d5/d6/d8/d13/f12 [244417,4168] 0 2024-09-19T09:03:07.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/515: fdatasync d5/d6/d19/d30/f65 0 2024-09-19T09:03:07.909 INFO:tasks.workunit.client.0.smithi049.stdout:6/556: creat dc/d1b/d20/d81/fac x:0 0 0 2024-09-19T09:03:07.910 INFO:tasks.workunit.client.0.smithi049.stdout:6/557: chown dc/d1b/d6f/f74 95 1 2024-09-19T09:03:07.913 INFO:tasks.workunit.client.0.smithi049.stdout:7/878: write d1/d8/d2d/f87 [814812,45292] 0 2024-09-19T09:03:07.918 INFO:tasks.workunit.client.0.smithi049.stdout:2/799: getdents d1/d2/d23/d49/d75/da5 0 2024-09-19T09:03:07.923 INFO:tasks.workunit.client.0.smithi049.stdout:7/879: mknod d1/d8/d2d/d31/d6e/dfe/c139 0 2024-09-19T09:03:07.923 INFO:tasks.workunit.client.0.smithi049.stdout:4/556: dwrite d4/f69 [0,4194304] 0 2024-09-19T09:03:07.925 INFO:tasks.workunit.client.0.smithi049.stdout:2/800: dread d1/d2/f67 [0,4194304] 0 2024-09-19T09:03:07.928 INFO:tasks.workunit.client.0.smithi049.stdout:1/516: dwrite d5/d6/fa [0,4194304] 0 2024-09-19T09:03:07.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/557: unlink d4/f25 0 2024-09-19T09:03:07.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/880: creat d1/d8/d19/f13a x:0 0 0 2024-09-19T09:03:07.932 INFO:tasks.workunit.client.0.smithi049.stdout:2/801: unlink d1/d4/f3c 0 2024-09-19T09:03:07.934 INFO:tasks.workunit.client.0.smithi049.stdout:7/881: chown d1/d1a/de7/fb6 7040 1 2024-09-19T09:03:07.941 INFO:tasks.workunit.client.0.smithi049.stdout:1/517: creat d5/d6/dc/fab x:0 0 0 2024-09-19T09:03:07.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/558: link dc/d1b/d20/d81/f29 dc/d1b/d20/fad 0 2024-09-19T09:03:07.945 INFO:tasks.workunit.client.0.smithi049.stdout:6/559: fsync dc/d1b/d20/d81/d5a/f9f 0 2024-09-19T09:03:07.945 INFO:tasks.workunit.client.0.smithi049.stdout:2/802: creat d1/d2/d23/d10c/f10f x:0 0 0 2024-09-19T09:03:07.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/882: mknod d1/d1a/de7/c13b 0 2024-09-19T09:03:07.949 INFO:tasks.workunit.client.0.smithi049.stdout:1/518: dwrite d5/d6/dc/fab [0,4194304] 0 2024-09-19T09:03:07.949 INFO:tasks.workunit.client.0.smithi049.stdout:2/803: symlink d1/d2/d6c/l110 0 2024-09-19T09:03:07.953 INFO:tasks.workunit.client.0.smithi049.stdout:7/883: dwrite d1/d8/fb [0,4194304] 0 2024-09-19T09:03:07.954 INFO:tasks.workunit.client.0.smithi049.stdout:3/627: sync 2024-09-19T09:03:07.958 INFO:tasks.workunit.client.0.smithi049.stdout:4/558: truncate d4/d34/d3d/d62/f64 1891413 0 2024-09-19T09:03:07.968 INFO:tasks.workunit.client.0.smithi049.stdout:6/560: getdents dc/d1b/d20 0 2024-09-19T09:03:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:2/804: fsync d1/d2/d32/f94 0 2024-09-19T09:03:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:3/628: rename d10/d11/d13/d7e/dd0 to d10/d3d/d76/dd8 0 2024-09-19T09:03:07.969 INFO:tasks.workunit.client.0.smithi049.stdout:4/559: fsync d4/d15/d19/d1f/d55/d7f/f8c 0 2024-09-19T09:03:07.971 INFO:tasks.workunit.client.0.smithi049.stdout:7/884: mkdir d1/d1a/da0/dd3/d62/d6b/d10e/d13c 0 2024-09-19T09:03:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:3/629: chown d10/d11/d13/f28 320452 1 2024-09-19T09:03:07.974 INFO:tasks.workunit.client.0.smithi049.stdout:4/560: write d4/d15/d19/d1f/f67 [2962141,43073] 0 2024-09-19T09:03:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:2/805: creat d1/d4/d1e/d21/dae/de5/f111 x:0 0 0 2024-09-19T09:03:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:3/630: stat d10/d11/d13/d30/f9c 0 2024-09-19T09:03:07.981 INFO:tasks.workunit.client.0.smithi049.stdout:6/561: dwrite dc/d16/f2d [0,4194304] 0 2024-09-19T09:03:07.981 INFO:tasks.workunit.client.0.smithi049.stdout:4/561: read d4/d34/d3d/d62/fa8 [1091777,125506] 0 2024-09-19T09:03:07.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/519: dread d5/d6/d19/f61 [0,4194304] 0 2024-09-19T09:03:07.988 INFO:tasks.workunit.client.0.smithi049.stdout:3/631: mkdir d10/d11/d27/d4f/d59/d81/dd9 0 2024-09-19T09:03:07.988 INFO:tasks.workunit.client.0.smithi049.stdout:4/562: symlink d4/d6c/lab 0 2024-09-19T09:03:07.989 INFO:tasks.workunit.client.0.smithi049.stdout:3/632: readlink l9 0 2024-09-19T09:03:07.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/562: unlink dc/d1b/d20/d2f/d4c/f6d 0 2024-09-19T09:03:07.992 INFO:tasks.workunit.client.0.smithi049.stdout:2/806: truncate d1/d2/f24 4739177 0 2024-09-19T09:03:07.995 INFO:tasks.workunit.client.0.smithi049.stdout:1/520: fdatasync d5/d6/d8/d13/d24/f8b 0 2024-09-19T09:03:07.996 INFO:tasks.workunit.client.0.smithi049.stdout:7/885: dwrite d1/d1a/de7/fbf [0,4194304] 0 2024-09-19T09:03:07.998 INFO:tasks.workunit.client.0.smithi049.stdout:6/563: mkdir dc/d1b/d20/d81/d5a/dae 0 2024-09-19T09:03:08.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/521: readlink d5/d6/d8/d1a/d78/l8a 0 2024-09-19T09:03:08.005 INFO:tasks.workunit.client.0.smithi049.stdout:1/522: fdatasync d5/d6/d8/d13/d24/f8b 0 2024-09-19T09:03:08.006 INFO:tasks.workunit.client.0.smithi049.stdout:3/633: write d10/d11/d13/d30/f83 [2841354,129105] 0 2024-09-19T09:03:08.007 INFO:tasks.workunit.client.0.smithi049.stdout:3/634: fsync d10/d3d/f94 0 2024-09-19T09:03:08.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/564: creat dc/d1b/d6f/faf x:0 0 0 2024-09-19T09:03:08.008 INFO:tasks.workunit.client.0.smithi049.stdout:3/635: chown d10/d11/d13 213312705 1 2024-09-19T09:03:08.010 INFO:tasks.workunit.client.0.smithi049.stdout:3/636: chown d10/d11/d27/d4f/d59/d81/dd9 0 1 2024-09-19T09:03:08.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/807: write d1/d2/d70/f9a [900541,45698] 0 2024-09-19T09:03:08.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/808: chown d1/d2/d6c/dd5 18412896 1 2024-09-19T09:03:08.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/523: symlink d5/d6/dc/lac 0 2024-09-19T09:03:08.016 INFO:tasks.workunit.client.0.smithi049.stdout:1/524: fdatasync d5/d6/d19/d21/d52/f76 0 2024-09-19T09:03:08.017 INFO:tasks.workunit.client.0.smithi049.stdout:3/637: rmdir d10/d3d/d76/da3/db7 39 2024-09-19T09:03:08.017 INFO:tasks.workunit.client.0.smithi049.stdout:3/638: readlink l8 0 2024-09-19T09:03:08.020 INFO:tasks.workunit.client.0.smithi049.stdout:7/886: rename d1/d8/d2d/d31/f79 to d1/d1a/de7/f13d 0 2024-09-19T09:03:08.020 INFO:tasks.workunit.client.0.smithi049.stdout:6/565: dread dc/d1b/d20/d81/f4d [4194304,4194304] 0 2024-09-19T09:03:08.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/887: read d1/d8/d2d/f87 [1597489,93404] 0 2024-09-19T09:03:08.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/525: mknod d5/d6/dc/cad 0 2024-09-19T09:03:08.024 INFO:tasks.workunit.client.0.smithi049.stdout:3/639: unlink c0 0 2024-09-19T09:03:08.025 INFO:tasks.workunit.client.0.smithi049.stdout:2/809: mknod d1/d2b/c112 0 2024-09-19T09:03:08.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/526: dread d5/d6/f6f [0,4194304] 0 2024-09-19T09:03:08.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/888: dwrite d1/d1a/da0/fbb [0,4194304] 0 2024-09-19T09:03:08.031 INFO:tasks.workunit.client.0.smithi049.stdout:7/889: chown d1/d1a/c73 1878 1 2024-09-19T09:03:08.032 INFO:tasks.workunit.client.0.smithi049.stdout:3/640: creat d10/d3d/d76/dac/dad/fda x:0 0 0 2024-09-19T09:03:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:2/810: dread - d1/d4/d1e/d9f/db7/fd9 zero size 2024-09-19T09:03:08.035 INFO:tasks.workunit.client.0.smithi049.stdout:7/890: dread d1/d8/d2d/d31/f47 [0,4194304] 0 2024-09-19T09:03:08.035 INFO:tasks.workunit.client.0.smithi049.stdout:6/566: rename dc/d16/f3d to dc/d1b/d78/fb0 0 2024-09-19T09:03:08.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/811: dread - d1/d4/d20/d92/fc2 zero size 2024-09-19T09:03:08.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/891: mknod d1/d1a/de7/c13e 0 2024-09-19T09:03:08.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/641: dwrite d10/d3d/d76/dac/dad/fc8 [0,4194304] 0 2024-09-19T09:03:08.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/892: rmdir d1/d1a 39 2024-09-19T09:03:08.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/893: stat d1/d8/d2d/d72/d11d 0 2024-09-19T09:03:08.046 INFO:tasks.workunit.client.0.smithi049.stdout:3/642: creat d10/d3d/d46/fdb x:0 0 0 2024-09-19T09:03:08.053 INFO:tasks.workunit.client.0.smithi049.stdout:7/894: dread d1/d53/dc6/f70 [0,4194304] 0 2024-09-19T09:03:08.058 INFO:tasks.workunit.client.0.smithi049.stdout:2/812: write d1/d2/d23/fce [211382,89438] 0 2024-09-19T09:03:08.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/567: truncate dc/d16/f18 6590396 0 2024-09-19T09:03:08.064 INFO:tasks.workunit.client.0.smithi049.stdout:2/813: creat d1/d4/d1e/d21/f113 x:0 0 0 2024-09-19T09:03:08.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/568: creat dc/d1b/d20/d81/d80/fb1 x:0 0 0 2024-09-19T09:03:08.066 INFO:tasks.workunit.client.0.smithi049.stdout:3/643: write d10/d3d/d76/da3/db7/fbd [990397,91112] 0 2024-09-19T09:03:08.067 INFO:tasks.workunit.client.0.smithi049.stdout:6/569: write dc/d1b/d20/f6c [4942810,67587] 0 2024-09-19T09:03:08.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/814: rename d1/d4/d20/d26 to d1/d2/d23/d49/d75/d114 0 2024-09-19T09:03:08.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/644: write d10/f34 [5134676,94912] 0 2024-09-19T09:03:08.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/895: dread d1/d8/d19/f34 [0,4194304] 0 2024-09-19T09:03:08.073 INFO:tasks.workunit.client.0.smithi049.stdout:2/815: mkdir d1/d2/d23/d115 0 2024-09-19T09:03:08.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/645: mkdir d10/d3d/d76/dac/dad/ddc 0 2024-09-19T09:03:08.077 INFO:tasks.workunit.client.0.smithi049.stdout:7/896: creat d1/d8/d80/f13f x:0 0 0 2024-09-19T09:03:08.079 INFO:tasks.workunit.client.0.smithi049.stdout:6/570: rmdir dc/d1b/d20/d81 39 2024-09-19T09:03:08.080 INFO:tasks.workunit.client.0.smithi049.stdout:2/816: dwrite d1/d4/d1e/d9f/fb1 [4194304,4194304] 0 2024-09-19T09:03:08.081 INFO:tasks.workunit.client.0.smithi049.stdout:6/571: write dc/d1b/d6f/f74 [2965572,49193] 0 2024-09-19T09:03:08.085 INFO:tasks.workunit.client.0.smithi049.stdout:2/817: fdatasync d1/d2/d32/f64 0 2024-09-19T09:03:08.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/818: fsync d1/d4/d1e/d21/ffb 0 2024-09-19T09:03:08.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/572: chown dc/d1b/d20/d2f/l49 988398 1 2024-09-19T09:03:08.091 INFO:tasks.workunit.client.0.smithi049.stdout:2/819: write d1/d2/d32/f64 [1606766,112304] 0 2024-09-19T09:03:08.096 INFO:tasks.workunit.client.0.smithi049.stdout:7/897: link d1/d1a/da0/dd3/d62/cc0 d1/d1a/da0/dd3/c140 0 2024-09-19T09:03:08.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/820: dread d1/d4/f2a [0,4194304] 0 2024-09-19T09:03:08.097 INFO:tasks.workunit.client.0.smithi049.stdout:6/573: creat dc/d1b/fb2 x:0 0 0 2024-09-19T09:03:08.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/574: mkdir dc/d1b/d78/db3 0 2024-09-19T09:03:08.100 INFO:tasks.workunit.client.0.smithi049.stdout:7/898: mknod d1/d1a/de7/d50/c141 0 2024-09-19T09:03:08.105 INFO:tasks.workunit.client.0.smithi049.stdout:2/821: dwrite d1/d4/d1e/d9f/db3/f85 [0,4194304] 0 2024-09-19T09:03:08.110 INFO:tasks.workunit.client.0.smithi049.stdout:2/822: write d1/d4/d1e/d9f/db3/d41/fa6 [1540713,120070] 0 2024-09-19T09:03:08.114 INFO:tasks.workunit.client.0.smithi049.stdout:7/899: dwrite d1/d8/d2d/d31/d6e/dfe/d10a/f10d [0,4194304] 0 2024-09-19T09:03:08.118 INFO:tasks.workunit.client.0.smithi049.stdout:7/900: truncate d1/d8/d2d/d36/fb7 244238 0 2024-09-19T09:03:08.121 INFO:tasks.workunit.client.0.smithi049.stdout:6/575: dread dc/d16/f3b [0,4194304] 0 2024-09-19T09:03:08.129 INFO:tasks.workunit.client.0.smithi049.stdout:2/823: truncate d1/d4/d1e/d9f/db7/ffe 10691264 0 2024-09-19T09:03:08.130 INFO:tasks.workunit.client.0.smithi049.stdout:7/901: write d1/d8/d2d/d36/d91/fa1 [1144184,97851] 0 2024-09-19T09:03:08.148 INFO:tasks.workunit.client.0.smithi049.stdout:7/902: dread d1/f68 [0,4194304] 0 2024-09-19T09:03:08.148 INFO:tasks.workunit.client.0.smithi049.stdout:7/903: chown d1/d8/d2d/d31/d6e/c78 306 1 2024-09-19T09:03:08.148 INFO:tasks.workunit.client.0.smithi049.stdout:7/904: dread - d1/d8/f5e zero size 2024-09-19T09:03:08.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/905: creat d1/d1a/da0/dd3/d62/d6b/d115/f142 x:0 0 0 2024-09-19T09:03:08.153 INFO:tasks.workunit.client.0.smithi049.stdout:7/906: mknod d1/d8/d2d/d72/c143 0 2024-09-19T09:03:08.153 INFO:tasks.workunit.client.0.smithi049.stdout:7/907: chown d1/d53/dc6/c11e 470 1 2024-09-19T09:03:08.163 INFO:tasks.workunit.client.0.smithi049.stdout:7/908: dwrite d1/d8/dda/fef [0,4194304] 0 2024-09-19T09:03:08.164 INFO:tasks.workunit.client.0.smithi049.stdout:7/909: readlink d1/d1a/l44 0 2024-09-19T09:03:08.171 INFO:tasks.workunit.client.0.smithi049.stdout:7/910: write d1/d53/f5b [396793,8277] 0 2024-09-19T09:03:08.177 INFO:tasks.workunit.client.0.smithi049.stdout:7/911: link d1/d1a/de7/d59/cc9 d1/d1a/de7/c144 0 2024-09-19T09:03:08.180 INFO:tasks.workunit.client.0.smithi049.stdout:7/912: readlink d1/d53/l25 0 2024-09-19T09:03:08.183 INFO:tasks.workunit.client.0.smithi049.stdout:7/913: link d1/d1a/de7/d59/fb2 d1/d8/d2d/d72/d11d/d99/f145 0 2024-09-19T09:03:08.185 INFO:tasks.workunit.client.0.smithi049.stdout:7/914: creat d1/d53/dc6/dd8/f146 x:0 0 0 2024-09-19T09:03:08.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/915: chown d1/d8/d2d/d36/fb7 699001 1 2024-09-19T09:03:08.204 INFO:tasks.workunit.client.0.smithi049.stdout:7/916: dwrite d1/d1a/de7/d59/fdb [0,4194304] 0 2024-09-19T09:03:08.213 INFO:tasks.workunit.client.0.smithi049.stdout:7/917: dread d1/d53/f85 [0,4194304] 0 2024-09-19T09:03:08.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/918: dread d1/d8/d2d/d31/f47 [0,4194304] 0 2024-09-19T09:03:08.225 INFO:tasks.workunit.client.0.smithi049.stdout:7/919: mknod d1/d1a/da0/dd3/d62/d6b/d10e/d13c/c147 0 2024-09-19T09:03:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:08 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:08.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:08 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:08.682 INFO:tasks.workunit.client.0.smithi049.stdout:5/653: sync 2024-09-19T09:03:08.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/800: sync 2024-09-19T09:03:08.682 INFO:tasks.workunit.client.0.smithi049.stdout:8/762: sync 2024-09-19T09:03:08.688 INFO:tasks.workunit.client.0.smithi049.stdout:5/654: mkdir d3/d5/de/dce 0 2024-09-19T09:03:08.688 INFO:tasks.workunit.client.0.smithi049.stdout:5/655: readlink d3/d5/l11 0 2024-09-19T09:03:08.695 INFO:tasks.workunit.client.0.smithi049.stdout:5/656: mknod d3/d5/d1c/d3a/d8f/ccf 0 2024-09-19T09:03:08.698 INFO:tasks.workunit.client.0.smithi049.stdout:0/801: dwrite d5/d10/d13/d15/d29/f57 [0,4194304] 0 2024-09-19T09:03:08.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/657: unlink d3/d5/de/d12/c66 0 2024-09-19T09:03:08.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/763: dwrite d1/d11/d4f/d87/d5d/dcb/d5b/fb9 [0,4194304] 0 2024-09-19T09:03:08.702 INFO:tasks.workunit.client.0.smithi049.stdout:5/658: creat d3/d5/de/d12/d97/fd0 x:0 0 0 2024-09-19T09:03:08.707 INFO:tasks.workunit.client.0.smithi049.stdout:8/764: link d1/d11/d4f/d87/d5d/dcb/d5b/fd0 d1/d11/d4f/d87/d5d/d65/fe6 0 2024-09-19T09:03:08.708 INFO:tasks.workunit.client.0.smithi049.stdout:5/659: truncate d3/f10 2618715 0 2024-09-19T09:03:08.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/765: rmdir d1/d11/d4f/d87/d5d/d65 39 2024-09-19T09:03:08.785 INFO:tasks.workunit.client.0.smithi049.stdout:5/660: link d3/d5/d1c/d2d/d89/cae d3/d5/de/d12/d45/d7a/cd1 0 2024-09-19T09:03:08.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/766: dwrite d1/d11/d4f/d87/d5d/d65/fcd [0,4194304] 0 2024-09-19T09:03:08.790 INFO:tasks.workunit.client.0.smithi049.stdout:8/767: write d1/d11/d4f/d87/d5d/dcb/d8c/fcc [2370849,89805] 0 2024-09-19T09:03:08.791 INFO:tasks.workunit.client.0.smithi049.stdout:5/661: rename d3/d5/d1c/d3a/d8f to d3/d5/d1c/dd2 0 2024-09-19T09:03:08.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/662: read d3/f62 [1025150,77250] 0 2024-09-19T09:03:08.794 INFO:tasks.workunit.client.0.smithi049.stdout:5/663: readlink d3/d5/de/d4a/dbd/lc8 0 2024-09-19T09:03:08.797 INFO:tasks.workunit.client.0.smithi049.stdout:5/664: write d3/d5/f1b [5159358,24943] 0 2024-09-19T09:03:08.800 INFO:tasks.workunit.client.0.smithi049.stdout:5/665: mknod d3/d6c/d6d/da1/cd3 0 2024-09-19T09:03:08.801 INFO:tasks.workunit.client.0.smithi049.stdout:8/768: write d1/d27/fc6 [610502,75449] 0 2024-09-19T09:03:08.804 INFO:tasks.workunit.client.0.smithi049.stdout:8/769: creat d1/d11/d4f/d87/d5d/dcb/d8c/fe7 x:0 0 0 2024-09-19T09:03:08.972 INFO:tasks.workunit.client.0.smithi049.stdout:2/824: sync 2024-09-19T09:03:08.972 INFO:tasks.workunit.client.0.smithi049.stdout:6/576: sync 2024-09-19T09:03:08.972 INFO:tasks.workunit.client.0.smithi049.stdout:1/527: sync 2024-09-19T09:03:08.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/563: sync 2024-09-19T09:03:08.972 INFO:tasks.workunit.client.0.smithi049.stdout:7/920: sync 2024-09-19T09:03:08.972 INFO:tasks.workunit.client.0.smithi049.stdout:3/646: sync 2024-09-19T09:03:08.974 INFO:tasks.workunit.client.0.smithi049.stdout:7/921: fdatasync d1/d1a/de7/d59/fdb 0 2024-09-19T09:03:08.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/577: chown dc/d1b/d20/d2f/d53/fa1 1175 1 2024-09-19T09:03:08.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/825: write d1/d4/d1e/d21/f22 [411412,85462] 0 2024-09-19T09:03:08.979 INFO:tasks.workunit.client.0.smithi049.stdout:4/564: dread d4/d15/f65 [0,4194304] 0 2024-09-19T09:03:08.980 INFO:tasks.workunit.client.0.smithi049.stdout:4/565: truncate d4/d4c/f8a 91430 0 2024-09-19T09:03:08.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/826: dwrite d1/d2/d23/d10c/f10f [0,4194304] 0 2024-09-19T09:03:09.081 INFO:tasks.workunit.client.0.smithi049.stdout:1/528: rename d5/d6/d19/d30/d63/l8f to d5/d6/d73/da8/lae 0 2024-09-19T09:03:09.081 INFO:tasks.workunit.client.0.smithi049.stdout:1/529: stat d5/d6/d8/d13/d24/l79 0 2024-09-19T09:03:09.082 INFO:tasks.workunit.client.0.smithi049.stdout:7/922: rmdir d1/d1a/da0 39 2024-09-19T09:03:09.083 INFO:tasks.workunit.client.0.smithi049.stdout:6/578: readlink dc/d1b/d20/d7f/la0 0 2024-09-19T09:03:09.088 INFO:tasks.workunit.client.0.smithi049.stdout:2/827: unlink d1/d4/d1e/d21/fa8 0 2024-09-19T09:03:09.090 INFO:tasks.workunit.client.0.smithi049.stdout:3/647: dwrite d10/d3d/d51/fd6 [0,4194304] 0 2024-09-19T09:03:09.091 INFO:tasks.workunit.client.0.smithi049.stdout:2/828: read d1/d4/d1e/d45/faa [2558254,40133] 0 2024-09-19T09:03:09.092 INFO:tasks.workunit.client.0.smithi049.stdout:3/648: readlink d10/d3d/d76/da3/db7/ld2 0 2024-09-19T09:03:09.100 INFO:tasks.workunit.client.0.smithi049.stdout:4/566: write d4/d34/d3d/d62/f64 [1453268,125047] 0 2024-09-19T09:03:09.102 INFO:tasks.workunit.client.0.smithi049.stdout:7/923: mkdir d1/d8/d2d/d72/d11d/d9c/d131/d138/d148 0 2024-09-19T09:03:09.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/829: creat d1/d2/d70/df3/f116 x:0 0 0 2024-09-19T09:03:09.111 INFO:tasks.workunit.client.0.smithi049.stdout:1/530: getdents d5/d6/d8/d13/d24/d7e 0 2024-09-19T09:03:09.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/830: rmdir d1/d4/d1e/d9f/db7 39 2024-09-19T09:03:09.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/531: write d5/d6/fa [2501769,46722] 0 2024-09-19T09:03:09.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/579: dwrite dc/d1b/f77 [0,4194304] 0 2024-09-19T09:03:09.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/649: dread d10/d11/d13/d30/f31 [0,4194304] 0 2024-09-19T09:03:09.120 INFO:tasks.workunit.client.0.smithi049.stdout:7/924: rename d1/d53 to d1/d8/d149 0 2024-09-19T09:03:09.123 INFO:tasks.workunit.client.0.smithi049.stdout:6/580: mkdir dc/d1b/d20/d2f/db4 0 2024-09-19T09:03:09.124 INFO:tasks.workunit.client.0.smithi049.stdout:6/581: stat dc/d1b/f77 0 2024-09-19T09:03:09.124 INFO:tasks.workunit.client.0.smithi049.stdout:7/925: mknod d1/c14a 0 2024-09-19T09:03:09.126 INFO:tasks.workunit.client.0.smithi049.stdout:3/650: truncate d10/f5c 2655313 0 2024-09-19T09:03:09.126 INFO:tasks.workunit.client.0.smithi049.stdout:7/926: write d1/d1a/de7/d50/daa/f12d [386617,85341] 0 2024-09-19T09:03:09.129 INFO:tasks.workunit.client.0.smithi049.stdout:2/831: write d1/d2/d23/d49/d75/fc1 [1185231,26670] 0 2024-09-19T09:03:09.130 INFO:tasks.workunit.client.0.smithi049.stdout:7/927: write d1/d8/d89/ff8 [2611315,40559] 0 2024-09-19T09:03:09.130 INFO:tasks.workunit.client.0.smithi049.stdout:3/651: dread - d10/d3d/d79/fb3 zero size 2024-09-19T09:03:09.130 INFO:tasks.workunit.client.0.smithi049.stdout:1/532: dread d5/d6/d8/d13/f12 [0,4194304] 0 2024-09-19T09:03:09.132 INFO:tasks.workunit.client.0.smithi049.stdout:3/652: fdatasync d10/d3d/f4a 0 2024-09-19T09:03:09.132 INFO:tasks.workunit.client.0.smithi049.stdout:6/582: creat dc/fb5 x:0 0 0 2024-09-19T09:03:09.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/928: fdatasync d1/d8/d2d/d72/d105/f120 0 2024-09-19T09:03:09.136 INFO:tasks.workunit.client.0.smithi049.stdout:2/832: mkdir d1/d4/d1e/d21/d8c/d117 0 2024-09-19T09:03:09.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/533: dwrite d5/d6/f38 [0,4194304] 0 2024-09-19T09:03:09.140 INFO:tasks.workunit.client.0.smithi049.stdout:7/929: truncate d1/d8/d19/f46 4006806 0 2024-09-19T09:03:09.143 INFO:tasks.workunit.client.0.smithi049.stdout:3/653: dread d10/d11/d13/d30/f6d [0,4194304] 0 2024-09-19T09:03:09.145 INFO:tasks.workunit.client.0.smithi049.stdout:1/534: creat d5/d6/d19/d30/faf x:0 0 0 2024-09-19T09:03:09.151 INFO:tasks.workunit.client.0.smithi049.stdout:3/654: dwrite d10/d3d/d76/da3/db7/fbd [0,4194304] 0 2024-09-19T09:03:09.153 INFO:tasks.workunit.client.0.smithi049.stdout:6/583: dread dc/d1b/f57 [0,4194304] 0 2024-09-19T09:03:09.156 INFO:tasks.workunit.client.0.smithi049.stdout:6/584: read dc/d1b/d20/d2f/f3f [1466331,51580] 0 2024-09-19T09:03:09.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/655: unlink d10/d3d/d79/fa4 0 2024-09-19T09:03:09.158 INFO:tasks.workunit.client.0.smithi049.stdout:7/930: write d1/f2 [1676170,82586] 0 2024-09-19T09:03:09.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/656: rename d10/d3d to d10/d3d/d76/da3/ddd 22 2024-09-19T09:03:09.161 INFO:tasks.workunit.client.0.smithi049.stdout:6/585: write dc/d1b/d20/d81/f27 [1068899,25675] 0 2024-09-19T09:03:09.162 INFO:tasks.workunit.client.0.smithi049.stdout:7/931: mkdir d1/d8/dda/d14b 0 2024-09-19T09:03:09.168 INFO:tasks.workunit.client.0.smithi049.stdout:7/932: dwrite d1/d8/d89/f119 [0,4194304] 0 2024-09-19T09:03:09.169 INFO:tasks.workunit.client.0.smithi049.stdout:6/586: mknod dc/d1b/d20/d81/cb6 0 2024-09-19T09:03:09.171 INFO:tasks.workunit.client.0.smithi049.stdout:7/933: dread - d1/d8/d2d/d36/d91/fd5 zero size 2024-09-19T09:03:09.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/934: dread - d1/d8/d2d/d72/d11d/d99/f132 zero size 2024-09-19T09:03:09.173 INFO:tasks.workunit.client.0.smithi049.stdout:3/657: getdents d10/d3d/d76/dac 0 2024-09-19T09:03:09.178 INFO:tasks.workunit.client.0.smithi049.stdout:3/658: rename d10/d11/d13/dbc/dcd/f8a to d10/d11/d13/d30/fde 0 2024-09-19T09:03:09.185 INFO:tasks.workunit.client.0.smithi049.stdout:3/659: getdents d10/db8 0 2024-09-19T09:03:09.187 INFO:tasks.workunit.client.0.smithi049.stdout:6/587: dwrite dc/d1b/f38 [0,4194304] 0 2024-09-19T09:03:09.189 INFO:tasks.workunit.client.0.smithi049.stdout:7/935: truncate d1/d8/d2d/d36/d91/fe6 4075993 0 2024-09-19T09:03:09.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/936: chown d1/d8/d2d/d72/d11d/c123 38 1 2024-09-19T09:03:09.192 INFO:tasks.workunit.client.0.smithi049.stdout:7/937: dread - d1/d8/d2d/d72/d11d/d99/f132 zero size 2024-09-19T09:03:09.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/660: mknod d10/d3d/d76/dac/cdf 0 2024-09-19T09:03:09.198 INFO:tasks.workunit.client.0.smithi049.stdout:7/938: symlink d1/d8/d149/dc6/l14c 0 2024-09-19T09:03:09.198 INFO:tasks.workunit.client.0.smithi049.stdout:5/666: sync 2024-09-19T09:03:09.198 INFO:tasks.workunit.client.0.smithi049.stdout:0/802: sync 2024-09-19T09:03:09.200 INFO:tasks.workunit.client.0.smithi049.stdout:3/661: dread d10/d3d/d76/fb2 [0,4194304] 0 2024-09-19T09:03:09.201 INFO:tasks.workunit.client.0.smithi049.stdout:0/803: write d5/d10/d13/d15/f1b [3333056,51948] 0 2024-09-19T09:03:09.201 INFO:tasks.workunit.client.0.smithi049.stdout:6/588: link dc/d1b/l30 dc/d1b/d20/d81/d5a/dae/lb7 0 2024-09-19T09:03:09.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/804: chown d5/d10/d2f 19 1 2024-09-19T09:03:09.204 INFO:tasks.workunit.client.0.smithi049.stdout:6/589: write dc/d1b/d6f/faf [826495,20811] 0 2024-09-19T09:03:09.205 INFO:tasks.workunit.client.0.smithi049.stdout:6/590: fsync dc/fb5 0 2024-09-19T09:03:09.208 INFO:tasks.workunit.client.0.smithi049.stdout:3/662: chown d10/d11/d27/c77 3868076 1 2024-09-19T09:03:09.208 INFO:tasks.workunit.client.0.smithi049.stdout:7/939: dwrite d1/d8/d149/dc6/dd8/f146 [0,4194304] 0 2024-09-19T09:03:09.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/591: chown dc/d1b/d20/d81/c79 8382253 1 2024-09-19T09:03:09.222 INFO:tasks.workunit.client.0.smithi049.stdout:3/663: dwrite d10/d11/d13/d7e/f85 [0,4194304] 0 2024-09-19T09:03:09.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/940: write d1/d1a/da0/dd3/d62/f110 [467449,119606] 0 2024-09-19T09:03:09.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/941: readlink d1/d8/d2d/l10c 0 2024-09-19T09:03:09.250 INFO:tasks.workunit.client.0.smithi049.stdout:7/942: stat d1/d8/ld 0 2024-09-19T09:03:09.250 INFO:tasks.workunit.client.0.smithi049.stdout:3/664: chown d10/d11/c5b 859411378 1 2024-09-19T09:03:09.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/943: stat d1/d8/df2/f125 0 2024-09-19T09:03:09.252 INFO:tasks.workunit.client.0.smithi049.stdout:7/944: dread - d1/d1a/fcb zero size 2024-09-19T09:03:09.253 INFO:tasks.workunit.client.0.smithi049.stdout:3/665: mknod d10/d3d/d46/d84/ce0 0 2024-09-19T09:03:09.253 INFO:tasks.workunit.client.0.smithi049.stdout:3/666: stat d10/d3d/d76/da3/db7/fbd 0 2024-09-19T09:03:09.265 INFO:tasks.workunit.client.0.smithi049.stdout:7/945: dread d1/d1a/de7/d59/f29 [0,4194304] 0 2024-09-19T09:03:09.267 INFO:tasks.workunit.client.0.smithi049.stdout:7/946: read - d1/d8/d2d/d31/fcc zero size 2024-09-19T09:03:09.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/947: fdatasync d1/d8/d149/dc6/f4c 0 2024-09-19T09:03:09.273 INFO:tasks.workunit.client.0.smithi049.stdout:7/948: fdatasync d1/d8/d149/f5d 0 2024-09-19T09:03:09.280 INFO:tasks.workunit.client.0.smithi049.stdout:7/949: dwrite d1/d8/d2d/d72/d105/f120 [0,4194304] 0 2024-09-19T09:03:09.281 INFO:tasks.workunit.client.0.smithi049.stdout:6/592: truncate dc/d1b/d6f/faf 439522 0 2024-09-19T09:03:09.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/950: mknod d1/d8/d2d/d31/d6e/dfe/d10a/c14d 0 2024-09-19T09:03:09.286 INFO:tasks.workunit.client.0.smithi049.stdout:6/593: symlink dc/d16/lb8 0 2024-09-19T09:03:09.291 INFO:tasks.workunit.client.0.smithi049.stdout:3/667: dwrite d10/d11/d13/f67 [0,4194304] 0 2024-09-19T09:03:09.292 INFO:tasks.workunit.client.0.smithi049.stdout:6/594: rename dc/d1b/d20/d81/fac to dc/d1b/d20/d2f/d4c/fb9 0 2024-09-19T09:03:09.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/668: read d10/f48 [3167308,32045] 0 2024-09-19T09:03:09.294 INFO:tasks.workunit.client.0.smithi049.stdout:6/595: write dc/d1b/d20/d2f/d6b/d73/fa4 [765121,130840] 0 2024-09-19T09:03:09.305 INFO:tasks.workunit.client.0.smithi049.stdout:6/596: fsync dc/d1b/d20/fad 0 2024-09-19T09:03:09.306 INFO:tasks.workunit.client.0.smithi049.stdout:3/669: mkdir d10/d3d/d76/dac/dad/de1 0 2024-09-19T09:03:09.309 INFO:tasks.workunit.client.0.smithi049.stdout:3/670: symlink d10/d3d/d76/le2 0 2024-09-19T09:03:09.313 INFO:tasks.workunit.client.0.smithi049.stdout:6/597: dwrite dc/fb5 [0,4194304] 0 2024-09-19T09:03:09.314 INFO:tasks.workunit.client.0.smithi049.stdout:6/598: fsync dc/d1b/d20/d81/f15 0 2024-09-19T09:03:09.314 INFO:tasks.workunit.client.0.smithi049.stdout:3/671: mkdir d10/d3d/d76/da3/db7/de3 0 2024-09-19T09:03:09.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/672: symlink d10/d11/d27/d4f/le4 0 2024-09-19T09:03:09.322 INFO:tasks.workunit.client.0.smithi049.stdout:6/599: truncate dc/d1b/d20/d81/d5a/f9a 61883 0 2024-09-19T09:03:09.322 INFO:tasks.workunit.client.0.smithi049.stdout:6/600: chown dc/l10 0 1 2024-09-19T09:03:09.323 INFO:tasks.workunit.client.0.smithi049.stdout:3/673: symlink d10/d3d/d79/le5 0 2024-09-19T09:03:09.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/674: symlink d10/d11/d27/le6 0 2024-09-19T09:03:09.335 INFO:tasks.workunit.client.0.smithi049.stdout:3/675: dwrite d10/d11/d13/d30/f9b [0,4194304] 0 2024-09-19T09:03:09.335 INFO:tasks.workunit.client.0.smithi049.stdout:6/601: dread dc/d1b/d20/d81/f14 [4194304,4194304] 0 2024-09-19T09:03:09.341 INFO:tasks.workunit.client.0.smithi049.stdout:3/676: creat d10/d11/d13/dbc/dcd/fe7 x:0 0 0 2024-09-19T09:03:09.342 INFO:tasks.workunit.client.0.smithi049.stdout:6/602: dwrite dc/d16/d88/f8e [0,4194304] 0 2024-09-19T09:03:09.347 INFO:tasks.workunit.client.0.smithi049.stdout:3/677: rename d10/d3d/d46/l6a to d10/d3d/d76/dac/dad/le8 0 2024-09-19T09:03:09.347 INFO:tasks.workunit.client.0.smithi049.stdout:6/603: rename dc to dc/d1b/d20/d81/d6e/dba 22 2024-09-19T09:03:09.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/678: write d10/d3d/d76/da3/fb9 [1169315,124309] 0 2024-09-19T09:03:09.352 INFO:tasks.workunit.client.0.smithi049.stdout:6/604: mknod dc/d1b/d20/d2f/d53/cbb 0 2024-09-19T09:03:09.357 INFO:tasks.workunit.client.0.smithi049.stdout:3/679: symlink d10/d3d/d76/dac/le9 0 2024-09-19T09:03:09.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/605: creat dc/d1b/d78/db3/fbc x:0 0 0 2024-09-19T09:03:09.360 INFO:tasks.workunit.client.0.smithi049.stdout:6/606: write dc/d1b/d20/d2f/d6b/d73/fa4 [1234615,54738] 0 2024-09-19T09:03:09.361 INFO:tasks.workunit.client.0.smithi049.stdout:3/680: chown d10/d11/d13/l91 152976 1 2024-09-19T09:03:09.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/607: fdatasync dc/d1b/d20/d7f/f8c 0 2024-09-19T09:03:09.363 INFO:tasks.workunit.client.0.smithi049.stdout:3/681: fdatasync d10/f70 0 2024-09-19T09:03:09.364 INFO:tasks.workunit.client.0.smithi049.stdout:3/682: chown fd 0 1 2024-09-19T09:03:09.368 INFO:tasks.workunit.client.0.smithi049.stdout:3/683: unlink d10/d11/d27/le6 0 2024-09-19T09:03:09.369 INFO:tasks.workunit.client.0.smithi049.stdout:6/608: dwrite dc/d1b/d20/d81/d6e/f76 [0,4194304] 0 2024-09-19T09:03:09.376 INFO:tasks.workunit.client.0.smithi049.stdout:3/684: creat d10/d3d/d76/da3/db7/de3/fea x:0 0 0 2024-09-19T09:03:09.377 INFO:tasks.workunit.client.0.smithi049.stdout:6/609: write dc/d1b/d20/d2f/d31/f5d [3795201,41535] 0 2024-09-19T09:03:09.379 INFO:tasks.workunit.client.0.smithi049.stdout:3/685: chown d10/d11/l4d 7463370 1 2024-09-19T09:03:09.381 INFO:tasks.workunit.client.0.smithi049.stdout:3/686: write d10/d3d/d51/fd6 [4051742,109015] 0 2024-09-19T09:03:09.385 INFO:tasks.workunit.client.0.smithi049.stdout:6/610: mknod dc/cbd 0 2024-09-19T09:03:09.390 INFO:tasks.workunit.client.0.smithi049.stdout:3/687: dwrite d10/d11/d27/d4f/d59/d81/fd5 [0,4194304] 0 2024-09-19T09:03:09.392 INFO:tasks.workunit.client.0.smithi049.stdout:3/688: stat d10/d11/d13/d7e 0 2024-09-19T09:03:09.397 INFO:tasks.workunit.client.0.smithi049.stdout:6/611: rename dc/d1b/d20/c5f to dc/d1b/d78/cbe 0 2024-09-19T09:03:09.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/612: dread - dc/d1b/d20/d7f/f8c zero size 2024-09-19T09:03:09.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/770: sync 2024-09-19T09:03:09.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/771: stat d1/f39 0 2024-09-19T09:03:09.441 INFO:tasks.workunit.client.0.smithi049.stdout:6/613: symlink dc/d1b/d78/lbf 0 2024-09-19T09:03:09.441 INFO:tasks.workunit.client.0.smithi049.stdout:3/689: truncate d10/d11/d13/dbc/dcd/f93 2200596 0 2024-09-19T09:03:09.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/614: chown dc/d1b/d78/db3/fbc 2027455 1 2024-09-19T09:03:09.443 INFO:tasks.workunit.client.0.smithi049.stdout:8/772: fsync d1/d11/d2e/f56 0 2024-09-19T09:03:09.449 INFO:tasks.workunit.client.0.smithi049.stdout:8/773: creat d1/d27/fe8 x:0 0 0 2024-09-19T09:03:09.456 INFO:tasks.workunit.client.0.smithi049.stdout:6/615: creat dc/fc0 x:0 0 0 2024-09-19T09:03:09.462 INFO:tasks.workunit.client.0.smithi049.stdout:6/616: dwrite dc/d1b/d78/db3/fbc [0,4194304] 0 2024-09-19T09:03:09.466 INFO:tasks.workunit.client.0.smithi049.stdout:6/617: mknod dc/d1b/d20/d81/d5a/cc1 0 2024-09-19T09:03:09.468 INFO:tasks.workunit.client.0.smithi049.stdout:6/618: write dc/d1b/d20/d2f/d31/f5d [99120,97137] 0 2024-09-19T09:03:09.468 INFO:tasks.workunit.client.0.smithi049.stdout:6/619: chown dc/fc0 3677614 1 2024-09-19T09:03:09.499 INFO:tasks.workunit.client.0.smithi049.stdout:6/620: unlink dc/d1b/d20/d2f/d6b/l86 0 2024-09-19T09:03:09.501 INFO:tasks.workunit.client.0.smithi049.stdout:6/621: symlink dc/d1b/d20/d2f/db4/lc2 0 2024-09-19T09:03:09.506 INFO:tasks.workunit.client.0.smithi049.stdout:6/622: link dc/d1b/d20/d2f/f3f dc/d1b/d20/d2f/d4c/fc3 0 2024-09-19T09:03:09.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:09 smithi102 ceph-mon[35280]: pgmap v41: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 102 MiB/s wr, 273 op/s 2024-09-19T09:03:09.517 INFO:tasks.workunit.client.0.smithi049.stdout:8/774: dwrite d1/d11/d4f/d87/d5d/d65/fcd [4194304,4194304] 0 2024-09-19T09:03:09.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/775: dread - d1/d11/d4f/d87/d5d/dcb/d8c/fe7 zero size 2024-09-19T09:03:09.523 INFO:tasks.workunit.client.0.smithi049.stdout:8/776: read d1/f77 [3864240,79163] 0 2024-09-19T09:03:09.545 INFO:tasks.workunit.client.0.smithi049.stdout:6/623: truncate dc/d1b/d20/d81/f27 1902469 0 2024-09-19T09:03:09.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:09 smithi049 ceph-mon[28158]: pgmap v41: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 102 MiB/s wr, 273 op/s 2024-09-19T09:03:09.555 INFO:tasks.workunit.client.0.smithi049.stdout:8/777: dwrite d1/d11/d2e/d4e/f88 [0,4194304] 0 2024-09-19T09:03:09.560 INFO:tasks.workunit.client.0.smithi049.stdout:8/778: fsync d1/d11/d4f/f66 0 2024-09-19T09:03:09.561 INFO:tasks.workunit.client.0.smithi049.stdout:6/624: dread dc/d16/f18 [0,4194304] 0 2024-09-19T09:03:09.563 INFO:tasks.workunit.client.0.smithi049.stdout:6/625: truncate dc/d1b/f77 4570657 0 2024-09-19T09:03:09.567 INFO:tasks.workunit.client.0.smithi049.stdout:8/779: rename d1/d11/d4f/d87/d5d/dcb to d1/d11/d4f/d87/d7a/de9 0 2024-09-19T09:03:09.570 INFO:tasks.workunit.client.0.smithi049.stdout:6/626: mkdir dc/d1b/d20/d2f/d4c/dc4 0 2024-09-19T09:03:09.572 INFO:tasks.workunit.client.0.smithi049.stdout:8/780: mknod d1/d11/d4f/d87/d5d/cea 0 2024-09-19T09:03:09.576 INFO:tasks.workunit.client.0.smithi049.stdout:6/627: symlink dc/d1b/d20/d81/d6e/lc5 0 2024-09-19T09:03:09.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/628: link dc/d1b/f77 dc/d1b/d20/d81/d80/fc6 0 2024-09-19T09:03:09.587 INFO:tasks.workunit.client.0.smithi049.stdout:8/781: write d1/d11/d4f/d87/f7f [379685,41826] 0 2024-09-19T09:03:09.590 INFO:tasks.workunit.client.0.smithi049.stdout:8/782: symlink d1/d11/d4f/leb 0 2024-09-19T09:03:09.591 INFO:tasks.workunit.client.0.smithi049.stdout:8/783: chown d1/d11/d4f/d87/f7f 224416882 1 2024-09-19T09:03:09.594 INFO:tasks.workunit.client.0.smithi049.stdout:8/784: write d1/d11/d4f/d87/d7a/de9/d8c/fae [4435259,26315] 0 2024-09-19T09:03:09.595 INFO:tasks.workunit.client.0.smithi049.stdout:6/629: dread dc/d1b/d20/d81/f85 [0,4194304] 0 2024-09-19T09:03:09.596 INFO:tasks.workunit.client.0.smithi049.stdout:6/630: chown dc/d1b/d20/d2f/da6 170976185 1 2024-09-19T09:03:09.597 INFO:tasks.workunit.client.0.smithi049.stdout:6/631: write dc/d16/d88/f8e [5206664,773] 0 2024-09-19T09:03:09.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/785: creat d1/d11/d2e/d4e/d61/d9f/fec x:0 0 0 2024-09-19T09:03:09.598 INFO:tasks.workunit.client.0.smithi049.stdout:6/632: stat dc/cbd 0 2024-09-19T09:03:09.598 INFO:tasks.workunit.client.0.smithi049.stdout:6/633: chown dc 1309957 1 2024-09-19T09:03:09.600 INFO:tasks.workunit.client.0.smithi049.stdout:8/786: creat d1/d27/fed x:0 0 0 2024-09-19T09:03:09.601 INFO:tasks.workunit.client.0.smithi049.stdout:6/634: symlink dc/d1b/d20/d81/d5a/dae/lc7 0 2024-09-19T09:03:09.605 INFO:tasks.workunit.client.0.smithi049.stdout:6/635: dread dc/d1b/f57 [0,4194304] 0 2024-09-19T09:03:09.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/567: sync 2024-09-19T09:03:09.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/787: getdents d1/d11/d4f 0 2024-09-19T09:03:09.606 INFO:tasks.workunit.client.0.smithi049.stdout:6/636: readlink dc/d16/l75 0 2024-09-19T09:03:09.609 INFO:tasks.workunit.client.0.smithi049.stdout:4/568: creat d4/d6c/d74/fac x:0 0 0 2024-09-19T09:03:09.613 INFO:tasks.workunit.client.0.smithi049.stdout:6/637: dwrite dc/d1b/d20/d2f/d31/f69 [0,4194304] 0 2024-09-19T09:03:09.613 INFO:tasks.workunit.client.0.smithi049.stdout:4/569: creat d4/d15/d19/d1f/d55/d7f/fad x:0 0 0 2024-09-19T09:03:09.615 INFO:tasks.workunit.client.0.smithi049.stdout:4/570: write d4/d15/d19/f68 [1119042,6777] 0 2024-09-19T09:03:09.615 INFO:tasks.workunit.client.0.smithi049.stdout:6/638: dread - dc/d1b/d20/d2f/d4c/fb9 zero size 2024-09-19T09:03:09.620 INFO:tasks.workunit.client.0.smithi049.stdout:4/571: truncate f2 2221449 0 2024-09-19T09:03:09.621 INFO:tasks.workunit.client.0.smithi049.stdout:4/572: dread - d4/d6c/d74/fac zero size 2024-09-19T09:03:09.622 INFO:tasks.workunit.client.0.smithi049.stdout:6/639: creat dc/fc8 x:0 0 0 2024-09-19T09:03:09.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/573: mkdir d4/d45/d3f/dae 0 2024-09-19T09:03:09.633 INFO:tasks.workunit.client.0.smithi049.stdout:4/574: creat d4/d45/d3f/d47/faf x:0 0 0 2024-09-19T09:03:09.634 INFO:tasks.workunit.client.0.smithi049.stdout:6/640: link dc/d1b/c58 dc/d1b/d20/d2f/d4c/dc4/cc9 0 2024-09-19T09:03:09.637 INFO:tasks.workunit.client.0.smithi049.stdout:4/575: creat d4/d34/d3d/d62/d76/fb0 x:0 0 0 2024-09-19T09:03:09.646 INFO:tasks.workunit.client.0.smithi049.stdout:4/576: dwrite d4/d45/d3f/d47/f81 [0,4194304] 0 2024-09-19T09:03:09.649 INFO:tasks.workunit.client.0.smithi049.stdout:8/788: write d1/d11/d2e/d4e/d61/fc5 [982918,88782] 0 2024-09-19T09:03:09.654 INFO:tasks.workunit.client.0.smithi049.stdout:8/789: creat d1/d11/d4f/d87/d7a/de9/fee x:0 0 0 2024-09-19T09:03:09.657 INFO:tasks.workunit.client.0.smithi049.stdout:8/790: write d1/d11/d2e/d4e/f88 [4666671,63351] 0 2024-09-19T09:03:09.657 INFO:tasks.workunit.client.0.smithi049.stdout:4/577: creat d4/d15/d19/d7b/fb1 x:0 0 0 2024-09-19T09:03:09.662 INFO:tasks.workunit.client.0.smithi049.stdout:6/641: dread dc/d1b/d20/d81/d5a/f60 [0,4194304] 0 2024-09-19T09:03:09.664 INFO:tasks.workunit.client.0.smithi049.stdout:8/791: creat d1/d11/d2e/d4e/d61/d9f/fef x:0 0 0 2024-09-19T09:03:09.666 INFO:tasks.workunit.client.0.smithi049.stdout:4/578: mknod d4/d15/d19/d1f/d77/cb2 0 2024-09-19T09:03:09.668 INFO:tasks.workunit.client.0.smithi049.stdout:4/579: dread - d4/d6c/d74/fac zero size 2024-09-19T09:03:09.670 INFO:tasks.workunit.client.0.smithi049.stdout:6/642: dread dc/d1b/d20/d81/d5a/f9a [0,4194304] 0 2024-09-19T09:03:09.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/792: dwrite d1/d11/d2e/d4e/f88 [0,4194304] 0 2024-09-19T09:03:09.678 INFO:tasks.workunit.client.0.smithi049.stdout:6/643: readlink dc/d1b/d20/d2f/d31/l3e 0 2024-09-19T09:03:09.679 INFO:tasks.workunit.client.0.smithi049.stdout:8/793: dread d1/d11/d2e/d4e/d61/d9f/fb4 [0,4194304] 0 2024-09-19T09:03:09.682 INFO:tasks.workunit.client.0.smithi049.stdout:6/644: symlink dc/d1b/d20/d2f/d6b/lca 0 2024-09-19T09:03:09.687 INFO:tasks.workunit.client.0.smithi049.stdout:8/794: unlink d1/d11/d4f/d87/d7a/de9/d8c/fcc 0 2024-09-19T09:03:09.687 INFO:tasks.workunit.client.0.smithi049.stdout:4/580: dread d4/f69 [0,4194304] 0 2024-09-19T09:03:09.691 INFO:tasks.workunit.client.0.smithi049.stdout:6/645: dread dc/d1b/d6f/faf [0,4194304] 0 2024-09-19T09:03:09.691 INFO:tasks.workunit.client.0.smithi049.stdout:6/646: read dc/d16/f18 [1198499,19328] 0 2024-09-19T09:03:09.692 INFO:tasks.workunit.client.0.smithi049.stdout:6/647: chown dc/d16/f4a 599 1 2024-09-19T09:03:09.696 INFO:tasks.workunit.client.0.smithi049.stdout:6/648: symlink dc/d1b/d20/d2f/d4c/lcb 0 2024-09-19T09:03:09.696 INFO:tasks.workunit.client.0.smithi049.stdout:4/581: link d4/d15/c56 d4/d15/d19/d7b/cb3 0 2024-09-19T09:03:09.698 INFO:tasks.workunit.client.0.smithi049.stdout:4/582: chown d4/d15/d19/d1f/d55/d7f/la1 3627654 1 2024-09-19T09:03:09.700 INFO:tasks.workunit.client.0.smithi049.stdout:4/583: read d4/d34/d3d/d62/f98 [3062407,74908] 0 2024-09-19T09:03:09.701 INFO:tasks.workunit.client.0.smithi049.stdout:6/649: dread dc/d1b/d20/d2f/d6b/d73/fa4 [0,4194304] 0 2024-09-19T09:03:09.702 INFO:tasks.workunit.client.0.smithi049.stdout:6/650: read dc/d1b/d20/d81/f14 [4001858,115881] 0 2024-09-19T09:03:09.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/651: dread dc/d1b/d20/d2f/d6b/d73/fa4 [0,4194304] 0 2024-09-19T09:03:09.705 INFO:tasks.workunit.client.0.smithi049.stdout:4/584: mknod d4/d4c/cb4 0 2024-09-19T09:03:09.708 INFO:tasks.workunit.client.0.smithi049.stdout:6/652: dread dc/d1b/f38 [0,4194304] 0 2024-09-19T09:03:09.708 INFO:tasks.workunit.client.0.smithi049.stdout:8/795: write d1/d11/d45/f91 [1019194,94346] 0 2024-09-19T09:03:09.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/585: rename d4/d15/d19/d1f/ca7 to d4/d34/d3d/cb5 0 2024-09-19T09:03:09.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/796: fsync d1/fa5 0 2024-09-19T09:03:09.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/653: rmdir dc/d1b/d20/d81 39 2024-09-19T09:03:09.715 INFO:tasks.workunit.client.0.smithi049.stdout:4/586: dwrite d4/d45/f8e [0,4194304] 0 2024-09-19T09:03:09.718 INFO:tasks.workunit.client.0.smithi049.stdout:8/797: symlink d1/d11/d4f/d87/d5d/d65/lf0 0 2024-09-19T09:03:09.719 INFO:tasks.workunit.client.0.smithi049.stdout:8/798: read d1/d11/d4f/d87/d5d/d65/fcd [6341810,23875] 0 2024-09-19T09:03:09.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/654: stat dc/d1b/d20/c41 0 2024-09-19T09:03:09.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/587: mkdir d4/d15/d19/d1f/d77/db6 0 2024-09-19T09:03:09.725 INFO:tasks.workunit.client.0.smithi049.stdout:4/588: fsync d4/d15/f20 0 2024-09-19T09:03:09.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/589: rmdir d4/d34/d3d/d4f 39 2024-09-19T09:03:09.729 INFO:tasks.workunit.client.0.smithi049.stdout:4/590: stat d4/d15/d19/d1f/d77/db6 0 2024-09-19T09:03:09.729 INFO:tasks.workunit.client.0.smithi049.stdout:8/799: getdents d1/d11/d2e/d4e 0 2024-09-19T09:03:09.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/591: dread - d4/d15/d19/d7b/fb1 zero size 2024-09-19T09:03:09.731 INFO:tasks.workunit.client.0.smithi049.stdout:8/800: write d1/d11/d2e/d89/fbb [1482573,45552] 0 2024-09-19T09:03:09.731 INFO:tasks.workunit.client.0.smithi049.stdout:4/592: stat f2 0 2024-09-19T09:03:09.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/593: write d4/d45/d3f/d47/fa5 [562720,95656] 0 2024-09-19T09:03:09.734 INFO:tasks.workunit.client.0.smithi049.stdout:4/594: stat d4/d6c/d74/fac 0 2024-09-19T09:03:09.741 INFO:tasks.workunit.client.0.smithi049.stdout:4/595: creat d4/d45/d3f/fb7 x:0 0 0 2024-09-19T09:03:09.744 INFO:tasks.workunit.client.0.smithi049.stdout:6/655: dwrite dc/d16/f4a [0,4194304] 0 2024-09-19T09:03:09.745 INFO:tasks.workunit.client.0.smithi049.stdout:8/801: truncate d1/d11/d4f/d87/d7a/de9/d5b/faa 553221 0 2024-09-19T09:03:09.751 INFO:tasks.workunit.client.0.smithi049.stdout:8/802: rename d1/d11/d4f/d87/d7a/de9/fee to d1/d1a/ff1 0 2024-09-19T09:03:09.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/803: mknod d1/d11/d2e/db5/cf2 0 2024-09-19T09:03:09.760 INFO:tasks.workunit.client.0.smithi049.stdout:4/596: dwrite d4/d15/d19/f2f [0,4194304] 0 2024-09-19T09:03:09.760 INFO:tasks.workunit.client.0.smithi049.stdout:6/656: creat dc/d1b/fcc x:0 0 0 2024-09-19T09:03:09.766 INFO:tasks.workunit.client.0.smithi049.stdout:4/597: write d4/d34/d3d/d62/fa8 [1133707,36594] 0 2024-09-19T09:03:09.768 INFO:tasks.workunit.client.0.smithi049.stdout:6/657: creat dc/d1b/d20/d2f/d31/fcd x:0 0 0 2024-09-19T09:03:09.770 INFO:tasks.workunit.client.0.smithi049.stdout:8/804: dwrite d1/d27/fdf [4194304,4194304] 0 2024-09-19T09:03:09.771 INFO:tasks.workunit.client.0.smithi049.stdout:8/805: stat d1/d11/d2e/d4e/d61 0 2024-09-19T09:03:09.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/598: mkdir d4/d15/d19/d1f/d77/db6/db8 0 2024-09-19T09:03:09.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/599: chown d4/d15/d19/d1f/f5a 74 1 2024-09-19T09:03:09.775 INFO:tasks.workunit.client.0.smithi049.stdout:6/658: rename dc/d1b/f38 to dc/d1b/d78/db3/fce 0 2024-09-19T09:03:09.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/659: write dc/d1b/d20/d81/f85 [4575164,12822] 0 2024-09-19T09:03:09.784 INFO:tasks.workunit.client.0.smithi049.stdout:6/660: truncate dc/d16/f2d 4200850 0 2024-09-19T09:03:09.785 INFO:tasks.workunit.client.0.smithi049.stdout:6/661: mknod dc/d1b/d20/d7f/ccf 0 2024-09-19T09:03:09.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/662: write dc/fc0 [190270,69502] 0 2024-09-19T09:03:09.790 INFO:tasks.workunit.client.0.smithi049.stdout:4/600: truncate d4/d15/f61 2315684 0 2024-09-19T09:03:09.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/806: dwrite d1/d11/d4f/f66 [0,4194304] 0 2024-09-19T09:03:09.794 INFO:tasks.workunit.client.0.smithi049.stdout:4/601: mknod d4/d15/d19/d1f/d55/cb9 0 2024-09-19T09:03:09.795 INFO:tasks.workunit.client.0.smithi049.stdout:4/602: fdatasync d4/d6c/da2/f9b 0 2024-09-19T09:03:09.797 INFO:tasks.workunit.client.0.smithi049.stdout:8/807: rmdir d1/d11/d2e/d4e/d82/dd8 39 2024-09-19T09:03:09.798 INFO:tasks.workunit.client.0.smithi049.stdout:6/663: getdents dc/d1b 0 2024-09-19T09:03:09.801 INFO:tasks.workunit.client.0.smithi049.stdout:6/664: mknod dc/d1b/d20/d81/d5a/cd0 0 2024-09-19T09:03:09.801 INFO:tasks.workunit.client.0.smithi049.stdout:6/665: dread - dc/d1b/d20/d2f/da6/fa9 zero size 2024-09-19T09:03:09.803 INFO:tasks.workunit.client.0.smithi049.stdout:6/666: chown dc/d1b/d20/d2f/d53/f95 2 1 2024-09-19T09:03:09.804 INFO:tasks.workunit.client.0.smithi049.stdout:4/603: creat d4/fba x:0 0 0 2024-09-19T09:03:09.806 INFO:tasks.workunit.client.0.smithi049.stdout:6/667: mkdir dc/d1b/d20/d81/dd1 0 2024-09-19T09:03:09.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/604: dread d4/d45/f8e [0,4194304] 0 2024-09-19T09:03:09.810 INFO:tasks.workunit.client.0.smithi049.stdout:4/605: creat d4/d6c/d74/d8b/fbb x:0 0 0 2024-09-19T09:03:09.813 INFO:tasks.workunit.client.0.smithi049.stdout:4/606: mknod d4/d45/d3f/d47/cbc 0 2024-09-19T09:03:09.817 INFO:tasks.workunit.client.0.smithi049.stdout:4/607: unlink d4/d15/d19/d1f/d77/f9f 0 2024-09-19T09:03:09.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/668: dread dc/d1b/d20/d2f/f5c [0,4194304] 0 2024-09-19T09:03:09.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/669: chown dc/d1b/d20/d81/d5a/f64 361065 1 2024-09-19T09:03:09.823 INFO:tasks.workunit.client.0.smithi049.stdout:6/670: mkdir dc/d1b/d20/d2f/d6b/dd2 0 2024-09-19T09:03:09.826 INFO:tasks.workunit.client.0.smithi049.stdout:4/608: rename d4/d6c/d74/d8b to d4/d15/d19/d1f/daa/dbd 0 2024-09-19T09:03:09.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/609: dwrite d4/d45/d3f/d47/f81 [0,4194304] 0 2024-09-19T09:03:09.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/610: creat d4/d45/d4a/fbe x:0 0 0 2024-09-19T09:03:09.839 INFO:tasks.workunit.client.0.smithi049.stdout:6/671: dread dc/d1b/d20/d2f/d53/f95 [0,4194304] 0 2024-09-19T09:03:09.839 INFO:tasks.workunit.client.0.smithi049.stdout:4/611: creat d4/d45/d4a/fbf x:0 0 0 2024-09-19T09:03:09.840 INFO:tasks.workunit.client.0.smithi049.stdout:6/672: dread - dc/d1b/d20/d2f/d53/fa1 zero size 2024-09-19T09:03:09.843 INFO:tasks.workunit.client.0.smithi049.stdout:4/612: chown d4/d15/d19/d1f/d77/c95 1 1 2024-09-19T09:03:09.844 INFO:tasks.workunit.client.0.smithi049.stdout:6/673: write dc/d1b/d20/d2f/f5c [4681638,105301] 0 2024-09-19T09:03:09.845 INFO:tasks.workunit.client.0.smithi049.stdout:4/613: write d4/f69 [2858338,26738] 0 2024-09-19T09:03:09.846 INFO:tasks.workunit.client.0.smithi049.stdout:4/614: chown d4/d15/d19/d1f/daa/dbd 458 1 2024-09-19T09:03:09.848 INFO:tasks.workunit.client.0.smithi049.stdout:6/674: readlink dc/d1b/l3c 0 2024-09-19T09:03:09.849 INFO:tasks.workunit.client.0.smithi049.stdout:4/615: mkdir d4/d45/d4a/dc0 0 2024-09-19T09:03:09.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/675: dread dc/d1b/d20/d2f/d6b/d73/fa4 [0,4194304] 0 2024-09-19T09:03:09.855 INFO:tasks.workunit.client.0.smithi049.stdout:6/676: creat dc/d1b/d20/d2f/d6b/d73/fd3 x:0 0 0 2024-09-19T09:03:09.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/616: dwrite d4/d6c/d74/fac [0,4194304] 0 2024-09-19T09:03:09.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/677: mknod dc/d1b/d20/d81/d5a/dae/cd4 0 2024-09-19T09:03:09.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/678: read dc/d1b/d20/d2f/f5c [4712070,114094] 0 2024-09-19T09:03:09.861 INFO:tasks.workunit.client.0.smithi049.stdout:4/617: dread - d4/d15/d19/d1f/d55/f78 zero size 2024-09-19T09:03:09.862 INFO:tasks.workunit.client.0.smithi049.stdout:6/679: chown dc/d1b/d78/db3 4039 1 2024-09-19T09:03:09.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/680: mknod dc/d1b/d20/d81/d80/dab/cd5 0 2024-09-19T09:03:09.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/618: unlink d4/cb 0 2024-09-19T09:03:09.870 INFO:tasks.workunit.client.0.smithi049.stdout:4/619: unlink d4/d15/d19/d1f/d55/d66/f9c 0 2024-09-19T09:03:09.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/620: dread d4/d45/d3f/d47/f81 [0,4194304] 0 2024-09-19T09:03:09.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/681: truncate dc/d1b/d20/d2f/d6b/d73/f82 1914207 0 2024-09-19T09:03:09.876 INFO:tasks.workunit.client.0.smithi049.stdout:4/621: truncate d4/d34/d3d/d62/d76/fb0 187221 0 2024-09-19T09:03:09.876 INFO:tasks.workunit.client.0.smithi049.stdout:6/682: write dc/d1b/d20/d2f/d31/fcd [171493,25288] 0 2024-09-19T09:03:09.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/683: dread - dc/fc8 zero size 2024-09-19T09:03:09.878 INFO:tasks.workunit.client.0.smithi049.stdout:4/622: truncate d4/d15/d19/d1f/d55/d66/f9e 800771 0 2024-09-19T09:03:09.882 INFO:tasks.workunit.client.0.smithi049.stdout:4/623: dread d4/f69 [0,4194304] 0 2024-09-19T09:03:09.882 INFO:tasks.workunit.client.0.smithi049.stdout:6/684: mknod dc/d1b/d20/d2f/d4c/dc4/cd6 0 2024-09-19T09:03:09.884 INFO:tasks.workunit.client.0.smithi049.stdout:4/624: mkdir d4/d6c/d7a/dc1 0 2024-09-19T09:03:09.890 INFO:tasks.workunit.client.0.smithi049.stdout:6/685: getdents dc/d1b/d78 0 2024-09-19T09:03:09.892 INFO:tasks.workunit.client.0.smithi049.stdout:6/686: read dc/d1b/d20/d81/d6e/f76 [550014,32805] 0 2024-09-19T09:03:09.899 INFO:tasks.workunit.client.0.smithi049.stdout:6/687: dwrite dc/d1b/d20/d2f/d6b/f89 [0,4194304] 0 2024-09-19T09:03:09.900 INFO:tasks.workunit.client.0.smithi049.stdout:4/625: dread d4/d4c/f6e [0,4194304] 0 2024-09-19T09:03:09.900 INFO:tasks.workunit.client.0.smithi049.stdout:4/626: chown d4/f1e 20386 1 2024-09-19T09:03:09.902 INFO:tasks.workunit.client.0.smithi049.stdout:6/688: mknod dc/d1b/d20/d81/d80/dab/cd7 0 2024-09-19T09:03:09.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/627: rename d4/d45/d4a/fbf to d4/d6c/d7a/dc1/fc2 0 2024-09-19T09:03:09.909 INFO:tasks.workunit.client.0.smithi049.stdout:4/628: rename d4/d15/d19/d1f/d77 to d4/d45/d4a/dc3 0 2024-09-19T09:03:09.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/689: dwrite dc/d1b/d20/d2f/d6b/d73/fa4 [0,4194304] 0 2024-09-19T09:03:09.918 INFO:tasks.workunit.client.0.smithi049.stdout:4/629: dwrite d4/d45/d3f/fb7 [0,4194304] 0 2024-09-19T09:03:09.920 INFO:tasks.workunit.client.0.smithi049.stdout:6/690: getdents dc/d1b/d20/d81/dd1 0 2024-09-19T09:03:09.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/691: write dc/d1b/d20/d2f/d6b/d73/fa4 [547599,104224] 0 2024-09-19T09:03:09.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/630: symlink d4/d15/lc4 0 2024-09-19T09:03:09.934 INFO:tasks.workunit.client.0.smithi049.stdout:4/631: readlink d4/l7e 0 2024-09-19T09:03:09.935 INFO:tasks.workunit.client.0.smithi049.stdout:4/632: read - d4/d45/d3f/d47/fa6 zero size 2024-09-19T09:03:09.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/692: link dc/d1b/d20/d81/f4d dc/d1b/d20/d2f/d4c/dc4/fd8 0 2024-09-19T09:03:09.940 INFO:tasks.workunit.client.0.smithi049.stdout:6/693: symlink dc/d1b/d20/d2f/d6b/d73/ld9 0 2024-09-19T09:03:09.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/633: dwrite d4/d45/d3f/d47/faf [0,4194304] 0 2024-09-19T09:03:09.943 INFO:tasks.workunit.client.0.smithi049.stdout:4/634: readlink d4/d15/d19/d1f/l42 0 2024-09-19T09:03:09.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/635: creat d4/d34/d3d/d62/fc5 x:0 0 0 2024-09-19T09:03:09.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/636: rmdir d4/d45/d4a/dc0 0 2024-09-19T09:03:09.957 INFO:tasks.workunit.client.0.smithi049.stdout:4/637: dwrite d4/d4c/f8a [0,4194304] 0 2024-09-19T09:03:09.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/638: dread d4/d15/d19/d1f/d55/d66/f9e [0,4194304] 0 2024-09-19T09:03:09.966 INFO:tasks.workunit.client.0.smithi049.stdout:4/639: dwrite d4/d34/f91 [0,4194304] 0 2024-09-19T09:03:09.970 INFO:tasks.workunit.client.0.smithi049.stdout:4/640: dread - d4/d15/d19/d1f/f5a zero size 2024-09-19T09:03:09.974 INFO:tasks.workunit.client.0.smithi049.stdout:4/641: unlink d4/d15/d19/d1f/d55/d7f/f8c 0 2024-09-19T09:03:09.976 INFO:tasks.workunit.client.0.smithi049.stdout:4/642: truncate d4/d45/d4a/f4e 606256 0 2024-09-19T09:03:09.978 INFO:tasks.workunit.client.0.smithi049.stdout:4/643: rename d4/d15/d19/d7b to d4/d15/d19/d1f/daa/dbd/dc6 0 2024-09-19T09:03:09.983 INFO:tasks.workunit.client.0.smithi049.stdout:4/644: dwrite d4/f1e [0,4194304] 0 2024-09-19T09:03:09.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/645: stat d4/d45/d4a/dc3/db6/db8 0 2024-09-19T09:03:09.989 INFO:tasks.workunit.client.0.smithi049.stdout:4/646: mknod d4/d35/d84/cc7 0 2024-09-19T09:03:09.990 INFO:tasks.workunit.client.0.smithi049.stdout:4/647: write d4/d15/d19/d1f/f71 [813269,100633] 0 2024-09-19T09:03:09.994 INFO:tasks.workunit.client.0.smithi049.stdout:4/648: creat d4/d34/d3d/d4f/d70/fc8 x:0 0 0 2024-09-19T09:03:09.997 INFO:tasks.workunit.client.0.smithi049.stdout:4/649: mkdir d4/d45/d4a/dc3/dc9 0 2024-09-19T09:03:09.999 INFO:tasks.workunit.client.0.smithi049.stdout:4/650: read d4/d15/d19/f68 [2858749,74680] 0 2024-09-19T09:03:10.000 INFO:tasks.workunit.client.0.smithi049.stdout:4/651: readlink d4/d34/d3d/d4f/d70/l88 0 2024-09-19T09:03:10.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/652: dread d4/d15/d19/f68 [0,4194304] 0 2024-09-19T09:03:10.019 INFO:tasks.workunit.client.0.smithi049.stdout:4/653: dwrite d4/d35/f52 [0,4194304] 0 2024-09-19T09:03:10.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/654: link d4/d34/d3d/d4f/d70/fc8 d4/d34/fca 0 2024-09-19T09:03:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/655: chown d4/d15/d19/d1f/f67 0 1 2024-09-19T09:03:10.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/656: chown d4/d45/d3f/c80 4601720 1 2024-09-19T09:03:10.030 INFO:tasks.workunit.client.0.smithi049.stdout:4/657: unlink d4/lf 0 2024-09-19T09:03:10.033 INFO:tasks.workunit.client.0.smithi049.stdout:4/658: mkdir d4/d4c/dcb 0 2024-09-19T09:03:10.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/833: sync 2024-09-19T09:03:10.087 INFO:tasks.workunit.client.0.smithi049.stdout:2/834: dread d1/d2/d32/f94 [0,4194304] 0 2024-09-19T09:03:10.092 INFO:tasks.workunit.client.0.smithi049.stdout:2/835: dwrite d1/d2/d23/fce [0,4194304] 0 2024-09-19T09:03:10.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/836: mkdir d1/d4/d1e/d9f/db3/d41/d118 0 2024-09-19T09:03:10.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/837: chown d1/d2d 969 1 2024-09-19T09:03:10.117 INFO:tasks.workunit.client.0.smithi049.stdout:2/838: symlink d1/d4/d1e/d21/dae/de5/l119 0 2024-09-19T09:03:10.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/839: mkdir d1/d4/d1e/d9f/db3/d41/d11a 0 2024-09-19T09:03:10.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/840: chown d1/d2 8 1 2024-09-19T09:03:10.122 INFO:tasks.workunit.client.0.smithi049.stdout:2/841: unlink d1/d4/d1e/d9f/db3/d41/c4b 0 2024-09-19T09:03:10.126 INFO:tasks.workunit.client.0.smithi049.stdout:2/842: link d1/d2/d23/d49/d75/d114/c4f d1/d4/d20/c11b 0 2024-09-19T09:03:10.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/843: symlink d1/d4/d1e/d45/l11c 0 2024-09-19T09:03:10.131 INFO:tasks.workunit.client.0.smithi049.stdout:2/844: rename d1/d4/d1e/d9f/c10a to d1/d2/d70/de4/c11d 0 2024-09-19T09:03:10.132 INFO:tasks.workunit.client.0.smithi049.stdout:2/845: rmdir d1/d2/d6c/dd5/de2 39 2024-09-19T09:03:10.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/846: dread d1/d2/d23/dca/fcb [4194304,4194304] 0 2024-09-19T09:03:10.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/847: dread d1/d4/d1e/d45/f5c [0,4194304] 0 2024-09-19T09:03:10.159 INFO:tasks.workunit.client.0.smithi049.stdout:2/848: write d1/d2b/f1a [2630224,72746] 0 2024-09-19T09:03:10.165 INFO:tasks.workunit.client.0.smithi049.stdout:2/849: getdents d1/d4/d1e/d21 0 2024-09-19T09:03:10.180 INFO:tasks.workunit.client.0.smithi049.stdout:2/850: dread d1/d4/d1e/d21/f3b [0,4194304] 0 2024-09-19T09:03:10.183 INFO:tasks.workunit.client.0.smithi049.stdout:2/851: mknod d1/d2/d70/df3/c11e 0 2024-09-19T09:03:10.190 INFO:tasks.workunit.client.0.smithi049.stdout:2/852: truncate d1/d4/d1e/d21/f3b 4133104 0 2024-09-19T09:03:10.193 INFO:tasks.workunit.client.0.smithi049.stdout:2/853: rename d1/d2/l1d to d1/d4/d20/dc8/l11f 0 2024-09-19T09:03:10.195 INFO:tasks.workunit.client.0.smithi049.stdout:2/854: truncate d1/d2/d70/df3/f116 947789 0 2024-09-19T09:03:10.197 INFO:tasks.workunit.client.0.smithi049.stdout:2/855: creat d1/d2/d23/d49/d75/d114/f120 x:0 0 0 2024-09-19T09:03:10.199 INFO:tasks.workunit.client.0.smithi049.stdout:2/856: mkdir d1/d4/d20/d92/dba/d121 0 2024-09-19T09:03:10.371 INFO:tasks.workunit.client.0.smithi049.stdout:1/535: sync 2024-09-19T09:03:10.497 INFO:tasks.workunit.client.0.smithi049.stdout:5/667: sync 2024-09-19T09:03:10.501 INFO:tasks.workunit.client.0.smithi049.stdout:5/668: mkdir d3/dc/dd4 0 2024-09-19T09:03:10.505 INFO:tasks.workunit.client.0.smithi049.stdout:5/669: link d3/f6 d3/d5/d1c/fd5 0 2024-09-19T09:03:10.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/670: rename d3/d5/d1c/d2d/d89 to d3/d5/d1c/d4c/dd6 0 2024-09-19T09:03:10.511 INFO:tasks.workunit.client.0.smithi049.stdout:5/671: creat d3/d6c/d6d/fd7 x:0 0 0 2024-09-19T09:03:10.517 INFO:tasks.workunit.client.0.smithi049.stdout:5/672: dwrite d3/d5/d1c/d2d/fc3 [0,4194304] 0 2024-09-19T09:03:10.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/673: rmdir d3/d5/d1c/d4c/d7c/dcc 0 2024-09-19T09:03:10.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/805: sync 2024-09-19T09:03:10.592 INFO:tasks.workunit.client.0.smithi049.stdout:7/951: sync 2024-09-19T09:03:10.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/806: rmdir d5/d10/d3c 39 2024-09-19T09:03:10.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/952: truncate d1/d1a/de7/d59/f48 2076939 0 2024-09-19T09:03:10.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/807: mkdir d5/d10/d13/dc4/dcd/ddb/df5 0 2024-09-19T09:03:10.603 INFO:tasks.workunit.client.0.smithi049.stdout:0/808: symlink d5/d10/d82/d67/lf6 0 2024-09-19T09:03:10.613 INFO:tasks.workunit.client.0.smithi049.stdout:7/953: truncate d1/d1a/da0/dd3/d62/f110 290037 0 2024-09-19T09:03:10.615 INFO:tasks.workunit.client.0.smithi049.stdout:7/954: mknod d1/d8/d149/dc6/dd8/c14e 0 2024-09-19T09:03:10.622 INFO:tasks.workunit.client.0.smithi049.stdout:0/809: dwrite d5/d10/d2f/d6d/fc6 [0,4194304] 0 2024-09-19T09:03:10.623 INFO:tasks.workunit.client.0.smithi049.stdout:7/955: dread d1/d8/d2d/d72/d11d/fb0 [0,4194304] 0 2024-09-19T09:03:10.625 INFO:tasks.workunit.client.0.smithi049.stdout:7/956: read d1/d8/d149/dc6/dd8/f146 [1916866,124108] 0 2024-09-19T09:03:10.638 INFO:tasks.workunit.client.0.smithi049.stdout:0/810: rename d5/d10/d3c to d5/d10/d13/d30/d75/df7 0 2024-09-19T09:03:10.642 INFO:tasks.workunit.client.0.smithi049.stdout:7/957: truncate d1/f68 4631885 0 2024-09-19T09:03:10.644 INFO:tasks.workunit.client.0.smithi049.stdout:0/811: creat d5/d10/d13/d15/d36/d3d/d7f/ff8 x:0 0 0 2024-09-19T09:03:10.645 INFO:tasks.workunit.client.0.smithi049.stdout:7/958: creat d1/d8/d80/f14f x:0 0 0 2024-09-19T09:03:10.647 INFO:tasks.workunit.client.0.smithi049.stdout:7/959: dread d1/d8/d2d/d36/fb7 [0,4194304] 0 2024-09-19T09:03:10.647 INFO:tasks.workunit.client.0.smithi049.stdout:7/960: chown d1/le2 993583 1 2024-09-19T09:03:10.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/812: mknod d5/d10/d82/d67/d85/cf9 0 2024-09-19T09:03:10.652 INFO:tasks.workunit.client.0.smithi049.stdout:7/961: rename d1/d8/d80/c109 to d1/d8/d2d/d31/d6e/c150 0 2024-09-19T09:03:10.653 INFO:tasks.workunit.client.0.smithi049.stdout:0/813: creat d5/d10/d2f/dd4/ffa x:0 0 0 2024-09-19T09:03:10.656 INFO:tasks.workunit.client.0.smithi049.stdout:7/962: write d1/d8/d149/dc6/dd8/f146 [2071359,74198] 0 2024-09-19T09:03:10.659 INFO:tasks.workunit.client.0.smithi049.stdout:0/814: symlink d5/d10/d13/dc4/dcd/ddb/df5/lfb 0 2024-09-19T09:03:10.660 INFO:tasks.workunit.client.0.smithi049.stdout:7/963: creat d1/d8/d2d/d36/d91/f151 x:0 0 0 2024-09-19T09:03:10.663 INFO:tasks.workunit.client.0.smithi049.stdout:7/964: fsync d1/d1a/da0/dd3/d62/fdd 0 2024-09-19T09:03:10.666 INFO:tasks.workunit.client.0.smithi049.stdout:0/815: dwrite d5/d10/d2f/d6d/dbe/fca [0,4194304] 0 2024-09-19T09:03:10.670 INFO:tasks.workunit.client.0.smithi049.stdout:7/965: unlink d1/d1a/da0/dd3/d62/d6b/f76 0 2024-09-19T09:03:10.673 INFO:tasks.workunit.client.0.smithi049.stdout:0/816: symlink d5/d10/d13/d15/d36/d3d/lfc 0 2024-09-19T09:03:10.677 INFO:tasks.workunit.client.0.smithi049.stdout:7/966: rmdir d1/d8/d149/dc6 39 2024-09-19T09:03:10.680 INFO:tasks.workunit.client.0.smithi049.stdout:0/817: rmdir d5/d10/d13 39 2024-09-19T09:03:10.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/967: fdatasync d1/d8/d149/dc6/dd8/f134 0 2024-09-19T09:03:10.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/818: dread - d5/d10/d13/d15/d36/f51 zero size 2024-09-19T09:03:10.685 INFO:tasks.workunit.client.0.smithi049.stdout:0/819: chown d5/d10/d13/d69 802 1 2024-09-19T09:03:10.699 INFO:tasks.workunit.client.0.smithi049.stdout:3/690: sync 2024-09-19T09:03:10.699 INFO:tasks.workunit.client.0.smithi049.stdout:4/659: sync 2024-09-19T09:03:10.699 INFO:tasks.workunit.client.0.smithi049.stdout:6/694: sync 2024-09-19T09:03:10.699 INFO:tasks.workunit.client.0.smithi049.stdout:8/808: sync 2024-09-19T09:03:10.701 INFO:tasks.workunit.client.0.smithi049.stdout:3/691: write d10/d3d/fa6 [1780909,18098] 0 2024-09-19T09:03:10.705 INFO:tasks.workunit.client.0.smithi049.stdout:6/695: stat dc/d1b/d20/d81/d5a/dae/lb7 0 2024-09-19T09:03:10.705 INFO:tasks.workunit.client.0.smithi049.stdout:8/809: dread d1/d11/d2e/f57 [0,4194304] 0 2024-09-19T09:03:10.706 INFO:tasks.workunit.client.0.smithi049.stdout:4/660: rename d4/d45/d3f/fb7 to d4/d34/d3d/d62/fcc 0 2024-09-19T09:03:10.707 INFO:tasks.workunit.client.0.smithi049.stdout:4/661: chown d4/d15/d19/d1f/l43 184111 1 2024-09-19T09:03:10.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/692: fdatasync d10/d11/d13/d30/f9c 0 2024-09-19T09:03:10.713 INFO:tasks.workunit.client.0.smithi049.stdout:4/662: dwrite d4/d45/f8e [4194304,4194304] 0 2024-09-19T09:03:10.714 INFO:tasks.workunit.client.0.smithi049.stdout:6/696: creat dc/d1b/d6f/fda x:0 0 0 2024-09-19T09:03:10.720 INFO:tasks.workunit.client.0.smithi049.stdout:4/663: dwrite d4/d34/f79 [0,4194304] 0 2024-09-19T09:03:10.726 INFO:tasks.workunit.client.0.smithi049.stdout:6/697: mknod dc/d1b/d20/d2f/d4c/cdb 0 2024-09-19T09:03:10.732 INFO:tasks.workunit.client.0.smithi049.stdout:3/693: rename d10/l42 to d10/d11/d13/d30/leb 0 2024-09-19T09:03:10.732 INFO:tasks.workunit.client.0.smithi049.stdout:6/698: symlink dc/d1b/d20/d2f/db4/ldc 0 2024-09-19T09:03:10.737 INFO:tasks.workunit.client.0.smithi049.stdout:3/694: fdatasync d10/d11/d27/d4f/f60 0 2024-09-19T09:03:10.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/968: dread d1/d1a/da0/dd3/d62/f110 [0,4194304] 0 2024-09-19T09:03:10.740 INFO:tasks.workunit.client.0.smithi049.stdout:8/810: getdents d1/d11/d2e/d4e 0 2024-09-19T09:03:10.740 INFO:tasks.workunit.client.0.smithi049.stdout:2/857: sync 2024-09-19T09:03:10.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/536: sync 2024-09-19T09:03:10.740 INFO:tasks.workunit.client.0.smithi049.stdout:5/674: sync 2024-09-19T09:03:10.741 INFO:tasks.workunit.client.0.smithi049.stdout:7/969: chown d1/fc8 1479 1 2024-09-19T09:03:10.742 INFO:tasks.workunit.client.0.smithi049.stdout:2/858: stat d1/d4/d20/l27 0 2024-09-19T09:03:10.742 INFO:tasks.workunit.client.0.smithi049.stdout:1/537: chown d5/d6/f1b 27838 1 2024-09-19T09:03:10.744 INFO:tasks.workunit.client.0.smithi049.stdout:4/664: link d4/d4c/cb4 d4/d92/ccd 0 2024-09-19T09:03:10.745 INFO:tasks.workunit.client.0.smithi049.stdout:8/811: dread d1/d11/f74 [0,4194304] 0 2024-09-19T09:03:10.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/812: readlink d1/d11/d2e/d4e/d61/le2 0 2024-09-19T09:03:10.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/970: unlink d1/d1a/de7/c49 0 2024-09-19T09:03:10.746 INFO:tasks.workunit.client.0.smithi049.stdout:3/695: dread d10/d11/d27/d4f/d59/d81/fcf [0,4194304] 0 2024-09-19T09:03:10.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/675: truncate d3/f32 3411286 0 2024-09-19T09:03:10.750 INFO:tasks.workunit.client.0.smithi049.stdout:2/859: dread - d1/d4/d1e/d9f/db3/d41/d7d/f102 zero size 2024-09-19T09:03:10.752 INFO:tasks.workunit.client.0.smithi049.stdout:0/820: dwrite d5/d10/d13/d15/d36/d3d/f7c [0,4194304] 0 2024-09-19T09:03:10.752 INFO:tasks.workunit.client.0.smithi049.stdout:3/696: symlink d10/d11/d13/d7e/lec 0 2024-09-19T09:03:10.753 INFO:tasks.workunit.client.0.smithi049.stdout:1/538: mkdir d5/d6/d8/d13/db0 0 2024-09-19T09:03:10.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/665: symlink d4/d34/d3d/d62/d76/da3/lce 0 2024-09-19T09:03:10.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/676: mknod d3/d5/d20/d38/d9c/cd8 0 2024-09-19T09:03:10.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/813: symlink d1/d11/d2e/lf3 0 2024-09-19T09:03:10.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/821: dread d5/fa [0,4194304] 0 2024-09-19T09:03:10.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/971: fdatasync d1/d1a/de7/d59/f48 0 2024-09-19T09:03:10.761 INFO:tasks.workunit.client.0.smithi049.stdout:8/814: chown d1/d11/d4f/d87 918475718 1 2024-09-19T09:03:10.761 INFO:tasks.workunit.client.0.smithi049.stdout:2/860: read - d1/d4/d20/dc7/feb zero size 2024-09-19T09:03:10.762 INFO:tasks.workunit.client.0.smithi049.stdout:3/697: rmdir d10/d11/d13 39 2024-09-19T09:03:10.762 INFO:tasks.workunit.client.0.smithi049.stdout:7/972: readlink d1/d8/d149/l25 0 2024-09-19T09:03:10.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/666: rename d4/d15/f65 to d4/d35/fcf 0 2024-09-19T09:03:10.767 INFO:tasks.workunit.client.0.smithi049.stdout:5/677: fsync d3/d5/d1c/fd5 0 2024-09-19T09:03:10.768 INFO:tasks.workunit.client.0.smithi049.stdout:2/861: dread d1/d2/d70/f9a [0,4194304] 0 2024-09-19T09:03:10.769 INFO:tasks.workunit.client.0.smithi049.stdout:5/678: stat d3/d5/d20/d38/d5a/d8b/c93 0 2024-09-19T09:03:10.772 INFO:tasks.workunit.client.0.smithi049.stdout:0/822: fsync d5/d10/d13/d15/f18 0 2024-09-19T09:03:10.772 INFO:tasks.workunit.client.0.smithi049.stdout:1/539: dread d5/d6/f38 [0,4194304] 0 2024-09-19T09:03:10.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/698: mkdir d10/d11/d27/d4f/d59/d81/ded 0 2024-09-19T09:03:10.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/667: dwrite d4/d6c/da2/f9b [0,4194304] 0 2024-09-19T09:03:10.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/973: rename d1/d1a/de7/f3b to d1/d1a/da0/dd3/d62/d6b/d10e/f152 0 2024-09-19T09:03:10.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/974: chown d1/d8/d149/dc6/dd8/lf6 51 1 2024-09-19T09:03:10.820 INFO:tasks.workunit.client.0.smithi049.stdout:1/540: fsync d5/d6/d8/f2a 0 2024-09-19T09:03:10.821 INFO:tasks.workunit.client.0.smithi049.stdout:0/823: write d5/d64/d97/fed [433828,94302] 0 2024-09-19T09:03:10.824 INFO:tasks.workunit.client.0.smithi049.stdout:8/815: write d1/fa5 [505047,65308] 0 2024-09-19T09:03:10.826 INFO:tasks.workunit.client.0.smithi049.stdout:4/668: symlink d4/d45/ld0 0 2024-09-19T09:03:10.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/541: creat d5/d6/d8/d1a/d78/fb1 x:0 0 0 2024-09-19T09:03:10.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/816: chown d1/d27/f4b 44088 1 2024-09-19T09:03:10.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/862: rename d1/d4/d1e/d9f/db3/d41/l10d to d1/d4/d1e/d9f/db3/l122 0 2024-09-19T09:03:10.835 INFO:tasks.workunit.client.0.smithi049.stdout:1/542: stat d5/d6/f38 0 2024-09-19T09:03:10.836 INFO:tasks.workunit.client.0.smithi049.stdout:6/699: dwrite dc/d1b/d20/d81/f4d [8388608,4194304] 0 2024-09-19T09:03:10.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/824: symlink d5/d10/d13/d15/d36/lfd 0 2024-09-19T09:03:10.843 INFO:tasks.workunit.client.0.smithi049.stdout:3/699: dread d10/d11/d27/f2e [0,4194304] 0 2024-09-19T09:03:10.845 INFO:tasks.workunit.client.0.smithi049.stdout:4/669: symlink d4/d45/d4a/ld1 0 2024-09-19T09:03:10.849 INFO:tasks.workunit.client.0.smithi049.stdout:4/670: chown d4/d15/d19/d1f/daa 390731 1 2024-09-19T09:03:10.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/817: fsync d1/d11/d4f/d87/d7a/de9/d5b/f9a 0 2024-09-19T09:03:10.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/825: mknod d5/d10/d13/d69/cfe 0 2024-09-19T09:03:10.851 INFO:tasks.workunit.client.0.smithi049.stdout:6/700: rename dc/d16/d88 to dc/d1b/d78/ddd 0 2024-09-19T09:03:10.856 INFO:tasks.workunit.client.0.smithi049.stdout:2/863: dread d1/d2/f54 [0,4194304] 0 2024-09-19T09:03:10.856 INFO:tasks.workunit.client.0.smithi049.stdout:6/701: read - dc/d1b/d20/d2f/d53/fa1 zero size 2024-09-19T09:03:10.856 INFO:tasks.workunit.client.0.smithi049.stdout:7/975: dwrite d1/d1a/da0/f100 [0,4194304] 0 2024-09-19T09:03:10.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/671: creat d4/d4c/dcb/fd2 x:0 0 0 2024-09-19T09:03:10.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/976: dread - d1/d8/d2d/d36/d91/fd5 zero size 2024-09-19T09:03:10.861 INFO:tasks.workunit.client.0.smithi049.stdout:1/543: rename d5/d6/d19/d21/d52/d94/l9b to d5/d6/d73/lb2 0 2024-09-19T09:03:10.862 INFO:tasks.workunit.client.0.smithi049.stdout:7/977: chown d1/d1a/da0/dd3/d62/fac 82976 1 2024-09-19T09:03:10.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/826: mkdir d5/d10/d13/d30/d75/dff 0 2024-09-19T09:03:10.865 INFO:tasks.workunit.client.0.smithi049.stdout:1/544: chown d5/d6/d8/f5d 760 1 2024-09-19T09:03:10.869 INFO:tasks.workunit.client.0.smithi049.stdout:4/672: symlink d4/d6c/ld3 0 2024-09-19T09:03:10.870 INFO:tasks.workunit.client.0.smithi049.stdout:2/864: dwrite d1/d4/d1e/d9f/db3/d41/fa6 [0,4194304] 0 2024-09-19T09:03:10.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/700: getdents d10/d11/d27/d4f 0 2024-09-19T09:03:10.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/673: mknod d4/d45/d3f/d47/d5f/cd4 0 2024-09-19T09:03:10.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/865: mknod d1/d2/d23/d49/d75/d114/c123 0 2024-09-19T09:03:10.884 INFO:tasks.workunit.client.0.smithi049.stdout:0/827: fsync d5/fb1 0 2024-09-19T09:03:10.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/545: mkdir d5/d6/d19/db3 0 2024-09-19T09:03:10.887 INFO:tasks.workunit.client.0.smithi049.stdout:4/674: symlink d4/d4c/dcb/ld5 0 2024-09-19T09:03:10.888 INFO:tasks.workunit.client.0.smithi049.stdout:3/701: dread d10/d11/d27/f43 [0,4194304] 0 2024-09-19T09:03:10.892 INFO:tasks.workunit.client.0.smithi049.stdout:1/546: mkdir d5/d6/db4 0 2024-09-19T09:03:10.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/818: dread d1/d11/d45/f84 [0,4194304] 0 2024-09-19T09:03:10.901 INFO:tasks.workunit.client.0.smithi049.stdout:3/702: dwrite d10/d3d/d76/dac/dad/fc8 [4194304,4194304] 0 2024-09-19T09:03:10.904 INFO:tasks.workunit.client.0.smithi049.stdout:7/978: truncate d1/d8/d2d/d31/f47 2634668 0 2024-09-19T09:03:10.905 INFO:tasks.workunit.client.0.smithi049.stdout:2/866: rmdir d1/d2b/d7c/dc3 39 2024-09-19T09:03:10.911 INFO:tasks.workunit.client.0.smithi049.stdout:4/675: dread d4/d15/f61 [0,4194304] 0 2024-09-19T09:03:10.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/979: mknod d1/d1a/da0/dd3/d62/d6b/c153 0 2024-09-19T09:03:10.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/676: fdatasync d4/d15/d19/f2f 0 2024-09-19T09:03:10.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/867: truncate d1/d2/d23/f56 7580842 0 2024-09-19T09:03:10.917 INFO:tasks.workunit.client.0.smithi049.stdout:1/547: rename d5/d6/d73/da8/lae to d5/d6/d73/da0/lb5 0 2024-09-19T09:03:10.928 INFO:tasks.workunit.client.0.smithi049.stdout:1/548: fsync d5/d6/d19/f90 0 2024-09-19T09:03:10.931 INFO:tasks.workunit.client.0.smithi049.stdout:0/828: getdents d5/d10/d13/d30 0 2024-09-19T09:03:10.932 INFO:tasks.workunit.client.0.smithi049.stdout:3/703: write d10/d11/d13/d30/f61 [275991,25904] 0 2024-09-19T09:03:10.934 INFO:tasks.workunit.client.0.smithi049.stdout:7/980: mknod d1/d8/d2d/dd9/c154 0 2024-09-19T09:03:10.936 INFO:tasks.workunit.client.0.smithi049.stdout:2/868: unlink d1/d2/d6c/dd5/de2/dee/ff4 0 2024-09-19T09:03:10.936 INFO:tasks.workunit.client.0.smithi049.stdout:0/829: chown d5/d10/d13/d15/d29/cb2 306652 1 2024-09-19T09:03:10.941 INFO:tasks.workunit.client.0.smithi049.stdout:8/819: dwrite d1/d27/fc6 [0,4194304] 0 2024-09-19T09:03:10.941 INFO:tasks.workunit.client.0.smithi049.stdout:1/549: dwrite d5/d6/d8/d1a/f3e [0,4194304] 0 2024-09-19T09:03:10.942 INFO:tasks.workunit.client.0.smithi049.stdout:7/981: truncate d1/d8/d2d/d36/d91/fd5 296725 0 2024-09-19T09:03:10.950 INFO:tasks.workunit.client.0.smithi049.stdout:3/704: dread fe [0,4194304] 0 2024-09-19T09:03:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/869: creat d1/d2/d70/f124 x:0 0 0 2024-09-19T09:03:10.952 INFO:tasks.workunit.client.0.smithi049.stdout:3/705: chown d10/d3d/d46/d84/dc7 1734485348 1 2024-09-19T09:03:10.964 INFO:tasks.workunit.client.0.smithi049.stdout:8/820: fdatasync d1/d11/d4f/d87/d5d/d65/fcd 0 2024-09-19T09:03:10.966 INFO:tasks.workunit.client.0.smithi049.stdout:3/706: creat d10/d3d/d46/fee x:0 0 0 2024-09-19T09:03:10.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/550: dread d5/d6/f7 [0,4194304] 0 2024-09-19T09:03:10.981 INFO:tasks.workunit.client.0.smithi049.stdout:7/982: dwrite d1/d8/d149/dc6/f64 [0,4194304] 0 2024-09-19T09:03:10.981 INFO:tasks.workunit.client.0.smithi049.stdout:1/551: rmdir d5/d6/d19/d21/d52/da6 39 2024-09-19T09:03:10.985 INFO:tasks.workunit.client.0.smithi049.stdout:8/821: mknod d1/d11/d2e/d4e/d61/d9f/dda/cf4 0 2024-09-19T09:03:10.986 INFO:tasks.workunit.client.0.smithi049.stdout:3/707: mkdir d10/d11/def 0 2024-09-19T09:03:10.987 INFO:tasks.workunit.client.0.smithi049.stdout:2/870: link d1/d4/d1e/d45/faa d1/d4/d20/d92/f125 0 2024-09-19T09:03:10.988 INFO:tasks.workunit.client.0.smithi049.stdout:0/830: getdents d5/d10/d2f/d6d/daa 0 2024-09-19T09:03:10.990 INFO:tasks.workunit.client.0.smithi049.stdout:0/831: chown d5/d10/d13/d30/d75/ff1 4622 1 2024-09-19T09:03:10.993 INFO:tasks.workunit.client.0.smithi049.stdout:7/983: unlink d1/d8/d149/dc6/f70 0 2024-09-19T09:03:10.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/552: mkdir d5/d6/d19/d21/d52/db6 0 2024-09-19T09:03:10.999 INFO:tasks.workunit.client.0.smithi049.stdout:0/832: rename d5/d10/d13/d15/d29/d9a/l99 to d5/d10/d2f/d6d/daa/dd3/l100 0 2024-09-19T09:03:11.002 INFO:tasks.workunit.client.0.smithi049.stdout:8/822: dread d1/d27/f79 [0,4194304] 0 2024-09-19T09:03:11.003 INFO:tasks.workunit.client.0.smithi049.stdout:3/708: mknod d10/d11/d27/d4f/d59/d81/ded/cf0 0 2024-09-19T09:03:11.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/871: write d1/d2/d6c/dd5/fec [851980,89300] 0 2024-09-19T09:03:11.007 INFO:tasks.workunit.client.0.smithi049.stdout:0/833: creat d5/d10/d13/dc4/f101 x:0 0 0 2024-09-19T09:03:11.007 INFO:tasks.workunit.client.0.smithi049.stdout:8/823: rmdir d1/d11/d2e/d4e/d61 39 2024-09-19T09:03:11.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/984: dread d1/d8/d2d/d72/d11d/d9c/ff3 [0,4194304] 0 2024-09-19T09:03:11.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/709: symlink d10/db8/lf1 0 2024-09-19T09:03:11.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/824: creat d1/d11/d4f/d87/d7a/de9/d5b/ff5 x:0 0 0 2024-09-19T09:03:11.014 INFO:tasks.workunit.client.0.smithi049.stdout:2/872: unlink d1/d2/d23/d49/d75/d114/l109 0 2024-09-19T09:03:11.016 INFO:tasks.workunit.client.0.smithi049.stdout:1/553: rename d5/f49 to d5/d6/d8/fb7 0 2024-09-19T09:03:11.018 INFO:tasks.workunit.client.0.smithi049.stdout:3/710: rmdir d10/d3d/d76/da3/db7 39 2024-09-19T09:03:11.019 INFO:tasks.workunit.client.0.smithi049.stdout:3/711: readlink d10/d11/d27/d4f/d59/lb1 0 2024-09-19T09:03:11.023 INFO:tasks.workunit.client.0.smithi049.stdout:0/834: dread d5/d10/d13/d30/f31 [0,4194304] 0 2024-09-19T09:03:11.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/554: rename d5/d6/dc/fab to d5/d6/d73/da0/fb8 0 2024-09-19T09:03:11.029 INFO:tasks.workunit.client.0.smithi049.stdout:7/985: creat d1/d8/f155 x:0 0 0 2024-09-19T09:03:11.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/873: dwrite d1/d4/d20/f81 [0,4194304] 0 2024-09-19T09:03:11.036 INFO:tasks.workunit.client.0.smithi049.stdout:8/825: link d1/d11/d2e/d4e/cb3 d1/d11/d2e/dd3/cf6 0 2024-09-19T09:03:11.041 INFO:tasks.workunit.client.0.smithi049.stdout:7/986: creat d1/d8/d2d/d31/f156 x:0 0 0 2024-09-19T09:03:11.041 INFO:tasks.workunit.client.0.smithi049.stdout:2/874: rmdir d1/d2b 39 2024-09-19T09:03:11.042 INFO:tasks.workunit.client.0.smithi049.stdout:3/712: dwrite d10/d11/d13/d30/fa7 [0,4194304] 0 2024-09-19T09:03:11.044 INFO:tasks.workunit.client.0.smithi049.stdout:2/875: stat d1/d4/d1e/d45 0 2024-09-19T09:03:11.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/555: link d5/d6/f5b d5/d6/d8/d13/d24/d96/fb9 0 2024-09-19T09:03:11.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/876: fdatasync d1/d2/d23/d49/d75/d114/f120 0 2024-09-19T09:03:11.049 INFO:tasks.workunit.client.0.smithi049.stdout:8/826: link d1/d11/d4f/d87/d7a/de9/d5b/fb9 d1/d11/d4f/d87/d7a/ff7 0 2024-09-19T09:03:11.051 INFO:tasks.workunit.client.0.smithi049.stdout:7/987: dread d1/d1a/de7/d59/ff4 [0,4194304] 0 2024-09-19T09:03:11.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/556: fdatasync d5/d6/f5b 0 2024-09-19T09:03:11.055 INFO:tasks.workunit.client.0.smithi049.stdout:8/827: unlink d1/d11/d4f/d87/d7a/de9/d8c/f8d 0 2024-09-19T09:03:11.055 INFO:tasks.workunit.client.0.smithi049.stdout:3/713: link d10/d11/d13/f32 d10/d3d/d46/ff2 0 2024-09-19T09:03:11.056 INFO:tasks.workunit.client.0.smithi049.stdout:0/835: truncate d5/d10/d2f/ff3 2426952 0 2024-09-19T09:03:11.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/988: unlink d1/d8/d80/f96 0 2024-09-19T09:03:11.059 INFO:tasks.workunit.client.0.smithi049.stdout:2/877: getdents d1/d4/d1e/d21/d8c/d117 0 2024-09-19T09:03:11.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/714: chown d10/d3d/d76/da3/db7/ld2 1873955 1 2024-09-19T09:03:11.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/715: dread fe [0,4194304] 0 2024-09-19T09:03:11.067 INFO:tasks.workunit.client.0.smithi049.stdout:7/989: fdatasync d1/d8/d2d/f11c 0 2024-09-19T09:03:11.068 INFO:tasks.workunit.client.0.smithi049.stdout:1/557: dwrite d5/d6/d19/f61 [4194304,4194304] 0 2024-09-19T09:03:11.069 INFO:tasks.workunit.client.0.smithi049.stdout:2/878: fdatasync d1/d4/d1e/d45/fbc 0 2024-09-19T09:03:11.071 INFO:tasks.workunit.client.0.smithi049.stdout:8/828: creat d1/d11/d2e/d4e/d61/d9f/dc3/ff8 x:0 0 0 2024-09-19T09:03:11.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/836: mkdir d5/d10/d13/d102 0 2024-09-19T09:03:11.081 INFO:tasks.workunit.client.0.smithi049.stdout:3/716: mknod d10/d11/cf3 0 2024-09-19T09:03:11.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/837: chown d5/d10/d13/d69/cf4 18 1 2024-09-19T09:03:11.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/829: symlink d1/d11/d4f/d87/d7a/de9/d5b/lf9 0 2024-09-19T09:03:11.085 INFO:tasks.workunit.client.0.smithi049.stdout:2/879: write d1/d4/f17 [3179666,46970] 0 2024-09-19T09:03:11.088 INFO:tasks.workunit.client.0.smithi049.stdout:3/717: mkdir d10/d3d/d51/df4 0 2024-09-19T09:03:11.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/718: read - d10/d11/d13/dbc/dcd/f9e zero size 2024-09-19T09:03:11.091 INFO:tasks.workunit.client.0.smithi049.stdout:7/990: rename d1/d8/d2d/d36/d91/f151 to d1/d1a/de7/f157 0 2024-09-19T09:03:11.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/558: dwrite d5/d6/d19/d21/d52/f7d [0,4194304] 0 2024-09-19T09:03:11.094 INFO:tasks.workunit.client.0.smithi049.stdout:8/830: symlink d1/d1a/db0/dd5/lfa 0 2024-09-19T09:03:11.096 INFO:tasks.workunit.client.0.smithi049.stdout:8/831: chown d1/d11/d4f/d87/d7a/de9/f9c 72198134 1 2024-09-19T09:03:11.101 INFO:tasks.workunit.client.0.smithi049.stdout:0/838: dwrite d5/f58 [0,4194304] 0 2024-09-19T09:03:11.104 INFO:tasks.workunit.client.0.smithi049.stdout:0/839: chown d5/d86/f95 22 1 2024-09-19T09:03:11.107 INFO:tasks.workunit.client.0.smithi049.stdout:1/559: creat d5/d6/d19/d30/d64/fba x:0 0 0 2024-09-19T09:03:11.111 INFO:tasks.workunit.client.0.smithi049.stdout:2/880: link d1/f107 d1/d4/d1e/d9f/f126 0 2024-09-19T09:03:11.126 INFO:tasks.workunit.client.0.smithi049.stdout:8/832: dwrite d1/d11/d4f/d87/f55 [4194304,4194304] 0 2024-09-19T09:03:11.127 INFO:tasks.workunit.client.0.smithi049.stdout:2/881: creat d1/d2/d70/de0/f127 x:0 0 0 2024-09-19T09:03:11.130 INFO:tasks.workunit.client.0.smithi049.stdout:3/719: getdents d10/d3d/d76/dac/dad 0 2024-09-19T09:03:11.133 INFO:tasks.workunit.client.0.smithi049.stdout:3/720: chown d10/d11/d27/f5f 93 1 2024-09-19T09:03:11.136 INFO:tasks.workunit.client.0.smithi049.stdout:0/840: dwrite d5/d10/d13/d15/d36/d3d/f33 [0,4194304] 0 2024-09-19T09:03:11.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/833: rmdir d1/d11/d4f/d87/d7a/de9/d5b 39 2024-09-19T09:03:11.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/991: dwrite d1/f68 [0,4194304] 0 2024-09-19T09:03:11.142 INFO:tasks.workunit.client.0.smithi049.stdout:0/841: truncate d5/d10/d13/dc4/f101 96385 0 2024-09-19T09:03:11.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/882: creat d1/d2b/d7c/dc3/f128 x:0 0 0 2024-09-19T09:03:11.144 INFO:tasks.workunit.client.0.smithi049.stdout:3/721: mkdir d10/d3d/d95/df5 0 2024-09-19T09:03:11.147 INFO:tasks.workunit.client.0.smithi049.stdout:3/722: dread - d10/d3d/d79/fb3 zero size 2024-09-19T09:03:11.147 INFO:tasks.workunit.client.0.smithi049.stdout:0/842: write d5/fa [2237276,17030] 0 2024-09-19T09:03:11.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/723: readlink d10/db8/lf1 0 2024-09-19T09:03:11.150 INFO:tasks.workunit.client.0.smithi049.stdout:8/834: dwrite d1/d27/fe8 [0,4194304] 0 2024-09-19T09:03:11.150 INFO:tasks.workunit.client.0.smithi049.stdout:2/883: creat d1/d2/d70/df3/f129 x:0 0 0 2024-09-19T09:03:11.152 INFO:tasks.workunit.client.0.smithi049.stdout:7/992: rename d1/d8/d149/dc6/dd8/f146 to d1/d8/d2d/d72/d11d/d9c/d131/d138/f158 0 2024-09-19T09:03:11.156 INFO:tasks.workunit.client.0.smithi049.stdout:0/843: chown d5/d10/d13/lc0 646884252 1 2024-09-19T09:03:11.159 INFO:tasks.workunit.client.0.smithi049.stdout:2/884: readlink d1/d2/d32/l44 0 2024-09-19T09:03:11.159 INFO:tasks.workunit.client.0.smithi049.stdout:3/724: truncate d10/d11/d13/d30/f31 930825 0 2024-09-19T09:03:11.160 INFO:tasks.workunit.client.0.smithi049.stdout:7/993: mknod d1/d1a/da0/dd3/d62/d6b/c159 0 2024-09-19T09:03:11.162 INFO:tasks.workunit.client.0.smithi049.stdout:0/844: rename d5/d10/d2f/d6d/daa to d5/d10/d13/d15/d36/d3d/d7f/d103 0 2024-09-19T09:03:11.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/885: mknod d1/d4/d1e/d21/d8c/c12a 0 2024-09-19T09:03:11.164 INFO:tasks.workunit.client.0.smithi049.stdout:7/994: rmdir d1/d8/d80 39 2024-09-19T09:03:11.165 INFO:tasks.workunit.client.0.smithi049.stdout:3/725: truncate d10/d11/d13/d30/f3c 570124 0 2024-09-19T09:03:11.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/845: mknod d5/d10/d13/d30/d9f/c104 0 2024-09-19T09:03:11.168 INFO:tasks.workunit.client.0.smithi049.stdout:2/886: truncate d1/d4/d1e/d21/f52 459547 0 2024-09-19T09:03:11.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/887: fsync d1/d2/f54 0 2024-09-19T09:03:11.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/726: dwrite d10/d3d/d46/fdb [0,4194304] 0 2024-09-19T09:03:11.174 INFO:tasks.workunit.client.0.smithi049.stdout:2/888: stat d1/d4/d1e/d21/d8c/d117 0 2024-09-19T09:03:11.175 INFO:tasks.workunit.client.0.smithi049.stdout:3/727: fsync d10/d11/d13/d30/f9b 0 2024-09-19T09:03:11.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/728: fsync d10/d3d/fa6 0 2024-09-19T09:03:11.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/889: creat d1/d4/d1e/d9f/db3/d41/d7d/f12b x:0 0 0 2024-09-19T09:03:11.182 INFO:tasks.workunit.client.0.smithi049.stdout:2/890: fsync d1/d2/d23/d10c/f10f 0 2024-09-19T09:03:11.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/846: rmdir d5/dab/dda 0 2024-09-19T09:03:11.194 INFO:tasks.workunit.client.0.smithi049.stdout:0/847: mkdir d5/d10/d82/d67/d85/db4/d105 0 2024-09-19T09:03:11.203 INFO:tasks.workunit.client.0.smithi049.stdout:0/848: dread d5/ff [0,4194304] 0 2024-09-19T09:03:11.204 INFO:tasks.workunit.client.0.smithi049.stdout:0/849: dread - d5/d10/d13/d15/d29/d9a/fcc zero size 2024-09-19T09:03:11.310 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:11 smithi102 ceph-mon[35280]: pgmap v42: 65 pgs: 65 active+clean; 2.3 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 67 MiB/s rd, 154 MiB/s wr, 429 op/s 2024-09-19T09:03:11.311 INFO:tasks.workunit.client.0.smithi049.stdout:2/891: mknod d1/d4/d1e/d9f/db3/d41/d118/c12c 0 2024-09-19T09:03:11.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/850: creat d5/d10/d2f/dd4/f106 x:0 0 0 2024-09-19T09:03:11.315 INFO:tasks.workunit.client.0.smithi049.stdout:7/995: dwrite d1/d8/d2d/f11c [0,4194304] 0 2024-09-19T09:03:11.374 INFO:tasks.workunit.client.0.smithi049.stdout:3/729: link d10/d11/d13/d30/fde d10/d11/d13/dbc/dcd/ff6 0 2024-09-19T09:03:11.376 INFO:tasks.workunit.client.0.smithi049.stdout:2/892: truncate d1/d4/d20/dc7/feb 218477 0 2024-09-19T09:03:11.377 INFO:tasks.workunit.client.0.smithi049.stdout:0/851: mknod d5/d10/d7d/c107 0 2024-09-19T09:03:11.381 INFO:tasks.workunit.client.0.smithi049.stdout:3/730: mknod d10/d3d/d95/cf7 0 2024-09-19T09:03:11.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/893: chown d1/d2/d23/f56 29942863 1 2024-09-19T09:03:11.387 INFO:tasks.workunit.client.0.smithi049.stdout:0/852: mknod d5/d10/d13/dc4/dcd/ddb/c108 0 2024-09-19T09:03:11.388 INFO:tasks.workunit.client.0.smithi049.stdout:3/731: mkdir d10/db8/df8 0 2024-09-19T09:03:11.390 INFO:tasks.workunit.client.0.smithi049.stdout:2/894: truncate d1/d4/d1e/d9f/db3/d41/fde 3831977 0 2024-09-19T09:03:11.403 INFO:tasks.workunit.client.0.smithi049.stdout:7/996: truncate d1/d1a/de7/d50/fde 4006579 0 2024-09-19T09:03:11.411 INFO:tasks.workunit.client.0.smithi049.stdout:0/853: write d5/d10/d82/d67/f90 [3957512,123941] 0 2024-09-19T09:03:11.413 INFO:tasks.workunit.client.0.smithi049.stdout:0/854: write d5/d10/d13/d15/d29/f3e [5080839,101973] 0 2024-09-19T09:03:11.418 INFO:tasks.workunit.client.0.smithi049.stdout:7/997: getdents d1/d8/d80 0 2024-09-19T09:03:11.422 INFO:tasks.workunit.client.0.smithi049.stdout:2/895: dwrite d1/d2d/fa4 [0,4194304] 0 2024-09-19T09:03:11.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/732: dwrite d10/d11/d13/dbc/dcd/f93 [0,4194304] 0 2024-09-19T09:03:11.430 INFO:tasks.workunit.client.0.smithi049.stdout:2/896: symlink d1/d4/d20/dc7/l12d 0 2024-09-19T09:03:11.431 INFO:tasks.workunit.client.0.smithi049.stdout:2/897: stat d1/d4/d1e/d9f/db3/d41/d7d/c9e 0 2024-09-19T09:03:11.431 INFO:tasks.workunit.client.0.smithi049.stdout:7/998: truncate d1/d8/d2d/d36/d91/f95 2148202 0 2024-09-19T09:03:11.435 INFO:tasks.workunit.client.0.smithi049.stdout:0/855: write d5/d10/d13/d15/d36/d3d/f24 [1338937,75560] 0 2024-09-19T09:03:11.442 INFO:tasks.workunit.client.0.smithi049.stdout:0/856: creat d5/d10/d2f/d6d/dbe/f109 x:0 0 0 2024-09-19T09:03:11.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/999: mkdir d1/d1a/de7/d15a 0 2024-09-19T09:03:11.443 INFO:tasks.workunit.client.0.smithi049.stdout:1/560: sync 2024-09-19T09:03:11.443 INFO:tasks.workunit.client.0.smithi049.stdout:6/702: sync 2024-09-19T09:03:11.443 INFO:tasks.workunit.client.0.smithi049.stdout:5/679: sync 2024-09-19T09:03:11.443 INFO:tasks.workunit.client.0.smithi049.stdout:4/677: sync 2024-09-19T09:03:11.444 INFO:tasks.workunit.client.0.smithi049.stdout:5/680: stat d3/d5/d1c/db4 0 2024-09-19T09:03:11.454 INFO:tasks.workunit.client.0.smithi049.stdout:3/733: dread d10/d11/d13/f5e [0,4194304] 0 2024-09-19T09:03:11.454 INFO:tasks.workunit.client.0.smithi049.stdout:0/857: creat d5/d10/d13/d15/d29/f10a x:0 0 0 2024-09-19T09:03:11.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/703: creat dc/d1b/d20/d81/fde x:0 0 0 2024-09-19T09:03:11.456 INFO:tasks.workunit.client.0.smithi049.stdout:2/898: dwrite d1/d4/d1e/d9f/db3/d41/f101 [0,4194304] 0 2024-09-19T09:03:11.457 INFO:tasks.workunit.client.0.smithi049.stdout:0/858: chown d5/d10/d13/d30/d75/df7 100 1 2024-09-19T09:03:11.461 INFO:tasks.workunit.client.0.smithi049.stdout:3/734: fsync d10/d11/d27/f89 0 2024-09-19T09:03:11.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/859: mknod d5/d10/d13/dc4/c10b 0 2024-09-19T09:03:11.465 INFO:tasks.workunit.client.0.smithi049.stdout:5/681: dwrite d3/f6 [0,4194304] 0 2024-09-19T09:03:11.467 INFO:tasks.workunit.client.0.smithi049.stdout:5/682: readlink d3/d5/d20/lb9 0 2024-09-19T09:03:11.472 INFO:tasks.workunit.client.0.smithi049.stdout:1/561: dread d5/d6/d8/d13/f34 [0,4194304] 0 2024-09-19T09:03:11.472 INFO:tasks.workunit.client.0.smithi049.stdout:2/899: rename d1/d4/l6e to d1/d2/d6c/dd5/de2/dee/l12e 0 2024-09-19T09:03:11.474 INFO:tasks.workunit.client.0.smithi049.stdout:6/704: write dc/d1b/f39 [5170798,70095] 0 2024-09-19T09:03:11.475 INFO:tasks.workunit.client.0.smithi049.stdout:0/860: fdatasync d5/f50 0 2024-09-19T09:03:11.479 INFO:tasks.workunit.client.0.smithi049.stdout:2/900: symlink d1/d2/d23/d115/l12f 0 2024-09-19T09:03:11.482 INFO:tasks.workunit.client.0.smithi049.stdout:6/705: mkdir dc/d1b/d20/d81/d5a/dae/ddf 0 2024-09-19T09:03:11.482 INFO:tasks.workunit.client.0.smithi049.stdout:1/562: dwrite d5/d6/d73/da0/fb8 [0,4194304] 0 2024-09-19T09:03:11.484 INFO:tasks.workunit.client.0.smithi049.stdout:1/563: chown d5/c27 512 1 2024-09-19T09:03:11.487 INFO:tasks.workunit.client.0.smithi049.stdout:3/735: dread d10/f34 [0,4194304] 0 2024-09-19T09:03:11.488 INFO:tasks.workunit.client.0.smithi049.stdout:6/706: mknod dc/d1b/d20/d81/d5a/dae/ce0 0 2024-09-19T09:03:11.490 INFO:tasks.workunit.client.0.smithi049.stdout:1/564: dread d5/d6/d19/d21/d52/f7d [0,4194304] 0 2024-09-19T09:03:11.491 INFO:tasks.workunit.client.0.smithi049.stdout:6/707: fsync dc/d1b/d20/d2f/da6/fa9 0 2024-09-19T09:03:11.491 INFO:tasks.workunit.client.0.smithi049.stdout:1/565: chown d5/d6/l74 0 1 2024-09-19T09:03:11.502 INFO:tasks.workunit.client.0.smithi049.stdout:0/861: dwrite d5/d10/d13/d15/d36/f6e [0,4194304] 0 2024-09-19T09:03:11.505 INFO:tasks.workunit.client.0.smithi049.stdout:2/901: dwrite d1/d4/d20/f1c [4194304,4194304] 0 2024-09-19T09:03:11.505 INFO:tasks.workunit.client.0.smithi049.stdout:3/736: write d10/d3d/d95/fcc [259898,44538] 0 2024-09-19T09:03:11.505 INFO:tasks.workunit.client.0.smithi049.stdout:6/708: write dc/d1b/d20/d2f/f5c [5101899,77946] 0 2024-09-19T09:03:11.509 INFO:tasks.workunit.client.0.smithi049.stdout:6/709: chown dc/c45 1 1 2024-09-19T09:03:11.510 INFO:tasks.workunit.client.0.smithi049.stdout:3/737: dread - d10/d3d/d46/fb4 zero size 2024-09-19T09:03:11.511 INFO:tasks.workunit.client.0.smithi049.stdout:0/862: truncate d5/d10/d13/d30/d9f/fad 1122904 0 2024-09-19T09:03:11.513 INFO:tasks.workunit.client.0.smithi049.stdout:0/863: write d5/d10/d13/d15/d36/d3d/f24 [574299,81510] 0 2024-09-19T09:03:11.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/864: rmdir d5/d10/d82/d67 39 2024-09-19T09:03:11.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/865: readlink d5/d64/ldd 0 2024-09-19T09:03:11.522 INFO:tasks.workunit.client.0.smithi049.stdout:0/866: mknod d5/d10/d82/c10c 0 2024-09-19T09:03:11.524 INFO:tasks.workunit.client.0.smithi049.stdout:0/867: rmdir d5/d64/d97 39 2024-09-19T09:03:11.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/710: dwrite dc/d1b/d20/f87 [0,4194304] 0 2024-09-19T09:03:11.527 INFO:tasks.workunit.client.0.smithi049.stdout:0/868: mkdir d5/d10/d13/d15/d36/d3d/d10d 0 2024-09-19T09:03:11.534 INFO:tasks.workunit.client.0.smithi049.stdout:3/738: write d10/d11/d27/d4f/f60 [2551160,2722] 0 2024-09-19T09:03:11.536 INFO:tasks.workunit.client.0.smithi049.stdout:0/869: chown d5/d64/d97/cb3 18231334 1 2024-09-19T09:03:11.538 INFO:tasks.workunit.client.0.smithi049.stdout:6/711: link dc/d1b/d20/d81/c44 dc/d1b/d20/d2f/d31/ce1 0 2024-09-19T09:03:11.540 INFO:tasks.workunit.client.0.smithi049.stdout:2/902: dwrite d1/d2b/f1a [0,4194304] 0 2024-09-19T09:03:11.541 INFO:tasks.workunit.client.0.smithi049.stdout:1/566: dread d5/d6/d19/f39 [0,4194304] 0 2024-09-19T09:03:11.542 INFO:tasks.workunit.client.0.smithi049.stdout:6/712: write dc/d1b/d6f/f96 [690653,18760] 0 2024-09-19T09:03:11.545 INFO:tasks.workunit.client.0.smithi049.stdout:3/739: truncate d10/d11/d13/d30/f3c 1112829 0 2024-09-19T09:03:11.549 INFO:tasks.workunit.client.0.smithi049.stdout:6/713: rmdir dc/d1b/d20/d2f/d6b 39 2024-09-19T09:03:11.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:11 smithi049 ceph-mon[28158]: pgmap v42: 65 pgs: 65 active+clean; 2.3 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 67 MiB/s rd, 154 MiB/s wr, 429 op/s 2024-09-19T09:03:11.552 INFO:tasks.workunit.client.0.smithi049.stdout:6/714: truncate dc/d1b/d20/d81/fde 199541 0 2024-09-19T09:03:11.552 INFO:tasks.workunit.client.0.smithi049.stdout:0/870: dwrite d5/d10/d13/d30/d75/f81 [0,4194304] 0 2024-09-19T09:03:11.556 INFO:tasks.workunit.client.0.smithi049.stdout:1/567: mkdir d5/d6/d8/d13/d24/dbb 0 2024-09-19T09:03:11.557 INFO:tasks.workunit.client.0.smithi049.stdout:2/903: symlink d1/d4/d1e/d21/d8c/d117/l130 0 2024-09-19T09:03:11.559 INFO:tasks.workunit.client.0.smithi049.stdout:2/904: chown d1/d2/d23/d49/d75/d114/c33 3326224 1 2024-09-19T09:03:11.559 INFO:tasks.workunit.client.0.smithi049.stdout:6/715: creat dc/d1b/d20/d2f/d4c/fe2 x:0 0 0 2024-09-19T09:03:11.560 INFO:tasks.workunit.client.0.smithi049.stdout:2/905: chown d1/d2/d23/d49/d75/f84 714141102 1 2024-09-19T09:03:11.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/740: rename d10/d3d/d46/ff2 to d10/d11/dd7/ff9 0 2024-09-19T09:03:11.566 INFO:tasks.workunit.client.0.smithi049.stdout:6/716: symlink dc/d1b/d20/d2f/le3 0 2024-09-19T09:03:11.567 INFO:tasks.workunit.client.0.smithi049.stdout:1/568: truncate d5/f36 2886365 0 2024-09-19T09:03:11.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/906: truncate d1/d4/d20/d92/f125 2048479 0 2024-09-19T09:03:11.570 INFO:tasks.workunit.client.0.smithi049.stdout:3/741: readlink d10/d11/l6f 0 2024-09-19T09:03:11.572 INFO:tasks.workunit.client.0.smithi049.stdout:2/907: write d1/d2/d23/d49/d75/d114/f120 [531484,5483] 0 2024-09-19T09:03:11.572 INFO:tasks.workunit.client.0.smithi049.stdout:0/871: dread d5/d86/f95 [0,4194304] 0 2024-09-19T09:03:11.574 INFO:tasks.workunit.client.0.smithi049.stdout:6/717: rename dc/d1b/d20/d2f/d53 to dc/d1b/d20/d81/d5a/dae/ddf/de4 0 2024-09-19T09:03:11.576 INFO:tasks.workunit.client.0.smithi049.stdout:2/908: rename d1/d2 to d1/d2/d23/d10c/d131 22 2024-09-19T09:03:11.579 INFO:tasks.workunit.client.0.smithi049.stdout:6/718: rmdir dc/d1b/d20/d2f/db4 39 2024-09-19T09:03:11.581 INFO:tasks.workunit.client.0.smithi049.stdout:3/742: dwrite d10/d3d/d76/dac/dad/fda [0,4194304] 0 2024-09-19T09:03:11.587 INFO:tasks.workunit.client.0.smithi049.stdout:1/569: write d5/d6/d8/d13/f12 [278113,119460] 0 2024-09-19T09:03:11.596 INFO:tasks.workunit.client.0.smithi049.stdout:3/743: truncate d10/d11/dd7/ff9 2453358 0 2024-09-19T09:03:11.597 INFO:tasks.workunit.client.0.smithi049.stdout:8/835: sync 2024-09-19T09:03:11.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/570: fsync d5/d6/d8/d13/d24/d7e/fa3 0 2024-09-19T09:03:11.600 INFO:tasks.workunit.client.0.smithi049.stdout:6/719: dread dc/d1b/d78/db3/fce [0,4194304] 0 2024-09-19T09:03:11.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/744: dread d10/d11/d27/d4f/d59/d81/fcf [0,4194304] 0 2024-09-19T09:03:11.604 INFO:tasks.workunit.client.0.smithi049.stdout:6/720: truncate dc/d1b/d20/d81/d5a/f9f 712487 0 2024-09-19T09:03:11.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/872: dwrite d5/d10/d13/d15/d36/f6a [0,4194304] 0 2024-09-19T09:03:11.613 INFO:tasks.workunit.client.0.smithi049.stdout:8/836: write d1/f14 [1462902,120506] 0 2024-09-19T09:03:11.616 INFO:tasks.workunit.client.0.smithi049.stdout:0/873: truncate d5/fb1 1502155 0 2024-09-19T09:03:11.617 INFO:tasks.workunit.client.0.smithi049.stdout:0/874: write d5/fa [1816843,123407] 0 2024-09-19T09:03:11.618 INFO:tasks.workunit.client.0.smithi049.stdout:0/875: fsync d5/d10/d13/d15/d36/f6e 0 2024-09-19T09:03:11.619 INFO:tasks.workunit.client.0.smithi049.stdout:1/571: mkdir d5/d6/d19/d21/d52/da6/da7/dbc 0 2024-09-19T09:03:11.625 INFO:tasks.workunit.client.0.smithi049.stdout:6/721: creat dc/d1b/d20/fe5 x:0 0 0 2024-09-19T09:03:11.627 INFO:tasks.workunit.client.0.smithi049.stdout:1/572: dwrite d5/d6/d19/fa4 [0,4194304] 0 2024-09-19T09:03:11.627 INFO:tasks.workunit.client.0.smithi049.stdout:6/722: read dc/d16/f70 [718003,89403] 0 2024-09-19T09:03:11.632 INFO:tasks.workunit.client.0.smithi049.stdout:8/837: rename d1/d11/d2e/d4e/f88 to d1/d11/d4f/d87/d5d/ffb 0 2024-09-19T09:03:11.636 INFO:tasks.workunit.client.0.smithi049.stdout:6/723: dwrite dc/d1b/d20/d2f/f66 [0,4194304] 0 2024-09-19T09:03:11.638 INFO:tasks.workunit.client.0.smithi049.stdout:6/724: dread - dc/d1b/d20/d81/d5a/dae/ddf/de4/f8a zero size 2024-09-19T09:03:11.641 INFO:tasks.workunit.client.0.smithi049.stdout:0/876: rename d5/d10/d13/d15/d36 to d5/d10/d82/d67/d85/d10e 0 2024-09-19T09:03:11.649 INFO:tasks.workunit.client.0.smithi049.stdout:3/745: write d10/d11/f39 [4865991,60006] 0 2024-09-19T09:03:11.650 INFO:tasks.workunit.client.0.smithi049.stdout:3/746: creat d10/d3d/d79/ffa x:0 0 0 2024-09-19T09:03:11.722 INFO:tasks.workunit.client.0.smithi049.stdout:3/747: rename d10/db8/df8 to d10/d3d/d95/dfb 0 2024-09-19T09:03:11.728 INFO:tasks.workunit.client.0.smithi049.stdout:3/748: dread d10/d3d/f8c [4194304,4194304] 0 2024-09-19T09:03:11.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/749: stat d10/d3d/d76/dac/dad/daf/cb6 0 2024-09-19T09:03:11.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/750: readlink l8 0 2024-09-19T09:03:11.730 INFO:tasks.workunit.client.0.smithi049.stdout:8/838: write d1/d27/f79 [1694141,103429] 0 2024-09-19T09:03:11.734 INFO:tasks.workunit.client.0.smithi049.stdout:8/839: readlink d1/d11/d4f/d87/d7a/de9/d5b/lf9 0 2024-09-19T09:03:11.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/840: chown d1/d11/d2e/d89 22235 1 2024-09-19T09:03:11.737 INFO:tasks.workunit.client.0.smithi049.stdout:0/877: dwrite d5/f50 [0,4194304] 0 2024-09-19T09:03:11.742 INFO:tasks.workunit.client.0.smithi049.stdout:8/841: symlink d1/d11/lfc 0 2024-09-19T09:03:11.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/878: dread - d5/d10/d13/d15/d29/d9a/fd6 zero size 2024-09-19T09:03:11.747 INFO:tasks.workunit.client.0.smithi049.stdout:0/879: truncate d5/d10/d2f/d6d/dbe/fca 4350905 0 2024-09-19T09:03:11.748 INFO:tasks.workunit.client.0.smithi049.stdout:8/842: dread d1/d11/d45/f84 [0,4194304] 0 2024-09-19T09:03:11.749 INFO:tasks.workunit.client.0.smithi049.stdout:0/880: write d5/d10/d2f/d6d/fc6 [1504412,99343] 0 2024-09-19T09:03:11.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/843: readlink d1/d11/d4f/d87/lb6 0 2024-09-19T09:03:11.752 INFO:tasks.workunit.client.0.smithi049.stdout:8/844: rmdir d1/d11 39 2024-09-19T09:03:11.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/845: rename d1 to d1/d1a/db0/dd5/dfd 22 2024-09-19T09:03:11.761 INFO:tasks.workunit.client.0.smithi049.stdout:0/881: dwrite d5/d10/d82/d67/d85/db4/dbb/fbd [0,4194304] 0 2024-09-19T09:03:11.764 INFO:tasks.workunit.client.0.smithi049.stdout:0/882: readlink l0 0 2024-09-19T09:03:11.766 INFO:tasks.workunit.client.0.smithi049.stdout:3/751: dwrite d10/d3d/f8c [4194304,4194304] 0 2024-09-19T09:03:11.769 INFO:tasks.workunit.client.0.smithi049.stdout:8/846: mknod d1/d27/cfe 0 2024-09-19T09:03:11.773 INFO:tasks.workunit.client.0.smithi049.stdout:8/847: chown d1/d11/d2e/d4e/d61/d9f/dda 361262 1 2024-09-19T09:03:11.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/848: dread d1/d11/f1b [0,4194304] 0 2024-09-19T09:03:11.803 INFO:tasks.workunit.client.0.smithi049.stdout:8/849: rename d1/d11/d4f/d87/d5d/d65/c72 to d1/d11/d2e/d4e/d61/cff 0 2024-09-19T09:03:11.803 INFO:tasks.workunit.client.0.smithi049.stdout:3/752: write d10/d11/d27/f2c [3645744,31971] 0 2024-09-19T09:03:11.806 INFO:tasks.workunit.client.0.smithi049.stdout:3/753: write d10/d3d/d76/da3/db7/de3/fea [397564,43752] 0 2024-09-19T09:03:11.812 INFO:tasks.workunit.client.0.smithi049.stdout:8/850: rename d1/d11/l2f to d1/d11/d4f/d9d/l100 0 2024-09-19T09:03:11.814 INFO:tasks.workunit.client.0.smithi049.stdout:8/851: truncate d1/d11/d4f/d87/d5d/d65/f6d 5765243 0 2024-09-19T09:03:11.818 INFO:tasks.workunit.client.0.smithi049.stdout:3/754: creat d10/d11/ffc x:0 0 0 2024-09-19T09:03:11.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/852: mkdir d1/d11/d101 0 2024-09-19T09:03:11.822 INFO:tasks.workunit.client.0.smithi049.stdout:8/853: chown d1/d1a/f3b 3171 1 2024-09-19T09:03:11.824 INFO:tasks.workunit.client.0.smithi049.stdout:8/854: symlink d1/d1a/db0/dd5/l102 0 2024-09-19T09:03:11.830 INFO:tasks.workunit.client.0.smithi049.stdout:8/855: creat d1/d11/d4f/d87/d5d/f103 x:0 0 0 2024-09-19T09:03:11.833 INFO:tasks.workunit.client.0.smithi049.stdout:3/755: dread d10/f38 [0,4194304] 0 2024-09-19T09:03:11.837 INFO:tasks.workunit.client.0.smithi049.stdout:3/756: unlink d10/d11/d27/c77 0 2024-09-19T09:03:11.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/856: fsync d1/d11/d4f/d87/d5d/ffb 0 2024-09-19T09:03:11.847 INFO:tasks.workunit.client.0.smithi049.stdout:8/857: truncate d1/d11/d4f/d87/d7a/de9/f6b 3805606 0 2024-09-19T09:03:11.847 INFO:tasks.workunit.client.0.smithi049.stdout:3/757: dwrite d10/d11/d13/d30/fde [0,4194304] 0 2024-09-19T09:03:11.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/858: mkdir d1/d11/d2e/d4e/d82/d104 0 2024-09-19T09:03:11.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/758: rename d10/d3d/d76/dac/cdf to d10/d11/d27/d4f/d59/d81/cfd 0 2024-09-19T09:03:11.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/859: creat d1/d11/d2e/d4e/d61/d9f/dc3/f105 x:0 0 0 2024-09-19T09:03:11.859 INFO:tasks.workunit.client.0.smithi049.stdout:3/759: symlink d10/db8/lfe 0 2024-09-19T09:03:11.866 INFO:tasks.workunit.client.0.smithi049.stdout:3/760: mknod d10/d11/def/cff 0 2024-09-19T09:03:11.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/761: getdents d10/d3d/d79/dc1 0 2024-09-19T09:03:11.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/762: chown d10/c54 23666 1 2024-09-19T09:03:11.875 INFO:tasks.workunit.client.0.smithi049.stdout:3/763: chown d10/d3d/d46/fdb 44452054 1 2024-09-19T09:03:11.877 INFO:tasks.workunit.client.0.smithi049.stdout:8/860: dwrite d1/d11/d4f/d87/d7a/fbd [0,4194304] 0 2024-09-19T09:03:11.879 INFO:tasks.workunit.client.0.smithi049.stdout:3/764: dread d10/d3d/d76/fb0 [0,4194304] 0 2024-09-19T09:03:11.880 INFO:tasks.workunit.client.0.smithi049.stdout:3/765: write d10/d3d/d95/fcc [1343870,130100] 0 2024-09-19T09:03:11.881 INFO:tasks.workunit.client.0.smithi049.stdout:8/861: mknod d1/d11/d101/c106 0 2024-09-19T09:03:11.884 INFO:tasks.workunit.client.0.smithi049.stdout:3/766: creat d10/db8/f100 x:0 0 0 2024-09-19T09:03:11.886 INFO:tasks.workunit.client.0.smithi049.stdout:8/862: creat d1/f107 x:0 0 0 2024-09-19T09:03:11.887 INFO:tasks.workunit.client.0.smithi049.stdout:3/767: creat d10/d11/d27/d4f/f101 x:0 0 0 2024-09-19T09:03:11.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/768: write d10/d3d/d46/fdb [170975,72866] 0 2024-09-19T09:03:11.890 INFO:tasks.workunit.client.0.smithi049.stdout:8/863: rename d1/d11/fc0 to d1/d27/f108 0 2024-09-19T09:03:11.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/769: mknod d10/d3d/d46/d84/c102 0 2024-09-19T09:03:11.895 INFO:tasks.workunit.client.0.smithi049.stdout:8/864: rmdir d1/d1a/dc2 39 2024-09-19T09:03:11.899 INFO:tasks.workunit.client.0.smithi049.stdout:8/865: symlink d1/d11/d4f/d87/d7a/de9/d8c/l109 0 2024-09-19T09:03:11.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/770: mknod d10/d3d/d76/dac/c103 0 2024-09-19T09:03:11.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/771: chown d10/l88 2 1 2024-09-19T09:03:11.903 INFO:tasks.workunit.client.0.smithi049.stdout:8/866: mkdir d1/d1a/dc2/d10a 0 2024-09-19T09:03:11.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/867: creat d1/d11/f10b x:0 0 0 2024-09-19T09:03:11.911 INFO:tasks.workunit.client.0.smithi049.stdout:3/772: link d10/d11/d27/d4f/d59/l62 d10/d11/d13/d7e/l104 0 2024-09-19T09:03:11.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/868: write d1/d11/d4f/d87/d7a/de9/d5b/f76 [375094,63234] 0 2024-09-19T09:03:11.915 INFO:tasks.workunit.client.0.smithi049.stdout:8/869: creat d1/d1a/db0/dd5/f10c x:0 0 0 2024-09-19T09:03:11.919 INFO:tasks.workunit.client.0.smithi049.stdout:8/870: rename d1/la to d1/d11/d2e/db5/l10d 0 2024-09-19T09:03:11.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/871: write d1/d11/f10b [222487,21818] 0 2024-09-19T09:03:11.925 INFO:tasks.workunit.client.0.smithi049.stdout:8/872: unlink d1/d11/d4f/d87/d7a/de9/fd9 0 2024-09-19T09:03:11.929 INFO:tasks.workunit.client.0.smithi049.stdout:8/873: write d1/f77 [582054,27953] 0 2024-09-19T09:03:11.932 INFO:tasks.workunit.client.0.smithi049.stdout:3/773: dwrite d10/d11/d27/f78 [0,4194304] 0 2024-09-19T09:03:11.934 INFO:tasks.workunit.client.0.smithi049.stdout:8/874: mkdir d1/d11/d2e/d4e/d61/d9f/d10e 0 2024-09-19T09:03:11.937 INFO:tasks.workunit.client.0.smithi049.stdout:8/875: mkdir d1/d1a/db0/d10f 0 2024-09-19T09:03:11.949 INFO:tasks.workunit.client.0.smithi049.stdout:3/774: dwrite d10/d11/d13/d30/f40 [4194304,4194304] 0 2024-09-19T09:03:11.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/775: readlink d10/d11/l58 0 2024-09-19T09:03:11.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/678: sync 2024-09-19T09:03:11.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/683: sync 2024-09-19T09:03:11.954 INFO:tasks.workunit.client.0.smithi049.stdout:3/776: mkdir d10/d3d/d76/d105 0 2024-09-19T09:03:11.955 INFO:tasks.workunit.client.0.smithi049.stdout:4/679: dread - d4/d6c/d74/f99 zero size 2024-09-19T09:03:11.960 INFO:tasks.workunit.client.0.smithi049.stdout:4/680: creat d4/d6c/da2/fd6 x:0 0 0 2024-09-19T09:03:11.961 INFO:tasks.workunit.client.0.smithi049.stdout:4/681: chown d4/d15/d19/f2f 920 1 2024-09-19T09:03:11.962 INFO:tasks.workunit.client.0.smithi049.stdout:3/777: truncate d10/d11/d13/f32 2032703 0 2024-09-19T09:03:11.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/876: dread d1/f77 [0,4194304] 0 2024-09-19T09:03:11.967 INFO:tasks.workunit.client.0.smithi049.stdout:3/778: readlink d10/d11/d13/d7e/l104 0 2024-09-19T09:03:11.968 INFO:tasks.workunit.client.0.smithi049.stdout:8/877: write d1/d11/d4f/d87/d5d/d65/f7e [9220289,60256] 0 2024-09-19T09:03:11.972 INFO:tasks.workunit.client.0.smithi049.stdout:5/684: dread d3/d5/de/d4a/f68 [0,4194304] 0 2024-09-19T09:03:11.979 INFO:tasks.workunit.client.0.smithi049.stdout:3/779: rmdir d10/d3d/d51/df4 0 2024-09-19T09:03:11.981 INFO:tasks.workunit.client.0.smithi049.stdout:4/682: dwrite d4/f93 [0,4194304] 0 2024-09-19T09:03:11.981 INFO:tasks.workunit.client.0.smithi049.stdout:3/780: dread - d10/d11/d13/dbc/dcd/fe7 zero size 2024-09-19T09:03:11.983 INFO:tasks.workunit.client.0.smithi049.stdout:8/878: link d1/d11/d2e/f57 d1/d27/f110 0 2024-09-19T09:03:11.984 INFO:tasks.workunit.client.0.smithi049.stdout:5/685: link d3/d5/d1c/d2d/l4e d3/d5/d20/ld9 0 2024-09-19T09:03:11.985 INFO:tasks.workunit.client.0.smithi049.stdout:4/683: rmdir d4/d34/d3d/d4f 39 2024-09-19T09:03:11.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/686: chown d3/d5/de/d12/d45/d7a 223 1 2024-09-19T09:03:11.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/687: fsync d3/d5/de/d12/d7d/d88/fcb 0 2024-09-19T09:03:11.989 INFO:tasks.workunit.client.0.smithi049.stdout:5/688: chown d3/dc/d43/f82 0 1 2024-09-19T09:03:11.991 INFO:tasks.workunit.client.0.smithi049.stdout:3/781: link d10/d11/d13/d7e/l104 d10/d3d/d76/dac/dad/daf/l106 0 2024-09-19T09:03:11.993 INFO:tasks.workunit.client.0.smithi049.stdout:8/879: getdents d1/d1a/dc2 0 2024-09-19T09:03:11.996 INFO:tasks.workunit.client.0.smithi049.stdout:2/909: sync 2024-09-19T09:03:11.996 INFO:tasks.workunit.client.0.smithi049.stdout:8/880: mknod d1/d11/d2e/d4e/d61/d9f/c111 0 2024-09-19T09:03:12.000 INFO:tasks.workunit.client.0.smithi049.stdout:2/910: symlink d1/d2/d23/d115/l132 0 2024-09-19T09:03:12.001 INFO:tasks.workunit.client.0.smithi049.stdout:8/881: creat d1/f112 x:0 0 0 2024-09-19T09:03:12.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/684: dread d4/d15/d19/f2f [0,4194304] 0 2024-09-19T09:03:12.003 INFO:tasks.workunit.client.0.smithi049.stdout:2/911: write d1/d2/d23/dca/fcb [4729814,24183] 0 2024-09-19T09:03:12.007 INFO:tasks.workunit.client.0.smithi049.stdout:4/685: write d4/d45/d3f/d47/f81 [2270460,92848] 0 2024-09-19T09:03:12.007 INFO:tasks.workunit.client.0.smithi049.stdout:3/782: truncate d10/d3d/d51/fd6 3907159 0 2024-09-19T09:03:12.009 INFO:tasks.workunit.client.0.smithi049.stdout:8/882: creat d1/d11/d2e/d4e/d82/dd8/f113 x:0 0 0 2024-09-19T09:03:12.012 INFO:tasks.workunit.client.0.smithi049.stdout:5/689: dread d3/f62 [0,4194304] 0 2024-09-19T09:03:12.014 INFO:tasks.workunit.client.0.smithi049.stdout:2/912: creat d1/d2/d32/f133 x:0 0 0 2024-09-19T09:03:12.015 INFO:tasks.workunit.client.0.smithi049.stdout:8/883: mknod d1/d11/d4f/d87/d5d/c114 0 2024-09-19T09:03:12.016 INFO:tasks.workunit.client.0.smithi049.stdout:4/686: fsync d4/d34/d3d/d4f/d70/fc8 0 2024-09-19T09:03:12.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/687: fsync d4/d15/d19/d1f/d55/d7f/fad 0 2024-09-19T09:03:12.019 INFO:tasks.workunit.client.0.smithi049.stdout:2/913: chown d1/d2/d32/l8d 39 1 2024-09-19T09:03:12.022 INFO:tasks.workunit.client.0.smithi049.stdout:8/884: readlink d1/d11/d4f/d9d/le4 0 2024-09-19T09:03:12.024 INFO:tasks.workunit.client.0.smithi049.stdout:3/783: dread d10/d11/f1a [0,4194304] 0 2024-09-19T09:03:12.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/688: dwrite d4/d45/f8e [0,4194304] 0 2024-09-19T09:03:12.028 INFO:tasks.workunit.client.0.smithi049.stdout:2/914: dread - d1/d4/d1e/d21/d8c/fda zero size 2024-09-19T09:03:12.029 INFO:tasks.workunit.client.0.smithi049.stdout:2/915: write d1/d4/d20/f1c [6498086,20401] 0 2024-09-19T09:03:12.030 INFO:tasks.workunit.client.0.smithi049.stdout:2/916: readlink d1/d4/d1e/d9f/db3/d41/d7d/lf1 0 2024-09-19T09:03:12.031 INFO:tasks.workunit.client.0.smithi049.stdout:8/885: symlink d1/d11/d2e/d4e/d61/d9f/l115 0 2024-09-19T09:03:12.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/690: link d3/d6c/f9d d3/fda 0 2024-09-19T09:03:12.034 INFO:tasks.workunit.client.0.smithi049.stdout:8/886: write d1/d11/d4f/d87/f49 [3462302,98605] 0 2024-09-19T09:03:12.037 INFO:tasks.workunit.client.0.smithi049.stdout:2/917: dread d1/d4/d20/f1c [4194304,4194304] 0 2024-09-19T09:03:12.037 INFO:tasks.workunit.client.0.smithi049.stdout:4/689: mknod d4/d15/d19/cd7 0 2024-09-19T09:03:12.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/691: creat d3/d5/d20/d57/d72/fdb x:0 0 0 2024-09-19T09:03:12.043 INFO:tasks.workunit.client.0.smithi049.stdout:2/918: dread d1/d2/f67 [0,4194304] 0 2024-09-19T09:03:12.044 INFO:tasks.workunit.client.0.smithi049.stdout:8/887: creat d1/d11/d2e/d4e/d82/dd8/f116 x:0 0 0 2024-09-19T09:03:12.046 INFO:tasks.workunit.client.0.smithi049.stdout:4/690: truncate d4/d6c/d74/f99 738184 0 2024-09-19T09:03:12.046 INFO:tasks.workunit.client.0.smithi049.stdout:4/691: chown d4/d15/d19 6446869 1 2024-09-19T09:03:12.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/784: link d10/lc2 d10/d3d/d76/l107 0 2024-09-19T09:03:12.048 INFO:tasks.workunit.client.0.smithi049.stdout:3/785: readlink d10/d11/d27/d4f/le4 0 2024-09-19T09:03:12.048 INFO:tasks.workunit.client.0.smithi049.stdout:5/692: rmdir d3/d5/d1c/dd2 39 2024-09-19T09:03:12.049 INFO:tasks.workunit.client.0.smithi049.stdout:5/693: readlink d3/d5/d20/d38/d5a/d8b/la6 0 2024-09-19T09:03:12.049 INFO:tasks.workunit.client.0.smithi049.stdout:5/694: dread - d3/dc/fca zero size 2024-09-19T09:03:12.050 INFO:tasks.workunit.client.0.smithi049.stdout:4/692: rmdir d4/d15/d19/d1f/daa/dbd/dc6 39 2024-09-19T09:03:12.051 INFO:tasks.workunit.client.0.smithi049.stdout:8/888: mknod d1/d11/d2e/d89/c117 0 2024-09-19T09:03:12.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/919: dread d1/d2/d70/f9a [0,4194304] 0 2024-09-19T09:03:12.057 INFO:tasks.workunit.client.0.smithi049.stdout:3/786: rename d10/d3d/f6b to d10/d3d/f108 0 2024-09-19T09:03:12.059 INFO:tasks.workunit.client.0.smithi049.stdout:4/693: mknod d4/d15/d19/d1f/daa/dbd/cd8 0 2024-09-19T09:03:12.062 INFO:tasks.workunit.client.0.smithi049.stdout:5/695: dread d3/f32 [0,4194304] 0 2024-09-19T09:03:12.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/694: symlink d4/d35/d84/ld9 0 2024-09-19T09:03:12.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/889: write d1/d11/d2e/db5/fc9 [182274,95699] 0 2024-09-19T09:03:12.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/787: creat d10/d3d/d95/df5/f109 x:0 0 0 2024-09-19T09:03:12.071 INFO:tasks.workunit.client.0.smithi049.stdout:5/696: write d3/d5/d20/f76 [1438047,127582] 0 2024-09-19T09:03:12.077 INFO:tasks.workunit.client.0.smithi049.stdout:8/890: unlink d1/d11/d4f/d87/d5d/d65/f7e 0 2024-09-19T09:03:12.079 INFO:tasks.workunit.client.0.smithi049.stdout:2/920: dwrite d1/d4/d20/dc7/feb [0,4194304] 0 2024-09-19T09:03:12.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/697: stat d3/d5/d20/l98 0 2024-09-19T09:03:12.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/921: dwrite d1/d2/d70/df3/f116 [0,4194304] 0 2024-09-19T09:03:12.089 INFO:tasks.workunit.client.0.smithi049.stdout:3/788: write d10/d11/d27/d4f/f86 [1029784,123388] 0 2024-09-19T09:03:12.090 INFO:tasks.workunit.client.0.smithi049.stdout:3/789: chown d10/d11/d27/ca2 0 1 2024-09-19T09:03:12.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/790: fdatasync d10/d11/d27/f2c 0 2024-09-19T09:03:12.096 INFO:tasks.workunit.client.0.smithi049.stdout:8/891: mkdir d1/d11/d4f/d87/d5d/d65/d99/d118 0 2024-09-19T09:03:12.097 INFO:tasks.workunit.client.0.smithi049.stdout:8/892: stat d1/d1a/c5c 0 2024-09-19T09:03:12.100 INFO:tasks.workunit.client.0.smithi049.stdout:2/922: mkdir d1/d2/d6c/dd5/de2/dee/d134 0 2024-09-19T09:03:12.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/695: getdents d4/d45/d3f/d47 0 2024-09-19T09:03:12.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/696: write d4/d15/d19/f2f [3354413,83281] 0 2024-09-19T09:03:12.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/893: mkdir d1/d11/d2e/d4e/d61/d9f/d119 0 2024-09-19T09:03:12.105 INFO:tasks.workunit.client.0.smithi049.stdout:8/894: chown d1/d1a/dc2/ldd 26508090 1 2024-09-19T09:03:12.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/791: rmdir d10/d3d/d76/d105 0 2024-09-19T09:03:12.110 INFO:tasks.workunit.client.0.smithi049.stdout:1/573: sync 2024-09-19T09:03:12.110 INFO:tasks.workunit.client.0.smithi049.stdout:6/725: sync 2024-09-19T09:03:12.110 INFO:tasks.workunit.client.0.smithi049.stdout:0/883: sync 2024-09-19T09:03:12.111 INFO:tasks.workunit.client.0.smithi049.stdout:5/698: getdents d3/d5/d1c/d4c 0 2024-09-19T09:03:12.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/895: mknod d1/d11/d2e/d4e/c11a 0 2024-09-19T09:03:12.114 INFO:tasks.workunit.client.0.smithi049.stdout:5/699: readlink d3/d6c/d6d/la5 0 2024-09-19T09:03:12.114 INFO:tasks.workunit.client.0.smithi049.stdout:2/923: write d1/f7 [2922564,94751] 0 2024-09-19T09:03:12.115 INFO:tasks.workunit.client.0.smithi049.stdout:4/697: dwrite d4/d34/d3d/d62/f98 [0,4194304] 0 2024-09-19T09:03:12.116 INFO:tasks.workunit.client.0.smithi049.stdout:2/924: dread - d1/d2/d70/df3/f129 zero size 2024-09-19T09:03:12.117 INFO:tasks.workunit.client.0.smithi049.stdout:6/726: mkdir dc/d1b/d78/ddd/de6 0 2024-09-19T09:03:12.121 INFO:tasks.workunit.client.0.smithi049.stdout:6/727: dread - dc/d1b/d20/fe5 zero size 2024-09-19T09:03:12.123 INFO:tasks.workunit.client.0.smithi049.stdout:1/574: symlink d5/d6/d19/d21/d52/da6/da7/lbd 0 2024-09-19T09:03:12.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/698: write d4/f69 [3985011,122866] 0 2024-09-19T09:03:12.172 INFO:tasks.workunit.client.0.smithi049.stdout:0/884: write d5/d10/d2f/d6d/f8a [2221741,39377] 0 2024-09-19T09:03:12.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/925: symlink d1/d4/d1e/d21/dae/ded/df8/l135 0 2024-09-19T09:03:12.173 INFO:tasks.workunit.client.0.smithi049.stdout:8/896: dwrite d1/d11/d4f/d87/f55 [0,4194304] 0 2024-09-19T09:03:12.176 INFO:tasks.workunit.client.0.smithi049.stdout:1/575: chown d5/d6/d82/c91 8711003 1 2024-09-19T09:03:12.178 INFO:tasks.workunit.client.0.smithi049.stdout:4/699: read - d4/d15/d19/d1f/d55/f97 zero size 2024-09-19T09:03:12.178 INFO:tasks.workunit.client.0.smithi049.stdout:8/897: stat d1/d11/d4f/d87/d7a/de9/d8c/fe7 0 2024-09-19T09:03:12.179 INFO:tasks.workunit.client.0.smithi049.stdout:0/885: write d5/d10/d82/d67/f90 [2149962,14357] 0 2024-09-19T09:03:12.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/576: dread - d5/d6/d19/d21/d52/fa9 zero size 2024-09-19T09:03:12.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/926: creat d1/d4/d20/d92/f136 x:0 0 0 2024-09-19T09:03:12.183 INFO:tasks.workunit.client.0.smithi049.stdout:0/886: fdatasync d5/d10/d2f/d6d/f8a 0 2024-09-19T09:03:12.185 INFO:tasks.workunit.client.0.smithi049.stdout:2/927: fdatasync d1/d2/d23/d10c/f10f 0 2024-09-19T09:03:12.185 INFO:tasks.workunit.client.0.smithi049.stdout:1/577: rmdir d5/d6 39 2024-09-19T09:03:12.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/928: chown d1/d2b/d7c/dc3 170428 1 2024-09-19T09:03:12.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/792: dread d10/d11/d13/d7e/f85 [0,4194304] 0 2024-09-19T09:03:12.189 INFO:tasks.workunit.client.0.smithi049.stdout:0/887: dread d5/d10/d2f/d6d/f83 [0,4194304] 0 2024-09-19T09:03:12.189 INFO:tasks.workunit.client.0.smithi049.stdout:8/898: dread d1/d11/d2e/d4e/d61/fc5 [0,4194304] 0 2024-09-19T09:03:12.190 INFO:tasks.workunit.client.0.smithi049.stdout:0/888: fdatasync d5/fee 0 2024-09-19T09:03:12.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/929: truncate d1/d2/d6c/dd5/de2/dee/f108 766693 0 2024-09-19T09:03:12.198 INFO:tasks.workunit.client.0.smithi049.stdout:3/793: dwrite d10/d3d/d46/fee [0,4194304] 0 2024-09-19T09:03:12.198 INFO:tasks.workunit.client.0.smithi049.stdout:1/578: chown d5/d6/d19/d21/d52/da6/da7 0 1 2024-09-19T09:03:12.200 INFO:tasks.workunit.client.0.smithi049.stdout:6/728: write dc/d1b/d20/d81/d5a/f64 [1763731,121188] 0 2024-09-19T09:03:12.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/579: chown d5/d6/d73/da8 2883448 1 2024-09-19T09:03:12.201 INFO:tasks.workunit.client.0.smithi049.stdout:2/930: dread d1/d2/d6c/dd5/fec [0,4194304] 0 2024-09-19T09:03:12.205 INFO:tasks.workunit.client.0.smithi049.stdout:2/931: write d1/d4/d20/d92/f136 [365592,122598] 0 2024-09-19T09:03:12.208 INFO:tasks.workunit.client.0.smithi049.stdout:3/794: rename d10/d3d/d76/da3 to d10/d11/dd7/d10a 0 2024-09-19T09:03:12.210 INFO:tasks.workunit.client.0.smithi049.stdout:3/795: chown d10/d11/d13/dbc/dcd/f9e 128 1 2024-09-19T09:03:12.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/899: creat d1/d1a/d8b/d8e/f11b x:0 0 0 2024-09-19T09:03:12.218 INFO:tasks.workunit.client.0.smithi049.stdout:4/700: link d4/d15/d19/d1f/d55/d7f/fad d4/d45/d4a/dc3/db6/fda 0 2024-09-19T09:03:12.222 INFO:tasks.workunit.client.0.smithi049.stdout:2/932: mkdir d1/d4/d1e/d9f/db3/d41/d11a/d137 0 2024-09-19T09:03:12.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/900: symlink d1/l11c 0 2024-09-19T09:03:12.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/933: dread - d1/d4/d20/d92/fc2 zero size 2024-09-19T09:03:12.232 INFO:tasks.workunit.client.0.smithi049.stdout:3/796: mkdir d10/d3d/d76/dac/dad/de1/d10b 0 2024-09-19T09:03:12.232 INFO:tasks.workunit.client.0.smithi049.stdout:1/580: write d5/d6/d8/d13/d24/f2f [513272,28552] 0 2024-09-19T09:03:12.233 INFO:tasks.workunit.client.0.smithi049.stdout:6/729: truncate dc/d1b/d20/d2f/f66 2611721 0 2024-09-19T09:03:12.235 INFO:tasks.workunit.client.0.smithi049.stdout:0/889: dread d5/d10/d2f/d6d/f8a [0,4194304] 0 2024-09-19T09:03:12.238 INFO:tasks.workunit.client.0.smithi049.stdout:2/934: write d1/d2/d6c/fa0 [204062,38009] 0 2024-09-19T09:03:12.242 INFO:tasks.workunit.client.0.smithi049.stdout:6/730: dwrite dc/fc8 [0,4194304] 0 2024-09-19T09:03:12.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/701: dwrite d4/d34/d3d/d4f/d70/fc8 [0,4194304] 0 2024-09-19T09:03:12.283 INFO:tasks.workunit.client.0.smithi049.stdout:3/797: truncate d10/d11/d13/f28 2378647 0 2024-09-19T09:03:12.284 INFO:tasks.workunit.client.0.smithi049.stdout:3/798: readlink d10/d11/d27/d4f/le4 0 2024-09-19T09:03:12.285 INFO:tasks.workunit.client.0.smithi049.stdout:0/890: unlink d5/ff 0 2024-09-19T09:03:12.289 INFO:tasks.workunit.client.0.smithi049.stdout:6/731: unlink dc/d1b/d20/c41 0 2024-09-19T09:03:12.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/901: rename d1/d11/d4f/d87/d5d/d65/d99 to d1/d11/d4f/d87/d5d/d11d 0 2024-09-19T09:03:12.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/902: chown d1/d11/f74 0 1 2024-09-19T09:03:12.293 INFO:tasks.workunit.client.0.smithi049.stdout:1/581: mkdir d5/d6/d8/dbe 0 2024-09-19T09:03:12.295 INFO:tasks.workunit.client.0.smithi049.stdout:3/799: write d10/d11/d13/d7e/f85 [4116480,100817] 0 2024-09-19T09:03:12.297 INFO:tasks.workunit.client.0.smithi049.stdout:6/732: creat dc/d1b/d20/d2f/d4c/fe7 x:0 0 0 2024-09-19T09:03:12.299 INFO:tasks.workunit.client.0.smithi049.stdout:8/903: mkdir d1/d11/d4f/d87/d5d/d11d/d11e 0 2024-09-19T09:03:12.300 INFO:tasks.workunit.client.0.smithi049.stdout:1/582: rename d5/d6/f38 to d5/d6/d73/fbf 0 2024-09-19T09:03:12.302 INFO:tasks.workunit.client.0.smithi049.stdout:3/800: creat d10/d3d/d95/df5/f10c x:0 0 0 2024-09-19T09:03:12.302 INFO:tasks.workunit.client.0.smithi049.stdout:3/801: stat d10/d3d/d76/fb0 0 2024-09-19T09:03:12.303 INFO:tasks.workunit.client.0.smithi049.stdout:3/802: dread - d10/d11/d13/dbc/dcd/fe7 zero size 2024-09-19T09:03:12.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/803: dread - d10/d11/d13/dbc/dcd/fe7 zero size 2024-09-19T09:03:12.310 INFO:tasks.workunit.client.0.smithi049.stdout:3/804: write d10/d11/d27/d4f/f101 [799343,95624] 0 2024-09-19T09:03:12.313 INFO:tasks.workunit.client.0.smithi049.stdout:1/583: creat d5/d6/d8/d13/d24/dbb/fc0 x:0 0 0 2024-09-19T09:03:12.313 INFO:tasks.workunit.client.0.smithi049.stdout:0/891: getdents d5 0 2024-09-19T09:03:12.316 INFO:tasks.workunit.client.0.smithi049.stdout:6/733: creat dc/d1b/d20/d2f/d6b/dd2/fe8 x:0 0 0 2024-09-19T09:03:12.317 INFO:tasks.workunit.client.0.smithi049.stdout:2/935: write d1/d2/d70/f9a [440283,39307] 0 2024-09-19T09:03:12.319 INFO:tasks.workunit.client.0.smithi049.stdout:4/702: write d4/d15/d19/d1f/d55/f78 [1025021,20697] 0 2024-09-19T09:03:12.321 INFO:tasks.workunit.client.0.smithi049.stdout:0/892: creat d5/d10/d13/d30/d9f/f10f x:0 0 0 2024-09-19T09:03:12.322 INFO:tasks.workunit.client.0.smithi049.stdout:1/584: truncate d5/d6/f6f 598553 0 2024-09-19T09:03:12.323 INFO:tasks.workunit.client.0.smithi049.stdout:0/893: chown d5/d10/d13/d30/d75/l79 42623 1 2024-09-19T09:03:12.325 INFO:tasks.workunit.client.0.smithi049.stdout:0/894: dread - d5/d10/d2f/dd4/f106 zero size 2024-09-19T09:03:12.326 INFO:tasks.workunit.client.0.smithi049.stdout:8/904: dread d1/f2d [0,4194304] 0 2024-09-19T09:03:12.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/936: symlink d1/d2/d70/l138 0 2024-09-19T09:03:12.328 INFO:tasks.workunit.client.0.smithi049.stdout:8/905: truncate d1/d11/d4f/d87/d5d/f103 695199 0 2024-09-19T09:03:12.329 INFO:tasks.workunit.client.0.smithi049.stdout:6/734: write dc/d1b/d20/d81/d5a/dae/ddf/de4/f95 [1395860,114552] 0 2024-09-19T09:03:12.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/703: truncate d4/d15/d19/d1f/d55/d66/f9e 1725809 0 2024-09-19T09:03:12.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/906: dread - d1/d11/d2e/d4e/d82/dd8/f113 zero size 2024-09-19T09:03:12.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/895: creat d5/d10/d13/d69/f110 x:0 0 0 2024-09-19T09:03:12.338 INFO:tasks.workunit.client.0.smithi049.stdout:8/907: chown d1/f78 4167645 1 2024-09-19T09:03:12.338 INFO:tasks.workunit.client.0.smithi049.stdout:1/585: mknod d5/d6/d8/d13/d24/d7e/d7f/cc1 0 2024-09-19T09:03:12.342 INFO:tasks.workunit.client.0.smithi049.stdout:8/908: write d1/d11/d4f/d87/d5d/d65/f8a [4586811,51578] 0 2024-09-19T09:03:12.343 INFO:tasks.workunit.client.0.smithi049.stdout:0/896: dwrite d5/d10/d82/d67/d85/d10e/f6a [0,4194304] 0 2024-09-19T09:03:12.344 INFO:tasks.workunit.client.0.smithi049.stdout:3/805: write d10/d11/dd7/ff9 [2341335,103140] 0 2024-09-19T09:03:12.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/937: mknod d1/d2/d23/dca/c139 0 2024-09-19T09:03:12.347 INFO:tasks.workunit.client.0.smithi049.stdout:3/806: write d10/d11/d13/f32 [1796957,86478] 0 2024-09-19T09:03:12.349 INFO:tasks.workunit.client.0.smithi049.stdout:4/704: dread d4/d6c/d74/fac [0,4194304] 0 2024-09-19T09:03:12.350 INFO:tasks.workunit.client.0.smithi049.stdout:4/705: chown d4/d6c/da2/fd6 0 1 2024-09-19T09:03:12.350 INFO:tasks.workunit.client.0.smithi049.stdout:6/735: fsync dc/d1b/d20/d2f/f3f 0 2024-09-19T09:03:12.354 INFO:tasks.workunit.client.0.smithi049.stdout:1/586: symlink d5/d6/d19/d30/lc2 0 2024-09-19T09:03:12.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/909: creat d1/d11/d2e/d4e/d82/dd8/f11f x:0 0 0 2024-09-19T09:03:12.360 INFO:tasks.workunit.client.0.smithi049.stdout:0/897: mknod d5/d64/d97/c111 0 2024-09-19T09:03:12.362 INFO:tasks.workunit.client.0.smithi049.stdout:2/938: write d1/d2/d6c/dd5/de2/ff6 [1602273,70416] 0 2024-09-19T09:03:12.366 INFO:tasks.workunit.client.0.smithi049.stdout:6/736: creat dc/d1b/d6f/fe9 x:0 0 0 2024-09-19T09:03:12.368 INFO:tasks.workunit.client.0.smithi049.stdout:3/807: write d10/d11/d27/d4f/d59/d81/f98 [3065326,27407] 0 2024-09-19T09:03:12.371 INFO:tasks.workunit.client.0.smithi049.stdout:2/939: mknod d1/d4/c13a 0 2024-09-19T09:03:12.374 INFO:tasks.workunit.client.0.smithi049.stdout:4/706: rename d4/d45/d4a/fbe to d4/d6c/fdb 0 2024-09-19T09:03:12.374 INFO:tasks.workunit.client.0.smithi049.stdout:3/808: dread d10/d11/d13/d30/f40 [4194304,4194304] 0 2024-09-19T09:03:12.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/910: dwrite d1/f39 [8388608,4194304] 0 2024-09-19T09:03:12.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/940: rmdir d1/d4 39 2024-09-19T09:03:12.387 INFO:tasks.workunit.client.0.smithi049.stdout:6/737: link dc/d1b/d6f/f96 dc/d1b/d78/ddd/de6/fea 0 2024-09-19T09:03:12.389 INFO:tasks.workunit.client.0.smithi049.stdout:0/898: rename d5/d10/d82/d67/d85/db4/dbb/fbd to d5/d10/d13/d15/d29/d9a/f112 0 2024-09-19T09:03:12.390 INFO:tasks.workunit.client.0.smithi049.stdout:0/899: chown d5/d10/d13/d30/d9f/cba 499124 1 2024-09-19T09:03:12.391 INFO:tasks.workunit.client.0.smithi049.stdout:3/809: rmdir d10/d3d/d76 39 2024-09-19T09:03:12.393 INFO:tasks.workunit.client.0.smithi049.stdout:4/707: dread d4/d45/d4a/f9d [0,4194304] 0 2024-09-19T09:03:12.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/738: dread dc/ff [0,4194304] 0 2024-09-19T09:03:12.397 INFO:tasks.workunit.client.0.smithi049.stdout:8/911: symlink d1/d1a/d8b/d8e/l120 0 2024-09-19T09:03:12.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/941: rename d1/d2/d70/f9a to d1/d2/d23/d49/d75/da5/f13b 0 2024-09-19T09:03:12.402 INFO:tasks.workunit.client.0.smithi049.stdout:0/900: dwrite d5/d10/d2f/dd4/f106 [0,4194304] 0 2024-09-19T09:03:12.402 INFO:tasks.workunit.client.0.smithi049.stdout:3/810: dwrite d10/d11/d27/f78 [0,4194304] 0 2024-09-19T09:03:12.404 INFO:tasks.workunit.client.0.smithi049.stdout:6/739: truncate dc/d1b/d20/d2f/d31/f5d 5157318 0 2024-09-19T09:03:12.407 INFO:tasks.workunit.client.0.smithi049.stdout:1/587: link d5/d6/dc/lac d5/d6/d19/d21/d52/lc3 0 2024-09-19T09:03:12.412 INFO:tasks.workunit.client.0.smithi049.stdout:1/588: read d5/d6/d19/d21/d52/f85 [4067675,58736] 0 2024-09-19T09:03:12.419 INFO:tasks.workunit.client.0.smithi049.stdout:3/811: mknod d10/d11/d13/dbc/c10d 0 2024-09-19T09:03:12.421 INFO:tasks.workunit.client.0.smithi049.stdout:6/740: creat dc/d1b/d20/d2f/d4c/dc4/feb x:0 0 0 2024-09-19T09:03:12.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/708: mknod d4/d45/d3f/dae/cdc 0 2024-09-19T09:03:12.423 INFO:tasks.workunit.client.0.smithi049.stdout:6/741: read dc/f19 [2160357,37910] 0 2024-09-19T09:03:12.424 INFO:tasks.workunit.client.0.smithi049.stdout:1/589: chown d5/d6/d19/d21/d52/lc3 7308965 1 2024-09-19T09:03:12.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/901: symlink d5/d10/d82/d67/d8c/l113 0 2024-09-19T09:03:12.428 INFO:tasks.workunit.client.0.smithi049.stdout:2/942: creat d1/d4/d1e/d21/dae/ded/f13c x:0 0 0 2024-09-19T09:03:12.430 INFO:tasks.workunit.client.0.smithi049.stdout:3/812: mknod d10/d11/d27/d4f/d59/d81/c10e 0 2024-09-19T09:03:12.432 INFO:tasks.workunit.client.0.smithi049.stdout:4/709: unlink d4/d15/d19/l31 0 2024-09-19T09:03:12.433 INFO:tasks.workunit.client.0.smithi049.stdout:6/742: rmdir dc/d1b/d20/d7f 39 2024-09-19T09:03:12.437 INFO:tasks.workunit.client.0.smithi049.stdout:1/590: chown d5/d6/d8/d13/f55 1183039038 1 2024-09-19T09:03:12.437 INFO:tasks.workunit.client.0.smithi049.stdout:0/902: symlink d5/dab/l114 0 2024-09-19T09:03:12.437 INFO:tasks.workunit.client.0.smithi049.stdout:1/591: fdatasync d5/d6/d19/d21/d52/f76 0 2024-09-19T09:03:12.438 INFO:tasks.workunit.client.0.smithi049.stdout:2/943: unlink d1/d2/d23/dca/c139 0 2024-09-19T09:03:12.438 INFO:tasks.workunit.client.0.smithi049.stdout:0/903: fdatasync d5/d10/d82/d67/d85/d10e/d3d/d7f/ff8 0 2024-09-19T09:03:12.439 INFO:tasks.workunit.client.0.smithi049.stdout:8/912: link d1/d11/d2e/d4e/d61/d9f/dc3/ff8 d1/d11/d2e/d4e/f121 0 2024-09-19T09:03:12.439 INFO:tasks.workunit.client.0.smithi049.stdout:0/904: dread d5/d10/d2f/d6d/f83 [0,4194304] 0 2024-09-19T09:03:12.441 INFO:tasks.workunit.client.0.smithi049.stdout:4/710: creat d4/d45/d3f/dae/fdd x:0 0 0 2024-09-19T09:03:12.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/743: unlink dc/d1b/d20/d2f/c52 0 2024-09-19T09:03:12.444 INFO:tasks.workunit.client.0.smithi049.stdout:1/592: write d5/f7a [4939647,70341] 0 2024-09-19T09:03:12.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/905: dwrite d5/d10/d82/d67/d85/d10e/d3d/f7c [0,4194304] 0 2024-09-19T09:03:12.473 INFO:tasks.workunit.client.0.smithi049.stdout:4/711: symlink d4/d34/d3d/lde 0 2024-09-19T09:03:12.474 INFO:tasks.workunit.client.0.smithi049.stdout:0/906: creat d5/d10/d13/d30/d9f/dcf/f115 x:0 0 0 2024-09-19T09:03:12.478 INFO:tasks.workunit.client.0.smithi049.stdout:4/712: stat d4/d45/d4a/f4e 0 2024-09-19T09:03:12.479 INFO:tasks.workunit.client.0.smithi049.stdout:0/907: fdatasync d5/d10/d13/d30/d75/ff1 0 2024-09-19T09:03:12.480 INFO:tasks.workunit.client.0.smithi049.stdout:8/913: write d1/d11/d2e/f56 [9379300,114214] 0 2024-09-19T09:03:12.487 INFO:tasks.workunit.client.0.smithi049.stdout:1/593: dwrite d5/f54 [0,4194304] 0 2024-09-19T09:03:12.491 INFO:tasks.workunit.client.0.smithi049.stdout:6/744: link dc/d16/c25 dc/d1b/d20/d2f/d31/cec 0 2024-09-19T09:03:12.492 INFO:tasks.workunit.client.0.smithi049.stdout:6/745: chown dc/d1b/d20/d81/dd1 44584 1 2024-09-19T09:03:12.497 INFO:tasks.workunit.client.0.smithi049.stdout:1/594: readlink d5/d6/d73/lb2 0 2024-09-19T09:03:12.503 INFO:tasks.workunit.client.0.smithi049.stdout:4/713: dwrite d4/d15/f83 [0,4194304] 0 2024-09-19T09:03:12.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/714: chown d4/f1e 0 1 2024-09-19T09:03:12.505 INFO:tasks.workunit.client.0.smithi049.stdout:4/715: chown d4/d34/da0 1 1 2024-09-19T09:03:12.506 INFO:tasks.workunit.client.0.smithi049.stdout:8/914: rmdir d1/d11/d2e/d4e/d61/d9f/d10e 0 2024-09-19T09:03:12.511 INFO:tasks.workunit.client.0.smithi049.stdout:0/908: dwrite d5/d10/f5b [0,4194304] 0 2024-09-19T09:03:12.513 INFO:tasks.workunit.client.0.smithi049.stdout:8/915: rmdir d1/d11/d2e/d4e 39 2024-09-19T09:03:12.515 INFO:tasks.workunit.client.0.smithi049.stdout:6/746: dread dc/d1b/d20/d81/f15 [0,4194304] 0 2024-09-19T09:03:12.517 INFO:tasks.workunit.client.0.smithi049.stdout:0/909: chown d5/d10/d82/cb7 422558 1 2024-09-19T09:03:12.519 INFO:tasks.workunit.client.0.smithi049.stdout:6/747: mkdir dc/d16/ded 0 2024-09-19T09:03:12.520 INFO:tasks.workunit.client.0.smithi049.stdout:8/916: creat d1/d1a/dc2/d10a/f122 x:0 0 0 2024-09-19T09:03:12.521 INFO:tasks.workunit.client.0.smithi049.stdout:6/748: chown dc/d1b/d6f/fe9 20 1 2024-09-19T09:03:12.522 INFO:tasks.workunit.client.0.smithi049.stdout:0/910: fsync d5/d10/d82/d67/d85/fc5 0 2024-09-19T09:03:12.522 INFO:tasks.workunit.client.0.smithi049.stdout:8/917: chown d1/d11/d4f/d87/d5d/cea 15 1 2024-09-19T09:03:12.523 INFO:tasks.workunit.client.0.smithi049.stdout:8/918: stat d1/f39 0 2024-09-19T09:03:12.524 INFO:tasks.workunit.client.0.smithi049.stdout:1/595: dread d5/d6/d8/fb7 [0,4194304] 0 2024-09-19T09:03:12.526 INFO:tasks.workunit.client.0.smithi049.stdout:8/919: write d1/d11/d4f/d87/d7a/de9/d8c/fae [290345,54222] 0 2024-09-19T09:03:12.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/911: rmdir d5/d10/d13/d15/d29/d9a 39 2024-09-19T09:03:12.530 INFO:tasks.workunit.client.0.smithi049.stdout:1/596: rmdir d5/d6/dc 39 2024-09-19T09:03:12.531 INFO:tasks.workunit.client.0.smithi049.stdout:4/716: truncate d4/d34/d3d/d4f/d70/fc8 64888 0 2024-09-19T09:03:12.531 INFO:tasks.workunit.client.0.smithi049.stdout:1/597: chown d5/d6/d19/d21/d52/f85 383016 1 2024-09-19T09:03:12.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/717: dwrite d4/d34/d3d/d62/f64 [0,4194304] 0 2024-09-19T09:03:12.542 INFO:tasks.workunit.client.0.smithi049.stdout:1/598: symlink d5/d6/db4/lc4 0 2024-09-19T09:03:12.546 INFO:tasks.workunit.client.0.smithi049.stdout:4/718: fsync d4/d45/d4a/f9d 0 2024-09-19T09:03:12.548 INFO:tasks.workunit.client.0.smithi049.stdout:8/920: dwrite d1/f23 [0,4194304] 0 2024-09-19T09:03:12.549 INFO:tasks.workunit.client.0.smithi049.stdout:1/599: mknod d5/d6/d8/d13/d24/dbb/cc5 0 2024-09-19T09:03:12.550 INFO:tasks.workunit.client.0.smithi049.stdout:8/921: chown d1/d11/d4f/d87/f6a 759 1 2024-09-19T09:03:12.552 INFO:tasks.workunit.client.0.smithi049.stdout:4/719: mknod d4/d45/d4a/dc3/db6/cdf 0 2024-09-19T09:03:12.553 INFO:tasks.workunit.client.0.smithi049.stdout:1/600: fsync d5/d6/d19/d30/f65 0 2024-09-19T09:03:12.554 INFO:tasks.workunit.client.0.smithi049.stdout:1/601: chown d5/d6/d19/f4e 1018901251 1 2024-09-19T09:03:12.557 INFO:tasks.workunit.client.0.smithi049.stdout:8/922: write d1/d11/d2e/d4e/d61/d9f/fec [835680,23551] 0 2024-09-19T09:03:12.559 INFO:tasks.workunit.client.0.smithi049.stdout:8/923: stat d1/d11/d4f/d87/d7a/de9 0 2024-09-19T09:03:12.560 INFO:tasks.workunit.client.0.smithi049.stdout:1/602: creat d5/fc6 x:0 0 0 2024-09-19T09:03:12.564 INFO:tasks.workunit.client.0.smithi049.stdout:1/603: truncate d5/d6/d8/d13/f34 713205 0 2024-09-19T09:03:12.566 INFO:tasks.workunit.client.0.smithi049.stdout:8/924: dread d1/d11/d4f/d87/f7f [0,4194304] 0 2024-09-19T09:03:12.570 INFO:tasks.workunit.client.0.smithi049.stdout:4/720: dwrite d4/d15/d19/d1f/d55/d7f/fad [0,4194304] 0 2024-09-19T09:03:12.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/604: mkdir d5/d6/d8/d13/d24/d9f/dc7 0 2024-09-19T09:03:12.574 INFO:tasks.workunit.client.0.smithi049.stdout:8/925: rename d1/d27/f68 to d1/d11/d4f/d87/d5d/d11d/f123 0 2024-09-19T09:03:12.582 INFO:tasks.workunit.client.0.smithi049.stdout:8/926: creat d1/d11/d4f/d87/d5d/f124 x:0 0 0 2024-09-19T09:03:12.589 INFO:tasks.workunit.client.0.smithi049.stdout:1/605: dread d5/d6/d19/d30/f65 [0,4194304] 0 2024-09-19T09:03:12.591 INFO:tasks.workunit.client.0.smithi049.stdout:8/927: write d1/d27/f110 [730948,65326] 0 2024-09-19T09:03:12.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/721: dwrite d4/d15/d19/d1f/d55/f97 [0,4194304] 0 2024-09-19T09:03:12.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/928: symlink d1/d1a/l125 0 2024-09-19T09:03:12.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/722: creat d4/d6c/d7a/dc1/fe0 x:0 0 0 2024-09-19T09:03:12.608 INFO:tasks.workunit.client.0.smithi049.stdout:8/929: mkdir d1/d11/d2e/d4e/d126 0 2024-09-19T09:03:12.612 INFO:tasks.workunit.client.0.smithi049.stdout:8/930: unlink d1/d11/d2e/d4e/c11a 0 2024-09-19T09:03:12.618 INFO:tasks.workunit.client.0.smithi049.stdout:8/931: dwrite d1/d27/f110 [0,4194304] 0 2024-09-19T09:03:12.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/723: dwrite d4/d15/d19/d1f/d55/d66/f9e [0,4194304] 0 2024-09-19T09:03:12.629 INFO:tasks.workunit.client.0.smithi049.stdout:8/932: unlink d1/d11/d4f/d87/c6e 0 2024-09-19T09:03:12.629 INFO:tasks.workunit.client.0.smithi049.stdout:4/724: rmdir d4/d34 39 2024-09-19T09:03:12.651 INFO:tasks.workunit.client.0.smithi049.stdout:4/725: dread d4/d34/d3d/d62/fcc [0,4194304] 0 2024-09-19T09:03:12.658 INFO:tasks.workunit.client.0.smithi049.stdout:4/726: rename d4/d15/d19/d1f/f71 to d4/d15/d19/d1f/daa/fe1 0 2024-09-19T09:03:12.659 INFO:tasks.workunit.client.0.smithi049.stdout:4/727: chown d4/f1e 55819 1 2024-09-19T09:03:12.663 INFO:tasks.workunit.client.0.smithi049.stdout:4/728: creat d4/d6c/d7a/dc1/fe2 x:0 0 0 2024-09-19T09:03:12.667 INFO:tasks.workunit.client.0.smithi049.stdout:4/729: symlink d4/d45/d4a/le3 0 2024-09-19T09:03:12.672 INFO:tasks.workunit.client.0.smithi049.stdout:8/933: write d1/d11/d4f/d87/f83 [3861397,6148] 0 2024-09-19T09:03:12.679 INFO:tasks.workunit.client.0.smithi049.stdout:8/934: symlink d1/d11/d4f/d87/d7a/de9/l127 0 2024-09-19T09:03:12.681 INFO:tasks.workunit.client.0.smithi049.stdout:8/935: creat d1/d11/d4f/d87/d7a/f128 x:0 0 0 2024-09-19T09:03:12.690 INFO:tasks.workunit.client.0.smithi049.stdout:8/936: rename d1/l3e to d1/d11/d2e/dd3/l129 0 2024-09-19T09:03:12.697 INFO:tasks.workunit.client.0.smithi049.stdout:8/937: dwrite d1/d11/d4f/d87/f83 [0,4194304] 0 2024-09-19T09:03:12.698 INFO:tasks.workunit.client.0.smithi049.stdout:4/730: truncate d4/d45/d3f/d47/fa5 504722 0 2024-09-19T09:03:12.699 INFO:tasks.workunit.client.0.smithi049.stdout:4/731: dread - d4/d6c/d7a/dc1/fe2 zero size 2024-09-19T09:03:12.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/732: symlink d4/d34/le4 0 2024-09-19T09:03:12.709 INFO:tasks.workunit.client.0.smithi049.stdout:4/733: dwrite d4/d34/d3d/d62/f64 [0,4194304] 0 2024-09-19T09:03:12.716 INFO:tasks.workunit.client.0.smithi049.stdout:4/734: link d4/d6c/da2/f9b d4/d34/da0/fe5 0 2024-09-19T09:03:12.720 INFO:tasks.workunit.client.0.smithi049.stdout:8/938: dread d1/f39 [4194304,4194304] 0 2024-09-19T09:03:12.720 INFO:tasks.workunit.client.0.smithi049.stdout:4/735: symlink d4/d6c/d7a/le6 0 2024-09-19T09:03:12.721 INFO:tasks.workunit.client.0.smithi049.stdout:4/736: chown d4/d45/f6b 4 1 2024-09-19T09:03:12.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/939: write d1/d11/d4f/d87/d7a/de9/d8c/fe7 [861634,16382] 0 2024-09-19T09:03:12.724 INFO:tasks.workunit.client.0.smithi049.stdout:8/940: symlink d1/d27/l12a 0 2024-09-19T09:03:12.726 INFO:tasks.workunit.client.0.smithi049.stdout:4/737: mknod d4/d15/d19/d1f/daa/dbd/dc6/ce7 0 2024-09-19T09:03:12.726 INFO:tasks.workunit.client.0.smithi049.stdout:8/941: symlink d1/d11/d45/l12b 0 2024-09-19T09:03:12.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/738: rmdir d4/d15/d19/d1f/d55/d7f 39 2024-09-19T09:03:12.731 INFO:tasks.workunit.client.0.smithi049.stdout:8/942: fdatasync d1/d11/d4f/d87/d7a/de9/d5b/fba 0 2024-09-19T09:03:12.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/739: creat d4/d6c/d7a/fe8 x:0 0 0 2024-09-19T09:03:12.740 INFO:tasks.workunit.client.0.smithi049.stdout:8/943: mkdir d1/d11/d2e/d4e/d82/d104/d12c 0 2024-09-19T09:03:12.741 INFO:tasks.workunit.client.0.smithi049.stdout:8/944: chown d1/d11/d2e/d4e/d61/fc1 184 1 2024-09-19T09:03:12.743 INFO:tasks.workunit.client.0.smithi049.stdout:8/945: stat d1/d11/d2e/db5/cd1 0 2024-09-19T09:03:12.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/946: rmdir d1/d11/d2e/d4e/d82/dd8 39 2024-09-19T09:03:12.751 INFO:tasks.workunit.client.0.smithi049.stdout:4/740: write d4/d34/f46 [583815,35862] 0 2024-09-19T09:03:12.751 INFO:tasks.workunit.client.0.smithi049.stdout:8/947: mkdir d1/d1a/db0/d10f/d12d 0 2024-09-19T09:03:12.759 INFO:tasks.workunit.client.0.smithi049.stdout:4/741: dwrite d4/d6c/fdb [0,4194304] 0 2024-09-19T09:03:12.761 INFO:tasks.workunit.client.0.smithi049.stdout:4/742: stat d4/d15/d19 0 2024-09-19T09:03:12.762 INFO:tasks.workunit.client.0.smithi049.stdout:8/948: link d1/d27/f53 d1/d11/d2e/d4e/d82/dd8/f12e 0 2024-09-19T09:03:12.762 INFO:tasks.workunit.client.0.smithi049.stdout:8/949: readlink d1/d1a/d8b/d8e/l98 0 2024-09-19T09:03:12.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/743: read - d4/d15/d19/d1f/daa/dbd/fbb zero size 2024-09-19T09:03:12.768 INFO:tasks.workunit.client.0.smithi049.stdout:4/744: mknod d4/d45/d4a/dc3/db6/db8/ce9 0 2024-09-19T09:03:12.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/745: chown d4/d34/d3d/d62/f64 334 1 2024-09-19T09:03:12.770 INFO:tasks.workunit.client.0.smithi049.stdout:4/746: write d4/f69 [3239908,122853] 0 2024-09-19T09:03:12.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/747: dwrite d4/d45/d3f/d47/fa6 [0,4194304] 0 2024-09-19T09:03:12.778 INFO:tasks.workunit.client.0.smithi049.stdout:8/950: truncate d1/d11/d2e/f57 756920 0 2024-09-19T09:03:12.782 INFO:tasks.workunit.client.0.smithi049.stdout:8/951: truncate d1/d11/d2e/d4e/d61/d9f/fec 1534392 0 2024-09-19T09:03:12.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/748: mknod d4/d34/d3d/d4f/d70/cea 0 2024-09-19T09:03:12.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/952: mknod d1/d1a/d8b/d8e/c12f 0 2024-09-19T09:03:12.794 INFO:tasks.workunit.client.0.smithi049.stdout:8/953: dwrite d1/d11/d2e/d4e/d61/d9f/fc4 [0,4194304] 0 2024-09-19T09:03:12.801 INFO:tasks.workunit.client.0.smithi049.stdout:4/749: dread f2 [0,4194304] 0 2024-09-19T09:03:12.811 INFO:tasks.workunit.client.0.smithi049.stdout:8/954: dwrite d1/d11/d4f/d87/d7a/de9/f9c [0,4194304] 0 2024-09-19T09:03:12.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/955: dwrite d1/d1a/db0/dd5/f10c [0,4194304] 0 2024-09-19T09:03:12.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/956: write d1/d11/d4f/d87/d7a/de9/f6b [889360,27186] 0 2024-09-19T09:03:12.833 INFO:tasks.workunit.client.0.smithi049.stdout:8/957: creat d1/d1a/dc2/d10a/f130 x:0 0 0 2024-09-19T09:03:12.833 INFO:tasks.workunit.client.0.smithi049.stdout:8/958: write d1/f107 [967313,1164] 0 2024-09-19T09:03:12.835 INFO:tasks.workunit.client.0.smithi049.stdout:8/959: write d1/f14 [774900,73697] 0 2024-09-19T09:03:12.838 INFO:tasks.workunit.client.0.smithi049.stdout:8/960: creat d1/d11/d4f/d87/d7a/de9/d8c/f131 x:0 0 0 2024-09-19T09:03:12.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/961: write d1/f39 [6698061,68814] 0 2024-09-19T09:03:12.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/700: sync 2024-09-19T09:03:12.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/701: chown d3/dc/l50 59197 1 2024-09-19T09:03:12.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/702: chown d3/l67 6570 1 2024-09-19T09:03:12.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/703: fdatasync d3/d5/d1c/fd5 0 2024-09-19T09:03:12.960 INFO:tasks.workunit.client.0.smithi049.stdout:5/704: creat d3/d5/de/d4a/dbd/fdc x:0 0 0 2024-09-19T09:03:12.973 INFO:tasks.workunit.client.0.smithi049.stdout:5/705: dwrite d3/d5/de/f15 [0,4194304] 0 2024-09-19T09:03:12.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/706: creat d3/d6c/fdd x:0 0 0 2024-09-19T09:03:12.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/707: dread d3/f6 [0,4194304] 0 2024-09-19T09:03:12.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/708: getdents d3/d5/d20/d38 0 2024-09-19T09:03:12.993 INFO:tasks.workunit.client.0.smithi049.stdout:5/709: write d3/d5/d20/d57/d72/fdb [792345,115327] 0 2024-09-19T09:03:12.998 INFO:tasks.workunit.client.0.smithi049.stdout:5/710: getdents d3/dc 0 2024-09-19T09:03:13.002 INFO:tasks.workunit.client.0.smithi049.stdout:5/711: write d3/d5/d20/f59 [1969841,59326] 0 2024-09-19T09:03:13.005 INFO:tasks.workunit.client.0.smithi049.stdout:5/712: unlink d3/d5/de/d12/d97/fd0 0 2024-09-19T09:03:13.008 INFO:tasks.workunit.client.0.smithi049.stdout:5/713: mknod d3/d5/d20/d38/d5d/cde 0 2024-09-19T09:03:13.009 INFO:tasks.workunit.client.0.smithi049.stdout:5/714: stat d3/d5/de/f15 0 2024-09-19T09:03:13.009 INFO:tasks.workunit.client.0.smithi049.stdout:5/715: stat d3/d6c/d6d/f92 0 2024-09-19T09:03:13.011 INFO:tasks.workunit.client.0.smithi049.stdout:5/716: creat d3/d6c/d6d/fdf x:0 0 0 2024-09-19T09:03:13.014 INFO:tasks.workunit.client.0.smithi049.stdout:5/717: dread d3/d5/d1c/fd5 [0,4194304] 0 2024-09-19T09:03:13.016 INFO:tasks.workunit.client.0.smithi049.stdout:5/718: mknod d3/d5/d20/d57/d72/ce0 0 2024-09-19T09:03:13.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/719: mknod d3/d5/d20/d38/d5a/d8b/ce1 0 2024-09-19T09:03:13.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/720: creat d3/d5/d1c/d4c/d7c/fe2 x:0 0 0 2024-09-19T09:03:13.026 INFO:tasks.workunit.client.0.smithi049.stdout:5/721: dwrite d3/dc/faf [0,4194304] 0 2024-09-19T09:03:13.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/722: creat d3/d5/fe3 x:0 0 0 2024-09-19T09:03:13.034 INFO:tasks.workunit.client.0.smithi049.stdout:5/723: read d3/dc/f9a [1717197,23369] 0 2024-09-19T09:03:13.037 INFO:tasks.workunit.client.0.smithi049.stdout:5/724: mkdir d3/d6c/d6d/de4 0 2024-09-19T09:03:13.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/725: rename d3/d5/d1c/d4c/c7f to d3/d6c/d6d/ce5 0 2024-09-19T09:03:13.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/726: mkdir d3/dc/dc4/de6 0 2024-09-19T09:03:13.046 INFO:tasks.workunit.client.0.smithi049.stdout:5/727: creat d3/d5/d1c/dd2/dbf/fe7 x:0 0 0 2024-09-19T09:03:13.048 INFO:tasks.workunit.client.0.smithi049.stdout:5/728: dread - d3/d5/d20/d57/f95 zero size 2024-09-19T09:03:13.055 INFO:tasks.workunit.client.0.smithi049.stdout:5/729: write d3/d6c/f47 [2104063,118676] 0 2024-09-19T09:03:13.056 INFO:tasks.workunit.client.0.smithi049.stdout:5/730: readlink d3/d5/de/d12/d45/lb5 0 2024-09-19T09:03:13.056 INFO:tasks.workunit.client.0.smithi049.stdout:5/731: stat d3/d5/d1c/d4c/c65 0 2024-09-19T09:03:13.071 INFO:tasks.workunit.client.0.smithi049.stdout:5/732: dwrite d3/d5/d1c/d2d/f2f [0,4194304] 0 2024-09-19T09:03:13.077 INFO:tasks.workunit.client.0.smithi049.stdout:5/733: rmdir d3/d5/d20/d38/d5a/db6 0 2024-09-19T09:03:13.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/734: mknod d3/d5/d1c/dd2/dbf/dcd/ce8 0 2024-09-19T09:03:13.086 INFO:tasks.workunit.client.0.smithi049.stdout:5/735: dwrite d3/d5/de/f1e [0,4194304] 0 2024-09-19T09:03:13.087 INFO:tasks.workunit.client.0.smithi049.stdout:5/736: chown d3/d5/de/l39 89172121 1 2024-09-19T09:03:13.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/737: write d3/d5/de/f1e [3443092,33427] 0 2024-09-19T09:03:13.089 INFO:tasks.workunit.client.0.smithi049.stdout:5/738: chown d3/dc/fca 51 1 2024-09-19T09:03:13.093 INFO:tasks.workunit.client.0.smithi049.stdout:5/739: symlink d3/d5/d1c/dd2/dbf/dcd/le9 0 2024-09-19T09:03:13.095 INFO:tasks.workunit.client.0.smithi049.stdout:5/740: rmdir d3/d5/d20/d38/d5a 39 2024-09-19T09:03:13.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/741: chown d3/d5/d20/l29 64186 1 2024-09-19T09:03:13.102 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:03:13.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-19T09:03:13.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/742: truncate d3/d5/d1c/d2d/fc3 2174663 0 2024-09-19T09:03:13.122 INFO:tasks.workunit.client.0.smithi049.stdout:5/743: dread d3/d5/d20/d38/f46 [0,4194304] 0 2024-09-19T09:03:13.125 INFO:tasks.workunit.client.0.smithi049.stdout:5/744: getdents d3/dc/dc4 0 2024-09-19T09:03:13.125 INFO:tasks.workunit.client.0.smithi049.stdout:5/745: dread - d3/d5/d1c/d4c/d63/fc9 zero size 2024-09-19T09:03:13.126 INFO:tasks.workunit.client.0.smithi049.stdout:5/746: read - d3/d5/d1c/d4c/d63/fc9 zero size 2024-09-19T09:03:13.127 INFO:tasks.workunit.client.0.smithi049.stdout:5/747: chown d3/d5/d20/d38/d5a 0 1 2024-09-19T09:03:13.131 INFO:tasks.workunit.client.0.smithi049.stdout:5/748: truncate d3/d5/d20/d38/f46 3050534 0 2024-09-19T09:03:13.133 INFO:tasks.workunit.client.0.smithi049.stdout:5/749: creat d3/dc/dc4/fea x:0 0 0 2024-09-19T09:03:13.134 INFO:tasks.workunit.client.0.smithi049.stdout:5/750: chown d3/d5/d1c 61484243 1 2024-09-19T09:03:13.135 INFO:tasks.workunit.client.0.smithi049.stdout:5/751: write d3/d6c/f85 [865539,7546] 0 2024-09-19T09:03:13.138 INFO:tasks.workunit.client.0.smithi049.stdout:5/752: dread - d3/d6c/f9d zero size 2024-09-19T09:03:13.139 INFO:tasks.workunit.client.0.smithi049.stdout:5/753: truncate d3/d6c/d6d/fdf 413114 0 2024-09-19T09:03:13.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/813: sync 2024-09-19T09:03:13.159 INFO:tasks.workunit.client.0.smithi049.stdout:3/814: creat d10/d11/def/f10f x:0 0 0 2024-09-19T09:03:13.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/815: mkdir d10/d3d/d76/dac/dad/daf/d110 0 2024-09-19T09:03:13.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/816: write d10/d3d/d51/fd6 [3249863,83148] 0 2024-09-19T09:03:13.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/817: dread - d10/d3d/d79/fb3 zero size 2024-09-19T09:03:13.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/818: dwrite d10/d3d/d95/fcc [0,4194304] 0 2024-09-19T09:03:13.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/819: truncate d10/d11/d27/d4f/f7d 1002279 0 2024-09-19T09:03:13.178 INFO:tasks.workunit.client.0.smithi049.stdout:3/820: dread - d10/d3d/d79/ffa zero size 2024-09-19T09:03:13.180 INFO:tasks.workunit.client.0.smithi049.stdout:3/821: creat d10/d11/d13/dbc/f111 x:0 0 0 2024-09-19T09:03:13.182 INFO:tasks.workunit.client.0.smithi049.stdout:3/822: rmdir d10/d11/def 39 2024-09-19T09:03:13.194 INFO:tasks.workunit.client.0.smithi049.stdout:3/823: dread d10/d3d/d51/fd6 [0,4194304] 0 2024-09-19T09:03:13.197 INFO:tasks.workunit.client.0.smithi049.stdout:3/824: dread d10/d11/f1a [0,4194304] 0 2024-09-19T09:03:13.198 INFO:tasks.workunit.client.0.smithi049.stdout:3/825: symlink d10/d3d/d76/dac/dad/l112 0 2024-09-19T09:03:13.202 INFO:tasks.workunit.client.0.smithi049.stdout:3/826: creat d10/d3d/d76/dac/dad/de1/d10b/f113 x:0 0 0 2024-09-19T09:03:13.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/827: dwrite d10/d3d/d79/ffa [0,4194304] 0 2024-09-19T09:03:13.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/828: fsync d10/d11/ffc 0 2024-09-19T09:03:13.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/829: symlink d10/d3d/d46/l114 0 2024-09-19T09:03:13.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/830: symlink d10/d3d/d79/dc1/l115 0 2024-09-19T09:03:13.218 INFO:tasks.workunit.client.0.smithi049.stdout:3/831: unlink d10/d11/d13/d30/f3b 0 2024-09-19T09:03:13.229 INFO:tasks.workunit.client.0.smithi049.stdout:3/832: dread d10/f70 [4194304,4194304] 0 2024-09-19T09:03:13.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/833: write d10/d3d/d76/fb0 [486075,99501] 0 2024-09-19T09:03:13.301 INFO:tasks.workunit.client.0.smithi049.stdout:2/944: sync 2024-09-19T09:03:13.307 INFO:tasks.workunit.client.0.smithi049.stdout:2/945: dwrite d1/d4/d20/f81 [4194304,4194304] 0 2024-09-19T09:03:13.310 INFO:tasks.workunit.client.0.smithi049.stdout:2/946: dread d1/d2/d6c/dd5/fec [0,4194304] 0 2024-09-19T09:03:13.314 INFO:tasks.workunit.client.0.smithi049.stdout:2/947: rename d1/d4/d1e/d21/dae/ded to d1/d4/d20/d92/dba/d121/d13d 0 2024-09-19T09:03:13.320 INFO:tasks.workunit.client.0.smithi049.stdout:2/948: dwrite d1/d4/f17 [0,4194304] 0 2024-09-19T09:03:13.322 INFO:tasks.workunit.client.0.smithi049.stdout:2/949: creat d1/d2d/f13e x:0 0 0 2024-09-19T09:03:13.326 INFO:tasks.workunit.client.0.smithi049.stdout:2/950: creat d1/d4/d1e/d9f/db3/d41/f13f x:0 0 0 2024-09-19T09:03:13.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/951: fdatasync d1/d2/d23/f56 0 2024-09-19T09:03:13.347 INFO:tasks.workunit.client.0.smithi049.stdout:2/952: dread d1/d4/d20/d92/fd2 [0,4194304] 0 2024-09-19T09:03:13.351 INFO:tasks.workunit.client.0.smithi049.stdout:2/953: rename d1/d4/d1e/d9f/db7 to d1/d4/d1e/d21/d8c/d140 0 2024-09-19T09:03:13.352 INFO:tasks.workunit.client.0.smithi049.stdout:2/954: fdatasync d1/d4/d20/dc7/feb 0 2024-09-19T09:03:13.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/955: truncate d1/d2/f24 1251342 0 2024-09-19T09:03:13.363 INFO:tasks.workunit.client.0.smithi049.stdout:2/956: write d1/d2/f54 [43876,6064] 0 2024-09-19T09:03:13.373 INFO:tasks.workunit.client.0.smithi049.stdout:2/957: dread d1/f7 [0,4194304] 0 2024-09-19T09:03:13.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/958: dread d1/d4/d1e/d21/f22 [0,4194304] 0 2024-09-19T09:03:13.389 INFO:tasks.workunit.client.0.smithi049.stdout:2/959: write d1/fc5 [1022774,54268] 0 2024-09-19T09:03:13.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/960: mkdir d1/d4/d1e/d21/d8c/d141 0 2024-09-19T09:03:13.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/961: unlink d1/d2/d70/l138 0 2024-09-19T09:03:13.403 INFO:tasks.workunit.client.0.smithi049.stdout:2/962: dread d1/d4/d20/f81 [0,4194304] 0 2024-09-19T09:03:13.404 INFO:tasks.workunit.client.0.smithi049.stdout:2/963: symlink d1/d4/d20/dc7/l142 0 2024-09-19T09:03:13.407 INFO:tasks.workunit.client.0.smithi049.stdout:2/964: getdents d1/d4/d20/dc8 0 2024-09-19T09:03:13.409 INFO:tasks.workunit.client.0.smithi049.stdout:2/965: mknod d1/d2/d23/d10c/c143 0 2024-09-19T09:03:13.410 INFO:tasks.workunit.client.0.smithi049.stdout:2/966: chown d1/d2/d70/de4 7329552 1 2024-09-19T09:03:13.414 INFO:tasks.workunit.client.0.smithi049.stdout:2/967: write d1/d4/d1e/d9f/db3/d41/d7d/f102 [1047547,38011] 0 2024-09-19T09:03:13.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/968: mknod d1/d4/d20/d92/c144 0 2024-09-19T09:03:13.419 INFO:tasks.workunit.client.0.smithi049.stdout:2/969: unlink d1/d4/d1e/d9f/db3/d41/fa7 0 2024-09-19T09:03:13.429 INFO:tasks.workunit.client.0.smithi049.stdout:2/970: dwrite d1/d4/d20/fea [0,4194304] 0 2024-09-19T09:03:13.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/971: dread d1/d4/d1e/d9f/db3/d41/f101 [0,4194304] 0 2024-09-19T09:03:13.455 INFO:tasks.workunit.client.0.smithi049.stdout:2/972: dwrite d1/d4/d20/f58 [4194304,4194304] 0 2024-09-19T09:03:13.456 INFO:tasks.workunit.client.0.smithi049.stdout:2/973: read - d1/d2/d70/f124 zero size 2024-09-19T09:03:13.460 INFO:tasks.workunit.client.0.smithi049.stdout:2/974: symlink d1/d2/d23/d49/d75/d114/l145 0 2024-09-19T09:03:13.463 INFO:tasks.workunit.client.0.smithi049.stdout:2/975: chown d1/d4/d20/c11b 903 1 2024-09-19T09:03:13.467 INFO:tasks.workunit.client.0.smithi049.stdout:2/976: creat d1/d4/d20/d92/dba/d121/f146 x:0 0 0 2024-09-19T09:03:13.469 INFO:tasks.workunit.client.0.smithi049.stdout:2/977: creat d1/d2/d23/d10c/f147 x:0 0 0 2024-09-19T09:03:13.472 INFO:tasks.workunit.client.0.smithi049.stdout:2/978: truncate d1/d4/f2a 1377695 0 2024-09-19T09:03:13.474 INFO:tasks.workunit.client.0.smithi049.stdout:2/979: creat d1/d2/d70/f148 x:0 0 0 2024-09-19T09:03:13.474 INFO:tasks.workunit.client.0.smithi049.stdout:2/980: chown d1/d2/d23/fce 0 1 2024-09-19T09:03:13.477 INFO:tasks.workunit.client.0.smithi049.stdout:2/981: symlink d1/d2/d32/l149 0 2024-09-19T09:03:13.477 INFO:tasks.workunit.client.0.smithi049.stdout:2/982: chown d1/d2b/c112 59 1 2024-09-19T09:03:13.492 INFO:tasks.workunit.client.0.smithi049.stdout:2/983: dread d1/d4/f39 [0,4194304] 0 2024-09-19T09:03:13.498 INFO:tasks.workunit.client.0.smithi049.stdout:2/984: dwrite d1/d2/d6c/dd5/de2/ff6 [0,4194304] 0 2024-09-19T09:03:13.502 INFO:tasks.workunit.client.0.smithi049.stdout:2/985: mkdir d1/d4/d1e/d21/d8c/d141/d14a 0 2024-09-19T09:03:13.504 INFO:tasks.workunit.client.0.smithi049.stdout:2/986: creat d1/d4/f14b x:0 0 0 2024-09-19T09:03:13.506 INFO:tasks.workunit.client.0.smithi049.stdout:2/987: rmdir d1/d4/d1e/d21 39 2024-09-19T09:03:13.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:13 smithi102 ceph-mon[35280]: pgmap v43: 65 pgs: 65 active+clean; 2.3 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 45 MiB/s rd, 106 MiB/s wr, 300 op/s 2024-09-19T09:03:13.511 INFO:tasks.workunit.client.0.smithi049.stdout:2/988: creat d1/d4/d1e/d9f/db3/d41/d11a/f14c x:0 0 0 2024-09-19T09:03:13.511 INFO:tasks.workunit.client.0.smithi049.stdout:2/989: dread - d1/d2/d70/f148 zero size 2024-09-19T09:03:13.515 INFO:tasks.workunit.client.0.smithi049.stdout:2/990: rename d1/d2/d23/d49/d75/d114/f120 to d1/d4/d20/d92/f14d 0 2024-09-19T09:03:13.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/991: dwrite d1/d2d/f13e [0,4194304] 0 2024-09-19T09:03:13.525 INFO:tasks.workunit.client.0.smithi049.stdout:0/912: sync 2024-09-19T09:03:13.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/749: sync 2024-09-19T09:03:13.526 INFO:tasks.workunit.client.0.smithi049.stdout:2/992: link d1/d2/d23/f68 d1/d4/f14e 0 2024-09-19T09:03:13.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/993: rmdir d1 39 2024-09-19T09:03:13.535 INFO:tasks.workunit.client.0.smithi049.stdout:2/994: creat d1/d2/d23/d115/f14f x:0 0 0 2024-09-19T09:03:13.537 INFO:tasks.workunit.client.0.smithi049.stdout:2/995: truncate d1/d2/d23/d49/d75/d114/f77 414607 0 2024-09-19T09:03:13.538 INFO:tasks.workunit.client.0.smithi049.stdout:0/913: dread d5/d10/d2f/d6d/fc6 [0,4194304] 0 2024-09-19T09:03:13.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/750: dwrite dc/d1b/d20/d81/d5a/f9a [0,4194304] 0 2024-09-19T09:03:13.550 INFO:tasks.workunit.client.0.smithi049.stdout:2/996: truncate d1/d2b/f1a 1680898 0 2024-09-19T09:03:13.551 INFO:tasks.workunit.client.0.smithi049.stdout:6/751: creat dc/d1b/d20/d2f/d31/fee x:0 0 0 2024-09-19T09:03:13.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:13 smithi049 ceph-mon[28158]: pgmap v43: 65 pgs: 65 active+clean; 2.3 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 45 MiB/s rd, 106 MiB/s wr, 300 op/s 2024-09-19T09:03:13.555 INFO:tasks.workunit.client.0.smithi049.stdout:6/752: rmdir dc/d1b/d20/d2f/d6b 39 2024-09-19T09:03:13.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/914: getdents d5/d10/d82 0 2024-09-19T09:03:13.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/915: dread d5/d10/d82/f46 [0,4194304] 0 2024-09-19T09:03:13.558 INFO:tasks.workunit.client.0.smithi049.stdout:2/997: rename d1/d4/d1e/d21/dae/cc9 to d1/d2/d6c/c150 0 2024-09-19T09:03:13.561 INFO:tasks.workunit.client.0.smithi049.stdout:6/753: creat dc/d1b/d20/d81/d5a/fef x:0 0 0 2024-09-19T09:03:13.565 INFO:tasks.workunit.client.0.smithi049.stdout:6/754: truncate dc/d16/f18 1018171 0 2024-09-19T09:03:13.570 INFO:tasks.workunit.client.0.smithi049.stdout:0/916: write d5/d10/d82/d67/d85/d10e/fc2 [684330,52914] 0 2024-09-19T09:03:13.578 INFO:tasks.workunit.client.0.smithi049.stdout:0/917: dwrite d5/d10/d82/d67/d85/d10e/f6a [4194304,4194304] 0 2024-09-19T09:03:13.580 INFO:tasks.workunit.client.0.smithi049.stdout:6/755: dread dc/d1b/f67 [0,4194304] 0 2024-09-19T09:03:13.582 INFO:tasks.workunit.client.0.smithi049.stdout:6/756: mknod dc/d1b/d20/d81/d5a/cf0 0 2024-09-19T09:03:13.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/757: getdents dc/d1b/d20/d2f 0 2024-09-19T09:03:13.591 INFO:tasks.workunit.client.0.smithi049.stdout:6/758: symlink dc/d1b/d78/ddd/de6/lf1 0 2024-09-19T09:03:13.599 INFO:tasks.workunit.client.0.smithi049.stdout:6/759: dwrite dc/d1b/d20/d2f/d6b/dd2/fe8 [0,4194304] 0 2024-09-19T09:03:13.603 INFO:tasks.workunit.client.0.smithi049.stdout:0/918: dread d5/d10/d82/d67/d85/d10e/f6e [0,4194304] 0 2024-09-19T09:03:13.610 INFO:tasks.workunit.client.0.smithi049.stdout:6/760: write dc/ff [574754,125473] 0 2024-09-19T09:03:13.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/919: creat d5/d10/d13/d15/d29/f116 x:0 0 0 2024-09-19T09:03:13.614 INFO:tasks.workunit.client.0.smithi049.stdout:6/761: rename dc/d1b/d78/db3 to dc/d1b/d6f/df2 0 2024-09-19T09:03:13.614 INFO:tasks.workunit.client.0.smithi049.stdout:8/962: sync 2024-09-19T09:03:13.614 INFO:tasks.workunit.client.0.smithi049.stdout:5/754: sync 2024-09-19T09:03:13.615 INFO:tasks.workunit.client.0.smithi049.stdout:1/606: sync 2024-09-19T09:03:13.615 INFO:tasks.workunit.client.0.smithi049.stdout:4/750: sync 2024-09-19T09:03:13.615 INFO:tasks.workunit.client.0.smithi049.stdout:3/834: sync 2024-09-19T09:03:13.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/963: dread - d1/d1a/dc2/d10a/f130 zero size 2024-09-19T09:03:13.617 INFO:tasks.workunit.client.0.smithi049.stdout:0/920: creat d5/d10/d13/dc4/dcd/ddb/df5/f117 x:0 0 0 2024-09-19T09:03:13.617 INFO:tasks.workunit.client.0.smithi049.stdout:3/835: chown d10/d3d/f4a 475212 1 2024-09-19T09:03:13.617 INFO:tasks.workunit.client.0.smithi049.stdout:5/755: write d3/d6c/d6d/fdf [1391976,63083] 0 2024-09-19T09:03:13.620 INFO:tasks.workunit.client.0.smithi049.stdout:5/756: write d3/d6c/d6d/fd7 [629287,33624] 0 2024-09-19T09:03:13.623 INFO:tasks.workunit.client.0.smithi049.stdout:6/762: symlink dc/lf3 0 2024-09-19T09:03:13.624 INFO:tasks.workunit.client.0.smithi049.stdout:1/607: dread d5/d6/d19/d21/f3a [0,4194304] 0 2024-09-19T09:03:13.627 INFO:tasks.workunit.client.0.smithi049.stdout:3/836: truncate d10/d11/d13/d30/f9c 892133 0 2024-09-19T09:03:13.628 INFO:tasks.workunit.client.0.smithi049.stdout:3/837: chown d10/d3d/d76/dac/dad/daf/cb6 149444 1 2024-09-19T09:03:13.629 INFO:tasks.workunit.client.0.smithi049.stdout:0/921: dread - d5/d10/d82/d67/d85/d10e/d3d/d7f/d103/fe4 zero size 2024-09-19T09:03:13.630 INFO:tasks.workunit.client.0.smithi049.stdout:3/838: write d10/d11/dd7/d10a/db7/de3/fea [1258709,100500] 0 2024-09-19T09:03:13.630 INFO:tasks.workunit.client.0.smithi049.stdout:0/922: fdatasync d5/d10/d13/d69/f110 0 2024-09-19T09:03:13.631 INFO:tasks.workunit.client.0.smithi049.stdout:5/757: unlink d3/dc/d43/f6a 0 2024-09-19T09:03:13.635 INFO:tasks.workunit.client.0.smithi049.stdout:6/763: creat dc/d1b/d20/d81/d6e/ff4 x:0 0 0 2024-09-19T09:03:13.639 INFO:tasks.workunit.client.0.smithi049.stdout:3/839: unlink d10/d11/d27/d4f/d59/d81/ded/cf0 0 2024-09-19T09:03:13.640 INFO:tasks.workunit.client.0.smithi049.stdout:0/923: symlink d5/d10/d13/dc4/dcd/ddb/df5/l118 0 2024-09-19T09:03:13.641 INFO:tasks.workunit.client.0.smithi049.stdout:0/924: write d5/f58 [4513764,121525] 0 2024-09-19T09:03:13.641 INFO:tasks.workunit.client.0.smithi049.stdout:5/758: creat d3/d5/d20/d57/feb x:0 0 0 2024-09-19T09:03:13.644 INFO:tasks.workunit.client.0.smithi049.stdout:6/764: symlink dc/d1b/d20/d2f/d6b/dd2/lf5 0 2024-09-19T09:03:13.646 INFO:tasks.workunit.client.0.smithi049.stdout:8/964: getdents d1/d11/d45 0 2024-09-19T09:03:13.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/759: creat d3/d5/de/d12/d45/d7a/fec x:0 0 0 2024-09-19T09:03:13.649 INFO:tasks.workunit.client.0.smithi049.stdout:0/925: rename d5/d10/d82/d67/d85/db4 to d5/d10/d82/d119 0 2024-09-19T09:03:13.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/840: getdents d10/d3d/d76/dac/dad/ddc 0 2024-09-19T09:03:13.654 INFO:tasks.workunit.client.0.smithi049.stdout:3/841: chown d10/d11/d27/f43 19124 1 2024-09-19T09:03:13.654 INFO:tasks.workunit.client.0.smithi049.stdout:8/965: rename d1/d11/d2e/d4e/d82/d104 to d1/d1a/dc2/d10a/d132 0 2024-09-19T09:03:13.657 INFO:tasks.workunit.client.0.smithi049.stdout:4/751: dwrite d4/d34/fca [0,4194304] 0 2024-09-19T09:03:13.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/842: mkdir d10/d3d/d79/dc1/d116 0 2024-09-19T09:03:13.662 INFO:tasks.workunit.client.0.smithi049.stdout:5/760: creat d3/d5/d1c/fed x:0 0 0 2024-09-19T09:03:13.662 INFO:tasks.workunit.client.0.smithi049.stdout:4/752: rmdir d4/d15/d19/d1f/d55 39 2024-09-19T09:03:13.664 INFO:tasks.workunit.client.0.smithi049.stdout:4/753: chown d4/d35/c72 3 1 2024-09-19T09:03:13.664 INFO:tasks.workunit.client.0.smithi049.stdout:6/765: dread dc/d16/f70 [0,4194304] 0 2024-09-19T09:03:13.666 INFO:tasks.workunit.client.0.smithi049.stdout:3/843: creat d10/d3d/d46/f117 x:0 0 0 2024-09-19T09:03:13.666 INFO:tasks.workunit.client.0.smithi049.stdout:4/754: chown d4/d34/d3d/d4f/l53 3 1 2024-09-19T09:03:13.668 INFO:tasks.workunit.client.0.smithi049.stdout:6/766: write dc/d1b/d20/d2f/d6b/d73/fa4 [423954,109306] 0 2024-09-19T09:03:13.669 INFO:tasks.workunit.client.0.smithi049.stdout:4/755: write d4/d6c/fdb [5020798,93488] 0 2024-09-19T09:03:13.669 INFO:tasks.workunit.client.0.smithi049.stdout:1/608: write d5/d6/d8/d13/d24/f4a [3199738,98744] 0 2024-09-19T09:03:13.671 INFO:tasks.workunit.client.0.smithi049.stdout:5/761: mkdir d3/d5/de/d12/d97/dee 0 2024-09-19T09:03:13.671 INFO:tasks.workunit.client.0.smithi049.stdout:0/926: getdents d5/d10/d13/d69/d70 0 2024-09-19T09:03:13.676 INFO:tasks.workunit.client.0.smithi049.stdout:4/756: creat d4/d6c/da2/feb x:0 0 0 2024-09-19T09:03:13.677 INFO:tasks.workunit.client.0.smithi049.stdout:1/609: mkdir d5/d6/d19/d30/d63/dc8 0 2024-09-19T09:03:13.680 INFO:tasks.workunit.client.0.smithi049.stdout:5/762: rename d3/d6c to d3/d5/d20/d38/d5a/d8b/def 0 2024-09-19T09:03:13.682 INFO:tasks.workunit.client.0.smithi049.stdout:6/767: creat dc/d1b/d20/d81/d5a/dae/ff6 x:0 0 0 2024-09-19T09:03:13.685 INFO:tasks.workunit.client.0.smithi049.stdout:3/844: truncate d10/d3d/f108 4038523 0 2024-09-19T09:03:13.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/845: dwrite d10/d3d/d95/df5/f10c [0,4194304] 0 2024-09-19T09:03:13.696 INFO:tasks.workunit.client.0.smithi049.stdout:1/610: getdents d5/d6/d8/d1a 0 2024-09-19T09:03:13.697 INFO:tasks.workunit.client.0.smithi049.stdout:1/611: chown d5/d6/d8/d13/d24/dbb/cc5 59238 1 2024-09-19T09:03:13.721 INFO:tasks.workunit.client.0.smithi049.stdout:0/927: link d5/d10/d82/d67/d8c/l113 d5/d10/d13/d30/d9f/l11a 0 2024-09-19T09:03:13.727 INFO:tasks.workunit.client.0.smithi049.stdout:0/928: creat d5/d64/f11b x:0 0 0 2024-09-19T09:03:13.728 INFO:tasks.workunit.client.0.smithi049.stdout:0/929: stat d5/d10/d7d/c107 0 2024-09-19T09:03:13.737 INFO:tasks.workunit.client.0.smithi049.stdout:4/757: write d4/d45/f8e [7179830,73602] 0 2024-09-19T09:03:13.737 INFO:tasks.workunit.client.0.smithi049.stdout:5/763: write d3/d5/de/d12/f6f [552230,25844] 0 2024-09-19T09:03:13.745 INFO:tasks.workunit.client.0.smithi049.stdout:1/612: truncate d5/d6/f7 1060210 0 2024-09-19T09:03:13.746 INFO:tasks.workunit.client.0.smithi049.stdout:3/846: dwrite d10/d11/d13/dbc/dcd/f9e [0,4194304] 0 2024-09-19T09:03:13.749 INFO:tasks.workunit.client.0.smithi049.stdout:4/758: unlink d4/d15/d19/d1f/l43 0 2024-09-19T09:03:13.752 INFO:tasks.workunit.client.0.smithi049.stdout:4/759: write d4/d15/f20 [1922291,24919] 0 2024-09-19T09:03:13.753 INFO:tasks.workunit.client.0.smithi049.stdout:4/760: dread - d4/d6c/d7a/dc1/fc2 zero size 2024-09-19T09:03:13.756 INFO:tasks.workunit.client.0.smithi049.stdout:0/930: write d5/d10/d82/d67/d85/d10e/f51 [592444,31891] 0 2024-09-19T09:03:13.756 INFO:tasks.workunit.client.0.smithi049.stdout:5/764: dread d3/d5/d20/f59 [0,4194304] 0 2024-09-19T09:03:13.758 INFO:tasks.workunit.client.0.smithi049.stdout:5/765: chown d3/d5/l11 4853613 1 2024-09-19T09:03:13.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/613: rename d5/d6/d8/f8c to d5/d6/d8/d13/d24/d3b/fc9 0 2024-09-19T09:03:13.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/761: dread d4/d35/fcf [0,4194304] 0 2024-09-19T09:03:13.773 INFO:tasks.workunit.client.0.smithi049.stdout:3/847: dread d10/d11/f39 [0,4194304] 0 2024-09-19T09:03:13.775 INFO:tasks.workunit.client.0.smithi049.stdout:3/848: read d10/d11/d27/f2c [2385475,31993] 0 2024-09-19T09:03:13.775 INFO:tasks.workunit.client.0.smithi049.stdout:5/766: creat d3/d5/de/dce/ff0 x:0 0 0 2024-09-19T09:03:13.776 INFO:tasks.workunit.client.0.smithi049.stdout:5/767: dread - d3/d5/fe3 zero size 2024-09-19T09:03:13.776 INFO:tasks.workunit.client.0.smithi049.stdout:1/614: creat d5/d6/d19/d21/d52/da6/da7/dbc/fca x:0 0 0 2024-09-19T09:03:13.778 INFO:tasks.workunit.client.0.smithi049.stdout:0/931: creat d5/d64/f11c x:0 0 0 2024-09-19T09:03:13.778 INFO:tasks.workunit.client.0.smithi049.stdout:3/849: mknod d10/d11/dd7/d10a/db7/de3/c118 0 2024-09-19T09:03:13.779 INFO:tasks.workunit.client.0.smithi049.stdout:5/768: symlink d3/d5/d1c/d4c/d63/lf1 0 2024-09-19T09:03:13.781 INFO:tasks.workunit.client.0.smithi049.stdout:1/615: mknod d5/d6/d19/d21/d52/da6/da7/ccb 0 2024-09-19T09:03:13.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/616: readlink d5/d6/d8/d13/d24/l79 0 2024-09-19T09:03:13.783 INFO:tasks.workunit.client.0.smithi049.stdout:3/850: mkdir d10/d3d/d76/dac/dad/ddc/d119 0 2024-09-19T09:03:13.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/769: dwrite d3/d5/d1c/d2d/f2f [4194304,4194304] 0 2024-09-19T09:03:13.850 INFO:tasks.workunit.client.0.smithi049.stdout:5/770: symlink d3/d5/d1c/dd2/dbf/lf2 0 2024-09-19T09:03:13.850 INFO:tasks.workunit.client.0.smithi049.stdout:1/617: dwrite d5/d6/d8/d13/d24/d3b/f5e [0,4194304] 0 2024-09-19T09:03:13.853 INFO:tasks.workunit.client.0.smithi049.stdout:0/932: dread d5/f50 [0,4194304] 0 2024-09-19T09:03:13.855 INFO:tasks.workunit.client.0.smithi049.stdout:5/771: unlink d3/d5/d1c/d3a/l56 0 2024-09-19T09:03:13.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/618: mknod d5/d6/d73/da0/ccc 0 2024-09-19T09:03:13.860 INFO:tasks.workunit.client.0.smithi049.stdout:0/933: mkdir d5/d10/d82/d67/d85/d11d 0 2024-09-19T09:03:13.861 INFO:tasks.workunit.client.0.smithi049.stdout:5/772: creat d3/d5/d1c/dd2/dbf/ff3 x:0 0 0 2024-09-19T09:03:13.863 INFO:tasks.workunit.client.0.smithi049.stdout:1/619: symlink d5/d6/d19/d21/d52/da6/da7/dbc/lcd 0 2024-09-19T09:03:13.867 INFO:tasks.workunit.client.0.smithi049.stdout:0/934: dread d5/d64/d97/fed [0,4194304] 0 2024-09-19T09:03:13.875 INFO:tasks.workunit.client.0.smithi049.stdout:1/620: write d5/d6/d19/d21/f72 [64874,2493] 0 2024-09-19T09:03:13.875 INFO:tasks.workunit.client.0.smithi049.stdout:5/773: link d3/d5/d1c/f22 d3/d5/d20/d38/d5d/ff4 0 2024-09-19T09:03:13.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/621: read - d5/d6/d8/d1a/d78/fb1 zero size 2024-09-19T09:03:13.878 INFO:tasks.workunit.client.0.smithi049.stdout:0/935: link d5/d10/c35 d5/d10/d82/d67/d85/d10e/d3d/d7f/d103/c11e 0 2024-09-19T09:03:13.884 INFO:tasks.workunit.client.0.smithi049.stdout:5/774: rename d3/d5/d20/d38/d9c/fbb to d3/d5/de/d12/d97/ff5 0 2024-09-19T09:03:13.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/622: fdatasync d5/d6/f7 0 2024-09-19T09:03:13.893 INFO:tasks.workunit.client.0.smithi049.stdout:0/936: write d5/d10/d13/d15/d29/d9a/f9e [926934,91998] 0 2024-09-19T09:03:13.894 INFO:tasks.workunit.client.0.smithi049.stdout:0/937: chown d5/d10/d13/d30/f91 2022 1 2024-09-19T09:03:13.900 INFO:tasks.workunit.client.0.smithi049.stdout:0/938: truncate d5/d10/d2f/ff3 2462534 0 2024-09-19T09:03:13.902 INFO:tasks.workunit.client.0.smithi049.stdout:5/775: link d3/d5/de/f1a d3/d5/ff6 0 2024-09-19T09:03:13.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/939: symlink d5/d10/d2f/l11f 0 2024-09-19T09:03:13.904 INFO:tasks.workunit.client.0.smithi049.stdout:0/940: chown d5/d10/d13/d15/l54 321998 1 2024-09-19T09:03:13.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/623: dread d5/d6/d19/d30/d63/fa2 [0,4194304] 0 2024-09-19T09:03:13.907 INFO:tasks.workunit.client.0.smithi049.stdout:5/776: rename d3/d5/d20/d57/d72/fa7 to d3/d5/de/d12/d45/d7a/ff7 0 2024-09-19T09:03:13.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/624: write d5/d6/d19/d30/d64/d71/f87 [1087769,62648] 0 2024-09-19T09:03:13.909 INFO:tasks.workunit.client.0.smithi049.stdout:0/941: rmdir d5/d10/d82/d67 39 2024-09-19T09:03:13.912 INFO:tasks.workunit.client.0.smithi049.stdout:5/777: symlink d3/d5/de/d12/d97/dee/lf8 0 2024-09-19T09:03:13.913 INFO:tasks.workunit.client.0.smithi049.stdout:5/778: readlink d3/d5/d20/l98 0 2024-09-19T09:03:13.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/779: dread d3/d5/de/d12/f6f [0,4194304] 0 2024-09-19T09:03:13.921 INFO:tasks.workunit.client.0.smithi049.stdout:5/780: rename d3/d5/d1c/c37 to d3/dc/d43/cf9 0 2024-09-19T09:03:13.922 INFO:tasks.workunit.client.0.smithi049.stdout:5/781: stat d3/d5/de/d12/d7d 0 2024-09-19T09:03:13.923 INFO:tasks.workunit.client.0.smithi049.stdout:1/625: truncate d5/d6/d73/da0/fb8 3629666 0 2024-09-19T09:03:13.927 INFO:tasks.workunit.client.0.smithi049.stdout:1/626: getdents d5/d6/d73/da0 0 2024-09-19T09:03:13.930 INFO:tasks.workunit.client.0.smithi049.stdout:5/782: write d3/d5/ff6 [60118,64170] 0 2024-09-19T09:03:13.932 INFO:tasks.workunit.client.0.smithi049.stdout:1/627: creat d5/d6/d8/d13/db0/fce x:0 0 0 2024-09-19T09:03:13.934 INFO:tasks.workunit.client.0.smithi049.stdout:5/783: rmdir d3/d5/d20/d38/d5a/d8b/def/d6d 39 2024-09-19T09:03:13.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/784: dread - d3/dc/fc1 zero size 2024-09-19T09:03:13.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/628: creat d5/d6/d19/fcf x:0 0 0 2024-09-19T09:03:13.940 INFO:tasks.workunit.client.0.smithi049.stdout:5/785: symlink d3/d5/d1c/db4/lfa 0 2024-09-19T09:03:13.941 INFO:tasks.workunit.client.0.smithi049.stdout:1/629: mkdir d5/d6/d19/d21/d52/db6/dd0 0 2024-09-19T09:03:13.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/630: readlink d5/d6/d19/d21/d52/l51 0 2024-09-19T09:03:13.944 INFO:tasks.workunit.client.0.smithi049.stdout:1/631: write d5/d6/d19/d21/f46 [2351011,81044] 0 2024-09-19T09:03:13.949 INFO:tasks.workunit.client.0.smithi049.stdout:5/786: dwrite d3/d5/d20/d38/d5a/d8b/def/d6d/fdf [0,4194304] 0 2024-09-19T09:03:13.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/787: write d3/d5/de/d12/d45/d7a/fec [767387,13322] 0 2024-09-19T09:03:13.954 INFO:tasks.workunit.client.0.smithi049.stdout:1/632: dwrite d5/d6/d8/d1a/d78/f8d [0,4194304] 0 2024-09-19T09:03:13.958 INFO:tasks.workunit.client.0.smithi049.stdout:1/633: mkdir d5/d6/d8/d13/db0/dd1 0 2024-09-19T09:03:13.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/788: dread d3/d5/de/f1e [0,4194304] 0 2024-09-19T09:03:13.963 INFO:tasks.workunit.client.0.smithi049.stdout:1/634: symlink d5/d6/d8/d13/d24/d96/ld2 0 2024-09-19T09:03:13.964 INFO:tasks.workunit.client.0.smithi049.stdout:1/635: chown d5 288829 1 2024-09-19T09:03:13.967 INFO:tasks.workunit.client.0.smithi049.stdout:5/789: dwrite d3/d5/de/f1a [4194304,4194304] 0 2024-09-19T09:03:13.977 INFO:tasks.workunit.client.0.smithi049.stdout:5/790: dwrite d3/d5/f1b [0,4194304] 0 2024-09-19T09:03:13.982 INFO:tasks.workunit.client.0.smithi049.stdout:1/636: dread d5/d6/d19/d21/d52/f76 [0,4194304] 0 2024-09-19T09:03:13.984 INFO:tasks.workunit.client.0.smithi049.stdout:5/791: dwrite d3/f62 [0,4194304] 0 2024-09-19T09:03:13.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/792: mkdir d3/d5/d20/d38/d5a/d8b/def/d6d/da1/dfb 0 2024-09-19T09:03:13.991 INFO:tasks.workunit.client.0.smithi049.stdout:1/637: link d5/d6/d8/d13/d24/d7e/fa3 d5/d6/d8/d13/d24/d7e/d7f/fd3 0 2024-09-19T09:03:13.993 INFO:tasks.workunit.client.0.smithi049.stdout:1/638: chown d5/d6/d19/d21/d52/da6/da7/dbc/lcd 61065 1 2024-09-19T09:03:13.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/639: fsync d5/f54 0 2024-09-19T09:03:13.994 INFO:tasks.workunit.client.0.smithi049.stdout:5/793: rename d3/d5/d1c/dd2/dbf/fe7 to d3/d5/de/d12/d45/ffc 0 2024-09-19T09:03:13.998 INFO:tasks.workunit.client.0.smithi049.stdout:5/794: mkdir d3/d5/de/d12/d97/dee/dfd 0 2024-09-19T09:03:14.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/640: rename d5/d6/d19/c37 to d5/d6/db4/cd4 0 2024-09-19T09:03:14.003 INFO:tasks.workunit.client.0.smithi049.stdout:1/641: symlink d5/d6/d8/d1a/ld5 0 2024-09-19T09:03:14.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/642: chown d5/d6/d19/c2e 141 1 2024-09-19T09:03:14.007 INFO:tasks.workunit.client.0.smithi049.stdout:5/795: dread d3/d5/de/f23 [0,4194304] 0 2024-09-19T09:03:14.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/643: rename d5/d6/d19/d30/d64/d71/f87 to d5/d6/d8/d13/db0/fd6 0 2024-09-19T09:03:14.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/644: fdatasync d5/d6/d19/fcf 0 2024-09-19T09:03:14.012 INFO:tasks.workunit.client.0.smithi049.stdout:5/796: fsync d3/d5/de/d12/d45/ffc 0 2024-09-19T09:03:14.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/797: creat d3/d5/de/d12/d97/dee/dfd/ffe x:0 0 0 2024-09-19T09:03:14.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/798: truncate d3/d5/d20/d38/d5a/d8b/def/d6d/f92 1875899 0 2024-09-19T09:03:14.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/799: fsync d3/d5/d20/d57/f95 0 2024-09-19T09:03:14.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/800: readlink d3/d5/de/lc6 0 2024-09-19T09:03:14.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/645: dwrite d5/d6/d19/f4e [0,4194304] 0 2024-09-19T09:03:14.024 INFO:tasks.workunit.client.0.smithi049.stdout:5/801: creat d3/d5/de/d12/d97/dee/dfd/fff x:0 0 0 2024-09-19T09:03:14.028 INFO:tasks.workunit.client.0.smithi049.stdout:1/646: write d5/d6/d8/d13/db0/fd6 [4296218,45778] 0 2024-09-19T09:03:14.030 INFO:tasks.workunit.client.0.smithi049.stdout:5/802: unlink d3/d5/d20/d57/d72/l83 0 2024-09-19T09:03:14.034 INFO:tasks.workunit.client.0.smithi049.stdout:1/647: rename d5/d6/d19/d30/d64/c83 to d5/d6/d19/db3/cd7 0 2024-09-19T09:03:14.034 INFO:tasks.workunit.client.0.smithi049.stdout:5/803: creat d3/d5/d20/d57/d72/f100 x:0 0 0 2024-09-19T09:03:14.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/648: fdatasync d5/d6/d19/f61 0 2024-09-19T09:03:14.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/649: unlink d5/f36 0 2024-09-19T09:03:14.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/650: stat d5/d6/d8/d1a 0 2024-09-19T09:03:14.039 INFO:tasks.workunit.client.0.smithi049.stdout:5/804: mknod d3/d5/d20/d57/d90/dbc/c101 0 2024-09-19T09:03:14.045 INFO:tasks.workunit.client.0.smithi049.stdout:5/805: link d3/d5/d20/d38/d5a/d8b/la6 d3/d5/de/d4a/l102 0 2024-09-19T09:03:14.051 INFO:tasks.workunit.client.0.smithi049.stdout:1/651: dread d5/d6/d73/fbf [0,4194304] 0 2024-09-19T09:03:14.058 INFO:tasks.workunit.client.0.smithi049.stdout:1/652: dwrite d5/d6/d8/d13/d24/d96/fb9 [0,4194304] 0 2024-09-19T09:03:14.062 INFO:tasks.workunit.client.0.smithi049.stdout:5/806: dread d3/d5/d1c/f2b [0,4194304] 0 2024-09-19T09:03:14.063 INFO:tasks.workunit.client.0.smithi049.stdout:5/807: readlink d3/d5/d1c/db4/lfa 0 2024-09-19T09:03:14.066 INFO:tasks.workunit.client.0.smithi049.stdout:1/653: write d5/d6/d8/f5d [1714671,22284] 0 2024-09-19T09:03:14.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/808: creat d3/d5/d20/d38/d5a/d8b/def/f103 x:0 0 0 2024-09-19T09:03:14.073 INFO:tasks.workunit.client.0.smithi049.stdout:1/654: dwrite d5/fc6 [0,4194304] 0 2024-09-19T09:03:14.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/809: dread - d3/d5/d1c/fed zero size 2024-09-19T09:03:14.076 INFO:tasks.workunit.client.0.smithi049.stdout:1/655: unlink d5/d6/d19/l89 0 2024-09-19T09:03:14.086 INFO:tasks.workunit.client.0.smithi049.stdout:5/810: dwrite d3/d5/de/f44 [0,4194304] 0 2024-09-19T09:03:14.087 INFO:tasks.workunit.client.0.smithi049.stdout:5/811: write d3/d5/d1c/dd2/dbf/ff3 [403598,33853] 0 2024-09-19T09:03:14.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/812: chown d3/d5/d1c/dd2/dbf/dcd/le9 537184 1 2024-09-19T09:03:14.092 INFO:tasks.workunit.client.0.smithi049.stdout:5/813: chown d3/d5/de/f87 237 1 2024-09-19T09:03:14.095 INFO:tasks.workunit.client.0.smithi049.stdout:5/814: mkdir d3/d5/de/d12/d45/d7a/d104 0 2024-09-19T09:03:14.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/815: getdents d3/d5/de/d12/d97/dee/dfd 0 2024-09-19T09:03:14.102 INFO:tasks.workunit.client.0.smithi049.stdout:5/816: rename d3/d5/d1c/d3a to d3/d5/de/d12/d7d/d88/d105 0 2024-09-19T09:03:14.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/817: chown d3/d5/d1c/d4c/d7c/fe2 2234 1 2024-09-19T09:03:14.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/818: fsync d3/d5/d20/f76 0 2024-09-19T09:03:14.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/819: creat d3/d5/de/d12/d7d/f106 x:0 0 0 2024-09-19T09:03:14.107 INFO:tasks.workunit.client.0.smithi049.stdout:5/820: mkdir d3/d5/d20/d38/d5a/d107 0 2024-09-19T09:03:14.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/821: chown d3/d5/d20/d57/d90/dbc/c101 754393 1 2024-09-19T09:03:14.115 INFO:tasks.workunit.client.0.smithi049.stdout:5/822: write d3/d5/de/d12/fa3 [754571,14711] 0 2024-09-19T09:03:14.118 INFO:tasks.workunit.client.0.smithi049.stdout:5/823: mknod d3/d5/de/d12/d45/d7a/d104/c108 0 2024-09-19T09:03:14.124 INFO:tasks.workunit.client.0.smithi049.stdout:5/824: truncate d3/d5/de/f1e 1994200 0 2024-09-19T09:03:14.131 INFO:tasks.workunit.client.0.smithi049.stdout:5/825: truncate d3/d5/de/f1a 3621282 0 2024-09-19T09:03:14.139 INFO:tasks.workunit.client.0.smithi049.stdout:5/826: write d3/f41 [3503285,10634] 0 2024-09-19T09:03:14.144 INFO:tasks.workunit.client.0.smithi049.stdout:5/827: rmdir d3/d5/d20/d38/d5a/d8b/def/d6d/da1/dfb 0 2024-09-19T09:03:14.147 INFO:tasks.workunit.client.0.smithi049.stdout:5/828: unlink d3/d5/d1c/d2d/c7e 0 2024-09-19T09:03:14.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/829: creat d3/d5/de/d12/d97/dee/dfd/f109 x:0 0 0 2024-09-19T09:03:14.151 INFO:tasks.workunit.client.0.smithi049.stdout:5/830: write d3/d5/d20/d38/d5a/d8b/def/f103 [842920,117462] 0 2024-09-19T09:03:14.154 INFO:tasks.workunit.client.0.smithi049.stdout:5/831: mkdir d3/d5/de/d4a/d10a 0 2024-09-19T09:03:14.459 INFO:tasks.workunit.client.0.smithi049.stdout:2/998: sync 2024-09-19T09:03:14.461 INFO:tasks.workunit.client.0.smithi049.stdout:2/999: mkdir d1/d4/d20/d92/dba/d121/d151 0 2024-09-19T09:03:14.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/966: sync 2024-09-19T09:03:14.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/967: dread d1/d11/d2e/d4e/d82/dd8/f12e [0,4194304] 0 2024-09-19T09:03:14.730 INFO:tasks.workunit.client.0.smithi049.stdout:8/968: rename d1/d11/d2e/f57 to d1/d11/d45/f133 0 2024-09-19T09:03:14.739 INFO:tasks.workunit.client.0.smithi049.stdout:8/969: dwrite d1/d27/f108 [0,4194304] 0 2024-09-19T09:03:14.748 INFO:tasks.workunit.client.0.smithi049.stdout:8/970: creat d1/d1a/dc2/d10a/d132/d12c/f134 x:0 0 0 2024-09-19T09:03:14.750 INFO:tasks.workunit.client.0.smithi049.stdout:6/768: sync 2024-09-19T09:03:14.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/762: sync 2024-09-19T09:03:14.751 INFO:tasks.workunit.client.0.smithi049.stdout:8/971: truncate d1/d11/d2e/d4e/d61/fd7 453537 0 2024-09-19T09:03:14.754 INFO:tasks.workunit.client.0.smithi049.stdout:8/972: creat d1/d11/d45/f135 x:0 0 0 2024-09-19T09:03:14.756 INFO:tasks.workunit.client.0.smithi049.stdout:8/973: truncate d1/d11/d4f/d87/d7a/de9/f9c 4588153 0 2024-09-19T09:03:14.757 INFO:tasks.workunit.client.0.smithi049.stdout:4/763: rename d4/d15/d19/d1f/c22 to d4/d45/d4a/dc3/db6/cec 0 2024-09-19T09:03:14.763 INFO:tasks.workunit.client.0.smithi049.stdout:6/769: write dc/d1b/fa8 [684485,3086] 0 2024-09-19T09:03:14.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/764: dwrite d4/d34/fca [0,4194304] 0 2024-09-19T09:03:14.766 INFO:tasks.workunit.client.0.smithi049.stdout:6/770: stat dc/d1b/d20/d2f/d6b/d73 0 2024-09-19T09:03:14.769 INFO:tasks.workunit.client.0.smithi049.stdout:8/974: dread d1/d11/d4f/d87/f55 [0,4194304] 0 2024-09-19T09:03:14.771 INFO:tasks.workunit.client.0.smithi049.stdout:4/765: creat d4/d15/d19/d1f/daa/fed x:0 0 0 2024-09-19T09:03:14.773 INFO:tasks.workunit.client.0.smithi049.stdout:6/771: unlink dc/d1b/d6f/df2/fce 0 2024-09-19T09:03:14.777 INFO:tasks.workunit.client.0.smithi049.stdout:8/975: symlink d1/d11/d2e/d4e/d126/l136 0 2024-09-19T09:03:14.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/976: dwrite d1/d11/d4f/d87/d5d/d65/f6d [0,4194304] 0 2024-09-19T09:03:14.785 INFO:tasks.workunit.client.0.smithi049.stdout:8/977: stat d1/d11/d4f/d87/d7a/de9/d5b/f86 0 2024-09-19T09:03:14.786 INFO:tasks.workunit.client.0.smithi049.stdout:8/978: chown d1/d11/d2e/d4e/d61/fc5 138925 1 2024-09-19T09:03:14.786 INFO:tasks.workunit.client.0.smithi049.stdout:4/766: creat d4/d45/d3f/fee x:0 0 0 2024-09-19T09:03:14.788 INFO:tasks.workunit.client.0.smithi049.stdout:4/767: dread d4/d35/fcf [0,4194304] 0 2024-09-19T09:03:14.790 INFO:tasks.workunit.client.0.smithi049.stdout:8/979: link d1/f14 d1/d11/d2e/d89/f137 0 2024-09-19T09:03:14.791 INFO:tasks.workunit.client.0.smithi049.stdout:4/768: read d4/d4c/f6e [666273,81311] 0 2024-09-19T09:03:14.794 INFO:tasks.workunit.client.0.smithi049.stdout:6/772: dwrite dc/f19 [0,4194304] 0 2024-09-19T09:03:14.794 INFO:tasks.workunit.client.0.smithi049.stdout:8/980: rename d1/d1a/l125 to d1/d1a/dc2/d10a/l138 0 2024-09-19T09:03:14.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/981: truncate d1/d11/d4f/d87/f6a 5154949 0 2024-09-19T09:03:14.803 INFO:tasks.workunit.client.0.smithi049.stdout:6/773: dwrite dc/d1b/d20/d81/d5a/fef [0,4194304] 0 2024-09-19T09:03:14.809 INFO:tasks.workunit.client.0.smithi049.stdout:4/769: write d4/d15/d19/d1f/d55/f90 [1876188,114687] 0 2024-09-19T09:03:14.810 INFO:tasks.workunit.client.0.smithi049.stdout:4/770: chown d4/d6c/da2/fd6 2626281 1 2024-09-19T09:03:14.814 INFO:tasks.workunit.client.0.smithi049.stdout:6/774: link dc/d1b/fa8 dc/d16/ded/ff7 0 2024-09-19T09:03:14.815 INFO:tasks.workunit.client.0.smithi049.stdout:4/771: creat d4/d4c/dcb/fef x:0 0 0 2024-09-19T09:03:14.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/942: sync 2024-09-19T09:03:14.815 INFO:tasks.workunit.client.0.smithi049.stdout:1/656: sync 2024-09-19T09:03:14.815 INFO:tasks.workunit.client.0.smithi049.stdout:3/851: sync 2024-09-19T09:03:14.815 INFO:tasks.workunit.client.0.smithi049.stdout:5/832: sync 2024-09-19T09:03:14.820 INFO:tasks.workunit.client.0.smithi049.stdout:8/982: dwrite d1/d27/f60 [0,4194304] 0 2024-09-19T09:03:14.821 INFO:tasks.workunit.client.0.smithi049.stdout:0/943: creat d5/d10/d13/dc4/f120 x:0 0 0 2024-09-19T09:03:14.822 INFO:tasks.workunit.client.0.smithi049.stdout:1/657: dread - d5/d6/d19/d30/faf zero size 2024-09-19T09:03:14.823 INFO:tasks.workunit.client.0.smithi049.stdout:8/983: chown d1/d27/l12a 196 1 2024-09-19T09:03:14.826 INFO:tasks.workunit.client.0.smithi049.stdout:5/833: creat d3/d5/de/dce/f10b x:0 0 0 2024-09-19T09:03:14.830 INFO:tasks.workunit.client.0.smithi049.stdout:3/852: write d10/d3d/d46/fb4 [821716,6539] 0 2024-09-19T09:03:14.833 INFO:tasks.workunit.client.0.smithi049.stdout:3/853: chown d10/d3d/d76/fb2 262 1 2024-09-19T09:03:14.835 INFO:tasks.workunit.client.0.smithi049.stdout:1/658: dwrite d5/d6/d8/d13/d24/dbb/fc0 [0,4194304] 0 2024-09-19T09:03:14.837 INFO:tasks.workunit.client.0.smithi049.stdout:6/775: getdents dc/d1b/d20/d81/d5a/dae/ddf/de4 0 2024-09-19T09:03:14.840 INFO:tasks.workunit.client.0.smithi049.stdout:4/772: dread d4/d45/f6b [0,4194304] 0 2024-09-19T09:03:14.842 INFO:tasks.workunit.client.0.smithi049.stdout:3/854: creat d10/d3d/d76/f11a x:0 0 0 2024-09-19T09:03:14.843 INFO:tasks.workunit.client.0.smithi049.stdout:1/659: rmdir d5/d6/d82 39 2024-09-19T09:03:14.847 INFO:tasks.workunit.client.0.smithi049.stdout:6/776: symlink dc/d1b/d20/d2f/db4/lf8 0 2024-09-19T09:03:14.847 INFO:tasks.workunit.client.0.smithi049.stdout:6/777: readlink dc/d1b/l98 0 2024-09-19T09:03:14.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/660: rmdir d5/d6/d8/d1a 39 2024-09-19T09:03:14.852 INFO:tasks.workunit.client.0.smithi049.stdout:4/773: dread d4/d45/d3f/d47/fa5 [0,4194304] 0 2024-09-19T09:03:14.853 INFO:tasks.workunit.client.0.smithi049.stdout:1/661: chown d5/d6/d8/d13/db0 581 1 2024-09-19T09:03:14.854 INFO:tasks.workunit.client.0.smithi049.stdout:6/778: creat dc/d16/ff9 x:0 0 0 2024-09-19T09:03:14.854 INFO:tasks.workunit.client.0.smithi049.stdout:5/834: dread d3/d5/d1c/d2d/f60 [0,4194304] 0 2024-09-19T09:03:14.855 INFO:tasks.workunit.client.0.smithi049.stdout:1/662: read d5/d6/d8/d13/d24/d3b/f5e [1393547,36698] 0 2024-09-19T09:03:14.856 INFO:tasks.workunit.client.0.smithi049.stdout:6/779: chown dc/d1b/d20/d81/d6e/lc5 2057510083 1 2024-09-19T09:03:14.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/984: dread d1/d11/d4f/d87/d5d/d65/fcd [4194304,4194304] 0 2024-09-19T09:03:14.859 INFO:tasks.workunit.client.0.smithi049.stdout:4/774: read d4/d35/f3c [2974339,3912] 0 2024-09-19T09:03:14.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/775: fdatasync d4/d4c/dcb/fd2 0 2024-09-19T09:03:14.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/985: stat d1/d11/d4f/d87/d7a/de9/d8c/fae 0 2024-09-19T09:03:14.861 INFO:tasks.workunit.client.0.smithi049.stdout:1/663: rmdir d5/d6/d19/d21/d52/db6 39 2024-09-19T09:03:14.862 INFO:tasks.workunit.client.0.smithi049.stdout:3/855: link d10/d11/d13/d30/f83 d10/d3d/d76/dd8/f11b 0 2024-09-19T09:03:14.865 INFO:tasks.workunit.client.0.smithi049.stdout:6/780: fdatasync dc/d1b/d78/f93 0 2024-09-19T09:03:14.866 INFO:tasks.workunit.client.0.smithi049.stdout:5/835: dread d3/dc/d43/f5b [0,4194304] 0 2024-09-19T09:03:14.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/986: creat d1/d11/d2e/d4e/d82/dd8/f139 x:0 0 0 2024-09-19T09:03:14.872 INFO:tasks.workunit.client.0.smithi049.stdout:1/664: dwrite d5/d6/d19/d30/d64/fba [0,4194304] 0 2024-09-19T09:03:14.875 INFO:tasks.workunit.client.0.smithi049.stdout:4/776: mkdir d4/d45/df0 0 2024-09-19T09:03:14.876 INFO:tasks.workunit.client.0.smithi049.stdout:8/987: dread d1/d11/d45/fa1 [0,4194304] 0 2024-09-19T09:03:14.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/781: dwrite dc/ff [0,4194304] 0 2024-09-19T09:03:14.877 INFO:tasks.workunit.client.0.smithi049.stdout:4/777: fdatasync d4/d34/fca 0 2024-09-19T09:03:14.880 INFO:tasks.workunit.client.0.smithi049.stdout:5/836: dwrite d3/d5/de/d12/d7d/f106 [0,4194304] 0 2024-09-19T09:03:14.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/665: creat d5/d6/d19/fd8 x:0 0 0 2024-09-19T09:03:14.887 INFO:tasks.workunit.client.0.smithi049.stdout:6/782: unlink dc/d1b/d20/d2f/d4c/c7e 0 2024-09-19T09:03:14.887 INFO:tasks.workunit.client.0.smithi049.stdout:5/837: unlink d3/d5/d20/lb9 0 2024-09-19T09:03:14.890 INFO:tasks.workunit.client.0.smithi049.stdout:5/838: fdatasync d3/d5/d20/d57/f95 0 2024-09-19T09:03:14.890 INFO:tasks.workunit.client.0.smithi049.stdout:4/778: mknod d4/d45/d4a/dc3/db6/db8/cf1 0 2024-09-19T09:03:14.893 INFO:tasks.workunit.client.0.smithi049.stdout:1/666: dread - d5/d6/d8/d1a/d78/fb1 zero size 2024-09-19T09:03:14.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/856: dread d10/d11/dd7/d10a/fb9 [0,4194304] 0 2024-09-19T09:03:14.896 INFO:tasks.workunit.client.0.smithi049.stdout:3/857: write d10/d11/d27/d4f/f101 [1803068,84427] 0 2024-09-19T09:03:14.896 INFO:tasks.workunit.client.0.smithi049.stdout:8/988: creat d1/d11/d2e/d4e/d82/f13a x:0 0 0 2024-09-19T09:03:14.899 INFO:tasks.workunit.client.0.smithi049.stdout:4/779: mkdir d4/d34/df2 0 2024-09-19T09:03:14.900 INFO:tasks.workunit.client.0.smithi049.stdout:5/839: creat d3/d5/d1c/dd2/dbf/f10c x:0 0 0 2024-09-19T09:03:14.904 INFO:tasks.workunit.client.0.smithi049.stdout:1/667: creat d5/d6/d19/d21/d52/da6/fd9 x:0 0 0 2024-09-19T09:03:14.904 INFO:tasks.workunit.client.0.smithi049.stdout:8/989: dwrite d1/f23 [4194304,4194304] 0 2024-09-19T09:03:14.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/990: truncate d1/d11/d4f/d87/d7a/de9/d5b/ff5 954601 0 2024-09-19T09:03:14.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/858: creat d10/d3d/d76/dac/dad/de1/d10b/f11c x:0 0 0 2024-09-19T09:03:14.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/991: stat d1/d11/d4f/d87/d7a/fbd 0 2024-09-19T09:03:14.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/780: symlink d4/d6c/d7a/dc1/lf3 0 2024-09-19T09:03:14.913 INFO:tasks.workunit.client.0.smithi049.stdout:5/840: rmdir d3/d5/d20/d57 39 2024-09-19T09:03:14.914 INFO:tasks.workunit.client.0.smithi049.stdout:1/668: fdatasync d5/d6/d8/d13/d24/d7e/fa3 0 2024-09-19T09:03:14.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/859: truncate d10/d11/d27/f68 643736 0 2024-09-19T09:03:14.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/841: dread d3/d5/de/d12/d7d/f106 [0,4194304] 0 2024-09-19T09:03:14.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/783: dread dc/d1b/d20/d2f/d31/f5d [0,4194304] 0 2024-09-19T09:03:14.922 INFO:tasks.workunit.client.0.smithi049.stdout:8/992: symlink d1/d11/d4f/d87/d5d/d11d/d118/l13b 0 2024-09-19T09:03:14.925 INFO:tasks.workunit.client.0.smithi049.stdout:8/993: read d1/d27/f108 [1695647,89086] 0 2024-09-19T09:03:14.925 INFO:tasks.workunit.client.0.smithi049.stdout:4/781: mkdir d4/d45/d4a/df4 0 2024-09-19T09:03:14.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/860: dwrite d10/d11/d27/d4f/f60 [0,4194304] 0 2024-09-19T09:03:14.932 INFO:tasks.workunit.client.0.smithi049.stdout:6/784: mknod dc/d1b/d78/ddd/de6/cfa 0 2024-09-19T09:03:14.937 INFO:tasks.workunit.client.0.smithi049.stdout:3/861: creat d10/d11/d27/d4f/f11d x:0 0 0 2024-09-19T09:03:14.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/785: dwrite dc/d1b/d20/d2f/d4c/fe7 [0,4194304] 0 2024-09-19T09:03:14.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/786: truncate dc/d16/f3b 5028981 0 2024-09-19T09:03:14.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/782: symlink d4/d45/lf5 0 2024-09-19T09:03:14.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/783: stat d4/d15/f83 0 2024-09-19T09:03:14.948 INFO:tasks.workunit.client.0.smithi049.stdout:3/862: fdatasync d10/f48 0 2024-09-19T09:03:14.948 INFO:tasks.workunit.client.0.smithi049.stdout:6/787: dread dc/f19 [0,4194304] 0 2024-09-19T09:03:14.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/863: chown d10/d11/l6f 2 1 2024-09-19T09:03:14.955 INFO:tasks.workunit.client.0.smithi049.stdout:6/788: dread dc/d1b/d20/d2f/f51 [0,4194304] 0 2024-09-19T09:03:14.956 INFO:tasks.workunit.client.0.smithi049.stdout:3/864: write d10/d11/d27/d4f/f11d [691764,27269] 0 2024-09-19T09:03:14.958 INFO:tasks.workunit.client.0.smithi049.stdout:1/669: dwrite d5/f26 [0,4194304] 0 2024-09-19T09:03:14.960 INFO:tasks.workunit.client.0.smithi049.stdout:5/842: getdents d3/d5/de/d12/d97/dee/dfd 0 2024-09-19T09:03:14.968 INFO:tasks.workunit.client.0.smithi049.stdout:3/865: fsync d10/d3d/d51/fd6 0 2024-09-19T09:03:14.971 INFO:tasks.workunit.client.0.smithi049.stdout:3/866: write d10/d3d/d76/f11a [103614,87987] 0 2024-09-19T09:03:14.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/994: dwrite d1/ff [0,4194304] 0 2024-09-19T09:03:14.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/784: dread d4/d45/d3f/d47/faf [0,4194304] 0 2024-09-19T09:03:14.974 INFO:tasks.workunit.client.0.smithi049.stdout:8/995: readlink d1/d11/d4f/d87/d7a/de9/d8c/l109 0 2024-09-19T09:03:14.976 INFO:tasks.workunit.client.0.smithi049.stdout:1/670: rename d5/d6/d8/d13/d24/l93 to d5/d6/d73/da8/lda 0 2024-09-19T09:03:14.976 INFO:tasks.workunit.client.0.smithi049.stdout:4/785: write d4/d6c/da2/fd6 [196716,20736] 0 2024-09-19T09:03:14.977 INFO:tasks.workunit.client.0.smithi049.stdout:5/843: mkdir d3/d5/d20/d38/d5a/d8b/def/d6d/de4/d10d 0 2024-09-19T09:03:14.977 INFO:tasks.workunit.client.0.smithi049.stdout:8/996: read - d1/d1a/d8b/d8e/f11b zero size 2024-09-19T09:03:14.979 INFO:tasks.workunit.client.0.smithi049.stdout:3/867: creat d10/d3d/d76/f11e x:0 0 0 2024-09-19T09:03:14.983 INFO:tasks.workunit.client.0.smithi049.stdout:1/671: creat d5/d6/d8/d13/d24/d96/fdb x:0 0 0 2024-09-19T09:03:14.983 INFO:tasks.workunit.client.0.smithi049.stdout:8/997: chown d1/la3 509 1 2024-09-19T09:03:14.984 INFO:tasks.workunit.client.0.smithi049.stdout:1/672: chown d5/d6/fa 31705 1 2024-09-19T09:03:14.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/844: mknod d3/d5/de/d4a/c10e 0 2024-09-19T09:03:14.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/845: stat d3/d5/d20/d57/d72/fdb 0 2024-09-19T09:03:14.991 INFO:tasks.workunit.client.0.smithi049.stdout:3/868: dread d10/d11/d27/d4f/f7d [0,4194304] 0 2024-09-19T09:03:14.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/846: write d3/dc/faf [2058293,14770] 0 2024-09-19T09:03:14.993 INFO:tasks.workunit.client.0.smithi049.stdout:5/847: stat d3/d5/d1c/d4c 0 2024-09-19T09:03:14.993 INFO:tasks.workunit.client.0.smithi049.stdout:4/786: rename d4/d15/d19/d1f/d55/d7f to d4/d34/da0/df6 0 2024-09-19T09:03:14.995 INFO:tasks.workunit.client.0.smithi049.stdout:1/673: symlink d5/d6/d8/ldc 0 2024-09-19T09:03:14.998 INFO:tasks.workunit.client.0.smithi049.stdout:3/869: mkdir d10/d11/d27/d4f/d59/d81/ded/d11f 0 2024-09-19T09:03:15.001 INFO:tasks.workunit.client.0.smithi049.stdout:8/998: rename d1/d11/d4f/d87/d7a/de9/d5b/f76 to d1/d1a/dc2/d10a/d132/f13c 0 2024-09-19T09:03:15.003 INFO:tasks.workunit.client.0.smithi049.stdout:1/674: dwrite d5/d6/d8/d1a/d78/fb1 [0,4194304] 0 2024-09-19T09:03:15.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/787: unlink d4/d34/d3d/lde 0 2024-09-19T09:03:15.005 INFO:tasks.workunit.client.0.smithi049.stdout:4/788: chown d4/d6c/d7a/dc1/lf3 1096 1 2024-09-19T09:03:15.006 INFO:tasks.workunit.client.0.smithi049.stdout:4/789: dread - d4/d4c/dcb/fd2 zero size 2024-09-19T09:03:15.007 INFO:tasks.workunit.client.0.smithi049.stdout:5/848: mknod d3/d5/d1c/d4c/da0/c10f 0 2024-09-19T09:03:15.007 INFO:tasks.workunit.client.0.smithi049.stdout:8/999: read d1/d11/d4f/d87/d7a/de9/f9c [3987812,58791] 0 2024-09-19T09:03:15.009 INFO:tasks.workunit.client.0.smithi049.stdout:3/870: rename d10/d3d/d51/c55 to d10/d3d/d79/dc1/d116/c120 0 2024-09-19T09:03:15.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/790: dread d4/d15/d19/d1f/d55/f97 [0,4194304] 0 2024-09-19T09:03:15.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/675: link d5/d6/d8/d13/d24/d3b/fc9 d5/d6/d8/dbe/fdd 0 2024-09-19T09:03:15.031 INFO:tasks.workunit.client.0.smithi049.stdout:5/849: truncate d3/d5/d20/d38/d5a/d8b/def/d6d/fd7 391395 0 2024-09-19T09:03:15.031 INFO:tasks.workunit.client.0.smithi049.stdout:3/871: link d10/c72 d10/d11/dd7/c121 0 2024-09-19T09:03:15.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/676: fsync d5/d6/d19/d30/faf 0 2024-09-19T09:03:15.034 INFO:tasks.workunit.client.0.smithi049.stdout:1/677: dread - d5/d6/d8/d13/d24/d96/fdb zero size 2024-09-19T09:03:15.036 INFO:tasks.workunit.client.0.smithi049.stdout:3/872: dread d10/d3d/d76/fb0 [0,4194304] 0 2024-09-19T09:03:15.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/850: creat d3/d5/de/d12/d7d/f110 x:0 0 0 2024-09-19T09:03:15.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/678: dread d5/d6/d8/d13/d24/f4a [0,4194304] 0 2024-09-19T09:03:15.043 INFO:tasks.workunit.client.0.smithi049.stdout:1/679: chown d5/d6/db4 14877 1 2024-09-19T09:03:15.044 INFO:tasks.workunit.client.0.smithi049.stdout:5/851: dwrite d3/d5/d1c/d4c/d7c/fe2 [0,4194304] 0 2024-09-19T09:03:15.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/873: dread d10/d11/d27/f78 [0,4194304] 0 2024-09-19T09:03:15.054 INFO:tasks.workunit.client.0.smithi049.stdout:3/874: write d10/d3d/d76/dac/dad/fda [1603388,85359] 0 2024-09-19T09:03:15.060 INFO:tasks.workunit.client.0.smithi049.stdout:3/875: symlink d10/d3d/d46/d84/dc7/l122 0 2024-09-19T09:03:15.061 INFO:tasks.workunit.client.0.smithi049.stdout:3/876: rmdir d10 39 2024-09-19T09:03:15.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/877: readlink d10/d11/l4d 0 2024-09-19T09:03:15.063 INFO:tasks.workunit.client.0.smithi049.stdout:5/852: write d3/fbe [433636,70901] 0 2024-09-19T09:03:15.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/878: mknod d10/d11/d13/dbc/dcd/c123 0 2024-09-19T09:03:15.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/853: creat d3/dc/dc4/f111 x:0 0 0 2024-09-19T09:03:15.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/879: mknod d10/d11/d27/d4f/c124 0 2024-09-19T09:03:15.068 INFO:tasks.workunit.client.0.smithi049.stdout:5/854: dread - d3/d5/de/d12/d97/dee/dfd/f109 zero size 2024-09-19T09:03:15.070 INFO:tasks.workunit.client.0.smithi049.stdout:5/855: symlink d3/dc/dc4/l112 0 2024-09-19T09:03:15.071 INFO:tasks.workunit.client.0.smithi049.stdout:3/880: creat d10/d3d/d76/dac/dad/daf/d110/f125 x:0 0 0 2024-09-19T09:03:15.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/881: fdatasync d10/d11/d13/d30/f83 0 2024-09-19T09:03:15.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/882: mkdir d10/d11/d27/d4f/d59/d81/d126 0 2024-09-19T09:03:15.080 INFO:tasks.workunit.client.0.smithi049.stdout:3/883: mkdir d10/d3d/d95/d127 0 2024-09-19T09:03:15.082 INFO:tasks.workunit.client.0.smithi049.stdout:3/884: truncate d10/d3d/d76/fb0 30962 0 2024-09-19T09:03:15.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/885: creat d10/d3d/d76/dac/dad/de1/f128 x:0 0 0 2024-09-19T09:03:15.087 INFO:tasks.workunit.client.0.smithi049.stdout:5/856: dwrite d3/d5/de/d12/d97/ff5 [0,4194304] 0 2024-09-19T09:03:15.089 INFO:tasks.workunit.client.0.smithi049.stdout:3/886: creat d10/d11/d27/d4f/d59/d81/f129 x:0 0 0 2024-09-19T09:03:15.090 INFO:tasks.workunit.client.0.smithi049.stdout:5/857: symlink d3/d5/de/d4a/d10a/l113 0 2024-09-19T09:03:15.093 INFO:tasks.workunit.client.0.smithi049.stdout:3/887: creat d10/d3d/d79/dc1/f12a x:0 0 0 2024-09-19T09:03:15.098 INFO:tasks.workunit.client.0.smithi049.stdout:5/858: dwrite d3/d5/d20/d38/d5a/d8b/def/fdd [0,4194304] 0 2024-09-19T09:03:15.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/859: creat d3/d5/de/d4a/dbd/f114 x:0 0 0 2024-09-19T09:03:15.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/888: rmdir d10/d3d/d79 39 2024-09-19T09:03:15.111 INFO:tasks.workunit.client.0.smithi049.stdout:5/860: dwrite d3/d5/de/d12/d45/ffc [0,4194304] 0 2024-09-19T09:03:15.118 INFO:tasks.workunit.client.0.smithi049.stdout:3/889: rename d10/d11/d27/c82 to d10/db8/c12b 0 2024-09-19T09:03:15.124 INFO:tasks.workunit.client.0.smithi049.stdout:3/890: dwrite d10/d11/d27/d4f/f60 [0,4194304] 0 2024-09-19T09:03:15.130 INFO:tasks.workunit.client.0.smithi049.stdout:5/861: dwrite d3/d5/d20/d38/f46 [0,4194304] 0 2024-09-19T09:03:15.134 INFO:tasks.workunit.client.0.smithi049.stdout:5/862: creat d3/d5/d1c/db4/f115 x:0 0 0 2024-09-19T09:03:15.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/891: write d10/d11/d13/f5e [489067,99326] 0 2024-09-19T09:03:15.144 INFO:tasks.workunit.client.0.smithi049.stdout:3/892: stat d10/d3d/d76/dac 0 2024-09-19T09:03:15.146 INFO:tasks.workunit.client.0.smithi049.stdout:5/863: write d3/d5/d1c/f2b [1615638,46568] 0 2024-09-19T09:03:15.148 INFO:tasks.workunit.client.0.smithi049.stdout:5/864: mkdir d3/d5/d1c/d4c/d116 0 2024-09-19T09:03:15.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/893: mknod d10/d3d/d76/dac/dad/ddc/d119/c12c 0 2024-09-19T09:03:15.151 INFO:tasks.workunit.client.0.smithi049.stdout:3/894: truncate d10/d3d/d76/fb2 401821 0 2024-09-19T09:03:15.157 INFO:tasks.workunit.client.0.smithi049.stdout:3/895: dwrite d10/d11/d27/d4f/d59/d81/f129 [0,4194304] 0 2024-09-19T09:03:15.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/896: mknod d10/d3d/d95/dfb/c12d 0 2024-09-19T09:03:15.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/897: dread - d10/d3d/d95/df5/f109 zero size 2024-09-19T09:03:15.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/898: symlink d10/d11/d27/d4f/d59/d81/l12e 0 2024-09-19T09:03:15.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/899: dread d10/f5c [0,4194304] 0 2024-09-19T09:03:15.169 INFO:tasks.workunit.client.0.smithi049.stdout:3/900: mknod d10/d3d/d76/dac/dad/daf/d110/c12f 0 2024-09-19T09:03:15.171 INFO:tasks.workunit.client.0.smithi049.stdout:3/901: rmdir d10/d3d/d95/df5 39 2024-09-19T09:03:15.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/902: rmdir d10/d11/d13 39 2024-09-19T09:03:15.178 INFO:tasks.workunit.client.0.smithi049.stdout:3/903: dwrite d10/d11/dd7/ff9 [0,4194304] 0 2024-09-19T09:03:15.182 INFO:tasks.workunit.client.0.smithi049.stdout:3/904: rmdir d10/d11 39 2024-09-19T09:03:15.190 INFO:tasks.workunit.client.0.smithi049.stdout:3/905: truncate d10/d3d/d76/dac/dad/fc8 2138700 0 2024-09-19T09:03:15.194 INFO:tasks.workunit.client.0.smithi049.stdout:3/906: write d10/d11/d13/d30/fde [4361267,78549] 0 2024-09-19T09:03:15.196 INFO:tasks.workunit.client.0.smithi049.stdout:3/907: truncate d10/d11/d27/f5f 28665 0 2024-09-19T09:03:15.202 INFO:tasks.workunit.client.0.smithi049.stdout:3/908: truncate d10/d11/d27/d4f/fa1 682990 0 2024-09-19T09:03:15.205 INFO:tasks.workunit.client.0.smithi049.stdout:3/909: creat d10/d3d/d76/dac/dad/daf/f130 x:0 0 0 2024-09-19T09:03:15.207 INFO:tasks.workunit.client.0.smithi049.stdout:3/910: stat d10/d11/d27/d4f/d59/d81/cfd 0 2024-09-19T09:03:15.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/911: mknod d10/d11/dd7/d10a/db7/de3/c131 0 2024-09-19T09:03:15.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/912: rename d10/d11/d27/d4f/l50 to d10/d11/d27/d4f/d59/d81/ded/d11f/l132 0 2024-09-19T09:03:15.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/913: chown d10/l88 32 1 2024-09-19T09:03:15.214 INFO:tasks.workunit.client.0.smithi049.stdout:3/914: creat d10/d3d/d95/d127/f133 x:0 0 0 2024-09-19T09:03:15.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/915: dread d10/d3d/d76/dac/dad/fda [0,4194304] 0 2024-09-19T09:03:15.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/916: creat d10/d11/dd7/d10a/db7/f134 x:0 0 0 2024-09-19T09:03:15.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/917: mknod d10/d11/d13/d7e/c135 0 2024-09-19T09:03:15.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/918: read d10/d11/d13/d30/fa7 [277585,11060] 0 2024-09-19T09:03:15.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/919: rmdir d10/d11/def 39 2024-09-19T09:03:15.232 INFO:tasks.workunit.client.0.smithi049.stdout:3/920: chown c7 152061 1 2024-09-19T09:03:15.233 INFO:tasks.workunit.client.0.smithi049.stdout:3/921: rmdir d10/d3d/d46 39 2024-09-19T09:03:15.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/922: dread d10/d11/d27/d4f/f7d [0,4194304] 0 2024-09-19T09:03:15.307 INFO:tasks.workunit.client.0.smithi049.stdout:3/923: rename d10/d11/d13/d7e/fbf to d10/d3d/d76/dac/dad/ddc/d119/f136 0 2024-09-19T09:03:15.311 INFO:tasks.workunit.client.0.smithi049.stdout:3/924: truncate d10/d3d/d79/fb3 802335 0 2024-09-19T09:03:15.315 INFO:tasks.workunit.client.0.smithi049.stdout:3/925: mkdir d10/d3d/d95/df5/d137 0 2024-09-19T09:03:15.317 INFO:tasks.workunit.client.0.smithi049.stdout:3/926: mkdir d10/d11/d27/d4f/d59/d138 0 2024-09-19T09:03:15.318 INFO:tasks.workunit.client.0.smithi049.stdout:3/927: write d10/d11/dd7/ff9 [608591,42707] 0 2024-09-19T09:03:15.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/928: write d10/d11/d27/d4f/d59/d81/f98 [2329047,32402] 0 2024-09-19T09:03:15.322 INFO:tasks.workunit.client.0.smithi049.stdout:3/929: mknod d10/d3d/d76/dac/dad/de1/c139 0 2024-09-19T09:03:15.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/930: creat d10/d3d/d76/dac/f13a x:0 0 0 2024-09-19T09:03:15.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/931: unlink c7 0 2024-09-19T09:03:15.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/932: mknod d10/d11/dd7/d10a/db7/c13b 0 2024-09-19T09:03:15.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/933: chown d10/d11/d13/d7e 5 1 2024-09-19T09:03:15.332 INFO:tasks.workunit.client.0.smithi049.stdout:3/934: rmdir d10/d11/d27/d4f/d59/d81/ded/d11f 39 2024-09-19T09:03:15.334 INFO:tasks.workunit.client.0.smithi049.stdout:3/935: symlink d10/d3d/d76/l13c 0 2024-09-19T09:03:15.335 INFO:tasks.workunit.client.0.smithi049.stdout:3/936: write d10/d11/d27/f2c [2271429,97054] 0 2024-09-19T09:03:15.344 INFO:tasks.workunit.client.0.smithi049.stdout:3/937: getdents d10/d11/dd7/d10a/db7 0 2024-09-19T09:03:15.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/938: readlink d10/d11/d27/d4f/d59/d81/l12e 0 2024-09-19T09:03:15.349 INFO:tasks.workunit.client.0.smithi049.stdout:3/939: dwrite d10/d11/d27/d4f/f60 [0,4194304] 0 2024-09-19T09:03:15.403 INFO:tasks.workunit.client.0.smithi049.stdout:0/944: sync 2024-09-19T09:03:15.413 INFO:tasks.workunit.client.0.smithi049.stdout:3/940: write d10/d3d/d79/fb3 [649322,130112] 0 2024-09-19T09:03:15.416 INFO:tasks.workunit.client.0.smithi049.stdout:3/941: symlink d10/d3d/d46/l13d 0 2024-09-19T09:03:15.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:15 smithi102 ceph-mon[35280]: pgmap v44: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 151 MiB/s wr, 440 op/s 2024-09-19T09:03:15.536 INFO:tasks.workunit.client.0.smithi049.stdout:6/789: sync 2024-09-19T09:03:15.537 INFO:tasks.workunit.client.0.smithi049.stdout:6/790: dread - dc/d1b/d20/d2f/d4c/fb9 zero size 2024-09-19T09:03:15.542 INFO:tasks.workunit.client.0.smithi049.stdout:6/791: rename dc/d1b/d20/d2f/d31/f69 to dc/d1b/d20/d81/d5a/dae/ddf/de4/ffb 0 2024-09-19T09:03:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:15 smithi049 ceph-mon[28158]: pgmap v44: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 151 MiB/s wr, 440 op/s 2024-09-19T09:03:15.557 INFO:tasks.workunit.client.0.smithi049.stdout:6/792: dread dc/d16/f3b [0,4194304] 0 2024-09-19T09:03:15.568 INFO:tasks.workunit.client.0.smithi049.stdout:6/793: dread dc/d1b/d20/fad [0,4194304] 0 2024-09-19T09:03:15.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/794: write f9 [1695736,110341] 0 2024-09-19T09:03:15.577 INFO:tasks.workunit.client.0.smithi049.stdout:6/795: write dc/d1b/d20/f32 [3150816,88706] 0 2024-09-19T09:03:15.577 INFO:tasks.workunit.client.0.smithi049.stdout:6/796: chown dc/d1b/d20 0 1 2024-09-19T09:03:15.580 INFO:tasks.workunit.client.0.smithi049.stdout:6/797: creat dc/d1b/d20/d7f/ffc x:0 0 0 2024-09-19T09:03:15.582 INFO:tasks.workunit.client.0.smithi049.stdout:6/798: creat dc/d1b/d20/d81/d80/ffd x:0 0 0 2024-09-19T09:03:15.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/799: dread - dc/d1b/d20/d7f/f8c zero size 2024-09-19T09:03:15.586 INFO:tasks.workunit.client.0.smithi049.stdout:6/800: creat dc/d1b/d20/d81/d5a/dae/ddf/de4/ffe x:0 0 0 2024-09-19T09:03:15.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/801: fsync dc/d1b/d20/d7f/f8c 0 2024-09-19T09:03:15.599 INFO:tasks.workunit.client.0.smithi049.stdout:6/802: dwrite dc/d1b/d20/d2f/d6b/f89 [0,4194304] 0 2024-09-19T09:03:15.602 INFO:tasks.workunit.client.0.smithi049.stdout:6/803: symlink dc/d1b/d78/lff 0 2024-09-19T09:03:15.603 INFO:tasks.workunit.client.0.smithi049.stdout:6/804: mknod dc/d1b/d20/d81/d5a/dae/c100 0 2024-09-19T09:03:15.619 INFO:tasks.workunit.client.0.smithi049.stdout:6/805: dwrite dc/d1b/d6f/f96 [0,4194304] 0 2024-09-19T09:03:15.626 INFO:tasks.workunit.client.0.smithi049.stdout:6/806: dwrite dc/d16/f3b [0,4194304] 0 2024-09-19T09:03:15.627 INFO:tasks.workunit.client.0.smithi049.stdout:6/807: write dc/d1b/d6f/f96 [4355947,62582] 0 2024-09-19T09:03:15.631 INFO:tasks.workunit.client.0.smithi049.stdout:6/808: fdatasync dc/d1b/d20/d2f/d6b/d73/f82 0 2024-09-19T09:03:15.635 INFO:tasks.workunit.client.0.smithi049.stdout:6/809: truncate dc/fb5 5181306 0 2024-09-19T09:03:15.743 INFO:tasks.workunit.client.0.smithi049.stdout:4/791: sync 2024-09-19T09:03:15.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/792: write d4/d15/f83 [4384480,21201] 0 2024-09-19T09:03:15.746 INFO:tasks.workunit.client.0.smithi049.stdout:4/793: write d4/d34/f46 [860222,2241] 0 2024-09-19T09:03:15.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/794: mkdir d4/d4c/df7 0 2024-09-19T09:03:15.751 INFO:tasks.workunit.client.0.smithi049.stdout:4/795: rename d4/d45/ld0 to d4/d6c/da2/lf8 0 2024-09-19T09:03:15.756 INFO:tasks.workunit.client.0.smithi049.stdout:4/796: dwrite d4/d34/f46 [0,4194304] 0 2024-09-19T09:03:15.768 INFO:tasks.workunit.client.0.smithi049.stdout:4/797: dwrite d4/d4c/f6e [4194304,4194304] 0 2024-09-19T09:03:15.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/798: read d4/d15/d19/d1f/daa/fe1 [830560,61915] 0 2024-09-19T09:03:15.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/799: mknod d4/d34/d3d/d62/d76/cf9 0 2024-09-19T09:03:15.928 INFO:tasks.workunit.client.0.smithi049.stdout:5/865: sync 2024-09-19T09:03:15.928 INFO:tasks.workunit.client.0.smithi049.stdout:1/680: sync 2024-09-19T09:03:15.929 INFO:tasks.workunit.client.0.smithi049.stdout:1/681: stat d5/d6/d19/d21/d52/l51 0 2024-09-19T09:03:15.932 INFO:tasks.workunit.client.0.smithi049.stdout:5/866: rename d3/d5/de/d12/d7d/d88/fcb to d3/d5/de/d12/d7d/d88/f117 0 2024-09-19T09:03:15.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/867: write d3/d5/de/d12/d7d/f110 [755625,53792] 0 2024-09-19T09:03:15.934 INFO:tasks.workunit.client.0.smithi049.stdout:1/682: mkdir d5/d6/d82/dde 0 2024-09-19T09:03:15.937 INFO:tasks.workunit.client.0.smithi049.stdout:5/868: symlink d3/d5/d1c/d4c/d63/l118 0 2024-09-19T09:03:15.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/869: mknod d3/dc/dc4/c119 0 2024-09-19T09:03:15.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/683: rename d5/d6/d19/d21/f3a to d5/d6/d8/fdf 0 2024-09-19T09:03:15.945 INFO:tasks.workunit.client.0.smithi049.stdout:5/870: rename d3/d5/d1c/d4c/c5c to d3/d5/d20/d38/d5a/d8b/c11a 0 2024-09-19T09:03:15.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/684: creat d5/d6/d19/d30/d64/fe0 x:0 0 0 2024-09-19T09:03:15.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/685: fdatasync d5/d6/d19/fd8 0 2024-09-19T09:03:15.958 INFO:tasks.workunit.client.0.smithi049.stdout:1/686: write d5/f1e [304968,19929] 0 2024-09-19T09:03:15.960 INFO:tasks.workunit.client.0.smithi049.stdout:5/871: write d3/d5/d1c/d2d/fc3 [1987092,68329] 0 2024-09-19T09:03:15.962 INFO:tasks.workunit.client.0.smithi049.stdout:1/687: dread d5/d6/d8/d13/d24/d96/fb9 [0,4194304] 0 2024-09-19T09:03:15.967 INFO:tasks.workunit.client.0.smithi049.stdout:1/688: creat d5/d6/d19/d21/d52/da6/da7/dbc/fe1 x:0 0 0 2024-09-19T09:03:15.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/689: fsync d5/f54 0 2024-09-19T09:03:15.970 INFO:tasks.workunit.client.0.smithi049.stdout:1/690: unlink d5/d6/d19/d30/d64/fe0 0 2024-09-19T09:03:15.975 INFO:tasks.workunit.client.0.smithi049.stdout:1/691: symlink d5/d6/d19/le2 0 2024-09-19T09:03:15.978 INFO:tasks.workunit.client.0.smithi049.stdout:5/872: dwrite d3/d5/de/f23 [0,4194304] 0 2024-09-19T09:03:15.980 INFO:tasks.workunit.client.0.smithi049.stdout:1/692: mkdir d5/d6/d73/da0/de3 0 2024-09-19T09:03:15.984 INFO:tasks.workunit.client.0.smithi049.stdout:5/873: creat d3/d5/d20/d38/d5a/d8b/def/d6d/f11b x:0 0 0 2024-09-19T09:03:15.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/874: creat d3/d5/d1c/d4c/f11c x:0 0 0 2024-09-19T09:03:15.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/875: chown d3/d5/de/d12/d7d/f106 7 1 2024-09-19T09:03:15.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/876: stat d3/d5/de/d12/d97/c99 0 2024-09-19T09:03:15.993 INFO:tasks.workunit.client.0.smithi049.stdout:5/877: creat d3/dc/dc4/f11d x:0 0 0 2024-09-19T09:03:15.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/693: write d5/d6/d8/d13/f34 [364209,6429] 0 2024-09-19T09:03:16.001 INFO:tasks.workunit.client.0.smithi049.stdout:1/694: fdatasync d5/d6/d8/d13/d24/d96/fb9 0 2024-09-19T09:03:16.011 INFO:tasks.workunit.client.0.smithi049.stdout:5/878: dwrite d3/d5/de/f87 [0,4194304] 0 2024-09-19T09:03:16.017 INFO:tasks.workunit.client.0.smithi049.stdout:1/695: dwrite d5/d6/d19/d21/d52/f85 [0,4194304] 0 2024-09-19T09:03:16.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/879: mkdir d3/d5/d20/d57/d90/dbc/d11e 0 2024-09-19T09:03:16.021 INFO:tasks.workunit.client.0.smithi049.stdout:1/696: symlink d5/d6/d8/d13/d24/d9f/le4 0 2024-09-19T09:03:16.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/697: write d5/d6/d19/d21/d52/f85 [978648,64486] 0 2024-09-19T09:03:16.026 INFO:tasks.workunit.client.0.smithi049.stdout:5/880: link d3/dc/dc4/c119 d3/d5/d20/d57/d90/dbc/d11e/c11f 0 2024-09-19T09:03:16.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/698: symlink d5/d6/d82/dde/le5 0 2024-09-19T09:03:16.029 INFO:tasks.workunit.client.0.smithi049.stdout:5/881: mknod d3/d5/de/d4a/d10a/c120 0 2024-09-19T09:03:16.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/699: unlink d5/d6/d82/c91 0 2024-09-19T09:03:16.031 INFO:tasks.workunit.client.0.smithi049.stdout:5/882: rmdir d3/d5/d20/d38/d5a/d8b/def/d6d/da1 39 2024-09-19T09:03:16.034 INFO:tasks.workunit.client.0.smithi049.stdout:1/700: creat d5/d6/d19/d21/d52/fe6 x:0 0 0 2024-09-19T09:03:16.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/883: mknod d3/d5/d20/d38/d5a/d8b/def/d6d/de4/d10d/c121 0 2024-09-19T09:03:16.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/884: symlink d3/d5/de/d4a/d10a/l122 0 2024-09-19T09:03:16.050 INFO:tasks.workunit.client.0.smithi049.stdout:5/885: write d3/dc/f9a [4962231,58838] 0 2024-09-19T09:03:16.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/886: fsync d3/d5/d1c/dd2/dbf/fc0 0 2024-09-19T09:03:16.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/887: rename d3/d5/d1c/d4c/d63/f6b to d3/d5/d1c/d4c/d7c/f123 0 2024-09-19T09:03:16.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/945: sync 2024-09-19T09:03:16.199 INFO:tasks.workunit.client.0.smithi049.stdout:0/946: dwrite d5/d10/d2f/d6d/fc6 [0,4194304] 0 2024-09-19T09:03:16.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/947: truncate d5/d10/d13/d15/f8d 3399939 0 2024-09-19T09:03:16.205 INFO:tasks.workunit.client.0.smithi049.stdout:0/948: read - d5/d86/fd8 zero size 2024-09-19T09:03:16.209 INFO:tasks.workunit.client.0.smithi049.stdout:0/949: mkdir d5/d10/d13/d15/d29/d9a/d121 0 2024-09-19T09:03:16.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/950: truncate d5/d10/f5b 4142928 0 2024-09-19T09:03:16.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/951: write d5/d64/f11b [831580,95675] 0 2024-09-19T09:03:16.225 INFO:tasks.workunit.client.0.smithi049.stdout:0/952: creat d5/d10/d82/d67/d85/d10e/d3d/d7f/f122 x:0 0 0 2024-09-19T09:03:16.226 INFO:tasks.workunit.client.0.smithi049.stdout:0/953: chown d5/d10/d13/d15/f43 70 1 2024-09-19T09:03:16.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/954: mkdir d5/d10/d13/d69/d123 0 2024-09-19T09:03:16.231 INFO:tasks.workunit.client.0.smithi049.stdout:0/955: creat d5/d10/d82/d67/f124 x:0 0 0 2024-09-19T09:03:16.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/956: chown d5/d10/d82/d67/d85 268 1 2024-09-19T09:03:16.233 INFO:tasks.workunit.client.0.smithi049.stdout:0/957: readlink d5/d10/d13/ld0 0 2024-09-19T09:03:16.236 INFO:tasks.workunit.client.0.smithi049.stdout:0/958: creat d5/d64/f125 x:0 0 0 2024-09-19T09:03:16.237 INFO:tasks.workunit.client.0.smithi049.stdout:0/959: dread - d5/d10/d13/d15/d29/f10a zero size 2024-09-19T09:03:16.243 INFO:tasks.workunit.client.0.smithi049.stdout:0/960: dwrite d5/d10/d13/d15/d29/d9a/f112 [4194304,4194304] 0 2024-09-19T09:03:16.245 INFO:tasks.workunit.client.0.smithi049.stdout:0/961: write d5/d10/d82/d67/d85/d10e/f51 [620495,129308] 0 2024-09-19T09:03:16.250 INFO:tasks.workunit.client.0.smithi049.stdout:0/962: mknod d5/d10/d82/d119/c126 0 2024-09-19T09:03:16.258 INFO:tasks.workunit.client.0.smithi049.stdout:0/963: rename d5/d10/d13/d15/d29/c37 to d5/d10/d82/d67/d85/d10e/c127 0 2024-09-19T09:03:16.259 INFO:tasks.workunit.client.0.smithi049.stdout:0/964: stat d5/d10/d82/d67/d85/d10e/d3d/l61 0 2024-09-19T09:03:16.262 INFO:tasks.workunit.client.0.smithi049.stdout:0/965: creat d5/d10/d13/d69/d123/f128 x:0 0 0 2024-09-19T09:03:16.272 INFO:tasks.workunit.client.0.smithi049.stdout:0/966: dread d5/d10/d82/d67/d85/fa6 [0,4194304] 0 2024-09-19T09:03:16.273 INFO:tasks.workunit.client.0.smithi049.stdout:0/967: readlink d5/d10/d13/l38 0 2024-09-19T09:03:16.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/968: mkdir d5/d10/d13/d30/d75/df7/d129 0 2024-09-19T09:03:16.279 INFO:tasks.workunit.client.0.smithi049.stdout:0/969: unlink d5/d10/d82/d67/d8c/l113 0 2024-09-19T09:03:16.281 INFO:tasks.workunit.client.0.smithi049.stdout:0/970: mknod d5/d10/c12a 0 2024-09-19T09:03:16.284 INFO:tasks.workunit.client.0.smithi049.stdout:0/971: mkdir d5/d10/d13/dc4/dcd/ddb/d12b 0 2024-09-19T09:03:16.295 INFO:tasks.workunit.client.0.smithi049.stdout:3/942: sync 2024-09-19T09:03:16.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/810: sync 2024-09-19T09:03:16.296 INFO:tasks.workunit.client.0.smithi049.stdout:4/800: sync 2024-09-19T09:03:16.296 INFO:tasks.workunit.client.0.smithi049.stdout:4/801: chown d4/d6c/lab 2784 1 2024-09-19T09:03:16.303 INFO:tasks.workunit.client.0.smithi049.stdout:4/802: dwrite d4/d45/d3f/d47/f81 [0,4194304] 0 2024-09-19T09:03:16.327 INFO:tasks.workunit.client.0.smithi049.stdout:0/972: link d5/d10/d13/d15/d29/d9a/fcc d5/d10/d2f/d6d/dbe/f12c 0 2024-09-19T09:03:16.332 INFO:tasks.workunit.client.0.smithi049.stdout:3/943: unlink d10/d11/d13/dbc/dcd/ff6 0 2024-09-19T09:03:16.336 INFO:tasks.workunit.client.0.smithi049.stdout:4/803: unlink d4/d6c/lab 0 2024-09-19T09:03:16.343 INFO:tasks.workunit.client.0.smithi049.stdout:3/944: rename d10/d3d/d79/fc6 to d10/d11/d13/dbc/dcd/f13e 0 2024-09-19T09:03:16.344 INFO:tasks.workunit.client.0.smithi049.stdout:3/945: chown d10/db8/lf1 1371 1 2024-09-19T09:03:16.344 INFO:tasks.workunit.client.0.smithi049.stdout:1/701: sync 2024-09-19T09:03:16.344 INFO:tasks.workunit.client.0.smithi049.stdout:5/888: sync 2024-09-19T09:03:16.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/889: dread - d3/dc/dc4/f11d zero size 2024-09-19T09:03:16.346 INFO:tasks.workunit.client.0.smithi049.stdout:4/804: mkdir d4/d45/df0/dfa 0 2024-09-19T09:03:16.352 INFO:tasks.workunit.client.0.smithi049.stdout:0/973: getdents d5/d10/d13/d15/d29/d9a/ddc 0 2024-09-19T09:03:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:1/702: creat d5/d6/d8/d13/d24/d9f/dc7/fe7 x:0 0 0 2024-09-19T09:03:16.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/811: dwrite dc/d1b/d20/d81/f15 [0,4194304] 0 2024-09-19T09:03:16.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/974: fdatasync d5/d10/fae 0 2024-09-19T09:03:16.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/812: fsync dc/d1b/d20/d2f/d31/fee 0 2024-09-19T09:03:16.363 INFO:tasks.workunit.client.0.smithi049.stdout:4/805: dread d4/d45/d3f/d47/fa6 [0,4194304] 0 2024-09-19T09:03:16.364 INFO:tasks.workunit.client.0.smithi049.stdout:5/890: mkdir d3/d5/d20/d57/d90/dbc/d11e/d124 0 2024-09-19T09:03:16.365 INFO:tasks.workunit.client.0.smithi049.stdout:0/975: write d5/d10/d82/d67/d85/d10e/d3d/d7f/f122 [981550,36558] 0 2024-09-19T09:03:16.365 INFO:tasks.workunit.client.0.smithi049.stdout:4/806: stat d4/d45/d4a/dc3/dc9 0 2024-09-19T09:03:16.368 INFO:tasks.workunit.client.0.smithi049.stdout:3/946: write d10/d11/d13/d30/f83 [4054547,127607] 0 2024-09-19T09:03:16.373 INFO:tasks.workunit.client.0.smithi049.stdout:4/807: dread d4/d45/d4a/f4e [0,4194304] 0 2024-09-19T09:03:16.375 INFO:tasks.workunit.client.0.smithi049.stdout:4/808: chown d4/d34/d3d/d62/fa8 31 1 2024-09-19T09:03:16.376 INFO:tasks.workunit.client.0.smithi049.stdout:6/813: rename dc/d1b/d20/d2f/le3 to dc/d1b/l101 0 2024-09-19T09:03:16.380 INFO:tasks.workunit.client.0.smithi049.stdout:0/976: creat d5/d10/d82/d67/d85/d10e/d3d/d7f/d103/dd3/f12d x:0 0 0 2024-09-19T09:03:16.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/809: rmdir d4/d34/d3d/d62/d76 39 2024-09-19T09:03:16.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/814: mknod dc/d1b/d20/d7f/c102 0 2024-09-19T09:03:16.385 INFO:tasks.workunit.client.0.smithi049.stdout:0/977: dread d5/fd9 [0,4194304] 0 2024-09-19T09:03:16.386 INFO:tasks.workunit.client.0.smithi049.stdout:0/978: write d5/d10/d13/dc4/f120 [923542,117480] 0 2024-09-19T09:03:16.391 INFO:tasks.workunit.client.0.smithi049.stdout:3/947: symlink d10/d11/d27/d4f/d59/d81/d126/l13f 0 2024-09-19T09:03:16.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/891: write d3/d5/d20/d38/d5a/d8b/def/d6d/fd7 [391296,87340] 0 2024-09-19T09:03:16.396 INFO:tasks.workunit.client.0.smithi049.stdout:0/979: creat d5/d10/d13/d69/d70/f12e x:0 0 0 2024-09-19T09:03:16.397 INFO:tasks.workunit.client.0.smithi049.stdout:3/948: rename d10/d3d/d76/dac/dad/daf/d110/f125 to d10/d3d/d76/f140 0 2024-09-19T09:03:16.400 INFO:tasks.workunit.client.0.smithi049.stdout:5/892: creat d3/dc/f125 x:0 0 0 2024-09-19T09:03:16.404 INFO:tasks.workunit.client.0.smithi049.stdout:0/980: creat d5/d10/d82/d119/dbb/f12f x:0 0 0 2024-09-19T09:03:16.404 INFO:tasks.workunit.client.0.smithi049.stdout:6/815: fdatasync dc/d1b/d20/d2f/d4c/f5e 0 2024-09-19T09:03:16.406 INFO:tasks.workunit.client.0.smithi049.stdout:4/810: dwrite d4/d34/f79 [0,4194304] 0 2024-09-19T09:03:16.407 INFO:tasks.workunit.client.0.smithi049.stdout:5/893: stat d3/d5/d20/ld9 0 2024-09-19T09:03:16.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/949: dwrite d10/d11/ffc [0,4194304] 0 2024-09-19T09:03:16.417 INFO:tasks.workunit.client.0.smithi049.stdout:5/894: write d3/dc/dc4/fea [16233,39806] 0 2024-09-19T09:03:16.420 INFO:tasks.workunit.client.0.smithi049.stdout:4/811: dwrite d4/d34/fca [0,4194304] 0 2024-09-19T09:03:16.432 INFO:tasks.workunit.client.0.smithi049.stdout:0/981: symlink d5/d10/d13/d15/d29/l130 0 2024-09-19T09:03:16.434 INFO:tasks.workunit.client.0.smithi049.stdout:6/816: dread dc/d1b/d20/f91 [0,4194304] 0 2024-09-19T09:03:16.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/950: write d10/d11/d13/f67 [2433490,90340] 0 2024-09-19T09:03:16.440 INFO:tasks.workunit.client.0.smithi049.stdout:5/895: rename d3/d5/d1c/f22 to d3/d5/d1c/d4c/d7c/f126 0 2024-09-19T09:03:16.440 INFO:tasks.workunit.client.0.smithi049.stdout:4/812: dread d4/d34/d3d/d62/d76/fb0 [0,4194304] 0 2024-09-19T09:03:16.440 INFO:tasks.workunit.client.0.smithi049.stdout:5/896: chown d3/d5/d20/d57/d72/ce0 10 1 2024-09-19T09:03:16.442 INFO:tasks.workunit.client.0.smithi049.stdout:3/951: creat d10/d11/d13/dbc/f141 x:0 0 0 2024-09-19T09:03:16.443 INFO:tasks.workunit.client.0.smithi049.stdout:0/982: dread d5/d86/fa0 [0,4194304] 0 2024-09-19T09:03:16.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/952: chown d10/d11/c5b 381522148 1 2024-09-19T09:03:16.445 INFO:tasks.workunit.client.0.smithi049.stdout:6/817: mkdir dc/d1b/d20/d81/d5a/dae/ddf/d103 0 2024-09-19T09:03:16.447 INFO:tasks.workunit.client.0.smithi049.stdout:6/818: write dc/fc8 [4892824,25367] 0 2024-09-19T09:03:16.448 INFO:tasks.workunit.client.0.smithi049.stdout:0/983: readlink d5/d10/d82/d67/d85/d10e/d3d/l2c 0 2024-09-19T09:03:16.451 INFO:tasks.workunit.client.0.smithi049.stdout:0/984: write d5/d10/d13/d15/d29/d9a/f112 [8125529,112521] 0 2024-09-19T09:03:16.451 INFO:tasks.workunit.client.0.smithi049.stdout:3/953: dread - d10/d3d/d76/dac/dad/ddc/d119/f136 zero size 2024-09-19T09:03:16.453 INFO:tasks.workunit.client.0.smithi049.stdout:5/897: dwrite d3/d5/d1c/d2d/fc3 [0,4194304] 0 2024-09-19T09:03:16.464 INFO:tasks.workunit.client.0.smithi049.stdout:4/813: getdents d4/d45/d3f/dae 0 2024-09-19T09:03:16.466 INFO:tasks.workunit.client.0.smithi049.stdout:3/954: mkdir d10/d11/d27/d142 0 2024-09-19T09:03:16.468 INFO:tasks.workunit.client.0.smithi049.stdout:5/898: mknod d3/c127 0 2024-09-19T09:03:16.472 INFO:tasks.workunit.client.0.smithi049.stdout:5/899: truncate d3/d5/de/d12/d45/d7a/ff7 1941908 0 2024-09-19T09:03:16.473 INFO:tasks.workunit.client.0.smithi049.stdout:3/955: getdents d10/d11/d27/d4f/d59/d138 0 2024-09-19T09:03:16.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/814: truncate d4/d34/da0/fe5 792270 0 2024-09-19T09:03:16.475 INFO:tasks.workunit.client.0.smithi049.stdout:0/985: dwrite d5/d10/d13/d15/f43 [0,4194304] 0 2024-09-19T09:03:16.476 INFO:tasks.workunit.client.0.smithi049.stdout:4/815: chown d4/d35 1 1 2024-09-19T09:03:16.476 INFO:tasks.workunit.client.0.smithi049.stdout:5/900: mkdir d3/d5/d1c/db4/d128 0 2024-09-19T09:03:16.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/819: dread dc/d1b/d20/d81/f43 [0,4194304] 0 2024-09-19T09:03:16.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/956: creat d10/d3d/d76/dac/dad/daf/d110/f143 x:0 0 0 2024-09-19T09:03:16.484 INFO:tasks.workunit.client.0.smithi049.stdout:4/816: creat d4/d34/da0/df6/ffb x:0 0 0 2024-09-19T09:03:16.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/901: mknod d3/d5/de/d12/d45/c129 0 2024-09-19T09:03:16.489 INFO:tasks.workunit.client.0.smithi049.stdout:0/986: truncate d5/d10/d13/d30/f31 527229 0 2024-09-19T09:03:16.496 INFO:tasks.workunit.client.0.smithi049.stdout:0/987: dread - d5/d10/d82/d67/d85/d10e/d3d/fc1 zero size 2024-09-19T09:03:16.504 INFO:tasks.workunit.client.0.smithi049.stdout:5/902: dwrite d3/f8 [0,4194304] 0 2024-09-19T09:03:16.506 INFO:tasks.workunit.client.0.smithi049.stdout:3/957: link d10/d3d/d79/dc1/lc3 d10/d3d/d79/dc1/d116/l144 0 2024-09-19T09:03:16.506 INFO:tasks.workunit.client.0.smithi049.stdout:4/817: getdents d4/d45/d3f/d47 0 2024-09-19T09:03:16.506 INFO:tasks.workunit.client.0.smithi049.stdout:5/903: fsync d3/d5/d20/d38/d5a/d8b/def/d6d/fd7 0 2024-09-19T09:03:16.506 INFO:tasks.workunit.client.0.smithi049.stdout:4/818: chown d4/d45/d4a/dc3 6833 1 2024-09-19T09:03:16.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/904: chown d3/d5/de/d12/d45/d7a/l86 10174973 1 2024-09-19T09:03:16.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/819: truncate d4/d6c/da2/fd6 1034528 0 2024-09-19T09:03:16.509 INFO:tasks.workunit.client.0.smithi049.stdout:6/820: rename dc/d1b/d20/d2f/c7b to dc/c104 0 2024-09-19T09:03:16.510 INFO:tasks.workunit.client.0.smithi049.stdout:4/820: fsync d4/d45/d3f/dae/fdd 0 2024-09-19T09:03:16.516 INFO:tasks.workunit.client.0.smithi049.stdout:0/988: write d5/d10/d13/d15/f1b [6435779,60754] 0 2024-09-19T09:03:16.518 INFO:tasks.workunit.client.0.smithi049.stdout:5/905: rmdir d3/d5/d20/d57/d90/dbc/d11e 39 2024-09-19T09:03:16.519 INFO:tasks.workunit.client.0.smithi049.stdout:6/821: creat dc/d1b/d20/d81/d5a/dae/ddf/f105 x:0 0 0 2024-09-19T09:03:16.521 INFO:tasks.workunit.client.0.smithi049.stdout:6/822: stat dc/d1b/d20/d81/d5a/dae/c100 0 2024-09-19T09:03:16.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/989: rename d5/d64/d97/cb3 to d5/d10/d82/d119/c131 0 2024-09-19T09:03:16.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/821: getdents d4/d45/d3f/dae 0 2024-09-19T09:03:16.522 INFO:tasks.workunit.client.0.smithi049.stdout:3/958: dread d10/d11/d27/d4f/d59/d81/f98 [0,4194304] 0 2024-09-19T09:03:16.523 INFO:tasks.workunit.client.0.smithi049.stdout:0/990: readlink d5/d10/d82/d67/lf6 0 2024-09-19T09:03:16.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/991: mknod d5/d10/d13/d15/d29/d9a/ddc/c132 0 2024-09-19T09:03:16.527 INFO:tasks.workunit.client.0.smithi049.stdout:0/992: chown d5/l78 822635 1 2024-09-19T09:03:16.528 INFO:tasks.workunit.client.0.smithi049.stdout:3/959: fdatasync d10/d3d/d76/dac/dad/fc8 0 2024-09-19T09:03:16.533 INFO:tasks.workunit.client.0.smithi049.stdout:5/906: link d3/d5/d20/d38/d5a/d8b/def/d6d/ce5 d3/d5/d20/d57/d90/dbc/d11e/d124/c12a 0 2024-09-19T09:03:16.539 INFO:tasks.workunit.client.0.smithi049.stdout:3/960: dwrite d10/d11/def/f10f [0,4194304] 0 2024-09-19T09:03:16.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/822: write d4/d15/d19/d1f/f67 [1801336,26508] 0 2024-09-19T09:03:16.547 INFO:tasks.workunit.client.0.smithi049.stdout:6/823: dwrite dc/d1b/fcc [0,4194304] 0 2024-09-19T09:03:16.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/823: write d4/d6c/d7a/dc1/fc2 [882911,17329] 0 2024-09-19T09:03:16.549 INFO:tasks.workunit.client.0.smithi049.stdout:0/993: link d5/d10/d13/d30/f31 d5/d10/d82/f133 0 2024-09-19T09:03:16.550 INFO:tasks.workunit.client.0.smithi049.stdout:4/824: write d4/d15/d19/d1f/daa/fed [679453,106491] 0 2024-09-19T09:03:16.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/825: dread d4/d45/d4a/f9d [0,4194304] 0 2024-09-19T09:03:16.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/994: unlink d5/d10/d13/dc4/dcd/dd2/cec 0 2024-09-19T09:03:16.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/995: chown d5/d10/d13/d15/d29 86 1 2024-09-19T09:03:16.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/996: stat d5/d10/d13/dc4/dcd/ddb/df5 0 2024-09-19T09:03:16.557 INFO:tasks.workunit.client.0.smithi049.stdout:6/824: rename dc/d1b/d20/d81/cb6 to dc/d1b/d20/d2f/db4/c106 0 2024-09-19T09:03:16.559 INFO:tasks.workunit.client.0.smithi049.stdout:6/825: truncate dc/d1b/d20/d7f/ffc 3562 0 2024-09-19T09:03:16.560 INFO:tasks.workunit.client.0.smithi049.stdout:0/997: symlink d5/d10/d13/dc4/dcd/ddb/df5/l134 0 2024-09-19T09:03:16.561 INFO:tasks.workunit.client.0.smithi049.stdout:6/826: fdatasync dc/d1b/d20/d81/d5a/dae/ddf/de4/f8a 0 2024-09-19T09:03:16.563 INFO:tasks.workunit.client.0.smithi049.stdout:4/826: creat d4/d15/d19/d1f/d55/ffc x:0 0 0 2024-09-19T09:03:16.565 INFO:tasks.workunit.client.0.smithi049.stdout:0/998: creat d5/d10/d13/d30/f135 x:0 0 0 2024-09-19T09:03:16.566 INFO:tasks.workunit.client.0.smithi049.stdout:6/827: stat dc/d1b/d20/d2f/d31/fee 0 2024-09-19T09:03:16.571 INFO:tasks.workunit.client.0.smithi049.stdout:0/999: getdents d5/d64/d97 0 2024-09-19T09:03:16.574 INFO:tasks.workunit.client.0.smithi049.stdout:4/827: dread d4/d34/d3d/d62/f64 [0,4194304] 0 2024-09-19T09:03:16.579 INFO:tasks.workunit.client.0.smithi049.stdout:3/961: write d10/d11/f36 [794658,110613] 0 2024-09-19T09:03:16.583 INFO:tasks.workunit.client.0.smithi049.stdout:3/962: mknod d10/d3d/d95/d127/c145 0 2024-09-19T09:03:16.587 INFO:tasks.workunit.client.0.smithi049.stdout:3/963: creat d10/d11/d27/f146 x:0 0 0 2024-09-19T09:03:16.591 INFO:tasks.workunit.client.0.smithi049.stdout:3/964: rename d10/d3d/d95/ccb to d10/d11/dd7/d10a/db7/c147 0 2024-09-19T09:03:16.594 INFO:tasks.workunit.client.0.smithi049.stdout:3/965: creat d10/d3d/d95/dfb/f148 x:0 0 0 2024-09-19T09:03:16.631 INFO:tasks.workunit.client.0.smithi049.stdout:3/966: write d10/d11/d13/d30/f31 [637785,84471] 0 2024-09-19T09:03:16.634 INFO:tasks.workunit.client.0.smithi049.stdout:3/967: mknod d10/d3d/d76/dac/dad/c149 0 2024-09-19T09:03:16.635 INFO:tasks.workunit.client.0.smithi049.stdout:3/968: truncate d10/d11/d13/dbc/f141 200175 0 2024-09-19T09:03:16.636 INFO:tasks.workunit.client.0.smithi049.stdout:3/969: mknod d10/d3d/d95/df5/c14a 0 2024-09-19T09:03:16.637 INFO:tasks.workunit.client.0.smithi049.stdout:3/970: write d10/d11/d27/d4f/f86 [1896276,92923] 0 2024-09-19T09:03:16.644 INFO:tasks.workunit.client.0.smithi049.stdout:3/971: dwrite d10/d11/f36 [0,4194304] 0 2024-09-19T09:03:16.648 INFO:tasks.workunit.client.0.smithi049.stdout:3/972: rename d10/d3d/d95/cf7 to d10/d11/d13/dbc/dcd/c14b 0 2024-09-19T09:03:16.649 INFO:tasks.workunit.client.0.smithi049.stdout:3/973: chown d10/db8/lf1 66998852 1 2024-09-19T09:03:16.668 INFO:tasks.workunit.client.0.smithi049.stdout:3/974: write d10/d11/f1a [4132875,94995] 0 2024-09-19T09:03:16.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/975: unlink d10/d11/d13/d30/f31 0 2024-09-19T09:03:16.672 INFO:tasks.workunit.client.0.smithi049.stdout:3/976: chown d10/d11/d13/dbc/dcd/fa9 64865 1 2024-09-19T09:03:16.682 INFO:tasks.workunit.client.0.smithi049.stdout:3/977: creat d10/d11/dd7/d10a/f14c x:0 0 0 2024-09-19T09:03:16.684 INFO:tasks.workunit.client.0.smithi049.stdout:3/978: symlink d10/d3d/d76/dac/dad/ddc/d119/l14d 0 2024-09-19T09:03:16.685 INFO:tasks.workunit.client.0.smithi049.stdout:3/979: dread d10/d11/d13/dbc/f141 [0,4194304] 0 2024-09-19T09:03:16.690 INFO:tasks.workunit.client.0.smithi049.stdout:3/980: dread d10/d11/d27/d4f/d59/d81/f129 [0,4194304] 0 2024-09-19T09:03:16.691 INFO:tasks.workunit.client.0.smithi049.stdout:3/981: write d10/d11/d13/dbc/dcd/fe7 [326299,107645] 0 2024-09-19T09:03:16.707 INFO:tasks.workunit.client.0.smithi049.stdout:3/982: dwrite d10/d11/d27/d4f/d59/d81/fd5 [0,4194304] 0 2024-09-19T09:03:16.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/983: dwrite d10/d3d/d79/dc1/f12a [0,4194304] 0 2024-09-19T09:03:16.726 INFO:tasks.workunit.client.0.smithi049.stdout:3/984: dwrite d10/d3d/d46/fb4 [0,4194304] 0 2024-09-19T09:03:16.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/985: mknod d10/d3d/d95/df5/c14e 0 2024-09-19T09:03:16.734 INFO:tasks.workunit.client.0.smithi049.stdout:3/986: mknod d10/d11/def/c14f 0 2024-09-19T09:03:16.742 INFO:tasks.workunit.client.0.smithi049.stdout:3/987: dread d10/d11/d27/f5f [0,4194304] 0 2024-09-19T09:03:16.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/988: rename d10/d3d/c4b to d10/d11/dd7/c150 0 2024-09-19T09:03:16.753 INFO:tasks.workunit.client.0.smithi049.stdout:3/989: creat d10/d11/f151 x:0 0 0 2024-09-19T09:03:16.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/990: dwrite d10/d11/d27/d4f/fa1 [0,4194304] 0 2024-09-19T09:03:16.783 INFO:tasks.workunit.client.0.smithi049.stdout:3/991: mkdir d10/d3d/d46/d84/dc7/d152 0 2024-09-19T09:03:16.787 INFO:tasks.workunit.client.0.smithi049.stdout:3/992: creat d10/d11/d13/f153 x:0 0 0 2024-09-19T09:03:16.793 INFO:tasks.workunit.client.0.smithi049.stdout:3/993: dwrite d10/d3d/d76/dac/dad/daf/d110/f143 [0,4194304] 0 2024-09-19T09:03:16.794 INFO:tasks.workunit.client.0.smithi049.stdout:3/994: readlink d10/d11/l6f 0 2024-09-19T09:03:16.794 INFO:tasks.workunit.client.0.smithi049.stdout:3/995: fsync d10/d3d/d76/dac/f13a 0 2024-09-19T09:03:16.799 INFO:tasks.workunit.client.0.smithi049.stdout:3/996: creat d10/d11/d27/d4f/d59/d81/ded/f154 x:0 0 0 2024-09-19T09:03:16.866 INFO:tasks.workunit.client.0.smithi049.stdout:3/997: write d10/d11/d13/dbc/f141 [27761,81326] 0 2024-09-19T09:03:16.868 INFO:tasks.workunit.client.0.smithi049.stdout:3/998: rmdir d10/d3d 39 2024-09-19T09:03:16.868 INFO:tasks.workunit.client.0.smithi049.stdout:3/999: readlink d10/d11/l58 0 2024-09-19T09:03:16.982 INFO:tasks.workunit.client.0.smithi049.stdout:1/703: sync 2024-09-19T09:03:16.985 INFO:tasks.workunit.client.0.smithi049.stdout:1/704: getdents d5/d6/d19/d21 0 2024-09-19T09:03:16.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/705: write d5/d6/d8/d13/d24/d7e/d7f/fd3 [984346,23390] 0 2024-09-19T09:03:16.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/706: creat d5/d6/d19/d30/fe8 x:0 0 0 2024-09-19T09:03:17.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/707: creat d5/d6/d19/d21/d52/fe9 x:0 0 0 2024-09-19T09:03:17.005 INFO:tasks.workunit.client.0.smithi049.stdout:1/708: mkdir d5/d6/d19/d21/d52/d94/dea 0 2024-09-19T09:03:17.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/709: read d5/d6/d8/d13/d24/d7e/d7f/fd3 [4688424,22552] 0 2024-09-19T09:03:17.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/710: write d5/d6/fa [3595573,31953] 0 2024-09-19T09:03:17.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/711: stat d5/d6/d73/da8 0 2024-09-19T09:03:17.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/712: chown d5/d6/l74 11 1 2024-09-19T09:03:17.017 INFO:tasks.workunit.client.0.smithi049.stdout:1/713: getdents d5/d6/d8/d13/db0/dd1 0 2024-09-19T09:03:17.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/714: read d5/d6/d19/d30/f65 [3743017,68523] 0 2024-09-19T09:03:17.021 INFO:tasks.workunit.client.0.smithi049.stdout:6/828: sync 2024-09-19T09:03:17.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/907: sync 2024-09-19T09:03:17.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/828: sync 2024-09-19T09:03:17.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/715: unlink d5/d6/d8/d13/d24/d3b/l41 0 2024-09-19T09:03:17.026 INFO:tasks.workunit.client.0.smithi049.stdout:6/829: rmdir dc/d1b/d20/d81/d5a 39 2024-09-19T09:03:17.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/908: mkdir d3/d5/d1c/d4c/da0/d12b 0 2024-09-19T09:03:17.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/716: mkdir d5/d6/d19/d21/deb 0 2024-09-19T09:03:17.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/717: chown d5/d6/d82 966935 1 2024-09-19T09:03:17.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/718: stat d5/d6/d8/d1a/d78/l8a 0 2024-09-19T09:03:17.037 INFO:tasks.workunit.client.0.smithi049.stdout:5/909: dwrite d3/d5/de/d4a/dbd/f114 [0,4194304] 0 2024-09-19T09:03:17.038 INFO:tasks.workunit.client.0.smithi049.stdout:4/829: dread d4/d6c/fdb [0,4194304] 0 2024-09-19T09:03:17.044 INFO:tasks.workunit.client.0.smithi049.stdout:4/830: unlink d4/c1b 0 2024-09-19T09:03:17.044 INFO:tasks.workunit.client.0.smithi049.stdout:6/830: dwrite dc/d16/f48 [0,4194304] 0 2024-09-19T09:03:17.047 INFO:tasks.workunit.client.0.smithi049.stdout:6/831: mknod dc/d1b/d6f/df2/c107 0 2024-09-19T09:03:17.052 INFO:tasks.workunit.client.0.smithi049.stdout:1/719: link d5/d6/d19/d21/d52/l51 d5/d6/d8/d13/lec 0 2024-09-19T09:03:17.058 INFO:tasks.workunit.client.0.smithi049.stdout:1/720: dwrite d5/d6/d19/d21/d52/f76 [4194304,4194304] 0 2024-09-19T09:03:17.063 INFO:tasks.workunit.client.0.smithi049.stdout:1/721: mkdir d5/d6/d8/d13/d24/d9f/ded 0 2024-09-19T09:03:17.063 INFO:tasks.workunit.client.0.smithi049.stdout:1/722: fsync d5/d6/d8/d13/d24/d96/fdb 0 2024-09-19T09:03:17.069 INFO:tasks.workunit.client.0.smithi049.stdout:1/723: symlink d5/d6/d19/d21/d52/d94/dea/lee 0 2024-09-19T09:03:17.069 INFO:tasks.workunit.client.0.smithi049.stdout:6/832: dwrite dc/fc0 [0,4194304] 0 2024-09-19T09:03:17.072 INFO:tasks.workunit.client.0.smithi049.stdout:1/724: fsync d5/d6/d8/d13/d24/f8b 0 2024-09-19T09:03:17.080 INFO:tasks.workunit.client.0.smithi049.stdout:6/833: rename dc/d1b/d20/d2f/d4c/lcb to dc/d1b/d20/d2f/d6b/dd2/l108 0 2024-09-19T09:03:17.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/834: mkdir dc/d1b/d20/d2f/db4/d109 0 2024-09-19T09:03:17.087 INFO:tasks.workunit.client.0.smithi049.stdout:6/835: link dc/d1b/d20/d2f/d6b/d73/fd3 dc/d16/f10a 0 2024-09-19T09:03:17.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/836: chown dc/d1b/d20/d2f/d6b/d73/c9b 0 1 2024-09-19T09:03:17.089 INFO:tasks.workunit.client.0.smithi049.stdout:6/837: chown dc/d16/la7 37 1 2024-09-19T09:03:17.091 INFO:tasks.workunit.client.0.smithi049.stdout:1/725: dread d5/d6/d8/d13/db0/fd6 [0,4194304] 0 2024-09-19T09:03:17.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/726: fdatasync d5/d6/d8/d1a/d78/fb1 0 2024-09-19T09:03:17.094 INFO:tasks.workunit.client.0.smithi049.stdout:6/838: mknod dc/d1b/d20/d81/d5a/c10b 0 2024-09-19T09:03:17.096 INFO:tasks.workunit.client.0.smithi049.stdout:1/727: mkdir d5/d6/d73/da0/def 0 2024-09-19T09:03:17.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/839: rename dc/d1b/d20/d81/f85 to dc/d16/ded/f10c 0 2024-09-19T09:03:17.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/840: write dc/d1b/d20/d2f/d4c/fe7 [400458,56268] 0 2024-09-19T09:03:17.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/841: stat dc/d16/f3b 0 2024-09-19T09:03:17.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/728: readlink d5/d6/d73/da8/lda 0 2024-09-19T09:03:17.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/842: truncate dc/d1b/d20/d81/d5a/dae/ddf/de4/f8a 806271 0 2024-09-19T09:03:17.106 INFO:tasks.workunit.client.0.smithi049.stdout:1/729: mkdir d5/d6/d19/d21/d52/da6/da7/df0 0 2024-09-19T09:03:17.107 INFO:tasks.workunit.client.0.smithi049.stdout:1/730: write d5/d6/d8/d1a/d78/f8d [3788771,130155] 0 2024-09-19T09:03:17.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/731: stat d5/d6/d8/d13/d24/d7e/d7f/cc1 0 2024-09-19T09:03:17.111 INFO:tasks.workunit.client.0.smithi049.stdout:1/732: write d5/d6/d19/d21/d52/da6/da7/dbc/fe1 [916963,109838] 0 2024-09-19T09:03:17.121 INFO:tasks.workunit.client.0.smithi049.stdout:1/733: write d5/f80 [529067,83306] 0 2024-09-19T09:03:17.123 INFO:tasks.workunit.client.0.smithi049.stdout:6/843: dread dc/d1b/f39 [0,4194304] 0 2024-09-19T09:03:17.125 INFO:tasks.workunit.client.0.smithi049.stdout:1/734: mkdir d5/d6/d8/d13/d24/d7e/d7f/df1 0 2024-09-19T09:03:17.125 INFO:tasks.workunit.client.0.smithi049.stdout:6/844: stat dc/d1b/d20/d81/d80/ffd 0 2024-09-19T09:03:17.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/735: dread - d5/d6/d8/d13/d24/d3b/f99 zero size 2024-09-19T09:03:17.131 INFO:tasks.workunit.client.0.smithi049.stdout:6/845: rename dc/d1b/d20/d2f/d31/fcd to dc/d1b/d20/d2f/d4c/f10d 0 2024-09-19T09:03:17.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/736: getdents d5/d6/d82/dde 0 2024-09-19T09:03:17.140 INFO:tasks.workunit.client.0.smithi049.stdout:1/737: chown d5/d6/db4/cd4 122270854 1 2024-09-19T09:03:17.144 INFO:tasks.workunit.client.0.smithi049.stdout:1/738: unlink d5/d6/d8/d13/d24/d7e/c81 0 2024-09-19T09:03:17.144 INFO:tasks.workunit.client.0.smithi049.stdout:1/739: stat d5/d6/d8/d13/d24/la5 0 2024-09-19T09:03:17.148 INFO:tasks.workunit.client.0.smithi049.stdout:1/740: creat d5/d6/d19/d21/d52/d94/ff2 x:0 0 0 2024-09-19T09:03:17.153 INFO:tasks.workunit.client.0.smithi049.stdout:1/741: mknod d5/d6/d19/d21/d52/db6/dd0/cf3 0 2024-09-19T09:03:17.156 INFO:tasks.workunit.client.0.smithi049.stdout:1/742: symlink d5/d6/d19/db3/lf4 0 2024-09-19T09:03:17.176 INFO:tasks.workunit.client.0.smithi049.stdout:1/743: rmdir d5/d6/d8/d13/d24/d7e 39 2024-09-19T09:03:17.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/744: creat d5/d6/d8/d13/d24/d9f/dc7/ff5 x:0 0 0 2024-09-19T09:03:17.181 INFO:tasks.workunit.client.0.smithi049.stdout:1/745: symlink d5/lf6 0 2024-09-19T09:03:17.193 INFO:tasks.workunit.client.0.smithi049.stdout:1/746: write d5/d6/d19/d30/d63/f68 [1045464,7095] 0 2024-09-19T09:03:17.195 INFO:tasks.workunit.client.0.smithi049.stdout:1/747: mkdir d5/d6/d8/d13/db0/df7 0 2024-09-19T09:03:17.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/748: dwrite d5/d6/d19/d30/d63/f68 [0,4194304] 0 2024-09-19T09:03:17.217 INFO:tasks.workunit.client.0.smithi049.stdout:1/749: dread d5/d6/d8/d13/d24/d7e/d7f/fd3 [0,4194304] 0 2024-09-19T09:03:17.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/750: truncate d5/d6/d19/d21/f72 851842 0 2024-09-19T09:03:17.224 INFO:tasks.workunit.client.0.smithi049.stdout:1/751: creat d5/d6/d8/d13/ff8 x:0 0 0 2024-09-19T09:03:17.225 INFO:tasks.workunit.client.0.smithi049.stdout:1/752: mknod d5/d6/d19/db3/cf9 0 2024-09-19T09:03:17.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/753: mknod d5/d6/d19/d21/d52/d94/cfa 0 2024-09-19T09:03:17.228 INFO:tasks.workunit.client.0.smithi049.stdout:1/754: readlink d5/d6/d19/d21/d52/lc3 0 2024-09-19T09:03:17.228 INFO:tasks.workunit.client.0.smithi049.stdout:1/755: stat d5/d6/d8/d13/d24/d9f/le4 0 2024-09-19T09:03:17.233 INFO:tasks.workunit.client.0.smithi049.stdout:1/756: dwrite d5/f7a [0,4194304] 0 2024-09-19T09:03:17.234 INFO:tasks.workunit.client.0.smithi049.stdout:1/757: dread - d5/d6/d8/d13/d24/d9f/dc7/fe7 zero size 2024-09-19T09:03:17.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/758: chown d5/d6/d8/d13/d24/d3b 76096391 1 2024-09-19T09:03:17.240 INFO:tasks.workunit.client.0.smithi049.stdout:1/759: creat d5/d6/d8/d13/ffb x:0 0 0 2024-09-19T09:03:17.246 INFO:tasks.workunit.client.0.smithi049.stdout:1/760: dread d5/f7a [4194304,4194304] 0 2024-09-19T09:03:17.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/761: symlink d5/d6/d73/lfc 0 2024-09-19T09:03:17.250 INFO:tasks.workunit.client.0.smithi049.stdout:1/762: unlink d5/d6/d19/d21/d52/da6/da7/dbc/lcd 0 2024-09-19T09:03:17.252 INFO:tasks.workunit.client.0.smithi049.stdout:1/763: mknod d5/d6/d19/d21/cfd 0 2024-09-19T09:03:17.254 INFO:tasks.workunit.client.0.smithi049.stdout:1/764: creat d5/d6/d19/d30/d63/dc8/ffe x:0 0 0 2024-09-19T09:03:17.255 INFO:tasks.workunit.client.0.smithi049.stdout:1/765: chown d5/d6/d8/d13/d24/d9f/dc7 447947098 1 2024-09-19T09:03:17.257 INFO:tasks.workunit.client.0.smithi049.stdout:1/766: mkdir d5/d6/d8/d13/d24/d9f/dc7/dff 0 2024-09-19T09:03:17.260 INFO:tasks.workunit.client.0.smithi049.stdout:1/767: creat d5/d6/d19/d21/d52/da6/da7/dbc/f100 x:0 0 0 2024-09-19T09:03:17.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/768: mknod d5/d6/d19/d30/d64/c101 0 2024-09-19T09:03:17.264 INFO:tasks.workunit.client.0.smithi049.stdout:1/769: creat d5/d6/d19/d30/d63/f102 x:0 0 0 2024-09-19T09:03:17.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/770: rmdir d5/d6/d19/d30 39 2024-09-19T09:03:17.276 INFO:tasks.workunit.client.0.smithi049.stdout:1/771: write d5/d6/d8/d13/d24/d3b/f99 [630468,108584] 0 2024-09-19T09:03:17.278 INFO:tasks.workunit.client.0.smithi049.stdout:1/772: unlink d5/d6/d8/d13/d24/l66 0 2024-09-19T09:03:17.280 INFO:tasks.workunit.client.0.smithi049.stdout:1/773: fdatasync d5/d6/d19/f90 0 2024-09-19T09:03:17.282 INFO:tasks.workunit.client.0.smithi049.stdout:1/774: symlink d5/d6/d19/d21/d52/db6/l103 0 2024-09-19T09:03:17.299 INFO:tasks.workunit.client.0.smithi049.stdout:1/775: dwrite d5/d6/d8/d1a/f5c [0,4194304] 0 2024-09-19T09:03:17.345 INFO:tasks.workunit.client.0.smithi049.stdout:1/776: dwrite d5/d6/d8/d13/d24/d7e/fa3 [0,4194304] 0 2024-09-19T09:03:17.349 INFO:tasks.workunit.client.0.smithi049.stdout:1/777: truncate d5/d6/d8/d1a/d78/f8d 4357271 0 2024-09-19T09:03:17.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:17 smithi102 ceph-mon[35280]: pgmap v45: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 97 MiB/s wr, 296 op/s 2024-09-19T09:03:17.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:17 smithi049 ceph-mon[28158]: pgmap v45: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 97 MiB/s wr, 296 op/s 2024-09-19T09:03:17.673 INFO:tasks.workunit.client.0.smithi049.stdout:5/910: sync 2024-09-19T09:03:17.673 INFO:tasks.workunit.client.0.smithi049.stdout:5/911: chown d3/d5/de/d12/d97 1527 1 2024-09-19T09:03:17.687 INFO:tasks.workunit.client.0.smithi049.stdout:5/912: getdents d3/d5/d20/d38/d5d 0 2024-09-19T09:03:17.691 INFO:tasks.workunit.client.0.smithi049.stdout:5/913: unlink d3/d5/d1c/f2b 0 2024-09-19T09:03:17.692 INFO:tasks.workunit.client.0.smithi049.stdout:5/914: write d3/dc/f125 [411911,97721] 0 2024-09-19T09:03:17.694 INFO:tasks.workunit.client.0.smithi049.stdout:5/915: truncate d3/d5/d20/d57/f95 395563 0 2024-09-19T09:03:17.695 INFO:tasks.workunit.client.0.smithi049.stdout:5/916: dread - d3/d5/d20/d57/feb zero size 2024-09-19T09:03:17.700 INFO:tasks.workunit.client.0.smithi049.stdout:5/917: rename d3/d5/d20/d38/d5a/d8b/def/d6d/da1/cd3 to d3/d5/d20/d38/d5a/d8b/def/d6d/da1/c12c 0 2024-09-19T09:03:17.711 INFO:tasks.workunit.client.0.smithi049.stdout:5/918: dread d3/d5/d1c/fd5 [0,4194304] 0 2024-09-19T09:03:17.717 INFO:tasks.workunit.client.0.smithi049.stdout:5/919: dread d3/d5/d20/f59 [0,4194304] 0 2024-09-19T09:03:17.719 INFO:tasks.workunit.client.0.smithi049.stdout:5/920: fsync d3/dc/d43/f82 0 2024-09-19T09:03:17.724 INFO:tasks.workunit.client.0.smithi049.stdout:5/921: dwrite d3/dc/f9a [0,4194304] 0 2024-09-19T09:03:17.768 INFO:tasks.workunit.client.0.smithi049.stdout:4/831: sync 2024-09-19T09:03:17.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/832: truncate d4/d4c/dcb/fef 470715 0 2024-09-19T09:03:17.770 INFO:tasks.workunit.client.0.smithi049.stdout:4/833: chown d4/d4c/dcb/fef 216 1 2024-09-19T09:03:17.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/834: mkdir d4/d34/d3d/d62/d76/dfd 0 2024-09-19T09:03:17.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/835: chown d4/d45/d3f/d47/d5f/cd4 28678905 1 2024-09-19T09:03:17.776 INFO:tasks.workunit.client.0.smithi049.stdout:4/836: truncate d4/d15/d19/d1f/daa/dbd/dc6/fb1 840753 0 2024-09-19T09:03:17.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/837: write d4/f1e [3485500,62589] 0 2024-09-19T09:03:17.809 INFO:tasks.workunit.client.0.smithi049.stdout:4/838: readlink d4/d15/lc4 0 2024-09-19T09:03:17.812 INFO:tasks.workunit.client.0.smithi049.stdout:4/839: fdatasync d4/d35/f52 0 2024-09-19T09:03:17.819 INFO:tasks.workunit.client.0.smithi049.stdout:4/840: creat d4/d45/df0/dfa/ffe x:0 0 0 2024-09-19T09:03:17.838 INFO:tasks.workunit.client.0.smithi049.stdout:4/841: dread d4/d15/d19/d1f/d55/f97 [0,4194304] 0 2024-09-19T09:03:17.847 INFO:tasks.workunit.client.0.smithi049.stdout:4/842: dwrite d4/d34/da0/df6/ffb [0,4194304] 0 2024-09-19T09:03:17.851 INFO:tasks.workunit.client.0.smithi049.stdout:4/843: unlink d4/d34/le4 0 2024-09-19T09:03:17.857 INFO:tasks.workunit.client.0.smithi049.stdout:4/844: dread d4/d34/d3d/d4f/d70/fc8 [0,4194304] 0 2024-09-19T09:03:17.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/845: write d4/d15/d19/d1f/daa/fed [72495,57068] 0 2024-09-19T09:03:17.859 INFO:tasks.workunit.client.0.smithi049.stdout:4/846: chown d4/la4 0 1 2024-09-19T09:03:17.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/847: unlink d4/d35/f3c 0 2024-09-19T09:03:17.866 INFO:tasks.workunit.client.0.smithi049.stdout:4/848: truncate d4/d6c/da2/f9b 155772 0 2024-09-19T09:03:17.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/846: sync 2024-09-19T09:03:17.872 INFO:tasks.workunit.client.0.smithi049.stdout:1/778: sync 2024-09-19T09:03:17.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/779: chown d5/d6/d8/d13/d24/f2f 314 1 2024-09-19T09:03:17.876 INFO:tasks.workunit.client.0.smithi049.stdout:6/847: creat dc/d1b/d20/d2f/db4/f10e x:0 0 0 2024-09-19T09:03:17.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/780: chown d5/d6/d19/d21/d52/f76 21937201 1 2024-09-19T09:03:17.878 INFO:tasks.workunit.client.0.smithi049.stdout:1/781: readlink d5/d6/d8/l3c 0 2024-09-19T09:03:17.881 INFO:tasks.workunit.client.0.smithi049.stdout:6/848: symlink dc/d1b/d20/d81/d80/l10f 0 2024-09-19T09:03:17.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/782: creat d5/d6/d19/d30/d63/dc8/f104 x:0 0 0 2024-09-19T09:03:17.888 INFO:tasks.workunit.client.0.smithi049.stdout:1/783: stat d5/f1e 0 2024-09-19T09:03:17.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/849: dread d4/d6c/da2/f85 [0,4194304] 0 2024-09-19T09:03:17.891 INFO:tasks.workunit.client.0.smithi049.stdout:1/784: dread - d5/d6/d19/d21/d52/d94/ff2 zero size 2024-09-19T09:03:17.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/850: fsync d4/d4c/f6e 0 2024-09-19T09:03:17.893 INFO:tasks.workunit.client.0.smithi049.stdout:4/851: dread - d4/d4c/dcb/fd2 zero size 2024-09-19T09:03:17.894 INFO:tasks.workunit.client.0.smithi049.stdout:1/785: write d5/d6/d19/d21/d52/da6/fd9 [1020192,13316] 0 2024-09-19T09:03:17.902 INFO:tasks.workunit.client.0.smithi049.stdout:1/786: rename d5 to d5/d6/dc/d105 22 2024-09-19T09:03:17.903 INFO:tasks.workunit.client.0.smithi049.stdout:6/849: getdents dc/d1b/d20/d2f/db4 0 2024-09-19T09:03:17.905 INFO:tasks.workunit.client.0.smithi049.stdout:4/852: symlink d4/d34/d3d/lff 0 2024-09-19T09:03:17.907 INFO:tasks.workunit.client.0.smithi049.stdout:5/922: sync 2024-09-19T09:03:17.913 INFO:tasks.workunit.client.0.smithi049.stdout:1/787: mknod d5/d6/d8/d13/d24/d9f/dc7/dff/c106 0 2024-09-19T09:03:17.918 INFO:tasks.workunit.client.0.smithi049.stdout:4/853: write d4/d4c/f8a [505053,89326] 0 2024-09-19T09:03:17.918 INFO:tasks.workunit.client.0.smithi049.stdout:6/850: symlink dc/d1b/d20/d2f/l110 0 2024-09-19T09:03:17.923 INFO:tasks.workunit.client.0.smithi049.stdout:1/788: dwrite d5/d6/d8/d13/d24/d3b/f99 [0,4194304] 0 2024-09-19T09:03:17.924 INFO:tasks.workunit.client.0.smithi049.stdout:1/789: dread - d5/d6/d19/d21/d52/fe9 zero size 2024-09-19T09:03:17.925 INFO:tasks.workunit.client.0.smithi049.stdout:5/923: creat d3/d5/d20/d38/d5a/d8b/def/f12d x:0 0 0 2024-09-19T09:03:17.927 INFO:tasks.workunit.client.0.smithi049.stdout:1/790: stat d5/d6/dc/lac 0 2024-09-19T09:03:17.929 INFO:tasks.workunit.client.0.smithi049.stdout:1/791: fsync d5/d6/d19/d21/f72 0 2024-09-19T09:03:17.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/924: dwrite d3/d5/de/d12/d97/dee/dfd/f109 [0,4194304] 0 2024-09-19T09:03:17.938 INFO:tasks.workunit.client.0.smithi049.stdout:6/851: write dc/d1b/d20/d81/f29 [3112219,125672] 0 2024-09-19T09:03:17.940 INFO:tasks.workunit.client.0.smithi049.stdout:4/854: creat d4/d34/d3d/f100 x:0 0 0 2024-09-19T09:03:17.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/852: write dc/d16/f2d [1788482,58571] 0 2024-09-19T09:03:17.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/855: symlink d4/d34/da0/df6/l101 0 2024-09-19T09:03:17.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/925: creat d3/d5/d20/d57/d90/dbc/d11e/d124/f12e x:0 0 0 2024-09-19T09:03:17.951 INFO:tasks.workunit.client.0.smithi049.stdout:1/792: dread d5/d6/d8/d13/d24/f4a [0,4194304] 0 2024-09-19T09:03:17.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/926: dread - d3/d5/d20/d57/d90/dbc/d11e/d124/f12e zero size 2024-09-19T09:03:17.954 INFO:tasks.workunit.client.0.smithi049.stdout:4/856: creat d4/d45/d3f/dae/f102 x:0 0 0 2024-09-19T09:03:17.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/927: write d3/d5/f1b [4355322,119443] 0 2024-09-19T09:03:17.958 INFO:tasks.workunit.client.0.smithi049.stdout:1/793: mkdir d5/d6/d19/d107 0 2024-09-19T09:03:17.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/928: chown d3/d5/d20/d57/d90/dbc/d11e/c11f 5 1 2024-09-19T09:03:17.961 INFO:tasks.workunit.client.0.smithi049.stdout:4/857: truncate d4/d6c/da2/f85 3191304 0 2024-09-19T09:03:17.961 INFO:tasks.workunit.client.0.smithi049.stdout:5/929: dread d3/d5/d20/d57/f95 [0,4194304] 0 2024-09-19T09:03:17.961 INFO:tasks.workunit.client.0.smithi049.stdout:6/853: link dc/d1b/d20/d2f/d4c/l97 dc/d1b/d20/d81/d80/dab/l111 0 2024-09-19T09:03:17.961 INFO:tasks.workunit.client.0.smithi049.stdout:4/858: stat d4/d45/d3f/dae/fdd 0 2024-09-19T09:03:17.964 INFO:tasks.workunit.client.0.smithi049.stdout:1/794: mknod d5/d6/d19/d21/d52/c108 0 2024-09-19T09:03:17.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/854: symlink dc/d1b/d20/d81/d5a/dae/l112 0 2024-09-19T09:03:17.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/855: fsync dc/d1b/d20/d2f/d6b/f89 0 2024-09-19T09:03:17.970 INFO:tasks.workunit.client.0.smithi049.stdout:6/856: symlink dc/d1b/d20/d2f/d6b/dd2/l113 0 2024-09-19T09:03:17.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/930: truncate d3/d5/d20/d38/d5a/d8b/def/d6d/f92 253983 0 2024-09-19T09:03:17.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/859: getdents d4/d45/d4a/dc3/dc9 0 2024-09-19T09:03:17.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/857: unlink f9 0 2024-09-19T09:03:17.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/931: dread d3/d5/de/d4a/dbd/f114 [0,4194304] 0 2024-09-19T09:03:17.980 INFO:tasks.workunit.client.0.smithi049.stdout:1/795: getdents d5/d6/d8/d13/d24/d9f/dc7/dff 0 2024-09-19T09:03:17.983 INFO:tasks.workunit.client.0.smithi049.stdout:5/932: rename d3/d5/de/f23 to d3/d5/d1c/db4/d128/f12f 0 2024-09-19T09:03:17.985 INFO:tasks.workunit.client.0.smithi049.stdout:6/858: creat dc/d1b/d20/d2f/db4/d109/f114 x:0 0 0 2024-09-19T09:03:17.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/796: dwrite d5/d6/d19/d30/d64/fba [0,4194304] 0 2024-09-19T09:03:17.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/859: mkdir dc/d1b/d20/d2f/d6b/d73/d115 0 2024-09-19T09:03:17.994 INFO:tasks.workunit.client.0.smithi049.stdout:6/860: chown dc/d1b/d20/d2f/d6b/d73/ld9 163597 1 2024-09-19T09:03:17.995 INFO:tasks.workunit.client.0.smithi049.stdout:1/797: dwrite d5/d6/d19/fcf [0,4194304] 0 2024-09-19T09:03:18.005 INFO:tasks.workunit.client.0.smithi049.stdout:1/798: mkdir d5/d6/d8/d13/d24/d9f/ded/d109 0 2024-09-19T09:03:18.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/799: read d5/d6/d19/d21/f46 [3568020,26813] 0 2024-09-19T09:03:18.011 INFO:tasks.workunit.client.0.smithi049.stdout:5/933: dread d3/d5/de/f44 [0,4194304] 0 2024-09-19T09:03:18.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/934: creat d3/d5/de/d12/d97/dee/f130 x:0 0 0 2024-09-19T09:03:18.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/861: write dc/d1b/d20/d81/d5a/f9f [748931,64917] 0 2024-09-19T09:03:18.017 INFO:tasks.workunit.client.0.smithi049.stdout:1/800: rename d5/d6/d19/d21/d52/c108 to d5/d6/d8/d13/d24/c10a 0 2024-09-19T09:03:18.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/935: dwrite d3/f41 [0,4194304] 0 2024-09-19T09:03:18.026 INFO:tasks.workunit.client.0.smithi049.stdout:1/801: unlink d5/f26 0 2024-09-19T09:03:18.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/936: rename d3/d5/c75 to d3/d5/d1c/db4/c131 0 2024-09-19T09:03:18.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/862: unlink dc/d1b/d20/l40 0 2024-09-19T09:03:18.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/863: write dc/d1b/d20/d81/d5a/dae/ff6 [787684,23371] 0 2024-09-19T09:03:18.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/864: creat dc/d1b/d20/d2f/da6/f116 x:0 0 0 2024-09-19T09:03:18.041 INFO:tasks.workunit.client.0.smithi049.stdout:6/865: stat dc/d1b/d6f/fda 0 2024-09-19T09:03:18.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/937: dread d3/dc/d43/f5b [0,4194304] 0 2024-09-19T09:03:18.045 INFO:tasks.workunit.client.0.smithi049.stdout:5/938: write d3/d5/d20/d38/d5a/d8b/def/d6d/fd7 [1420147,31326] 0 2024-09-19T09:03:18.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/802: write d5/d6/d19/d21/d52/f7d [202073,4233] 0 2024-09-19T09:03:18.054 INFO:tasks.workunit.client.0.smithi049.stdout:1/803: write d5/d6/d8/f5d [1157972,3495] 0 2024-09-19T09:03:18.055 INFO:tasks.workunit.client.0.smithi049.stdout:5/939: link d3/d5/de/d4a/dbd/f114 d3/d5/d20/d38/d5a/d8b/def/f132 0 2024-09-19T09:03:18.058 INFO:tasks.workunit.client.0.smithi049.stdout:1/804: symlink d5/d6/d82/dde/l10b 0 2024-09-19T09:03:18.060 INFO:tasks.workunit.client.0.smithi049.stdout:5/940: creat d3/d5/de/d12/d7d/d88/f133 x:0 0 0 2024-09-19T09:03:18.061 INFO:tasks.workunit.client.0.smithi049.stdout:5/941: fdatasync d3/d5/d1c/d4c/f11c 0 2024-09-19T09:03:18.062 INFO:tasks.workunit.client.0.smithi049.stdout:1/805: mkdir d5/d6/d8/dbe/d10c 0 2024-09-19T09:03:18.064 INFO:tasks.workunit.client.0.smithi049.stdout:6/866: write dc/d16/f4a [959676,100069] 0 2024-09-19T09:03:18.066 INFO:tasks.workunit.client.0.smithi049.stdout:1/806: creat d5/d6/db4/f10d x:0 0 0 2024-09-19T09:03:18.068 INFO:tasks.workunit.client.0.smithi049.stdout:5/942: dread d3/d5/de/d12/d45/d7a/ff7 [0,4194304] 0 2024-09-19T09:03:18.071 INFO:tasks.workunit.client.0.smithi049.stdout:6/867: link dc/d1b/d20/fad dc/d1b/d20/d2f/da6/f117 0 2024-09-19T09:03:18.072 INFO:tasks.workunit.client.0.smithi049.stdout:1/807: mknod d5/d6/d19/d21/deb/c10e 0 2024-09-19T09:03:18.073 INFO:tasks.workunit.client.0.smithi049.stdout:1/808: chown d5/d6/d8/l3c 30 1 2024-09-19T09:03:18.076 INFO:tasks.workunit.client.0.smithi049.stdout:1/809: creat d5/d6/d8/d13/d24/d7e/d7f/f10f x:0 0 0 2024-09-19T09:03:18.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/868: link dc/d16/ff9 dc/d1b/d20/d2f/d6b/f118 0 2024-09-19T09:03:18.079 INFO:tasks.workunit.client.0.smithi049.stdout:6/869: dread - dc/d1b/d20/d2f/d4c/fb9 zero size 2024-09-19T09:03:18.081 INFO:tasks.workunit.client.0.smithi049.stdout:1/810: dread d5/d6/d8/d13/d24/d7e/d7f/fd3 [0,4194304] 0 2024-09-19T09:03:18.083 INFO:tasks.workunit.client.0.smithi049.stdout:6/870: creat dc/d1b/d78/f119 x:0 0 0 2024-09-19T09:03:18.083 INFO:tasks.workunit.client.0.smithi049.stdout:6/871: chown c1 184139672 1 2024-09-19T09:03:18.085 INFO:tasks.workunit.client.0.smithi049.stdout:1/811: mkdir d5/d6/d8/d13/d24/d9f/ded/d110 0 2024-09-19T09:03:18.089 INFO:tasks.workunit.client.0.smithi049.stdout:1/812: creat d5/d6/d8/d1a/f111 x:0 0 0 2024-09-19T09:03:18.089 INFO:tasks.workunit.client.0.smithi049.stdout:5/943: write d3/dc/fca [922621,71683] 0 2024-09-19T09:03:18.091 INFO:tasks.workunit.client.0.smithi049.stdout:1/813: readlink d5/d6/d19/d21/d52/lc3 0 2024-09-19T09:03:18.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/872: getdents dc/d1b/d20/d2f/da6 0 2024-09-19T09:03:18.096 INFO:tasks.workunit.client.0.smithi049.stdout:6/873: dread - dc/d1b/d20/d2f/da6/f116 zero size 2024-09-19T09:03:18.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/944: symlink d3/d5/d20/d38/d5a/d8b/def/d6d/l134 0 2024-09-19T09:03:18.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/945: mkdir d3/d5/d20/d38/d5a/d8b/d135 0 2024-09-19T09:03:18.110 INFO:tasks.workunit.client.0.smithi049.stdout:5/946: chown d3/d5/de/d4a/dbd/fdc 882245 1 2024-09-19T09:03:18.110 INFO:tasks.workunit.client.0.smithi049.stdout:1/814: getdents d5/d6/d8/d1a 0 2024-09-19T09:03:18.111 INFO:tasks.workunit.client.0.smithi049.stdout:5/947: write d3/d5/d20/d38/f46 [2294804,53675] 0 2024-09-19T09:03:18.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/815: rmdir d5/d6/d8/d13/d24/d3b 39 2024-09-19T09:03:18.115 INFO:tasks.workunit.client.0.smithi049.stdout:6/874: truncate dc/d1b/d20/d2f/d6b/d73/f82 3364200 0 2024-09-19T09:03:18.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/816: chown d5/d6/d19/d21/d52/da6/da7/dbc/fca 2672 1 2024-09-19T09:03:18.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/817: fdatasync d5/d6/d19/d30/d63/f102 0 2024-09-19T09:03:18.117 INFO:tasks.workunit.client.0.smithi049.stdout:1/818: stat d5/d6/f5b 0 2024-09-19T09:03:18.118 INFO:tasks.workunit.client.0.smithi049.stdout:5/948: rmdir d3/d5/d1c/dd2/dbf/dcd 39 2024-09-19T09:03:18.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/875: mknod dc/d1b/d20/d7f/c11a 0 2024-09-19T09:03:18.132 INFO:tasks.workunit.client.0.smithi049.stdout:1/819: write d5/d6/d8/d13/f22 [1333479,86461] 0 2024-09-19T09:03:18.135 INFO:tasks.workunit.client.0.smithi049.stdout:5/949: dwrite d3/d5/d1c/dd2/dbf/fc0 [0,4194304] 0 2024-09-19T09:03:18.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/820: write d5/d6/d19/d21/d52/da6/fd9 [1918732,101663] 0 2024-09-19T09:03:18.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/876: dwrite dc/d1b/d20/d2f/d4c/dc4/fd8 [8388608,4194304] 0 2024-09-19T09:03:18.141 INFO:tasks.workunit.client.0.smithi049.stdout:5/950: write d3/d5/d20/d38/d5a/d8b/def/d6d/fd7 [1661873,22070] 0 2024-09-19T09:03:18.141 INFO:tasks.workunit.client.0.smithi049.stdout:1/821: chown d5/d6/d73/da0/lb5 14 1 2024-09-19T09:03:18.144 INFO:tasks.workunit.client.0.smithi049.stdout:1/822: stat d5/d6/d82/dde/l10b 0 2024-09-19T09:03:18.149 INFO:tasks.workunit.client.0.smithi049.stdout:6/877: unlink dc/d1b/d78/lff 0 2024-09-19T09:03:18.150 INFO:tasks.workunit.client.0.smithi049.stdout:6/878: stat dc/d1b/l3c 0 2024-09-19T09:03:18.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/823: chown d5/d6/d8/d13/c4b 62 1 2024-09-19T09:03:18.155 INFO:tasks.workunit.client.0.smithi049.stdout:1/824: dread d5/d6/d8/fb7 [0,4194304] 0 2024-09-19T09:03:18.160 INFO:tasks.workunit.client.0.smithi049.stdout:1/825: dread d5/d6/d19/d21/d52/da6/da7/dbc/fe1 [0,4194304] 0 2024-09-19T09:03:18.165 INFO:tasks.workunit.client.0.smithi049.stdout:5/951: truncate d3/d5/d1c/d2d/f2f 1099017 0 2024-09-19T09:03:18.165 INFO:tasks.workunit.client.0.smithi049.stdout:5/952: write d3/dc/faf [2488341,102597] 0 2024-09-19T09:03:18.165 INFO:tasks.workunit.client.0.smithi049.stdout:5/953: chown d3/d5/d20/d57/d90/dbc/c101 506 1 2024-09-19T09:03:18.168 INFO:tasks.workunit.client.0.smithi049.stdout:5/954: mkdir d3/d5/d20/d57/d136 0 2024-09-19T09:03:18.170 INFO:tasks.workunit.client.0.smithi049.stdout:1/826: creat d5/d6/d8/d13/d24/f112 x:0 0 0 2024-09-19T09:03:18.171 INFO:tasks.workunit.client.0.smithi049.stdout:6/879: dwrite dc/d1b/d20/d2f/f5c [0,4194304] 0 2024-09-19T09:03:18.179 INFO:tasks.workunit.client.0.smithi049.stdout:6/880: rename dc/d1b/fcc to dc/d1b/d20/d81/d80/dab/f11b 0 2024-09-19T09:03:18.184 INFO:tasks.workunit.client.0.smithi049.stdout:6/881: fsync dc/d1b/d78/ddd/f8e 0 2024-09-19T09:03:18.184 INFO:tasks.workunit.client.0.smithi049.stdout:5/955: link d3/d5/d20/d38/d9c/c9e d3/d5/de/d12/c137 0 2024-09-19T09:03:18.187 INFO:tasks.workunit.client.0.smithi049.stdout:5/956: write d3/d5/d1c/d4c/d63/fc9 [621532,79872] 0 2024-09-19T09:03:18.188 INFO:tasks.workunit.client.0.smithi049.stdout:5/957: stat d3/d5/de/d12/f6f 0 2024-09-19T09:03:18.189 INFO:tasks.workunit.client.0.smithi049.stdout:6/882: rename dc/d1b/l56 to dc/d1b/d78/l11c 0 2024-09-19T09:03:18.193 INFO:tasks.workunit.client.0.smithi049.stdout:1/827: dread d5/fc6 [0,4194304] 0 2024-09-19T09:03:18.196 INFO:tasks.workunit.client.0.smithi049.stdout:6/883: symlink dc/d1b/d20/d2f/da6/l11d 0 2024-09-19T09:03:18.199 INFO:tasks.workunit.client.0.smithi049.stdout:1/828: rmdir d5/d6/d8/d13 39 2024-09-19T09:03:18.200 INFO:tasks.workunit.client.0.smithi049.stdout:5/958: creat d3/d5/d20/d38/d5a/d8b/def/f138 x:0 0 0 2024-09-19T09:03:18.208 INFO:tasks.workunit.client.0.smithi049.stdout:5/959: dwrite d3/d5/d1c/dd2/dbf/ff3 [0,4194304] 0 2024-09-19T09:03:18.213 INFO:tasks.workunit.client.0.smithi049.stdout:1/829: unlink d5/d6/d19/d21/d52/l51 0 2024-09-19T09:03:18.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/960: stat d3/d5/de/d12/c137 0 2024-09-19T09:03:18.215 INFO:tasks.workunit.client.0.smithi049.stdout:6/884: dwrite dc/d1b/d20/d81/d5a/f64 [0,4194304] 0 2024-09-19T09:03:18.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/830: dread - d5/d6/d8/d13/d24/d7e/d7f/f10f zero size 2024-09-19T09:03:18.224 INFO:tasks.workunit.client.0.smithi049.stdout:5/961: creat d3/d5/d1c/d4c/d116/f139 x:0 0 0 2024-09-19T09:03:18.226 INFO:tasks.workunit.client.0.smithi049.stdout:1/831: unlink d5/d6/d82/dde/l10b 0 2024-09-19T09:03:18.231 INFO:tasks.workunit.client.0.smithi049.stdout:5/962: rename d3/d5/d1c/fd5 to d3/d5/d1c/d4c/d7c/f13a 0 2024-09-19T09:03:18.233 INFO:tasks.workunit.client.0.smithi049.stdout:6/885: link dc/d1b/d78/cbe dc/d1b/d20/d2f/d6b/d73/c11e 0 2024-09-19T09:03:18.234 INFO:tasks.workunit.client.0.smithi049.stdout:6/886: fsync dc/d1b/d20/d81/d5a/f9f 0 2024-09-19T09:03:18.238 INFO:tasks.workunit.client.0.smithi049.stdout:5/963: mknod d3/d5/d20/d57/d72/c13b 0 2024-09-19T09:03:18.244 INFO:tasks.workunit.client.0.smithi049.stdout:1/832: creat d5/d6/f113 x:0 0 0 2024-09-19T09:03:18.245 INFO:tasks.workunit.client.0.smithi049.stdout:5/964: mknod d3/d5/d1c/d4c/da0/c13c 0 2024-09-19T09:03:18.247 INFO:tasks.workunit.client.0.smithi049.stdout:6/887: mknod dc/d1b/d20/c11f 0 2024-09-19T09:03:18.251 INFO:tasks.workunit.client.0.smithi049.stdout:1/833: mkdir d5/d6/d19/d21/d52/d94/d114 0 2024-09-19T09:03:18.254 INFO:tasks.workunit.client.0.smithi049.stdout:1/834: dread - d5/d6/d19/d30/fe8 zero size 2024-09-19T09:03:18.254 INFO:tasks.workunit.client.0.smithi049.stdout:5/965: write d3/d5/d1c/d4c/d7c/f13a [1357695,50867] 0 2024-09-19T09:03:18.255 INFO:tasks.workunit.client.0.smithi049.stdout:6/888: dwrite dc/d1b/d78/f119 [0,4194304] 0 2024-09-19T09:03:18.264 INFO:tasks.workunit.client.0.smithi049.stdout:6/889: symlink dc/d1b/d78/l120 0 2024-09-19T09:03:18.268 INFO:tasks.workunit.client.0.smithi049.stdout:5/966: rename d3/d5/de/d12/d45/d8d to d3/d5/de/d12/d45/d7a/d13d 0 2024-09-19T09:03:18.276 INFO:tasks.workunit.client.0.smithi049.stdout:1/835: chown d5/d6/d8/d13/d24/d3b/fc9 0 1 2024-09-19T09:03:18.277 INFO:tasks.workunit.client.0.smithi049.stdout:5/967: dwrite d3/d5/d20/d38/d5a/d8b/def/f85 [0,4194304] 0 2024-09-19T09:03:18.284 INFO:tasks.workunit.client.0.smithi049.stdout:6/890: dread dc/ff [0,4194304] 0 2024-09-19T09:03:18.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/836: chown d5/d6/d8/d13/db0 1572461 1 2024-09-19T09:03:18.286 INFO:tasks.workunit.client.0.smithi049.stdout:5/968: truncate d3/fda 456205 0 2024-09-19T09:03:18.291 INFO:tasks.workunit.client.0.smithi049.stdout:1/837: creat d5/d6/d8/d13/d24/d7e/d7f/df1/f115 x:0 0 0 2024-09-19T09:03:18.294 INFO:tasks.workunit.client.0.smithi049.stdout:5/969: mkdir d3/d5/de/d13e 0 2024-09-19T09:03:18.300 INFO:tasks.workunit.client.0.smithi049.stdout:4/860: sync 2024-09-19T09:03:18.360 INFO:tasks.workunit.client.0.smithi049.stdout:1/838: dwrite d5/d6/f1b [0,4194304] 0 2024-09-19T09:03:18.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/970: mknod d3/dc/dc4/c13f 0 2024-09-19T09:03:18.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/971: fdatasync d3/d5/d20/f76 0 2024-09-19T09:03:18.394 INFO:tasks.workunit.client.0.smithi049.stdout:4/861: fsync d4/d35/f52 0 2024-09-19T09:03:18.398 INFO:tasks.workunit.client.0.smithi049.stdout:5/972: unlink d3/d5/de/d4a/d10a/l122 0 2024-09-19T09:03:18.398 INFO:tasks.workunit.client.0.smithi049.stdout:5/973: readlink d3/l67 0 2024-09-19T09:03:18.403 INFO:tasks.workunit.client.0.smithi049.stdout:4/862: rename d4/d34 to d4/d4c/df7/d103 0 2024-09-19T09:03:18.405 INFO:tasks.workunit.client.0.smithi049.stdout:5/974: dwrite d3/d5/de/f87 [4194304,4194304] 0 2024-09-19T09:03:18.407 INFO:tasks.workunit.client.0.smithi049.stdout:1/839: unlink d5/d6/d73/da0/fb8 0 2024-09-19T09:03:18.414 INFO:tasks.workunit.client.0.smithi049.stdout:5/975: dwrite d3/d5/d1c/dd2/dbf/f10c [0,4194304] 0 2024-09-19T09:03:18.416 INFO:tasks.workunit.client.0.smithi049.stdout:5/976: chown d3/dc/faf 9342960 1 2024-09-19T09:03:18.421 INFO:tasks.workunit.client.0.smithi049.stdout:4/863: dread d4/d4c/f6e [4194304,4194304] 0 2024-09-19T09:03:18.425 INFO:tasks.workunit.client.0.smithi049.stdout:4/864: read d4/d4c/df7/d103/d3d/d62/fa8 [218236,80355] 0 2024-09-19T09:03:18.427 INFO:tasks.workunit.client.0.smithi049.stdout:1/840: write d5/d6/d19/f42 [848488,35198] 0 2024-09-19T09:03:18.428 INFO:tasks.workunit.client.0.smithi049.stdout:4/865: creat d4/d4c/df7/d103/f104 x:0 0 0 2024-09-19T09:03:18.429 INFO:tasks.workunit.client.0.smithi049.stdout:4/866: dread - d4/d4c/df7/d103/f104 zero size 2024-09-19T09:03:18.431 INFO:tasks.workunit.client.0.smithi049.stdout:1/841: symlink d5/d6/d8/d13/d24/d7e/d7f/df1/l116 0 2024-09-19T09:03:18.432 INFO:tasks.workunit.client.0.smithi049.stdout:4/867: chown d4/d4c/df7/d103/c54 328 1 2024-09-19T09:03:18.433 INFO:tasks.workunit.client.0.smithi049.stdout:1/842: mknod d5/d6/db4/c117 0 2024-09-19T09:03:18.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/843: unlink d5/d6/d8/d13/d24/d7e/d7f/df1/f115 0 2024-09-19T09:03:18.441 INFO:tasks.workunit.client.0.smithi049.stdout:5/977: truncate d3/d5/f1b 2159803 0 2024-09-19T09:03:18.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/978: fsync d3/f10 0 2024-09-19T09:03:18.447 INFO:tasks.workunit.client.0.smithi049.stdout:4/868: write d4/f69 [2927717,106507] 0 2024-09-19T09:03:18.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/869: unlink d4/d15/d19/d1f/d55/cb9 0 2024-09-19T09:03:18.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/844: truncate d5/d6/d19/f42 296036 0 2024-09-19T09:03:18.454 INFO:tasks.workunit.client.0.smithi049.stdout:4/870: chown d4/d4c/df7/d103/d3d/d62/fc5 13911458 1 2024-09-19T09:03:18.455 INFO:tasks.workunit.client.0.smithi049.stdout:4/871: read d4/d45/f6b [288108,37494] 0 2024-09-19T09:03:18.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/845: unlink d5/d6/d8/d13/d24/d96/ld2 0 2024-09-19T09:03:18.462 INFO:tasks.workunit.client.0.smithi049.stdout:4/872: mknod d4/d45/d4a/dc3/db6/db8/c105 0 2024-09-19T09:03:18.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/846: symlink d5/d6/d8/d13/d24/d7e/d7f/l118 0 2024-09-19T09:03:18.464 INFO:tasks.workunit.client.0.smithi049.stdout:1/847: write d5/d6/d8/d13/d24/f112 [9663,19884] 0 2024-09-19T09:03:18.465 INFO:tasks.workunit.client.0.smithi049.stdout:1/848: fsync d5/d6/d19/d30/d63/f102 0 2024-09-19T09:03:18.467 INFO:tasks.workunit.client.0.smithi049.stdout:1/849: dread - d5/d6/d8/d1a/f111 zero size 2024-09-19T09:03:18.471 INFO:tasks.workunit.client.0.smithi049.stdout:1/850: write d5/d6/d8/d13/f22 [2418341,42409] 0 2024-09-19T09:03:18.472 INFO:tasks.workunit.client.0.smithi049.stdout:5/979: dwrite d3/d5/d1c/d4c/d7c/f123 [0,4194304] 0 2024-09-19T09:03:18.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/873: rename d4/d6c/d7a/dc1/fe2 to d4/d4c/df7/d103/d3d/f106 0 2024-09-19T09:03:18.477 INFO:tasks.workunit.client.0.smithi049.stdout:5/980: creat d3/d5/d20/d57/d72/f140 x:0 0 0 2024-09-19T09:03:18.481 INFO:tasks.workunit.client.0.smithi049.stdout:4/874: creat d4/d35/f107 x:0 0 0 2024-09-19T09:03:18.481 INFO:tasks.workunit.client.0.smithi049.stdout:4/875: readlink d4/la4 0 2024-09-19T09:03:18.482 INFO:tasks.workunit.client.0.smithi049.stdout:1/851: mknod d5/d6/d8/d13/d24/c119 0 2024-09-19T09:03:18.483 INFO:tasks.workunit.client.0.smithi049.stdout:1/852: rename d5/d6/d19 to d5/d6/d19/d21/d52/da6/d11a 22 2024-09-19T09:03:18.484 INFO:tasks.workunit.client.0.smithi049.stdout:4/876: chown d4/d15/c87 7835 1 2024-09-19T09:03:18.487 INFO:tasks.workunit.client.0.smithi049.stdout:1/853: mknod d5/d6/d19/d30/c11b 0 2024-09-19T09:03:18.488 INFO:tasks.workunit.client.0.smithi049.stdout:1/854: readlink d5/d6/d8/d13/d24/d7e/l9e 0 2024-09-19T09:03:18.491 INFO:tasks.workunit.client.0.smithi049.stdout:5/981: getdents d3 0 2024-09-19T09:03:18.494 INFO:tasks.workunit.client.0.smithi049.stdout:1/855: link d5/d6/d8/d13/d24/d7e/d7f/f10f d5/d6/d19/d107/f11c 0 2024-09-19T09:03:18.495 INFO:tasks.workunit.client.0.smithi049.stdout:1/856: chown d5/d6/d8/d13/d24/d3b 0 1 2024-09-19T09:03:18.495 INFO:tasks.workunit.client.0.smithi049.stdout:5/982: mknod d3/dc/d43/c141 0 2024-09-19T09:03:18.495 INFO:tasks.workunit.client.0.smithi049.stdout:4/877: dwrite d4/d45/f6b [0,4194304] 0 2024-09-19T09:03:18.498 INFO:tasks.workunit.client.0.smithi049.stdout:5/983: unlink d3/d5/cba 0 2024-09-19T09:03:18.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/857: symlink d5/d6/d19/d21/deb/l11d 0 2024-09-19T09:03:18.500 INFO:tasks.workunit.client.0.smithi049.stdout:4/878: write d4/d15/d19/d1f/d55/f97 [442030,125993] 0 2024-09-19T09:03:18.503 INFO:tasks.workunit.client.0.smithi049.stdout:1/858: unlink d5/d6/d19/d21/d52/lc3 0 2024-09-19T09:03:18.510 INFO:tasks.workunit.client.0.smithi049.stdout:1/859: rename d5/d6/d19/d21/d52/db6 to d5/d6/d8/d13/d24/d9f/ded/d110/d11e 0 2024-09-19T09:03:18.511 INFO:tasks.workunit.client.0.smithi049.stdout:5/984: getdents d3/d5/d1c/dd2/dbf 0 2024-09-19T09:03:18.512 INFO:tasks.workunit.client.0.smithi049.stdout:5/985: stat d3/dc/c3d 0 2024-09-19T09:03:18.514 INFO:tasks.workunit.client.0.smithi049.stdout:1/860: unlink d5/d6/d19/d30/faf 0 2024-09-19T09:03:18.515 INFO:tasks.workunit.client.0.smithi049.stdout:5/986: dread d3/d5/d20/d38/d5a/d8b/def/f47 [0,4194304] 0 2024-09-19T09:03:18.517 INFO:tasks.workunit.client.0.smithi049.stdout:1/861: mkdir d5/d6/d19/d21/d52/d94/dea/d11f 0 2024-09-19T09:03:18.518 INFO:tasks.workunit.client.0.smithi049.stdout:1/862: fdatasync d5/d6/d8/d13/d24/dbb/fc0 0 2024-09-19T09:03:18.518 INFO:tasks.workunit.client.0.smithi049.stdout:5/987: readlink d3/d5/de/d4a/l102 0 2024-09-19T09:03:18.524 INFO:tasks.workunit.client.0.smithi049.stdout:5/988: rename d3/d5/de/d12/d7d/f110 to d3/d5/d1c/db4/f142 0 2024-09-19T09:03:18.525 INFO:tasks.workunit.client.0.smithi049.stdout:1/863: dwrite d5/d6/f7 [0,4194304] 0 2024-09-19T09:03:18.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/879: write d4/d15/d19/d1f/daa/dbd/dc6/fb1 [1551644,62566] 0 2024-09-19T09:03:18.530 INFO:tasks.workunit.client.0.smithi049.stdout:5/989: rename d3/dc/dc4/f11d to d3/d5/d1c/db4/f143 0 2024-09-19T09:03:18.534 INFO:tasks.workunit.client.0.smithi049.stdout:1/864: mkdir d5/d6/d8/d13/d24/d9f/ded/d110/d11e/dd0/d120 0 2024-09-19T09:03:18.538 INFO:tasks.workunit.client.0.smithi049.stdout:5/990: creat d3/d5/d1c/dd2/f144 x:0 0 0 2024-09-19T09:03:18.538 INFO:tasks.workunit.client.0.smithi049.stdout:1/865: dread d5/d6/f10 [4194304,4194304] 0 2024-09-19T09:03:18.542 INFO:tasks.workunit.client.0.smithi049.stdout:1/866: dread d5/d6/d8/d13/d24/d7e/fa3 [0,4194304] 0 2024-09-19T09:03:18.543 INFO:tasks.workunit.client.0.smithi049.stdout:5/991: truncate d3/dc/f42 1057292 0 2024-09-19T09:03:18.546 INFO:tasks.workunit.client.0.smithi049.stdout:4/880: link d4/d15/d19/d1f/daa/dbd/c8f d4/d4c/df7/d103/d3d/d4f/c108 0 2024-09-19T09:03:18.546 INFO:tasks.workunit.client.0.smithi049.stdout:4/881: chown d4/d4c/df7/d103/d3d/d4f/d70/cea 1183967 1 2024-09-19T09:03:18.547 INFO:tasks.workunit.client.0.smithi049.stdout:1/867: truncate d5/d6/d19/f39 3450666 0 2024-09-19T09:03:18.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/882: chown d4/d4c/df7/d103/df2 139 1 2024-09-19T09:03:18.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/868: chown d5/d6/d19/d21/d52/d94 19220 1 2024-09-19T09:03:18.551 INFO:tasks.workunit.client.0.smithi049.stdout:5/992: rename d3/c127 to d3/d5/d20/d38/d5a/d8b/def/d6d/de4/d10d/c145 0 2024-09-19T09:03:18.553 INFO:tasks.workunit.client.0.smithi049.stdout:4/883: dwrite d4/d15/f7c [0,4194304] 0 2024-09-19T09:03:18.554 INFO:tasks.workunit.client.0.smithi049.stdout:1/869: readlink d5/d6/d8/d13/lec 0 2024-09-19T09:03:18.558 INFO:tasks.workunit.client.0.smithi049.stdout:4/884: mknod d4/d15/d19/d1f/daa/dbd/dc6/c109 0 2024-09-19T09:03:18.563 INFO:tasks.workunit.client.0.smithi049.stdout:4/885: creat d4/d15/d19/d1f/daa/f10a x:0 0 0 2024-09-19T09:03:18.564 INFO:tasks.workunit.client.0.smithi049.stdout:4/886: chown d4/d4c/df7/d103 6 1 2024-09-19T09:03:18.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/993: mkdir d3/d5/d20/d38/d5a/d8b/def/d6d/d146 0 2024-09-19T09:03:18.573 INFO:tasks.workunit.client.0.smithi049.stdout:5/994: stat d3/d5/de/l21 0 2024-09-19T09:03:18.576 INFO:tasks.workunit.client.0.smithi049.stdout:1/870: truncate d5/d6/d8/d1a/f3e 2324649 0 2024-09-19T09:03:18.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/887: write d4/d6c/d74/fac [864333,41401] 0 2024-09-19T09:03:18.579 INFO:tasks.workunit.client.0.smithi049.stdout:1/871: creat d5/d6/d73/da0/f121 x:0 0 0 2024-09-19T09:03:18.579 INFO:tasks.workunit.client.0.smithi049.stdout:4/888: fdatasync d4/d15/f83 0 2024-09-19T09:03:18.580 INFO:tasks.workunit.client.0.smithi049.stdout:5/995: mknod d3/d5/d20/d38/d5a/d8b/def/d6d/d146/c147 0 2024-09-19T09:03:18.581 INFO:tasks.workunit.client.0.smithi049.stdout:5/996: dread - d3/d5/d20/d57/d90/dbc/d11e/d124/f12e zero size 2024-09-19T09:03:18.584 INFO:tasks.workunit.client.0.smithi049.stdout:4/889: unlink d4/d15/d19/d1f/d55/f90 0 2024-09-19T09:03:18.590 INFO:tasks.workunit.client.0.smithi049.stdout:4/890: truncate d4/d15/d19/d1f/d55/f78 1706602 0 2024-09-19T09:03:18.593 INFO:tasks.workunit.client.0.smithi049.stdout:5/997: creat d3/f148 x:0 0 0 2024-09-19T09:03:18.600 INFO:tasks.workunit.client.0.smithi049.stdout:4/891: rename d4/f5 to d4/d4c/f10b 0 2024-09-19T09:03:18.601 INFO:tasks.workunit.client.0.smithi049.stdout:1/872: link d5/d6/d8/d1a/f3e d5/d6/d8/d13/db0/f122 0 2024-09-19T09:03:18.602 INFO:tasks.workunit.client.0.smithi049.stdout:5/998: rmdir d3/d5/d1c/db4/d128 39 2024-09-19T09:03:18.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/892: mknod d4/d45/d4a/dc3/db6/c10c 0 2024-09-19T09:03:18.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/873: rename d5/d6/dc/cad to d5/d6/d19/d30/d63/dc8/c123 0 2024-09-19T09:03:18.608 INFO:tasks.workunit.client.0.smithi049.stdout:4/893: chown d4/d6c/da2/f85 34672 1 2024-09-19T09:03:18.609 INFO:tasks.workunit.client.0.smithi049.stdout:1/874: mkdir d5/d6/d19/db3/d124 0 2024-09-19T09:03:18.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/875: read - d5/d6/f113 zero size 2024-09-19T09:03:18.613 INFO:tasks.workunit.client.0.smithi049.stdout:4/894: mknod d4/d15/d19/d1f/daa/dbd/c10d 0 2024-09-19T09:03:18.618 INFO:tasks.workunit.client.0.smithi049.stdout:4/895: creat d4/d4c/df7/d103/f10e x:0 0 0 2024-09-19T09:03:18.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/876: dwrite d5/d6/d8/d1a/d78/f8d [4194304,4194304] 0 2024-09-19T09:03:18.621 INFO:tasks.workunit.client.0.smithi049.stdout:4/896: chown d4/d4c/df7/d103/d3d/f100 16175201 1 2024-09-19T09:03:18.621 INFO:tasks.workunit.client.0.smithi049.stdout:5/999: dread d3/d5/f1f [0,4194304] 0 2024-09-19T09:03:18.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/877: creat d5/d6/d8/d1a/d78/f125 x:0 0 0 2024-09-19T09:03:18.624 INFO:tasks.workunit.client.0.smithi049.stdout:1/878: fsync d5/d6/d19/d30/d63/dc8/f104 0 2024-09-19T09:03:18.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/879: chown d5/d6/d8/d13/db0 166 1 2024-09-19T09:03:18.629 INFO:tasks.workunit.client.0.smithi049.stdout:1/880: mkdir d5/d6/d8/d126 0 2024-09-19T09:03:18.630 INFO:tasks.workunit.client.0.smithi049.stdout:4/897: dwrite d4/d6c/d7a/dc1/fc2 [0,4194304] 0 2024-09-19T09:03:18.634 INFO:tasks.workunit.client.0.smithi049.stdout:4/898: symlink d4/d45/d4a/dc3/l10f 0 2024-09-19T09:03:18.636 INFO:tasks.workunit.client.0.smithi049.stdout:1/881: creat d5/d6/d19/d21/d52/f127 x:0 0 0 2024-09-19T09:03:18.644 INFO:tasks.workunit.client.0.smithi049.stdout:4/899: dwrite d4/d15/d19/d1f/daa/fe1 [0,4194304] 0 2024-09-19T09:03:18.644 INFO:tasks.workunit.client.0.smithi049.stdout:6/891: sync 2024-09-19T09:03:18.645 INFO:tasks.workunit.client.0.smithi049.stdout:6/892: readlink dc/d16/l33 0 2024-09-19T09:03:18.647 INFO:tasks.workunit.client.0.smithi049.stdout:6/893: read dc/d1b/d78/ddd/f8e [2305709,77781] 0 2024-09-19T09:03:18.650 INFO:tasks.workunit.client.0.smithi049.stdout:4/900: dread d4/d15/d19/d1f/daa/dbd/dc6/fb1 [0,4194304] 0 2024-09-19T09:03:18.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/894: mkdir dc/d1b/d20/d81/d5a/dae/ddf/d121 0 2024-09-19T09:03:18.652 INFO:tasks.workunit.client.0.smithi049.stdout:1/882: write d5/d6/f10 [614285,90215] 0 2024-09-19T09:03:18.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/883: unlink d5/d6/db4/cd4 0 2024-09-19T09:03:18.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/884: dread - d5/d6/d19/d21/d52/da6/da7/dbc/f100 zero size 2024-09-19T09:03:18.665 INFO:tasks.workunit.client.0.smithi049.stdout:4/901: rename d4/d4c/df7/d103/da0/fe5 to d4/f110 0 2024-09-19T09:03:18.668 INFO:tasks.workunit.client.0.smithi049.stdout:1/885: creat d5/d6/d8/d13/d24/f128 x:0 0 0 2024-09-19T09:03:18.668 INFO:tasks.workunit.client.0.smithi049.stdout:6/895: dwrite dc/d16/ded/ff7 [0,4194304] 0 2024-09-19T09:03:18.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/902: mkdir d4/d111 0 2024-09-19T09:03:18.672 INFO:tasks.workunit.client.0.smithi049.stdout:1/886: chown d5/d6/d8/d13/f34 2394 1 2024-09-19T09:03:18.673 INFO:tasks.workunit.client.0.smithi049.stdout:1/887: dread - d5/d6/d73/da0/f121 zero size 2024-09-19T09:03:18.675 INFO:tasks.workunit.client.0.smithi049.stdout:6/896: dread dc/d1b/d20/f72 [0,4194304] 0 2024-09-19T09:03:18.679 INFO:tasks.workunit.client.0.smithi049.stdout:1/888: rmdir d5/d6/d8/d13/db0 39 2024-09-19T09:03:18.681 INFO:tasks.workunit.client.0.smithi049.stdout:4/903: write d4/d45/d3f/d47/f81 [2071941,6933] 0 2024-09-19T09:03:18.683 INFO:tasks.workunit.client.0.smithi049.stdout:6/897: symlink dc/d1b/d78/ddd/de6/l122 0 2024-09-19T09:03:18.684 INFO:tasks.workunit.client.0.smithi049.stdout:6/898: write dc/d1b/d20/d81/d5a/dae/ddf/f105 [440509,54298] 0 2024-09-19T09:03:18.686 INFO:tasks.workunit.client.0.smithi049.stdout:1/889: rename d5/d6/d73 to d5/d6/d19/d30/d63/dc8/d129 0 2024-09-19T09:03:18.688 INFO:tasks.workunit.client.0.smithi049.stdout:1/890: dread - d5/d6/d8/d13/d24/d3b/fc9 zero size 2024-09-19T09:03:18.690 INFO:tasks.workunit.client.0.smithi049.stdout:1/891: write d5/d6/d8/d13/d24/dbb/fc0 [3458167,62545] 0 2024-09-19T09:03:18.698 INFO:tasks.workunit.client.0.smithi049.stdout:4/904: fdatasync d4/f110 0 2024-09-19T09:03:18.700 INFO:tasks.workunit.client.0.smithi049.stdout:4/905: read d4/d4c/df7/d103/f46 [716574,103025] 0 2024-09-19T09:03:18.700 INFO:tasks.workunit.client.0.smithi049.stdout:1/892: mknod d5/d6/d8/d13/d24/d9f/ded/d110/d11e/dd0/c12a 0 2024-09-19T09:03:18.704 INFO:tasks.workunit.client.0.smithi049.stdout:6/899: write dc/d1b/d20/d2f/d4c/fc3 [5086456,116029] 0 2024-09-19T09:03:18.706 INFO:tasks.workunit.client.0.smithi049.stdout:6/900: truncate dc/d1b/d78/ddd/de6/fea 4944457 0 2024-09-19T09:03:18.711 INFO:tasks.workunit.client.0.smithi049.stdout:4/906: creat d4/d45/d3f/d47/f112 x:0 0 0 2024-09-19T09:03:18.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/893: creat d5/d6/d8/d13/d24/f12b x:0 0 0 2024-09-19T09:03:18.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/907: mknod d4/d45/d4a/dc3/dc9/c113 0 2024-09-19T09:03:18.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/908: chown d4/d45/d4a/dc3 315 1 2024-09-19T09:03:18.719 INFO:tasks.workunit.client.0.smithi049.stdout:1/894: link d5/fc6 d5/d6/d8/d1a/f12c 0 2024-09-19T09:03:18.726 INFO:tasks.workunit.client.0.smithi049.stdout:6/901: dwrite dc/d1b/d20/d81/f29 [0,4194304] 0 2024-09-19T09:03:18.727 INFO:tasks.workunit.client.0.smithi049.stdout:1/895: dwrite d5/d6/d19/d21/d52/da6/da7/dbc/f100 [0,4194304] 0 2024-09-19T09:03:18.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/896: creat d5/d6/d19/d30/f12d x:0 0 0 2024-09-19T09:03:18.738 INFO:tasks.workunit.client.0.smithi049.stdout:1/897: mkdir d5/d6/dc/d12e 0 2024-09-19T09:03:18.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/902: creat dc/d1b/d20/d2f/f123 x:0 0 0 2024-09-19T09:03:18.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/903: creat dc/d1b/d20/d2f/db4/f124 x:0 0 0 2024-09-19T09:03:18.746 INFO:tasks.workunit.client.0.smithi049.stdout:4/909: write d4/d6c/da2/f85 [2245276,66489] 0 2024-09-19T09:03:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:4/910: mknod d4/d4c/c114 0 2024-09-19T09:03:18.749 INFO:tasks.workunit.client.0.smithi049.stdout:1/898: dwrite d5/d6/d8/d13/d24/d7e/d7f/fd3 [0,4194304] 0 2024-09-19T09:03:18.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/911: readlink d4/d15/lc4 0 2024-09-19T09:03:18.754 INFO:tasks.workunit.client.0.smithi049.stdout:1/899: symlink d5/d6/d8/d13/d24/d9f/ded/d110/d11e/dd0/l12f 0 2024-09-19T09:03:18.756 INFO:tasks.workunit.client.0.smithi049.stdout:1/900: write d5/d6/d8/d13/d24/dbb/fc0 [1899448,97882] 0 2024-09-19T09:03:18.771 INFO:tasks.workunit.client.0.smithi049.stdout:4/912: dread d4/d4c/f8a [0,4194304] 0 2024-09-19T09:03:18.777 INFO:tasks.workunit.client.0.smithi049.stdout:4/913: write d4/d4c/df7/d103/d3d/d4f/d70/fc8 [3601042,3389] 0 2024-09-19T09:03:18.782 INFO:tasks.workunit.client.0.smithi049.stdout:4/914: dwrite d4/d15/f20 [0,4194304] 0 2024-09-19T09:03:18.784 INFO:tasks.workunit.client.0.smithi049.stdout:4/915: chown d4/d6c/d7a/dc1/lf3 384023 1 2024-09-19T09:03:18.800 INFO:tasks.workunit.client.0.smithi049.stdout:6/904: write dc/d1b/d20/d81/d80/fb1 [907006,92052] 0 2024-09-19T09:03:18.828 INFO:tasks.workunit.client.0.smithi049.stdout:1/901: write d5/d6/d8/d13/d24/d3b/fc9 [28948,118439] 0 2024-09-19T09:03:18.829 INFO:tasks.workunit.client.0.smithi049.stdout:1/902: stat d5/d6/d19/d30/d63/dc8/d129/da8 0 2024-09-19T09:03:18.831 INFO:tasks.workunit.client.0.smithi049.stdout:4/916: truncate d4/d15/f61 2525005 0 2024-09-19T09:03:18.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/917: chown d4/d6c/d7a/le6 1072944169 1 2024-09-19T09:03:18.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/918: read d4/d45/d4a/f4e [212823,20248] 0 2024-09-19T09:03:18.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/903: dwrite d5/d6/d19/d21/d52/f7d [0,4194304] 0 2024-09-19T09:03:18.840 INFO:tasks.workunit.client.0.smithi049.stdout:4/919: symlink d4/d4c/df7/d103/d3d/d4f/l115 0 2024-09-19T09:03:18.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/905: dwrite dc/d1b/d20/d81/f43 [0,4194304] 0 2024-09-19T09:03:18.849 INFO:tasks.workunit.client.0.smithi049.stdout:1/904: mknod d5/d6/d19/d30/d64/d71/c130 0 2024-09-19T09:03:18.850 INFO:tasks.workunit.client.0.smithi049.stdout:1/905: dread - d5/d6/d19/d30/d63/f102 zero size 2024-09-19T09:03:18.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/906: stat d5/d6/d19/fd8 0 2024-09-19T09:03:18.851 INFO:tasks.workunit.client.0.smithi049.stdout:6/906: creat dc/d1b/d6f/f125 x:0 0 0 2024-09-19T09:03:18.854 INFO:tasks.workunit.client.0.smithi049.stdout:4/920: creat d4/d45/d3f/d47/f116 x:0 0 0 2024-09-19T09:03:18.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/907: mkdir d5/d6/d82/dde/d131 0 2024-09-19T09:03:18.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/908: chown d5/d6/fa 1177277103 1 2024-09-19T09:03:18.858 INFO:tasks.workunit.client.0.smithi049.stdout:6/907: mkdir dc/d1b/d20/d81/d5a/dae/ddf/de4/d126 0 2024-09-19T09:03:18.861 INFO:tasks.workunit.client.0.smithi049.stdout:1/909: rename d5/d6/f5b to d5/d6/d19/d30/d63/f132 0 2024-09-19T09:03:18.866 INFO:tasks.workunit.client.0.smithi049.stdout:4/921: write d4/d45/d3f/d47/fa6 [1916635,69124] 0 2024-09-19T09:03:18.868 INFO:tasks.workunit.client.0.smithi049.stdout:1/910: creat d5/d6/d19/d21/d52/d94/d114/f133 x:0 0 0 2024-09-19T09:03:18.869 INFO:tasks.workunit.client.0.smithi049.stdout:6/908: creat dc/d1b/d20/f127 x:0 0 0 2024-09-19T09:03:18.871 INFO:tasks.workunit.client.0.smithi049.stdout:6/909: stat dc/d1b/d20/d81/d5a/dae/ff6 0 2024-09-19T09:03:18.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/910: read dc/d1b/d20/d2f/d31/f65 [2851998,15078] 0 2024-09-19T09:03:18.877 INFO:tasks.workunit.client.0.smithi049.stdout:1/911: mknod d5/d6/d8/d13/c134 0 2024-09-19T09:03:18.879 INFO:tasks.workunit.client.0.smithi049.stdout:6/911: rmdir dc/d1b/d20/d2f/d4c 39 2024-09-19T09:03:18.883 INFO:tasks.workunit.client.0.smithi049.stdout:6/912: creat dc/d1b/d20/d81/d80/f128 x:0 0 0 2024-09-19T09:03:18.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/913: chown dc/d1b/d78 4 1 2024-09-19T09:03:18.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/912: creat d5/d6/d8/d13/db0/dd1/f135 x:0 0 0 2024-09-19T09:03:18.892 INFO:tasks.workunit.client.0.smithi049.stdout:4/922: dwrite d4/d15/f59 [0,4194304] 0 2024-09-19T09:03:18.895 INFO:tasks.workunit.client.0.smithi049.stdout:6/914: dwrite dc/d1b/d20/d81/d80/dab/f11b [4194304,4194304] 0 2024-09-19T09:03:18.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/913: link d5/fc6 d5/d6/d19/d30/f136 0 2024-09-19T09:03:18.896 INFO:tasks.workunit.client.0.smithi049.stdout:4/923: truncate d4/d4c/dcb/fef 1213258 0 2024-09-19T09:03:18.898 INFO:tasks.workunit.client.0.smithi049.stdout:1/914: write d5/d6/d8/d13/d24/f112 [278855,107372] 0 2024-09-19T09:03:18.898 INFO:tasks.workunit.client.0.smithi049.stdout:4/924: fdatasync d4/d4c/df7/d103/f10e 0 2024-09-19T09:03:18.901 INFO:tasks.workunit.client.0.smithi049.stdout:6/915: mkdir dc/d16/d129 0 2024-09-19T09:03:18.902 INFO:tasks.workunit.client.0.smithi049.stdout:6/916: readlink dc/d16/la7 0 2024-09-19T09:03:18.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/917: mkdir dc/d1b/d20/d81/d5a/dae/ddf/de4/d12a 0 2024-09-19T09:03:18.909 INFO:tasks.workunit.client.0.smithi049.stdout:1/915: dwrite d5/d6/d8/d13/d24/f12b [0,4194304] 0 2024-09-19T09:03:18.910 INFO:tasks.workunit.client.0.smithi049.stdout:6/918: mknod dc/d1b/d20/d81/d5a/c12b 0 2024-09-19T09:03:18.913 INFO:tasks.workunit.client.0.smithi049.stdout:1/916: creat d5/d6/d19/d30/d64/f137 x:0 0 0 2024-09-19T09:03:18.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/919: mkdir dc/d1b/d78/d12c 0 2024-09-19T09:03:18.921 INFO:tasks.workunit.client.0.smithi049.stdout:1/917: link d5/d6/d19/d30/d63/dc8/d129/da0/f121 d5/d6/d19/d30/d63/dc8/f138 0 2024-09-19T09:03:18.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/920: link dc/d1b/d20/d81/d5a/cd0 dc/d1b/d20/d2f/d6b/c12d 0 2024-09-19T09:03:18.925 INFO:tasks.workunit.client.0.smithi049.stdout:1/918: mkdir d5/d6/d82/dde/d131/d139 0 2024-09-19T09:03:18.927 INFO:tasks.workunit.client.0.smithi049.stdout:1/919: write d5/d6/f1b [4617401,116590] 0 2024-09-19T09:03:18.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/925: write d4/d6c/d7a/dc1/fc2 [4489244,41624] 0 2024-09-19T09:03:18.941 INFO:tasks.workunit.client.0.smithi049.stdout:4/926: dread d4/d15/d19/f2f [0,4194304] 0 2024-09-19T09:03:18.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/927: readlink d4/d45/d3f/d47/l75 0 2024-09-19T09:03:18.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/928: stat d4/d35/f52 0 2024-09-19T09:03:18.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/920: dwrite d5/d6/d8/d13/d24/f2f [0,4194304] 0 2024-09-19T09:03:18.948 INFO:tasks.workunit.client.0.smithi049.stdout:1/921: fdatasync d5/d6/d8/d13/d24/f128 0 2024-09-19T09:03:18.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/929: mknod d4/d45/d3f/d47/d5f/c117 0 2024-09-19T09:03:18.955 INFO:tasks.workunit.client.0.smithi049.stdout:1/922: mkdir d5/d6/d8/d13/d24/d9f/ded/d13a 0 2024-09-19T09:03:18.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/930: link d4/d15/d19/cd7 d4/d45/d3f/d47/d5f/c118 0 2024-09-19T09:03:18.961 INFO:tasks.workunit.client.0.smithi049.stdout:1/923: getdents d5/d6/d19/db3 0 2024-09-19T09:03:18.962 INFO:tasks.workunit.client.0.smithi049.stdout:1/924: write d5/d6/d19/d21/d52/fe6 [58577,7216] 0 2024-09-19T09:03:18.962 INFO:tasks.workunit.client.0.smithi049.stdout:4/931: creat d4/d45/df0/dfa/f119 x:0 0 0 2024-09-19T09:03:18.965 INFO:tasks.workunit.client.0.smithi049.stdout:1/925: creat d5/d6/d19/d21/d52/d94/dea/f13b x:0 0 0 2024-09-19T09:03:18.967 INFO:tasks.workunit.client.0.smithi049.stdout:1/926: readlink d5/d6/d19/d30/l5a 0 2024-09-19T09:03:18.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/927: dread - d5/d6/d19/d30/d64/f137 zero size 2024-09-19T09:03:18.969 INFO:tasks.workunit.client.0.smithi049.stdout:4/932: dwrite d4/d15/d19/d1f/daa/fed [0,4194304] 0 2024-09-19T09:03:18.970 INFO:tasks.workunit.client.0.smithi049.stdout:4/933: fdatasync d4/d35/f107 0 2024-09-19T09:03:18.972 INFO:tasks.workunit.client.0.smithi049.stdout:1/928: mkdir d5/d6/dc/d12e/d13c 0 2024-09-19T09:03:18.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/934: chown d4/d45/d3f/dae/cdc 999605920 1 2024-09-19T09:03:18.974 INFO:tasks.workunit.client.0.smithi049.stdout:1/929: chown d5/d6/d8/d13/d24/d7e/d7f/l118 112 1 2024-09-19T09:03:18.974 INFO:tasks.workunit.client.0.smithi049.stdout:4/935: write d4/d15/f7c [4938339,103387] 0 2024-09-19T09:03:18.982 INFO:tasks.workunit.client.0.smithi049.stdout:1/930: mkdir d5/d6/d8/d1a/d78/d13d 0 2024-09-19T09:03:18.990 INFO:tasks.workunit.client.0.smithi049.stdout:4/936: dread d4/d45/d3f/d47/f81 [0,4194304] 0 2024-09-19T09:03:18.992 INFO:tasks.workunit.client.0.smithi049.stdout:1/931: dwrite d5/d6/d8/d13/d24/f8b [4194304,4194304] 0 2024-09-19T09:03:18.993 INFO:tasks.workunit.client.0.smithi049.stdout:4/937: fsync d4/d4c/df7/d103/d3d/d62/f64 0 2024-09-19T09:03:19.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/932: creat d5/d6/d19/d21/d52/f13e x:0 0 0 2024-09-19T09:03:19.005 INFO:tasks.workunit.client.0.smithi049.stdout:1/933: fsync d5/d6/d19/d30/d63/dc8/d129/fbf 0 2024-09-19T09:03:19.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/934: creat d5/d6/d19/d30/f13f x:0 0 0 2024-09-19T09:03:19.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/935: readlink d5/d6/d19/d30/d63/dc8/d129/da0/lb5 0 2024-09-19T09:03:19.009 INFO:tasks.workunit.client.0.smithi049.stdout:4/938: write d4/d15/d19/d1f/f67 [1296208,41023] 0 2024-09-19T09:03:19.012 INFO:tasks.workunit.client.0.smithi049.stdout:1/936: mknod d5/d6/d8/d13/d24/dbb/c140 0 2024-09-19T09:03:19.015 INFO:tasks.workunit.client.0.smithi049.stdout:4/939: dwrite d4/d15/f20 [0,4194304] 0 2024-09-19T09:03:19.016 INFO:tasks.workunit.client.0.smithi049.stdout:4/940: chown d4/d4c/dcb/fd2 2125 1 2024-09-19T09:03:19.025 INFO:tasks.workunit.client.0.smithi049.stdout:1/937: truncate d5/d6/f10 3492180 0 2024-09-19T09:03:19.032 INFO:tasks.workunit.client.0.smithi049.stdout:1/938: link d5/d6/fa d5/d6/d19/d21/d52/da6/da7/df0/f141 0 2024-09-19T09:03:19.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/941: dwrite d4/d6c/d7a/dc1/fe0 [0,4194304] 0 2024-09-19T09:03:19.054 INFO:tasks.workunit.client.0.smithi049.stdout:4/942: dwrite d4/d6c/d7a/fe8 [0,4194304] 0 2024-09-19T09:03:19.054 INFO:tasks.workunit.client.0.smithi049.stdout:1/939: dread d5/d6/d19/d21/d52/f85 [0,4194304] 0 2024-09-19T09:03:19.055 INFO:tasks.workunit.client.0.smithi049.stdout:1/940: dread - d5/d6/d19/d21/d52/d94/dea/f13b zero size 2024-09-19T09:03:19.057 INFO:tasks.workunit.client.0.smithi049.stdout:1/941: read - d5/d6/d8/d13/d24/d7e/d7f/f10f zero size 2024-09-19T09:03:19.064 INFO:tasks.workunit.client.0.smithi049.stdout:1/942: link d5/d6/d19/db3/cf9 d5/d6/d19/d30/d63/dc8/d129/da8/c142 0 2024-09-19T09:03:19.067 INFO:tasks.workunit.client.0.smithi049.stdout:1/943: creat d5/d6/dc/f143 x:0 0 0 2024-09-19T09:03:19.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/943: dwrite d4/d45/f8e [0,4194304] 0 2024-09-19T09:03:19.076 INFO:tasks.workunit.client.0.smithi049.stdout:4/944: rename d4/d92 to d4/d6c/d7a/d89/d11a 0 2024-09-19T09:03:19.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/945: chown d4/d4c/df7/d103/f104 5 1 2024-09-19T09:03:19.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/944: link d5/d6/d19/f42 d5/d6/d19/d21/deb/f144 0 2024-09-19T09:03:19.082 INFO:tasks.workunit.client.0.smithi049.stdout:1/945: truncate d5/d6/dc/f143 439398 0 2024-09-19T09:03:19.083 INFO:tasks.workunit.client.0.smithi049.stdout:4/946: creat d4/d15/d19/d1f/daa/f11b x:0 0 0 2024-09-19T09:03:19.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/946: truncate d5/d6/d19/d21/d52/d94/ff2 39344 0 2024-09-19T09:03:19.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/947: rmdir d4/d6c/da2 39 2024-09-19T09:03:19.086 INFO:tasks.workunit.client.0.smithi049.stdout:1/947: truncate d5/d6/d8/d1a/f111 675856 0 2024-09-19T09:03:19.088 INFO:tasks.workunit.client.0.smithi049.stdout:1/948: chown d5/d6/d19/d30/d63/dc8/d129/da0/lb5 467864 1 2024-09-19T09:03:19.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/948: rename d4/d4c/df7/d103/d3d/d62/fc5 to d4/d45/d4a/df4/f11c 0 2024-09-19T09:03:19.096 INFO:tasks.workunit.client.0.smithi049.stdout:4/949: creat d4/d45/df0/dfa/f11d x:0 0 0 2024-09-19T09:03:19.097 INFO:tasks.workunit.client.0.smithi049.stdout:1/949: mknod d5/d6/d19/db3/d124/c145 0 2024-09-19T09:03:19.098 INFO:tasks.workunit.client.0.smithi049.stdout:4/950: mknod d4/d35/c11e 0 2024-09-19T09:03:19.101 INFO:tasks.workunit.client.0.smithi049.stdout:1/950: link d5/f54 d5/d6/d8/d13/d24/d9f/ded/d13a/f146 0 2024-09-19T09:03:19.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/951: symlink d5/d6/d19/d21/d52/da6/l147 0 2024-09-19T09:03:19.106 INFO:tasks.workunit.client.0.smithi049.stdout:1/952: readlink d5/d6/d19/db3/lf4 0 2024-09-19T09:03:19.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/951: dwrite d4/d15/d19/d1f/daa/dbd/dc6/fb1 [0,4194304] 0 2024-09-19T09:03:19.110 INFO:tasks.workunit.client.0.smithi049.stdout:4/952: write d4/d4c/df7/d103/f104 [337267,26511] 0 2024-09-19T09:03:19.115 INFO:tasks.workunit.client.0.smithi049.stdout:1/953: rename d5/d6/d19/d21/d52/d94/dea to d5/d6/d19/d148 0 2024-09-19T09:03:19.116 INFO:tasks.workunit.client.0.smithi049.stdout:4/953: creat d4/d6c/d7a/dc1/f11f x:0 0 0 2024-09-19T09:03:19.118 INFO:tasks.workunit.client.0.smithi049.stdout:1/954: symlink d5/d6/d82/l149 0 2024-09-19T09:03:19.119 INFO:tasks.workunit.client.0.smithi049.stdout:4/954: fdatasync d4/d4c/f8a 0 2024-09-19T09:03:19.120 INFO:tasks.workunit.client.0.smithi049.stdout:4/955: stat d4/d15/d19 0 2024-09-19T09:03:19.122 INFO:tasks.workunit.client.0.smithi049.stdout:4/956: mkdir d4/d45/df0/dfa/d120 0 2024-09-19T09:03:19.122 INFO:tasks.workunit.client.0.smithi049.stdout:1/955: symlink d5/d6/d8/d13/d24/l14a 0 2024-09-19T09:03:19.123 INFO:tasks.workunit.client.0.smithi049.stdout:4/957: chown d4/d45/d4a/dc3/db6/cdf 238723 1 2024-09-19T09:03:19.125 INFO:tasks.workunit.client.0.smithi049.stdout:4/958: creat d4/d6c/d7a/d89/f121 x:0 0 0 2024-09-19T09:03:19.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/959: dread d4/d6c/d7a/fe8 [0,4194304] 0 2024-09-19T09:03:19.130 INFO:tasks.workunit.client.0.smithi049.stdout:1/956: read d5/d6/d8/f2a [98279,105647] 0 2024-09-19T09:03:19.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/957: dwrite d5/d6/d19/d21/d52/fe9 [0,4194304] 0 2024-09-19T09:03:19.140 INFO:tasks.workunit.client.0.smithi049.stdout:1/958: symlink d5/d6/d19/d21/d52/da6/l14b 0 2024-09-19T09:03:19.141 INFO:tasks.workunit.client.0.smithi049.stdout:4/960: rmdir d4 39 2024-09-19T09:03:19.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/959: symlink d5/d6/d19/d30/l14c 0 2024-09-19T09:03:19.147 INFO:tasks.workunit.client.0.smithi049.stdout:1/960: creat d5/d6/dc/d12e/d13c/f14d x:0 0 0 2024-09-19T09:03:19.151 INFO:tasks.workunit.client.0.smithi049.stdout:1/961: rename d5/d6/d19/db3 to d5/d6/d8/d13/db0/dd1/d14e 0 2024-09-19T09:03:19.155 INFO:tasks.workunit.client.0.smithi049.stdout:1/962: dread d5/d6/d19/d21/deb/f144 [0,4194304] 0 2024-09-19T09:03:19.158 INFO:tasks.workunit.client.0.smithi049.stdout:4/961: dread d4/d4c/f10b [0,4194304] 0 2024-09-19T09:03:19.162 INFO:tasks.workunit.client.0.smithi049.stdout:4/962: dread d4/d45/f8e [0,4194304] 0 2024-09-19T09:03:19.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/963: rename d5/d6/d8/d13/d24/d9f/ded to d5/d6/d8/d13/db0/dd1/d14e/d124/d14f 0 2024-09-19T09:03:19.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/963: unlink d4/d45/d3f/d47/fa5 0 2024-09-19T09:03:19.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/964: stat d4/d4c/df7/d103/df2 0 2024-09-19T09:03:19.175 INFO:tasks.workunit.client.0.smithi049.stdout:1/964: rename d5/d6/d8/d1a/f3e to d5/d6/dc/d12e/d13c/f150 0 2024-09-19T09:03:19.181 INFO:tasks.workunit.client.0.smithi049.stdout:1/965: dwrite d5/f80 [0,4194304] 0 2024-09-19T09:03:19.183 INFO:tasks.workunit.client.0.smithi049.stdout:1/966: truncate d5/d6/d8/d13/d24/d7e/fa3 5493436 0 2024-09-19T09:03:19.186 INFO:tasks.workunit.client.0.smithi049.stdout:1/967: unlink d5/d6/d8/d13/d24/dbb/c140 0 2024-09-19T09:03:19.188 INFO:tasks.workunit.client.0.smithi049.stdout:1/968: stat d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d110/d11e/dd0 0 2024-09-19T09:03:19.188 INFO:tasks.workunit.client.0.smithi049.stdout:4/965: truncate d4/d45/d3f/d47/fa6 2349404 0 2024-09-19T09:03:19.193 INFO:tasks.workunit.client.0.smithi049.stdout:1/969: dread d5/f80 [0,4194304] 0 2024-09-19T09:03:19.195 INFO:tasks.workunit.client.0.smithi049.stdout:1/970: write d5/d6/d8/d13/d24/f112 [7647,64640] 0 2024-09-19T09:03:19.199 INFO:tasks.workunit.client.0.smithi049.stdout:4/966: dwrite d4/d6c/da2/feb [0,4194304] 0 2024-09-19T09:03:19.203 INFO:tasks.workunit.client.0.smithi049.stdout:4/967: unlink d4/d45/d4a/dc3/db6/db8/c105 0 2024-09-19T09:03:19.207 INFO:tasks.workunit.client.0.smithi049.stdout:1/971: getdents d5/d6/d19/d30/d64/d71 0 2024-09-19T09:03:19.211 INFO:tasks.workunit.client.0.smithi049.stdout:1/972: unlink d5/d6/d8/dbe/fdd 0 2024-09-19T09:03:19.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/968: dwrite d4/d15/d19/d1f/d55/f97 [4194304,4194304] 0 2024-09-19T09:03:19.213 INFO:tasks.workunit.client.0.smithi049.stdout:1/973: write d5/f1e [261119,74987] 0 2024-09-19T09:03:19.215 INFO:tasks.workunit.client.0.smithi049.stdout:4/969: chown d4/d45/d3f/d47/f112 251982 1 2024-09-19T09:03:19.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/970: mkdir d4/d4c/df7/d103/d3d/d62/d76/da3/d122 0 2024-09-19T09:03:19.220 INFO:tasks.workunit.client.0.smithi049.stdout:4/971: fsync d4/d6c/fdb 0 2024-09-19T09:03:19.224 INFO:tasks.workunit.client.0.smithi049.stdout:4/972: link d4/d15/d19/d1f/daa/dbd/c8f d4/d45/d4a/df4/c123 0 2024-09-19T09:03:19.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/973: chown d4/d6c/d7a/d89/f121 6502783 1 2024-09-19T09:03:19.237 INFO:tasks.workunit.client.0.smithi049.stdout:4/974: dwrite d4/d6c/da2/f9b [0,4194304] 0 2024-09-19T09:03:19.238 INFO:tasks.workunit.client.0.smithi049.stdout:4/975: stat d4/d15/f83 0 2024-09-19T09:03:19.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/976: rename d4/d15/d19/d1f/daa/dbd/c8f to d4/d45/d4a/dc3/c124 0 2024-09-19T09:03:19.245 INFO:tasks.workunit.client.0.smithi049.stdout:4/977: write d4/d4c/dcb/fef [384123,125749] 0 2024-09-19T09:03:19.252 INFO:tasks.workunit.client.0.smithi049.stdout:4/978: rmdir d4/d15/d19/d1f/daa/dbd/d94 0 2024-09-19T09:03:19.254 INFO:tasks.workunit.client.0.smithi049.stdout:4/979: mknod d4/d45/d4a/dc3/c125 0 2024-09-19T09:03:19.257 INFO:tasks.workunit.client.0.smithi049.stdout:4/980: mkdir d4/d15/d126 0 2024-09-19T09:03:19.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:19 smithi102 ceph-mon[35280]: pgmap v46: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 97 MiB/s wr, 296 op/s 2024-09-19T09:03:19.517 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:19 smithi049 ceph-mon[28158]: pgmap v46: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 97 MiB/s wr, 296 op/s 2024-09-19T09:03:19.988 INFO:tasks.workunit.client.0.smithi049.stdout:4/981: sync 2024-09-19T09:03:19.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/974: sync 2024-09-19T09:03:19.989 INFO:tasks.workunit.client.0.smithi049.stdout:6/921: sync 2024-09-19T09:03:19.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/922: creat dc/d1b/d6f/f12e x:0 0 0 2024-09-19T09:03:19.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/975: mkdir d5/d6/d19/d30/d63/dc8/d129/da0/def/d151 0 2024-09-19T09:03:19.995 INFO:tasks.workunit.client.0.smithi049.stdout:4/982: dwrite d4/d6c/da2/fd6 [0,4194304] 0 2024-09-19T09:03:19.998 INFO:tasks.workunit.client.0.smithi049.stdout:1/976: creat d5/d6/d8/d13/d24/d9f/f152 x:0 0 0 2024-09-19T09:03:19.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/977: stat d5/d6/db4/f10d 0 2024-09-19T09:03:20.005 INFO:tasks.workunit.client.0.smithi049.stdout:4/983: mkdir d4/d4c/df7/d103/da0/d127 0 2024-09-19T09:03:20.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/923: mkdir dc/d1b/d20/d2f/d6b/d73/d115/d12f 0 2024-09-19T09:03:20.006 INFO:tasks.workunit.client.0.smithi049.stdout:6/924: creat dc/d1b/d20/d2f/d6b/d73/d115/f130 x:0 0 0 2024-09-19T09:03:20.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/925: dread - dc/d1b/d20/d2f/da6/f116 zero size 2024-09-19T09:03:20.010 INFO:tasks.workunit.client.0.smithi049.stdout:4/984: getdents d4/d6c/d7a/d89 0 2024-09-19T09:03:20.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/985: write d4/d6c/da2/f9b [1770206,66183] 0 2024-09-19T09:03:20.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/986: chown d4/d15/f61 3194720 1 2024-09-19T09:03:20.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/987: dwrite d4/d6c/fdb [0,4194304] 0 2024-09-19T09:03:20.018 INFO:tasks.workunit.client.0.smithi049.stdout:1/978: dread d5/d6/d8/f2a [0,4194304] 0 2024-09-19T09:03:20.020 INFO:tasks.workunit.client.0.smithi049.stdout:6/926: write dc/d1b/d20/d81/d6e/ff4 [452401,36358] 0 2024-09-19T09:03:20.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/927: chown dc/d1b/d20/d2f/da6 322235 1 2024-09-19T09:03:20.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/988: creat d4/d6c/da2/f128 x:0 0 0 2024-09-19T09:03:20.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/979: dread d5/d6/f1b [0,4194304] 0 2024-09-19T09:03:20.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/980: creat d5/d6/d82/f153 x:0 0 0 2024-09-19T09:03:20.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/981: rmdir d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d13a 39 2024-09-19T09:03:20.036 INFO:tasks.workunit.client.0.smithi049.stdout:1/982: mknod d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d13a/c154 0 2024-09-19T09:03:20.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/928: dread dc/d16/f4a [0,4194304] 0 2024-09-19T09:03:20.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/989: dread d4/d4c/df7/d103/da0/df6/fad [0,4194304] 0 2024-09-19T09:03:20.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/929: dwrite dc/d1b/d6f/f96 [4194304,4194304] 0 2024-09-19T09:03:20.050 INFO:tasks.workunit.client.0.smithi049.stdout:1/983: write d5/d6/d19/d30/f136 [1388957,88970] 0 2024-09-19T09:03:20.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/930: link dc/d1b/d78/fb0 dc/d1b/d20/d81/d80/f131 0 2024-09-19T09:03:20.057 INFO:tasks.workunit.client.0.smithi049.stdout:4/990: getdents d4/d4c/df7/d103/da0 0 2024-09-19T09:03:20.059 INFO:tasks.workunit.client.0.smithi049.stdout:1/984: dwrite d5/d6/d8/d13/d24/f12b [4194304,4194304] 0 2024-09-19T09:03:20.060 INFO:tasks.workunit.client.0.smithi049.stdout:4/991: write d4/d6c/d7a/dc1/f11f [216244,522] 0 2024-09-19T09:03:20.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/985: write d5/d6/d19/d30/d64/f137 [153724,106319] 0 2024-09-19T09:03:20.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/931: unlink dc/d1b/d20/d2f/d31/ce1 0 2024-09-19T09:03:20.067 INFO:tasks.workunit.client.0.smithi049.stdout:4/992: mknod d4/d45/d4a/dc3/db6/db8/c129 0 2024-09-19T09:03:20.069 INFO:tasks.workunit.client.0.smithi049.stdout:1/986: creat d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d110/d11e/f155 x:0 0 0 2024-09-19T09:03:20.072 INFO:tasks.workunit.client.0.smithi049.stdout:4/993: mknod d4/d45/d4a/dc3/db6/db8/c12a 0 2024-09-19T09:03:20.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/932: truncate dc/d1b/d20/d81/d5a/dae/ff6 488104 0 2024-09-19T09:03:20.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/933: rmdir dc/d1b/d20 39 2024-09-19T09:03:20.091 INFO:tasks.workunit.client.0.smithi049.stdout:1/987: write d5/d6/d19/f39 [2454370,95938] 0 2024-09-19T09:03:20.093 INFO:tasks.workunit.client.0.smithi049.stdout:6/934: read dc/fc8 [1889617,10167] 0 2024-09-19T09:03:20.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/988: fdatasync d5/d6/d8/d13/d24/f128 0 2024-09-19T09:03:20.096 INFO:tasks.workunit.client.0.smithi049.stdout:4/994: dwrite d4/d4c/df7/d103/d3d/d62/fcc [0,4194304] 0 2024-09-19T09:03:20.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/995: dread d4/d6c/fdb [0,4194304] 0 2024-09-19T09:03:20.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/935: chown dc/d1b/d20/d2f/d4c/f10d 194768 1 2024-09-19T09:03:20.105 INFO:tasks.workunit.client.0.smithi049.stdout:4/996: readlink d4/d45/d4a/l50 0 2024-09-19T09:03:20.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/936: creat dc/d1b/d78/ddd/f132 x:0 0 0 2024-09-19T09:03:20.108 INFO:tasks.workunit.client.0.smithi049.stdout:4/997: creat d4/d4c/df7/d103/f12b x:0 0 0 2024-09-19T09:03:20.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/989: dwrite d5/d6/d19/d21/d52/da6/da7/dbc/fe1 [0,4194304] 0 2024-09-19T09:03:20.113 INFO:tasks.workunit.client.0.smithi049.stdout:4/998: chown d4/d6c/d7a/dc1/fc2 328666865 1 2024-09-19T09:03:20.120 INFO:tasks.workunit.client.0.smithi049.stdout:1/990: rmdir d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d110 39 2024-09-19T09:03:20.124 INFO:tasks.workunit.client.0.smithi049.stdout:4/999: creat d4/d4c/df7/d103/da0/d127/f12c x:0 0 0 2024-09-19T09:03:20.131 INFO:tasks.workunit.client.0.smithi049.stdout:1/991: creat d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d110/f156 x:0 0 0 2024-09-19T09:03:20.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/992: link d5/d6/d19/d21/d52/d94/cfa d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d13a/c157 0 2024-09-19T09:03:20.144 INFO:tasks.workunit.client.0.smithi049.stdout:6/937: write dc/d1b/d20/fe5 [565771,31651] 0 2024-09-19T09:03:20.149 INFO:tasks.workunit.client.0.smithi049.stdout:6/938: symlink dc/d1b/d20/d81/d6e/l133 0 2024-09-19T09:03:20.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/939: truncate dc/d1b/d20/d2f/d4c/fb9 120674 0 2024-09-19T09:03:20.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/940: creat dc/d1b/d20/d81/d5a/f134 x:0 0 0 2024-09-19T09:03:20.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/941: mknod dc/d1b/d20/d81/d80/dab/c135 0 2024-09-19T09:03:20.161 INFO:tasks.workunit.client.0.smithi049.stdout:6/942: unlink dc/d1b/d20/d2f/d4c/f10d 0 2024-09-19T09:03:20.164 INFO:tasks.workunit.client.0.smithi049.stdout:6/943: rename dc/d1b/d20/d2f/f5c to dc/d16/ded/f136 0 2024-09-19T09:03:20.179 INFO:tasks.workunit.client.0.smithi049.stdout:6/944: write dc/d1b/d20/d81/d5a/f9a [1079262,45512] 0 2024-09-19T09:03:20.180 INFO:tasks.workunit.client.0.smithi049.stdout:6/945: chown dc/d16/l33 6238 1 2024-09-19T09:03:20.182 INFO:tasks.workunit.client.0.smithi049.stdout:6/946: dread dc/d1b/d20/d7f/ffc [0,4194304] 0 2024-09-19T09:03:20.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/947: chown dc/d1b/d78/ddd/de6/l122 6215 1 2024-09-19T09:03:20.185 INFO:tasks.workunit.client.0.smithi049.stdout:6/948: rmdir dc/d1b/d20 39 2024-09-19T09:03:20.188 INFO:tasks.workunit.client.0.smithi049.stdout:6/949: dread - dc/d1b/d20/d2f/f123 zero size 2024-09-19T09:03:20.211 INFO:tasks.workunit.client.0.smithi049.stdout:6/950: dwrite dc/d1b/d20/d2f/d6b/d73/fd3 [0,4194304] 0 2024-09-19T09:03:20.215 INFO:tasks.workunit.client.0.smithi049.stdout:6/951: rename dc/d1b/d6f/df2/c107 to dc/d1b/d20/d2f/d6b/d73/d115/c137 0 2024-09-19T09:03:20.216 INFO:tasks.workunit.client.0.smithi049.stdout:6/952: chown dc/d16/f48 789 1 2024-09-19T09:03:20.221 INFO:tasks.workunit.client.0.smithi049.stdout:6/953: rename dc/d1b/d20/d81/d80/la5 to dc/d1b/d20/d81/d5a/dae/ddf/l138 0 2024-09-19T09:03:20.223 INFO:tasks.workunit.client.0.smithi049.stdout:6/954: write dc/d1b/d20/d81/d80/fb1 [372577,45241] 0 2024-09-19T09:03:20.225 INFO:tasks.workunit.client.0.smithi049.stdout:6/955: write dc/d1b/d78/ddd/f132 [469613,77999] 0 2024-09-19T09:03:20.226 INFO:tasks.workunit.client.0.smithi049.stdout:6/956: chown dc/d16/f48 3 1 2024-09-19T09:03:20.227 INFO:tasks.workunit.client.0.smithi049.stdout:6/957: write dc/d1b/d20/d2f/db4/f10e [451451,59023] 0 2024-09-19T09:03:20.232 INFO:tasks.workunit.client.0.smithi049.stdout:6/958: rmdir dc/d1b/d6f 39 2024-09-19T09:03:20.235 INFO:tasks.workunit.client.0.smithi049.stdout:6/959: creat dc/d1b/d20/d2f/d6b/f139 x:0 0 0 2024-09-19T09:03:20.241 INFO:tasks.workunit.client.0.smithi049.stdout:6/960: dwrite dc/d1b/d20/d2f/db4/d109/f114 [0,4194304] 0 2024-09-19T09:03:20.244 INFO:tasks.workunit.client.0.smithi049.stdout:6/961: symlink dc/d1b/d20/d7f/l13a 0 2024-09-19T09:03:20.248 INFO:tasks.workunit.client.0.smithi049.stdout:6/962: fsync dc/d1b/d20/d2f/da6/fa9 0 2024-09-19T09:03:20.250 INFO:tasks.workunit.client.0.smithi049.stdout:6/963: truncate dc/d1b/d6f/f125 553070 0 2024-09-19T09:03:20.256 INFO:tasks.workunit.client.0.smithi049.stdout:6/964: rename dc/d1b/d78/cbe to dc/d1b/d20/d7f/c13b 0 2024-09-19T09:03:20.272 INFO:tasks.workunit.client.0.smithi049.stdout:6/965: dread dc/d1b/d20/d81/d5a/dae/ddf/de4/f95 [0,4194304] 0 2024-09-19T09:03:20.272 INFO:tasks.workunit.client.0.smithi049.stdout:6/966: fdatasync dc/d1b/d20/d2f/d6b/f139 0 2024-09-19T09:03:20.275 INFO:tasks.workunit.client.0.smithi049.stdout:6/967: creat dc/d1b/d78/d12c/f13c x:0 0 0 2024-09-19T09:03:20.278 INFO:tasks.workunit.client.0.smithi049.stdout:6/968: rename dc/d16/f4a to dc/d1b/d20/d2f/d6b/f13d 0 2024-09-19T09:03:20.280 INFO:tasks.workunit.client.0.smithi049.stdout:6/969: mknod dc/d1b/d78/ddd/c13e 0 2024-09-19T09:03:20.281 INFO:tasks.workunit.client.0.smithi049.stdout:6/970: chown dc/d1b/d78/ddd/de6/l122 4955 1 2024-09-19T09:03:20.283 INFO:tasks.workunit.client.0.smithi049.stdout:6/971: truncate dc/d16/f2e 5037129 0 2024-09-19T09:03:20.285 INFO:tasks.workunit.client.0.smithi049.stdout:6/972: fdatasync dc/d1b/d20/d7f/ffc 0 2024-09-19T09:03:20.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/973: sync 2024-09-19T09:03:20.483 INFO:tasks.workunit.client.0.smithi049.stdout:1/993: sync 2024-09-19T09:03:20.485 INFO:tasks.workunit.client.0.smithi049.stdout:6/974: mknod dc/d1b/d20/d2f/d4c/c13f 0 2024-09-19T09:03:20.489 INFO:tasks.workunit.client.0.smithi049.stdout:6/975: chown dc/d1b/d20/d81/d80/dab/l111 12 1 2024-09-19T09:03:20.490 INFO:tasks.workunit.client.0.smithi049.stdout:1/994: link d5/d6/d8/d13/d24/l14a d5/d6/d19/d30/d63/dc8/d129/l158 0 2024-09-19T09:03:20.491 INFO:tasks.workunit.client.0.smithi049.stdout:6/976: rmdir dc/d1b/d6f/df2 39 2024-09-19T09:03:20.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/977: creat dc/d1b/d20/d2f/d6b/f140 x:0 0 0 2024-09-19T09:03:20.497 INFO:tasks.workunit.client.0.smithi049.stdout:1/995: creat d5/d6/d8/d13/db0/df7/f159 x:0 0 0 2024-09-19T09:03:20.500 INFO:tasks.workunit.client.0.smithi049.stdout:1/996: symlink d5/d6/d8/d13/db0/dd1/d14e/d124/l15a 0 2024-09-19T09:03:20.502 INFO:tasks.workunit.client.0.smithi049.stdout:1/997: read - d5/d6/d8/d13/db0/dd1/d14e/d124/d14f/d110/d11e/f155 zero size 2024-09-19T09:03:20.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/998: mknod d5/d6/d8/d13/d24/d9f/dc7/dff/c15b 0 2024-09-19T09:03:20.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/978: dread dc/d1b/d78/ddd/f8e [0,4194304] 0 2024-09-19T09:03:20.510 INFO:tasks.workunit.client.0.smithi049.stdout:1/999: symlink d5/d6/d19/d21/d52/da6/da7/df0/l15c 0 2024-09-19T09:03:20.512 INFO:tasks.workunit.client.0.smithi049.stdout:6/979: rename dc/d1b/d20/d2f/d6b/f140 to dc/d1b/d20/d81/d6e/f141 0 2024-09-19T09:03:20.514 INFO:tasks.workunit.client.0.smithi049.stdout:6/980: symlink dc/l142 0 2024-09-19T09:03:20.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/981: rename dc/d1b/d20/d2f/d6b/d73/d115/f130 to dc/d1b/d20/d81/d5a/dae/ddf/de4/f143 0 2024-09-19T09:03:20.521 INFO:tasks.workunit.client.0.smithi049.stdout:6/982: rename dc/d1b/d20/d2f/da6/l11d to dc/d1b/d20/d7f/l144 0 2024-09-19T09:03:20.523 INFO:tasks.workunit.client.0.smithi049.stdout:6/983: chown dc/d1b/d20/d2f/d6b/d73/c11e 10010 1 2024-09-19T09:03:20.524 INFO:tasks.workunit.client.0.smithi049.stdout:6/984: stat dc/d1b/d78/ddd/de6/l122 0 2024-09-19T09:03:20.525 INFO:tasks.workunit.client.0.smithi049.stdout:6/985: dread - dc/d1b/fb2 zero size 2024-09-19T09:03:20.530 INFO:tasks.workunit.client.0.smithi049.stdout:6/986: getdents dc/d1b/d78 0 2024-09-19T09:03:20.531 INFO:tasks.workunit.client.0.smithi049.stdout:6/987: fdatasync dc/d1b/d20/d2f/f123 0 2024-09-19T09:03:20.532 INFO:tasks.workunit.client.0.smithi049.stdout:6/988: chown dc/d1b/d20/d81/d5a/dae/ddf 9176 1 2024-09-19T09:03:20.534 INFO:tasks.workunit.client.0.smithi049.stdout:6/989: write dc/ff [3781258,115719] 0 2024-09-19T09:03:20.541 INFO:tasks.workunit.client.0.smithi049.stdout:6/990: dwrite dc/d1b/d20/d81/d5a/f134 [0,4194304] 0 2024-09-19T09:03:20.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/991: symlink dc/d1b/d20/d7f/l145 0 2024-09-19T09:03:20.550 INFO:tasks.workunit.client.0.smithi049.stdout:6/992: truncate dc/d1b/d20/d2f/f51 521597 0 2024-09-19T09:03:20.565 INFO:tasks.workunit.client.0.smithi049.stdout:6/993: dwrite dc/f19 [4194304,4194304] 0 2024-09-19T09:03:20.572 INFO:tasks.workunit.client.0.smithi049.stdout:6/994: link dc/fc0 dc/f146 0 2024-09-19T09:03:20.578 INFO:tasks.workunit.client.0.smithi049.stdout:6/995: mknod dc/d1b/d20/d81/d5a/dae/ddf/d121/c147 0 2024-09-19T09:03:20.591 INFO:tasks.workunit.client.0.smithi049.stdout:6/996: dread dc/d16/f2d [0,4194304] 0 2024-09-19T09:03:20.592 INFO:tasks.workunit.client.0.smithi049.stdout:6/997: truncate dc/d1b/d20/d81/d80/fb1 1119242 0 2024-09-19T09:03:20.593 INFO:tasks.workunit.client.0.smithi049.stdout:6/998: chown dc/d1b/d78/f93 92631 1 2024-09-19T09:03:20.594 INFO:tasks.workunit.client.0.smithi049.stdout:6/999: chown dc/d1b/caa 286574 1 2024-09-19T09:03:20.598 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm -rf -- ./tmp.gq4qxHqFYF 2024-09-19T09:03:21.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:21 smithi049 ceph-mon[28158]: pgmap v47: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 128 MiB/s wr, 410 op/s 2024-09-19T09:03:21.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:21 smithi102 ceph-mon[35280]: pgmap v47: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 128 MiB/s wr, 410 op/s 2024-09-19T09:03:22.773 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:22 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:22.773 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:22 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:22.773 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:22 smithi049 ceph-mon[28158]: pgmap v48: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 76 MiB/s wr, 253 op/s 2024-09-19T09:03:22.773 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:22 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:22.773 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:22 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:22.773 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:22 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:22 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:22 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:22 smithi102 ceph-mon[35280]: pgmap v48: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 76 MiB/s wr, 253 op/s 2024-09-19T09:03:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:22 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:22 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:22 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.283+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3656314230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a0100d90 msgr2=0x7fe7a0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.283+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3656314230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a0100d90 0x7fe7a0101210 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009880 tx=0x7fe78c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.283+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3656314230 shutdown_connections 2024-09-19T09:03:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.283+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3656314230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a0100d90 0x7fe7a0101210 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.283+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3656314230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a00ffb90 0x7fe7a00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.283+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3656314230 >> 172.21.15.49:0/3656314230 conn(0x7fe7a00fb320 msgr2=0x7fe7a00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.283+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3656314230 shutdown_connections 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3656314230 wait complete. 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a6e15640 1 Processor -- start 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a6e15640 1 -- start start 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a6e15640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a00ffb90 0x7fe7a0074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a6e15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a0100d90 0x7fe7a00728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a6e15640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0072de0 con 0x7fe7a00ffb90 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a6e15640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0072f50 con 0x7fe7a0100d90 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.284+0000 7fe7a4bb1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a00ffb90 0x7fe7a0074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe7a4bb1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a00ffb90 0x7fe7a0074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51996/0 (socket says 172.21.15.49:51996) 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe7a4bb1640 1 -- 172.21.15.49:0/3780843070 learned_addr learned my addr 172.21.15.49:0/3780843070 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe79ffff640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a0100d90 0x7fe7a00728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe7a4bb1640 1 -- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a0100d90 msgr2=0x7fe7a00728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe7a4bb1640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a0100d90 0x7fe7a00728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe7a4bb1640 1 -- 172.21.15.49:0/3780843070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009560 con 0x7fe7a00ffb90 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe7a4bb1640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a00ffb90 0x7fe7a0074200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe79400e940 tx=0x7fe79400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe79dffb640 1 -- 172.21.15.49:0/3780843070 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe794009700 con 0x7fe7a00ffb90 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe79dffb640 1 -- 172.21.15.49:0/3780843070 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe79400cc90 con 0x7fe7a00ffb90 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a0073230 con 0x7fe7a00ffb90 2024-09-19T09:03:24.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.285+0000 7fe79dffb640 1 -- 172.21.15.49:0/3780843070 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe794010430 con 0x7fe7a00ffb90 2024-09-19T09:03:24.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.286+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a019d670 con 0x7fe7a00ffb90 2024-09-19T09:03:24.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.287+0000 7fe79dffb640 1 -- 172.21.15.49:0/3780843070 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 27) v1 ==== 92414+0+0 (secure 0 0 0) 0x7fe794003fa0 con 0x7fe7a00ffb90 2024-09-19T09:03:24.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.287+0000 7fe79dffb640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fe79006e270 0x7fe790070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.287+0000 7fe79dffb640 1 -- 172.21.15.49:0/3780843070 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe794014070 con 0x7fe7a00ffb90 2024-09-19T09:03:24.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.288+0000 7fe79ffff640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fe79006e270 0x7fe790070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.288+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a01090e0 con 0x7fe7a00ffb90 2024-09-19T09:03:24.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.288+0000 7fe79ffff640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fe79006e270 0x7fe790070730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe78c000c00 tx=0x7fe78c0314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.294+0000 7fe79dffb640 1 -- 172.21.15.49:0/3780843070 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fe794057b90 con 0x7fe7a00ffb90 2024-09-19T09:03:24.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.589+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7a0108a80 con 0x7fe79006e270 2024-09-19T09:03:24.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.590+0000 7fe79dffb640 1 -- 172.21.15.49:0/3780843070 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe78c041070 con 0x7fe79006e270 2024-09-19T09:03:24.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.592+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fe79006e270 msgr2=0x7fe790070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.592+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fe79006e270 0x7fe790070730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe78c000c00 tx=0x7fe78c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.592+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a00ffb90 msgr2=0x7fe7a0074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.592+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a00ffb90 0x7fe7a0074200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe79400e940 tx=0x7fe79400ee00 comp rx=0 tx=0).stop 2024-09-19T09:03:24.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.593+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 shutdown_connections 2024-09-19T09:03:24.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.593+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fe79006e270 0x7fe790070730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.593+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a0100d90 0x7fe7a00728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.593+0000 7fe7a6e15640 1 --2- 172.21.15.49:0/3780843070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7a00ffb90 0x7fe7a0074200 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.593+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 >> 172.21.15.49:0/3780843070 conn(0x7fe7a00fb320 msgr2=0x7fe7a0104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.593+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 shutdown_connections 2024-09-19T09:03:24.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.593+0000 7fe7a6e15640 1 -- 172.21.15.49:0/3780843070 wait complete. 2024-09-19T09:03:24.603 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:03:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 -- 172.21.15.49:0/268260726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9590071760 msgr2=0x7f9590071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 --2- 172.21.15.49:0/268260726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9590071760 0x7f9590071b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9580009880 tx=0x7f958002a4b0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 -- 172.21.15.49:0/268260726 shutdown_connections 2024-09-19T09:03:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 --2- 172.21.15.49:0/268260726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95901085c0 0x7f9590108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 --2- 172.21.15.49:0/268260726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9590071760 0x7f9590071b60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 -- 172.21.15.49:0/268260726 >> 172.21.15.49:0/268260726 conn(0x7f959006cc10 msgr2=0x7f959006f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 -- 172.21.15.49:0/268260726 shutdown_connections 2024-09-19T09:03:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.710+0000 7f959620d640 1 -- 172.21.15.49:0/268260726 wait complete. 2024-09-19T09:03:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.711+0000 7f959620d640 1 Processor -- start 2024-09-19T09:03:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.711+0000 7f959620d640 1 -- start start 2024-09-19T09:03:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.711+0000 7f959620d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590071760 0x7f959019de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.711+0000 7f959620d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95901085c0 0x7f959019e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.711+0000 7f959620d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959019e910 con 0x7f95901085c0 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.711+0000 7f959620d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959019ea80 con 0x7f9590071760 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590071760 0x7f959019de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590071760 0x7f959019de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:45050/0 (socket says 172.21.15.49:45050) 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958f7fe640 1 -- 172.21.15.49:0/782619589 learned_addr learned my addr 172.21.15.49:0/782619589 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958effd640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95901085c0 0x7f959019e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958f7fe640 1 -- 172.21.15.49:0/782619589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95901085c0 msgr2=0x7f959019e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958f7fe640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95901085c0 0x7f959019e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958f7fe640 1 -- 172.21.15.49:0/782619589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580009560 con 0x7f9590071760 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.712+0000 7f958f7fe640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590071760 0x7f959019de00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f958002a9d0 tx=0x7f95800054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.713+0000 7f958cff9640 1 -- 172.21.15.49:0/782619589 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9580004aa0 con 0x7f9590071760 2024-09-19T09:03:24.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.713+0000 7f958cff9640 1 -- 172.21.15.49:0/782619589 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9580004c00 con 0x7f9590071760 2024-09-19T09:03:24.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.713+0000 7f958cff9640 1 -- 172.21.15.49:0/782619589 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9580003a80 con 0x7f9590071760 2024-09-19T09:03:24.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.713+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9590109ca0 con 0x7f9590071760 2024-09-19T09:03:24.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.713+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959010a210 con 0x7f9590071760 2024-09-19T09:03:24.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.714+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959010ff30 con 0x7f9590071760 2024-09-19T09:03:24.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.715+0000 7f958cff9640 1 -- 172.21.15.49:0/782619589 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 27) v1 ==== 92414+0+0 (secure 0 0 0) 0x7f9580003be0 con 0x7f9590071760 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.716+0000 7f958cff9640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f957806e2c0 0x7f9578070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.717+0000 7f958effd640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f957806e2c0 0x7f9578070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.717+0000 7f958cff9640 1 -- 172.21.15.49:0/782619589 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f95800af270 con 0x7f9590071760 2024-09-19T09:03:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.717+0000 7f958effd640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f957806e2c0 0x7f9578070780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9584005fd0 tx=0x7f9584005850 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:24.721+0000 7f958cff9640 1 -- 172.21.15.49:0/782619589 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f9580078970 con 0x7f9590071760 2024-09-19T09:03:24.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:24 smithi049 ceph-mon[28158]: mgrmap e27: smithi102.csalqv(active, since 91s), standbys: smithi049.qdvksw 2024-09-19T09:03:24.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:24 smithi049 ceph-mon[28158]: pgmap v49: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 45 MiB/s rd, 96 MiB/s wr, 338 op/s 2024-09-19T09:03:25.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:24 smithi102 ceph-mon[35280]: mgrmap e27: smithi102.csalqv(active, since 91s), standbys: smithi049.qdvksw 2024-09-19T09:03:25.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:24 smithi102 ceph-mon[35280]: pgmap v49: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 45 MiB/s rd, 96 MiB/s wr, 338 op/s 2024-09-19T09:03:25.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.075+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95900608f0 con 0x7f957806e2c0 2024-09-19T09:03:25.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.077+0000 7f958cff9640 1 -- 172.21.15.49:0/782619589 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f95900608f0 con 0x7f957806e2c0 2024-09-19T09:03:25.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.080+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f957806e2c0 msgr2=0x7f9578070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.080+0000 7f959620d640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f957806e2c0 0x7f9578070780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9584005fd0 tx=0x7f9584005850 comp rx=0 tx=0).stop 2024-09-19T09:03:25.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.081+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590071760 msgr2=0x7f959019de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.081+0000 7f959620d640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590071760 0x7f959019de00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f958002a9d0 tx=0x7f95800054f0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.083+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 shutdown_connections 2024-09-19T09:03:25.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.083+0000 7f959620d640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f957806e2c0 0x7f9578070780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.083+0000 7f959620d640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95901085c0 0x7f959019e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.083+0000 7f959620d640 1 --2- 172.21.15.49:0/782619589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9590071760 0x7f959019de00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.083+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 >> 172.21.15.49:0/782619589 conn(0x7f959006cc10 msgr2=0x7f959006ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.084+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 shutdown_connections 2024-09-19T09:03:25.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.084+0000 7f959620d640 1 -- 172.21.15.49:0/782619589 wait complete. 2024-09-19T09:03:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 -- 172.21.15.49:0/1857160392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 msgr2=0x7f7f4c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1857160392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c100170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f340097e0 tx=0x7f7f3402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 -- 172.21.15.49:0/1857160392 shutdown_connections 2024-09-19T09:03:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1857160392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c100170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1857160392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f4c0feaf0 0x7f7f4c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 -- 172.21.15.49:0/1857160392 >> 172.21.15.49:0/1857160392 conn(0x7f7f4c0fa280 msgr2=0x7f7f4c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 -- 172.21.15.49:0/1857160392 shutdown_connections 2024-09-19T09:03:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.195+0000 7f7f50afc640 1 -- 172.21.15.49:0/1857160392 wait complete. 2024-09-19T09:03:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.196+0000 7f7f50afc640 1 Processor -- start 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.196+0000 7f7f50afc640 1 -- start start 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.196+0000 7f7f50afc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f4c0feaf0 0x7f7f4c102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.196+0000 7f7f50afc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.196+0000 7f7f50afc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c101610 con 0x7f7f4c0feaf0 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.196+0000 7f7f50afc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c101780 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f43fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f43fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c1010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:45070/0 (socket says 172.21.15.49:45070) 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f43fff640 1 -- 172.21.15.49:0/1191315916 learned_addr learned my addr 172.21.15.49:0/1191315916 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f43fff640 1 -- 172.21.15.49:0/1191315916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f4c0feaf0 msgr2=0x7f7f4c102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f43fff640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f4c0feaf0 0x7f7f4c102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f43fff640 1 -- 172.21.15.49:0/1191315916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c009560 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f43fff640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c1010d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009900 tx=0x7f7f34030c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.197+0000 7f7f437fe640 1 -- 172.21.15.49:0/1191315916 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f340037c0 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.198+0000 7f7f437fe640 1 -- 172.21.15.49:0/1191315916 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f340044f0 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.198+0000 7f7f437fe640 1 -- 172.21.15.49:0/1191315916 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f34031d80 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.198+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f34009490 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.198+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4c101d60 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.199+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4c0feef0 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.199+0000 7f7f437fe640 1 -- 172.21.15.49:0/1191315916 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 27) v1 ==== 92414+0+0 (secure 0 0 0) 0x7f7f34031400 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.200+0000 7f7f437fe640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7f3806e270 0x7f7f38070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.200+0000 7f7f437fe640 1 -- 172.21.15.49:0/1191315916 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7f340af740 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.200+0000 7f7f4a59c640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7f3806e270 0x7f7f38070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.201+0000 7f7f4a59c640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7f3806e270 0x7f7f38070730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c005ab0 tx=0x7f7f3c005a20 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.205+0000 7f7f437fe640 1 -- 172.21.15.49:0/1191315916 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f7f34078e40 con 0x7f7f4c0ffcf0 2024-09-19T09:03:25.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.476+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 --> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f4c0683b0 con 0x7f7f3806e270 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.487+0000 7f7f437fe640 1 -- 172.21.15.49:0/1191315916 <== mgr.24395 v2:172.21.15.102:6828/655933659 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7f4c0683b0 con 0x7f7f3806e270 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (7m) 3s ago 8m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (9m) 3s ago 9m 8052k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (8m) 80s ago 8m 7822k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 3s ago 9m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (8m) 80s ago 8m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:03:25.487 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (7m) 3s ago 8m 85.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (3m) 3s ago 3m 259M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (3m) 3s ago 3m 238M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (3m) 80s ago 3m 22.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (3m) 80s ago 3m 21.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (38s) 3s ago 10m 109M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (106s) 80s ago 8m 483M - 19.1.1-361-g2f599a46 d2baa855c067 83adb7fb6aac 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (10m) 3s ago 10m 51.7M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (7m) 80s ago 7m 43.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (9m) 3s ago 9m 15.4M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (8m) 80s ago 8m 16.7M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 3s ago 7m 155M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:03:25.488 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 3s ago 6m 190M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:03:25.489 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 3s ago 6m 158M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:03:25.489 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (5m) 80s ago 5m 72.9M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:03:25.489 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (5m) 80s ago 5m 71.8M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:03:25.489 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (5m) 80s ago 5m 72.5M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:03:25.489 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (55s) 3s ago 8m 45.0M - 2.43.0 a07b618ecd1d 074a8755488c 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7f3806e270 msgr2=0x7f7f38070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7f3806e270 0x7f7f38070730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c005ab0 tx=0x7f7f3c005a20 comp rx=0 tx=0).stop 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 msgr2=0x7f7f4c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c1010d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009900 tx=0x7f7f34030c00 comp rx=0 tx=0).stop 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 shutdown_connections 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f7f3806e270 0x7f7f38070730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f4c0ffcf0 0x7f7f4c1010d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 --2- 172.21.15.49:0/1191315916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f4c0feaf0 0x7f7f4c102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 >> 172.21.15.49:0/1191315916 conn(0x7f7f4c0fa280 msgr2=0x7f7f4c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 shutdown_connections 2024-09-19T09:03:25.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.491+0000 7f7f50afc640 1 -- 172.21.15.49:0/1191315916 wait complete. 2024-09-19T09:03:25.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 -- 172.21.15.49:0/3112929977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c102fb0 msgr2=0x7fb30c1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 --2- 172.21.15.49:0/3112929977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c102fb0 0x7fb30c1053a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb3000098b0 tx=0x7fb30002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 -- 172.21.15.49:0/3112929977 shutdown_connections 2024-09-19T09:03:25.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 --2- 172.21.15.49:0/3112929977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c102fb0 0x7fb30c1053a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 --2- 172.21.15.49:0/3112929977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb30c100680 0x7fb30c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 -- 172.21.15.49:0/3112929977 >> 172.21.15.49:0/3112929977 conn(0x7fb30c0fa280 msgr2=0x7fb30c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 -- 172.21.15.49:0/3112929977 shutdown_connections 2024-09-19T09:03:25.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.591+0000 7fb310d7a640 1 -- 172.21.15.49:0/3112929977 wait complete. 2024-09-19T09:03:25.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.592+0000 7fb310d7a640 1 Processor -- start 2024-09-19T09:03:25.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb310d7a640 1 -- start start 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb310d7a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c100680 0x7fb30c0fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb310d7a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb30c102fb0 0x7fb30c0fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb310d7a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0feb70 con 0x7fb30c100680 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb310d7a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0fece0 con 0x7fb30c102fb0 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb30a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c100680 0x7fb30c0fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb30a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c100680 0x7fb30c0fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52038/0 (socket says 172.21.15.49:52038) 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb30a59c640 1 -- 172.21.15.49:0/1424185091 learned_addr learned my addr 172.21.15.49:0/1424185091 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb309d9b640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb30c102fb0 0x7fb30c0fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb30a59c640 1 -- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb30c102fb0 msgr2=0x7fb30c0fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.593+0000 7fb30a59c640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb30c102fb0 0x7fb30c0fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.594+0000 7fb30a59c640 1 -- 172.21.15.49:0/1424185091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300009560 con 0x7fb30c100680 2024-09-19T09:03:25.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.594+0000 7fb30a59c640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c100680 0x7fb30c0fffe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00d6f0 tx=0x7fb2fc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.594+0000 7fb2fb7fe640 1 -- 172.21.15.49:0/1424185091 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc009a30 con 0x7fb30c100680 2024-09-19T09:03:25.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.594+0000 7fb2fb7fe640 1 -- 172.21.15.49:0/1424185091 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2fc0054e0 con 0x7fb30c100680 2024-09-19T09:03:25.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.594+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0fefc0 con 0x7fb30c100680 2024-09-19T09:03:25.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.594+0000 7fb2fb7fe640 1 -- 172.21.15.49:0/1424185091 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc010460 con 0x7fb30c100680 2024-09-19T09:03:25.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.594+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c19d780 con 0x7fb30c100680 2024-09-19T09:03:25.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.595+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c109190 con 0x7fb30c100680 2024-09-19T09:03:25.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.596+0000 7fb2fb7fe640 1 -- 172.21.15.49:0/1424185091 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 27) v1 ==== 92414+0+0 (secure 0 0 0) 0x7fb2fc009b90 con 0x7fb30c100680 2024-09-19T09:03:25.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.596+0000 7fb2fb7fe640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fb2f406e280 0x7fb2f4070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.597+0000 7fb2fb7fe640 1 -- 172.21.15.49:0/1424185091 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb2fc08daa0 con 0x7fb30c100680 2024-09-19T09:03:25.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.597+0000 7fb309d9b640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fb2f406e280 0x7fb2f4070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.597+0000 7fb309d9b640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fb2f406e280 0x7fb2f4070740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb300009880 tx=0x7fb3000314e0 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.604+0000 7fb2fb7fe640 1 -- 172.21.15.49:0/1424185091 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fb2fc0572f0 con 0x7fb30c100680 2024-09-19T09:03:25.755 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:25 smithi049 ceph-mon[28158]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:25.755 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:25 smithi049 ceph-mon[28158]: from='client.24513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:25.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.938+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb30c100a60 con 0x7fb30c100680 2024-09-19T09:03:25.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.939+0000 7fb2fb7fe640 1 -- 172.21.15.49:0/1424185091 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fb2fc0202f0 con 0x7fb30c100680 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:03:25.939 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 12, 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:03:25.940 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fb2f406e280 msgr2=0x7fb2f4070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fb2f406e280 0x7fb2f4070740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb300009880 tx=0x7fb3000314e0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c100680 msgr2=0x7fb30c0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c100680 0x7fb30c0fffe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00d6f0 tx=0x7fb2fc00dbb0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 shutdown_connections 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7fb2f406e280 0x7fb2f4070740 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb30c102fb0 0x7fb30c0fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 --2- 172.21.15.49:0/1424185091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb30c100680 0x7fb30c0fffe0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 >> 172.21.15.49:0/1424185091 conn(0x7fb30c0fa280 msgr2=0x7fb30c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 shutdown_connections 2024-09-19T09:03:25.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:25.943+0000 7fb310d7a640 1 -- 172.21.15.49:0/1424185091 wait complete. 2024-09-19T09:03:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:25 smithi102 ceph-mon[35280]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:25 smithi102 ceph-mon[35280]: from='client.24513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.082+0000 7f2a70186640 1 -- 172.21.15.49:0/454930631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 msgr2=0x7f2a681031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.082+0000 7f2a70186640 1 --2- 172.21.15.49:0/454930631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a681031b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009c20 tx=0x7f2a5402a980 comp rx=0 tx=0).stop 2024-09-19T09:03:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.083+0000 7f2a70186640 1 -- 172.21.15.49:0/454930631 shutdown_connections 2024-09-19T09:03:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.083+0000 7f2a70186640 1 --2- 172.21.15.49:0/454930631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a681031b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.083+0000 7f2a70186640 1 --2- 172.21.15.49:0/454930631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 0x7f2a68100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.083+0000 7f2a70186640 1 -- 172.21.15.49:0/454930631 >> 172.21.15.49:0/454930631 conn(0x7f2a680fa200 msgr2=0x7f2a680fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.083+0000 7f2a70186640 1 -- 172.21.15.49:0/454930631 shutdown_connections 2024-09-19T09:03:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.084+0000 7f2a70186640 1 -- 172.21.15.49:0/454930631 wait complete. 2024-09-19T09:03:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.084+0000 7f2a70186640 1 Processor -- start 2024-09-19T09:03:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.084+0000 7f2a70186640 1 -- start start 2024-09-19T09:03:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.085+0000 7f2a70186640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 0x7f2a6810c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.085+0000 7f2a70186640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a6810c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.085+0000 7f2a70186640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6810cb60 con 0x7f2a680fe3f0 2024-09-19T09:03:26.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.085+0000 7f2a70186640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6810cca0 con 0x7f2a68100d40 2024-09-19T09:03:26.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.085+0000 7f2a6d721640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a6810c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.085+0000 7f2a6df22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 0x7f2a6810c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.086+0000 7f2a6df22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 0x7f2a6810c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52068/0 (socket says 172.21.15.49:52068) 2024-09-19T09:03:26.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.086+0000 7f2a6d721640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a6810c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:45112/0 (socket says 172.21.15.49:45112) 2024-09-19T09:03:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.086+0000 7f2a6df22640 1 -- 172.21.15.49:0/504912413 learned_addr learned my addr 172.21.15.49:0/504912413 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.086+0000 7f2a6df22640 1 -- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 msgr2=0x7f2a6810c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.087+0000 7f2a6df22640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a6810c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.087+0000 7f2a6df22640 1 -- 172.21.15.49:0/504912413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009900 con 0x7f2a680fe3f0 2024-09-19T09:03:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.087+0000 7f2a6d721640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a6810c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:26.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.087+0000 7f2a6df22640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 0x7f2a6810c000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000e970 tx=0x7f2a6000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.088+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a6000cc90 con 0x7f2a680fe3f0 2024-09-19T09:03:26.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.088+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6806a070 con 0x7f2a680fe3f0 2024-09-19T09:03:26.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.088+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6806a610 con 0x7f2a680fe3f0 2024-09-19T09:03:26.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.088+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a6000cdf0 con 0x7f2a680fe3f0 2024-09-19T09:03:26.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.088+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a60018810 con 0x7f2a680fe3f0 2024-09-19T09:03:26.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.089+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c005280 con 0x7f2a680fe3f0 2024-09-19T09:03:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.091+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 27) v1 ==== 92414+0+0 (secure 0 0 0) 0x7f2a60010c10 con 0x7f2a680fe3f0 2024-09-19T09:03:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.092+0000 7f2a66ffd640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f2a5806e330 0x7f2a580707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.092+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2a60014070 con 0x7f2a680fe3f0 2024-09-19T09:03:26.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.092+0000 7f2a6d721640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f2a5806e330 0x7f2a580707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.094+0000 7f2a6d721640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f2a5806e330 0x7f2a580707f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a5402fb80 tx=0x7f2a5403c040 comp rx=0 tx=0).ready entity=mgr.24395 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.100+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f2a60053d60 con 0x7f2a680fe3f0 2024-09-19T09:03:26.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.401+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 28) v1 ==== 46131+0+0 (secure 0 0 0) 0x7f2a6008c9b0 con 0x7f2a680fe3f0 2024-09-19T09:03:26.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.402+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f2a5806e330 msgr2=0x7f2a580707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.402+0000 7f2a66ffd640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f2a5806e330 0x7f2a580707f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a5402fb80 tx=0x7f2a5403c040 comp rx=0 tx=0).stop 2024-09-19T09:03:26.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.474+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a4c005d40 con 0x7f2a680fe3f0 2024-09-19T09:03:26.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.474+0000 7f2a66ffd640 1 -- 172.21.15.49:0/504912413 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f2a6005b760 con 0x7f2a680fe3f0 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:03:26.475 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:03:26.476 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:03:26.477 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:03:26.478 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:03:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:03:26.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:03:26.478 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 msgr2=0x7f2a6810c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 0x7f2a6810c000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000e970 tx=0x7f2a6000ee30 comp rx=0 tx=0).stop 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 shutdown_connections 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:6828/655933659,v1:172.21.15.102:6829/655933659] conn(0x7f2a5806e330 0x7f2a580707f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a68100d40 0x7f2a6810c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 --2- 172.21.15.49:0/504912413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fe3f0 0x7f2a6810c000 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 >> 172.21.15.49:0/504912413 conn(0x7f2a680fa200 msgr2=0x7f2a680fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 shutdown_connections 2024-09-19T09:03:26.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.478+0000 7f2a70186640 1 -- 172.21.15.49:0/504912413 wait complete. 2024-09-19T09:03:26.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 -- 172.21.15.49:0/1543691120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0102fb0 msgr2=0x7efcd01053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/1543691120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0102fb0 0x7efcd01053a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098b0 tx=0x7efcc002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 -- 172.21.15.49:0/1543691120 shutdown_connections 2024-09-19T09:03:26.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/1543691120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0102fb0 0x7efcd01053a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/1543691120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcd0100680 0x7efcd0102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 -- 172.21.15.49:0/1543691120 >> 172.21.15.49:0/1543691120 conn(0x7efcd00fa280 msgr2=0x7efcd00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 -- 172.21.15.49:0/1543691120 shutdown_connections 2024-09-19T09:03:26.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.576+0000 7efcd7f6a640 1 -- 172.21.15.49:0/1543691120 wait complete. 2024-09-19T09:03:26.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd7f6a640 1 Processor -- start 2024-09-19T09:03:26.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd7f6a640 1 -- start start 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd7f6a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0100680 0x7efcd0197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd7f6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcd0102fb0 0x7efcd0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd7f6a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0198420 con 0x7efcd0100680 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd7f6a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0198590 con 0x7efcd0102fb0 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd5d06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0100680 0x7efcd0197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd5d06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0100680 0x7efcd0197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52088/0 (socket says 172.21.15.49:52088) 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd5d06640 1 -- 172.21.15.49:0/2627433327 learned_addr learned my addr 172.21.15.49:0/2627433327 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.577+0000 7efcd5505640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcd0102fb0 0x7efcd0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcd5d06640 1 -- 172.21.15.49:0/2627433327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcd0102fb0 msgr2=0x7efcd0197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcd5d06640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcd0102fb0 0x7efcd0197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcd5d06640 1 -- 172.21.15.49:0/2627433327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0009560 con 0x7efcd0100680 2024-09-19T09:03:26.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcd5d06640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0100680 0x7efcd0197910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efccc00d900 tx=0x7efccc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc009c00 con 0x7efcd0100680 2024-09-19T09:03:26.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd019cfd0 con 0x7efcd0100680 2024-09-19T09:03:26.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efccc009d60 con 0x7efcd0100680 2024-09-19T09:03:26.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc0049d0 con 0x7efcd0100680 2024-09-19T09:03:26.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.578+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd019d4f0 con 0x7efcd0100680 2024-09-19T09:03:26.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.579+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd01087e0 con 0x7efcd0100680 2024-09-19T09:03:26.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.580+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 28) v1 ==== 46131+0+0 (secure 0 0 0) 0x7efccc004b30 con 0x7efcd0100680 2024-09-19T09:03:26.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.580+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7efccc04ca20 con 0x7efcd0100680 2024-09-19T09:03:26.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:26.589+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7efccc00f8d0 con 0x7efcd0100680 2024-09-19T09:03:26.723 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: pgmap v50: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 50 MiB/s wr, 199 op/s 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1424185091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr fail", "who": "smithi102.csalqv"}]: dispatch 2024-09-19T09:03:26.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr fail", "who": "smithi102.csalqv"}]: dispatch 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: Activating manager daemon smithi049.qdvksw 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd='[{"prefix": "mgr fail", "who": "smithi102.csalqv"}]': finished 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: mgrmap e28: smithi049.qdvksw(active, starting, since 0.00989131s) 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:03:26.725 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:03:26.726 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:26 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/504912413' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: pgmap v50: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 50 MiB/s wr, 199 op/s 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1424185091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' 2024-09-19T09:03:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 172.21.15.102:0/653683147' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr fail", "who": "smithi102.csalqv"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "mgr fail", "who": "smithi102.csalqv"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: Activating manager daemon smithi049.qdvksw 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.24395 ' entity='mgr.smithi102.csalqv' cmd='[{"prefix": "mgr fail", "who": "smithi102.csalqv"}]': finished 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: mgrmap e28: smithi049.qdvksw(active, starting, since 0.00989131s) 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:03:26.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:03:26.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:03:26.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:03:26.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:26 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/504912413' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:03:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.546+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 29) v1 ==== 46258+0+0 (secure 0 0 0) 0x7efccc0035f0 con 0x7efcd0100680 2024-09-19T09:03:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.546+0000 7efcc6ffd640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7efcbc03e230 0x7efcbc040620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.546+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcbc040b60 con 0x7efcbc03e230 2024-09-19T09:03:27.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.546+0000 7efcd5505640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7efcbc03e230 0x7efcbc040620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.548+0000 7efcd5505640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7efcbc03e230 0x7efcbc040620 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009880 tx=0x7efcc00314e0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.556+0000 7efcc6ffd640 1 -- 172.21.15.49:0/2627433327 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7efcbc040b60 con 0x7efcbc03e230 2024-09-19T09:03:27.557 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:03:27.557 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:03:27.557 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/23 daemons upgraded", 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:03:27.558 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:03:27.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7efcbc03e230 msgr2=0x7efcbc040620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7efcbc03e230 0x7efcbc040620 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009880 tx=0x7efcc00314e0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0100680 msgr2=0x7efcd0197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0100680 0x7efcd0197910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efccc00d900 tx=0x7efccc00ddc0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 shutdown_connections 2024-09-19T09:03:27.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7efcbc03e230 0x7efcbc040620 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efcd0102fb0 0x7efcd0197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 --2- 172.21.15.49:0/2627433327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efcd0100680 0x7efcd0197910 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 >> 172.21.15.49:0/2627433327 conn(0x7efcd00fa280 msgr2=0x7efcd00ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 shutdown_connections 2024-09-19T09:03:27.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.560+0000 7efcd7f6a640 1 -- 172.21.15.49:0/2627433327 wait complete. 2024-09-19T09:03:27.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.672+0000 7fc8427a0640 1 -- 172.21.15.49:0/621455425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c102fb0 msgr2=0x7fc83c1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.672+0000 7fc8427a0640 1 --2- 172.21.15.49:0/621455425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c102fb0 0x7fc83c1053a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc8300098b0 tx=0x7fc83002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.672+0000 7fc8427a0640 1 -- 172.21.15.49:0/621455425 shutdown_connections 2024-09-19T09:03:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.672+0000 7fc8427a0640 1 --2- 172.21.15.49:0/621455425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c102fb0 0x7fc83c1053a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.672+0000 7fc8427a0640 1 --2- 172.21.15.49:0/621455425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c100680 0x7fc83c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.672+0000 7fc8427a0640 1 -- 172.21.15.49:0/621455425 >> 172.21.15.49:0/621455425 conn(0x7fc83c0fa280 msgr2=0x7fc83c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.673+0000 7fc8427a0640 1 -- 172.21.15.49:0/621455425 shutdown_connections 2024-09-19T09:03:27.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.673+0000 7fc8427a0640 1 -- 172.21.15.49:0/621455425 wait complete. 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.673+0000 7fc8427a0640 1 Processor -- start 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc8427a0640 1 -- start start 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc8427a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c100680 0x7fc83c0fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc8427a0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c102fb0 0x7fc83c0fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc8427a0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1990e0 con 0x7fc83c100680 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc8427a0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c199250 con 0x7fc83c102fb0 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc83b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c102fb0 0x7fc83c0fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc83b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c102fb0 0x7fc83c0fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:45284/0 (socket says 172.21.15.49:45284) 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc83b7fe640 1 -- 172.21.15.49:0/2321264652 learned_addr learned my addr 172.21.15.49:0/2321264652 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:27.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.674+0000 7fc83bfff640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c100680 0x7fc83c0fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc83b7fe640 1 -- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c100680 msgr2=0x7fc83c0fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc83b7fe640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c100680 0x7fc83c0fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc83b7fe640 1 -- 172.21.15.49:0/2321264652 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830009560 con 0x7fc83c102fb0 2024-09-19T09:03:27.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc83b7fe640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c102fb0 0x7fc83c0fe630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc830009230 tx=0x7fc8300045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc8397fa640 1 -- 172.21.15.49:0/2321264652 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8300053e0 con 0x7fc83c102fb0 2024-09-19T09:03:27.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc8397fa640 1 -- 172.21.15.49:0/2321264652 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc830005540 con 0x7fc83c102fb0 2024-09-19T09:03:27.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c0feb70 con 0x7fc83c102fb0 2024-09-19T09:03:27.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc8397fa640 1 -- 172.21.15.49:0/2321264652 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc830003c70 con 0x7fc83c102fb0 2024-09-19T09:03:27.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.675+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c0ff060 con 0x7fc83c102fb0 2024-09-19T09:03:27.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.676+0000 7fc8397fa640 1 -- 172.21.15.49:0/2321264652 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 29) v1 ==== 46258+0+0 (secure 0 0 0) 0x7fc83003c470 con 0x7fc83c102fb0 2024-09-19T09:03:27.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.677+0000 7fc8397fa640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc824039150 0x7fc82403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.677+0000 7fc8397fa640 1 -- 172.21.15.49:0/2321264652 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc83006e2a0 con 0x7fc83c102fb0 2024-09-19T09:03:27.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.677+0000 7fc83bfff640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc824039150 0x7fc82403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.677+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0ff400 con 0x7fc83c102fb0 2024-09-19T09:03:27.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.678+0000 7fc83bfff640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc824039150 0x7fc82403b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009b60 tx=0x7fc82c005f90 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:27.682+0000 7fc8397fa640 1 -- 172.21.15.49:0/2321264652 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fc830035080 con 0x7fc83c102fb0 2024-09-19T09:03:27.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:27 smithi102 ceph-mon[35280]: Manager daemon smithi049.qdvksw is now available 2024-09-19T09:03:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:27 smithi049 ceph-mon[28158]: Manager daemon smithi049.qdvksw is now available 2024-09-19T09:03:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:03:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:27.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T09:03:28.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.094+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc83c1087e0 con 0x7fc83c102fb0 2024-09-19T09:03:28.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.094+0000 7fc8397fa640 1 -- 172.21.15.49:0/2321264652 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc830040070 con 0x7fc83c102fb0 2024-09-19T09:03:28.095 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:03:28.095 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:03:28.095 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:03:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.096+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc824039150 msgr2=0x7fc82403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.096+0000 7fc8427a0640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc824039150 0x7fc82403b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009b60 tx=0x7fc82c005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.096+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c102fb0 msgr2=0x7fc83c0fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.096+0000 7fc8427a0640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c102fb0 0x7fc83c0fe630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc830009230 tx=0x7fc8300045e0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.097+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 shutdown_connections 2024-09-19T09:03:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.097+0000 7fc8427a0640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc824039150 0x7fc82403b610 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.097+0000 7fc8427a0640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c102fb0 0x7fc83c0fe630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.097+0000 7fc8427a0640 1 --2- 172.21.15.49:0/2321264652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc83c100680 0x7fc83c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.097+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 >> 172.21.15.49:0/2321264652 conn(0x7fc83c0fa280 msgr2=0x7fc83c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.097+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 shutdown_connections 2024-09-19T09:03:28.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:28.097+0000 7fc8427a0640 1 -- 172.21.15.49:0/2321264652 wait complete. 2024-09-19T09:03:28.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:28 smithi049 ceph-mon[28158]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:28.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:28 smithi049 ceph-mon[28158]: mgrmap e29: smithi049.qdvksw(active, since 1.15568s) 2024-09-19T09:03:28.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:28 smithi049 ceph-mon[28158]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:28.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:28 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/2321264652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:03:28.881 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:28 smithi102 ceph-mon[35280]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:28.881 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:28 smithi102 ceph-mon[35280]: mgrmap e29: smithi049.qdvksw(active, since 1.15568s) 2024-09-19T09:03:28.881 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:28 smithi102 ceph-mon[35280]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:28.882 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:28 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2321264652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:03:29.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:29 smithi049 ceph-mon[28158]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:29.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:29 smithi049 ceph-mon[28158]: mgrmap e30: smithi049.qdvksw(active, since 2s) 2024-09-19T09:03:29.812 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:29 smithi102 ceph-mon[35280]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:29.813 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:29 smithi102 ceph-mon[35280]: mgrmap e30: smithi049.qdvksw(active, since 2s) 2024-09-19T09:03:30.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:30 smithi102 ceph-mon[35280]: [19/Sep/2024:09:03:29] ENGINE Bus STARTING 2024-09-19T09:03:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:30 smithi102 ceph-mon[35280]: [19/Sep/2024:09:03:29] ENGINE Serving on http://172.21.15.49:8765 2024-09-19T09:03:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:30 smithi102 ceph-mon[35280]: [19/Sep/2024:09:03:30] ENGINE Serving on https://172.21.15.49:7150 2024-09-19T09:03:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:30 smithi102 ceph-mon[35280]: [19/Sep/2024:09:03:30] ENGINE Bus STARTED 2024-09-19T09:03:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:30 smithi102 ceph-mon[35280]: [19/Sep/2024:09:03:30] ENGINE Error in HTTPServer.serve 2024-09-19T09:03:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Traceback (most recent call last): 2024-09-19T09:03:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:03:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._run(expiration_interval) 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:03:30.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: s = self.context.wrap_socket( 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: return self.sslsocket_class._create( 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self.do_handshake() 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._sslobj.do_handshake() 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:03:30.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:30 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:30.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:30 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:30.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:30 smithi049 ceph-mon[28158]: [19/Sep/2024:09:03:29] ENGINE Bus STARTING 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:30 smithi049 ceph-mon[28158]: [19/Sep/2024:09:03:29] ENGINE Serving on http://172.21.15.49:8765 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:30 smithi049 ceph-mon[28158]: [19/Sep/2024:09:03:30] ENGINE Serving on https://172.21.15.49:7150 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:30 smithi049 ceph-mon[28158]: [19/Sep/2024:09:03:30] ENGINE Bus STARTED 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:30 smithi049 ceph-mon[28158]: [19/Sep/2024:09:03:30] ENGINE Error in HTTPServer.serve 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Traceback (most recent call last): 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._run(expiration_interval) 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:03:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s = self.context.wrap_socket( 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: return self.sslsocket_class._create( 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self.do_handshake() 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._sslobj.do_handshake() 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:30 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:30.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:30 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:31.879 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:31 smithi049 ceph-mon[28158]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:31.879 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:31 smithi049 ceph-mon[28158]: mgrmap e31: smithi049.qdvksw(active, since 4s) 2024-09-19T09:03:31.879 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:31 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:31.879 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:31 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:32.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:31 smithi102 ceph-mon[35280]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:32.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:31 smithi102 ceph-mon[35280]: mgrmap e31: smithi049.qdvksw(active, since 4s) 2024-09-19T09:03:32.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:31 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:32.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:31 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:32.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:32 smithi049 ceph-mon[28158]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:03:32.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:32 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:03:32.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:32 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:32.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:32 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:03:32.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:32 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:33.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:32 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:03:33.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:32 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:03:33.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:32 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:03:33.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:32 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:03:33.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:32 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/3289381012' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:03:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:33 smithi102 ceph-mon[35280]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:33 smithi102 ceph-mon[35280]: mgrmap e32: smithi049.qdvksw(active, since 6s), standbys: smithi102.csalqv 2024-09-19T09:03:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:33 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T09:03:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:33 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:34.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:33 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:34.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:33 smithi049 ceph-mon[28158]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail 2024-09-19T09:03:34.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:33 smithi049 ceph-mon[28158]: mgrmap e32: smithi049.qdvksw(active, since 6s), standbys: smithi102.csalqv 2024-09-19T09:03:34.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:33 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T09:03:34.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:33 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:34.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:33 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:35.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:35 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:35.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:35 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:35.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:35 smithi049 ceph-mon[28158]: pgmap v7: 65 pgs: 65 active+clean; 1.2 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 129 op/s 2024-09-19T09:03:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:35 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:35 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:35.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:35 smithi102 ceph-mon[35280]: pgmap v7: 65 pgs: 65 active+clean; 1.2 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 129 op/s 2024-09-19T09:03:37.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:37 smithi102 ceph-mon[35280]: pgmap v8: 65 pgs: 65 active+clean; 1.2 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 818 KiB/s rd, 966 KiB/s wr, 100 op/s 2024-09-19T09:03:37.778 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:37 smithi049 ceph-mon[28158]: pgmap v8: 65 pgs: 65 active+clean; 1.2 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 818 KiB/s rd, 966 KiB/s wr, 100 op/s 2024-09-19T09:03:39.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: pgmap v9: 65 pgs: 65 active+clean; 700 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 161 op/s 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:39.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:39 smithi049 ceph-mon[28158]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:39.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:39.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:39.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: pgmap v9: 65 pgs: 65 active+clean; 700 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 161 op/s 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:03:39.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:39 smithi102 ceph-mon[35280]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:40.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:40.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.621 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2024-09-19T09:03:40.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:40 smithi049 ceph-mon[28158]: Reconfiguring daemon prometheus.smithi049 on smithi049 2024-09-19T09:03:40.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:03:40.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:03:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: Reconfiguring prometheus.smithi049 (dependencies changed)... 2024-09-19T09:03:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:40 smithi102 ceph-mon[35280]: Reconfiguring daemon prometheus.smithi049 on smithi049 2024-09-19T09:03:41.081 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:03:41.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:03:41.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:41 smithi049 ceph-mon[28158]: pgmap v10: 65 pgs: 65 active+clean; 700 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-09-19T09:03:41.659 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:41 smithi102 ceph-mon[35280]: pgmap v10: 65 pgs: 65 active+clean; 700 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-09-19T09:03:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:42 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:42.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:42 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:43.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:43 smithi102 ceph-mon[35280]: pgmap v11: 65 pgs: 65 active+clean; 700 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-09-19T09:03:43.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:43 smithi049 ceph-mon[28158]: pgmap v11: 65 pgs: 65 active+clean; 700 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-09-19T09:03:45.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:45 smithi102 ceph-mon[35280]: pgmap v12: 65 pgs: 65 active+clean; 368 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-19T09:03:45.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:45 smithi049 ceph-mon[28158]: pgmap v12: 65 pgs: 65 active+clean; 368 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-19T09:03:47.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:47 smithi102 ceph-mon[35280]: pgmap v13: 65 pgs: 65 active+clean; 368 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 128 op/s 2024-09-19T09:03:47.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:47 smithi049 ceph-mon[28158]: pgmap v13: 65 pgs: 65 active+clean; 368 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 128 op/s 2024-09-19T09:03:49.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:49 smithi102 ceph-mon[35280]: pgmap v14: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 190 op/s 2024-09-19T09:03:49.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:49 smithi049 ceph-mon[28158]: pgmap v14: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 190 op/s 2024-09-19T09:03:51.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:51 smithi049 ceph-mon[28158]: pgmap v15: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 118 op/s 2024-09-19T09:03:51.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:51 smithi102 ceph-mon[35280]: pgmap v15: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 118 op/s 2024-09-19T09:03:53.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:53 smithi102 ceph-mon[35280]: pgmap v16: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 118 op/s 2024-09-19T09:03:53.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:53 smithi049 ceph-mon[28158]: pgmap v16: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 118 op/s 2024-09-19T09:03:55.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:55 smithi102 ceph-mon[35280]: pgmap v17: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-09-19T09:03:55.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:55 smithi049 ceph-mon[28158]: pgmap v17: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-09-19T09:03:57.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:57 smithi102 ceph-mon[35280]: pgmap v18: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 113 op/s 2024-09-19T09:03:57.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:57 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:57.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:57 smithi049 ceph-mon[28158]: pgmap v18: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 113 op/s 2024-09-19T09:03:57.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:57 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:03:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 -- 172.21.15.49:0/1265980201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440ff3e0 msgr2=0x7f30440ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 --2- 172.21.15.49:0/1265980201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440ff3e0 0x7f30440ff860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f303800aa10 tx=0x7f303802c8f0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 -- 172.21.15.49:0/1265980201 shutdown_connections 2024-09-19T09:03:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 --2- 172.21.15.49:0/1265980201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440ff3e0 0x7f30440ff860 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 --2- 172.21.15.49:0/1265980201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30440fe1e0 0x7f30440fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 -- 172.21.15.49:0/1265980201 >> 172.21.15.49:0/1265980201 conn(0x7f30440f9950 msgr2=0x7f30440fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 -- 172.21.15.49:0/1265980201 shutdown_connections 2024-09-19T09:03:58.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.212+0000 7f30491d5640 1 -- 172.21.15.49:0/1265980201 wait complete. 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.213+0000 7f30491d5640 1 Processor -- start 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.213+0000 7f30491d5640 1 -- start start 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.213+0000 7f30491d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440fe1e0 0x7f3044193430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.213+0000 7f30491d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30440ff3e0 0x7f3044193970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.213+0000 7f30491d5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3044193f40 con 0x7f30440fe1e0 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.213+0000 7f30491d5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30441940b0 con 0x7f30440ff3e0 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.214+0000 7f3042d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440fe1e0 0x7f3044193430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.214+0000 7f3042d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440fe1e0 0x7f3044193430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51294/0 (socket says 172.21.15.49:51294) 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.214+0000 7f3042d9d640 1 -- 172.21.15.49:0/767681133 learned_addr learned my addr 172.21.15.49:0/767681133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:58.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.214+0000 7f304259c640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30440ff3e0 0x7f3044193970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.214+0000 7f3042d9d640 1 -- 172.21.15.49:0/767681133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30440ff3e0 msgr2=0x7f3044193970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.214+0000 7f3042d9d640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30440ff3e0 0x7f3044193970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.214+0000 7f3042d9d640 1 -- 172.21.15.49:0/767681133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303800a670 con 0x7f30440fe1e0 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.215+0000 7f3042d9d640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440fe1e0 0x7f3044193430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f303400d720 tx=0x7f303400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.215+0000 7f302bfff640 1 -- 172.21.15.49:0/767681133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30340041f0 con 0x7f30440fe1e0 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.215+0000 7f302bfff640 1 -- 172.21.15.49:0/767681133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3034004350 con 0x7f30440fe1e0 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.216+0000 7f302bfff640 1 -- 172.21.15.49:0/767681133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3034003df0 con 0x7f30440fe1e0 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.216+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3044198b50 con 0x7f30440fe1e0 2024-09-19T09:03:58.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.216+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3044199070 con 0x7f30440fe1e0 2024-09-19T09:03:58.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.217+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304418d4d0 con 0x7f30440fe1e0 2024-09-19T09:03:58.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.219+0000 7f302bfff640 1 -- 172.21.15.49:0/767681133 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f30340035f0 con 0x7f30440fe1e0 2024-09-19T09:03:58.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.220+0000 7f302bfff640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f302c06e3f0 0x7f302c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.220+0000 7f302bfff640 1 -- 172.21.15.49:0/767681133 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f303408e110 con 0x7f30440fe1e0 2024-09-19T09:03:58.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.220+0000 7f304259c640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f302c06e3f0 0x7f302c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.221+0000 7f304259c640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f302c06e3f0 0x7f302c0708b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3038006010 tx=0x7f3038032660 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.228+0000 7f302bfff640 1 -- 172.21.15.49:0/767681133 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f30340576e0 con 0x7f30440fe1e0 2024-09-19T09:03:58.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.501+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f304402c610 con 0x7f302c06e3f0 2024-09-19T09:03:58.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.502+0000 7f302bfff640 1 -- 172.21.15.49:0/767681133 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f304402c610 con 0x7f302c06e3f0 2024-09-19T09:03:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f302c06e3f0 msgr2=0x7f302c0708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f302c06e3f0 0x7f302c0708b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3038006010 tx=0x7f3038032660 comp rx=0 tx=0).stop 2024-09-19T09:03:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440fe1e0 msgr2=0x7f3044193430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440fe1e0 0x7f3044193430 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f303400d720 tx=0x7f303400dbe0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 shutdown_connections 2024-09-19T09:03:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f302c06e3f0 0x7f302c0708b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30440ff3e0 0x7f3044193970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 --2- 172.21.15.49:0/767681133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f30440fe1e0 0x7f3044193430 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 >> 172.21.15.49:0/767681133 conn(0x7f30440f9950 msgr2=0x7f3044102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 shutdown_connections 2024-09-19T09:03:58.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.504+0000 7f30491d5640 1 -- 172.21.15.49:0/767681133 wait complete. 2024-09-19T09:03:58.512 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:03:58.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 -- 172.21.15.49:0/1538931935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 msgr2=0x7faa5c107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 --2- 172.21.15.49:0/1538931935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c107810 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faa58009880 tx=0x7faa5802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 -- 172.21.15.49:0/1538931935 shutdown_connections 2024-09-19T09:03:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 --2- 172.21.15.49:0/1538931935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c107810 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 --2- 172.21.15.49:0/1538931935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa5c1066c0 0x7faa5c106ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 -- 172.21.15.49:0/1538931935 >> 172.21.15.49:0/1538931935 conn(0x7faa5c075370 msgr2=0x7faa5c077790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 -- 172.21.15.49:0/1538931935 shutdown_connections 2024-09-19T09:03:58.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.601+0000 7faa63951640 1 -- 172.21.15.49:0/1538931935 wait complete. 2024-09-19T09:03:58.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa63951640 1 Processor -- start 2024-09-19T09:03:58.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa63951640 1 -- start start 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa63951640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa5c1066c0 0x7faa5c19bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa63951640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c19c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa63951640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c19c770 con 0x7faa5c107390 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa63951640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c19c8e0 con 0x7faa5c1066c0 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa60eec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c19c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.602+0000 7faa60eec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c19c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51308/0 (socket says 172.21.15.49:51308) 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa60eec640 1 -- 172.21.15.49:0/580341122 learned_addr learned my addr 172.21.15.49:0/580341122 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa616ed640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa5c1066c0 0x7faa5c19bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa60eec640 1 -- 172.21.15.49:0/580341122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa5c1066c0 msgr2=0x7faa5c19bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa60eec640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa5c1066c0 0x7faa5c19bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa60eec640 1 -- 172.21.15.49:0/580341122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58009560 con 0x7faa5c107390 2024-09-19T09:03:58.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa60eec640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c19c1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faa58004650 tx=0x7faa580055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa527fc640 1 -- 172.21.15.49:0/580341122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa58004aa0 con 0x7faa5c107390 2024-09-19T09:03:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa527fc640 1 -- 172.21.15.49:0/580341122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa58005d50 con 0x7faa5c107390 2024-09-19T09:03:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c1a12c0 con 0x7faa5c107390 2024-09-19T09:03:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.603+0000 7faa527fc640 1 -- 172.21.15.49:0/580341122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa580039e0 con 0x7faa5c107390 2024-09-19T09:03:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.604+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c1a1830 con 0x7faa5c107390 2024-09-19T09:03:58.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.605+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c195d30 con 0x7faa5c107390 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.605+0000 7faa527fc640 1 -- 172.21.15.49:0/580341122 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7faa58003ca0 con 0x7faa5c107390 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.606+0000 7faa527fc640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7faa4806e3b0 0x7faa48070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.606+0000 7faa527fc640 1 -- 172.21.15.49:0/580341122 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7faa580af440 con 0x7faa5c107390 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.606+0000 7faa616ed640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7faa4806e3b0 0x7faa48070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.607+0000 7faa616ed640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7faa4806e3b0 0x7faa48070870 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa5c19d0f0 tx=0x7faa4c005f90 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.611+0000 7faa527fc640 1 -- 172.21.15.49:0/580341122 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7faa580788f0 con 0x7faa5c107390 2024-09-19T09:03:58.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.951+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa5c0608f0 con 0x7faa4806e3b0 2024-09-19T09:03:58.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.952+0000 7faa527fc640 1 -- 172.21.15.49:0/580341122 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7faa5c0608f0 con 0x7faa4806e3b0 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7faa4806e3b0 msgr2=0x7faa48070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7faa4806e3b0 0x7faa48070870 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa5c19d0f0 tx=0x7faa4c005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 msgr2=0x7faa5c19c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c19c1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faa58004650 tx=0x7faa580055a0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 shutdown_connections 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7faa4806e3b0 0x7faa48070870 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa5c107390 0x7faa5c19c1a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 --2- 172.21.15.49:0/580341122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa5c1066c0 0x7faa5c19bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 >> 172.21.15.49:0/580341122 conn(0x7faa5c075370 msgr2=0x7faa5c10aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 shutdown_connections 2024-09-19T09:03:58.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:58.955+0000 7faa63951640 1 -- 172.21.15.49:0/580341122 wait complete. 2024-09-19T09:03:59.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 -- 172.21.15.49:0/1874286318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8100690 msgr2=0x7f2aa8102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/1874286318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8100690 0x7f2aa8102a80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009880 tx=0x7f2a9802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 -- 172.21.15.49:0/1874286318 shutdown_connections 2024-09-19T09:03:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/1874286318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8102fc0 0x7f2aa81053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/1874286318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8100690 0x7f2aa8102a80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 -- 172.21.15.49:0/1874286318 >> 172.21.15.49:0/1874286318 conn(0x7f2aa80fa230 msgr2=0x7f2aa80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 -- 172.21.15.49:0/1874286318 shutdown_connections 2024-09-19T09:03:59.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.054+0000 7f2aae4ad640 1 -- 172.21.15.49:0/1874286318 wait complete. 2024-09-19T09:03:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.055+0000 7f2aae4ad640 1 Processor -- start 2024-09-19T09:03:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.055+0000 7f2aae4ad640 1 -- start start 2024-09-19T09:03:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aae4ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8100690 0x7f2aa8195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aae4ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8102fc0 0x7f2aa8195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aae4ad640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8196160 con 0x7f2aa8102fc0 2024-09-19T09:03:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aae4ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa81962d0 con 0x7f2aa8100690 2024-09-19T09:03:59.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8100690 0x7f2aa8195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8100690 0x7f2aa8195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:48066/0 (socket says 172.21.15.49:48066) 2024-09-19T09:03:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aa7fff640 1 -- 172.21.15.49:0/4099321340 learned_addr learned my addr 172.21.15.49:0/4099321340 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aa77fe640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8102fc0 0x7f2aa8195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aa7fff640 1 -- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8102fc0 msgr2=0x7f2aa8195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aa7fff640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8102fc0 0x7f2aa8195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.056+0000 7f2aa7fff640 1 -- 172.21.15.49:0/4099321340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98009560 con 0x7f2aa8100690 2024-09-19T09:03:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.057+0000 7f2aa7fff640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8100690 0x7f2aa8195650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a98004650 tx=0x7f2a980055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.057+0000 7f2aa57fa640 1 -- 172.21.15.49:0/4099321340 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a98004aa0 con 0x7f2aa8100690 2024-09-19T09:03:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.057+0000 7f2aa57fa640 1 -- 172.21.15.49:0/4099321340 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a98005d50 con 0x7f2aa8100690 2024-09-19T09:03:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.057+0000 7f2aa57fa640 1 -- 172.21.15.49:0/4099321340 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a980039b0 con 0x7f2aa8100690 2024-09-19T09:03:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.057+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa819ad20 con 0x7f2aa8100690 2024-09-19T09:03:59.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.057+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa819b240 con 0x7f2aa8100690 2024-09-19T09:03:59.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.058+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa8108770 con 0x7f2aa8100690 2024-09-19T09:03:59.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.059+0000 7f2aa57fa640 1 -- 172.21.15.49:0/4099321340 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f2a98003c30 con 0x7f2aa8100690 2024-09-19T09:03:59.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.059+0000 7f2aa57fa640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f2a9006e3b0 0x7f2a90070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.059+0000 7f2aa57fa640 1 -- 172.21.15.49:0/4099321340 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2a980af4b0 con 0x7f2aa8100690 2024-09-19T09:03:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.060+0000 7f2aa77fe640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f2a9006e3b0 0x7f2a90070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.060+0000 7f2aa77fe640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f2a9006e3b0 0x7f2a90070870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8196b20 tx=0x7f2a9c005f90 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.064+0000 7f2aa57fa640 1 -- 172.21.15.49:0/4099321340 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f2a980788b0 con 0x7f2aa8100690 2024-09-19T09:03:59.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.282+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2aa81039e0 con 0x7f2a9006e3b0 2024-09-19T09:03:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.293+0000 7f2aa57fa640 1 -- 172.21.15.49:0/4099321340 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f2aa81039e0 con 0x7f2a9006e3b0 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (8m) 25s ago 9m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (9m) 25s ago 9m 8102k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (8m) 28s ago 8m 7940k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 25s ago 9m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (8m) 28s ago 8m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (8m) 25s ago 9m 85.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (4m) 25s ago 4m 281M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (4m) 25s ago 4m 249M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:03:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (4m) 28s ago 4m 25.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (4m) 28s ago 4m 24.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (72s) 25s ago 10m 473M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (2m) 28s ago 8m 126M - 19.1.1-361-g2f599a46 d2baa855c067 83adb7fb6aac 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (10m) 25s ago 10m 54.7M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (8m) 28s ago 8m 45.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (9m) 25s ago 9m 15.7M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (8m) 28s ago 8m 16.4M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 25s ago 7m 172M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 25s ago 7m 189M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 25s ago 6m 163M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (6m) 28s ago 6m 209M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (6m) 28s ago 6m 186M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:03:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (5m) 28s ago 5m 186M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:03:59.295 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (89s) 25s ago 9m 53.8M - 2.43.0 a07b618ecd1d 074a8755488c 2024-09-19T09:03:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f2a9006e3b0 msgr2=0x7f2a90070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f2a9006e3b0 0x7f2a90070870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8196b20 tx=0x7f2a9c005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8100690 msgr2=0x7f2aa8195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8100690 0x7f2aa8195650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a98004650 tx=0x7f2a980055a0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 shutdown_connections 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f2a9006e3b0 0x7f2a90070870 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2aa8102fc0 0x7f2aa8195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 --2- 172.21.15.49:0/4099321340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aa8100690 0x7f2aa8195650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 >> 172.21.15.49:0/4099321340 conn(0x7f2aa80fa230 msgr2=0x7f2aa80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 shutdown_connections 2024-09-19T09:03:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.295+0000 7f2aae4ad640 1 -- 172.21.15.49:0/4099321340 wait complete. 2024-09-19T09:03:59.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 -- 172.21.15.49:0/2327738876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fe4d0 msgr2=0x7f49d80fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 --2- 172.21.15.49:0/2327738876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fe4d0 0x7f49d80fe8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49c80097e0 tx=0x7f49c802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 -- 172.21.15.49:0/2327738876 shutdown_connections 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 --2- 172.21.15.49:0/2327738876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fee10 0x7f49d80ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 --2- 172.21.15.49:0/2327738876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fe4d0 0x7f49d80fe8d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 -- 172.21.15.49:0/2327738876 >> 172.21.15.49:0/2327738876 conn(0x7f49d80fa280 msgr2=0x7f49d80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 -- 172.21.15.49:0/2327738876 shutdown_connections 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.399+0000 7f49dd99f640 1 -- 172.21.15.49:0/2327738876 wait complete. 2024-09-19T09:03:59.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.400+0000 7f49dd99f640 1 Processor -- start 2024-09-19T09:03:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.400+0000 7f49dd99f640 1 -- start start 2024-09-19T09:03:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.400+0000 7f49dd99f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fe4d0 0x7f49d8197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.400+0000 7f49dd99f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fee10 0x7f49d8197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49dd99f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8198370 con 0x7f49d80fe4d0 2024-09-19T09:03:59.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49dd99f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81984e0 con 0x7f49d80fee10 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fe4d0 0x7f49d8197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d67fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fee10 0x7f49d8197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fe4d0 0x7f49d8197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51340/0 (socket says 172.21.15.49:51340) 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d6ffd640 1 -- 172.21.15.49:0/3881383405 learned_addr learned my addr 172.21.15.49:0/3881383405 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d67fc640 1 -- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fe4d0 msgr2=0x7f49d8197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d67fc640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fe4d0 0x7f49d8197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d67fc640 1 -- 172.21.15.49:0/3881383405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c8009490 con 0x7f49d80fee10 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d6ffd640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fe4d0 0x7f49d8197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:59.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.401+0000 7f49d67fc640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fee10 0x7f49d8197da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00e710 tx=0x7f49cc00ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.402+0000 7f49dc99d640 1 -- 172.21.15.49:0/3881383405 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49cc00ca80 con 0x7f49d80fee10 2024-09-19T09:03:59.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.402+0000 7f49dc99d640 1 -- 172.21.15.49:0/3881383405 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49cc00cbe0 con 0x7f49d80fee10 2024-09-19T09:03:59.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.402+0000 7f49dc99d640 1 -- 172.21.15.49:0/3881383405 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49cc018700 con 0x7f49d80fee10 2024-09-19T09:03:59.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.402+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d819cf80 con 0x7f49d80fee10 2024-09-19T09:03:59.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.402+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d819d4a0 con 0x7f49d80fee10 2024-09-19T09:03:59.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.403+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d80fe8d0 con 0x7f49d80fee10 2024-09-19T09:03:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.403+0000 7f49dc99d640 1 -- 172.21.15.49:0/3881383405 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f49cc00cd50 con 0x7f49d80fee10 2024-09-19T09:03:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.404+0000 7f49dc99d640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f49c006e3a0 0x7f49c0070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.404+0000 7f49dc99d640 1 -- 172.21.15.49:0/3881383405 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f49cc014070 con 0x7f49d80fee10 2024-09-19T09:03:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.404+0000 7f49d6ffd640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f49c006e3a0 0x7f49c0070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.405+0000 7f49d6ffd640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f49c006e3a0 0x7f49c0070860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49c80097b0 tx=0x7f49c8030870 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.408+0000 7f49dc99d640 1 -- 172.21.15.49:0/3881383405 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f49cc053d60 con 0x7f49d80fee10 2024-09-19T09:03:59.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:59 smithi049 ceph-mon[28158]: pgmap v19: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 168 op/s 2024-09-19T09:03:59.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:59 smithi049 ceph-mon[28158]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:59.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:03:59 smithi049 ceph-mon[28158]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:59.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:59 smithi102 ceph-mon[35280]: pgmap v19: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 168 op/s 2024-09-19T09:03:59.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:59 smithi102 ceph-mon[35280]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:59.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:03:59 smithi102 ceph-mon[35280]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:59.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.812+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f49d8191950 con 0x7f49d80fee10 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.813+0000 7f49dc99d640 1 -- 172.21.15.49:0/3881383405 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f49cc057b50 con 0x7f49d80fee10 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:59.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 12, 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:03:59.814 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:03:59.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.815+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f49c006e3a0 msgr2=0x7f49c0070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.815+0000 7f49dd99f640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f49c006e3a0 0x7f49c0070860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49c80097b0 tx=0x7f49c8030870 comp rx=0 tx=0).stop 2024-09-19T09:03:59.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.815+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fee10 msgr2=0x7f49d8197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.815+0000 7f49dd99f640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fee10 0x7f49d8197da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00e710 tx=0x7f49cc00ebd0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.816+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 shutdown_connections 2024-09-19T09:03:59.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.816+0000 7f49dd99f640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f49c006e3a0 0x7f49c0070860 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.816+0000 7f49dd99f640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d80fee10 0x7f49d8197da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.816+0000 7f49dd99f640 1 --2- 172.21.15.49:0/3881383405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49d80fe4d0 0x7f49d8197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.816+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 >> 172.21.15.49:0/3881383405 conn(0x7f49d80fa280 msgr2=0x7f49d8106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:59.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.816+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 shutdown_connections 2024-09-19T09:03:59.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.816+0000 7f49dd99f640 1 -- 172.21.15.49:0/3881383405 wait complete. 2024-09-19T09:03:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.940+0000 7fceebe7d640 1 -- 172.21.15.49:0/3990668242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40ffca0 msgr2=0x7fcee4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.940+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3990668242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40ffca0 0x7fcee4100120 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fced4009880 tx=0x7fced402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.940+0000 7fceebe7d640 1 -- 172.21.15.49:0/3990668242 shutdown_connections 2024-09-19T09:03:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.940+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3990668242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40ffca0 0x7fcee4100120 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.940+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3990668242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40feaa0 0x7fcee40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.940+0000 7fceebe7d640 1 -- 172.21.15.49:0/3990668242 >> 172.21.15.49:0/3990668242 conn(0x7fcee40fa250 msgr2=0x7fcee40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:59.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.941+0000 7fceebe7d640 1 -- 172.21.15.49:0/3990668242 shutdown_connections 2024-09-19T09:03:59.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.941+0000 7fceebe7d640 1 -- 172.21.15.49:0/3990668242 wait complete. 2024-09-19T09:03:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fceebe7d640 1 Processor -- start 2024-09-19T09:03:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fceebe7d640 1 -- start start 2024-09-19T09:03:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fceebe7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40feaa0 0x7fcee4195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fceebe7d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40ffca0 0x7fcee4195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fceebe7d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4196120 con 0x7fcee40feaa0 2024-09-19T09:03:59.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fcee9c19640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40feaa0 0x7fcee4195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fceebe7d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4196290 con 0x7fcee40ffca0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fcee9418640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40ffca0 0x7fcee4195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fcee9418640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40ffca0 0x7fcee4195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:48094/0 (socket says 172.21.15.49:48094) 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.942+0000 7fcee9418640 1 -- 172.21.15.49:0/3752675151 learned_addr learned my addr 172.21.15.49:0/3752675151 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fcee9418640 1 -- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40feaa0 msgr2=0x7fcee4195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fcee9418640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40feaa0 0x7fcee4195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fcee9418640 1 -- 172.21.15.49:0/3752675151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4009560 con 0x7fcee40ffca0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fcee9418640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40ffca0 0x7fcee4195b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fced4004650 tx=0x7fced40055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fcedaffd640 1 -- 172.21.15.49:0/3752675151 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced4004aa0 con 0x7fcee40ffca0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee419acd0 con 0x7fcee40ffca0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fcedaffd640 1 -- 172.21.15.49:0/3752675151 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fced4005d50 con 0x7fcee40ffca0 2024-09-19T09:03:59.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fcedaffd640 1 -- 172.21.15.49:0/3752675151 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced40039b0 con 0x7fcee40ffca0 2024-09-19T09:03:59.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.943+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee419b240 con 0x7fcee40ffca0 2024-09-19T09:03:59.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.945+0000 7fcedaffd640 1 -- 172.21.15.49:0/3752675151 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fced4003c30 con 0x7fcee40ffca0 2024-09-19T09:03:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.945+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee4107690 con 0x7fcee40ffca0 2024-09-19T09:03:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.945+0000 7fcedaffd640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fced006e3b0 0x7fced0070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.945+0000 7fcedaffd640 1 -- 172.21.15.49:0/3752675151 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fced40af4f0 con 0x7fcee40ffca0 2024-09-19T09:03:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.945+0000 7fcee9c19640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fced006e3b0 0x7fced0070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.946+0000 7fcee9c19640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fced006e3b0 0x7fced0070870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ffb00 tx=0x7fcee0005f90 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:03:59.950+0000 7fcedaffd640 1 -- 172.21.15.49:0/3752675151 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fced4078900 con 0x7fcee40ffca0 2024-09-19T09:04:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.290+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcee419b430 con 0x7fcee40ffca0 2024-09-19T09:04:00.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.291+0000 7fcedaffd640 1 -- 172.21.15.49:0/3752675151 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7fced407bfc0 con 0x7fcee40ffca0 2024-09-19T09:04:00.291 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:04:00.291 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:04:00.291 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:00.291 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:04:00.291 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:04:00.291 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:04:00.291 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:04:00.292 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:04:00.293 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:04:00.294 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:04:00.294 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:04:00.294 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:04:00.294 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:04:00.294 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:04:00.295 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:04:00.295 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:00.295 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:00.295 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:00.295 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:00.295 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:04:00.295 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fced006e3b0 msgr2=0x7fced0070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fced006e3b0 0x7fced0070870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ffb00 tx=0x7fcee0005f90 comp rx=0 tx=0).stop 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40ffca0 msgr2=0x7fcee4195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40ffca0 0x7fcee4195b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fced4004650 tx=0x7fced40055a0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 shutdown_connections 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fced006e3b0 0x7fced0070870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcee40ffca0 0x7fcee4195b50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 --2- 172.21.15.49:0/3752675151 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcee40feaa0 0x7fcee4195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 >> 172.21.15.49:0/3752675151 conn(0x7fcee40fa250 msgr2=0x7fcee4068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 shutdown_connections 2024-09-19T09:04:00.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.294+0000 7fceebe7d640 1 -- 172.21.15.49:0/3752675151 wait complete. 2024-09-19T09:04:00.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 -- 172.21.15.49:0/910280572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c0ffb80 msgr2=0x7f9f2c0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 --2- 172.21.15.49:0/910280572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c0ffb80 0x7f9f2c0fff80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009880 tx=0x7f9f1c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 -- 172.21.15.49:0/910280572 shutdown_connections 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 --2- 172.21.15.49:0/910280572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f2c100d80 0x7f9f2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 --2- 172.21.15.49:0/910280572 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c0ffb80 0x7f9f2c0fff80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 -- 172.21.15.49:0/910280572 >> 172.21.15.49:0/910280572 conn(0x7f9f2c0fb310 msgr2=0x7f9f2c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 -- 172.21.15.49:0/910280572 shutdown_connections 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.400+0000 7f9f30e88640 1 -- 172.21.15.49:0/910280572 wait complete. 2024-09-19T09:04:00.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.401+0000 7f9f30e88640 1 Processor -- start 2024-09-19T09:04:00.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f30e88640 1 -- start start 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f30e88640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f2c0ffb80 0x7f9f2c06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f30e88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c100d80 0x7f9f2c06f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f30e88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c06fd50 con 0x7f9f2c100d80 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f30e88640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c06fec0 con 0x7f9f2c0ffb80 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f29d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c100d80 0x7f9f2c06f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f29d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c100d80 0x7f9f2c06f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34698/0 (socket says 172.21.15.49:34698) 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.402+0000 7f9f29d9b640 1 -- 172.21.15.49:0/297069628 learned_addr learned my addr 172.21.15.49:0/297069628 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:00.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.403+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f2c0ffb80 0x7f9f2c06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.403+0000 7f9f29d9b640 1 -- 172.21.15.49:0/297069628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f2c0ffb80 msgr2=0x7f9f2c06f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.403+0000 7f9f29d9b640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f2c0ffb80 0x7f9f2c06f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.403+0000 7f9f29d9b640 1 -- 172.21.15.49:0/297069628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c009560 con 0x7f9f2c100d80 2024-09-19T09:04:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.403+0000 7f9f29d9b640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c100d80 0x7f9f2c06f780 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000e970 tx=0x7f9f2000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.404+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/297069628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f2000cc90 con 0x7f9f2c100d80 2024-09-19T09:04:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.404+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/297069628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f2000cdf0 con 0x7f9f2c100d80 2024-09-19T09:04:00.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.404+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c070970 con 0x7f9f2c100d80 2024-09-19T09:04:00.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.404+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/297069628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f200188b0 con 0x7f9f2c100d80 2024-09-19T09:04:00.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.404+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c070e00 con 0x7f9f2c100d80 2024-09-19T09:04:00.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.406+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c005280 con 0x7f9f2c100d80 2024-09-19T09:04:00.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.407+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/297069628 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f9f20018a10 con 0x7f9f2c100d80 2024-09-19T09:04:00.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.407+0000 7f9f1b7fe640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f9f1406e430 0x7f9f140708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.408+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/297069628 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f9f20014070 con 0x7f9f2c100d80 2024-09-19T09:04:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.408+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f9f1406e430 0x7f9f140708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.409+0000 7f9f2a59c640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f9f1406e430 0x7f9f140708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000c00 tx=0x7f9f1c031500 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.416+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/297069628 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f9f20057e60 con 0x7f9f2c100d80 2024-09-19T09:04:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:00 smithi049 ceph-mon[28158]: from='client.24569 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:00 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3881383405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:00 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/3752675151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:04:00.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.738+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f0c000bf0 con 0x7f9f1406e430 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.740+0000 7f9f1b7fe640 1 -- 172.21.15.49:0/297069628 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9f0c000bf0 con 0x7f9f1406e430 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:04:00.740 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/23 daemons upgraded", 2024-09-19T09:04:00.741 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-09-19T09:04:00.741 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:04:00.741 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:04:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f9f1406e430 msgr2=0x7f9f140708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f9f1406e430 0x7f9f140708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000c00 tx=0x7f9f1c031500 comp rx=0 tx=0).stop 2024-09-19T09:04:00.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c100d80 msgr2=0x7f9f2c06f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c100d80 0x7f9f2c06f780 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000e970 tx=0x7f9f2000ee30 comp rx=0 tx=0).stop 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 shutdown_connections 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f9f1406e430 0x7f9f140708f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f2c100d80 0x7f9f2c06f780 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 --2- 172.21.15.49:0/297069628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f2c0ffb80 0x7f9f2c06f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 >> 172.21.15.49:0/297069628 conn(0x7f9f2c0fb310 msgr2=0x7f9f2c0fbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 shutdown_connections 2024-09-19T09:04:00.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.743+0000 7f9f30e88640 1 -- 172.21.15.49:0/297069628 wait complete. 2024-09-19T09:04:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:00 smithi102 ceph-mon[35280]: from='client.24569 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:00 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3881383405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:00.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:00 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/3752675151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:04:00.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.851+0000 7f3312077640 1 -- 172.21.15.49:0/3640802241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 msgr2=0x7f330c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.851+0000 7f3312077640 1 --2- 172.21.15.49:0/3640802241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 0x7f330c100170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3300009880 tx=0x7f330002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.851+0000 7f3312077640 1 -- 172.21.15.49:0/3640802241 shutdown_connections 2024-09-19T09:04:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.851+0000 7f3312077640 1 --2- 172.21.15.49:0/3640802241 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 0x7f330c100170 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.851+0000 7f3312077640 1 --2- 172.21.15.49:0/3640802241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f330c0feaf0 0x7f330c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.851+0000 7f3312077640 1 -- 172.21.15.49:0/3640802241 >> 172.21.15.49:0/3640802241 conn(0x7f330c0fa280 msgr2=0x7f330c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.852+0000 7f3312077640 1 -- 172.21.15.49:0/3640802241 shutdown_connections 2024-09-19T09:04:00.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.852+0000 7f3312077640 1 -- 172.21.15.49:0/3640802241 wait complete. 2024-09-19T09:04:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.852+0000 7f3312077640 1 Processor -- start 2024-09-19T09:04:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f3312077640 1 -- start start 2024-09-19T09:04:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f3312077640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f330c0feaf0 0x7f330c1956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f3312077640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 0x7f330c195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f3312077640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c1961e0 con 0x7f330c0ffcf0 2024-09-19T09:04:00.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f3312077640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c196350 con 0x7f330c0feaf0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f330affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 0x7f330c195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f330affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 0x7f330c195c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34722/0 (socket says 172.21.15.49:34722) 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f330c0feaf0 0x7f330c1956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f330affd640 1 -- 172.21.15.49:0/1954416669 learned_addr learned my addr 172.21.15.49:0/1954416669 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f330b7fe640 1 -- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 msgr2=0x7f330c195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f330b7fe640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 0x7f330c195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.853+0000 7f330b7fe640 1 -- 172.21.15.49:0/1954416669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300009560 con 0x7f330c0feaf0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.854+0000 7f330b7fe640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f330c0feaf0 0x7f330c1956d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00e940 tx=0x7f32fc00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.854+0000 7f3308ff9640 1 -- 172.21.15.49:0/1954416669 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32fc00cc90 con 0x7f330c0feaf0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.854+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c19adf0 con 0x7f330c0feaf0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.854+0000 7f3308ff9640 1 -- 172.21.15.49:0/1954416669 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32fc0044f0 con 0x7f330c0feaf0 2024-09-19T09:04:00.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.854+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c19b2c0 con 0x7f330c0feaf0 2024-09-19T09:04:00.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.854+0000 7f3308ff9640 1 -- 172.21.15.49:0/1954416669 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32fc010430 con 0x7f330c0feaf0 2024-09-19T09:04:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.856+0000 7f3308ff9640 1 -- 172.21.15.49:0/1954416669 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 32) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f32fc0106b0 con 0x7f330c0feaf0 2024-09-19T09:04:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.856+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f8005250 con 0x7f330c0feaf0 2024-09-19T09:04:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.857+0000 7f3308ff9640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f32f406e3b0 0x7f32f4070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.857+0000 7f3308ff9640 1 -- 172.21.15.49:0/1954416669 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f32fc014070 con 0x7f330c0feaf0 2024-09-19T09:04:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.857+0000 7f330affd640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f32f406e3b0 0x7f32f4070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.857+0000 7f330affd640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f32f406e3b0 0x7f32f4070870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f330c196bf0 tx=0x7f33000314e0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:00.861+0000 7f3308ff9640 1 -- 172.21.15.49:0/1954416669 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f32fc057c00 con 0x7f330c0feaf0 2024-09-19T09:04:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.221+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f32f80057d0 con 0x7f330c0feaf0 2024-09-19T09:04:01.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.222+0000 7f3308ff9640 1 -- 172.21.15.49:0/1954416669 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f32fc05b2c0 con 0x7f330c0feaf0 2024-09-19T09:04:01.222 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:01.222 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:01.222 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f32f406e3b0 msgr2=0x7f32f4070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f32f406e3b0 0x7f32f4070870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f330c196bf0 tx=0x7f33000314e0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f330c0feaf0 msgr2=0x7f330c1956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f330c0feaf0 0x7f330c1956d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00e940 tx=0x7f32fc00ee00 comp rx=0 tx=0).stop 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 shutdown_connections 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f32f406e3b0 0x7f32f4070870 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c0ffcf0 0x7f330c195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 --2- 172.21.15.49:0/1954416669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f330c0feaf0 0x7f330c1956d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 >> 172.21.15.49:0/1954416669 conn(0x7f330c0fa280 msgr2=0x7f330c067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 shutdown_connections 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:01.224+0000 7f3312077640 1 -- 172.21.15.49:0/1954416669 wait complete. 2024-09-19T09:04:01.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:01 smithi102 ceph-mon[35280]: pgmap v20: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 106 op/s 2024-09-19T09:04:01.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:01 smithi102 ceph-mon[35280]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:01.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:01 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1954416669' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:04:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:01 smithi049 ceph-mon[28158]: pgmap v20: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 106 op/s 2024-09-19T09:04:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:01 smithi049 ceph-mon[28158]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:01 smithi049 ceph-mon[28158]: from='client.? 172.21.15.49:0/1954416669' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:04:03.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:03 smithi102 ceph-mon[35280]: pgmap v21: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 106 op/s 2024-09-19T09:04:03.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:03 smithi049 ceph-mon[28158]: pgmap v21: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 106 op/s 2024-09-19T09:04:05.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:05 smithi102 ceph-mon[35280]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-09-19T09:04:05.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:05 smithi049 ceph-mon[28158]: pgmap v22: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-09-19T09:04:07.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:07 smithi049 ceph-mon[28158]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-19T09:04:07.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:07 smithi102 ceph-mon[35280]: pgmap v23: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-19T09:04:09.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:09 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:09.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:09 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:09.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:09 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:04:09.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:09 smithi102 ceph-mon[35280]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:04:09.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:09 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:09.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:09 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:09.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:09 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:09.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:09 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:04:09.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:09 smithi049 ceph-mon[28158]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:04:09.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:09 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:10.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:10 smithi102 ceph-mon[35280]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 183 op/s 2024-09-19T09:04:10.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:10 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:04:10.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:10 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:04:10.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:10 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:04:10.365 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:10 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:10.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:10 smithi049 ceph-mon[28158]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 183 op/s 2024-09-19T09:04:10.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:10 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:04:10.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:10 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:04:10.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:10 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:04:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:10 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:11.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:11 smithi102 ceph-mon[35280]: Upgrade: Updating mgr.smithi102.csalqv 2024-09-19T09:04:11.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:11 smithi102 ceph-mon[35280]: Deploying daemon mgr.smithi102.csalqv on smithi102 2024-09-19T09:04:11.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:11 smithi049 ceph-mon[28158]: Upgrade: Updating mgr.smithi102.csalqv 2024-09-19T09:04:11.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:11 smithi049 ceph-mon[28158]: Deploying daemon mgr.smithi102.csalqv on smithi102 2024-09-19T09:04:12.242 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:12 smithi102 ceph-mon[35280]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-19T09:04:12.243 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:12 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:04:12.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:12 smithi049 ceph-mon[28158]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-19T09:04:12.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:12 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:04:14.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:14 smithi102 ceph-mon[35280]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-19T09:04:14.445 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:14 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:14.446 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:14 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:14.446 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:14 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:14 smithi049 ceph-mon[28158]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-19T09:04:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:14 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:14 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:14.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:14 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:15.489 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:15 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:15.489 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:15 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:15.489 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:15 smithi102 ceph-mon[35280]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 451 op/s 2024-09-19T09:04:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:15 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:15 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:15.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:15 smithi049 ceph-mon[28158]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 451 op/s 2024-09-19T09:04:17.727 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:17 smithi102 ceph-mon[35280]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 397 op/s 2024-09-19T09:04:17.774 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:17 smithi049 ceph-mon[28158]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 397 op/s 2024-09-19T09:04:18.691 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:18 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:18.692 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:18 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:18.692 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:18 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:18.692 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:18 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:18.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:18 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:18.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:18 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:18.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:18 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:18.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:18 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:19.021 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-19T09:04:19.021 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-19T09:04:19.357 DEBUG:teuthology.parallel:result is None 2024-09-19T09:04:19.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:19 smithi102 ceph-mon[35280]: pgmap v29: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 536 op/s 2024-09-19T09:04:19.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:19 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv restarted 2024-09-19T09:04:19.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:19 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:04:19.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:19 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:04:19.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:19 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:04:19.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:19 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:04:19.720 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:19 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:04:19.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:19 smithi049 ceph-mon[28158]: pgmap v29: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 536 op/s 2024-09-19T09:04:19.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:19 smithi049 ceph-mon[28158]: Standby manager daemon smithi102.csalqv restarted 2024-09-19T09:04:19.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:19 smithi049 ceph-mon[28158]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:04:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:19 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:04:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:19 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:04:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:19 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:04:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:19 smithi049 ceph-mon[28158]: from='mgr.? 172.21.15.102:0/4053586587' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:04:21.312 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:21 smithi049 ceph-mon[28158]: mgrmap e33: smithi049.qdvksw(active, since 53s), standbys: smithi102.csalqv 2024-09-19T09:04:21.312 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:21 smithi049 ceph-mon[28158]: pgmap v30: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 461 op/s 2024-09-19T09:04:21.366 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:21 smithi102 ceph-mon[35280]: mgrmap e33: smithi049.qdvksw(active, since 53s), standbys: smithi102.csalqv 2024-09-19T09:04:21.366 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:21 smithi102 ceph-mon[35280]: pgmap v30: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 461 op/s 2024-09-19T09:04:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:22 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:22 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:23.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:22 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:23.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:22 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:23.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:23 smithi049 ceph-mon[28158]: pgmap v31: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 461 op/s 2024-09-19T09:04:24.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:23 smithi102 ceph-mon[35280]: pgmap v31: 65 pgs: 65 active+clean; 299 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 461 op/s 2024-09-19T09:04:26.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:25 smithi049 ceph-mon[28158]: pgmap v32: 65 pgs: 65 active+clean; 290 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 593 op/s 2024-09-19T09:04:26.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:25 smithi102 ceph-mon[35280]: pgmap v32: 65 pgs: 65 active+clean; 290 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 593 op/s 2024-09-19T09:04:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: pgmap v33: 65 pgs: 65 active+clean; 290 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 270 op/s 2024-09-19T09:04:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: Upgrade: Setting container_image for all mgr 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.qdvksw"}]: dispatch 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.qdvksw"}]: dispatch 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.qdvksw"}]': finished 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi102.csalqv"}]: dispatch 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi102.csalqv"}]: dispatch 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi102.csalqv"}]': finished 2024-09-19T09:04:28.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:27 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:04:28.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: pgmap v33: 65 pgs: 65 active+clean; 290 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 270 op/s 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: Upgrade: Setting container_image for all mgr 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.qdvksw"}]: dispatch 2024-09-19T09:04:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.qdvksw"}]: dispatch 2024-09-19T09:04:28.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.qdvksw"}]': finished 2024-09-19T09:04:28.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi102.csalqv"}]: dispatch 2024-09-19T09:04:28.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi102.csalqv"}]: dispatch 2024-09-19T09:04:28.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi102.csalqv"}]': finished 2024-09-19T09:04:28.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:27 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:04:29.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:29 smithi049 ceph-mon[28158]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 325 op/s 2024-09-19T09:04:29.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:29 smithi049 ceph-mon[28158]: Upgrade: Updating mon.smithi049 2024-09-19T09:04:29.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:29 smithi049 ceph-mon[28158]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:29.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:29 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:04:29.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:29 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:04:29.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:29 smithi049 ceph-mon[28158]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:29.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:29 smithi049 ceph-mon[28158]: Deploying daemon mon.smithi049 on smithi049 2024-09-19T09:04:30.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:29 smithi102 ceph-mon[35280]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 325 op/s 2024-09-19T09:04:30.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:29 smithi102 ceph-mon[35280]: Upgrade: Updating mon.smithi049 2024-09-19T09:04:30.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:29 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:30.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:29 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:04:30.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:29 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:04:30.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:29 smithi102 ceph-mon[35280]: from='mgr.14678 172.21.15.49:0/367113188' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:30.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:29 smithi102 ceph-mon[35280]: Deploying daemon mon.smithi049 on smithi049 2024-09-19T09:04:31.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:30 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.331+0000 7f42c4417640 1 -- 172.21.15.49:0/2248709133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc102fb0 msgr2=0x7f42bc1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.331+0000 7f42c4417640 1 --2- 172.21.15.49:0/2248709133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc102fb0 0x7f42bc1053a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009880 tx=0x7f42ac02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 -- 172.21.15.49:0/2248709133 shutdown_connections 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 --2- 172.21.15.49:0/2248709133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc102fb0 0x7f42bc1053a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 --2- 172.21.15.49:0/2248709133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42bc100680 0x7f42bc102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 -- 172.21.15.49:0/2248709133 >> 172.21.15.49:0/2248709133 conn(0x7f42bc0fa280 msgr2=0x7f42bc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 -- 172.21.15.49:0/2248709133 shutdown_connections 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 -- 172.21.15.49:0/2248709133 wait complete. 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 Processor -- start 2024-09-19T09:04:31.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.332+0000 7f42c4417640 1 -- start start 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c4417640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc100680 0x7f42bc0fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c4417640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42bc102fb0 0x7f42bc0fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c4417640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0feb70 con 0x7f42bc102fb0 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c4417640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0fece0 con 0x7f42bc100680 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c19b2640 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42bc102fb0 msgr2=0x7f42bc0fe630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c19b2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42bc102fb0 0x7f42bc0fe630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c21b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc100680 0x7f42bc0fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c21b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc100680 0x7f42bc0fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:37228/0 (socket says 172.21.15.49:37228) 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c21b3640 1 -- 172.21.15.49:0/3643341002 learned_addr learned my addr 172.21.15.49:0/3643341002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c21b3640 1 -- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42bc102fb0 msgr2=0x7f42bc0fe630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c21b3640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42bc102fb0 0x7f42bc0fe630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.333+0000 7f42c21b3640 1 -- 172.21.15.49:0/3643341002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009560 con 0x7f42bc100680 2024-09-19T09:04:31.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.334+0000 7f42c21b3640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc100680 0x7f42bc0fffe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42b800b4d0 tx=0x7f42b800b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.334+0000 7f42b37fe640 1 -- 172.21.15.49:0/3643341002 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b80107e0 con 0x7f42bc100680 2024-09-19T09:04:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.334+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc0fefc0 con 0x7f42bc100680 2024-09-19T09:04:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.334+0000 7f42b37fe640 1 -- 172.21.15.49:0/3643341002 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42b8010e00 con 0x7f42bc100680 2024-09-19T09:04:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.334+0000 7f42b37fe640 1 -- 172.21.15.49:0/3643341002 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b800f360 con 0x7f42bc100680 2024-09-19T09:04:31.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.334+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42bc19d730 con 0x7f42bc100680 2024-09-19T09:04:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.335+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc100a60 con 0x7f42bc100680 2024-09-19T09:04:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.335+0000 7f42b37fe640 1 -- 172.21.15.49:0/3643341002 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 33) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f42b8010940 con 0x7f42bc100680 2024-09-19T09:04:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.336+0000 7f42b37fe640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f42a806e2f0 0x7f42a80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.336+0000 7f42b37fe640 1 -- 172.21.15.49:0/3643341002 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f42b808ddc0 con 0x7f42bc100680 2024-09-19T09:04:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.336+0000 7f42c19b2640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f42a806e2f0 0x7f42a80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.337+0000 7f42c19b2640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f42a806e2f0 0x7f42a80707b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f42ac02a9f0 tx=0x7f42ac000bc0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.341+0000 7f42b37fe640 1 -- 172.21.15.49:0/3643341002 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f42b8057270 con 0x7f42bc100680 2024-09-19T09:04:31.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:31 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[28154]: 2024-09-19T09:04:31.121+0000 7f41cc83a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:04:31.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:31 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[28154]: 2024-09-19T09:04:31.121+0000 7f41cc83a640 -1 mon.smithi049@0(leader) e2 *** Got Signal Terminated *** 2024-09-19T09:04:31.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.593+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42bc103950 con 0x7f42a806e2f0 2024-09-19T09:04:31.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.595+0000 7f42b37fe640 1 -- 172.21.15.49:0/3643341002 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f42bc103950 con 0x7f42a806e2f0 2024-09-19T09:04:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f42a806e2f0 msgr2=0x7f42a80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f42a806e2f0 0x7f42a80707b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f42ac02a9f0 tx=0x7f42ac000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc100680 msgr2=0x7f42bc0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc100680 0x7f42bc0fffe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42b800b4d0 tx=0x7f42b800b990 comp rx=0 tx=0).stop 2024-09-19T09:04:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 shutdown_connections 2024-09-19T09:04:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f42a806e2f0 0x7f42a80707b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42bc102fb0 0x7f42bc0fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 --2- 172.21.15.49:0/3643341002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42bc100680 0x7f42bc0fffe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 >> 172.21.15.49:0/3643341002 conn(0x7f42bc0fa280 msgr2=0x7f42bc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 shutdown_connections 2024-09-19T09:04:31.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.597+0000 7f42c4417640 1 -- 172.21.15.49:0/3643341002 wait complete. 2024-09-19T09:04:31.609 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:04:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 -- 172.21.15.49:0/2584107798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f80ffb80 msgr2=0x7fe5f80fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/2584107798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f80ffb80 0x7fe5f80fff80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009880 tx=0x7fe5e802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 -- 172.21.15.49:0/2584107798 shutdown_connections 2024-09-19T09:04:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/2584107798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f8100d80 0x7fe5f8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.719 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:31 smithi049 podman[91442]: 2024-09-19 09:04:31.386083691 +0000 UTC m=+0.397690653 container died 619b66ac80ddd7c35c8fdd9b4b8a342166a4f0b95443cb468b4aed3970c753f0 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/2584107798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f80ffb80 0x7fe5f80fff80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 -- 172.21.15.49:0/2584107798 >> 172.21.15.49:0/2584107798 conn(0x7fe5f80fb310 msgr2=0x7fe5f80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 -- 172.21.15.49:0/2584107798 shutdown_connections 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.719+0000 7fe5fcab7640 1 -- 172.21.15.49:0/2584107798 wait complete. 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5fcab7640 1 Processor -- start 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5fcab7640 1 -- start start 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5fcab7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f80ffb80 0x7fe5f8195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5fcab7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f8100d80 0x7fe5f8195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5fcab7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8196260 con 0x7fe5f80ffb80 2024-09-19T09:04:31.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5fcab7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f81963d0 con 0x7fe5f8100d80 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5f659c640 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f80ffb80 msgr2=0x7fe5f8195750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5f659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f80ffb80 0x7fe5f8195750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5f5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f8100d80 0x7fe5f8195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.720+0000 7fe5f5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f8100d80 0x7fe5f8195c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:37250/0 (socket says 172.21.15.49:37250) 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.721+0000 7fe5f5d9b640 1 -- 172.21.15.49:0/4258093501 learned_addr learned my addr 172.21.15.49:0/4258093501 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.721+0000 7fe5f5d9b640 1 -- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f80ffb80 msgr2=0x7fe5f8195750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.721+0000 7fe5f5d9b640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f80ffb80 0x7fe5f8195750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.721+0000 7fe5f5d9b640 1 -- 172.21.15.49:0/4258093501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8009560 con 0x7fe5f8100d80 2024-09-19T09:04:31.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.721+0000 7fe5f5d9b640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f8100d80 0x7fe5f8195c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00b420 tx=0x7fe5ec00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.721+0000 7fe5e77fe640 1 -- 172.21.15.49:0/4258093501 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec011800 con 0x7fe5f8100d80 2024-09-19T09:04:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.722+0000 7fe5e77fe640 1 -- 172.21.15.49:0/4258093501 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5ec011e20 con 0x7fe5f8100d80 2024-09-19T09:04:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.722+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f819ae70 con 0x7fe5f8100d80 2024-09-19T09:04:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.722+0000 7fe5e77fe640 1 -- 172.21.15.49:0/4258093501 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec00f510 con 0x7fe5f8100d80 2024-09-19T09:04:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.722+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f819b3b0 con 0x7fe5f8100d80 2024-09-19T09:04:31.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.723+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f8100000 con 0x7fe5f8100d80 2024-09-19T09:04:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.724+0000 7fe5e77fe640 1 -- 172.21.15.49:0/4258093501 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 33) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fe5ec011960 con 0x7fe5f8100d80 2024-09-19T09:04:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.725+0000 7fe5e77fe640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fe5e006e3a0 0x7fe5e0070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.725+0000 7fe5e77fe640 1 -- 172.21.15.49:0/4258093501 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe5ec08dbe0 con 0x7fe5f8100d80 2024-09-19T09:04:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.725+0000 7fe5f659c640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fe5e006e3a0 0x7fe5e0070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.725+0000 7fe5f659c640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fe5e006e3a0 0x7fe5e0070860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8005790 tx=0x7fe5e8000bc0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.729+0000 7fe5e77fe640 1 -- 172.21.15.49:0/4258093501 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fe5ec0570d0 con 0x7fe5f8100d80 2024-09-19T09:04:31.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.974+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5f81056d0 con 0x7fe5e006e3a0 2024-09-19T09:04:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.976+0000 7fe5e77fe640 1 -- 172.21.15.49:0/4258093501 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe5f81056d0 con 0x7fe5e006e3a0 2024-09-19T09:04:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fe5e006e3a0 msgr2=0x7fe5e0070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fe5e006e3a0 0x7fe5e0070860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8005790 tx=0x7fe5e8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f8100d80 msgr2=0x7fe5f8195c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f8100d80 0x7fe5f8195c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00b420 tx=0x7fe5ec00b8e0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 shutdown_connections 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fe5e006e3a0 0x7fe5e0070860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5f8100d80 0x7fe5f8195c90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 --2- 172.21.15.49:0/4258093501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5f80ffb80 0x7fe5f8195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.978+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 >> 172.21.15.49:0/4258093501 conn(0x7fe5f80fb310 msgr2=0x7fe5f8103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.979+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 shutdown_connections 2024-09-19T09:04:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:31.979+0000 7fe5fcab7640 1 -- 172.21.15.49:0/4258093501 wait complete. 2024-09-19T09:04:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.085+0000 7f5358d8f640 1 -- 172.21.15.49:0/266267768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354100630 msgr2=0x7f5354102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.085+0000 7f5358d8f640 1 --2- 172.21.15.49:0/266267768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354100630 0x7f5354102a20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f534c009880 tx=0x7f534c02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.085+0000 7f5358d8f640 1 -- 172.21.15.49:0/266267768 shutdown_connections 2024-09-19T09:04:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.085+0000 7f5358d8f640 1 --2- 172.21.15.49:0/266267768 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354102f60 0x7f5354105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.085+0000 7f5358d8f640 1 --2- 172.21.15.49:0/266267768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354100630 0x7f5354102a20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.085+0000 7f5358d8f640 1 -- 172.21.15.49:0/266267768 >> 172.21.15.49:0/266267768 conn(0x7f53540fa250 msgr2=0x7f53540fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.086+0000 7f5358d8f640 1 -- 172.21.15.49:0/266267768 shutdown_connections 2024-09-19T09:04:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.086+0000 7f5358d8f640 1 -- 172.21.15.49:0/266267768 wait complete. 2024-09-19T09:04:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5358d8f640 1 Processor -- start 2024-09-19T09:04:32.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5358d8f640 1 -- start start 2024-09-19T09:04:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5358d8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354100630 0x7f53541934e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5358d8f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354102f60 0x7f5354193a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5358d8f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354193ff0 con 0x7f5354100630 2024-09-19T09:04:32.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5358d8f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5354194160 con 0x7f5354102f60 2024-09-19T09:04:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5351d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354102f60 0x7f5354193a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f535259c640 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354100630 msgr2=0x7f53541934e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2024-09-19T09:04:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f535259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354100630 0x7f53541934e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:04:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5351d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354102f60 0x7f5354193a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:37262/0 (socket says 172.21.15.49:37262) 2024-09-19T09:04:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.087+0000 7f5351d9b640 1 -- 172.21.15.49:0/2878820164 learned_addr learned my addr 172.21.15.49:0/2878820164 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:32.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.088+0000 7f5351d9b640 1 -- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354100630 msgr2=0x7f53541934e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.088+0000 7f5351d9b640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354100630 0x7f53541934e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.088+0000 7f5351d9b640 1 -- 172.21.15.49:0/2878820164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c009560 con 0x7f5354102f60 2024-09-19T09:04:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.088+0000 7f5351d9b640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354102f60 0x7f5354193a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f534800b4a0 tx=0x7f534800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.089+0000 7f53437fe640 1 -- 172.21.15.49:0/2878820164 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53480107e0 con 0x7f5354102f60 2024-09-19T09:04:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.089+0000 7f53437fe640 1 -- 172.21.15.49:0/2878820164 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5348010e00 con 0x7f5354102f60 2024-09-19T09:04:32.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.089+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5354198c00 con 0x7f5354102f60 2024-09-19T09:04:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.089+0000 7f53437fe640 1 -- 172.21.15.49:0/2878820164 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f534800f360 con 0x7f5354102f60 2024-09-19T09:04:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.089+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53541991d0 con 0x7f5354102f60 2024-09-19T09:04:32.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.090+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5354106620 con 0x7f5354102f60 2024-09-19T09:04:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.091+0000 7f53437fe640 1 -- 172.21.15.49:0/2878820164 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 33) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f5348010940 con 0x7f5354102f60 2024-09-19T09:04:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.092+0000 7f53437fe640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f533c0727b0 0x7f533c074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.092+0000 7f53437fe640 1 -- 172.21.15.49:0/2878820164 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f534808dbe0 con 0x7f5354102f60 2024-09-19T09:04:32.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.092+0000 7f535259c640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f533c0727b0 0x7f533c074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.093+0000 7f535259c640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f533c0727b0 0x7f533c074c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f534c009230 tx=0x7f534c000bc0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.099+0000 7f53437fe640 1 -- 172.21.15.49:0/2878820164 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f53480570d0 con 0x7f5354102f60 2024-09-19T09:04:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.357+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5354199420 con 0x7f533c0727b0 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.369+0000 7f53437fe640 1 -- 172.21.15.49:0/2878820164 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5354199420 con 0x7f533c0727b0 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (8m) 5s ago 9m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (10m) 5s ago 10m 8162k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (9m) 14s ago 9m 8002k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (10m) 5s ago 10m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (9m) 14s ago 9m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (8m) 5s ago 9m 85.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (4m) 5s ago 4m 225M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:04:32.369 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (4m) 5s ago 4m 239M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (4m) 14s ago 4m 25.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (4m) 14s ago 4m 25.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (105s) 5s ago 11m 491M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (19s) 14s ago 9m 70.8M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (11m) 5s ago 11m 55.4M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 619b66ac80dd 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (9m) 14s ago 9m 47.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 4f6e29b8995e 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (10m) 5s ago 10m 15.6M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (9m) 14s ago 9m 16.6M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (8m) 5s ago 8m 196M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 5s ago 7m 209M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 5s ago 7m 183M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (7m) 14s ago 7m 238M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:04:32.370 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (6m) 14s ago 6m 209M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:04:32.371 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (6m) 14s ago 6m 201M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:04:32.371 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (24s) 5s ago 9m 40.3M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f533c0727b0 msgr2=0x7f533c074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f533c0727b0 0x7f533c074c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f534c009230 tx=0x7f534c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354102f60 msgr2=0x7f5354193a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354102f60 0x7f5354193a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f534800b4a0 tx=0x7f534800b960 comp rx=0 tx=0).stop 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 shutdown_connections 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f533c0727b0 0x7f533c074c70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5354102f60 0x7f5354193a20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 --2- 172.21.15.49:0/2878820164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5354100630 0x7f53541934e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 >> 172.21.15.49:0/2878820164 conn(0x7f53540fa250 msgr2=0x7f53540fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 shutdown_connections 2024-09-19T09:04:32.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.372+0000 7f5358d8f640 1 -- 172.21.15.49:0/2878820164 wait complete. 2024-09-19T09:04:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 -- 172.21.15.49:0/2612365084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0071850 msgr2=0x7fddc0071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 --2- 172.21.15.49:0/2612365084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0071850 0x7fddc0071c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009880 tx=0x7fdda802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 -- 172.21.15.49:0/2612365084 shutdown_connections 2024-09-19T09:04:32.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 --2- 172.21.15.49:0/2612365084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddc0068940 0x7fddc0107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 --2- 172.21.15.49:0/2612365084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0071850 0x7fddc0071c50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 -- 172.21.15.49:0/2612365084 >> 172.21.15.49:0/2612365084 conn(0x7fddc006cfa0 msgr2=0x7fddc006f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 -- 172.21.15.49:0/2612365084 shutdown_connections 2024-09-19T09:04:32.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.471+0000 7fddc59af640 1 -- 172.21.15.49:0/2612365084 wait complete. 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddc59af640 1 Processor -- start 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddc59af640 1 -- start start 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddc59af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0068940 0x7fddc019df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddc59af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddc0071850 0x7fddc019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddc59af640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc019ea60 con 0x7fddc0071850 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddc59af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc019ebd0 con 0x7fddc0068940 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddb7fff640 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddc0071850 msgr2=0x7fddc019e490 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.472+0000 7fddb7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddc0071850 0x7fddc019e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.473+0000 7fddbeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0068940 0x7fddc019df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.473+0000 7fddbeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0068940 0x7fddc019df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:37274/0 (socket says 172.21.15.49:37274) 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.473+0000 7fddbeffd640 1 -- 172.21.15.49:0/1926700615 learned_addr learned my addr 172.21.15.49:0/1926700615 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:32.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.473+0000 7fddbeffd640 1 -- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddc0071850 msgr2=0x7fddc019e490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.473+0000 7fddbeffd640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddc0071850 0x7fddc019e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.473+0000 7fddbeffd640 1 -- 172.21.15.49:0/1926700615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009560 con 0x7fddc0068940 2024-09-19T09:04:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.473+0000 7fddbeffd640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0068940 0x7fddc019df50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdda8006010 tx=0x7fdda80055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.474+0000 7fddc49ad640 1 -- 172.21.15.49:0/1926700615 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda8004b20 con 0x7fddc0068940 2024-09-19T09:04:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.474+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc010db50 con 0x7fddc0068940 2024-09-19T09:04:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.474+0000 7fddc49ad640 1 -- 172.21.15.49:0/1926700615 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdda8004c80 con 0x7fddc0068940 2024-09-19T09:04:32.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.474+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc010e0c0 con 0x7fddc0068940 2024-09-19T09:04:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.475+0000 7fddc49ad640 1 -- 172.21.15.49:0/1926700615 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdda8031a70 con 0x7fddc0068940 2024-09-19T09:04:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.475+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc0107880 con 0x7fddc0068940 2024-09-19T09:04:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.476+0000 7fddc49ad640 1 -- 172.21.15.49:0/1926700615 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 33) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fdda8031ce0 con 0x7fddc0068940 2024-09-19T09:04:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.476+0000 7fddc49ad640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fddac06e0e0 0x7fddac0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.477+0000 7fddc49ad640 1 -- 172.21.15.49:0/1926700615 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fdda80af550 con 0x7fddc0068940 2024-09-19T09:04:32.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.477+0000 7fddb7fff640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fddac06e0e0 0x7fddac0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.477+0000 7fddb7fff640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fddac06e0e0 0x7fddac0705a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fddb0006fd0 tx=0x7fddb0006da0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.481+0000 7fddc49ad640 1 -- 172.21.15.49:0/1926700615 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fdda80789d0 con 0x7fddc0068940 2024-09-19T09:04:32.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.770+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddc0111310 con 0x7fddc0068940 2024-09-19T09:04:32.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.770+0000 7fddc49ad640 1 -- 172.21.15.49:0/1926700615 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fdda807c090 con 0x7fddc0068940 2024-09-19T09:04:32.770 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:04:32.770 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:04:32.771 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:04:32.772 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 12, 2024-09-19T09:04:32.772 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:04:32.772 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:04:32.772 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fddac06e0e0 msgr2=0x7fddac0705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fddac06e0e0 0x7fddac0705a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fddb0006fd0 tx=0x7fddb0006da0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0068940 msgr2=0x7fddc019df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0068940 0x7fddc019df50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdda8006010 tx=0x7fdda80055f0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 shutdown_connections 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fddac06e0e0 0x7fddac0705a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fddc0071850 0x7fddc019e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 --2- 172.21.15.49:0/1926700615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc0068940 0x7fddc019df50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 >> 172.21.15.49:0/1926700615 conn(0x7fddc006cfa0 msgr2=0x7fddc010bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 shutdown_connections 2024-09-19T09:04:32.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.773+0000 7fddc59af640 1 -- 172.21.15.49:0/1926700615 wait complete. 2024-09-19T09:04:32.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 -- 172.21.15.49:0/4059671444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08102f60 msgr2=0x7fdb08105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/4059671444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08102f60 0x7fdb08105350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009880 tx=0x7fdafc02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 -- 172.21.15.49:0/4059671444 shutdown_connections 2024-09-19T09:04:32.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/4059671444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08102f60 0x7fdb08105350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/4059671444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb08100630 0x7fdb08102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 -- 172.21.15.49:0/4059671444 >> 172.21.15.49:0/4059671444 conn(0x7fdb080fa230 msgr2=0x7fdb080fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 -- 172.21.15.49:0/4059671444 shutdown_connections 2024-09-19T09:04:32.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.865+0000 7fdb0d83c640 1 -- 172.21.15.49:0/4059671444 wait complete. 2024-09-19T09:04:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb0d83c640 1 Processor -- start 2024-09-19T09:04:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb0d83c640 1 -- start start 2024-09-19T09:04:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb0d83c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08100630 0x7fdb08197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb0d83c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb08102f60 0x7fdb08197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb0d83c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08198470 con 0x7fdb08102f60 2024-09-19T09:04:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb0d83c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081985e0 con 0x7fdb08100630 2024-09-19T09:04:32.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb067fc640 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb08102f60 msgr2=0x7fdb08197ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb067fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb08102f60 0x7fdb08197ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb06ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08100630 0x7fdb08197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb06ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08100630 0x7fdb08197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:37292/0 (socket says 172.21.15.49:37292) 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.866+0000 7fdb06ffd640 1 -- 172.21.15.49:0/917350271 learned_addr learned my addr 172.21.15.49:0/917350271 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb06ffd640 1 -- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb08102f60 msgr2=0x7fdb08197ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb06ffd640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb08102f60 0x7fdb08197ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb06ffd640 1 -- 172.21.15.49:0/917350271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc009560 con 0x7fdb08100630 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb06ffd640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08100630 0x7fdb08197960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800b4d0 tx=0x7fdaf800b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb0c83a640 1 -- 172.21.15.49:0/917350271 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf80107e0 con 0x7fdb08100630 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0819d080 con 0x7fdb08100630 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb0c83a640 1 -- 172.21.15.49:0/917350271 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdaf8010e00 con 0x7fdb08100630 2024-09-19T09:04:32.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0819d650 con 0x7fdb08100630 2024-09-19T09:04:32.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.867+0000 7fdb0c83a640 1 -- 172.21.15.49:0/917350271 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf800f360 con 0x7fdb08100630 2024-09-19T09:04:32.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.869+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb080fbd70 con 0x7fdb08100630 2024-09-19T09:04:32.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.869+0000 7fdb0c83a640 1 -- 172.21.15.49:0/917350271 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 33) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fdaf8010940 con 0x7fdb08100630 2024-09-19T09:04:32.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.870+0000 7fdb0c83a640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fdaf006e2f0 0x7fdaf00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.870+0000 7fdb0c83a640 1 -- 172.21.15.49:0/917350271 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fdaf808dd90 con 0x7fdb08100630 2024-09-19T09:04:32.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.870+0000 7fdb067fc640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fdaf006e2f0 0x7fdaf00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.870+0000 7fdb067fc640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fdaf006e2f0 0x7fdaf00707b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdafc02a9f0 tx=0x7fdafc000bc0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:32.874+0000 7fdb0c83a640 1 -- 172.21.15.49:0/917350271 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fdaf8057200 con 0x7fdb08100630 2024-09-19T09:04:33.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.182+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdb08108ae0 con 0x7fdb08100630 2024-09-19T09:04:33.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.182+0000 7fdb0c83a640 1 -- 172.21.15.49:0/917350271 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1869 (secure 0 0 0) 0x7fdaf805a8c0 con 0x7fdb08100630 2024-09-19T09:04:33.182 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:04:33.182 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:04:33.183 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:04:33.184 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:04:33.185 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fdaf006e2f0 msgr2=0x7fdaf00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fdaf006e2f0 0x7fdaf00707b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdafc02a9f0 tx=0x7fdafc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08100630 msgr2=0x7fdb08197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08100630 0x7fdb08197960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800b4d0 tx=0x7fdaf800b990 comp rx=0 tx=0).stop 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 shutdown_connections 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fdaf006e2f0 0x7fdaf00707b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb08102f60 0x7fdb08197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 --2- 172.21.15.49:0/917350271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb08100630 0x7fdb08197960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 >> 172.21.15.49:0/917350271 conn(0x7fdb080fa230 msgr2=0x7fdb081039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:33.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 shutdown_connections 2024-09-19T09:04:33.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.185+0000 7fdb0d83c640 1 -- 172.21.15.49:0/917350271 wait complete. 2024-09-19T09:04:33.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.285+0000 7f4902d98640 1 -- 172.21.15.49:0/2570476689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 msgr2=0x7f48fc0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.285+0000 7f4902d98640 1 --2- 172.21.15.49:0/2570476689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc0ff200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009880 tx=0x7f48e802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 -- 172.21.15.49:0/2570476689 shutdown_connections 2024-09-19T09:04:33.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 --2- 172.21.15.49:0/2570476689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc0ff200 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 --2- 172.21.15.49:0/2570476689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc0fe460 0x7f48fc0fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 -- 172.21.15.49:0/2570476689 >> 172.21.15.49:0/2570476689 conn(0x7f48fc0fa230 msgr2=0x7f48fc0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:33.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 -- 172.21.15.49:0/2570476689 shutdown_connections 2024-09-19T09:04:33.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 -- 172.21.15.49:0/2570476689 wait complete. 2024-09-19T09:04:33.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 Processor -- start 2024-09-19T09:04:33.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.286+0000 7f4902d98640 1 -- start start 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f4902d98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc0fe460 0x7f48fc1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f4902d98640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f4902d98640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc1983e0 con 0x7f48fc0fe460 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f4902d98640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc198550 con 0x7f48fc0feda0 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f4900b34640 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc0fe460 msgr2=0x7f48fc1978d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f4900b34640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc0fe460 0x7f48fc1978d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f48fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:33.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f48fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:37296/0 (socket says 172.21.15.49:37296) 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f48fbfff640 1 -- 172.21.15.49:0/971924026 learned_addr learned my addr 172.21.15.49:0/971924026 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f48fbfff640 1 -- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc0fe460 msgr2=0x7f48fc1978d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f48fbfff640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc0fe460 0x7f48fc1978d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f48fbfff640 1 -- 172.21.15.49:0/971924026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009560 con 0x7f48fc0feda0 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.287+0000 7f48fbfff640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc197e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48e8031540 tx=0x7f48e80056c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.288+0000 7f48f9ffb640 1 -- 172.21.15.49:0/971924026 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e8004c60 con 0x7f48fc0feda0 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.288+0000 7f48f9ffb640 1 -- 172.21.15.49:0/971924026 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48e8004dc0 con 0x7f48fc0feda0 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.288+0000 7f48f9ffb640 1 -- 172.21.15.49:0/971924026 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e8031b80 con 0x7f48fc0feda0 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.288+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc19cf90 con 0x7f48fc0feda0 2024-09-19T09:04:33.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.288+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc19d480 con 0x7f48fc0feda0 2024-09-19T09:04:33.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.289+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc10a9f0 con 0x7f48fc0feda0 2024-09-19T09:04:33.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.290+0000 7f48f9ffb640 1 -- 172.21.15.49:0/971924026 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 33) v1 ==== 92514+0+0 (secure 0 0 0) 0x7f48e80035f0 con 0x7f48fc0feda0 2024-09-19T09:04:33.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.290+0000 7f48f9ffb640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f48ec06e2f0 0x7f48ec0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:33.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.290+0000 7f48f9ffb640 1 -- 172.21.15.49:0/971924026 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f48e80af750 con 0x7f48fc0feda0 2024-09-19T09:04:33.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.290+0000 7f4900b34640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f48ec06e2f0 0x7f48ec0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:33.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.291+0000 7f4900b34640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f48ec06e2f0 0x7f48ec0707b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48f0006fd0 tx=0x7f48f0006da0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:33.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.295+0000 7f48f9ffb640 1 -- 172.21.15.49:0/971924026 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7f48e8078af0 con 0x7f48fc0feda0 2024-09-19T09:04:33.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.541+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 --> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48fc1081b0 con 0x7f48ec06e2f0 2024-09-19T09:04:33.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.542+0000 7f48f9ffb640 1 -- 172.21.15.49:0/971924026 <== mgr.14678 v2:172.21.15.49:6800/2132142494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f48fc1081b0 con 0x7f48ec06e2f0 2024-09-19T09:04:33.542 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:04:33.542 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:04:33.542 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:04:33.542 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:04:33.542 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:04:33.542 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-09-19T09:04:33.543 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:04:33.543 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/23 daemons upgraded", 2024-09-19T09:04:33.543 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mon daemons", 2024-09-19T09:04:33.543 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:04:33.543 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:04:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f48ec06e2f0 msgr2=0x7f48ec0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f48ec06e2f0 0x7f48ec0707b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48f0006fd0 tx=0x7f48f0006da0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 msgr2=0x7f48fc197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc197e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48e8031540 tx=0x7f48e80056c0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 shutdown_connections 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7f48ec06e2f0 0x7f48ec0707b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48fc0feda0 0x7f48fc197e10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.544+0000 7f4902d98640 1 --2- 172.21.15.49:0/971924026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48fc0fe460 0x7f48fc1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.545+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 >> 172.21.15.49:0/971924026 conn(0x7f48fc0fa230 msgr2=0x7f48fc106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.545+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 shutdown_connections 2024-09-19T09:04:33.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.545+0000 7f4902d98640 1 -- 172.21.15.49:0/971924026 wait complete. 2024-09-19T09:04:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 -- 172.21.15.49:0/1483512429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c1006e0 msgr2=0x7fc38c102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 --2- 172.21.15.49:0/1483512429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c1006e0 0x7fc38c102ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009880 tx=0x7fc37c02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 -- 172.21.15.49:0/1483512429 shutdown_connections 2024-09-19T09:04:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 --2- 172.21.15.49:0/1483512429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c103010 0x7fc38c105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 --2- 172.21.15.49:0/1483512429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c1006e0 0x7fc38c102ad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 -- 172.21.15.49:0/1483512429 >> 172.21.15.49:0/1483512429 conn(0x7fc38c0fa280 msgr2=0x7fc38c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:33.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 -- 172.21.15.49:0/1483512429 shutdown_connections 2024-09-19T09:04:33.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.637+0000 7fc390f23640 1 -- 172.21.15.49:0/1483512429 wait complete. 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc390f23640 1 Processor -- start 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc390f23640 1 -- start start 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc390f23640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c1006e0 0x7fc38c195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc390f23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c103010 0x7fc38c195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc390f23640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c1961a0 con 0x7fc38c1006e0 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc390f23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c196310 con 0x7fc38c103010 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc38a59c640 1 -- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c1006e0 msgr2=0x7fc38c195690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:3300/0 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.638+0000 7fc38a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c1006e0 0x7fc38c195690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.639+0000 7fc389d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c103010 0x7fc38c195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:33.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.639+0000 7fc389d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c103010 0x7fc38c195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:37310/0 (socket says 172.21.15.49:37310) 2024-09-19T09:04:33.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.639+0000 7fc389d9b640 1 -- 172.21.15.49:0/2826962177 learned_addr learned my addr 172.21.15.49:0/2826962177 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:04:33.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.639+0000 7fc389d9b640 1 -- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c1006e0 msgr2=0x7fc38c195690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:33.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.639+0000 7fc389d9b640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c1006e0 0x7fc38c195690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.639+0000 7fc389d9b640 1 -- 172.21.15.49:0/2826962177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c009560 con 0x7fc38c103010 2024-09-19T09:04:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.639+0000 7fc389d9b640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c103010 0x7fc38c195bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc38000b420 tx=0x7fc38000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.640+0000 7fc37b7fe640 1 -- 172.21.15.49:0/2826962177 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc380011800 con 0x7fc38c103010 2024-09-19T09:04:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.640+0000 7fc37b7fe640 1 -- 172.21.15.49:0/2826962177 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc380011e20 con 0x7fc38c103010 2024-09-19T09:04:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.640+0000 7fc37b7fe640 1 -- 172.21.15.49:0/2826962177 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38000f510 con 0x7fc38c103010 2024-09-19T09:04:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.640+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c0fe530 con 0x7fc38c103010 2024-09-19T09:04:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.640+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c0fea50 con 0x7fc38c103010 2024-09-19T09:04:33.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.641+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c108810 con 0x7fc38c103010 2024-09-19T09:04:33.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.642+0000 7fc37b7fe640 1 -- 172.21.15.49:0/2826962177 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 33) v1 ==== 92514+0+0 (secure 0 0 0) 0x7fc380011960 con 0x7fc38c103010 2024-09-19T09:04:33.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.642+0000 7fc37b7fe640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc374072760 0x7fc374074c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:33.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.642+0000 7fc37b7fe640 1 -- 172.21.15.49:0/2826962177 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc38008dc40 con 0x7fc38c103010 2024-09-19T09:04:33.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.642+0000 7fc38a59c640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc374072760 0x7fc374074c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:33.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.643+0000 7fc38a59c640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc374072760 0x7fc374074c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc37c005790 tx=0x7fc37c000bc0 comp rx=0 tx=0).ready entity=mgr.14678 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:33.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.646+0000 7fc37b7fe640 1 -- 172.21.15.49:0/2826962177 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187726 (secure 0 0 0) 0x7fc3800570f0 con 0x7fc38c103010 2024-09-19T09:04:33.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.928+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc38c1089d0 con 0x7fc38c103010 2024-09-19T09:04:33.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.928+0000 7fc37b7fe640 1 -- 172.21.15.49:0/2826962177 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc38005a7b0 con 0x7fc38c103010 2024-09-19T09:04:33.928 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:33.928 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:33.928 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc374072760 msgr2=0x7fc374074c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc374072760 0x7fc374074c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc37c005790 tx=0x7fc37c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c103010 msgr2=0x7fc38c195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c103010 0x7fc38c195bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc38000b420 tx=0x7fc38000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 shutdown_connections 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:6800/2132142494,v1:172.21.15.49:6801/2132142494] conn(0x7fc374072760 0x7fc374074c20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc38c103010 0x7fc38c195bd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 --2- 172.21.15.49:0/2826962177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c1006e0 0x7fc38c195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.930+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 >> 172.21.15.49:0/2826962177 conn(0x7fc38c0fa280 msgr2=0x7fc38c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.931+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 shutdown_connections 2024-09-19T09:04:33.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:04:33.931+0000 7fc390f23640 1 -- 172.21.15.49:0/2826962177 wait complete. 2024-09-19T09:04:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:34 smithi049 podman[91442]: 2024-09-19 09:04:34.009471902 +0000 UTC m=+3.021078844 container cleanup 619b66ac80ddd7c35c8fdd9b4b8a342166a4f0b95443cb468b4aed3970c753f0 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:04:34.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:34 smithi049 bash[91442]: ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049 2024-09-19T09:04:34.834 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-19T09:04:34.834 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:04:35.314 DEBUG:teuthology.parallel:result is None 2024-09-19T09:04:35.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:04:35.351 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:04:35.351 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-19T09:04:35.385 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-19T09:04:35.385 DEBUG:teuthology.parallel:result is None 2024-09-19T09:04:35.895 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:35 smithi049 podman[91477]: 2024-09-19 09:04:35.630194741 +0000 UTC m=+4.237450965 container remove 619b66ac80ddd7c35c8fdd9b4b8a342166a4f0b95443cb468b4aed3970c753f0 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:04:36.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:35 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service: Deactivated successfully. 2024-09-19T09:04:36.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:35 smithi049 systemd[1]: Stopped Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:04:36.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:35 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service: Consumed 12.391s CPU time. 2024-09-19T09:04:36.497 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:04:36.497 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 podman[91774]: 2024-09-19 09:04:36.317185127 +0000 UTC m=+0.020227659 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:04:36.497 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 podman[91774]: 2024-09-19 09:04:36.498024667 +0000 UTC m=+0.201067198 container create a5ea9706c7ce3cf4a76bb2d8f736abe3a2d4168dbdcc429de8e45c74e3128ac8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:04:36.750 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 podman[91774]: 2024-09-19 09:04:36.725631545 +0000 UTC m=+0.428674079 container init a5ea9706c7ce3cf4a76bb2d8f736abe3a2d4168dbdcc429de8e45c74e3128ac8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:04:36.751 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 podman[91774]: 2024-09-19 09:04:36.729230646 +0000 UTC m=+0.432273178 container start a5ea9706c7ce3cf4a76bb2d8f736abe3a2d4168dbdcc429de8e45c74e3128ac8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:04:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:04:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:04:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: pidfile_write: ignore empty --pid-file 2024-09-19T09:04:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: load: jerasure load: lrc 2024-09-19T09:04:37.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Git sha 0 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: DB SUMMARY 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: DB Session ID: L1PRB3OMSYR34P2W1E7F 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1259 Bytes 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi049/store.db dir, Total Num: 1, files: 000029.sst 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi049/store.db: 000027.log size: 2729902 ; 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:04:37.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.env: 0x55a6a407c940 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.info_log: 0x55a6a52738c0 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.statistics: (nil) 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.use_fsync: 0 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:04:37.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.db_log_dir: 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.wal_dir: 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:04:37.056 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.write_buffer_manager: 0x55a6a5282dc0 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:04:37.057 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.unordered_write: 0 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:04:37.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.row_cache: None 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.wal_filter: None 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.wal_compression: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:04:37.059 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:04:37.060 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:04:37.060 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:04:37.060 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:04:37.060 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:04:37.060 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:04:37.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:04:37.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:04:37.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:04:37.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_open_files: -1 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:04:37.062 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Compression algorithms supported: 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kZSTD supported: 0 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:04:37.063 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000015 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:04:37.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.merge_operator: 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_filter: None 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a6a5273520) 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:04:37.065 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_type: 0 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_index_type: 0 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_shortening: 1 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: checksum: 4 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: no_block_cache: 0 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache: 0x55a6a52671f0 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_options: 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: capacity : 536870912 2024-09-19T09:04:37.066 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_shard_bits : 4 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: strict_capacity_limit : 0 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_compressed: (nil) 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: persistent_cache: (nil) 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size: 4096 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size_deviation: 10 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_restart_interval: 16 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_block_restart_interval: 1 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_block_size: 4096 2024-09-19T09:04:37.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: partition_filters: 0 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: use_delta_encoding: 1 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: filter_policy: bloomfilter 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: whole_key_filtering: 1 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: verify_compression: 0 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: format_version: 5 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_index_compression: 1 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_align: 0 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_auto_readahead_size: 262144 2024-09-19T09:04:37.068 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: prepopulate_block_cache: 0 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression: NoCompression 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.num_levels: 7 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:04:37.069 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:04:37.070 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:04:37.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:04:37.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:04:37.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:04:37.074 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.ttl: 2592000 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:04:37.075 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 31, last_sequence is 10371, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 27 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 27 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 200ef800-085d-40d1-8a59-0d08a58f341b 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736676757077, "job": 1, "event": "recovery_started", "wal_files": [27]} 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #27 mode 2 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736676766427, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 32, "file_size": 2501161, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10372, "largest_seqno": 11519, "table_properties": {"data_size": 2494971, "index_size": 3865, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 11621, "raw_average_key_size": 22, "raw_value_size": 2483635, "raw_average_value_size": 4879, "num_data_blocks": 177, "num_entries": 509, "num_filter_entries": 509, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726736676, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "200ef800-085d-40d1-8a59-0d08a58f341b", "db_session_id": "L1PRB3OMSYR34P2W1E7F", "orig_file_number": 32, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736676766545, "job": 1, "event": "recovery_finished"} 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/version_set.cc:5047] Creating manifest 34 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:04:37.076 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi049/store.db/000027.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a6a5294e00 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: DB pointer 0x55a6a5390000 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** DB Stats ** 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:04:37.077 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L0 1/0 2.39 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 446.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L6 1/0 5.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Sum 2/0 7.87 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 446.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 446.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2024-09-19T09:04:37.078 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 446.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative compaction: 0.00 GB write, 197.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:04:37.079 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval compaction: 0.00 GB write, 197.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache BinnedLRUCache@0x55a6a52671f0#2 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: starting mon.smithi049 rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi049 fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???) e2 preinit fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???).mds e21 new map 2024-09-19T09:04:37.080 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???).mds e21 print_map 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: e21 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: legacy client fscid: 1 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Filesystem 'cephfs' (1) 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: fs_name cephfs 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: epoch 21 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:04:37.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: tableserver 0 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: root 0 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: session_timeout 60 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: session_autoclose 300 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_file_size 1099511627776 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_xattr_size 65536 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: required_client_features {} 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: last_failure 0 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: last_failure_osd_epoch 46 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_mds 2 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: in 0,1 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: up {0=14478,1=24285} 2024-09-19T09:04:37.082 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: failed 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: damaged 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: stopped 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_pools [3] 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_pool 2 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: inline_data enabled 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: balancer 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: bal_rank_mask -1 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: standby_count_wanted 1 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: qdb_cluster leader: 0 members: 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:37.083 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 ceph-mon[91793]: mon.smithi049@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 bash[91774]: a5ea9706c7ce3cf4a76bb2d8f736abe3a2d4168dbdcc429de8e45c74e3128ac8 2024-09-19T09:04:37.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:36 smithi049 systemd[1]: Started Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:04:37.743 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 186 op/s 2024-09-19T09:04:37.743 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.743 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='client.24597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='client.24601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 186 op/s 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/1926700615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/917350271' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='client.? 172.21.15.49:0/2826962177' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: pgmap v37: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 284 op/s 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: pgmap v38: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1008 KiB/s wr, 152 op/s 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: mon.smithi049 calling monitor election 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: mon.smithi049 is new leader, mons smithi049,smithi102 in quorum (ranks 0,1) 2024-09-19T09:04:37.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: monmap epoch 2 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: last_changed 2024-09-19T08:55:27.778128+0000 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: created 2024-09-19T08:52:57.894000+0000 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: min_mon_release 18 (reef) 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: election_strategy: 1 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.smithi049 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.smithi102 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:04:37.745 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:04:37.746 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: mgrmap e33: smithi049.qdvksw(active, since 70s), standbys: smithi102.csalqv 2024-09-19T09:04:37.746 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:37.746 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:37.746 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:37.746 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: mgrmap e34: smithi049.qdvksw(active, since 71s), standbys: smithi102.csalqv 2024-09-19T09:04:37.746 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:37 smithi102 ceph-mon[35280]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 186 op/s 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='client.24597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='client.24601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 186 op/s 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1926700615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/917350271' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:04:37.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2826962177' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: pgmap v37: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 284 op/s 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: pgmap v38: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1008 KiB/s wr, 152 op/s 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: mon.smithi049 calling monitor election 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: mon.smithi049 is new leader, mons smithi049,smithi102 in quorum (ranks 0,1) 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: monmap epoch 2 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: last_changed 2024-09-19T08:55:27.778128+0000 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: created 2024-09-19T08:52:57.894000+0000 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: min_mon_release 18 (reef) 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: election_strategy: 1 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.smithi049 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.smithi102 2024-09-19T09:04:37.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:04:37.763 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T09:04:37.763 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: mgrmap e33: smithi049.qdvksw(active, since 70s), standbys: smithi102.csalqv 2024-09-19T09:04:37.763 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:37.763 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:37.763 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:37.763 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: mgrmap e34: smithi049.qdvksw(active, since 71s), standbys: smithi102.csalqv 2024-09-19T09:04:37.763 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:37 smithi049 ceph-mon[91793]: from='mgr.14678 ' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:42.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:42 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv restarted 2024-09-19T09:04:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:42 smithi102 ceph-mon[35280]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:04:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:42 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:04:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:42 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:04:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:42 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:04:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:42 smithi102 ceph-mon[35280]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:04:42.550 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:42 smithi049 ceph-mon[91793]: Standby manager daemon smithi102.csalqv restarted 2024-09-19T09:04:42.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:42 smithi049 ceph-mon[91793]: Standby manager daemon smithi102.csalqv started 2024-09-19T09:04:42.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:42 smithi049 ceph-mon[91793]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/crt"}]: dispatch 2024-09-19T09:04:42.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:42 smithi049 ceph-mon[91793]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:04:42.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:42 smithi049 ceph-mon[91793]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi102.csalqv/key"}]: dispatch 2024-09-19T09:04:42.551 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:42 smithi049 ceph-mon[91793]: from='mgr.? 172.21.15.102:0/771020516' entity='mgr.smithi102.csalqv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:04:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: mgrmap e35: smithi049.qdvksw(active, since 75s), standbys: smithi102.csalqv 2024-09-19T09:04:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: Active manager daemon smithi049.qdvksw restarted 2024-09-19T09:04:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: Activating manager daemon smithi049.qdvksw 2024-09-19T09:04:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: osdmap e49: 6 total, 6 up, 6 in 2024-09-19T09:04:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: mgrmap e36: smithi049.qdvksw(active, starting, since 0.00571735s), standbys: smithi102.csalqv 2024-09-19T09:04:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:04:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:04:43.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:04:43.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:04:43.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:04:43.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: Manager daemon smithi049.qdvksw is now available 2024-09-19T09:04:43.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:43.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:04:43.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:04:43.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T09:04:43.573 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: mgrmap e35: smithi049.qdvksw(active, since 75s), standbys: smithi102.csalqv 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: Active manager daemon smithi049.qdvksw restarted 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: Activating manager daemon smithi049.qdvksw 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: osdmap e49: 6 total, 6 up, 6 in 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: mgrmap e36: smithi049.qdvksw(active, starting, since 0.00571735s), standbys: smithi102.csalqv 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:04:43.574 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi049.qdvksw", "id": "smithi049.qdvksw"}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr metadata", "who": "smithi102.csalqv", "id": "smithi102.csalqv"}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: Manager daemon smithi049.qdvksw is now available 2024-09-19T09:04:43.575 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:43.576 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:04:43.576 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:04:43.576 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:43 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.qdvksw/trash_purge_schedule"}]: dispatch 2024-09-19T09:04:44.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:44 smithi102 ceph-mon[35280]: mgrmap e37: smithi049.qdvksw(active, since 1.01003s), standbys: smithi102.csalqv 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:44 smithi102 ceph-mon[35280]: [19/Sep/2024:09:04:43] ENGINE Bus STARTING 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:44 smithi102 ceph-mon[35280]: [19/Sep/2024:09:04:43] ENGINE Serving on https://172.21.15.49:7150 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:44 smithi102 ceph-mon[35280]: [19/Sep/2024:09:04:43] ENGINE Error in HTTPServer.serve 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Traceback (most recent call last): 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._run(expiration_interval) 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:04:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: s = self.context.wrap_socket( 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: return self.sslsocket_class._create( 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self.do_handshake() 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: self._sslobj.do_handshake() 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:44 smithi102 ceph-mon[35280]: [19/Sep/2024:09:04:44] ENGINE Serving on http://172.21.15.49:8765 2024-09-19T09:04:44.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:44 smithi102 ceph-mon[35280]: [19/Sep/2024:09:04:44] ENGINE Bus STARTED 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:44 smithi049 ceph-mon[91793]: mgrmap e37: smithi049.qdvksw(active, since 1.01003s), standbys: smithi102.csalqv 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:44 smithi049 ceph-mon[91793]: [19/Sep/2024:09:04:43] ENGINE Bus STARTING 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:44 smithi049 ceph-mon[91793]: [19/Sep/2024:09:04:43] ENGINE Serving on https://172.21.15.49:7150 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:44 smithi049 ceph-mon[91793]: [19/Sep/2024:09:04:43] ENGINE Error in HTTPServer.serve 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Traceback (most recent call last): 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._run(expiration_interval) 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:04:44.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: s = self.context.wrap_socket( 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: return self.sslsocket_class._create( 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self.do_handshake() 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: self._sslobj.do_handshake() 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:44 smithi049 ceph-mon[91793]: [19/Sep/2024:09:04:44] ENGINE Serving on http://172.21.15.49:8765 2024-09-19T09:04:44.806 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:44 smithi049 ceph-mon[91793]: [19/Sep/2024:09:04:44] ENGINE Bus STARTED 2024-09-19T09:04:45.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:45 smithi102 ceph-mon[35280]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:04:45.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:45 smithi102 ceph-mon[35280]: mgrmap e38: smithi049.qdvksw(active, since 2s), standbys: smithi102.csalqv 2024-09-19T09:04:45.780 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:45 smithi049 ceph-mon[91793]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:04:45.780 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:45 smithi049 ceph-mon[91793]: mgrmap e38: smithi049.qdvksw(active, since 2s), standbys: smithi102.csalqv 2024-09-19T09:04:46.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:46.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:46.957 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:46 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:46.957 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:46 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:46.957 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:46 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:46.958 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:46 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:48.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:48 smithi049 ceph-mon[91793]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:04:48.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:48 smithi049 ceph-mon[91793]: mgrmap e39: smithi049.qdvksw(active, since 4s), standbys: smithi102.csalqv 2024-09-19T09:04:48.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:48 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:48.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:48 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:48.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:48 smithi102 ceph-mon[35280]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:04:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:48 smithi102 ceph-mon[35280]: mgrmap e39: smithi049.qdvksw(active, since 4s), standbys: smithi102.csalqv 2024-09-19T09:04:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:48 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:48 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:50.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:49 smithi102 ceph-mon[35280]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:04:50.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:49 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:50.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:49 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:50.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:49 smithi049 ceph-mon[91793]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-19T09:04:50.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:50.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:04:51.215 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.216 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.216 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.216 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:51.216 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:50 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:52.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:51 smithi049 ceph-mon[91793]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-19T09:04:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:51 smithi049 ceph-mon[91793]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:04:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:51 smithi049 ceph-mon[91793]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:04:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:04:52.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:51 smithi102 ceph-mon[35280]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-19T09:04:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:51 smithi102 ceph-mon[35280]: Updating smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:04:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:51 smithi102 ceph-mon[35280]: Updating smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:04:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:51 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:51 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:04:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:51 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T09:04:53.438 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-mon[35280]: Upgrade: Updating mon.smithi102 2024-09-19T09:04:53.438 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:53.438 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:04:53.438 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:04:53.438 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-mon[35280]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:53.438 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-mon[35280]: Deploying daemon mon.smithi102 on smithi102 2024-09-19T09:04:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:53 smithi049 ceph-mon[91793]: Upgrade: Updating mon.smithi102 2024-09-19T09:04:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:04:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:04:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:53 smithi049 ceph-mon[91793]: Deploying daemon mon.smithi102 on smithi102 2024-09-19T09:04:54.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 systemd[1]: Stopping Ceph mon.smithi102 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:04:54.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102[35251]: 2024-09-19T09:04:53.942+0000 7f5b1b7f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi102 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:04:54.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102[35251]: 2024-09-19T09:04:53.942+0000 7f5b1b7f1640 -1 mon.smithi102@1(peon) e2 *** Got Signal Terminated *** 2024-09-19T09:04:54.333 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 podman[80713]: 2024-09-19 09:04:54.034774911 +0000 UTC m=+0.174401031 container died 4f6e29b8995eec97e3760a9134f6483d3f21039121e55ba4b650eac315b13ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:04:54.333 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 podman[80713]: 2024-09-19 09:04:54.334082592 +0000 UTC m=+0.473708667 container cleanup 4f6e29b8995eec97e3760a9134f6483d3f21039121e55ba4b650eac315b13ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b) 2024-09-19T09:04:54.701 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 bash[80713]: ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102 2024-09-19T09:04:54.701 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 podman[80725]: 2024-09-19 09:04:54.577463813 +0000 UTC m=+0.536670346 container remove 4f6e29b8995eec97e3760a9134f6483d3f21039121e55ba4b650eac315b13ad0 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T09:04:54.971 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi102.service: Deactivated successfully. 2024-09-19T09:04:54.971 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 systemd[1]: Stopped Ceph mon.smithi102 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:04:54.971 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi102.service: Consumed 6.254s CPU time. 2024-09-19T09:04:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:54 smithi102 systemd[1]: Starting Ceph mon.smithi102 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:04:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 podman[80856]: 2024-09-19 09:04:55.085459561 +0000 UTC m=+0.015963284 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:04:55.589 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 podman[80856]: 2024-09-19 09:04:55.329263237 +0000 UTC m=+0.259766961 container create 50b15ebe2a3eb8f2143f70ca5d5db10eec822534ae9625a2c79558f80d79a744 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:04:55.589 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 podman[80856]: 2024-09-19 09:04:55.56497943 +0000 UTC m=+0.495483157 container init 50b15ebe2a3eb8f2143f70ca5d5db10eec822534ae9625a2c79558f80d79a744 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T09:04:55.589 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 podman[80856]: 2024-09-19 09:04:55.568193836 +0000 UTC m=+0.498697562 container start 50b15ebe2a3eb8f2143f70ca5d5db10eec822534ae9625a2c79558f80d79a744 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T09:04:56.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:04:56.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:04:56.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: pidfile_write: ignore empty --pid-file 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: load: jerasure load: lrc 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Git sha 0 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: DB SUMMARY 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: DB Session ID: 1ZZOH5VUHLTLX4JIILM2 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1391 Bytes 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi102/store.db dir, Total Num: 1, files: 000027.sst 2024-09-19T09:04:56.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi102/store.db: 000025.log size: 71988 ; 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.env: 0x55d1f2e26940 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.info_log: 0x55d1f36878c0 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.statistics: (nil) 2024-09-19T09:04:56.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.use_fsync: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:04:56.012 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.db_log_dir: 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.wal_dir: 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.write_buffer_manager: 0x55d1f3696dc0 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:04:56.013 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.unordered_write: 0 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.row_cache: None 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.wal_filter: None 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:04:56.014 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.wal_compression: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:04:56.015 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:04:56.017 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_open_files: -1 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Compression algorithms supported: 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kZSTD supported: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:04:56.018 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi102/store.db/MANIFEST-000010 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.merge_operator: 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_filter: None 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d1f3687520) 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:04:56.019 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: index_type: 0 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: data_block_index_type: 0 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: index_shortening: 1 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: checksum: 4 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: no_block_cache: 0 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_cache: 0x55d1f367b1f0 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_cache_options: 2024-09-19T09:04:56.020 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: capacity : 536870912 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: num_shard_bits : 4 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: strict_capacity_limit : 0 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_cache_compressed: (nil) 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: persistent_cache: (nil) 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_size: 4096 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_size_deviation: 10 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_restart_interval: 16 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: index_block_restart_interval: 1 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: metadata_block_size: 4096 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: partition_filters: 0 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: use_delta_encoding: 1 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: filter_policy: bloomfilter 2024-09-19T09:04:56.021 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: whole_key_filtering: 1 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: verify_compression: 0 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: format_version: 5 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: enable_index_compression: 1 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: block_align: 0 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: max_auto_readahead_size: 262144 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: prepopulate_block_cache: 0 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression: NoCompression 2024-09-19T09:04:56.022 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.num_levels: 7 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:04:56.023 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:04:56.024 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:04:56.025 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:04:56.025 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:04:56.025 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:04:56.025 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:04:56.025 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:04:56.025 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:04:56.025 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:04:56.026 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:04:56.027 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:04:56.028 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.ttl: 2592000 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:04:56.029 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi102/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12295, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4d970006-9580-4891-aa68-4d84993a0e2c 2024-09-19T09:04:56.030 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736695594962, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736695595630, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 48370, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12300, "largest_seqno": 12378, "table_properties": {"data_size": 46934, "index_size": 206, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 197, "raw_key_size": 1421, "raw_average_key_size": 26, "raw_value_size": 45767, "raw_average_value_size": 863, "num_data_blocks": 9, "num_entries": 53, "num_filter_entries": 53, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726736695, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4d970006-9580-4891-aa68-4d84993a0e2c", "db_session_id": "1ZZOH5VUHLTLX4JIILM2", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736695595724, "job": 1, "event": "recovery_finished"} 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi102/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d1f36a8e00 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: DB pointer 0x55d1f37a4000 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ** DB Stats ** 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:04:56.031 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ** Compaction Stats [default] ** 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: L0 1/0 47.24 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: L6 1/0 8.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Sum 2/0 8.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:04:56.032 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ** Compaction Stats [default] ** 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 107.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:04:56.033 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Cumulative compaction: 0.00 GB write, 16.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Interval compaction: 0.00 GB write, 16.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Block cache BinnedLRUCache@0x55d1f367b1f0#2 capacity: 512.00 MB usage: 0.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.23 KB,4.47035e-05%) IndexBlock(1,0.28 KB,5.36442e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: starting mon.smithi102 rank 1 at public addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] at bind addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi102 fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???) e2 preinit fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???).mds e21 new map 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???).mds e21 print_map 2024-09-19T09:04:56.034 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: e21 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: legacy client fscid: 1 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: Filesystem 'cephfs' (1) 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: fs_name cephfs 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: epoch 21 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: tableserver 0 2024-09-19T09:04:56.035 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: root 0 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: session_timeout 60 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: session_autoclose 300 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: max_file_size 1099511627776 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: max_xattr_size 65536 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: required_client_features {} 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: last_failure 0 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: last_failure_osd_epoch 46 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: max_mds 2 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: in 0,1 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: up {0=14478,1=24285} 2024-09-19T09:04:56.036 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: failed 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: damaged 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: stopped 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: data_pools [3] 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: metadata_pool 2 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: inline_data enabled 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: balancer 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: bal_rank_mask -1 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: standby_count_wanted 1 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: qdb_cluster leader: 0 members: 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: [mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: [mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: [mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:56.037 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: [mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout: 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 ceph-mon[80875]: mon.smithi102@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 bash[80856]: 50b15ebe2a3eb8f2143f70ca5d5db10eec822534ae9625a2c79558f80d79a744 2024-09-19T09:04:56.038 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:55 smithi102 systemd[1]: Started Ceph mon.smithi102 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:04:57.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:57 smithi049 ceph-mon[91793]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-19T09:04:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:57 smithi102 ceph-mon[80875]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-19T09:04:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: pgmap v10: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-19T09:04:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.smithi102 2024-09-19T09:04:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:04:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: osdmap e49: 6 total, 6 up, 6 in 2024-09-19T09:04:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: mgrmap e39: smithi049.qdvksw(active, since 14s), standbys: smithi102.csalqv 2024-09-19T09:04:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: mon.smithi102 calling monitor election 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: mon.smithi049 calling monitor election 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: mon.smithi049 is new leader, mons smithi049,smithi102 in quorum (ranks 0,1) 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: monmap epoch 3 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: last_changed 2024-09-19T09:04:57.080472+0000 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: created 2024-09-19T08:52:57.894000+0000 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: min_mon_release 19 (squid) 2024-09-19T09:04:58.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: election_strategy: 1 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.smithi049 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.smithi102 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: osdmap e49: 6 total, 6 up, 6 in 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: mgrmap e39: smithi049.qdvksw(active, since 14s), standbys: smithi102.csalqv 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:58.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:04:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: pgmap v10: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.smithi102 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: osdmap e49: 6 total, 6 up, 6 in 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: mgrmap e39: smithi049.qdvksw(active, since 14s), standbys: smithi102.csalqv 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: mon.smithi102 calling monitor election 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: mon.smithi049 calling monitor election 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mon metadata", "id": "smithi102"}]: dispatch 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: mon.smithi049 is new leader, mons smithi049,smithi102 in quorum (ranks 0,1) 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: monmap epoch 3 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: fsid 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: last_changed 2024-09-19T09:04:57.080472+0000 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: created 2024-09-19T08:52:57.894000+0000 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: min_mon_release 19 (squid) 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: election_strategy: 1 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.smithi049 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.smithi102 2024-09-19T09:04:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby-replay 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: osdmap e49: 6 total, 6 up, 6 in 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: mgrmap e39: smithi049.qdvksw(active, since 14s), standbys: smithi102.csalqv 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:58.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:04:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:00 smithi102 ceph-mon[80875]: pgmap v11: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-19T09:05:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:00.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:00 smithi049 ceph-mon[91793]: pgmap v11: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-19T09:05:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:00.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:01.709 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:01 smithi102 ceph-mon[80875]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T09:05:01.709 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:01.709 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:02.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:01 smithi049 ceph-mon[91793]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-19T09:05:02.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:02.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:04.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 -- 172.21.15.49:0/2834183204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700feaf0 msgr2=0x7f7c700feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 --2- 172.21.15.49:0/2834183204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700feaf0 0x7f7c700feef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009880 tx=0x7f7c6002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 -- 172.21.15.49:0/2834183204 shutdown_connections 2024-09-19T09:05:04.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 --2- 172.21.15.49:0/2834183204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700ffcf0 0x7f7c70100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 --2- 172.21.15.49:0/2834183204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700feaf0 0x7f7c700feef0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 -- 172.21.15.49:0/2834183204 >> 172.21.15.49:0/2834183204 conn(0x7f7c700fa280 msgr2=0x7f7c700fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 -- 172.21.15.49:0/2834183204 shutdown_connections 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 -- 172.21.15.49:0/2834183204 wait complete. 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 Processor -- start 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.021+0000 7f7c76721640 1 -- start start 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c76721640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700feaf0 0x7f7c70068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c76721640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700ffcf0 0x7f7c7019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c76721640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7019a9f0 con 0x7f7c700ffcf0 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c76721640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7019ab30 con 0x7f7c700feaf0 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700ffcf0 0x7f7c7019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700ffcf0 0x7f7c7019a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42574/0 (socket says 172.21.15.49:42574) 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c6f7fe640 1 -- 172.21.15.49:0/3549602637 learned_addr learned my addr 172.21.15.49:0/3549602637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c6ffff640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700feaf0 0x7f7c70068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c6f7fe640 1 -- 172.21.15.49:0/3549602637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700feaf0 msgr2=0x7f7c70068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c6f7fe640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700feaf0 0x7f7c70068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.022+0000 7f7c6f7fe640 1 -- 172.21.15.49:0/3549602637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009560 con 0x7f7c700ffcf0 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.023+0000 7f7c6f7fe640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700ffcf0 0x7f7c7019a420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e970 tx=0x7f7c5800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.023+0000 7f7c6d7fa640 1 -- 172.21.15.49:0/3549602637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c5800cc90 con 0x7f7c700ffcf0 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.023+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7019ade0 con 0x7f7c700ffcf0 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.023+0000 7f7c6d7fa640 1 -- 172.21.15.49:0/3549602637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c5800cdf0 con 0x7f7c700ffcf0 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.023+0000 7f7c6d7fa640 1 -- 172.21.15.49:0/3549602637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c58010430 con 0x7f7c700ffcf0 2024-09-19T09:05:04.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.023+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7019b300 con 0x7f7c700ffcf0 2024-09-19T09:05:04.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.024+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c700feef0 con 0x7f7c700ffcf0 2024-09-19T09:05:04.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.024+0000 7f7c6d7fa640 1 -- 172.21.15.49:0/3549602637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7c580046c0 con 0x7f7c700ffcf0 2024-09-19T09:05:04.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.025+0000 7f7c6d7fa640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7c5c06e730 0x7f7c5c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.025+0000 7f7c6d7fa640 1 -- 172.21.15.49:0/3549602637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7c58014070 con 0x7f7c700ffcf0 2024-09-19T09:05:04.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.025+0000 7f7c6ffff640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7c5c06e730 0x7f7c5c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.026+0000 7f7c6ffff640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7c5c06e730 0x7f7c5c070bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009230 tx=0x7f7c600314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.030+0000 7f7c6d7fa640 1 -- 172.21.15.49:0/3549602637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7c58057dd0 con 0x7f7c700ffcf0 2024-09-19T09:05:04.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:03 smithi049 ceph-mon[91793]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:04.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.227+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c7002c4a0 con 0x7f7c5c06e730 2024-09-19T09:05:04.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.228+0000 7f7c6d7fa640 1 -- 172.21.15.49:0/3549602637 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f7c7002c4a0 con 0x7f7c5c06e730 2024-09-19T09:05:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7c5c06e730 msgr2=0x7f7c5c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7c5c06e730 0x7f7c5c070bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009230 tx=0x7f7c600314e0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700ffcf0 msgr2=0x7f7c7019a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700ffcf0 0x7f7c7019a420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e970 tx=0x7f7c5800ed70 comp rx=0 tx=0).stop 2024-09-19T09:05:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 shutdown_connections 2024-09-19T09:05:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7c5c06e730 0x7f7c5c070bf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7c700ffcf0 0x7f7c7019a420 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 --2- 172.21.15.49:0/3549602637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c700feaf0 0x7f7c70068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.230+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 >> 172.21.15.49:0/3549602637 conn(0x7f7c700fa280 msgr2=0x7f7c701033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.231+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 shutdown_connections 2024-09-19T09:05:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.231+0000 7f7c76721640 1 -- 172.21.15.49:0/3549602637 wait complete. 2024-09-19T09:05:04.239 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:05:04.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:03 smithi102 ceph-mon[80875]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 -- 172.21.15.49:0/2568898423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4102fa0 msgr2=0x7fbde4105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 --2- 172.21.15.49:0/2568898423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4102fa0 0x7fbde4105390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009880 tx=0x7fbdcc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 -- 172.21.15.49:0/2568898423 shutdown_connections 2024-09-19T09:05:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 --2- 172.21.15.49:0/2568898423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4102fa0 0x7fbde4105390 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 --2- 172.21.15.49:0/2568898423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbde4100670 0x7fbde4102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 -- 172.21.15.49:0/2568898423 >> 172.21.15.49:0/2568898423 conn(0x7fbde40fa230 msgr2=0x7fbde40fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 -- 172.21.15.49:0/2568898423 shutdown_connections 2024-09-19T09:05:04.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.316+0000 7fbde9199640 1 -- 172.21.15.49:0/2568898423 wait complete. 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde9199640 1 Processor -- start 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde9199640 1 -- start start 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde9199640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4100670 0x7fbde40fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde9199640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbde4102fa0 0x7fbde40fe620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde9199640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40feb60 con 0x7fbde4100670 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde9199640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40fecd0 con 0x7fbde4102fa0 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4100670 0x7fbde40fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4100670 0x7fbde40fffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42584/0 (socket says 172.21.15.49:42584) 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde2d9d640 1 -- 172.21.15.49:0/2760738869 learned_addr learned my addr 172.21.15.49:0/2760738869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.317+0000 7fbde259c640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbde4102fa0 0x7fbde40fe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbde2d9d640 1 -- 172.21.15.49:0/2760738869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbde4102fa0 msgr2=0x7fbde40fe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbde2d9d640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbde4102fa0 0x7fbde40fe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbde2d9d640 1 -- 172.21.15.49:0/2760738869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc009560 con 0x7fbde4100670 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbde259c640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbde4102fa0 0x7fbde40fe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbde2d9d640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4100670 0x7fbde40fffd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400d8d0 tx=0x7fbdd400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbddbfff640 1 -- 172.21.15.49:0/2760738869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdd400bea0 con 0x7fbde4100670 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbddbfff640 1 -- 172.21.15.49:0/2760738869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdd4009c00 con 0x7fbde4100670 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbddbfff640 1 -- 172.21.15.49:0/2760738869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdd400f710 con 0x7fbde4100670 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde40fefb0 con 0x7fbde4100670 2024-09-19T09:05:04.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.318+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde419d620 con 0x7fbde4100670 2024-09-19T09:05:04.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.319+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde4100a50 con 0x7fbde4100670 2024-09-19T09:05:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.320+0000 7fbddbfff640 1 -- 172.21.15.49:0/2760738869 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fbdd400f990 con 0x7fbde4100670 2024-09-19T09:05:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.321+0000 7fbddbfff640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbdd006e730 0x7fbdd0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.321+0000 7fbddbfff640 1 -- 172.21.15.49:0/2760738869 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbdd408e620 con 0x7fbde4100670 2024-09-19T09:05:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.321+0000 7fbde259c640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbdd006e730 0x7fbdd0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.321+0000 7fbde259c640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbdd006e730 0x7fbdd0070bf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009230 tx=0x7fbdcc0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.325+0000 7fbddbfff640 1 -- 172.21.15.49:0/2760738869 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbdd4057600 con 0x7fbde4100670 2024-09-19T09:05:04.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.523+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbde41039e0 con 0x7fbdd006e730 2024-09-19T09:05:04.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.525+0000 7fbddbfff640 1 -- 172.21.15.49:0/2760738869 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fbde41039e0 con 0x7fbdd006e730 2024-09-19T09:05:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbdd006e730 msgr2=0x7fbdd0070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbdd006e730 0x7fbdd0070bf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009230 tx=0x7fbdcc0314e0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4100670 msgr2=0x7fbde40fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4100670 0x7fbde40fffd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400d8d0 tx=0x7fbdd400dd90 comp rx=0 tx=0).stop 2024-09-19T09:05:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 shutdown_connections 2024-09-19T09:05:04.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbdd006e730 0x7fbdd0070bf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbde4102fa0 0x7fbde40fe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 --2- 172.21.15.49:0/2760738869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbde4100670 0x7fbde40fffd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 >> 172.21.15.49:0/2760738869 conn(0x7fbde40fa230 msgr2=0x7fbde40fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 shutdown_connections 2024-09-19T09:05:04.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.527+0000 7fbde9199640 1 -- 172.21.15.49:0/2760738869 wait complete. 2024-09-19T09:05:04.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 -- 172.21.15.49:0/136292847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14103010 msgr2=0x7faf14105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 --2- 172.21.15.49:0/136292847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14103010 0x7faf14105400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faf04009880 tx=0x7faf0402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 -- 172.21.15.49:0/136292847 shutdown_connections 2024-09-19T09:05:04.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 --2- 172.21.15.49:0/136292847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf14103010 0x7faf14105400 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 --2- 172.21.15.49:0/136292847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf141006e0 0x7faf14102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 -- 172.21.15.49:0/136292847 >> 172.21.15.49:0/136292847 conn(0x7faf140fa280 msgr2=0x7faf140fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 -- 172.21.15.49:0/136292847 shutdown_connections 2024-09-19T09:05:04.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.614+0000 7faf1c579640 1 -- 172.21.15.49:0/136292847 wait complete. 2024-09-19T09:05:04.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1c579640 1 Processor -- start 2024-09-19T09:05:04.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1c579640 1 -- start start 2024-09-19T09:05:04.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1c579640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf141006e0 0x7faf140ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1c579640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf14103010 0x7faf140fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1c579640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140febd0 con 0x7faf141006e0 2024-09-19T09:05:04.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1c579640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf140fed40 con 0x7faf14103010 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1a315640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf141006e0 0x7faf140ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1a315640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf141006e0 0x7faf140ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42602/0 (socket says 172.21.15.49:42602) 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1a315640 1 -- 172.21.15.49:0/3800757161 learned_addr learned my addr 172.21.15.49:0/3800757161 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf19b14640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf14103010 0x7faf140fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1a315640 1 -- 172.21.15.49:0/3800757161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf14103010 msgr2=0x7faf140fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.615+0000 7faf1a315640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf14103010 0x7faf140fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.616+0000 7faf1a315640 1 -- 172.21.15.49:0/3800757161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04009560 con 0x7faf141006e0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.616+0000 7faf1a315640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf141006e0 0x7faf140ffff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf1000e970 tx=0x7faf1000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.616+0000 7faf0b7fe640 1 -- 172.21.15.49:0/3800757161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1000cc90 con 0x7faf141006e0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.616+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf140ff020 con 0x7faf141006e0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.616+0000 7faf0b7fe640 1 -- 172.21.15.49:0/3800757161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf1000cdf0 con 0x7faf141006e0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.616+0000 7faf0b7fe640 1 -- 172.21.15.49:0/3800757161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf10018810 con 0x7faf141006e0 2024-09-19T09:05:04.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.616+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1419d710 con 0x7faf141006e0 2024-09-19T09:05:04.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.617+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf14100ac0 con 0x7faf141006e0 2024-09-19T09:05:04.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.618+0000 7faf0b7fe640 1 -- 172.21.15.49:0/3800757161 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7faf10010c10 con 0x7faf141006e0 2024-09-19T09:05:04.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.618+0000 7faf0b7fe640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf0006e730 0x7faf00070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.619+0000 7faf0b7fe640 1 -- 172.21.15.49:0/3800757161 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faf10014070 con 0x7faf141006e0 2024-09-19T09:05:04.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.619+0000 7faf19b14640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf0006e730 0x7faf00070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.620+0000 7faf19b14640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf0006e730 0x7faf00070bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf04009230 tx=0x7faf04005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.623+0000 7faf0b7fe640 1 -- 172.21.15.49:0/3800757161 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faf10054210 con 0x7faf141006e0 2024-09-19T09:05:04.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.808+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf14103a90 con 0x7faf0006e730 2024-09-19T09:05:04.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.818+0000 7faf0b7fe640 1 -- 172.21.15.49:0/3800757161 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7faf14103a90 con 0x7faf0006e730 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (9m) 16s ago 10m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (10m) 16s ago 10m 8200k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (9m) 4s ago 9m 8061k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (10m) 16s ago 10m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 bf45b26a6f91 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (9m) 4s ago 9m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (9m) 16s ago 10m 84.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (5m) 16s ago 5m 92.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:05:04.819 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (5m) 16s ago 5m 161M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (5m) 4s ago 5m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (5m) 4s ago 5m 26.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (2m) 16s ago 11m 472M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (51s) 4s ago 9m 438M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (28s) 16s ago 12m 29.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (9s) 4s ago 9m 18.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (10m) 16s ago 10m 15.7M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (9m) 4s ago 9m 16.6M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (8m) 16s ago 8m 208M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (8m) 16s ago 8m 220M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 16s ago 7m 191M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:05:04.820 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (7m) 4s ago 7m 244M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:05:04.821 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (7m) 4s ago 7m 215M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:05:04.821 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (6m) 4s ago 6m 208M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:05:04.821 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (57s) 16s ago 10m 49.4M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:05:04.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf0006e730 msgr2=0x7faf00070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf0006e730 0x7faf00070bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf04009230 tx=0x7faf04005d50 comp rx=0 tx=0).stop 2024-09-19T09:05:04.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf141006e0 msgr2=0x7faf140ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf141006e0 0x7faf140ffff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf1000e970 tx=0x7faf1000ee30 comp rx=0 tx=0).stop 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 shutdown_connections 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf0006e730 0x7faf00070bf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf14103010 0x7faf140fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 --2- 172.21.15.49:0/3800757161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf141006e0 0x7faf140ffff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.820+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 >> 172.21.15.49:0/3800757161 conn(0x7faf140fa280 msgr2=0x7faf140fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.821+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 shutdown_connections 2024-09-19T09:05:04.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.821+0000 7faf1c579640 1 -- 172.21.15.49:0/3800757161 wait complete. 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 -- 172.21.15.49:0/3752339067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0feaa0 msgr2=0x7f594c0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 --2- 172.21.15.49:0/3752339067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0feaa0 0x7f594c0feea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5948009880 tx=0x7f594802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 -- 172.21.15.49:0/3752339067 shutdown_connections 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 --2- 172.21.15.49:0/3752339067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f594c0ffca0 0x7f594c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 --2- 172.21.15.49:0/3752339067 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0feaa0 0x7f594c0feea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 -- 172.21.15.49:0/3752339067 >> 172.21.15.49:0/3752339067 conn(0x7f594c0fa250 msgr2=0x7f594c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 -- 172.21.15.49:0/3752339067 shutdown_connections 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.903+0000 7f5953550640 1 -- 172.21.15.49:0/3752339067 wait complete. 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5953550640 1 Processor -- start 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5953550640 1 -- start start 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5953550640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f594c0feaa0 0x7f594c195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5953550640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0ffca0 0x7f594c195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5953550640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c1960e0 con 0x7f594c0ffca0 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5953550640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c196250 con 0x7f594c0feaa0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5950aeb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0ffca0 0x7f594c195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5950aeb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0ffca0 0x7f594c195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42608/0 (socket says 172.21.15.49:42608) 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f5950aeb640 1 -- 172.21.15.49:0/1322549753 learned_addr learned my addr 172.21.15.49:0/1322549753 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.904+0000 7f59512ec640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f594c0feaa0 0x7f594c195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f5950aeb640 1 -- 172.21.15.49:0/1322549753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f594c0feaa0 msgr2=0x7f594c195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f5950aeb640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f594c0feaa0 0x7f594c195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f5950aeb640 1 -- 172.21.15.49:0/1322549753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948009560 con 0x7f594c0ffca0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f5950aeb640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0ffca0 0x7f594c195ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c8a0 tx=0x7f593c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f59427fc640 1 -- 172.21.15.49:0/1322549753 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c007b80 con 0x7f594c0ffca0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f59427fc640 1 -- 172.21.15.49:0/1322549753 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f593c007ce0 con 0x7f594c0ffca0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c19ad30 con 0x7f594c0ffca0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f59427fc640 1 -- 172.21.15.49:0/1322549753 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593c018810 con 0x7f594c0ffca0 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.905+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c19b2b0 con 0x7f594c0ffca0 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.906+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c107690 con 0x7f594c0ffca0 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.907+0000 7f59427fc640 1 -- 172.21.15.49:0/1322549753 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f593c018970 con 0x7f594c0ffca0 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.907+0000 7f59427fc640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f593806e730 0x7f5938070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.907+0000 7f59427fc640 1 -- 172.21.15.49:0/1322549753 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f593c08e9b0 con 0x7f594c0ffca0 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.907+0000 7f59512ec640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f593806e730 0x7f5938070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.908+0000 7f59512ec640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f593806e730 0x7f5938070bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5948009230 tx=0x7f59480314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:04.912+0000 7f59427fc640 1 -- 172.21.15.49:0/1322549753 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f593c057960 con 0x7f594c0ffca0 2024-09-19T09:05:05.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: Reconfiguring mon.smithi049 (monmap changed)... 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: Reconfiguring daemon mon.smithi049 on smithi049 2024-09-19T09:05:05.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:04 smithi049 ceph-mon[91793]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:05.113 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:05.113 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:05.113 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:05.113 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:05.113 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:05.113 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: Reconfiguring mon.smithi049 (monmap changed)... 2024-09-19T09:05:05.113 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:05:05.114 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:05:05.114 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:05.114 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: Reconfiguring daemon mon.smithi049 on smithi049 2024-09-19T09:05:05.114 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:04 smithi102 ceph-mon[80875]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.158+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f594c107870 con 0x7f594c0ffca0 2024-09-19T09:05:05.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.158+0000 7f59427fc640 1 -- 172.21.15.49:0/1322549753 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f593c05b020 con 0x7f594c0ffca0 2024-09-19T09:05:05.158 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:05.159 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:05:05.160 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 10, 2024-09-19T09:05:05.160 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:05:05.160 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:05:05.160 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f593806e730 msgr2=0x7f5938070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f593806e730 0x7f5938070bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5948009230 tx=0x7f59480314e0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0ffca0 msgr2=0x7f594c195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0ffca0 0x7f594c195ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c8a0 tx=0x7f593c00cd60 comp rx=0 tx=0).stop 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 shutdown_connections 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f593806e730 0x7f5938070bf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f594c0ffca0 0x7f594c195ba0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 --2- 172.21.15.49:0/1322549753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f594c0feaa0 0x7f594c195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 >> 172.21.15.49:0/1322549753 conn(0x7f594c0fa250 msgr2=0x7f594c0fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 shutdown_connections 2024-09-19T09:05:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.160+0000 7f5953550640 1 -- 172.21.15.49:0/1322549753 wait complete. 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1058273638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc100d90 msgr2=0x7fd7bc101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1058273638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc100d90 0x7fd7bc101210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009880 tx=0x7fd7a402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1058273638 shutdown_connections 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1058273638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc100d90 0x7fd7bc101210 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1058273638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7bc0ffb90 0x7fd7bc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1058273638 >> 172.21.15.49:0/1058273638 conn(0x7fd7bc0fb320 msgr2=0x7fd7bc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1058273638 shutdown_connections 2024-09-19T09:05:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.245+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1058273638 wait complete. 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7c26e2640 1 Processor -- start 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7c26e2640 1 -- start start 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7c26e2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc0ffb90 0x7fd7bc195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7c26e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7bc100d90 0x7fd7bc195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7c26e2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc196240 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7c26e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc1963b0 con 0x7fd7bc100d90 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc0ffb90 0x7fd7bc195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc0ffb90 0x7fd7bc195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42632/0 (socket says 172.21.15.49:42632) 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7bbfff640 1 -- 172.21.15.49:0/1503859854 learned_addr learned my addr 172.21.15.49:0/1503859854 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.246+0000 7fd7bb7fe640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7bc100d90 0x7fd7bc195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7bbfff640 1 -- 172.21.15.49:0/1503859854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7bc100d90 msgr2=0x7fd7bc195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7bbfff640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7bc100d90 0x7fd7bc195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7bbfff640 1 -- 172.21.15.49:0/1503859854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4009560 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7bbfff640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc0ffb90 0x7fd7bc195730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00b400 tx=0x7fd7ac00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7b97fa640 1 -- 172.21.15.49:0/1503859854 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac011800 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc19ae50 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7b97fa640 1 -- 172.21.15.49:0/1503859854 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7ac011e20 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7b97fa640 1 -- 172.21.15.49:0/1503859854 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac00f2e0 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.247+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc19b390 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.248+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc100010 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.248+0000 7fd7b97fa640 1 -- 172.21.15.49:0/1503859854 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fd7ac010380 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.249+0000 7fd7b97fa640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd7a806e730 0x7fd7a8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.249+0000 7fd7b97fa640 1 -- 172.21.15.49:0/1503859854 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd7ac08e520 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.249+0000 7fd7bb7fe640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd7a806e730 0x7fd7a8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.249+0000 7fd7bb7fe640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd7a806e730 0x7fd7a8070bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4000c00 tx=0x7fd7a40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:05.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.253+0000 7fd7b97fa640 1 -- 172.21.15.49:0/1503859854 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd7ac057560 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.467+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd7bc108820 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.468+0000 7fd7b97fa640 1 -- 172.21.15.49:0/1503859854 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7fd7ac05ac20 con 0x7fd7bc0ffb90 2024-09-19T09:05:05.468 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:05:05.468 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:05:05.469 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:05:05.469 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:05:05.469 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:05:05.469 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:05:05.472 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:05:05.473 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:05.474 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:05.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:05:05.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:05:05.475 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd7a806e730 msgr2=0x7fd7a8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd7a806e730 0x7fd7a8070bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4000c00 tx=0x7fd7a40314e0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc0ffb90 msgr2=0x7fd7bc195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc0ffb90 0x7fd7bc195730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00b400 tx=0x7fd7ac00b8c0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 shutdown_connections 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd7a806e730 0x7fd7a8070bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7bc100d90 0x7fd7bc195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 --2- 172.21.15.49:0/1503859854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7bc0ffb90 0x7fd7bc195730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 >> 172.21.15.49:0/1503859854 conn(0x7fd7bc0fb320 msgr2=0x7fd7bc103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 shutdown_connections 2024-09-19T09:05:05.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.470+0000 7fd7c26e2640 1 -- 172.21.15.49:0/1503859854 wait complete. 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 -- 172.21.15.49:0/1357685743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 msgr2=0x7f29340ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 --2- 172.21.15.49:0/1357685743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f29340ff270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2928009880 tx=0x7f292802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 -- 172.21.15.49:0/1357685743 shutdown_connections 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 --2- 172.21.15.49:0/1357685743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f29340ff270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 --2- 172.21.15.49:0/1357685743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29340fe4d0 0x7f29340fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 -- 172.21.15.49:0/1357685743 >> 172.21.15.49:0/1357685743 conn(0x7f29340fa280 msgr2=0x7f29340fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 -- 172.21.15.49:0/1357685743 shutdown_connections 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.555+0000 7f29393d4640 1 -- 172.21.15.49:0/1357685743 wait complete. 2024-09-19T09:05:05.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.556+0000 7f29393d4640 1 Processor -- start 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.556+0000 7f29393d4640 1 -- start start 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.556+0000 7f29393d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29340fe4d0 0x7f29341978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.556+0000 7f29393d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f2934197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.556+0000 7f29393d4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29341983e0 con 0x7f29340fee10 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.556+0000 7f29393d4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934198550 con 0x7f29340fe4d0 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.556+0000 7f29327fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f2934197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29327fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f2934197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42642/0 (socket says 172.21.15.49:42642) 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29327fc640 1 -- 172.21.15.49:0/2173902237 learned_addr learned my addr 172.21.15.49:0/2173902237 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f2932ffd640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29340fe4d0 0x7f29341978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29327fc640 1 -- 172.21.15.49:0/2173902237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29340fe4d0 msgr2=0x7f29341978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29327fc640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29340fe4d0 0x7f29341978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29327fc640 1 -- 172.21.15.49:0/2173902237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2928009560 con 0x7f29340fee10 2024-09-19T09:05:05.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29327fc640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f2934197e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f29280055a0 tx=0x7f29280055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f291bfff640 1 -- 172.21.15.49:0/2173902237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2928004aa0 con 0x7f29340fee10 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f291bfff640 1 -- 172.21.15.49:0/2173902237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2928004c00 con 0x7f29340fee10 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293419cf40 con 0x7f29340fee10 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f291bfff640 1 -- 172.21.15.49:0/2173902237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2928003b10 con 0x7f29340fee10 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.557+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293419d400 con 0x7f29340fee10 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.559+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29340fe8d0 con 0x7f29340fee10 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.559+0000 7f291bfff640 1 -- 172.21.15.49:0/2173902237 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2928003d40 con 0x7f29340fee10 2024-09-19T09:05:05.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.559+0000 7f291bfff640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f291c06e730 0x7f291c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.560+0000 7f291bfff640 1 -- 172.21.15.49:0/2173902237 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f29280af980 con 0x7f29340fee10 2024-09-19T09:05:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.560+0000 7f2932ffd640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f291c06e730 0x7f291c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.560+0000 7f2932ffd640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f291c06e730 0x7f291c070bf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2924009bd0 tx=0x7f2924005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:05.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.564+0000 7f291bfff640 1 -- 172.21.15.49:0/2173902237 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2928078a20 con 0x7f29340fee10 2024-09-19T09:05:05.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.767+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f293402c4a0 con 0x7f291c06e730 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.769+0000 7f291bfff640 1 -- 172.21.15.49:0/2173902237 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f293402c4a0 con 0x7f291c06e730 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-09-19T09:05:05.769 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:05:05.770 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "4/23 daemons upgraded", 2024-09-19T09:05:05.770 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mon daemons", 2024-09-19T09:05:05.770 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:05:05.770 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:05:05.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f291c06e730 msgr2=0x7f291c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f291c06e730 0x7f291c070bf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2924009bd0 tx=0x7f2924005f90 comp rx=0 tx=0).stop 2024-09-19T09:05:05.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 msgr2=0x7f2934197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f2934197e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f29280055a0 tx=0x7f29280055d0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 shutdown_connections 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f291c06e730 0x7f291c070bf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29340fee10 0x7f2934197e10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 --2- 172.21.15.49:0/2173902237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29340fe4d0 0x7f29341978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.771+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 >> 172.21.15.49:0/2173902237 conn(0x7f29340fa280 msgr2=0x7f2934106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.772+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 shutdown_connections 2024-09-19T09:05:05.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.772+0000 7f29393d4640 1 -- 172.21.15.49:0/2173902237 wait complete. 2024-09-19T09:05:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 -- 172.21.15.49:0/975644973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 msgr2=0x7f2a800fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/975644973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a800fe820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009880 tx=0x7f2a7c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 -- 172.21.15.49:0/975644973 shutdown_connections 2024-09-19T09:05:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/975644973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a800fed60 0x7f2a800ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/975644973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a800fe820 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 -- 172.21.15.49:0/975644973 >> 172.21.15.49:0/975644973 conn(0x7f2a800fa250 msgr2=0x7f2a800fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 -- 172.21.15.49:0/975644973 shutdown_connections 2024-09-19T09:05:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.859+0000 7f2a87c1e640 1 -- 172.21.15.49:0/975644973 wait complete. 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a87c1e640 1 Processor -- start 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a87c1e640 1 -- start start 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a87c1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a801977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a87c1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a800fed60 0x7f2a80197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a87c1e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a801982d0 con 0x7f2a800fe420 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a87c1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80198440 con 0x7f2a800fed60 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a859ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a801977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a859ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a801977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42664/0 (socket says 172.21.15.49:42664) 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.860+0000 7f2a859ba640 1 -- 172.21.15.49:0/1418238681 learned_addr learned my addr 172.21.15.49:0/1418238681 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a851b9640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a800fed60 0x7f2a80197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a859ba640 1 -- 172.21.15.49:0/1418238681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a800fed60 msgr2=0x7f2a80197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a859ba640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a800fed60 0x7f2a80197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a859ba640 1 -- 172.21.15.49:0/1418238681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c009560 con 0x7f2a800fe420 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a859ba640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a801977c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0055a0 tx=0x7f2a7c0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a76ffd640 1 -- 172.21.15.49:0/1418238681 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c004aa0 con 0x7f2a800fe420 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a76ffd640 1 -- 172.21.15.49:0/1418238681 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a7c004c00 con 0x7f2a800fe420 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8019ce80 con 0x7f2a800fe420 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a76ffd640 1 -- 172.21.15.49:0/1418238681 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c003b10 con 0x7f2a800fe420 2024-09-19T09:05:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.861+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8019d370 con 0x7f2a800fe420 2024-09-19T09:05:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.863+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8010a990 con 0x7f2a800fe420 2024-09-19T09:05:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.863+0000 7f2a76ffd640 1 -- 172.21.15.49:0/1418238681 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2a7c003d40 con 0x7f2a800fe420 2024-09-19T09:05:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.864+0000 7f2a76ffd640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2a6c06e730 0x7f2a6c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.864+0000 7f2a76ffd640 1 -- 172.21.15.49:0/1418238681 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2a7c0afa20 con 0x7f2a800fe420 2024-09-19T09:05:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.864+0000 7f2a851b9640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2a6c06e730 0x7f2a6c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.864+0000 7f2a851b9640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2a6c06e730 0x7f2a6c070bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a80198ce0 tx=0x7f2a70005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:05.871+0000 7f2a76ffd640 1 -- 172.21.15.49:0/1418238681 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2a7c078a20 con 0x7f2a800fe420 2024-09-19T09:05:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1322549753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1503859854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:05:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:06.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:05:06.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:05:06.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:06.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.121+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2a8010ab40 con 0x7f2a800fe420 2024-09-19T09:05:06.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.121+0000 7f2a76ffd640 1 -- 172.21.15.49:0/1418238681 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2a7c07c0e0 con 0x7f2a800fe420 2024-09-19T09:05:06.122 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:05:06.122 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:05:06.122 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:05:06.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2a6c06e730 msgr2=0x7f2a6c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2a6c06e730 0x7f2a6c070bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a80198ce0 tx=0x7f2a70005f90 comp rx=0 tx=0).stop 2024-09-19T09:05:06.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 msgr2=0x7f2a801977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a801977c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0055a0 tx=0x7f2a7c0055d0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 shutdown_connections 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2a6c06e730 0x7f2a6c070bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a800fed60 0x7f2a80197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.123+0000 7f2a87c1e640 1 --2- 172.21.15.49:0/1418238681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a800fe420 0x7f2a801977c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.124+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 >> 172.21.15.49:0/1418238681 conn(0x7f2a800fa250 msgr2=0x7f2a800fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.124+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 shutdown_connections 2024-09-19T09:05:06.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:06.124+0000 7f2a87c1e640 1 -- 172.21.15.49:0/1418238681 wait complete. 2024-09-19T09:05:06.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:06.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1322549753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1503859854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.qdvksw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:05:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:07.168 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:06 smithi049 ceph-mon[91793]: Reconfiguring mgr.smithi049.qdvksw (monmap changed)... 2024-09-19T09:05:07.168 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:06 smithi049 ceph-mon[91793]: Reconfiguring daemon mgr.smithi049.qdvksw on smithi049 2024-09-19T09:05:07.168 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:06 smithi049 ceph-mon[91793]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:07.168 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:06 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1418238681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:05:07.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:06 smithi102 ceph-mon[80875]: Reconfiguring mgr.smithi049.qdvksw (monmap changed)... 2024-09-19T09:05:07.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:06 smithi102 ceph-mon[80875]: Reconfiguring daemon mgr.smithi049.qdvksw on smithi049 2024-09-19T09:05:07.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:06 smithi102 ceph-mon[80875]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:07.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:06 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1418238681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:05:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: Reconfiguring ceph-exporter.smithi049 (monmap changed)... 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: Unable to update caps for client.ceph-exporter.smithi049 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi049"}]: dispatch 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:08 smithi102 ceph-mon[80875]: Reconfiguring daemon ceph-exporter.smithi049 on smithi049 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: Reconfiguring ceph-exporter.smithi049 (monmap changed)... 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: Unable to update caps for client.ceph-exporter.smithi049 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi049"}]: dispatch 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:08 smithi049 ceph-mon[91793]: Reconfiguring daemon ceph-exporter.smithi049 on smithi049 2024-09-19T09:05:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:09 smithi102 ceph-mon[80875]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:09 smithi102 ceph-mon[80875]: Reconfiguring crash.smithi049 (monmap changed)... 2024-09-19T09:05:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:09 smithi102 ceph-mon[80875]: Reconfiguring daemon crash.smithi049 on smithi049 2024-09-19T09:05:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:09 smithi049 ceph-mon[91793]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:09 smithi049 ceph-mon[91793]: Reconfiguring crash.smithi049 (monmap changed)... 2024-09-19T09:05:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:09 smithi049 ceph-mon[91793]: Reconfiguring daemon crash.smithi049 on smithi049 2024-09-19T09:05:11.679 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:11 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:11.679 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:11 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:11.679 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:11 smithi102 ceph-mon[80875]: Reconfiguring osd.0 (monmap changed)... 2024-09-19T09:05:11.679 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:11 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:05:11.680 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:11 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:11.680 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:11 smithi102 ceph-mon[80875]: Reconfiguring daemon osd.0 on smithi049 2024-09-19T09:05:11.766 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:11 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:11.766 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:11 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:11.766 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:11 smithi049 ceph-mon[91793]: Reconfiguring osd.0 (monmap changed)... 2024-09-19T09:05:11.766 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:11 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:05:11.766 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:11 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:11.766 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:11 smithi049 ceph-mon[91793]: Reconfiguring daemon osd.0 on smithi049 2024-09-19T09:05:12.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:12 smithi049 ceph-mon[91793]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:12.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:12.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:12.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:05:12.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:12.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:12 smithi102 ceph-mon[80875]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:05:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:13.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:13 smithi049 ceph-mon[91793]: Reconfiguring osd.1 (monmap changed)... 2024-09-19T09:05:13.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:13 smithi049 ceph-mon[91793]: Reconfiguring daemon osd.1 on smithi049 2024-09-19T09:05:13.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:13.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:13.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:13 smithi102 ceph-mon[80875]: Reconfiguring osd.1 (monmap changed)... 2024-09-19T09:05:13.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:13 smithi102 ceph-mon[80875]: Reconfiguring daemon osd.1 on smithi049 2024-09-19T09:05:13.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:14 smithi102 ceph-mon[80875]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:14 smithi102 ceph-mon[80875]: Reconfiguring osd.2 (monmap changed)... 2024-09-19T09:05:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:05:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:14 smithi102 ceph-mon[80875]: Reconfiguring daemon osd.2 on smithi049 2024-09-19T09:05:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:14 smithi049 ceph-mon[91793]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:14 smithi049 ceph-mon[91793]: Reconfiguring osd.2 (monmap changed)... 2024-09-19T09:05:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:05:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:14 smithi049 ceph-mon[91793]: Reconfiguring daemon osd.2 on smithi049 2024-09-19T09:05:16.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:15 smithi102 ceph-mon[80875]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:16.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:16.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:16.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:15 smithi102 ceph-mon[80875]: Reconfiguring mds.cephfs.smithi049.ibssbl (monmap changed)... 2024-09-19T09:05:16.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:16.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:16.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:15 smithi102 ceph-mon[80875]: Reconfiguring daemon mds.cephfs.smithi049.ibssbl on smithi049 2024-09-19T09:05:16.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:15 smithi049 ceph-mon[91793]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:16.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:16.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:16.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:15 smithi049 ceph-mon[91793]: Reconfiguring mds.cephfs.smithi049.ibssbl (monmap changed)... 2024-09-19T09:05:16.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:16.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:16.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:15 smithi049 ceph-mon[91793]: Reconfiguring daemon mds.cephfs.smithi049.ibssbl on smithi049 2024-09-19T09:05:17.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:17.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:17.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:17 smithi102 ceph-mon[80875]: Reconfiguring mds.cephfs.smithi049.uujbrc (monmap changed)... 2024-09-19T09:05:17.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:17.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:17.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:17 smithi102 ceph-mon[80875]: Reconfiguring daemon mds.cephfs.smithi049.uujbrc on smithi049 2024-09-19T09:05:17.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:17.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:17.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:17 smithi049 ceph-mon[91793]: Reconfiguring mds.cephfs.smithi049.uujbrc (monmap changed)... 2024-09-19T09:05:17.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:17.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:17.772 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:17 smithi049 ceph-mon[91793]: Reconfiguring daemon mds.cephfs.smithi049.uujbrc on smithi049 2024-09-19T09:05:18.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:18.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-19T09:05:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi102"}]: dispatch 2024-09-19T09:05:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:18.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:05:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-19T09:05:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi102"}]: dispatch 2024-09-19T09:05:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:19.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:19 smithi102 ceph-mon[80875]: Reconfiguring ceph-exporter.smithi102 (monmap changed)... 2024-09-19T09:05:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:19 smithi102 ceph-mon[80875]: Unable to update caps for client.ceph-exporter.smithi102 2024-09-19T09:05:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:19 smithi102 ceph-mon[80875]: Reconfiguring daemon ceph-exporter.smithi102 on smithi102 2024-09-19T09:05:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:19.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:19 smithi049 ceph-mon[91793]: Reconfiguring ceph-exporter.smithi102 (monmap changed)... 2024-09-19T09:05:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:19 smithi049 ceph-mon[91793]: Unable to update caps for client.ceph-exporter.smithi102 2024-09-19T09:05:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:19 smithi049 ceph-mon[91793]: Reconfiguring daemon ceph-exporter.smithi102 on smithi102 2024-09-19T09:05:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:19.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:20.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:20 smithi102 ceph-mon[80875]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:20 smithi102 ceph-mon[80875]: Reconfiguring crash.smithi102 (monmap changed)... 2024-09-19T09:05:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:20 smithi102 ceph-mon[80875]: Reconfiguring daemon crash.smithi102 on smithi102 2024-09-19T09:05:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:20 smithi102 ceph-mon[80875]: Reconfiguring mgr.smithi102.csalqv (monmap changed)... 2024-09-19T09:05:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:05:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:20 smithi049 ceph-mon[91793]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:20 smithi049 ceph-mon[91793]: Reconfiguring crash.smithi102 (monmap changed)... 2024-09-19T09:05:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:20 smithi049 ceph-mon[91793]: Reconfiguring daemon crash.smithi102 on smithi102 2024-09-19T09:05:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:20 smithi049 ceph-mon[91793]: Reconfiguring mgr.smithi102.csalqv (monmap changed)... 2024-09-19T09:05:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi102.csalqv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:05:21.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:05:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:21 smithi102 ceph-mon[80875]: Reconfiguring daemon mgr.smithi102.csalqv on smithi102 2024-09-19T09:05:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:21 smithi102 ceph-mon[80875]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:05:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:21.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:21 smithi049 ceph-mon[91793]: Reconfiguring daemon mgr.smithi102.csalqv on smithi102 2024-09-19T09:05:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:21 smithi049 ceph-mon[91793]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:23.121 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:22 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:23.121 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:22 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:23.121 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:22 smithi102 ceph-mon[80875]: Reconfiguring mon.smithi102 (monmap changed)... 2024-09-19T09:05:23.121 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:22 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:05:23.121 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:22 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:05:23.121 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:22 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:23.122 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:22 smithi102 ceph-mon[80875]: Reconfiguring daemon mon.smithi102 on smithi102 2024-09-19T09:05:23.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:22 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:23.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:22 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:23.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:22 smithi049 ceph-mon[91793]: Reconfiguring mon.smithi102 (monmap changed)... 2024-09-19T09:05:23.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:22 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:05:23.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:22 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:05:23.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:22 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:23.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:22 smithi049 ceph-mon[91793]: Reconfiguring daemon mon.smithi102 on smithi102 2024-09-19T09:05:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:24 smithi049 ceph-mon[91793]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:24 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:24 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:24 smithi049 ceph-mon[91793]: Reconfiguring osd.3 (monmap changed)... 2024-09-19T09:05:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:24 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:05:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:24 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:24.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:24 smithi049 ceph-mon[91793]: Reconfiguring daemon osd.3 on smithi102 2024-09-19T09:05:24.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:24 smithi102 ceph-mon[80875]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:24 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:24 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:24 smithi102 ceph-mon[80875]: Reconfiguring osd.3 (monmap changed)... 2024-09-19T09:05:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:24 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:05:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:24 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:24 smithi102 ceph-mon[80875]: Reconfiguring daemon osd.3 on smithi102 2024-09-19T09:05:26.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:25 smithi102 ceph-mon[80875]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:26.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:26.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:26.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:25 smithi102 ceph-mon[80875]: Reconfiguring osd.4 (monmap changed)... 2024-09-19T09:05:26.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:05:26.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:26.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:25 smithi102 ceph-mon[80875]: Reconfiguring daemon osd.4 on smithi102 2024-09-19T09:05:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:25 smithi049 ceph-mon[91793]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:25 smithi049 ceph-mon[91793]: Reconfiguring osd.4 (monmap changed)... 2024-09-19T09:05:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:05:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:25 smithi049 ceph-mon[91793]: Reconfiguring daemon osd.4 on smithi102 2024-09-19T09:05:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:27 smithi102 ceph-mon[80875]: Reconfiguring osd.5 (monmap changed)... 2024-09-19T09:05:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:05:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:27 smithi102 ceph-mon[80875]: Reconfiguring daemon osd.5 on smithi102 2024-09-19T09:05:27.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:27.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:27.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:27 smithi049 ceph-mon[91793]: Reconfiguring osd.5 (monmap changed)... 2024-09-19T09:05:27.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:05:27.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:27.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:27 smithi049 ceph-mon[91793]: Reconfiguring daemon osd.5 on smithi102 2024-09-19T09:05:28.240 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:28 smithi102 ceph-mon[80875]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:28.240 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:28.240 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:28.240 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:28.240 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:28.240 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:28 smithi049 ceph-mon[91793]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:28.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:29.435 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:29 smithi102 ceph-mon[80875]: Reconfiguring mds.cephfs.smithi102.snrasw (monmap changed)... 2024-09-19T09:05:29.435 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:29 smithi102 ceph-mon[80875]: Reconfiguring daemon mds.cephfs.smithi102.snrasw on smithi102 2024-09-19T09:05:29.435 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:29 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:29.436 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:29 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:29.436 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:29 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:29.436 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:29 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:29 smithi049 ceph-mon[91793]: Reconfiguring mds.cephfs.smithi102.snrasw (monmap changed)... 2024-09-19T09:05:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:29 smithi049 ceph-mon[91793]: Reconfiguring daemon mds.cephfs.smithi102.snrasw on smithi102 2024-09-19T09:05:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:29 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:29 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:29 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:05:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:29 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:30.418 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:30 smithi102 ceph-mon[80875]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:30.418 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:30 smithi102 ceph-mon[80875]: Reconfiguring mds.cephfs.smithi102.ojquyx (monmap changed)... 2024-09-19T09:05:30.418 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:30 smithi102 ceph-mon[80875]: Reconfiguring daemon mds.cephfs.smithi102.ojquyx on smithi102 2024-09-19T09:05:30.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:30 smithi049 ceph-mon[91793]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:30.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:30 smithi049 ceph-mon[91793]: Reconfiguring mds.cephfs.smithi102.ojquyx (monmap changed)... 2024-09-19T09:05:30.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:30 smithi049 ceph-mon[91793]: Reconfiguring daemon mds.cephfs.smithi102.ojquyx on smithi102 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all mon 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:31.528 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]: dispatch 2024-09-19T09:05:31.529 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]': finished 2024-09-19T09:05:31.529 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi102"}]: dispatch 2024-09-19T09:05:31.529 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi102"}]': finished 2024-09-19T09:05:31.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:31.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:31.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:31.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:31.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:31.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:31.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all mon 2024-09-19T09:05:31.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:31.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]: dispatch 2024-09-19T09:05:31.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]': finished 2024-09-19T09:05:31.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi102"}]: dispatch 2024-09-19T09:05:31.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi102"}]': finished 2024-09-19T09:05:33.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:32 smithi102 ceph-mon[80875]: Upgrade: Updating crash.smithi049 (1/2) 2024-09-19T09:05:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:32 smithi102 ceph-mon[80875]: Deploying daemon crash.smithi049 on smithi049 2024-09-19T09:05:33.268 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:32 smithi049 ceph-mon[91793]: Upgrade: Updating crash.smithi049 (1/2) 2024-09-19T09:05:33.268 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:33.268 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:33.268 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:33.268 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:32 smithi049 ceph-mon[91793]: Deploying daemon crash.smithi049 on smithi049 2024-09-19T09:05:34.014 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:33 smithi049 ceph-mon[91793]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:34.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:33 smithi102 ceph-mon[80875]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:36.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3597592918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300ffcf0 msgr2=0x7f1b30100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3597592918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300ffcf0 0x7f1b30100170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009880 tx=0x7f1b1802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3597592918 shutdown_connections 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3597592918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300ffcf0 0x7f1b30100170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3597592918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b300feaf0 0x7f1b300feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3597592918 >> 172.21.15.49:0/3597592918 conn(0x7f1b300fa280 msgr2=0x7f1b300fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3597592918 shutdown_connections 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.214+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3597592918 wait complete. 2024-09-19T09:05:36.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b34ac5640 1 Processor -- start 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b34ac5640 1 -- start start 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b34ac5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300feaf0 0x7f1b30068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b34ac5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b300ffcf0 0x7f1b3019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b34ac5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b301962c0 con 0x7f1b300feaf0 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b34ac5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3019cd90 con 0x7f1b300ffcf0 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300feaf0 0x7f1b30068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b2e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300feaf0 0x7f1b30068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51326/0 (socket says 172.21.15.49:51326) 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b2e59c640 1 -- 172.21.15.49:0/3527719707 learned_addr learned my addr 172.21.15.49:0/3527719707 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:36.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.215+0000 7f1b2dd9b640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b300ffcf0 0x7f1b3019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b2e59c640 1 -- 172.21.15.49:0/3527719707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b300ffcf0 msgr2=0x7f1b3019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b2e59c640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b300ffcf0 0x7f1b3019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b2e59c640 1 -- 172.21.15.49:0/3527719707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18009560 con 0x7f1b300feaf0 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b2e59c640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300feaf0 0x7f1b30068790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000d8d0 tx=0x7f1b2000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b277fe640 1 -- 172.21.15.49:0/3527719707 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b20009a20 con 0x7f1b300feaf0 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b277fe640 1 -- 172.21.15.49:0/3527719707 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b20009b80 con 0x7f1b300feaf0 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3019cfc0 con 0x7f1b300feaf0 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b277fe640 1 -- 172.21.15.49:0/3527719707 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b2000f5d0 con 0x7f1b300feaf0 2024-09-19T09:05:36.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.216+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3019d4e0 con 0x7f1b300feaf0 2024-09-19T09:05:36.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.217+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b300feef0 con 0x7f1b300feaf0 2024-09-19T09:05:36.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.218+0000 7f1b277fe640 1 -- 172.21.15.49:0/3527719707 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f1b20009cf0 con 0x7f1b300feaf0 2024-09-19T09:05:36.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.218+0000 7f1b277fe640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1b1c06e730 0x7f1b1c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.218+0000 7f1b277fe640 1 -- 172.21.15.49:0/3527719707 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1b2008e6e0 con 0x7f1b300feaf0 2024-09-19T09:05:36.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.219+0000 7f1b2dd9b640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1b1c06e730 0x7f1b1c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.219+0000 7f1b2dd9b640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1b1c06e730 0x7f1b1c070bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009230 tx=0x7f1b180058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.223+0000 7f1b277fe640 1 -- 172.21.15.49:0/3527719707 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1b200576c0 con 0x7f1b300feaf0 2024-09-19T09:05:36.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.423+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b3002c550 con 0x7f1b1c06e730 2024-09-19T09:05:36.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.424+0000 7f1b277fe640 1 -- 172.21.15.49:0/3527719707 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f1b3002c550 con 0x7f1b1c06e730 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1b1c06e730 msgr2=0x7f1b1c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1b1c06e730 0x7f1b1c070bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009230 tx=0x7f1b180058d0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300feaf0 msgr2=0x7f1b30068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300feaf0 0x7f1b30068790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000d8d0 tx=0x7f1b2000dd90 comp rx=0 tx=0).stop 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 shutdown_connections 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1b1c06e730 0x7f1b1c070bf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b300ffcf0 0x7f1b3019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 --2- 172.21.15.49:0/3527719707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1b300feaf0 0x7f1b30068790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 >> 172.21.15.49:0/3527719707 conn(0x7f1b300fa280 msgr2=0x7f1b301033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 shutdown_connections 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.427+0000 7f1b34ac5640 1 -- 172.21.15.49:0/3527719707 wait complete. 2024-09-19T09:05:36.436 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:05:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 -- 172.21.15.49:0/4019854583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c0ffb80 msgr2=0x7f018c0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 --2- 172.21.15.49:0/4019854583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c0ffb80 0x7f018c0fff80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0180009880 tx=0x7f018002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 -- 172.21.15.49:0/4019854583 shutdown_connections 2024-09-19T09:05:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 --2- 172.21.15.49:0/4019854583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018c100d80 0x7f018c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 --2- 172.21.15.49:0/4019854583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c0ffb80 0x7f018c0fff80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 -- 172.21.15.49:0/4019854583 >> 172.21.15.49:0/4019854583 conn(0x7f018c0fb310 msgr2=0x7f018c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.515 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:36 smithi049 ceph-mon[91793]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:36.515 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:36 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:36.515 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:36 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 -- 172.21.15.49:0/4019854583 shutdown_connections 2024-09-19T09:05:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.514+0000 7f019372f640 1 -- 172.21.15.49:0/4019854583 wait complete. 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f019372f640 1 Processor -- start 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f019372f640 1 -- start start 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f019372f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018c0ffb80 0x7f018c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f019372f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c100d80 0x7f018c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f019372f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c072de0 con 0x7f018c100d80 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f019372f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c072f50 con 0x7f018c0ffb80 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f0190cca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c100d80 0x7f018c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f0190cca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c100d80 0x7f018c0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51352/0 (socket says 172.21.15.49:51352) 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f0190cca640 1 -- 172.21.15.49:0/2786643669 learned_addr learned my addr 172.21.15.49:0/2786643669 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f01914cb640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018c0ffb80 0x7f018c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f0190cca640 1 -- 172.21.15.49:0/2786643669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018c0ffb80 msgr2=0x7f018c074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f0190cca640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018c0ffb80 0x7f018c074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.515+0000 7f0190cca640 1 -- 172.21.15.49:0/2786643669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180009560 con 0x7f018c100d80 2024-09-19T09:05:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.516+0000 7f01914cb640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018c0ffb80 0x7f018c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.516+0000 7f0190cca640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c100d80 0x7f018c0728a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f018800e970 tx=0x7f018800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.516+0000 7f017e7fc640 1 -- 172.21.15.49:0/2786643669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f018800cc90 con 0x7f018c100d80 2024-09-19T09:05:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.516+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018c073230 con 0x7f018c100d80 2024-09-19T09:05:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.516+0000 7f017e7fc640 1 -- 172.21.15.49:0/2786643669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f018800cdf0 con 0x7f018c100d80 2024-09-19T09:05:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.516+0000 7f017e7fc640 1 -- 172.21.15.49:0/2786643669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0188010430 con 0x7f018c100d80 2024-09-19T09:05:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.516+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018c19d650 con 0x7f018c100d80 2024-09-19T09:05:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.517+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018c108790 con 0x7f018c100d80 2024-09-19T09:05:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.518+0000 7f017e7fc640 1 -- 172.21.15.49:0/2786643669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f01880046c0 con 0x7f018c100d80 2024-09-19T09:05:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.518+0000 7f017e7fc640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f017806e720 0x7f0178070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.519+0000 7f017e7fc640 1 -- 172.21.15.49:0/2786643669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0188014070 con 0x7f018c100d80 2024-09-19T09:05:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.519+0000 7f01914cb640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f017806e720 0x7f0178070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.519+0000 7f01914cb640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f017806e720 0x7f0178070be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0180006010 tx=0x7f01800314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.523+0000 7f017e7fc640 1 -- 172.21.15.49:0/2786643669 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0188057dd0 con 0x7f018c100d80 2024-09-19T09:05:36.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.718+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f018c1056d0 con 0x7f017806e720 2024-09-19T09:05:36.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.719+0000 7f017e7fc640 1 -- 172.21.15.49:0/2786643669 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f018c1056d0 con 0x7f017806e720 2024-09-19T09:05:36.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f017806e720 msgr2=0x7f0178070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f017806e720 0x7f0178070be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0180006010 tx=0x7f01800314e0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c100d80 msgr2=0x7f018c0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c100d80 0x7f018c0728a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f018800e970 tx=0x7f018800ed70 comp rx=0 tx=0).stop 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 shutdown_connections 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f017806e720 0x7f0178070be0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f018c100d80 0x7f018c0728a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 --2- 172.21.15.49:0/2786643669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018c0ffb80 0x7f018c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 >> 172.21.15.49:0/2786643669 conn(0x7f018c0fb310 msgr2=0x7f018c103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 shutdown_connections 2024-09-19T09:05:36.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.722+0000 7f019372f640 1 -- 172.21.15.49:0/2786643669 wait complete. 2024-09-19T09:05:36.749 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:36 smithi102 ceph-mon[80875]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:36.750 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:36 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:36.750 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:36 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:36.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 -- 172.21.15.49:0/2822712336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8103070 msgr2=0x7f97e8105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 --2- 172.21.15.49:0/2822712336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8103070 0x7f97e8105460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009880 tx=0x7f97dc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 -- 172.21.15.49:0/2822712336 shutdown_connections 2024-09-19T09:05:36.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 --2- 172.21.15.49:0/2822712336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8103070 0x7f97e8105460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 --2- 172.21.15.49:0/2822712336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97e8100740 0x7f97e8102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 -- 172.21.15.49:0/2822712336 >> 172.21.15.49:0/2822712336 conn(0x7f97e80fa280 msgr2=0x7f97e80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 -- 172.21.15.49:0/2822712336 shutdown_connections 2024-09-19T09:05:36.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 -- 172.21.15.49:0/2822712336 wait complete. 2024-09-19T09:05:36.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.809+0000 7f97ee16e640 1 Processor -- start 2024-09-19T09:05:36.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97ee16e640 1 -- start start 2024-09-19T09:05:36.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97ee16e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8100740 0x7f97e8195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97ee16e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97e8103070 0x7f97e8195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97ee16e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e81961a0 con 0x7f97e8100740 2024-09-19T09:05:36.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97ee16e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8196310 con 0x7f97e8103070 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97e77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8100740 0x7f97e8195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97e77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8100740 0x7f97e8195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51358/0 (socket says 172.21.15.49:51358) 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97e77fe640 1 -- 172.21.15.49:0/1231674132 learned_addr learned my addr 172.21.15.49:0/1231674132 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97e6ffd640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97e8103070 0x7f97e8195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97e77fe640 1 -- 172.21.15.49:0/1231674132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97e8103070 msgr2=0x7f97e8195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97e77fe640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97e8103070 0x7f97e8195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.810+0000 7f97e77fe640 1 -- 172.21.15.49:0/1231674132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8009490 con 0x7f97e8100740 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.811+0000 7f97e77fe640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8100740 0x7f97e8195690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97d800ea10 tx=0x7f97d800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.811+0000 7f97e4ff9640 1 -- 172.21.15.49:0/1231674132 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d800cd50 con 0x7f97e8100740 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.811+0000 7f97e4ff9640 1 -- 172.21.15.49:0/1231674132 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97d800ceb0 con 0x7f97e8100740 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.811+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc009560 con 0x7f97e8100740 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.811+0000 7f97e4ff9640 1 -- 172.21.15.49:0/1231674132 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d8004a60 con 0x7f97e8100740 2024-09-19T09:05:36.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.811+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e819b140 con 0x7f97e8100740 2024-09-19T09:05:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.812+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e8100b20 con 0x7f97e8100740 2024-09-19T09:05:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.812+0000 7f97e4ff9640 1 -- 172.21.15.49:0/1231674132 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f97d8004d20 con 0x7f97e8100740 2024-09-19T09:05:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.813+0000 7f97e4ff9640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f97d006e720 0x7f97d0070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.813+0000 7f97e4ff9640 1 -- 172.21.15.49:0/1231674132 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f97d8014070 con 0x7f97e8100740 2024-09-19T09:05:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.813+0000 7f97e6ffd640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f97d006e720 0x7f97d0070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.813+0000 7f97e6ffd640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f97d006e720 0x7f97d0070be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000c00 tx=0x7f97dc0314a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:36.818+0000 7f97e4ff9640 1 -- 172.21.15.49:0/1231674132 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f97d8057c80 con 0x7f97e8100740 2024-09-19T09:05:37.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.004+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f97e8103a70 con 0x7f97d006e720 2024-09-19T09:05:37.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.014+0000 7f97e4ff9640 1 -- 172.21.15.49:0/1231674132 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f97e8103a70 con 0x7f97d006e720 2024-09-19T09:05:37.014 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:05:37.014 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (9m) 49s ago 11m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:05:37.014 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (11m) 49s ago 11m 8200k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:05:37.014 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (10m) 37s ago 10m 8061k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 starting - - - - 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (10m) 37s ago 10m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 ef59e7f62561 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (9m) 49s ago 10m 84.4M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (5m) 49s ago 5m 92.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (5m) 49s ago 5m 161M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (5m) 37s ago 5m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (5m) 37s ago 5m 26.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (2m) 49s ago 12m 472M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (83s) 37s ago 10m 438M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:05:37.015 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (60s) 49s ago 12m 29.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (41s) 37s ago 10m 18.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (11m) 49s ago 11m 15.7M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (10m) 37s ago 10m 16.6M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (9m) 49s ago 9m 208M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 1cf71b2b1937 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (8m) 49s ago 8m 220M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (8m) 49s ago 8m 191M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (8m) 37s ago 8m 244M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (7m) 37s ago 7m 215M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:05:37.016 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (7m) 37s ago 7m 208M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:05:37.017 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (89s) 49s ago 10m 49.4M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:05:37.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f97d006e720 msgr2=0x7f97d0070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f97d006e720 0x7f97d0070be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000c00 tx=0x7f97dc0314a0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8100740 msgr2=0x7f97e8195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8100740 0x7f97e8195690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97d800ea10 tx=0x7f97d800eed0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 shutdown_connections 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f97d006e720 0x7f97d0070be0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97e8103070 0x7f97e8195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 --2- 172.21.15.49:0/1231674132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97e8100740 0x7f97e8195690 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 >> 172.21.15.49:0/1231674132 conn(0x7f97e80fa280 msgr2=0x7f97e80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 shutdown_connections 2024-09-19T09:05:37.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.017+0000 7f97ee16e640 1 -- 172.21.15.49:0/1231674132 wait complete. 2024-09-19T09:05:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 -- 172.21.15.49:0/2245046639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280feaf0 msgr2=0x7fa4280feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/2245046639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280feaf0 0x7fa4280feef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa410009880 tx=0x7fa41002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 -- 172.21.15.49:0/2245046639 shutdown_connections 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/2245046639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4280ffcf0 0x7fa428100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/2245046639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280feaf0 0x7fa4280feef0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 -- 172.21.15.49:0/2245046639 >> 172.21.15.49:0/2245046639 conn(0x7fa4280fa280 msgr2=0x7fa4280fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 -- 172.21.15.49:0/2245046639 shutdown_connections 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 -- 172.21.15.49:0/2245046639 wait complete. 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.101+0000 7fa42f0fb640 1 Processor -- start 2024-09-19T09:05:37.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa42f0fb640 1 -- start start 2024-09-19T09:05:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa42f0fb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4280feaf0 0x7fa4281956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa42f0fb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280ffcf0 0x7fa428195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa42f0fb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281961c0 con 0x7fa4280ffcf0 2024-09-19T09:05:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa42f0fb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428196330 con 0x7fa4280feaf0 2024-09-19T09:05:37.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa427fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280ffcf0 0x7fa428195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa427fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280ffcf0 0x7fa428195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51384/0 (socket says 172.21.15.49:51384) 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa427fff640 1 -- 172.21.15.49:0/914821474 learned_addr learned my addr 172.21.15.49:0/914821474 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa42ce97640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4280feaf0 0x7fa4281956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa427fff640 1 -- 172.21.15.49:0/914821474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4280feaf0 msgr2=0x7fa4281956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa427fff640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4280feaf0 0x7fa4281956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa427fff640 1 -- 172.21.15.49:0/914821474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410009560 con 0x7fa4280ffcf0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa42ce97640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4280feaf0 0x7fa4281956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.102+0000 7fa427fff640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280ffcf0 0x7fa428195bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa41800d900 tx=0x7fa41800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.103+0000 7fa425ffb640 1 -- 172.21.15.49:0/914821474 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa418009c00 con 0x7fa4280ffcf0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.103+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42819add0 con 0x7fa4280ffcf0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.103+0000 7fa425ffb640 1 -- 172.21.15.49:0/914821474 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa41800b660 con 0x7fa4280ffcf0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.103+0000 7fa425ffb640 1 -- 172.21.15.49:0/914821474 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa41800f680 con 0x7fa4280ffcf0 2024-09-19T09:05:37.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.103+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4281010e0 con 0x7fa4280ffcf0 2024-09-19T09:05:37.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.104+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4280feef0 con 0x7fa4280ffcf0 2024-09-19T09:05:37.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.105+0000 7fa425ffb640 1 -- 172.21.15.49:0/914821474 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa418010ab0 con 0x7fa4280ffcf0 2024-09-19T09:05:37.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.105+0000 7fa425ffb640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa414072b40 0x7fa414075000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.105+0000 7fa425ffb640 1 -- 172.21.15.49:0/914821474 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa41808e720 con 0x7fa4280ffcf0 2024-09-19T09:05:37.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.105+0000 7fa42ce97640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa414072b40 0x7fa414075000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.106+0000 7fa42ce97640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa414072b40 0x7fa414075000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa410009230 tx=0x7fa4100314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.112+0000 7fa425ffb640 1 -- 172.21.15.49:0/914821474 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa418057650 con 0x7fa4280ffcf0 2024-09-19T09:05:37.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.434+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa428107920 con 0x7fa4280ffcf0 2024-09-19T09:05:37.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.434+0000 7fa425ffb640 1 -- 172.21.15.49:0/914821474 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fa41805ad10 con 0x7fa4280ffcf0 2024-09-19T09:05:37.434 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:05:37.434 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:05:37.434 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 10, 2024-09-19T09:05:37.435 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:05:37.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:05:37.436 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa414072b40 msgr2=0x7fa414075000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa414072b40 0x7fa414075000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa410009230 tx=0x7fa4100314e0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280ffcf0 msgr2=0x7fa428195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280ffcf0 0x7fa428195bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa41800d900 tx=0x7fa41800ddc0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 shutdown_connections 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa414072b40 0x7fa414075000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa4280ffcf0 0x7fa428195bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 --2- 172.21.15.49:0/914821474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4280feaf0 0x7fa4281956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 >> 172.21.15.49:0/914821474 conn(0x7fa4280fa280 msgr2=0x7fa428067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 shutdown_connections 2024-09-19T09:05:37.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.437+0000 7fa42f0fb640 1 -- 172.21.15.49:0/914821474 wait complete. 2024-09-19T09:05:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3344043813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 msgr2=0x7f8fcc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3344043813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc102b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009880 tx=0x7f8fbc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3344043813 shutdown_connections 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3344043813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fcc103070 0x7f8fcc105460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3344043813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc102b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3344043813 >> 172.21.15.49:0/3344043813 conn(0x7f8fcc0fa280 msgr2=0x7f8fcc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3344043813 shutdown_connections 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3344043813 wait complete. 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.521+0000 7f8fd24f8640 1 Processor -- start 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fd24f8640 1 -- start start 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fd24f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fd24f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fcc103070 0x7f8fcc197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fd24f8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc198420 con 0x7f8fcc100740 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fd24f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc198590 con 0x7f8fcc103070 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fcbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51406/0 (socket says 172.21.15.49:51406) 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fcbfff640 1 -- 172.21.15.49:0/3626903551 learned_addr learned my addr 172.21.15.49:0/3626903551 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fcb7fe640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fcc103070 0x7f8fcc197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fcbfff640 1 -- 172.21.15.49:0/3626903551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fcc103070 msgr2=0x7f8fcc197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fcbfff640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fcc103070 0x7f8fcc197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.522+0000 7f8fcbfff640 1 -- 172.21.15.49:0/3626903551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc009560 con 0x7f8fcc100740 2024-09-19T09:05:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.523+0000 7f8fcbfff640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc197910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc031500 tx=0x7f8fbc032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.523+0000 7f8fc97fa640 1 -- 172.21.15.49:0/3626903551 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fbc0037c0 con 0x7f8fcc100740 2024-09-19T09:05:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.523+0000 7f8fc97fa640 1 -- 172.21.15.49:0/3626903551 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fbc003de0 con 0x7f8fcc100740 2024-09-19T09:05:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.523+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc19cfd0 con 0x7f8fcc100740 2024-09-19T09:05:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.523+0000 7f8fc97fa640 1 -- 172.21.15.49:0/3626903551 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fbc03a3c0 con 0x7f8fcc100740 2024-09-19T09:05:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.523+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc19d440 con 0x7f8fcc100740 2024-09-19T09:05:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.524+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc0fbdc0 con 0x7f8fcc100740 2024-09-19T09:05:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.524+0000 7f8fc97fa640 1 -- 172.21.15.49:0/3626903551 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f8fbc03b460 con 0x7f8fcc100740 2024-09-19T09:05:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.525+0000 7f8fc97fa640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8fb406e730 0x7f8fb4070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.525+0000 7f8fc97fa640 1 -- 172.21.15.49:0/3626903551 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8fbc0af700 con 0x7f8fcc100740 2024-09-19T09:05:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.525+0000 7f8fcb7fe640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8fb406e730 0x7f8fb4070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.526+0000 7f8fcb7fe640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8fb406e730 0x7f8fb4070bf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc198e30 tx=0x7f8fc0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.530+0000 7f8fc97fa640 1 -- 172.21.15.49:0/3626903551 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8fbc0786e0 con 0x7f8fcc100740 2024-09-19T09:05:37.740 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:37 smithi049 ceph-mon[91793]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:37.741 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:37 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:37.741 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:37 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:37.741 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:37 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.743+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8fcc02c480 con 0x7f8fcc100740 2024-09-19T09:05:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.743+0000 7f8fc97fa640 1 -- 172.21.15.49:0/3626903551 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7f8fbc07bda0 con 0x7f8fcc100740 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:05:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:05:37.745 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:05:37.746 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:37.748 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:05:37.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:05:37.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8fb406e730 msgr2=0x7f8fb4070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8fb406e730 0x7f8fb4070bf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc198e30 tx=0x7f8fc0005f90 comp rx=0 tx=0).stop 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 msgr2=0x7f8fcc197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc197910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc031500 tx=0x7f8fbc032bb0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 shutdown_connections 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8fb406e730 0x7f8fb4070bf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fcc103070 0x7f8fcc197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 --2- 172.21.15.49:0/3626903551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fcc100740 0x7f8fcc197910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 >> 172.21.15.49:0/3626903551 conn(0x7f8fcc0fa280 msgr2=0x7f8fcc0fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 shutdown_connections 2024-09-19T09:05:37.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.747+0000 7f8fd24f8640 1 -- 172.21.15.49:0/3626903551 wait complete. 2024-09-19T09:05:37.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:37 smithi102 ceph-mon[80875]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:37.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:37 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:37.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:37 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi102", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T09:05:37.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:37 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:37.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 -- 172.21.15.49:0/1485210563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00feaa0 msgr2=0x7fc8d00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/1485210563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00feaa0 0x7fc8d00feea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009880 tx=0x7fc8c002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 -- 172.21.15.49:0/1485210563 shutdown_connections 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/1485210563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d00ffca0 0x7fc8d0100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/1485210563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00feaa0 0x7fc8d00feea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 -- 172.21.15.49:0/1485210563 >> 172.21.15.49:0/1485210563 conn(0x7fc8d00fa250 msgr2=0x7fc8d00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 -- 172.21.15.49:0/1485210563 shutdown_connections 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.833+0000 7fc8d65cf640 1 -- 172.21.15.49:0/1485210563 wait complete. 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.834+0000 7fc8d65cf640 1 Processor -- start 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.834+0000 7fc8d65cf640 1 -- start start 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.834+0000 7fc8d65cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d00feaa0 0x7fc8d01029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.834+0000 7fc8d65cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00ffca0 0x7fc8d0101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.834+0000 7fc8d65cf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0102f90 con 0x7fc8d00ffca0 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.834+0000 7fc8d65cf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d01015f0 con 0x7fc8d00feaa0 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00ffca0 0x7fc8d0101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00ffca0 0x7fc8d0101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51418/0 (socket says 172.21.15.49:51418) 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cf7fe640 1 -- 172.21.15.49:0/868887325 learned_addr learned my addr 172.21.15.49:0/868887325 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cffff640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d00feaa0 0x7fc8d01029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cf7fe640 1 -- 172.21.15.49:0/868887325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d00feaa0 msgr2=0x7fc8d01029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cf7fe640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d00feaa0 0x7fc8d01029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cf7fe640 1 -- 172.21.15.49:0/868887325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009560 con 0x7fc8d00ffca0 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cf7fe640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00ffca0 0x7fc8d0101080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400b420 tx=0x7fc8c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cd7fa640 1 -- 172.21.15.49:0/868887325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c4011800 con 0x7fc8d00ffca0 2024-09-19T09:05:37.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d01018d0 con 0x7fc8d00ffca0 2024-09-19T09:05:37.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cd7fa640 1 -- 172.21.15.49:0/868887325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8c4011e20 con 0x7fc8d00ffca0 2024-09-19T09:05:37.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8cd7fa640 1 -- 172.21.15.49:0/868887325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c400f2e0 con 0x7fc8d00ffca0 2024-09-19T09:05:37.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.835+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d0101ea0 con 0x7fc8d00ffca0 2024-09-19T09:05:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.836+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d0107710 con 0x7fc8d00ffca0 2024-09-19T09:05:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.837+0000 7fc8cd7fa640 1 -- 172.21.15.49:0/868887325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fc8c4010380 con 0x7fc8d00ffca0 2024-09-19T09:05:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.838+0000 7fc8cd7fa640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc8b806e730 0x7fc8b8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.838+0000 7fc8cd7fa640 1 -- 172.21.15.49:0/868887325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc8c408e110 con 0x7fc8d00ffca0 2024-09-19T09:05:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.838+0000 7fc8cffff640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc8b806e730 0x7fc8b8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.838+0000 7fc8cffff640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc8b806e730 0x7fc8b8070bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009230 tx=0x7fc8c00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:37.842+0000 7fc8cd7fa640 1 -- 172.21.15.49:0/868887325 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc8c4057150 con 0x7fc8d00ffca0 2024-09-19T09:05:38.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.041+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8d00fc440 con 0x7fc8b806e730 2024-09-19T09:05:38.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.042+0000 7fc8cd7fa640 1 -- 172.21.15.49:0/868887325 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc8d00fc440 con 0x7fc8b806e730 2024-09-19T09:05:38.042 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:05:38.042 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:05:38.042 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:05:38.042 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:05:38.042 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:05:38.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:05:38.043 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-09-19T09:05:38.043 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:05:38.043 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "4/23 daemons upgraded", 2024-09-19T09:05:38.043 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading crash daemons", 2024-09-19T09:05:38.043 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:05:38.043 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.044+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc8b806e730 msgr2=0x7fc8b8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.044+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc8b806e730 0x7fc8b8070bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009230 tx=0x7fc8c00314e0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.044+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00ffca0 msgr2=0x7fc8d0101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.044+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00ffca0 0x7fc8d0101080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400b420 tx=0x7fc8c400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.045+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 shutdown_connections 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.045+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc8b806e730 0x7fc8b8070bf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.045+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8d00ffca0 0x7fc8d0101080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.045+0000 7fc8d65cf640 1 --2- 172.21.15.49:0/868887325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d00feaa0 0x7fc8d01029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.045+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 >> 172.21.15.49:0/868887325 conn(0x7fc8d00fa250 msgr2=0x7fc8d00fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.045+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 shutdown_connections 2024-09-19T09:05:38.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.045+0000 7fc8d65cf640 1 -- 172.21.15.49:0/868887325 wait complete. 2024-09-19T09:05:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 -- 172.21.15.49:0/3914169134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0ffcf0 msgr2=0x7f1a6c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3914169134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0ffcf0 0x7f1a6c100170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009880 tx=0x7f1a6002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 -- 172.21.15.49:0/3914169134 shutdown_connections 2024-09-19T09:05:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3914169134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0ffcf0 0x7f1a6c100170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3914169134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a6c0feaf0 0x7f1a6c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 -- 172.21.15.49:0/3914169134 >> 172.21.15.49:0/3914169134 conn(0x7f1a6c0fa280 msgr2=0x7f1a6c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 -- 172.21.15.49:0/3914169134 shutdown_connections 2024-09-19T09:05:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 -- 172.21.15.49:0/3914169134 wait complete. 2024-09-19T09:05:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 Processor -- start 2024-09-19T09:05:38.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.128+0000 7f1a723ed640 1 -- start start 2024-09-19T09:05:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a723ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0feaf0 0x7f1a6c1956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a723ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a6c0ffcf0 0x7f1a6c195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a723ed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c1961e0 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a723ed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c196350 con 0x7f1a6c0ffcf0 2024-09-19T09:05:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0feaf0 0x7f1a6c1956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0feaf0 0x7f1a6c1956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51436/0 (socket says 172.21.15.49:51436) 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6bfff640 1 -- 172.21.15.49:0/3386756967 learned_addr learned my addr 172.21.15.49:0/3386756967 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6b7fe640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a6c0ffcf0 0x7f1a6c195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6bfff640 1 -- 172.21.15.49:0/3386756967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a6c0ffcf0 msgr2=0x7f1a6c195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a6c0ffcf0 0x7f1a6c195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6bfff640 1 -- 172.21.15.49:0/3386756967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009560 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6b7fe640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a6c0ffcf0 0x7f1a6c195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.129+0000 7f1a6bfff640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0feaf0 0x7f1a6c1956d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00d900 tx=0x7f1a5c00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.130+0000 7f1a697fa640 1 -- 172.21.15.49:0/3386756967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c009c00 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.130+0000 7f1a697fa640 1 -- 172.21.15.49:0/3386756967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a5c009d60 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.130+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c19adf0 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.130+0000 7f1a697fa640 1 -- 172.21.15.49:0/3386756967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c00f660 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.130+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c19b2c0 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.131+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c0feef0 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.131+0000 7f1a697fa640 1 -- 172.21.15.49:0/3386756967 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f1a5c010460 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.132+0000 7f1a697fa640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1a5406e720 0x7f1a54070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.132+0000 7f1a697fa640 1 -- 172.21.15.49:0/3386756967 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1a5c08e6f0 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.132+0000 7f1a6b7fe640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1a5406e720 0x7f1a54070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.132+0000 7f1a6b7fe640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1a5406e720 0x7f1a54070be0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a60031540 tx=0x7f1a60000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:38.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.136+0000 7f1a697fa640 1 -- 172.21.15.49:0/3386756967 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1a5c0576a0 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.380+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1a6c107700 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.380+0000 7f1a697fa640 1 -- 172.21.15.49:0/3386756967 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1a5c05ad60 con 0x7f1a6c0feaf0 2024-09-19T09:05:38.380 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:05:38.380 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:05:38.381 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:05:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1a5406e720 msgr2=0x7f1a54070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1a5406e720 0x7f1a54070be0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a60031540 tx=0x7f1a60000bc0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0feaf0 msgr2=0x7f1a6c1956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:38.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0feaf0 0x7f1a6c1956d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00d900 tx=0x7f1a5c00ddc0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 shutdown_connections 2024-09-19T09:05:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1a5406e720 0x7f1a54070be0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a6c0ffcf0 0x7f1a6c195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 --2- 172.21.15.49:0/3386756967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a6c0feaf0 0x7f1a6c1956d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 >> 172.21.15.49:0/3386756967 conn(0x7f1a6c0fa280 msgr2=0x7f1a6c067c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 shutdown_connections 2024-09-19T09:05:38.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:05:38.382+0000 7f1a723ed640 1 -- 172.21.15.49:0/3386756967 wait complete. 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: Upgrade: Updating crash.smithi102 (2/2) 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: Deploying daemon crash.smithi102 on smithi102 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/914821474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3626903551' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:05:38.499 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:38 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3386756967' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:05:38.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: Upgrade: Updating crash.smithi102 (2/2) 2024-09-19T09:05:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: Deploying daemon crash.smithi102 on smithi102 2024-09-19T09:05:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/914821474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3626903551' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:05:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:38 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3386756967' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:05:39.687 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:39 smithi102 ceph-mon[80875]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:39.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:39 smithi049 ceph-mon[91793]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:05:40.685 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:40 smithi102 ceph-mon[80875]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:40.685 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:40.685 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:40.686 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:40.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:40 smithi049 ceph-mon[91793]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:40.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:40.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:40.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:41.819 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:41 smithi049 ceph-mon[91793]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:41.819 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:41.819 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:41.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:41 smithi102 ceph-mon[80875]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:41.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:41.842 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:42.888 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:43.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:44.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:44 smithi102 ceph-mon[80875]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:44.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:44 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:44.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:44 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:44.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:44 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:44.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:44 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:44.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:44 smithi049 ceph-mon[91793]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:44.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:44 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:44.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:44 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:44.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:44 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:44.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:44 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.421 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:46 smithi102 ceph-mon[80875]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:46.421 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:46 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.421 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:46 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.421 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:46 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.421 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:46 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:46 smithi049 ceph-mon[91793]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:47.953 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:47 smithi049 ceph-mon[91793]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:47.953 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:47.953 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:48.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:47 smithi102 ceph-mon[80875]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:48.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:48.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]: dispatch 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]': finished 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi102"}]: dispatch 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi102"}]': finished 2024-09-19T09:05:50.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:05:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:05:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]': finished 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi102"}]: dispatch 2024-09-19T09:05:50.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi102"}]': finished 2024-09-19T09:05:50.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:05:51.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:51 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all crash 2024-09-19T09:05:51.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:51 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:05:51.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:51 smithi049 ceph-mon[91793]: Upgrade: osd.0 is safe to restart 2024-09-19T09:05:51.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:51.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:05:51.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:51 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all crash 2024-09-19T09:05:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:51 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T09:05:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:51 smithi102 ceph-mon[80875]: Upgrade: osd.0 is safe to restart 2024-09-19T09:05:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:05:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:52.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:52 smithi049 ceph-mon[91793]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:52.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:52 smithi049 ceph-mon[91793]: Upgrade: Updating osd.0 2024-09-19T09:05:52.713 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:52 smithi049 ceph-mon[91793]: Deploying daemon osd.0 on smithi049 2024-09-19T09:05:52.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:52 smithi102 ceph-mon[80875]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:52.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:52 smithi102 ceph-mon[80875]: Upgrade: Updating osd.0 2024-09-19T09:05:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:52 smithi102 ceph-mon[80875]: Deploying daemon osd.0 on smithi049 2024-09-19T09:05:54.123 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:53 smithi049 systemd[1]: Stopping Ceph osd.0 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:05:54.416 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:54 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[47367]: 2024-09-19T09:05:54.122+0000 7fbc510ca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:05:54.416 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:54 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[47367]: 2024-09-19T09:05:54.122+0000 7fbc510ca640 -1 osd.0 49 *** Got signal Terminated *** 2024-09-19T09:05:54.416 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:54 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[47367]: 2024-09-19T09:05:54.122+0000 7fbc510ca640 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:05:54.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:54 smithi102 ceph-mon[80875]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:54.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:54 smithi102 ceph-mon[80875]: osd.0 marked itself down and dead 2024-09-19T09:05:54.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:54 smithi049 ceph-mon[91793]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:05:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:54 smithi049 ceph-mon[91793]: osd.0 marked itself down and dead 2024-09-19T09:05:55.189 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:54 smithi049 podman[100076]: 2024-09-19 09:05:54.827727317 +0000 UTC m=+0.829946269 container died 1cf71b2b19372315e5c1e1f656d1b182d53a226e9d9b8ecfd6279c97b88c027a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b) 2024-09-19T09:05:55.189 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:55 smithi049 podman[100076]: 2024-09-19 09:05:55.189501967 +0000 UTC m=+1.191720901 container cleanup 1cf71b2b19372315e5c1e1f656d1b182d53a226e9d9b8ecfd6279c97b88c027a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T09:05:55.465 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:55 smithi049 bash[100076]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:05:55.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:55 smithi049 ceph-mon[91793]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:05:55.466 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:55 smithi049 ceph-mon[91793]: osdmap e50: 6 total, 5 up, 6 in 2024-09-19T09:05:55.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:55 smithi102 ceph-mon[80875]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:05:55.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:55 smithi102 ceph-mon[80875]: osdmap e50: 6 total, 5 up, 6 in 2024-09-19T09:05:55.803 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:55 smithi049 podman[100096]: 2024-09-19 09:05:55.465925452 +0000 UTC m=+0.633104467 container remove 1cf71b2b19372315e5c1e1f656d1b182d53a226e9d9b8ecfd6279c97b88c027a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T09:05:56.086 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:55 smithi049 podman[100182]: 2024-09-19 09:05:55.717352217 +0000 UTC m=+0.016689697 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:05:56.086 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:55 smithi049 podman[100182]: 2024-09-19 09:05:55.825206648 +0000 UTC m=+0.124544110 container create e51f0d06922a2ae50b267d12a5511a03cd2173ce85e7c4fa7d076a275d7c11d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:05:56.086 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 podman[100182]: 2024-09-19 09:05:56.086220251 +0000 UTC m=+0.385557742 container init e51f0d06922a2ae50b267d12a5511a03cd2173ce85e7c4fa7d076a275d7c11d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:05:56.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 podman[100182]: 2024-09-19 09:05:56.090006883 +0000 UTC m=+0.389344350 container start e51f0d06922a2ae50b267d12a5511a03cd2173ce85e7c4fa7d076a275d7c11d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:05:56.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 podman[100182]: 2024-09-19 09:05:56.194601587 +0000 UTC m=+0.493939058 container attach e51f0d06922a2ae50b267d12a5511a03cd2173ce85e7c4fa7d076a275d7c11d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:05:56.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 podman[100182]: 2024-09-19 09:05:56.286816425 +0000 UTC m=+0.586153909 container died e51f0d06922a2ae50b267d12a5511a03cd2173ce85e7c4fa7d076a275d7c11d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:05:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:56 smithi102 ceph-mon[80875]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:05:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:56 smithi102 ceph-mon[80875]: osdmap e51: 6 total, 5 up, 6 in 2024-09-19T09:05:56.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:56 smithi049 ceph-mon[91793]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:05:56.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:56 smithi049 ceph-mon[91793]: osdmap e51: 6 total, 5 up, 6 in 2024-09-19T09:05:57.257 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 podman[100205]: 2024-09-19 09:05:56.881873493 +0000 UTC m=+0.588963871 container remove e51f0d06922a2ae50b267d12a5511a03cd2173ce85e7c4fa7d076a275d7c11d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:05:57.257 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-19T09:05:57.257 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 systemd[1]: Stopped Ceph osd.0 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:05:57.257 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:56 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.0.service: Consumed 54.777s CPU time. 2024-09-19T09:05:57.257 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 systemd[1]: Starting Ceph osd.0 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:05:57.511 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 podman[100304]: 2024-09-19 09:05:57.238512529 +0000 UTC m=+0.016624567 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:05:57.511 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 podman[100304]: 2024-09-19 09:05:57.391645411 +0000 UTC m=+0.169757436 container create f28055ef0d1632deb9298eaeda3072dab4f946c5f677bb0f311e39367a1d4c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:05:58.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 podman[100304]: 2024-09-19 09:05:57.61106098 +0000 UTC m=+0.389173013 container init f28055ef0d1632deb9298eaeda3072dab4f946c5f677bb0f311e39367a1d4c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:05:58.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 podman[100304]: 2024-09-19 09:05:57.614876469 +0000 UTC m=+0.392988494 container start f28055ef0d1632deb9298eaeda3072dab4f946c5f677bb0f311e39367a1d4c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:05:58.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 podman[100304]: 2024-09-19 09:05:57.685842088 +0000 UTC m=+0.463954113 container attach f28055ef0d1632deb9298eaeda3072dab4f946c5f677bb0f311e39367a1d4c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T09:05:58.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:05:58.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 bash[100304]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:05:58.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:05:58.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:57 smithi049 bash[100304]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:05:58.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-mon[91793]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:05:58.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:58.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:58.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:58 smithi102 ceph-mon[80875]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:05:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:05:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:05:58.785 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:05:58.786 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 bash[100304]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:05:58.786 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:05:58.786 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 bash[100304]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 bash[100304]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 bash[100304]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 bash[100304]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 bash[100304]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate[100319]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-19T09:05:59.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 bash[100304]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-19T09:05:59.054 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:58 smithi049 podman[100304]: 2024-09-19 09:05:58.815918047 +0000 UTC m=+1.594030084 container died f28055ef0d1632deb9298eaeda3072dab4f946c5f677bb0f311e39367a1d4c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:05:59.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:59 smithi049 ceph-mon[91793]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:05:59.724 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:05:59 smithi049 ceph-mon[91793]: Health check failed: Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded (PG_DEGRADED) 2024-09-19T09:05:59.724 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:59 smithi049 podman[100453]: 2024-09-19 09:05:59.448204093 +0000 UTC m=+0.625898998 container remove f28055ef0d1632deb9298eaeda3072dab4f946c5f677bb0f311e39367a1d4c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:05:59.724 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:59 smithi049 podman[100512]: 2024-09-19 09:05:59.567632786 +0000 UTC m=+0.016731444 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:05:59.724 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:59 smithi049 podman[100512]: 2024-09-19 09:05:59.724500654 +0000 UTC m=+0.173599288 container create 530476c8de21d517666f63fe364a6d2a192e1e244ccab8b8e10d937011d87383 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T09:05:59.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:59 smithi102 ceph-mon[80875]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:05:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:05:59 smithi102 ceph-mon[80875]: Health check failed: Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded (PG_DEGRADED) 2024-09-19T09:06:00.035 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:59 smithi049 podman[100512]: 2024-09-19 09:05:59.935950921 +0000 UTC m=+0.385049570 container init 530476c8de21d517666f63fe364a6d2a192e1e244ccab8b8e10d937011d87383 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:06:00.035 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:59 smithi049 podman[100512]: 2024-09-19 09:05:59.939329488 +0000 UTC m=+0.388428131 container start 530476c8de21d517666f63fe364a6d2a192e1e244ccab8b8e10d937011d87383 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:00.036 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:05:59 smithi049 ceph-osd[100531]: -- 172.21.15.49:0/916562195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d5815501e0 con 0x55d580765c00 2024-09-19T09:06:00.302 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:06:00 smithi049 bash[100512]: 530476c8de21d517666f63fe364a6d2a192e1e244ccab8b8e10d937011d87383 2024-09-19T09:06:00.302 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:06:00 smithi049 systemd[1]: Started Ceph osd.0 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:06:01.400 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:01.400 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:01.400 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:01.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:01.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:02.092 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:06:01 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[100527]: 2024-09-19T09:06:01.812+0000 7f66341d0640 -1 Falling back to public interface 2024-09-19T09:06:02.362 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:02 smithi049 ceph-mon[91793]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:02.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:02 smithi102 ceph-mon[80875]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:04.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:04 smithi049 ceph-mon[91793]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:04.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:04 smithi102 ceph-mon[80875]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:06.219 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:05 smithi049 ceph-mon[91793]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:06.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:06.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:06.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:06.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:05 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:05 smithi102 ceph-mon[80875]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:05 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:07.596 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:06:07 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[100527]: 2024-09-19T09:06:07.373+0000 7f66341d0640 -1 osd.0 49 log_to_monitors true 2024-09-19T09:06:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:07 smithi102 ceph-mon[80875]: pgmap v47: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:08.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:07 smithi102 ceph-mon[80875]: from='osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:06:08.270 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:06:07 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[100527]: 2024-09-19T09:06:07.935+0000 7f662bf6a640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:06:08.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:07 smithi049 ceph-mon[91793]: pgmap v47: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:08.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:07 smithi049 ceph-mon[91793]: from='osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 -- 172.21.15.49:0/1696233640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580ffcf0 msgr2=0x7fcd58100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1696233640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580ffcf0 0x7fcd58100170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009880 tx=0x7fcd4402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 -- 172.21.15.49:0/1696233640 shutdown_connections 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1696233640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580ffcf0 0x7fcd58100170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1696233640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd580feaf0 0x7fcd580feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 -- 172.21.15.49:0/1696233640 >> 172.21.15.49:0/1696233640 conn(0x7fcd580fa280 msgr2=0x7fcd580fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 -- 172.21.15.49:0/1696233640 shutdown_connections 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.472+0000 7fcd5f127640 1 -- 172.21.15.49:0/1696233640 wait complete. 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.473+0000 7fcd5f127640 1 Processor -- start 2024-09-19T09:06:08.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.473+0000 7fcd5f127640 1 -- start start 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.473+0000 7fcd5f127640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580feaf0 0x7fcd58102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.473+0000 7fcd5f127640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd580ffcf0 0x7fcd581010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.473+0000 7fcd5f127640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58101610 con 0x7fcd580feaf0 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.473+0000 7fcd5f127640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58101780 con 0x7fcd580ffcf0 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5cec3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580feaf0 0x7fcd58102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5cec3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580feaf0 0x7fcd58102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46518/0 (socket says 172.21.15.49:46518) 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5cec3640 1 -- 172.21.15.49:0/1725370053 learned_addr learned my addr 172.21.15.49:0/1725370053 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd57fff640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd580ffcf0 0x7fcd581010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5cec3640 1 -- 172.21.15.49:0/1725370053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd580ffcf0 msgr2=0x7fcd581010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5cec3640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd580ffcf0 0x7fcd581010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5cec3640 1 -- 172.21.15.49:0/1725370053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44009560 con 0x7fcd580feaf0 2024-09-19T09:06:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5cec3640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580feaf0 0x7fcd58102a80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e940 tx=0x7fcd4c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd55ffb640 1 -- 172.21.15.49:0/1725370053 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4c009700 con 0x7fcd580feaf0 2024-09-19T09:06:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.474+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd58101a60 con 0x7fcd580feaf0 2024-09-19T09:06:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.475+0000 7fcd55ffb640 1 -- 172.21.15.49:0/1725370053 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd4c00cc90 con 0x7fcd580feaf0 2024-09-19T09:06:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.475+0000 7fcd55ffb640 1 -- 172.21.15.49:0/1725370053 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4c018430 con 0x7fcd580feaf0 2024-09-19T09:06:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.475+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5819d720 con 0x7fcd580feaf0 2024-09-19T09:06:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.476+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd580feef0 con 0x7fcd580feaf0 2024-09-19T09:06:08.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.477+0000 7fcd55ffb640 1 -- 172.21.15.49:0/1725370053 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fcd4c003fb0 con 0x7fcd580feaf0 2024-09-19T09:06:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.477+0000 7fcd55ffb640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcd4806e720 0x7fcd48070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.477+0000 7fcd55ffb640 1 -- 172.21.15.49:0/1725370053 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcd4c014070 con 0x7fcd580feaf0 2024-09-19T09:06:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.477+0000 7fcd57fff640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcd4806e720 0x7fcd48070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.478+0000 7fcd57fff640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcd4806e720 0x7fcd48070be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000c00 tx=0x7fcd440314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:08.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.482+0000 7fcd55ffb640 1 -- 172.21.15.49:0/1725370053 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcd4c057c40 con 0x7fcd580feaf0 2024-09-19T09:06:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.681+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd58068410 con 0x7fcd4806e720 2024-09-19T09:06:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.682+0000 7fcd55ffb640 1 -- 172.21.15.49:0/1725370053 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcd58068410 con 0x7fcd4806e720 2024-09-19T09:06:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcd4806e720 msgr2=0x7fcd48070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcd4806e720 0x7fcd48070be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000c00 tx=0x7fcd440314e0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580feaf0 msgr2=0x7fcd58102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580feaf0 0x7fcd58102a80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e940 tx=0x7fcd4c00ee00 comp rx=0 tx=0).stop 2024-09-19T09:06:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 shutdown_connections 2024-09-19T09:06:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcd4806e720 0x7fcd48070be0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd580ffcf0 0x7fcd581010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 --2- 172.21.15.49:0/1725370053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd580feaf0 0x7fcd58102a80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 >> 172.21.15.49:0/1725370053 conn(0x7fcd580fa280 msgr2=0x7fcd58067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 shutdown_connections 2024-09-19T09:06:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.684+0000 7fcd5f127640 1 -- 172.21.15.49:0/1725370053 wait complete. 2024-09-19T09:06:08.696 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:06:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 -- 172.21.15.49:0/819835342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 msgr2=0x7fb0f0105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/819835342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0105330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00098b0 tx=0x7fb0e002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 -- 172.21.15.49:0/819835342 shutdown_connections 2024-09-19T09:06:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/819835342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0105330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/819835342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f0100610 0x7fb0f0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 -- 172.21.15.49:0/819835342 >> 172.21.15.49:0/819835342 conn(0x7fb0f00fa230 msgr2=0x7fb0f00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 -- 172.21.15.49:0/819835342 shutdown_connections 2024-09-19T09:06:08.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.772+0000 7fb0f78fc640 1 -- 172.21.15.49:0/819835342 wait complete. 2024-09-19T09:06:08.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f78fc640 1 Processor -- start 2024-09-19T09:06:08.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f78fc640 1 -- start start 2024-09-19T09:06:08.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f78fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f0100610 0x7fb0f01956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:08.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f78fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:08.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f78fc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f01961e0 con 0x7fb0f0102f40 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f78fc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0196350 con 0x7fb0f0100610 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f4e97640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f4e97640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0195c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46538/0 (socket says 172.21.15.49:46538) 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f4e97640 1 -- 172.21.15.49:0/2063213482 learned_addr learned my addr 172.21.15.49:0/2063213482 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.773+0000 7fb0f5698640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f0100610 0x7fb0f01956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0f4e97640 1 -- 172.21.15.49:0/2063213482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f0100610 msgr2=0x7fb0f01956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0f4e97640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f0100610 0x7fb0f01956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0f4e97640 1 -- 172.21.15.49:0/2063213482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0009560 con 0x7fb0f0102f40 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0f4e97640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0195c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00055a0 tx=0x7fb0e00055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0e67fc640 1 -- 172.21.15.49:0/2063213482 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e0004aa0 con 0x7fb0f0102f40 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0e67fc640 1 -- 172.21.15.49:0/2063213482 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0e0004c00 con 0x7fb0f0102f40 2024-09-19T09:06:08.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f019ad40 con 0x7fb0f0102f40 2024-09-19T09:06:08.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0e67fc640 1 -- 172.21.15.49:0/2063213482 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e0003b50 con 0x7fb0f0102f40 2024-09-19T09:06:08.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.774+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f019b2b0 con 0x7fb0f0102f40 2024-09-19T09:06:08.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.775+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f0108790 con 0x7fb0f0102f40 2024-09-19T09:06:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.776+0000 7fb0e67fc640 1 -- 172.21.15.49:0/2063213482 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb0e0003cb0 con 0x7fb0f0102f40 2024-09-19T09:06:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.776+0000 7fb0e67fc640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb0dc06e730 0x7fb0dc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.776+0000 7fb0e67fc640 1 -- 172.21.15.49:0/2063213482 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb0e00afab0 con 0x7fb0f0102f40 2024-09-19T09:06:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.776+0000 7fb0f5698640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb0dc06e730 0x7fb0dc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:08.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.777+0000 7fb0f5698640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb0dc06e730 0x7fb0dc070bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec005fd0 tx=0x7fb0ec009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:08.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.785+0000 7fb0e67fc640 1 -- 172.21.15.49:0/2063213482 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb0e0078a90 con 0x7fb0f0102f40 2024-09-19T09:06:08.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:08.998+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0f01039c0 con 0x7fb0dc06e730 2024-09-19T09:06:09.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.000+0000 7fb0e67fc640 1 -- 172.21.15.49:0/2063213482 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb0f01039c0 con 0x7fb0dc06e730 2024-09-19T09:06:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb0dc06e730 msgr2=0x7fb0dc070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb0dc06e730 0x7fb0dc070bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec005fd0 tx=0x7fb0ec009680 comp rx=0 tx=0).stop 2024-09-19T09:06:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 msgr2=0x7fb0f0195c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0195c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00055a0 tx=0x7fb0e00055d0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 shutdown_connections 2024-09-19T09:06:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb0dc06e730 0x7fb0dc070bf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0f0102f40 0x7fb0f0195c10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 --2- 172.21.15.49:0/2063213482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0f0100610 0x7fb0f01956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 >> 172.21.15.49:0/2063213482 conn(0x7fb0f00fa230 msgr2=0x7fb0f00fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 shutdown_connections 2024-09-19T09:06:09.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.002+0000 7fb0f78fc640 1 -- 172.21.15.49:0/2063213482 wait complete. 2024-09-19T09:06:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.091+0000 7f58deb89640 1 -- 172.21.15.49:0/3253367587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 msgr2=0x7f58d8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.091+0000 7f58deb89640 1 --2- 172.21.15.49:0/3253367587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8101210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009880 tx=0x7f58c402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 -- 172.21.15.49:0/3253367587 shutdown_connections 2024-09-19T09:06:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 --2- 172.21.15.49:0/3253367587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8101210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 --2- 172.21.15.49:0/3253367587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d80ffb90 0x7f58d80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 -- 172.21.15.49:0/3253367587 >> 172.21.15.49:0/3253367587 conn(0x7f58d80fb360 msgr2=0x7f58d80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 -- 172.21.15.49:0/3253367587 shutdown_connections 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 -- 172.21.15.49:0/3253367587 wait complete. 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 Processor -- start 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.092+0000 7f58deb89640 1 -- start start 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58deb89640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d80ffb90 0x7f58d8195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58deb89640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58deb89640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8196110 con 0x7f58d8100d90 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58deb89640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8196280 con 0x7f58d80ffb90 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58d7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8195b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46562/0 (socket says 172.21.15.49:46562) 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58d7fff640 1 -- 172.21.15.49:0/607313002 learned_addr learned my addr 172.21.15.49:0/607313002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:09.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58dc925640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d80ffb90 0x7f58d8195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58d7fff640 1 -- 172.21.15.49:0/607313002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d80ffb90 msgr2=0x7f58d8195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58d7fff640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d80ffb90 0x7f58d8195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.093+0000 7f58d7fff640 1 -- 172.21.15.49:0/607313002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009560 con 0x7f58d8100d90 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.094+0000 7f58d7fff640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8195b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58c4004650 tx=0x7f58c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.094+0000 7f58d5ffb640 1 -- 172.21.15.49:0/607313002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c4004aa0 con 0x7f58d8100d90 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.094+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d819acc0 con 0x7f58d8100d90 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.094+0000 7f58d5ffb640 1 -- 172.21.15.49:0/607313002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58c4005d50 con 0x7f58d8100d90 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.094+0000 7f58d5ffb640 1 -- 172.21.15.49:0/607313002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58c4003a20 con 0x7f58d8100d90 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.094+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d819b230 con 0x7f58d8100d90 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.095+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d818f730 con 0x7f58d8100d90 2024-09-19T09:06:09.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.096+0000 7f58d5ffb640 1 -- 172.21.15.49:0/607313002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f58c4004c00 con 0x7f58d8100d90 2024-09-19T09:06:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.097+0000 7f58d5ffb640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58c806e720 0x7f58c8070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.097+0000 7f58d5ffb640 1 -- 172.21.15.49:0/607313002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f58c40af8f0 con 0x7f58d8100d90 2024-09-19T09:06:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.097+0000 7f58dc925640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58c806e720 0x7f58c8070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.097+0000 7f58dc925640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58c806e720 0x7f58c8070be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f58d8100bf0 tx=0x7f58cc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.101+0000 7f58d5ffb640 1 -- 172.21.15.49:0/607313002 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f58c4078950 con 0x7f58d8100d90 2024-09-19T09:06:09.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:08 smithi049 ceph-mon[91793]: from='osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:06:09.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:08 smithi049 ceph-mon[91793]: osdmap e52: 6 total, 5 up, 6 in 2024-09-19T09:06:09.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:08 smithi049 ceph-mon[91793]: from='osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:06:09.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:08 smithi102 ceph-mon[80875]: from='osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:06:09.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:08 smithi102 ceph-mon[80875]: osdmap e52: 6 total, 5 up, 6 in 2024-09-19T09:06:09.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:08 smithi102 ceph-mon[80875]: from='osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:06:09.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.289+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58d802c550 con 0x7f58c806e720 2024-09-19T09:06:09.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.299+0000 7f58d5ffb640 1 -- 172.21.15.49:0/607313002 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f58d802c550 con 0x7f58c806e720 2024-09-19T09:06:09.300 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:06:09.300 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (10m) 4s ago 11m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:06:09.300 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (11m) 4s ago 11m 8300k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (10m) 26s ago 10m 8120k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (34s) 4s ago 11m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (29s) 26s ago 10m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (10m) 4s ago 11m 84.9M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (6m) 4s ago 6m 92.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (6m) 4s ago 6m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (6m) 26s ago 6m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (6m) 26s ago 6m 27.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (3m) 4s ago 13m 494M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (116s) 26s ago 10m 439M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (92s) 4s ago 13m 44.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (74s) 26s ago 10m 32.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:06:09.301 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (11m) 4s ago 11m 15.8M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (10m) 26s ago 10m 16.7M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (9s) 4s ago 9m 12.1M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (9m) 4s ago 9m 222M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 b64db6d6c4f7 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9m) 4s ago 9m 190M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (8m) 26s ago 8m 245M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (8m) 26s ago 8m 216M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (7m) 26s ago 7m 209M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:06:09.302 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (2m) 4s ago 11m 57.3M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.301+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58c806e720 msgr2=0x7f58c8070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.301+0000 7f58deb89640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58c806e720 0x7f58c8070be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f58d8100bf0 tx=0x7f58cc005f90 comp rx=0 tx=0).stop 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 msgr2=0x7f58d8195b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8195b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f58c4004650 tx=0x7f58c40055a0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 shutdown_connections 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58c806e720 0x7f58c8070be0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58d8100d90 0x7f58d8195b40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 --2- 172.21.15.49:0/607313002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d80ffb90 0x7f58d8195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 >> 172.21.15.49:0/607313002 conn(0x7f58d80fb360 msgr2=0x7f58d8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 shutdown_connections 2024-09-19T09:06:09.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.302+0000 7f58deb89640 1 -- 172.21.15.49:0/607313002 wait complete. 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 -- 172.21.15.49:0/4030721791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 msgr2=0x7f2ee8105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 --2- 172.21.15.49:0/4030721791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee8105460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009880 tx=0x7f2edc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 -- 172.21.15.49:0/4030721791 shutdown_connections 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 --2- 172.21.15.49:0/4030721791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee8105460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 --2- 172.21.15.49:0/4030721791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee8100740 0x7f2ee8102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 -- 172.21.15.49:0/4030721791 >> 172.21.15.49:0/4030721791 conn(0x7f2ee80fa280 msgr2=0x7f2ee80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 -- 172.21.15.49:0/4030721791 shutdown_connections 2024-09-19T09:06:09.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.385+0000 7f2eecb17640 1 -- 172.21.15.49:0/4030721791 wait complete. 2024-09-19T09:06:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2eecb17640 1 Processor -- start 2024-09-19T09:06:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2eecb17640 1 -- start start 2024-09-19T09:06:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2eecb17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee8100740 0x7f2ee81000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2eecb17640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee80fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2eecb17640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80fec30 con 0x7f2ee8103070 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2eecb17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80feda0 con 0x7f2ee8100740 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee80fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee80fe6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46586/0 (socket says 172.21.15.49:46586) 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee5d9b640 1 -- 172.21.15.49:0/1025232813 learned_addr learned my addr 172.21.15.49:0/1025232813 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee659c640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee8100740 0x7f2ee81000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee5d9b640 1 -- 172.21.15.49:0/1025232813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee8100740 msgr2=0x7f2ee81000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee5d9b640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee8100740 0x7f2ee81000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee5d9b640 1 -- 172.21.15.49:0/1025232813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009560 con 0x7f2ee8103070 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.386+0000 7f2ee659c640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee8100740 0x7f2ee81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.387+0000 7f2ee5d9b640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee80fe6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2edc032b90 tx=0x7f2edc032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.387+0000 7f2ed77fe640 1 -- 172.21.15.49:0/1025232813 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2edc005220 con 0x7f2ee8103070 2024-09-19T09:06:09.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.387+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee80ff020 con 0x7f2ee8103070 2024-09-19T09:06:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.387+0000 7f2ed77fe640 1 -- 172.21.15.49:0/1025232813 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2edc005380 con 0x7f2ee8103070 2024-09-19T09:06:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.387+0000 7f2ed77fe640 1 -- 172.21.15.49:0/1025232813 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2edc003ac0 con 0x7f2ee8103070 2024-09-19T09:06:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.387+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee80ff510 con 0x7f2ee8103070 2024-09-19T09:06:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.388+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee81087e0 con 0x7f2ee8103070 2024-09-19T09:06:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.389+0000 7f2ed77fe640 1 -- 172.21.15.49:0/1025232813 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2edc003d50 con 0x7f2ee8103070 2024-09-19T09:06:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.389+0000 7f2ed77fe640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2ed006e730 0x7f2ed0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.389+0000 7f2ed77fe640 1 -- 172.21.15.49:0/1025232813 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2edc0af7e0 con 0x7f2ee8103070 2024-09-19T09:06:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.389+0000 7f2ee659c640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2ed006e730 0x7f2ed0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.390+0000 7f2ee659c640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2ed006e730 0x7f2ed0070bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009b40 tx=0x7f2ed8005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.397+0000 7f2ed77fe640 1 -- 172.21.15.49:0/1025232813 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2edc0b1e60 con 0x7f2ee8103070 2024-09-19T09:06:09.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.643+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ee81089a0 con 0x7f2ee8103070 2024-09-19T09:06:09.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.643+0000 7f2ed77fe640 1 -- 172.21.15.49:0/1025232813 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7f2edc078710 con 0x7f2ee8103070 2024-09-19T09:06:09.644 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 5, 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:09.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:06:09.646 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:06:09.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:09.646 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:06:09.646 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 9, 2024-09-19T09:06:09.646 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T09:06:09.646 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:06:09.646 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2ed006e730 msgr2=0x7f2ed0070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2ed006e730 0x7f2ed0070bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009b40 tx=0x7f2ed8005e50 comp rx=0 tx=0).stop 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 msgr2=0x7f2ee80fe6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee80fe6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2edc032b90 tx=0x7f2edc032bc0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 shutdown_connections 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2ed006e730 0x7f2ed0070bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2ee8103070 0x7f2ee80fe6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 --2- 172.21.15.49:0/1025232813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ee8100740 0x7f2ee81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 >> 172.21.15.49:0/1025232813 conn(0x7f2ee80fa280 msgr2=0x7f2ee80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 shutdown_connections 2024-09-19T09:06:09.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.646+0000 7f2eecb17640 1 -- 172.21.15.49:0/1025232813 wait complete. 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 -- 172.21.15.49:0/2995694154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101b40 msgr2=0x7f3ec40fdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 --2- 172.21.15.49:0/2995694154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101b40 0x7f3ec40fdc10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009880 tx=0x7f3eb802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 -- 172.21.15.49:0/2995694154 shutdown_connections 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 --2- 172.21.15.49:0/2995694154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101b40 0x7f3ec40fdc10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 --2- 172.21.15.49:0/2995694154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ec4101170 0x7f3ec4101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 -- 172.21.15.49:0/2995694154 >> 172.21.15.49:0/2995694154 conn(0x7f3ec40f99c0 msgr2=0x7f3ec40fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 -- 172.21.15.49:0/2995694154 shutdown_connections 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.730+0000 7f3ec912e640 1 -- 172.21.15.49:0/2995694154 wait complete. 2024-09-19T09:06:09.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.731+0000 7f3ec912e640 1 Processor -- start 2024-09-19T09:06:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.731+0000 7f3ec912e640 1 -- start start 2024-09-19T09:06:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.731+0000 7f3ec912e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101170 0x7f3ec4195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.731+0000 7f3ec912e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ec4101b40 0x7f3ec4195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.731+0000 7f3ec912e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec41961a0 con 0x7f3ec4101170 2024-09-19T09:06:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.731+0000 7f3ec912e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4196310 con 0x7f3ec4101b40 2024-09-19T09:06:09.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.731+0000 7f3ec2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101170 0x7f3ec4195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101170 0x7f3ec4195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46606/0 (socket says 172.21.15.49:46606) 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec2d9d640 1 -- 172.21.15.49:0/3364799502 learned_addr learned my addr 172.21.15.49:0/3364799502 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec259c640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ec4101b40 0x7f3ec4195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec2d9d640 1 -- 172.21.15.49:0/3364799502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ec4101b40 msgr2=0x7f3ec4195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec2d9d640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ec4101b40 0x7f3ec4195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec2d9d640 1 -- 172.21.15.49:0/3364799502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb8009560 con 0x7f3ec4101170 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec259c640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ec4101b40 0x7f3ec4195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec2d9d640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101170 0x7f3ec4195690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400d900 tx=0x7f3eb400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3eabfff640 1 -- 172.21.15.49:0/3364799502 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eb4009c00 con 0x7f3ec4101170 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3eabfff640 1 -- 172.21.15.49:0/3364799502 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3eb4009d60 con 0x7f3ec4101170 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec419ad60 con 0x7f3ec4101170 2024-09-19T09:06:09.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3eabfff640 1 -- 172.21.15.49:0/3364799502 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eb400f7b0 con 0x7f3ec4101170 2024-09-19T09:06:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.732+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec419b220 con 0x7f3ec4101170 2024-09-19T09:06:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.733+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec418f720 con 0x7f3ec4101170 2024-09-19T09:06:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.734+0000 7f3eabfff640 1 -- 172.21.15.49:0/3364799502 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3eb4010460 con 0x7f3ec4101170 2024-09-19T09:06:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.734+0000 7f3eabfff640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3eac06e730 0x7f3eac070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:09.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.734+0000 7f3eabfff640 1 -- 172.21.15.49:0/3364799502 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3eb408ec80 con 0x7f3ec4101170 2024-09-19T09:06:09.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.734+0000 7f3ec259c640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3eac06e730 0x7f3eac070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:09.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.735+0000 7f3ec259c640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3eac06e730 0x7f3eac070bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009230 tx=0x7f3eb80314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:09.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.739+0000 7f3eabfff640 1 -- 172.21.15.49:0/3364799502 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3eb4057bb0 con 0x7f3ec4101170 2024-09-19T09:06:09.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.969+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ec402c520 con 0x7f3ec4101170 2024-09-19T09:06:09.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.969+0000 7f3eabfff640 1 -- 172.21.15.49:0/3364799502 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7f3eb405b270 con 0x7f3ec4101170 2024-09-19T09:06:09.970 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:06:09.970 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:06:09.970 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:06:09.971 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:06:09.972 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:06:09.973 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:06:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:06:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3eac06e730 msgr2=0x7f3eac070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3eac06e730 0x7f3eac070bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009230 tx=0x7f3eb80314e0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101170 msgr2=0x7f3ec4195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:09.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101170 0x7f3ec4195690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400d900 tx=0x7f3eb400ddc0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 shutdown_connections 2024-09-19T09:06:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3eac06e730 0x7f3eac070bf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ec4101b40 0x7f3ec4195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 --2- 172.21.15.49:0/3364799502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ec4101170 0x7f3ec4195690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 >> 172.21.15.49:0/3364799502 conn(0x7f3ec40f99c0 msgr2=0x7f3ec4104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 shutdown_connections 2024-09-19T09:06:09.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:09.971+0000 7f3ec912e640 1 -- 172.21.15.49:0/3364799502 wait complete. 2024-09-19T09:06:10.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 -- 172.21.15.49:0/877172469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b080fde50 msgr2=0x7f2b080fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/877172469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b080fde50 0x7f2b080fe250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009880 tx=0x7f2afc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 -- 172.21.15.49:0/877172469 shutdown_connections 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/877172469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b08100e30 0x7f2b081012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/877172469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b080fde50 0x7f2b080fe250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 -- 172.21.15.49:0/877172469 >> 172.21.15.49:0/877172469 conn(0x7f2b080f99c0 msgr2=0x7f2b080fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 -- 172.21.15.49:0/877172469 shutdown_connections 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.055+0000 7f2b0ee28640 1 -- 172.21.15.49:0/877172469 wait complete. 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b0ee28640 1 Processor -- start 2024-09-19T09:06:10.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b0ee28640 1 -- start start 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b0ee28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b080fde50 0x7f2b08195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b0ee28640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b08100e30 0x7f2b08195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b0ee28640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08196130 con 0x7f2b08100e30 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b0ee28640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b081962a0 con 0x7f2b080fde50 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b07fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b08100e30 0x7f2b08195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b07fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b08100e30 0x7f2b08195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46610/0 (socket says 172.21.15.49:46610) 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b07fff640 1 -- 172.21.15.49:0/652303471 learned_addr learned my addr 172.21.15.49:0/652303471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:10.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.056+0000 7f2b0cbc4640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b080fde50 0x7f2b08195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b07fff640 1 -- 172.21.15.49:0/652303471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b080fde50 msgr2=0x7f2b08195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b07fff640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b080fde50 0x7f2b08195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b07fff640 1 -- 172.21.15.49:0/652303471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009560 con 0x7f2b08100e30 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b0cbc4640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b080fde50 0x7f2b08195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b07fff640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b08100e30 0x7f2b08195b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c920 tx=0x7f2af400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b05ffb640 1 -- 172.21.15.49:0/652303471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af4007b80 con 0x7f2b08100e30 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b05ffb640 1 -- 172.21.15.49:0/652303471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2af40054e0 con 0x7f2b08100e30 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0819ad40 con 0x7f2b08100e30 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b05ffb640 1 -- 172.21.15.49:0/652303471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af400f450 con 0x7f2b08100e30 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.057+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0819b310 con 0x7f2b08100e30 2024-09-19T09:06:10.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.058+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b08108790 con 0x7f2b08100e30 2024-09-19T09:06:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.059+0000 7f2b05ffb640 1 -- 172.21.15.49:0/652303471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2af4004f60 con 0x7f2b08100e30 2024-09-19T09:06:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.059+0000 7f2b05ffb640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2af806e730 0x7f2af8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.059+0000 7f2b05ffb640 1 -- 172.21.15.49:0/652303471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2af408e770 con 0x7f2b08100e30 2024-09-19T09:06:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.059+0000 7f2b0cbc4640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2af806e730 0x7f2af8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:10.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.060+0000 7f2b0cbc4640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2af806e730 0x7f2af8070bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009230 tx=0x7f2afc0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:10.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.064+0000 7f2b05ffb640 1 -- 172.21.15.49:0/652303471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2af40576a0 con 0x7f2b08100e30 2024-09-19T09:06:10.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.257+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b08105780 con 0x7f2af806e730 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: pgmap v49: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050] boot 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: osdmap e53: 6 total, 6 up, 6 in 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:10.259 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1025232813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:09 smithi049 ceph-mon[91793]: osdmap e54: 6 total, 6 up, 6 in 2024-09-19T09:06:10.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: pgmap v49: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:10.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:10.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:06:10.261 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: osd.0 [v2:172.21.15.49:6802/2429083050,v1:172.21.15.49:6803/2429083050] boot 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: osdmap e53: 6 total, 6 up, 6 in 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.262 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:10.263 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:10.263 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-19T09:06:10.263 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:10.263 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1025232813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:10.263 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:09 smithi102 ceph-mon[80875]: osdmap e54: 6 total, 6 up, 6 in 2024-09-19T09:06:10.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.259+0000 7f2b05ffb640 1 -- 172.21.15.49:0/652303471 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2b08105780 con 0x7f2af806e730 2024-09-19T09:06:10.263 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:06:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:06:10.263 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "7/23 daemons upgraded", 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:06:10.264 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:06:10.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2af806e730 msgr2=0x7f2af8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2af806e730 0x7f2af8070bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009230 tx=0x7f2afc0314e0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b08100e30 msgr2=0x7f2b08195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b08100e30 0x7f2b08195b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c920 tx=0x7f2af400cde0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 shutdown_connections 2024-09-19T09:06:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f2af806e730 0x7f2af8070bf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b08100e30 0x7f2b08195b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 --2- 172.21.15.49:0/652303471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b080fde50 0x7f2b08195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 >> 172.21.15.49:0/652303471 conn(0x7f2b080f99c0 msgr2=0x7f2b08104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 shutdown_connections 2024-09-19T09:06:10.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.261+0000 7f2b0ee28640 1 -- 172.21.15.49:0/652303471 wait complete. 2024-09-19T09:06:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 -- 172.21.15.49:0/141534684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634100630 msgr2=0x7fa634102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 --2- 172.21.15.49:0/141534684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634100630 0x7fa634102a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6280098b0 tx=0x7fa62802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 -- 172.21.15.49:0/141534684 shutdown_connections 2024-09-19T09:06:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 --2- 172.21.15.49:0/141534684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa634102f60 0x7fa634105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 --2- 172.21.15.49:0/141534684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634100630 0x7fa634102a20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 -- 172.21.15.49:0/141534684 >> 172.21.15.49:0/141534684 conn(0x7fa6340fa250 msgr2=0x7fa6340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 -- 172.21.15.49:0/141534684 shutdown_connections 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.344+0000 7fa63b039640 1 -- 172.21.15.49:0/141534684 wait complete. 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa63b039640 1 Processor -- start 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa63b039640 1 -- start start 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa63b039640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa634100630 0x7fa634197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa63b039640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634102f60 0x7fa634197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa63b039640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6341983a0 con 0x7fa634102f60 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa63b039640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634198510 con 0x7fa634100630 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa633fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634102f60 0x7fa634197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa633fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634102f60 0x7fa634197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58182/0 (socket says 172.21.15.49:58182) 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa633fff640 1 -- 172.21.15.49:0/3860701464 learned_addr learned my addr 172.21.15.49:0/3860701464 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:10.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.345+0000 7fa638dd5640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa634100630 0x7fa634197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa633fff640 1 -- 172.21.15.49:0/3860701464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa634100630 msgr2=0x7fa634197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa633fff640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa634100630 0x7fa634197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa633fff640 1 -- 172.21.15.49:0/3860701464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628009560 con 0x7fa634102f60 2024-09-19T09:06:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa633fff640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634102f60 0x7fa634197dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa62000d8d0 tx=0x7fa62000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa631ffb640 1 -- 172.21.15.49:0/3860701464 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa62000bea0 con 0x7fa634102f60 2024-09-19T09:06:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa631ffb640 1 -- 172.21.15.49:0/3860701464 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa620009c00 con 0x7fa634102f60 2024-09-19T09:06:10.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63419cf60 con 0x7fa634102f60 2024-09-19T09:06:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa631ffb640 1 -- 172.21.15.49:0/3860701464 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa620010460 con 0x7fa634102f60 2024-09-19T09:06:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.346+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63419d480 con 0x7fa634102f60 2024-09-19T09:06:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.347+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634100a10 con 0x7fa634102f60 2024-09-19T09:06:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.348+0000 7fa631ffb640 1 -- 172.21.15.49:0/3860701464 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 39) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa620003f10 con 0x7fa634102f60 2024-09-19T09:06:10.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.348+0000 7fa631ffb640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa62406e720 0x7fa624070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.348+0000 7fa631ffb640 1 -- 172.21.15.49:0/3860701464 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa62008e710 con 0x7fa634102f60 2024-09-19T09:06:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.348+0000 7fa638dd5640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa62406e720 0x7fa624070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:10.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.349+0000 7fa638dd5640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa62406e720 0x7fa624070be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa628006010 tx=0x7fa6280314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:10.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.353+0000 7fa631ffb640 1 -- 172.21.15.49:0/3860701464 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa620057640 con 0x7fa634102f60 2024-09-19T09:06:10.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.597+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa6340fbd40 con 0x7fa634102f60 2024-09-19T09:06:10.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.597+0000 7fa631ffb640 1 -- 172.21.15.49:0/3860701464 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1484 (secure 0 0 0) 0x7fa62005ad00 con 0x7fa634102f60 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-19T09:06:10.598 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-19T09:06:10.599 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa62406e720 msgr2=0x7fa624070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa62406e720 0x7fa624070be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa628006010 tx=0x7fa6280314e0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634102f60 msgr2=0x7fa634197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634102f60 0x7fa634197dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa62000d8d0 tx=0x7fa62000dd90 comp rx=0 tx=0).stop 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 shutdown_connections 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa62406e720 0x7fa624070be0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa634102f60 0x7fa634197dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 --2- 172.21.15.49:0/3860701464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa634100630 0x7fa634197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:10.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 >> 172.21.15.49:0/3860701464 conn(0x7fa6340fa250 msgr2=0x7fa634103940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:10.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 shutdown_connections 2024-09-19T09:06:10.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:10.600+0000 7fa63b039640 1 -- 172.21.15.49:0/3860701464 wait complete. 2024-09-19T09:06:11.198 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:10 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3364799502' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:06:11.198 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:10 smithi102 ceph-mon[80875]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:11.199 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:10 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3860701464' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:06:11.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:10 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3364799502' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:06:11.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:10 smithi049 ceph-mon[91793]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:11.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:10 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3860701464' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:06:12.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:11 smithi102 ceph-mon[80875]: pgmap v52: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:11 smithi049 ceph-mon[91793]: pgmap v52: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:13 smithi049 ceph-mon[91793]: pgmap v53: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:14.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:13 smithi102 ceph-mon[80875]: pgmap v53: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-09-19T09:06:14.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:14.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:14 smithi102 ceph-mon[80875]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded) 2024-09-19T09:06:15.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:14 smithi102 ceph-mon[80875]: mgrmap e40: smithi049.qdvksw(active, since 92s), standbys: smithi102.csalqv 2024-09-19T09:06:15.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:14 smithi049 ceph-mon[91793]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded) 2024-09-19T09:06:15.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:14 smithi049 ceph-mon[91793]: mgrmap e40: smithi049.qdvksw(active, since 92s), standbys: smithi102.csalqv 2024-09-19T09:06:16.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:15 smithi102 ceph-mon[80875]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 779 B/s wr, 6 op/s 2024-09-19T09:06:16.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:15 smithi049 ceph-mon[91793]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 779 B/s wr, 6 op/s 2024-09-19T09:06:18.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:17 smithi102 ceph-mon[80875]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-19T09:06:18.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:17 smithi049 ceph-mon[91793]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-19T09:06:20.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:19 smithi102 ceph-mon[80875]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 535 B/s wr, 4 op/s 2024-09-19T09:06:20.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:19 smithi049 ceph-mon[91793]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 535 B/s wr, 4 op/s 2024-09-19T09:06:21.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:21 smithi102 ceph-mon[80875]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 484 B/s wr, 3 op/s 2024-09-19T09:06:21.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:21 smithi049 ceph-mon[91793]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 484 B/s wr, 3 op/s 2024-09-19T09:06:23.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:23 smithi049 ceph-mon[91793]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T09:06:23.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:23 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:24.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:23 smithi102 ceph-mon[80875]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-19T09:06:24.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:23 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:24.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:24 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:24.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:24 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:24.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:24 smithi049 ceph-mon[91793]: Upgrade: osd.1 is safe to restart 2024-09-19T09:06:25.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:24 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:25.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:24 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T09:06:25.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:24 smithi102 ceph-mon[80875]: Upgrade: osd.1 is safe to restart 2024-09-19T09:06:25.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:25 smithi049 ceph-mon[91793]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T09:06:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:25 smithi102 ceph-mon[80875]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T09:06:27.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:26 smithi049 ceph-mon[91793]: Upgrade: Updating osd.1 2024-09-19T09:06:27.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:26 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:27.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:26 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:06:27.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:26 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:27.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:26 smithi049 ceph-mon[91793]: Deploying daemon osd.1 on smithi049 2024-09-19T09:06:27.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:26 smithi102 ceph-mon[80875]: Upgrade: Updating osd.1 2024-09-19T09:06:27.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:26 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:27.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:26 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:06:27.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:26 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:27.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:26 smithi102 ceph-mon[80875]: Deploying daemon osd.1 on smithi049 2024-09-19T09:06:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:27 smithi049 ceph-mon[91793]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:06:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:28.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:28.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:27 smithi102 ceph-mon[80875]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:06:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:28.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:29.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:28 smithi049 systemd[1]: Stopping Ceph osd.1 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:06:29.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:29 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[54442]: 2024-09-19T09:06:29.076+0000 7f73aee1e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:29.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:29 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[54442]: 2024-09-19T09:06:29.076+0000 7f73aee1e640 -1 osd.1 54 *** Got signal Terminated *** 2024-09-19T09:06:29.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:29 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[54442]: 2024-09-19T09:06:29.076+0000 7f73aee1e640 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:30.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:29 smithi049 ceph-mon[91793]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:06:30.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:29 smithi049 ceph-mon[91793]: osd.1 marked itself down and dead 2024-09-19T09:06:30.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:29 smithi102 ceph-mon[80875]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:06:30.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:29 smithi102 ceph-mon[80875]: osd.1 marked itself down and dead 2024-09-19T09:06:30.435 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:30 smithi049 podman[105891]: 2024-09-19 09:06:30.182061693 +0000 UTC m=+1.198346060 container died b64db6d6c4f7cda0f81e43a61058efc3afb9c2590542ddf14f40cd32ee688b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:06:30.719 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:30 smithi049 podman[105891]: 2024-09-19 09:06:30.526673259 +0000 UTC m=+1.542957671 container cleanup b64db6d6c4f7cda0f81e43a61058efc3afb9c2590542ddf14f40cd32ee688b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-19T09:06:30.719 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:30 smithi049 bash[105891]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:06:31.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:30 smithi049 ceph-mon[91793]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:06:31.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:30 smithi049 ceph-mon[91793]: osdmap e55: 6 total, 5 up, 6 in 2024-09-19T09:06:31.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:30 smithi049 podman[105906]: 2024-09-19 09:06:30.719481054 +0000 UTC m=+0.534140846 container remove b64db6d6c4f7cda0f81e43a61058efc3afb9c2590542ddf14f40cd32ee688b4b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-19T09:06:31.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:30 smithi102 ceph-mon[80875]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:06:31.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:30 smithi102 ceph-mon[80875]: osdmap e55: 6 total, 5 up, 6 in 2024-09-19T09:06:31.456 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:31 smithi049 podman[105993]: 2024-09-19 09:06:31.06841349 +0000 UTC m=+0.016901314 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:31.456 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:31 smithi049 podman[105993]: 2024-09-19 09:06:31.21221807 +0000 UTC m=+0.160705933 container create 1cb0075bfb9279dadffddc07e50ae3f937861f15df5e57818a04d794f4849b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:06:31.456 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:31 smithi049 podman[105993]: 2024-09-19 09:06:31.456597643 +0000 UTC m=+0.405085474 container init 1cb0075bfb9279dadffddc07e50ae3f937861f15df5e57818a04d794f4849b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:06:31.791 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:31 smithi049 podman[105993]: 2024-09-19 09:06:31.460176059 +0000 UTC m=+0.408663881 container start 1cb0075bfb9279dadffddc07e50ae3f937861f15df5e57818a04d794f4849b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T09:06:31.791 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:31 smithi049 podman[105993]: 2024-09-19 09:06:31.564997259 +0000 UTC m=+0.513485094 container attach 1cb0075bfb9279dadffddc07e50ae3f937861f15df5e57818a04d794f4849b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:06:31.791 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:31 smithi049 podman[105993]: 2024-09-19 09:06:31.658532007 +0000 UTC m=+0.607019831 container died 1cb0075bfb9279dadffddc07e50ae3f937861f15df5e57818a04d794f4849b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:32.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:31 smithi102 ceph-mon[80875]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:06:32.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:31 smithi102 ceph-mon[80875]: osdmap e56: 6 total, 5 up, 6 in 2024-09-19T09:06:32.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:31 smithi049 ceph-mon[91793]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:06:32.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:31 smithi049 ceph-mon[91793]: osdmap e56: 6 total, 5 up, 6 in 2024-09-19T09:06:32.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 podman[106015]: 2024-09-19 09:06:32.251863815 +0000 UTC m=+0.583076453 container remove 1cb0075bfb9279dadffddc07e50ae3f937861f15df5e57818a04d794f4849b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T09:06:32.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-19T09:06:32.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 systemd[1]: Stopped Ceph osd.1 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:06:32.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 2.415s CPU time. 2024-09-19T09:06:32.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 systemd[1]: Starting Ceph osd.1 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:06:32.981 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 podman[106114]: 2024-09-19 09:06:32.618968218 +0000 UTC m=+0.021730901 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:32.981 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 podman[106114]: 2024-09-19 09:06:32.745066054 +0000 UTC m=+0.147828714 container create b07f52d1550ebd791a7a2fb1b752a3e35dcb15455d51f61ae78cace308f2f6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:06:33.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 podman[106114]: 2024-09-19 09:06:32.981596841 +0000 UTC m=+0.384359510 container init b07f52d1550ebd791a7a2fb1b752a3e35dcb15455d51f61ae78cace308f2f6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:06:33.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:32 smithi049 podman[106114]: 2024-09-19 09:06:32.985686231 +0000 UTC m=+0.388448892 container start b07f52d1550ebd791a7a2fb1b752a3e35dcb15455d51f61ae78cace308f2f6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:06:33.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 podman[106114]: 2024-09-19 09:06:33.064416897 +0000 UTC m=+0.467179558 container attach b07f52d1550ebd791a7a2fb1b752a3e35dcb15455d51f61ae78cace308f2f6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:33.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:06:33.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 bash[106114]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:06:33.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:06:33.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 bash[106114]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:06:34.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:33 smithi049 ceph-mon[91793]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:06:34.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:06:34.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 bash[106114]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:06:34.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:06:34.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:33 smithi049 bash[106114]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:06:34.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:33 smithi102 ceph-mon[80875]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:06:34.476 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:06:34.476 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 bash[106114]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 bash[106114]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 bash[106114]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 bash[106114]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate[106129]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 bash[106114]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-19T09:06:34.477 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 podman[106114]: 2024-09-19 09:06:34.18615869 +0000 UTC m=+1.588921368 container died b07f52d1550ebd791a7a2fb1b752a3e35dcb15455d51f61ae78cace308f2f6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:06:35.050 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:34 smithi049 ceph-mon[91793]: Health check failed: Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:06:35.050 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 podman[106281]: 2024-09-19 09:06:34.751532459 +0000 UTC m=+0.555533729 container remove b07f52d1550ebd791a7a2fb1b752a3e35dcb15455d51f61ae78cace308f2f6f2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:06:35.050 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 podman[106344]: 2024-09-19 09:06:34.952377251 +0000 UTC m=+0.106571398 container create ae5cb4e6931bab57fbce6121f312c712494bb9598528629a50789f173d7b308f (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:06:35.050 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:34 smithi049 podman[106344]: 2024-09-19 09:06:34.863307789 +0000 UTC m=+0.017501951 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:35.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:34 smithi102 ceph-mon[80875]: Health check failed: Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:06:35.304 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:35 smithi049 podman[106344]: 2024-09-19 09:06:35.129957097 +0000 UTC m=+0.284151251 container init ae5cb4e6931bab57fbce6121f312c712494bb9598528629a50789f173d7b308f (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:35.304 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:35 smithi049 podman[106344]: 2024-09-19 09:06:35.133356547 +0000 UTC m=+0.287550697 container start ae5cb4e6931bab57fbce6121f312c712494bb9598528629a50789f173d7b308f (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:35.304 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:35 smithi049 ceph-osd[106363]: -- 172.21.15.49:0/3026265823 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571428e21e0 con 0x557141a8fc00 2024-09-19T09:06:35.304 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:35 smithi049 bash[106344]: ae5cb4e6931bab57fbce6121f312c712494bb9598528629a50789f173d7b308f 2024-09-19T09:06:35.305 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:35 smithi049 systemd[1]: Started Ceph osd.1 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:06:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:36 smithi049 ceph-mon[91793]: pgmap v66: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:36 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:36 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:36 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:36.626 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:36 smithi102 ceph-mon[80875]: pgmap v66: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:36.626 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:36 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:36.626 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:36 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:36.627 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:36 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:37.302 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:37 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[106359]: 2024-09-19T09:06:37.016+0000 7f758fd88640 -1 Falling back to public interface 2024-09-19T09:06:38.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:38 smithi049 ceph-mon[91793]: pgmap v67: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/321 objects degraded (14.330%) 2024-09-19T09:06:38.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:38 smithi102 ceph-mon[80875]: pgmap v67: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/321 objects degraded (14.330%) 2024-09-19T09:06:40.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:40 smithi049 ceph-mon[91793]: pgmap v68: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 -- 172.21.15.49:0/2005148784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700fea70 msgr2=0x7ff6700fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 --2- 172.21.15.49:0/2005148784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700fea70 0x7ff6700fee70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff660009880 tx=0x7ff66002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 -- 172.21.15.49:0/2005148784 shutdown_connections 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 --2- 172.21.15.49:0/2005148784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6700ffc70 0x7ff6701000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 --2- 172.21.15.49:0/2005148784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700fea70 0x7ff6700fee70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 -- 172.21.15.49:0/2005148784 >> 172.21.15.49:0/2005148784 conn(0x7ff6700fa200 msgr2=0x7ff6700fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 -- 172.21.15.49:0/2005148784 shutdown_connections 2024-09-19T09:06:40.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.693+0000 7ff67496b640 1 -- 172.21.15.49:0/2005148784 wait complete. 2024-09-19T09:06:40.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.694+0000 7ff67496b640 1 Processor -- start 2024-09-19T09:06:40.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.694+0000 7ff67496b640 1 -- start start 2024-09-19T09:06:40.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.694+0000 7ff67496b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6700fea70 0x7ff670068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.694+0000 7ff67496b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700ffc70 0x7ff67019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.694+0000 7ff67496b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67019a900 con 0x7ff6700ffc70 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.694+0000 7ff67496b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67019aa70 con 0x7ff6700fea70 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700ffc70 0x7ff67019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700ffc70 0x7ff67019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45084/0 (socket says 172.21.15.49:45084) 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66dd9b640 1 -- 172.21.15.49:0/3541671387 learned_addr learned my addr 172.21.15.49:0/3541671387 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66e59c640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6700fea70 0x7ff670068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66dd9b640 1 -- 172.21.15.49:0/3541671387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6700fea70 msgr2=0x7ff670068ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66dd9b640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6700fea70 0x7ff670068ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66dd9b640 1 -- 172.21.15.49:0/3541671387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660009560 con 0x7ff6700ffc70 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff66dd9b640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700ffc70 0x7ff67019a330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c810 tx=0x7ff66400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:40.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.695+0000 7ff65f7fe640 1 -- 172.21.15.49:0/3541671387 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6640041f0 con 0x7ff6700ffc70 2024-09-19T09:06:40.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.696+0000 7ff65f7fe640 1 -- 172.21.15.49:0/3541671387 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff664007e70 con 0x7ff6700ffc70 2024-09-19T09:06:40.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.696+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67019ad50 con 0x7ff6700ffc70 2024-09-19T09:06:40.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.696+0000 7ff65f7fe640 1 -- 172.21.15.49:0/3541671387 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6640049d0 con 0x7ff6700ffc70 2024-09-19T09:06:40.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.696+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67019b320 con 0x7ff6700ffc70 2024-09-19T09:06:40.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.697+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff670107660 con 0x7ff6700ffc70 2024-09-19T09:06:40.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.697+0000 7ff65f7fe640 1 -- 172.21.15.49:0/3541671387 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff6640079b0 con 0x7ff6700ffc70 2024-09-19T09:06:40.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.698+0000 7ff65f7fe640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff65806e5f0 0x7ff658070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:40.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.698+0000 7ff65f7fe640 1 -- 172.21.15.49:0/3541671387 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff66408e460 con 0x7ff6700ffc70 2024-09-19T09:06:40.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.698+0000 7ff66e59c640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff65806e5f0 0x7ff658070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:40.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.699+0000 7ff66e59c640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff65806e5f0 0x7ff658070ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff670069530 tx=0x7ff6600314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:40.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.703+0000 7ff65f7fe640 1 -- 172.21.15.49:0/3541671387 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff664057660 con 0x7ff6700ffc70 2024-09-19T09:06:40.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:40 smithi102 ceph-mon[80875]: pgmap v68: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.931+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6701045c0 con 0x7ff65806e5f0 2024-09-19T09:06:40.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.933+0000 7ff65f7fe640 1 -- 172.21.15.49:0/3541671387 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff6701045c0 con 0x7ff65806e5f0 2024-09-19T09:06:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff65806e5f0 msgr2=0x7ff658070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff65806e5f0 0x7ff658070ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff670069530 tx=0x7ff6600314e0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700ffc70 msgr2=0x7ff67019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700ffc70 0x7ff67019a330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff66400c810 tx=0x7ff66400ccd0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 shutdown_connections 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff65806e5f0 0x7ff658070ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6700ffc70 0x7ff67019a330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 --2- 172.21.15.49:0/3541671387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6700fea70 0x7ff670068ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.935+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 >> 172.21.15.49:0/3541671387 conn(0x7ff6700fa200 msgr2=0x7ff670102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.936+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 shutdown_connections 2024-09-19T09:06:40.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:40.936+0000 7ff67496b640 1 -- 172.21.15.49:0/3541671387 wait complete. 2024-09-19T09:06:40.946 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 -- 172.21.15.49:0/2994487809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 msgr2=0x7fc198073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 --2- 172.21.15.49:0/2994487809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198073370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009880 tx=0x7fc18c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 -- 172.21.15.49:0/2994487809 shutdown_connections 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 --2- 172.21.15.49:0/2994487809 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198073370 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 --2- 172.21.15.49:0/2994487809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1980744e0 0x7fc198072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 -- 172.21.15.49:0/2994487809 >> 172.21.15.49:0/2994487809 conn(0x7fc1980fb360 msgr2=0x7fc1980fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 -- 172.21.15.49:0/2994487809 shutdown_connections 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.028+0000 7fc19d916640 1 -- 172.21.15.49:0/2994487809 wait complete. 2024-09-19T09:06:41.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc19d916640 1 Processor -- start 2024-09-19T09:06:41.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc19d916640 1 -- start start 2024-09-19T09:06:41.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc19d916640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc19d916640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1980744e0 0x7fc198197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc19d916640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198198380 con 0x7fc198072f10 2024-09-19T09:06:41.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc19d916640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1981984f0 con 0x7fc1980744e0 2024-09-19T09:06:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45090/0 (socket says 172.21.15.49:45090) 2024-09-19T09:06:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc196ffd640 1 -- 172.21.15.49:0/1420088544 learned_addr learned my addr 172.21.15.49:0/1420088544 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.029+0000 7fc1967fc640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1980744e0 0x7fc198197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc196ffd640 1 -- 172.21.15.49:0/1420088544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1980744e0 msgr2=0x7fc198197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc196ffd640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1980744e0 0x7fc198197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc196ffd640 1 -- 172.21.15.49:0/1420088544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c009560 con 0x7fc198072f10 2024-09-19T09:06:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc1967fc640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1980744e0 0x7fc198197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc196ffd640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198197870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc18800e9a0 tx=0x7fc18800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc19c914640 1 -- 172.21.15.49:0/1420088544 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18800cc90 con 0x7fc198072f10 2024-09-19T09:06:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc19c914640 1 -- 172.21.15.49:0/1420088544 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc18800cdf0 con 0x7fc198072f10 2024-09-19T09:06:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19819cf40 con 0x7fc198072f10 2024-09-19T09:06:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc19c914640 1 -- 172.21.15.49:0/1420088544 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc188010430 con 0x7fc198072f10 2024-09-19T09:06:41.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.030+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19819d480 con 0x7fc198072f10 2024-09-19T09:06:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.032+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc198073370 con 0x7fc198072f10 2024-09-19T09:06:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.032+0000 7fc19c914640 1 -- 172.21.15.49:0/1420088544 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc188010720 con 0x7fc198072f10 2024-09-19T09:06:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.032+0000 7fc19c914640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18006e5f0 0x7fc180070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.032+0000 7fc19c914640 1 -- 172.21.15.49:0/1420088544 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc188014070 con 0x7fc198072f10 2024-09-19T09:06:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.032+0000 7fc1967fc640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18006e5f0 0x7fc180070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.033+0000 7fc1967fc640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18006e5f0 0x7fc180070ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc18c000c00 tx=0x7fc18c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:41.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.037+0000 7fc19c914640 1 -- 172.21.15.49:0/1420088544 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc188057d60 con 0x7fc198072f10 2024-09-19T09:06:41.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.250+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc19802c590 con 0x7fc18006e5f0 2024-09-19T09:06:41.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.251+0000 7fc19c914640 1 -- 172.21.15.49:0/1420088544 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc19802c590 con 0x7fc18006e5f0 2024-09-19T09:06:41.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18006e5f0 msgr2=0x7fc180070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18006e5f0 0x7fc180070ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc18c000c00 tx=0x7fc18c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 msgr2=0x7fc198197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198197870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc18800e9a0 tx=0x7fc18800ee60 comp rx=0 tx=0).stop 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 shutdown_connections 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18006e5f0 0x7fc180070ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1980744e0 0x7fc198197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 --2- 172.21.15.49:0/1420088544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc198072f10 0x7fc198197870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 >> 172.21.15.49:0/1420088544 conn(0x7fc1980fb360 msgr2=0x7fc198105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:41.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 shutdown_connections 2024-09-19T09:06:41.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.253+0000 7fc19d916640 1 -- 172.21.15.49:0/1420088544 wait complete. 2024-09-19T09:06:41.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 -- 172.21.15.49:0/2542277349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 msgr2=0x7fda0c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 --2- 172.21.15.49:0/2542277349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c0fff90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009880 tx=0x7fd9fc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 -- 172.21.15.49:0/2542277349 shutdown_connections 2024-09-19T09:06:41.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 --2- 172.21.15.49:0/2542277349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda0c100d90 0x7fda0c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 --2- 172.21.15.49:0/2542277349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c0fff90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 -- 172.21.15.49:0/2542277349 >> 172.21.15.49:0/2542277349 conn(0x7fda0c0fb360 msgr2=0x7fda0c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:41.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 -- 172.21.15.49:0/2542277349 shutdown_connections 2024-09-19T09:06:41.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.347+0000 7fda10a83640 1 -- 172.21.15.49:0/2542277349 wait complete. 2024-09-19T09:06:41.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.348+0000 7fda10a83640 1 Processor -- start 2024-09-19T09:06:41.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda10a83640 1 -- start start 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda10a83640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c1955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda10a83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda0c100d90 0x7fda0c195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda10a83640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c1960f0 con 0x7fda0c0ffb90 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda10a83640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c196260 con 0x7fda0c100d90 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda0a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c1955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda0a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c1955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45112/0 (socket says 172.21.15.49:45112) 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda0a59c640 1 -- 172.21.15.49:0/190312998 learned_addr learned my addr 172.21.15.49:0/190312998 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda09d9b640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda0c100d90 0x7fda0c195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda0a59c640 1 -- 172.21.15.49:0/190312998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda0c100d90 msgr2=0x7fda0c195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda0a59c640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda0c100d90 0x7fda0c195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda0a59c640 1 -- 172.21.15.49:0/190312998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc009560 con 0x7fda0c0ffb90 2024-09-19T09:06:41.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.349+0000 7fda09d9b640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda0c100d90 0x7fda0c195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:41.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.350+0000 7fda0a59c640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c1955e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0054f0 tx=0x7fd9fc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:41.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.350+0000 7fd9fb7fe640 1 -- 172.21.15.49:0/190312998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9fc004aa0 con 0x7fda0c0ffb90 2024-09-19T09:06:41.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.350+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c19aca0 con 0x7fda0c0ffb90 2024-09-19T09:06:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.350+0000 7fd9fb7fe640 1 -- 172.21.15.49:0/190312998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9fc004c00 con 0x7fda0c0ffb90 2024-09-19T09:06:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.350+0000 7fd9fb7fe640 1 -- 172.21.15.49:0/190312998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9fc003ac0 con 0x7fda0c0ffb90 2024-09-19T09:06:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.350+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c19b190 con 0x7fda0c0ffb90 2024-09-19T09:06:41.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.351+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c108780 con 0x7fda0c0ffb90 2024-09-19T09:06:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.352+0000 7fd9fb7fe640 1 -- 172.21.15.49:0/190312998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd9fc003d80 con 0x7fda0c0ffb90 2024-09-19T09:06:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.353+0000 7fd9fb7fe640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd9f406e5f0 0x7fd9f4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.353+0000 7fd9fb7fe640 1 -- 172.21.15.49:0/190312998 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd9fc0af8d0 con 0x7fda0c0ffb90 2024-09-19T09:06:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.353+0000 7fda09d9b640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd9f406e5f0 0x7fd9f4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.353+0000 7fda09d9b640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd9f406e5f0 0x7fd9f4070ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda00005d00 tx=0x7fda00005c70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:41.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.361+0000 7fd9fb7fe640 1 -- 172.21.15.49:0/190312998 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd9fc078a20 con 0x7fda0c0ffb90 2024-09-19T09:06:41.543 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.543 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.543 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.544 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.560+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda0c1056e0 con 0x7fd9f406e5f0 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.571+0000 7fd9fb7fe640 1 -- 172.21.15.49:0/190312998 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fda0c1056e0 con 0x7fd9f406e5f0 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (10m) 1s ago 12m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (12m) 1s ago 12m 8879k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (11m) 58s ago 11m 8120k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (66s) 1s ago 12m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (61s) 58s ago 11m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (10m) 1s ago 11m 85.1M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:06:41.572 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (6m) 1s ago 6m 92.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (6m) 1s ago 6m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (6m) 58s ago 6m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (6m) 58s ago 6m 27.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (3m) 1s ago 13m 496M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (2m) 58s ago 11m 439M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (2m) 1s ago 13m 47.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (106s) 58s ago 11m 32.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (12m) 1s ago 12m 15.7M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (11m) 58s ago 11m 16.7M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (41s) 1s ago 10m 83.2M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6s) 1s ago 10m 11.5M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9m) 1s ago 9m 189M 1216M 18.2.4-855-g19e2a2be 980a0bfcd684 027b84586c58 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (9m) 58s ago 9m 245M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:06:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (8m) 58s ago 8m 216M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:06:41.574 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (8m) 58s ago 8m 209M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:06:41.574 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (2m) 1s ago 11m 59.9M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:06:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd9f406e5f0 msgr2=0x7fd9f4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd9f406e5f0 0x7fd9f4070ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fda00005d00 tx=0x7fda00005c70 comp rx=0 tx=0).stop 2024-09-19T09:06:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 msgr2=0x7fda0c1955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c1955e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0054f0 tx=0x7fd9fc005520 comp rx=0 tx=0).stop 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 shutdown_connections 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd9f406e5f0 0x7fd9f4070ab0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda0c100d90 0x7fda0c195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 --2- 172.21.15.49:0/190312998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda0c0ffb90 0x7fda0c1955e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 >> 172.21.15.49:0/190312998 conn(0x7fda0c0fb360 msgr2=0x7fda0c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 shutdown_connections 2024-09-19T09:06:41.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.573+0000 7fda10a83640 1 -- 172.21.15.49:0/190312998 wait complete. 2024-09-19T09:06:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.656+0000 7fa2d0032640 1 -- 172.21.15.49:0/1684209290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 msgr2=0x7fa2c8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.656+0000 7fa2d0032640 1 --2- 172.21.15.49:0/1684209290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c8073370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009880 tx=0x7fa2b802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 -- 172.21.15.49:0/1684209290 shutdown_connections 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 --2- 172.21.15.49:0/1684209290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c8073370 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 --2- 172.21.15.49:0/1684209290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2c80744e0 0x7fa2c8072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 -- 172.21.15.49:0/1684209290 >> 172.21.15.49:0/1684209290 conn(0x7fa2c80fb330 msgr2=0x7fa2c80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 -- 172.21.15.49:0/1684209290 shutdown_connections 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 -- 172.21.15.49:0/1684209290 wait complete. 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 Processor -- start 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 -- start start 2024-09-19T09:06:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2c80744e0 0x7fa2c819c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c819c720 con 0x7fa2c8072f10 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.657+0000 7fa2d0032640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c819c890 con 0x7fa2c80744e0 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cddce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cddce640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45120/0 (socket says 172.21.15.49:45120) 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cddce640 1 -- 172.21.15.49:0/888779606 learned_addr learned my addr 172.21.15.49:0/888779606 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cd5cd640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2c80744e0 0x7fa2c819c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cddce640 1 -- 172.21.15.49:0/888779606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2c80744e0 msgr2=0x7fa2c819c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cddce640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2c80744e0 0x7fa2c819c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cddce640 1 -- 172.21.15.49:0/888779606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b8009560 con 0x7fa2c8072f10 2024-09-19T09:06:41.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cd5cd640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2c80744e0 0x7fa2c819c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2cddce640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c819bc10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400e970 tx=0x7fa2c400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2beffd640 1 -- 172.21.15.49:0/888779606 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c400cc90 con 0x7fa2c8072f10 2024-09-19T09:06:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2beffd640 1 -- 172.21.15.49:0/888779606 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2c400cdf0 con 0x7fa2c8072f10 2024-09-19T09:06:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c81a1320 con 0x7fa2c8072f10 2024-09-19T09:06:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2beffd640 1 -- 172.21.15.49:0/888779606 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c4010430 con 0x7fa2c8072f10 2024-09-19T09:06:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.658+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c81a18f0 con 0x7fa2c8072f10 2024-09-19T09:06:41.664 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.664 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.664 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.664 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.659+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c810eda0 con 0x7fa2c8072f10 2024-09-19T09:06:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.660+0000 7fa2beffd640 1 -- 172.21.15.49:0/888779606 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa2c40046c0 con 0x7fa2c8072f10 2024-09-19T09:06:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.660+0000 7fa2beffd640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa2b406e600 0x7fa2b4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.660+0000 7fa2beffd640 1 -- 172.21.15.49:0/888779606 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa2c4014070 con 0x7fa2c8072f10 2024-09-19T09:06:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.661+0000 7fa2cd5cd640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa2b406e600 0x7fa2b4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.661+0000 7fa2cd5cd640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa2b406e600 0x7fa2b4070ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8000c00 tx=0x7fa2b80314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:41.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.665+0000 7fa2beffd640 1 -- 172.21.15.49:0/888779606 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa2c4057df0 con 0x7fa2c8072f10 2024-09-19T09:06:41.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.922+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa2c81a1eb0 con 0x7fa2c8072f10 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.922+0000 7fa2beffd640 1 -- 172.21.15.49:0/888779606 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fa2c405b4b0 con 0x7fa2c8072f10 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:41.924 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4, 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 8, 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:06:41.925 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:06:41.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa2b406e600 msgr2=0x7fa2b4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa2b406e600 0x7fa2b4070ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8000c00 tx=0x7fa2b80314e0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 msgr2=0x7fa2c819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:41.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c819bc10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400e970 tx=0x7fa2c400ee30 comp rx=0 tx=0).stop 2024-09-19T09:06:41.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 shutdown_connections 2024-09-19T09:06:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa2b406e600 0x7fa2b4070ac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2c80744e0 0x7fa2c819c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 --2- 172.21.15.49:0/888779606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c8072f10 0x7fa2c819bc10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 >> 172.21.15.49:0/888779606 conn(0x7fa2c80fb330 msgr2=0x7fa2c81013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 shutdown_connections 2024-09-19T09:06:41.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:41.925+0000 7fa2d0032640 1 -- 172.21.15.49:0/888779606 wait complete. 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 -- 172.21.15.49:0/2796459671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 msgr2=0x7f8348100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 --2- 172.21.15.49:0/2796459671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348100170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8338009880 tx=0x7f833802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 -- 172.21.15.49:0/2796459671 shutdown_connections 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 --2- 172.21.15.49:0/2796459671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348100170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 --2- 172.21.15.49:0/2796459671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83480feaf0 0x7f83480feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 -- 172.21.15.49:0/2796459671 >> 172.21.15.49:0/2796459671 conn(0x7f83480fa280 msgr2=0x7f83480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 -- 172.21.15.49:0/2796459671 shutdown_connections 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.017+0000 7f834f5e5640 1 -- 172.21.15.49:0/2796459671 wait complete. 2024-09-19T09:06:42.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834f5e5640 1 Processor -- start 2024-09-19T09:06:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834f5e5640 1 -- start start 2024-09-19T09:06:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834f5e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83480feaf0 0x7f83481956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834f5e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834f5e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83481961e0 con 0x7f83480ffcf0 2024-09-19T09:06:42.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834f5e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348196350 con 0x7f83480feaf0 2024-09-19T09:06:42.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834cb80640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834cb80640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348195c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45128/0 (socket says 172.21.15.49:45128) 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834cb80640 1 -- 172.21.15.49:0/3054010291 learned_addr learned my addr 172.21.15.49:0/3054010291 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834d381640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83480feaf0 0x7f83481956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834cb80640 1 -- 172.21.15.49:0/3054010291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83480feaf0 msgr2=0x7f83481956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.018+0000 7f834cb80640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83480feaf0 0x7f83481956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.019+0000 7f834cb80640 1 -- 172.21.15.49:0/3054010291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009560 con 0x7f83480ffcf0 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.019+0000 7f834cb80640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348195c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83380055a0 tx=0x7f83380055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.019+0000 7f833e7fc640 1 -- 172.21.15.49:0/3054010291 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8338004aa0 con 0x7f83480ffcf0 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.019+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834819ad90 con 0x7f83480ffcf0 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.019+0000 7f833e7fc640 1 -- 172.21.15.49:0/3054010291 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8338004c00 con 0x7f83480ffcf0 2024-09-19T09:06:42.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.019+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834819b280 con 0x7f83480ffcf0 2024-09-19T09:06:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.019+0000 7f833e7fc640 1 -- 172.21.15.49:0/3054010291 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8338003b10 con 0x7f83480ffcf0 2024-09-19T09:06:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.020+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c005250 con 0x7f83480ffcf0 2024-09-19T09:06:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.021+0000 7f833e7fc640 1 -- 172.21.15.49:0/3054010291 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8338003d60 con 0x7f83480ffcf0 2024-09-19T09:06:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.021+0000 7f833e7fc640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f833406e5f0 0x7f8334070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.021+0000 7f833e7fc640 1 -- 172.21.15.49:0/3054010291 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f83380af6e0 con 0x7f83480ffcf0 2024-09-19T09:06:42.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.021+0000 7f834d381640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f833406e5f0 0x7f8334070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.022+0000 7f834d381640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f833406e5f0 0x7f8334070ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f83480ffb50 tx=0x7f8344009500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.026+0000 7f833e7fc640 1 -- 172.21.15.49:0/3054010291 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f83380789a0 con 0x7f83480ffcf0 2024-09-19T09:06:42.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.246+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f832c005d10 con 0x7f83480ffcf0 2024-09-19T09:06:42.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.246+0000 7f833e7fc640 1 -- 172.21.15.49:0/3054010291 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7f833807c060 con 0x7f83480ffcf0 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:06:42.248 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:06:42.249 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:42.250 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:42.251 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:06:42.251 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:06:42.251 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:06:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:06:42.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.248+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f833406e5f0 msgr2=0x7f8334070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.248+0000 7f834f5e5640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f833406e5f0 0x7f8334070ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f83480ffb50 tx=0x7f8344009500 comp rx=0 tx=0).stop 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.248+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 msgr2=0x7f8348195c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.248+0000 7f834f5e5640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348195c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83380055a0 tx=0x7f83380055d0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.249+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 shutdown_connections 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.249+0000 7f834f5e5640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f833406e5f0 0x7f8334070ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.249+0000 7f834f5e5640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83480ffcf0 0x7f8348195c10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.249+0000 7f834f5e5640 1 --2- 172.21.15.49:0/3054010291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83480feaf0 0x7f83481956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.249+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 >> 172.21.15.49:0/3054010291 conn(0x7f83480fa280 msgr2=0x7f8348067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.249+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 shutdown_connections 2024-09-19T09:06:42.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.249+0000 7f834f5e5640 1 -- 172.21.15.49:0/3054010291 wait complete. 2024-09-19T09:06:42.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 -- 172.21.15.49:0/4011449127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 msgr2=0x7f0f00100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 --2- 172.21.15.49:0/4011449127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00100170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009880 tx=0x7f0ef002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 -- 172.21.15.49:0/4011449127 shutdown_connections 2024-09-19T09:06:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 --2- 172.21.15.49:0/4011449127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00100170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 --2- 172.21.15.49:0/4011449127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000feaf0 0x7f0f000feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 -- 172.21.15.49:0/4011449127 >> 172.21.15.49:0/4011449127 conn(0x7f0f000fa280 msgr2=0x7f0f000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 -- 172.21.15.49:0/4011449127 shutdown_connections 2024-09-19T09:06:42.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.339+0000 7f0f07b99640 1 -- 172.21.15.49:0/4011449127 wait complete. 2024-09-19T09:06:42.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f07b99640 1 Processor -- start 2024-09-19T09:06:42.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f07b99640 1 -- start start 2024-09-19T09:06:42.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f07b99640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000feaf0 0x7f0f001956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f07b99640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f07b99640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f001961e0 con 0x7f0f000ffcf0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f07b99640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f00196350 con 0x7f0f000feaf0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f05134640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f05134640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00195c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45146/0 (socket says 172.21.15.49:45146) 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f05134640 1 -- 172.21.15.49:0/3788507376 learned_addr learned my addr 172.21.15.49:0/3788507376 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.340+0000 7f0f05935640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000feaf0 0x7f0f001956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0f05134640 1 -- 172.21.15.49:0/3788507376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000feaf0 msgr2=0x7f0f001956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0f05134640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000feaf0 0x7f0f001956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0f05134640 1 -- 172.21.15.49:0/3788507376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0009560 con 0x7f0f000ffcf0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0f05134640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00195c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0005520 tx=0x7f0ef0005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0ef6ffd640 1 -- 172.21.15.49:0/3788507376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef0004aa0 con 0x7f0f000ffcf0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0019ad90 con 0x7f0f000ffcf0 2024-09-19T09:06:42.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0ef6ffd640 1 -- 172.21.15.49:0/3788507376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ef0004c00 con 0x7f0f000ffcf0 2024-09-19T09:06:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0ef6ffd640 1 -- 172.21.15.49:0/3788507376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef0003b10 con 0x7f0f000ffcf0 2024-09-19T09:06:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.341+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0019b280 con 0x7f0f000ffcf0 2024-09-19T09:06:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.342+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f00107700 con 0x7f0f000ffcf0 2024-09-19T09:06:42.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.343+0000 7f0ef6ffd640 1 -- 172.21.15.49:0/3788507376 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0ef0003c70 con 0x7f0f000ffcf0 2024-09-19T09:06:42.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.344+0000 7f0ef6ffd640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0eec06e5f0 0x7f0eec070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.344+0000 7f0ef6ffd640 1 -- 172.21.15.49:0/3788507376 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0ef00af730 con 0x7f0f000ffcf0 2024-09-19T09:06:42.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.344+0000 7f0f05935640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0eec06e5f0 0x7f0eec070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.344+0000 7f0f05935640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0eec06e5f0 0x7f0eec070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0efc005fd0 tx=0x7f0efc00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.348+0000 7f0ef6ffd640 1 -- 172.21.15.49:0/3788507376 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0ef00789b0 con 0x7f0f000ffcf0 2024-09-19T09:06:42.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.545+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f0019b4c0 con 0x7f0eec06e5f0 2024-09-19T09:06:42.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:42 smithi049 ceph-mon[91793]: pgmap v69: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:42.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:42 smithi049 ceph-mon[91793]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:42.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:42 smithi049 ceph-mon[91793]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:42.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:42 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/888779606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:42.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:42 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3054010291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.547+0000 7f0ef6ffd640 1 -- 172.21.15.49:0/3788507376 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0f0019b4c0 con 0x7f0eec06e5f0 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:06:42.548 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:06:42.549 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:06:42.549 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:06:42.549 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "8/23 daemons upgraded", 2024-09-19T09:06:42.549 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:06:42.549 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:06:42.549 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:06:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0eec06e5f0 msgr2=0x7f0eec070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0eec06e5f0 0x7f0eec070ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0efc005fd0 tx=0x7f0efc00b390 comp rx=0 tx=0).stop 2024-09-19T09:06:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 msgr2=0x7f0f00195c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00195c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0005520 tx=0x7f0ef0005550 comp rx=0 tx=0).stop 2024-09-19T09:06:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 shutdown_connections 2024-09-19T09:06:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0eec06e5f0 0x7f0eec070ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f000ffcf0 0x7f0f00195c10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 --2- 172.21.15.49:0/3788507376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f000feaf0 0x7f0f001956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 >> 172.21.15.49:0/3788507376 conn(0x7f0f000fa280 msgr2=0x7f0f00067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 shutdown_connections 2024-09-19T09:06:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.549+0000 7f0f07b99640 1 -- 172.21.15.49:0/3788507376 wait complete. 2024-09-19T09:06:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 -- 172.21.15.49:0/2235835740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00feaf0 msgr2=0x7f27f00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2235835740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00feaf0 0x7f27f00feef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009880 tx=0x7f27e002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 -- 172.21.15.49:0/2235835740 shutdown_connections 2024-09-19T09:06:42.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2235835740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f00ffcf0 0x7f27f0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2235835740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00feaf0 0x7f27f00feef0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 -- 172.21.15.49:0/2235835740 >> 172.21.15.49:0/2235835740 conn(0x7f27f00fa280 msgr2=0x7f27f00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 -- 172.21.15.49:0/2235835740 shutdown_connections 2024-09-19T09:06:42.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.637+0000 7f27f60d0640 1 -- 172.21.15.49:0/2235835740 wait complete. 2024-09-19T09:06:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27f60d0640 1 Processor -- start 2024-09-19T09:06:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27f60d0640 1 -- start start 2024-09-19T09:06:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27f60d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f00feaf0 0x7f27f0068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27f60d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00ffcf0 0x7f27f019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27f60d0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0196290 con 0x7f27f00ffcf0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27f60d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f019cd60 con 0x7f27f00feaf0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27eeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00ffcf0 0x7f27f019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27eeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00ffcf0 0x7f27f019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45174/0 (socket says 172.21.15.49:45174) 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27ef7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f00feaf0 0x7f27f0068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.638+0000 7f27eeffd640 1 -- 172.21.15.49:0/2548332736 learned_addr learned my addr 172.21.15.49:0/2548332736 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27ef7fe640 1 -- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00ffcf0 msgr2=0x7f27f019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27ef7fe640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00ffcf0 0x7f27f019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27ef7fe640 1 -- 172.21.15.49:0/2548332736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009560 con 0x7f27f00feaf0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27eeffd640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00ffcf0 0x7f27f019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27ef7fe640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f00feaf0 0x7f27f0068790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27e002a9c0 tx=0x7f27e00055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27ecff9640 1 -- 172.21.15.49:0/2548332736 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e0004aa0 con 0x7f27f00feaf0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f019cf90 con 0x7f27f00feaf0 2024-09-19T09:06:42.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27ecff9640 1 -- 172.21.15.49:0/2548332736 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27e0005d50 con 0x7f27f00feaf0 2024-09-19T09:06:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27ecff9640 1 -- 172.21.15.49:0/2548332736 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e0003990 con 0x7f27f00feaf0 2024-09-19T09:06:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.639+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f019d3f0 con 0x7f27f00feaf0 2024-09-19T09:06:42.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.640+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f018e690 con 0x7f27f00feaf0 2024-09-19T09:06:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.641+0000 7f27ecff9640 1 -- 172.21.15.49:0/2548332736 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f27e0031b90 con 0x7f27f00feaf0 2024-09-19T09:06:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.641+0000 7f27ecff9640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f27d806e5f0 0x7f27d8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.641+0000 7f27ecff9640 1 -- 172.21.15.49:0/2548332736 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f27e00af6b0 con 0x7f27f00feaf0 2024-09-19T09:06:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.641+0000 7f27eeffd640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f27d806e5f0 0x7f27d8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:42.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.642+0000 7f27eeffd640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f27d806e5f0 0x7f27d8070ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27f0068d10 tx=0x7f27e4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:42.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.646+0000 7f27ecff9640 1 -- 172.21.15.49:0/2548332736 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f27e00788b0 con 0x7f27f00feaf0 2024-09-19T09:06:42.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:42 smithi102 ceph-mon[80875]: pgmap v69: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:42.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:42 smithi102 ceph-mon[80875]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:42.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:42 smithi102 ceph-mon[80875]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:42.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:42 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/888779606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:42.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:42 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3054010291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:06:42.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.922+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f27f002c480 con 0x7f27f00feaf0 2024-09-19T09:06:42.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.923+0000 7f27ecff9640 1 -- 172.21.15.49:0/2548332736 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1294 (secure 0 0 0) 0x7f27e007bf70 con 0x7f27f00feaf0 2024-09-19T09:06:42.924 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded 2024-09-19T09:06:42.924 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:06:42.924 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:06:42.924 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:06:42.924 INFO:teuthology.orchestra.run.smithi049.stdout: osd.1 (root=default,host=smithi049) is down 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-19T09:06:42.925 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-19T09:06:42.926 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-19T09:06:42.926 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-19T09:06:42.926 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-19T09:06:42.926 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-19T09:06:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f27d806e5f0 msgr2=0x7f27d8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f27d806e5f0 0x7f27d8070ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27f0068d10 tx=0x7f27e4005f90 comp rx=0 tx=0).stop 2024-09-19T09:06:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f00feaf0 msgr2=0x7f27f0068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f00feaf0 0x7f27f0068790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27e002a9c0 tx=0x7f27e00055a0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 shutdown_connections 2024-09-19T09:06:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f27d806e5f0 0x7f27d8070ab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27f00ffcf0 0x7f27f019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 --2- 172.21.15.49:0/2548332736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27f00feaf0 0x7f27f0068790 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 >> 172.21.15.49:0/2548332736 conn(0x7f27f00fa280 msgr2=0x7f27f01033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 shutdown_connections 2024-09-19T09:06:42.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:06:42.926+0000 7f27f60d0640 1 -- 172.21.15.49:0/2548332736 wait complete. 2024-09-19T09:06:43.146 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:43 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[106359]: 2024-09-19T09:06:43.010+0000 7f758fd88640 -1 osd.1 54 log_to_monitors true 2024-09-19T09:06:43.441 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:43 smithi049 ceph-mon[91793]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:43.441 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:43.441 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:43.441 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:43 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2548332736' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:06:43.441 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:43 smithi049 ceph-mon[91793]: from='osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:06:43.716 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:06:43 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[106359]: 2024-09-19T09:06:43.538+0000 7f7583b1a640 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:06:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:43 smithi102 ceph-mon[80875]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:43 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2548332736' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:06:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:43 smithi102 ceph-mon[80875]: from='osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:06:44.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:44 smithi102 ceph-mon[80875]: pgmap v70: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:44 smithi102 ceph-mon[80875]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:44 smithi102 ceph-mon[80875]: from='osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:06:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:44 smithi102 ceph-mon[80875]: osdmap e57: 6 total, 5 up, 6 in 2024-09-19T09:06:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:44 smithi102 ceph-mon[80875]: from='osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:06:44.759 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:44 smithi049 ceph-mon[91793]: pgmap v70: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:44.759 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:44 smithi049 ceph-mon[91793]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:06:44.759 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:44 smithi049 ceph-mon[91793]: from='osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:06:44.760 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:44 smithi049 ceph-mon[91793]: osdmap e57: 6 total, 5 up, 6 in 2024-09-19T09:06:44.760 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:44 smithi049 ceph-mon[91793]: from='osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912] boot 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: osdmap e58: 6 total, 6 up, 6 in 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:45.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:45.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:45.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:45.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:45.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:45.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: osd.1 [v2:172.21.15.49:6810/3655232912,v1:172.21.15.49:6811/3655232912] boot 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: osdmap e58: 6 total, 6 up, 6 in 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:45.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:45.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:45.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:45.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:06:45.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:06:46.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:46 smithi102 ceph-mon[80875]: pgmap v72: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:46 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:06:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:46 smithi102 ceph-mon[80875]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-19T09:06:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:46 smithi102 ceph-mon[80875]: osdmap e59: 6 total, 6 up, 6 in 2024-09-19T09:06:46.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:46 smithi049 ceph-mon[91793]: pgmap v72: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:46 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:06:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:46 smithi049 ceph-mon[91793]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-19T09:06:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:46 smithi049 ceph-mon[91793]: osdmap e59: 6 total, 6 up, 6 in 2024-09-19T09:06:48.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:48 smithi102 ceph-mon[80875]: pgmap v75: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:48.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:48 smithi049 ceph-mon[91793]: pgmap v75: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/321 objects degraded (14.330%) 2024-09-19T09:06:49.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:49 smithi102 ceph-mon[80875]: Health check update: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T09:06:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:49 smithi049 ceph-mon[91793]: Health check update: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T09:06:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:50 smithi102 ceph-mon[80875]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 24/321 objects degraded (7.477%) 2024-09-19T09:06:50.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:50 smithi049 ceph-mon[91793]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 24/321 objects degraded (7.477%) 2024-09-19T09:06:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:51 smithi102 ceph-mon[80875]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:06:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:51 smithi102 ceph-mon[80875]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded) 2024-09-19T09:06:51.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:51 smithi049 ceph-mon[91793]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:06:51.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:51 smithi049 ceph-mon[91793]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded) 2024-09-19T09:06:53.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:53 smithi049 ceph-mon[91793]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:06:54.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:53 smithi102 ceph-mon[80875]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-19T09:06:55.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:55 smithi049 ceph-mon[91793]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-19T09:06:56.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:55 smithi102 ceph-mon[80875]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-19T09:06:57.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:57 smithi049 ceph-mon[91793]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:06:57.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:57.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:57.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:58.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:57 smithi102 ceph-mon[80875]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:06:58.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:58.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:06:58.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:06:59.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:06:59 smithi049 ceph-mon[91793]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T09:07:00.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:06:59 smithi102 ceph-mon[80875]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T09:07:00.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:07:00.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:00 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:07:00.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:00 smithi049 ceph-mon[91793]: Upgrade: osd.2 is safe to restart 2024-09-19T09:07:01.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:07:01.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:00 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T09:07:01.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:00 smithi102 ceph-mon[80875]: Upgrade: osd.2 is safe to restart 2024-09-19T09:07:02.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:02 smithi102 ceph-mon[80875]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:07:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:02 smithi102 ceph-mon[80875]: Upgrade: Updating osd.2 2024-09-19T09:07:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:02 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:02 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:07:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:02 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:02 smithi102 ceph-mon[80875]: Deploying daemon osd.2 on smithi049 2024-09-19T09:07:02.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:02 smithi049 ceph-mon[91793]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:07:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:02 smithi049 ceph-mon[91793]: Upgrade: Updating osd.2 2024-09-19T09:07:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:02 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:02 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:07:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:02 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:02 smithi049 ceph-mon[91793]: Deploying daemon osd.2 on smithi049 2024-09-19T09:07:04.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:04 smithi102 ceph-mon[80875]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:07:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:04 smithi049 ceph-mon[91793]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:07:04.804 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:04 smithi049 systemd[1]: Stopping Ceph osd.2 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:07:05.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:04 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[62047]: 2024-09-19T09:07:04.810+0000 7f8776c29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:05.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:04 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[62047]: 2024-09-19T09:07:04.810+0000 7f8776c29640 -1 osd.2 59 *** Got signal Terminated *** 2024-09-19T09:07:05.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:04 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[62047]: 2024-09-19T09:07:04.810+0000 7f8776c29640 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:07:05.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:05 smithi102 ceph-mon[80875]: osd.2 marked itself down and dead 2024-09-19T09:07:05.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:05 smithi049 ceph-mon[91793]: osd.2 marked itself down and dead 2024-09-19T09:07:06.248 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:05 smithi049 podman[111730]: 2024-09-19 09:07:05.967650917 +0000 UTC m=+1.314297823 container died 027b84586c585b1d7cecc1201f248d66e8b925f6387fb41aac7ddfa3ccfcbd85 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:07:06.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:06 smithi049 ceph-mon[91793]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:07:06.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:06 smithi049 ceph-mon[91793]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:07:06.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:06 smithi049 ceph-mon[91793]: osdmap e60: 6 total, 5 up, 6 in 2024-09-19T09:07:06.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:06 smithi049 podman[111730]: 2024-09-19 09:07:06.347559519 +0000 UTC m=+1.694206408 container cleanup 027b84586c585b1d7cecc1201f248d66e8b925f6387fb41aac7ddfa3ccfcbd85 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:07:06.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:06 smithi049 bash[111730]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:07:06.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:06 smithi102 ceph-mon[80875]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:07:06.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:06 smithi102 ceph-mon[80875]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:07:06.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:06 smithi102 ceph-mon[80875]: osdmap e60: 6 total, 5 up, 6 in 2024-09-19T09:07:06.933 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:06 smithi049 podman[111748]: 2024-09-19 09:07:06.599187211 +0000 UTC m=+0.632885617 container remove 027b84586c585b1d7cecc1201f248d66e8b925f6387fb41aac7ddfa3ccfcbd85 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:07:07.195 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:06 smithi049 podman[111834]: 2024-09-19 09:07:06.933428584 +0000 UTC m=+0.110903868 container create 4a578b81b2a30866d50a3a1e625cdfa1c3fb5009aef48d60089c4546ea548350 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:07:07.195 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:06 smithi049 podman[111834]: 2024-09-19 09:07:06.83922084 +0000 UTC m=+0.016696132 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:07.195 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:07 smithi049 podman[111834]: 2024-09-19 09:07:07.194713088 +0000 UTC m=+0.372188384 container init 4a578b81b2a30866d50a3a1e625cdfa1c3fb5009aef48d60089c4546ea548350 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:07:07.468 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:07 smithi049 podman[111834]: 2024-09-19 09:07:07.198674428 +0000 UTC m=+0.376149720 container start 4a578b81b2a30866d50a3a1e625cdfa1c3fb5009aef48d60089c4546ea548350 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:07:07.468 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:07 smithi049 podman[111834]: 2024-09-19 09:07:07.261051122 +0000 UTC m=+0.438526413 container attach 4a578b81b2a30866d50a3a1e625cdfa1c3fb5009aef48d60089c4546ea548350 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:07:07.468 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:07 smithi049 podman[111834]: 2024-09-19 09:07:07.391035856 +0000 UTC m=+0.568511141 container died 4a578b81b2a30866d50a3a1e625cdfa1c3fb5009aef48d60089c4546ea548350 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:07:07.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:07 smithi102 ceph-mon[80875]: osdmap e61: 6 total, 5 up, 6 in 2024-09-19T09:07:07.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:07 smithi049 ceph-mon[91793]: osdmap e61: 6 total, 5 up, 6 in 2024-09-19T09:07:08.266 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 podman[111857]: 2024-09-19 09:07:08.015026535 +0000 UTC m=+0.613504718 container remove 4a578b81b2a30866d50a3a1e625cdfa1c3fb5009aef48d60089c4546ea548350 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:07:08.266 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-19T09:07:08.266 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 systemd[1]: Stopped Ceph osd.2 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:07:08.266 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.2.service: Consumed 52.559s CPU time. 2024-09-19T09:07:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:08 smithi049 ceph-mon[91793]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-19T09:07:08.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 systemd[1]: Starting Ceph osd.2 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:07:08.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 podman[111958]: 2024-09-19 09:07:08.474379587 +0000 UTC m=+0.108860783 container create 481dd2fbf10590a3cc4b755cf135bf2cfb0c0500bb0609a8c07722b12d0a7f20 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T09:07:08.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 podman[111958]: 2024-09-19 09:07:08.381804885 +0000 UTC m=+0.016286099 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:08.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:08 smithi102 ceph-mon[80875]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-19T09:07:08.889 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 podman[111958]: 2024-09-19 09:07:08.752588574 +0000 UTC m=+0.387069776 container init 481dd2fbf10590a3cc4b755cf135bf2cfb0c0500bb0609a8c07722b12d0a7f20 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T09:07:08.889 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 podman[111958]: 2024-09-19 09:07:08.756242873 +0000 UTC m=+0.390724076 container start 481dd2fbf10590a3cc4b755cf135bf2cfb0c0500bb0609a8c07722b12d0a7f20 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:07:08.889 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 podman[111958]: 2024-09-19 09:07:08.82733991 +0000 UTC m=+0.461821122 container attach 481dd2fbf10590a3cc4b755cf135bf2cfb0c0500bb0609a8c07722b12d0a7f20 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:07:09.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:09.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 bash[111958]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:09.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:09.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:08 smithi049 bash[111958]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:09.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-mon[91793]: pgmap v88: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 27/321 objects degraded (8.411%) 2024-09-19T09:07:09.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-mon[91793]: Health check failed: Degraded data redundancy: 27/321 objects degraded (8.411%), 10 pgs degraded (PG_DEGRADED) 2024-09-19T09:07:09.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:07:09.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 bash[111958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:07:09.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:07:09.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 bash[111958]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:07:10.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:09 smithi102 ceph-mon[80875]: pgmap v88: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 27/321 objects degraded (8.411%) 2024-09-19T09:07:10.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:09 smithi102 ceph-mon[80875]: Health check failed: Degraded data redundancy: 27/321 objects degraded (8.411%), 10 pgs degraded (PG_DEGRADED) 2024-09-19T09:07:10.256 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 bash[111958]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 bash[111958]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 bash[111958]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 bash[111958]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate[111973]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 bash[111958]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-19T09:07:10.257 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:09 smithi049 podman[111958]: 2024-09-19 09:07:09.944806667 +0000 UTC m=+1.579287865 container died 481dd2fbf10590a3cc4b755cf135bf2cfb0c0500bb0609a8c07722b12d0a7f20 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T09:07:10.890 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:10 smithi049 podman[112108]: 2024-09-19 09:07:10.565102592 +0000 UTC m=+0.613856861 container remove 481dd2fbf10590a3cc4b755cf135bf2cfb0c0500bb0609a8c07722b12d0a7f20 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T09:07:10.890 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:10 smithi049 podman[112166]: 2024-09-19 09:07:10.77425944 +0000 UTC m=+0.112097978 container create 72e20f7003f6100cafaa8740ed7736b7dd934374c2c85c0a94773475f8b012ec (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T09:07:10.890 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:10 smithi049 podman[112166]: 2024-09-19 09:07:10.678588941 +0000 UTC m=+0.016427443 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:11.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:11 smithi049 podman[112166]: 2024-09-19 09:07:11.001591349 +0000 UTC m=+0.339429842 container init 72e20f7003f6100cafaa8740ed7736b7dd934374c2c85c0a94773475f8b012ec (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:07:11.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:11 smithi049 podman[112166]: 2024-09-19 09:07:11.004865818 +0000 UTC m=+0.342704311 container start 72e20f7003f6100cafaa8740ed7736b7dd934374c2c85c0a94773475f8b012ec (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:07:11.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:11 smithi049 ceph-osd[112184]: -- 172.21.15.49:0/4167799224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c653961e0 con 0x564c64543c00 2024-09-19T09:07:11.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:11 smithi049 bash[112166]: 72e20f7003f6100cafaa8740ed7736b7dd934374c2c85c0a94773475f8b012ec 2024-09-19T09:07:11.303 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:11 smithi049 systemd[1]: Started Ceph osd.2 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:07:12.499 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:12 smithi049 ceph-mon[91793]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:12.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:12.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:12.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:12.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:12 smithi102 ceph-mon[80875]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:13.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.023+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/3838794628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 msgr2=0x7f3b240fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.023+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/3838794628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b240fffa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009880 tx=0x7f3b1402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.023+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/3838794628 shutdown_connections 2024-09-19T09:07:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.023+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/3838794628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b24100da0 0x7f3b24101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.023+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/3838794628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b240fffa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.023+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/3838794628 >> 172.21.15.49:0/3838794628 conn(0x7f3b240fb330 msgr2=0x7f3b240fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.024+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/3838794628 shutdown_connections 2024-09-19T09:07:13.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.024+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/3838794628 wait complete. 2024-09-19T09:07:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.025+0000 7f3b2a6cd640 1 Processor -- start 2024-09-19T09:07:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.025+0000 7f3b2a6cd640 1 -- start start 2024-09-19T09:07:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.025+0000 7f3b2a6cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b24074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.025+0000 7f3b2a6cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b24100da0 0x7f3b240728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.025+0000 7f3b2a6cd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24072de0 con 0x7f3b240ffba0 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.025+0000 7f3b2a6cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24072f50 con 0x7f3b24100da0 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b24074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b23fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b24074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50348/0 (socket says 172.21.15.49:50348) 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b23fff640 1 -- 172.21.15.49:0/1481974023 learned_addr learned my addr 172.21.15.49:0/1481974023 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b237fe640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b24100da0 0x7f3b240728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b23fff640 1 -- 172.21.15.49:0/1481974023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b24100da0 msgr2=0x7f3b240728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b23fff640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b24100da0 0x7f3b240728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b23fff640 1 -- 172.21.15.49:0/1481974023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14009560 con 0x7f3b240ffba0 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b237fe640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b24100da0 0x7f3b240728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:13.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.026+0000 7f3b23fff640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b24074200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b1402a9c0 tx=0x7f3b140055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.027+0000 7f3b217fa640 1 -- 172.21.15.49:0/1481974023 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b14004aa0 con 0x7f3b240ffba0 2024-09-19T09:07:13.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.027+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b240731d0 con 0x7f3b240ffba0 2024-09-19T09:07:13.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.027+0000 7f3b217fa640 1 -- 172.21.15.49:0/1481974023 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b14005d50 con 0x7f3b240ffba0 2024-09-19T09:07:13.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.027+0000 7f3b217fa640 1 -- 172.21.15.49:0/1481974023 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b140039b0 con 0x7f3b240ffba0 2024-09-19T09:07:13.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.027+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2419d690 con 0x7f3b240ffba0 2024-09-19T09:07:13.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.028+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b240fffa0 con 0x7f3b240ffba0 2024-09-19T09:07:13.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.028+0000 7f3b217fa640 1 -- 172.21.15.49:0/1481974023 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3b14003c70 con 0x7f3b240ffba0 2024-09-19T09:07:13.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.029+0000 7f3b217fa640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3b0c06e600 0x7f3b0c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.029+0000 7f3b217fa640 1 -- 172.21.15.49:0/1481974023 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3b140af710 con 0x7f3b240ffba0 2024-09-19T09:07:13.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.029+0000 7f3b237fe640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3b0c06e600 0x7f3b0c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.030+0000 7f3b237fe640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3b0c06e600 0x7f3b0c070ac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b24073f80 tx=0x7f3b18005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.034+0000 7f3b217fa640 1 -- 172.21.15.49:0/1481974023 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3b14078910 con 0x7f3b240ffba0 2024-09-19T09:07:13.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.236+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b240608f0 con 0x7f3b0c06e600 2024-09-19T09:07:13.237 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:12 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[112180]: 2024-09-19T09:07:12.878+0000 7f2e87fb8640 -1 Falling back to public interface 2024-09-19T09:07:13.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.237+0000 7f3b217fa640 1 -- 172.21.15.49:0/1481974023 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3b240608f0 con 0x7f3b0c06e600 2024-09-19T09:07:13.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3b0c06e600 msgr2=0x7f3b0c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3b0c06e600 0x7f3b0c070ac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b24073f80 tx=0x7f3b18005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 msgr2=0x7f3b24074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b24074200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b1402a9c0 tx=0x7f3b140055a0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 shutdown_connections 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3b0c06e600 0x7f3b0c070ac0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b24100da0 0x7f3b240728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 --2- 172.21.15.49:0/1481974023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b240ffba0 0x7f3b24074200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.239+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 >> 172.21.15.49:0/1481974023 conn(0x7f3b240fb330 msgr2=0x7f3b24104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.240+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 shutdown_connections 2024-09-19T09:07:13.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.240+0000 7f3b2a6cd640 1 -- 172.21.15.49:0/1481974023 wait complete. 2024-09-19T09:07:13.250 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:07:13.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 -- 172.21.15.49:0/58049822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 msgr2=0x7fd640101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 --2- 172.21.15.49:0/58049822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640101590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009880 tx=0x7fd63c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 -- 172.21.15.49:0/58049822 shutdown_connections 2024-09-19T09:07:13.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 --2- 172.21.15.49:0/58049822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd640101b60 0x7fd6400fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 --2- 172.21.15.49:0/58049822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640101590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 -- 172.21.15.49:0/58049822 >> 172.21.15.49:0/58049822 conn(0x7fd6400f99c0 msgr2=0x7fd6400fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 -- 172.21.15.49:0/58049822 shutdown_connections 2024-09-19T09:07:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 -- 172.21.15.49:0/58049822 wait complete. 2024-09-19T09:07:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 Processor -- start 2024-09-19T09:07:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.328+0000 7fd647c24640 1 -- start start 2024-09-19T09:07:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd647c24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd647c24640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd640101b60 0x7fd640195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd647c24640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd640196130 con 0x7fd640101190 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd647c24640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6401962a0 con 0x7fd640101b60 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6459c0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6459c0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640195620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50370/0 (socket says 172.21.15.49:50370) 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6459c0640 1 -- 172.21.15.49:0/1931921617 learned_addr learned my addr 172.21.15.49:0/1931921617 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6451bf640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd640101b60 0x7fd640195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6459c0640 1 -- 172.21.15.49:0/1931921617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd640101b60 msgr2=0x7fd640195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6459c0640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd640101b60 0x7fd640195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6459c0640 1 -- 172.21.15.49:0/1931921617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c009560 con 0x7fd640101190 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd6459c0640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640195620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd63c005610 tx=0x7fd63c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.329+0000 7fd636ffd640 1 -- 172.21.15.49:0/1931921617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63c004ba0 con 0x7fd640101190 2024-09-19T09:07:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.330+0000 7fd636ffd640 1 -- 172.21.15.49:0/1931921617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd63c004d00 con 0x7fd640101190 2024-09-19T09:07:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.330+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64019ace0 con 0x7fd640101190 2024-09-19T09:07:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.330+0000 7fd636ffd640 1 -- 172.21.15.49:0/1931921617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63c003bd0 con 0x7fd640101190 2024-09-19T09:07:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.330+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64019b200 con 0x7fd640101190 2024-09-19T09:07:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.331+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64018f730 con 0x7fd640101190 2024-09-19T09:07:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.331+0000 7fd636ffd640 1 -- 172.21.15.49:0/1931921617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd63c031640 con 0x7fd640101190 2024-09-19T09:07:13.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.332+0000 7fd636ffd640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd62c06e5f0 0x7fd62c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.332+0000 7fd636ffd640 1 -- 172.21.15.49:0/1931921617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd63c0af960 con 0x7fd640101190 2024-09-19T09:07:13.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.332+0000 7fd6451bf640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd62c06e5f0 0x7fd62c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.333+0000 7fd6451bf640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd62c06e5f0 0x7fd62c070ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd640196b40 tx=0x7fd63000a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.336+0000 7fd636ffd640 1 -- 172.21.15.49:0/1931921617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd63c078b60 con 0x7fd640101190 2024-09-19T09:07:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.534+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd64002c5d0 con 0x7fd62c06e5f0 2024-09-19T09:07:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.535+0000 7fd636ffd640 1 -- 172.21.15.49:0/1931921617 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd64002c5d0 con 0x7fd62c06e5f0 2024-09-19T09:07:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd62c06e5f0 msgr2=0x7fd62c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd62c06e5f0 0x7fd62c070ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd640196b40 tx=0x7fd63000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 msgr2=0x7fd640195620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640195620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd63c005610 tx=0x7fd63c005640 comp rx=0 tx=0).stop 2024-09-19T09:07:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 shutdown_connections 2024-09-19T09:07:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd62c06e5f0 0x7fd62c070ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd640101b60 0x7fd640195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 --2- 172.21.15.49:0/1931921617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd640101190 0x7fd640195620 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 >> 172.21.15.49:0/1931921617 conn(0x7fd6400f99c0 msgr2=0x7fd640104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 shutdown_connections 2024-09-19T09:07:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.538+0000 7fd647c24640 1 -- 172.21.15.49:0/1931921617 wait complete. 2024-09-19T09:07:13.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 -- 172.21.15.49:0/2373308912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc670100d80 msgr2=0x7fc670101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 --2- 172.21.15.49:0/2373308912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc670100d80 0x7fc670101200 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc664009880 tx=0x7fc66402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 -- 172.21.15.49:0/2373308912 shutdown_connections 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 --2- 172.21.15.49:0/2373308912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc670100d80 0x7fc670101200 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 --2- 172.21.15.49:0/2373308912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6700ffb80 0x7fc6700fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 -- 172.21.15.49:0/2373308912 >> 172.21.15.49:0/2373308912 conn(0x7fc6700fb330 msgr2=0x7fc6700fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 -- 172.21.15.49:0/2373308912 shutdown_connections 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.621+0000 7fc677097640 1 -- 172.21.15.49:0/2373308912 wait complete. 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc677097640 1 Processor -- start 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc677097640 1 -- start start 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc677097640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6700ffb80 0x7fc670074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc677097640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc670100d80 0x7fc6700728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc677097640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc670074790 con 0x7fc6700ffb80 2024-09-19T09:07:13.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc677097640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc670072e10 con 0x7fc670100d80 2024-09-19T09:07:13.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc674e33640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6700ffb80 0x7fc670074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc674e33640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6700ffb80 0x7fc670074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50382/0 (socket says 172.21.15.49:50382) 2024-09-19T09:07:13.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.622+0000 7fc674e33640 1 -- 172.21.15.49:0/1784272246 learned_addr learned my addr 172.21.15.49:0/1784272246 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:13.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc66ffff640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc670100d80 0x7fc6700728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc674e33640 1 -- 172.21.15.49:0/1784272246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc670100d80 msgr2=0x7fc6700728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc674e33640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc670100d80 0x7fc6700728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc674e33640 1 -- 172.21.15.49:0/1784272246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664009560 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc66ffff640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc670100d80 0x7fc6700728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc674e33640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6700ffb80 0x7fc670074250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c8f0 tx=0x7fc66000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc66dffb640 1 -- 172.21.15.49:0/1784272246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6600041f0 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc66dffb640 1 -- 172.21.15.49:0/1784272246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc660007e10 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6700730f0 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc66dffb640 1 -- 172.21.15.49:0/1784272246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc66000f450 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.623+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc670073690 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.624+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6700fff80 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.625+0000 7fc66dffb640 1 -- 172.21.15.49:0/1784272246 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc660007950 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.625+0000 7fc66dffb640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc65806e5f0 0x7fc658070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.625+0000 7fc66dffb640 1 -- 172.21.15.49:0/1784272246 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc660013070 con 0x7fc6700ffb80 2024-09-19T09:07:13.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.625+0000 7fc66ffff640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc65806e5f0 0x7fc658070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.626+0000 7fc66ffff640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc65806e5f0 0x7fc658070ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc6640314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.630+0000 7fc66dffb640 1 -- 172.21.15.49:0/1784272246 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc660057950 con 0x7fc6700ffb80 2024-09-19T09:07:13.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:13 smithi049 ceph-mon[91793]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:13 smithi049 ceph-mon[91793]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:13.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.826+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc67002c4f0 con 0x7fc65806e5f0 2024-09-19T09:07:13.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.835+0000 7fc66dffb640 1 -- 172.21.15.49:0/1784272246 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fc67002c4f0 con 0x7fc65806e5f0 2024-09-19T09:07:13.836 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (11m) 33s ago 12m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (12m) 33s ago 12m 8879k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (12m) 90s ago 12m 8120k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (98s) 33s ago 12m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (94s) 90s ago 11m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (11m) 33s ago 12m 85.1M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (7m) 33s ago 7m 92.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (7m) 33s ago 7m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (7m) 90s ago 7m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (7m) 90s ago 7m 27.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (4m) 33s ago 14m 496M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:07:13.837 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (3m) 90s ago 11m 439M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (2m) 33s ago 14m 47.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (2m) 90s ago 11m 32.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (12m) 33s ago 12m 15.7M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (11m) 90s ago 11m 16.7M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (74s) 33s ago 10m 83.2M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (38s) 33s ago 10m 11.5M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 starting - - - 1216M 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (9m) 90s ago 9m 245M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 25f0ffe7a471 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (9m) 90s ago 9m 216M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (8m) 90s ago 8m 209M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:07:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (3m) 33s ago 12m 59.9M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:07:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc65806e5f0 msgr2=0x7fc658070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc65806e5f0 0x7fc658070ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc6640314e0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6700ffb80 msgr2=0x7fc670074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6700ffb80 0x7fc670074250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c8f0 tx=0x7fc66000cdb0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 shutdown_connections 2024-09-19T09:07:13.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc65806e5f0 0x7fc658070ab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc670100d80 0x7fc6700728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 --2- 172.21.15.49:0/1784272246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6700ffb80 0x7fc670074250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 >> 172.21.15.49:0/1784272246 conn(0x7fc6700fb330 msgr2=0x7fc670104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 shutdown_connections 2024-09-19T09:07:13.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.838+0000 7fc677097640 1 -- 172.21.15.49:0/1784272246 wait complete. 2024-09-19T09:07:13.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 -- 172.21.15.49:0/3942780588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 msgr2=0x7f61780fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 --2- 172.21.15.49:0/3942780588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f61780fff90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6168009880 tx=0x7f616802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 -- 172.21.15.49:0/3942780588 shutdown_connections 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 --2- 172.21.15.49:0/3942780588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6178100d90 0x7f6178101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 --2- 172.21.15.49:0/3942780588 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f61780fff90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 -- 172.21.15.49:0/3942780588 >> 172.21.15.49:0/3942780588 conn(0x7f61780fb320 msgr2=0x7f61780fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 -- 172.21.15.49:0/3942780588 shutdown_connections 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.921+0000 7f617d281640 1 -- 172.21.15.49:0/3942780588 wait complete. 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f617d281640 1 Processor -- start 2024-09-19T09:07:13.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f617d281640 1 -- start start 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f617d281640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f6178195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f617d281640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6178100d90 0x7f6178195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f617d281640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6178196180 con 0x7f61780ffb90 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f617d281640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61781962f0 con 0x7f6178100d90 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f6178195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f6178195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50386/0 (socket says 172.21.15.49:50386) 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f6176ffd640 1 -- 172.21.15.49:0/1063476825 learned_addr learned my addr 172.21.15.49:0/1063476825 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f61767fc640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6178100d90 0x7f6178195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f6176ffd640 1 -- 172.21.15.49:0/1063476825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6178100d90 msgr2=0x7f6178195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f6176ffd640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6178100d90 0x7f6178195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.922+0000 7f6176ffd640 1 -- 172.21.15.49:0/1063476825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168009560 con 0x7f61780ffb90 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.923+0000 7f6176ffd640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f6178195670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f616802a9c0 tx=0x7f61680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.923+0000 7f615ffff640 1 -- 172.21.15.49:0/1063476825 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6168004aa0 con 0x7f61780ffb90 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.923+0000 7f615ffff640 1 -- 172.21.15.49:0/1063476825 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6168004c00 con 0x7f61780ffb90 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.923+0000 7f615ffff640 1 -- 172.21.15.49:0/1063476825 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61680039b0 con 0x7f61780ffb90 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.923+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617819ad30 con 0x7f61780ffb90 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.923+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617819b240 con 0x7f61780ffb90 2024-09-19T09:07:13.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.924+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617818f710 con 0x7f61780ffb90 2024-09-19T09:07:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.925+0000 7f615ffff640 1 -- 172.21.15.49:0/1063476825 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6168031c00 con 0x7f61780ffb90 2024-09-19T09:07:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.925+0000 7f615ffff640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f616006e5f0 0x7f6160070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.925+0000 7f615ffff640 1 -- 172.21.15.49:0/1063476825 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f61680af7f0 con 0x7f61780ffb90 2024-09-19T09:07:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.925+0000 7f61767fc640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f616006e5f0 0x7f6160070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.926+0000 7f61767fc640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f616006e5f0 0x7f6160070ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f616c005fd0 tx=0x7f616c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:13.930+0000 7f615ffff640 1 -- 172.21.15.49:0/1063476825 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6168078940 con 0x7f61780ffb90 2024-09-19T09:07:14.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:13 smithi102 ceph-mon[80875]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:14.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:14.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:14.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:13 smithi102 ceph-mon[80875]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:14.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.186+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f617802c520 con 0x7f61780ffb90 2024-09-19T09:07:14.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.187+0000 7f615ffff640 1 -- 172.21.15.49:0/1063476825 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7f616807c000 con 0x7f61780ffb90 2024-09-19T09:07:14.188 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:07:14.188 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:07:14.188 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:07:14.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 3, 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 7, 2024-09-19T09:07:14.189 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:07:14.190 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:07:14.190 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:07:14.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f616006e5f0 msgr2=0x7f6160070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f616006e5f0 0x7f6160070ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f616c005fd0 tx=0x7f616c005850 comp rx=0 tx=0).stop 2024-09-19T09:07:14.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 msgr2=0x7f6178195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f6178195670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f616802a9c0 tx=0x7f61680055a0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 shutdown_connections 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f616006e5f0 0x7f6160070ab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6178100d90 0x7f6178195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 --2- 172.21.15.49:0/1063476825 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61780ffb90 0x7f6178195670 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.189+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 >> 172.21.15.49:0/1063476825 conn(0x7f61780fb320 msgr2=0x7f6178104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.190+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 shutdown_connections 2024-09-19T09:07:14.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.190+0000 7f617d281640 1 -- 172.21.15.49:0/1063476825 wait complete. 2024-09-19T09:07:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 -- 172.21.15.49:0/1340481414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa500ffb90 msgr2=0x7ffa500fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1340481414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa500ffb90 0x7ffa500fff90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009880 tx=0x7ffa4002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 -- 172.21.15.49:0/1340481414 shutdown_connections 2024-09-19T09:07:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1340481414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa50100d90 0x7ffa50101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1340481414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa500ffb90 0x7ffa500fff90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 -- 172.21.15.49:0/1340481414 >> 172.21.15.49:0/1340481414 conn(0x7ffa500fb320 msgr2=0x7ffa500fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 -- 172.21.15.49:0/1340481414 shutdown_connections 2024-09-19T09:07:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 -- 172.21.15.49:0/1340481414 wait complete. 2024-09-19T09:07:14.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.274+0000 7ffa55d66640 1 Processor -- start 2024-09-19T09:07:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa55d66640 1 -- start start 2024-09-19T09:07:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa55d66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa500ffb90 0x7ffa50195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa55d66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa50100d90 0x7ffa50195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa55d66640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa501961a0 con 0x7ffa50100d90 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa55d66640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50196310 con 0x7ffa500ffb90 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa50100d90 0x7ffa50195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa50100d90 0x7ffa50195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50394/0 (socket says 172.21.15.49:50394) 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4effd640 1 -- 172.21.15.49:0/1930704923 learned_addr learned my addr 172.21.15.49:0/1930704923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4f7fe640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa500ffb90 0x7ffa50195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4effd640 1 -- 172.21.15.49:0/1930704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa500ffb90 msgr2=0x7ffa50195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4effd640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa500ffb90 0x7ffa50195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4effd640 1 -- 172.21.15.49:0/1930704923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40009560 con 0x7ffa50100d90 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.275+0000 7ffa4f7fe640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa500ffb90 0x7ffa50195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.276+0000 7ffa4effd640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa50100d90 0x7ffa50195bd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c920 tx=0x7ffa4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.276+0000 7ffa4cff9640 1 -- 172.21.15.49:0/1930704923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa44007b80 con 0x7ffa50100d90 2024-09-19T09:07:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.276+0000 7ffa4cff9640 1 -- 172.21.15.49:0/1930704923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa440054e0 con 0x7ffa50100d90 2024-09-19T09:07:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.276+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5019ad60 con 0x7ffa50100d90 2024-09-19T09:07:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.276+0000 7ffa4cff9640 1 -- 172.21.15.49:0/1930704923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa4400f450 con 0x7ffa50100d90 2024-09-19T09:07:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.276+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5019b330 con 0x7ffa50100d90 2024-09-19T09:07:14.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.277+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5018f730 con 0x7ffa50100d90 2024-09-19T09:07:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.277+0000 7ffa4cff9640 1 -- 172.21.15.49:0/1930704923 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ffa44004f60 con 0x7ffa50100d90 2024-09-19T09:07:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.278+0000 7ffa4cff9640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ffa3806e600 0x7ffa38070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.278+0000 7ffa4cff9640 1 -- 172.21.15.49:0/1930704923 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffa4408e4f0 con 0x7ffa50100d90 2024-09-19T09:07:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.278+0000 7ffa4f7fe640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ffa3806e600 0x7ffa38070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.278+0000 7ffa4f7fe640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ffa3806e600 0x7ffa38070ac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa40006010 tx=0x7ffa40004040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.283+0000 7ffa4cff9640 1 -- 172.21.15.49:0/1930704923 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ffa44057640 con 0x7ffa50100d90 2024-09-19T09:07:14.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.499+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffa501089c0 con 0x7ffa50100d90 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.500+0000 7ffa4cff9640 1 -- 172.21.15.49:0/1930704923 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7ffa4405ad00 con 0x7ffa50100d90 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:07:14.501 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:07:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:07:14.503 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:07:14.504 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ffa3806e600 msgr2=0x7ffa38070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ffa3806e600 0x7ffa38070ac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa40006010 tx=0x7ffa40004040 comp rx=0 tx=0).stop 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa50100d90 msgr2=0x7ffa50195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa50100d90 0x7ffa50195bd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c920 tx=0x7ffa4400cde0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 shutdown_connections 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ffa3806e600 0x7ffa38070ac0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa50100d90 0x7ffa50195bd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 --2- 172.21.15.49:0/1930704923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa500ffb90 0x7ffa50195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 >> 172.21.15.49:0/1930704923 conn(0x7ffa500fb320 msgr2=0x7ffa501044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 shutdown_connections 2024-09-19T09:07:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.502+0000 7ffa55d66640 1 -- 172.21.15.49:0/1930704923 wait complete. 2024-09-19T09:07:14.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 -- 172.21.15.49:0/3717865614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc100d90 msgr2=0x7fc3bc101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3717865614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc100d90 0x7fc3bc101210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009880 tx=0x7fc3b002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 -- 172.21.15.49:0/3717865614 shutdown_connections 2024-09-19T09:07:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3717865614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc100d90 0x7fc3bc101210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3717865614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3bc0ffb90 0x7fc3bc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 -- 172.21.15.49:0/3717865614 >> 172.21.15.49:0/3717865614 conn(0x7fc3bc0fb320 msgr2=0x7fc3bc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 -- 172.21.15.49:0/3717865614 shutdown_connections 2024-09-19T09:07:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.599+0000 7fc3c227d640 1 -- 172.21.15.49:0/3717865614 wait complete. 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.600+0000 7fc3c227d640 1 Processor -- start 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.600+0000 7fc3c227d640 1 -- start start 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.600+0000 7fc3c227d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc0ffb90 0x7fc3bc1957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.600+0000 7fc3c227d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3bc195d10 0x7fc3bc19ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.600+0000 7fc3c227d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc196190 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.600+0000 7fc3c227d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc196300 con 0x7fc3bc195d10 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc0ffb90 0x7fc3bc1957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc0ffb90 0x7fc3bc1957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50408/0 (socket says 172.21.15.49:50408) 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bbfff640 1 -- 172.21.15.49:0/3826251011 learned_addr learned my addr 172.21.15.49:0/3826251011 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bb7fe640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3bc195d10 0x7fc3bc19ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bbfff640 1 -- 172.21.15.49:0/3826251011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3bc195d10 msgr2=0x7fc3bc19ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bbfff640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3bc195d10 0x7fc3bc19ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bbfff640 1 -- 172.21.15.49:0/3826251011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009560 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3bbfff640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc0ffb90 0x7fc3bc1957d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00c8f0 tx=0x7fc3ac00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3b97fa640 1 -- 172.21.15.49:0/3826251011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ac007b80 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc19b320 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3b97fa640 1 -- 172.21.15.49:0/3826251011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3ac007ce0 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3b97fa640 1 -- 172.21.15.49:0/3826251011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ac018870 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.601+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc19b870 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.603+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc108780 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.603+0000 7fc3b97fa640 1 -- 172.21.15.49:0/3826251011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc3ac018ae0 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.604+0000 7fc3b97fa640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc3a406e5f0 0x7fc3a4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.604+0000 7fc3b97fa640 1 -- 172.21.15.49:0/3826251011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc3ac08e8a0 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.604+0000 7fc3bb7fe640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc3a406e5f0 0x7fc3a4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.605+0000 7fc3bb7fe640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc3a406e5f0 0x7fc3a4070ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0006010 tx=0x7fc3b00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.609+0000 7fc3b97fa640 1 -- 172.21.15.49:0/3826251011 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc3ac057960 con 0x7fc3bc0ffb90 2024-09-19T09:07:14.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:14 smithi049 ceph-mon[91793]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:14 smithi049 ceph-mon[91793]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:14 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1063476825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:14 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1930704923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.809+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3bc19baf0 con 0x7fc3a406e5f0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.811+0000 7fc3b97fa640 1 -- 172.21.15.49:0/3826251011 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc3bc19baf0 con 0x7fc3a406e5f0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "8/23 daemons upgraded", 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:07:14.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc3a406e5f0 msgr2=0x7fc3a4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc3a406e5f0 0x7fc3a4070ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0006010 tx=0x7fc3b00314e0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc0ffb90 msgr2=0x7fc3bc1957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc0ffb90 0x7fc3bc1957d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00c8f0 tx=0x7fc3ac00cdb0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 shutdown_connections 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc3a406e5f0 0x7fc3a4070ab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3bc195d10 0x7fc3bc19ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 --2- 172.21.15.49:0/3826251011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3bc0ffb90 0x7fc3bc1957d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 >> 172.21.15.49:0/3826251011 conn(0x7fc3bc0fb320 msgr2=0x7fc3bc103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 shutdown_connections 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.813+0000 7fc3c227d640 1 -- 172.21.15.49:0/3826251011 wait complete. 2024-09-19T09:07:14.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3597685477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80ffcf0 msgr2=0x7f5ca8100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3597685477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80ffcf0 0x7f5ca8100170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009880 tx=0x7f5c9c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3597685477 shutdown_connections 2024-09-19T09:07:14.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3597685477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80ffcf0 0x7f5ca8100170 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3597685477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca80feaf0 0x7f5ca80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3597685477 >> 172.21.15.49:0/3597685477 conn(0x7f5ca80fa280 msgr2=0x7f5ca80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3597685477 shutdown_connections 2024-09-19T09:07:14.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.902+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3597685477 wait complete. 2024-09-19T09:07:14.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5cad3fd640 1 Processor -- start 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5cad3fd640 1 -- start start 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5cad3fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80feaf0 0x7f5ca81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5cad3fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca80ffcf0 0x7f5ca8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5cad3fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81983c0 con 0x7f5ca80feaf0 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5cad3fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8198530 con 0x7f5ca80ffcf0 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5ca6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80feaf0 0x7f5ca81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5ca6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80feaf0 0x7f5ca81978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50430/0 (socket says 172.21.15.49:50430) 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.903+0000 7f5ca6ffd640 1 -- 172.21.15.49:0/3636373274 learned_addr learned my addr 172.21.15.49:0/3636373274 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5ca67fc640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca80ffcf0 0x7f5ca8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5ca6ffd640 1 -- 172.21.15.49:0/3636373274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca80ffcf0 msgr2=0x7f5ca8197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5ca6ffd640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca80ffcf0 0x7f5ca8197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5ca6ffd640 1 -- 172.21.15.49:0/3636373274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c009560 con 0x7f5ca80feaf0 2024-09-19T09:07:14.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5ca6ffd640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80feaf0 0x7f5ca81978b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c920 tx=0x7f5c9800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5c8ffff640 1 -- 172.21.15.49:0/3636373274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c98007b80 con 0x7f5ca80feaf0 2024-09-19T09:07:14.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca819cfd0 con 0x7f5ca80feaf0 2024-09-19T09:07:14.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5c8ffff640 1 -- 172.21.15.49:0/3636373274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c98007ce0 con 0x7f5ca80feaf0 2024-09-19T09:07:14.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5c8ffff640 1 -- 172.21.15.49:0/3636373274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c98018770 con 0x7f5ca80feaf0 2024-09-19T09:07:14.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.904+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca819d490 con 0x7f5ca80feaf0 2024-09-19T09:07:14.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.906+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca80feef0 con 0x7f5ca80feaf0 2024-09-19T09:07:14.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.906+0000 7f5c8ffff640 1 -- 172.21.15.49:0/3636373274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5c980213f0 con 0x7f5ca80feaf0 2024-09-19T09:07:14.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.906+0000 7f5c8ffff640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5c9006e5f0 0x7f5c90070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.906+0000 7f5c8ffff640 1 -- 172.21.15.49:0/3636373274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5c9808e6d0 con 0x7f5ca80feaf0 2024-09-19T09:07:14.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.907+0000 7f5ca67fc640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5c9006e5f0 0x7f5c90070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.907+0000 7f5ca67fc640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5c9006e5f0 0x7f5c90070ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c000c00 tx=0x7f5c9c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:14.911+0000 7f5c8ffff640 1 -- 172.21.15.49:0/3636373274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5c98057820 con 0x7f5ca80feaf0 2024-09-19T09:07:15.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:14 smithi102 ceph-mon[80875]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:15.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:14 smithi102 ceph-mon[80875]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:15.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:14 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1063476825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:15.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:14 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1930704923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:07:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.162+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5ca8107970 con 0x7f5ca80feaf0 2024-09-19T09:07:15.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.162+0000 7f5c8ffff640 1 -- 172.21.15.49:0/3636373274 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1186 (secure 0 0 0) 0x7f5c9805aee0 con 0x7f5ca80feaf0 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout: osd.2 (root=default,host=smithi049) is down 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-19T09:07:15.164 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-19T09:07:15.165 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.164+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5c9006e5f0 msgr2=0x7f5c90070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.164+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5c9006e5f0 0x7f5c90070ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c000c00 tx=0x7f5c9c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.164+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80feaf0 msgr2=0x7f5ca81978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.164+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80feaf0 0x7f5ca81978b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800c920 tx=0x7f5c9800cde0 comp rx=0 tx=0).stop 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.165+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 shutdown_connections 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.165+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5c9006e5f0 0x7f5c90070ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.165+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ca80ffcf0 0x7f5ca8197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:15.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.165+0000 7f5cad3fd640 1 --2- 172.21.15.49:0/3636373274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ca80feaf0 0x7f5ca81978b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.165+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 >> 172.21.15.49:0/3636373274 conn(0x7f5ca80fa280 msgr2=0x7f5ca8067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.165+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 shutdown_connections 2024-09-19T09:07:15.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:15.165+0000 7f5cad3fd640 1 -- 172.21.15.49:0/3636373274 wait complete. 2024-09-19T09:07:15.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:15 smithi049 ceph-mon[91793]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:15.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:15 smithi049 ceph-mon[91793]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:15.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:15 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3636373274' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:07:16.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:15 smithi102 ceph-mon[80875]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:16.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:15 smithi102 ceph-mon[80875]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:16.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:15 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3636373274' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:07:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:17 smithi102 ceph-mon[80875]: Health check update: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded (PG_DEGRADED) 2024-09-19T09:07:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:17.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:17.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:17.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:17 smithi049 ceph-mon[91793]: Health check update: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded (PG_DEGRADED) 2024-09-19T09:07:17.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:17.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:18.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:18 smithi049 ceph-mon[91793]: pgmap v92: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:18.548 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:18 smithi049 ceph-mon[91793]: from='osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:07:18.548 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:18 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[112180]: 2024-09-19T09:07:18.169+0000 7f2e87fb8640 -1 osd.2 59 log_to_monitors true 2024-09-19T09:07:18.548 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:07:18 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[112180]: 2024-09-19T09:07:18.279+0000 7f2e7bd4a640 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:07:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:18 smithi102 ceph-mon[80875]: pgmap v92: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:18 smithi102 ceph-mon[80875]: from='osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:07:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:19 smithi049 ceph-mon[91793]: from='osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:07:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:19 smithi049 ceph-mon[91793]: osdmap e62: 6 total, 5 up, 6 in 2024-09-19T09:07:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:19 smithi049 ceph-mon[91793]: from='osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:07:19.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:19 smithi102 ceph-mon[80875]: from='osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:07:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:19 smithi102 ceph-mon[80875]: osdmap e62: 6 total, 5 up, 6 in 2024-09-19T09:07:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:19 smithi102 ceph-mon[80875]: from='osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-09-19T09:07:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: pgmap v94: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:07:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515] boot 2024-09-19T09:07:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: osdmap e63: 6 total, 6 up, 6 in 2024-09-19T09:07:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:07:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:20.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:20.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:20.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:20.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:20 smithi049 ceph-mon[91793]: osdmap e64: 6 total, 6 up, 6 in 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: pgmap v94: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: osd.2 [v2:172.21.15.49:6818/489440515,v1:172.21.15.49:6819/489440515] boot 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: osdmap e63: 6 total, 6 up, 6 in 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:20.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:20.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:20 smithi102 ceph-mon[80875]: osdmap e64: 6 total, 6 up, 6 in 2024-09-19T09:07:21.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:21.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:21.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:21.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:21.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:21.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:21 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:21.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:21 smithi049 ceph-mon[91793]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:07:21.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:21 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:21.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:21 smithi102 ceph-mon[80875]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:07:22.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:22 smithi049 ceph-mon[91793]: pgmap v97: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:22.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:22 smithi102 ceph-mon[80875]: pgmap v97: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:24.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:24 smithi049 ceph-mon[91793]: pgmap v98: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:24.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:24 smithi102 ceph-mon[80875]: pgmap v98: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 42/321 objects degraded (13.084%) 2024-09-19T09:07:25.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:25 smithi102 ceph-mon[80875]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded) 2024-09-19T09:07:25.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:25 smithi049 ceph-mon[91793]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded) 2024-09-19T09:07:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:26 smithi102 ceph-mon[80875]: pgmap v99: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:07:26.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:26 smithi049 ceph-mon[91793]: pgmap v99: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:07:28.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:28 smithi102 ceph-mon[80875]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:07:28.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:28.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:28 smithi049 ceph-mon[91793]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:07:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:30.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:30 smithi049 ceph-mon[91793]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:07:30.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:30 smithi102 ceph-mon[80875]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:07:32.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:32 smithi102 ceph-mon[80875]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-19T09:07:32.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:32 smithi049 ceph-mon[91793]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-19T09:07:33.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:33 smithi049 ceph-mon[91793]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:07:33.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:33 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:34.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:33 smithi102 ceph-mon[80875]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:07:34.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:33 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:35.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:35 smithi049 ceph-mon[91793]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:07:35.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:35.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:35 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:35.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:35 smithi049 ceph-mon[91793]: Upgrade: osd.3 is safe to restart 2024-09-19T09:07:35.888 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:35 smithi102 ceph-mon[80875]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:07:35.888 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:35.888 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:35 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T09:07:35.888 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:35 smithi102 ceph-mon[80875]: Upgrade: osd.3 is safe to restart 2024-09-19T09:07:38.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:37 smithi102 ceph-mon[80875]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:07:38.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:37 smithi102 ceph-mon[80875]: Upgrade: Updating osd.3 2024-09-19T09:07:38.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:37 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:38.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:37 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:07:38.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:37 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:38.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:37 smithi102 ceph-mon[80875]: Deploying daemon osd.3 on smithi102 2024-09-19T09:07:38.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:37 smithi049 ceph-mon[91793]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:07:38.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:37 smithi049 ceph-mon[91793]: Upgrade: Updating osd.3 2024-09-19T09:07:38.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:37 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:38.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:37 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:07:38.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:37 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:38.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:37 smithi049 ceph-mon[91793]: Deploying daemon osd.3 on smithi102 2024-09-19T09:07:39.720 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:39 smithi102 systemd[1]: Stopping Ceph osd.3 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:07:40.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:39 smithi102 ceph-mon[80875]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:07:40.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:39 smithi102 ceph-mon[80875]: osd.3 marked itself down and dead 2024-09-19T09:07:40.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:39 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[41234]: 2024-09-19T09:07:39.718+0000 7fd564627640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:40.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:39 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[41234]: 2024-09-19T09:07:39.718+0000 7fd564627640 -1 osd.3 64 *** Got signal Terminated *** 2024-09-19T09:07:40.010 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:39 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[41234]: 2024-09-19T09:07:39.718+0000 7fd564627640 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:07:40.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:39 smithi049 ceph-mon[91793]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:07:40.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:39 smithi049 ceph-mon[91793]: osd.3 marked itself down and dead 2024-09-19T09:07:40.403 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:40 smithi102 podman[89520]: 2024-09-19 09:07:40.148491756 +0000 UTC m=+0.543516411 container died 25f0ffe7a471092726d9abe0e8aa08c244f219c9f90f5eb880bf8393ab2e370c (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:07:40.758 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:40 smithi102 podman[89520]: 2024-09-19 09:07:40.533298306 +0000 UTC m=+0.928322963 container cleanup 25f0ffe7a471092726d9abe0e8aa08c244f219c9f90f5eb880bf8393ab2e370c (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:07:40.759 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:40 smithi102 bash[89520]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:07:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:40 smithi049 ceph-mon[91793]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:07:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:40 smithi049 ceph-mon[91793]: osdmap e65: 6 total, 5 up, 6 in 2024-09-19T09:07:41.130 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:40 smithi102 ceph-mon[80875]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:07:41.130 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:40 smithi102 ceph-mon[80875]: osdmap e65: 6 total, 5 up, 6 in 2024-09-19T09:07:41.130 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:40 smithi102 podman[89535]: 2024-09-19 09:07:40.771217443 +0000 UTC m=+0.625932352 container remove 25f0ffe7a471092726d9abe0e8aa08c244f219c9f90f5eb880bf8393ab2e370c (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:07:41.433 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:41 smithi102 podman[89635]: 2024-09-19 09:07:41.130415447 +0000 UTC m=+0.113915424 container create 4b005f3ba89c285ef8189454fc1cf2e72f0d9fd4e382f9e0e840efdd62588796 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:07:41.433 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:41 smithi102 podman[89635]: 2024-09-19 09:07:41.038333426 +0000 UTC m=+0.021833402 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:41.433 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:41 smithi102 podman[89635]: 2024-09-19 09:07:41.349966565 +0000 UTC m=+0.333466548 container init 4b005f3ba89c285ef8189454fc1cf2e72f0d9fd4e382f9e0e840efdd62588796 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:07:41.433 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:41 smithi102 podman[89635]: 2024-09-19 09:07:41.354919416 +0000 UTC m=+0.338419401 container start 4b005f3ba89c285ef8189454fc1cf2e72f0d9fd4e382f9e0e840efdd62588796 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:07:41.433 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:41 smithi102 podman[89635]: 2024-09-19 09:07:41.432945735 +0000 UTC m=+0.416445722 container attach 4b005f3ba89c285ef8189454fc1cf2e72f0d9fd4e382f9e0e840efdd62588796 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:07:41.758 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:41 smithi102 podman[89635]: 2024-09-19 09:07:41.547424951 +0000 UTC m=+0.530924929 container died 4b005f3ba89c285ef8189454fc1cf2e72f0d9fd4e382f9e0e840efdd62588796 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:07:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:41 smithi049 ceph-mon[91793]: pgmap v108: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:07:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:41 smithi049 ceph-mon[91793]: osdmap e66: 6 total, 5 up, 6 in 2024-09-19T09:07:42.129 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:41 smithi102 ceph-mon[80875]: pgmap v108: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:07:42.129 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:41 smithi102 ceph-mon[80875]: osdmap e66: 6 total, 5 up, 6 in 2024-09-19T09:07:42.509 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 podman[89660]: 2024-09-19 09:07:42.12922253 +0000 UTC m=+0.575605395 container remove 4b005f3ba89c285ef8189454fc1cf2e72f0d9fd4e382f9e0e840efdd62588796 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:07:42.509 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-19T09:07:42.509 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 systemd[1]: Stopped Ceph osd.3 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:07:42.509 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 1.312s CPU time. 2024-09-19T09:07:42.509 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 systemd[1]: Starting Ceph osd.3 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:07:42.858 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 podman[89762]: 2024-09-19 09:07:42.461762372 +0000 UTC m=+0.015645706 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:42.858 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 podman[89762]: 2024-09-19 09:07:42.58067843 +0000 UTC m=+0.134561751 container create 2601f105efe0972b191f10f3c0b9924ace6bf4a1e2ac5d2c3a6aa617ca1827e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:07:42.858 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 podman[89762]: 2024-09-19 09:07:42.758415395 +0000 UTC m=+0.312298724 container init 2601f105efe0972b191f10f3c0b9924ace6bf4a1e2ac5d2c3a6aa617ca1827e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:07:42.858 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 podman[89762]: 2024-09-19 09:07:42.76299162 +0000 UTC m=+0.316874951 container start 2601f105efe0972b191f10f3c0b9924ace6bf4a1e2ac5d2c3a6aa617ca1827e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:07:42.859 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 podman[89762]: 2024-09-19 09:07:42.858544673 +0000 UTC m=+0.412428009 container attach 2601f105efe0972b191f10f3c0b9924ace6bf4a1e2ac5d2c3a6aa617ca1827e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T09:07:42.859 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-09-19T09:07:42.859 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]: dispatch 2024-09-19T09:07:42.859 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-09-19T09:07:42.859 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]: dispatch 2024-09-19T09:07:42.859 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3, 1, 0]}]: dispatch 2024-09-19T09:07:42.859 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]: dispatch 2024-09-19T09:07:42.859 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:42.860 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]: dispatch 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]: dispatch 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]: dispatch 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3, 1, 0]}]: dispatch 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]: dispatch 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:43.258 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:43.259 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 bash[89762]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:43.259 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:43.259 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:42 smithi102 bash[89762]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:07:43.919 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:07:43.919 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 bash[89762]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:07:43.919 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:07:43.919 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 bash[89762]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]': finished 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]': finished 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3, 1, 0]}]': finished 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]': finished 2024-09-19T09:07:43.920 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-mon[80875]: osdmap e67: 6 total, 5 up, 6 in 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [0, 3]}]': finished 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 5]}]': finished 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]': finished 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 3, 1, 0]}]': finished 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]': finished 2024-09-19T09:07:44.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:43 smithi049 ceph-mon[91793]: osdmap e67: 6 total, 5 up, 6 in 2024-09-19T09:07:44.259 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 bash[89762]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 bash[89762]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 bash[89762]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 bash[89762]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate[89777]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 bash[89762]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-19T09:07:44.260 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:43 smithi102 podman[89762]: 2024-09-19 09:07:43.946766556 +0000 UTC m=+1.500649892 container died 2601f105efe0972b191f10f3c0b9924ace6bf4a1e2ac5d2c3a6aa617ca1827e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T09:07:44.721 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:44 smithi102 podman[89923]: 2024-09-19 09:07:44.529573118 +0000 UTC m=+0.576006827 container remove 2601f105efe0972b191f10f3c0b9924ace6bf4a1e2ac5d2c3a6aa617ca1827e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:07:45.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:44 smithi102 ceph-mon[80875]: osdmap e68: 6 total, 5 up, 6 in 2024-09-19T09:07:45.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:44 smithi102 podman[89982]: 2024-09-19 09:07:44.72208129 +0000 UTC m=+0.099450360 container create a484137c7424b78b8c8876608f73ac3c54d115845d245ce99d0704b6abad70cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:07:45.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:44 smithi102 podman[89982]: 2024-09-19 09:07:44.638846092 +0000 UTC m=+0.016215189 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:45.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:44 smithi102 podman[89982]: 2024-09-19 09:07:44.924544139 +0000 UTC m=+0.301913221 container init a484137c7424b78b8c8876608f73ac3c54d115845d245ce99d0704b6abad70cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T09:07:45.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:44 smithi102 podman[89982]: 2024-09-19 09:07:44.927767809 +0000 UTC m=+0.305136882 container start a484137c7424b78b8c8876608f73ac3c54d115845d245ce99d0704b6abad70cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:07:45.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:44 smithi102 ceph-osd[90002]: -- 172.21.15.102:0/2593654443 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f96f8ea1e0 con 0x55f96f87c000 2024-09-19T09:07:45.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:44 smithi049 ceph-mon[91793]: osdmap e68: 6 total, 5 up, 6 in 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.269+0000 7f986b70b640 1 -- 172.21.15.49:0/2071873633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fe4d0 msgr2=0x7f98640fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.270+0000 7f986b70b640 1 --2- 172.21.15.49:0/2071873633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fe4d0 0x7f98640fe8d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9860009880 tx=0x7f986002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.270+0000 7f986b70b640 1 -- 172.21.15.49:0/2071873633 shutdown_connections 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.270+0000 7f986b70b640 1 --2- 172.21.15.49:0/2071873633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fee10 0x7f98640ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.270+0000 7f986b70b640 1 --2- 172.21.15.49:0/2071873633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fe4d0 0x7f98640fe8d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.270+0000 7f986b70b640 1 -- 172.21.15.49:0/2071873633 >> 172.21.15.49:0/2071873633 conn(0x7f98640fa280 msgr2=0x7f98640fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.270+0000 7f986b70b640 1 -- 172.21.15.49:0/2071873633 shutdown_connections 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.270+0000 7f986b70b640 1 -- 172.21.15.49:0/2071873633 wait complete. 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f986b70b640 1 Processor -- start 2024-09-19T09:07:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f986b70b640 1 -- start start 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f986b70b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fe4d0 0x7f9864197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f986b70b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fee10 0x7f9864197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f986b70b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864198350 con 0x7f98640fee10 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f986b70b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98641984c0 con 0x7f98640fe4d0 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f9868ca6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fee10 0x7f9864197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f98694a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fe4d0 0x7f9864197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f9868ca6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fee10 0x7f9864197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41414/0 (socket says 172.21.15.49:41414) 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f98694a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fe4d0 0x7f9864197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:60874/0 (socket says 172.21.15.49:60874) 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.271+0000 7f9868ca6640 1 -- 172.21.15.49:0/3599782164 learned_addr learned my addr 172.21.15.49:0/3599782164 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f98694a7640 1 -- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fee10 msgr2=0x7f9864197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f98694a7640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fee10 0x7f9864197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f98694a7640 1 -- 172.21.15.49:0/3599782164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9860009560 con 0x7f98640fe4d0 2024-09-19T09:07:45.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f98694a7640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fe4d0 0x7f9864197840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f986002a9c0 tx=0x7f98600055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f985a7fc640 1 -- 172.21.15.49:0/3599782164 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9860004aa0 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986419cf00 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f985a7fc640 1 -- 172.21.15.49:0/3599782164 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9860005d50 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f985a7fc640 1 -- 172.21.15.49:0/3599782164 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98600039b0 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.272+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986419d370 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.273+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9864191950 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.274+0000 7f985a7fc640 1 -- 172.21.15.49:0/3599782164 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9860031c00 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.274+0000 7f985a7fc640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f985006e5f0 0x7f9850070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.275+0000 7f985a7fc640 1 -- 172.21.15.49:0/3599782164 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f98600af810 con 0x7f98640fe4d0 2024-09-19T09:07:45.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.275+0000 7f9868ca6640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f985006e5f0 0x7f9850070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.275+0000 7f9868ca6640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f985006e5f0 0x7f9850070ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9864198d60 tx=0x7f9854005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:45.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.279+0000 7f985a7fc640 1 -- 172.21.15.49:0/3599782164 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9860078840 con 0x7f98640fe4d0 2024-09-19T09:07:45.508 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:45 smithi102 bash[89982]: a484137c7424b78b8c8876608f73ac3c54d115845d245ce99d0704b6abad70cf 2024-09-19T09:07:45.508 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:45 smithi102 systemd[1]: Started Ceph osd.3 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:07:45.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.525+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f986402c4f0 con 0x7f985006e5f0 2024-09-19T09:07:45.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.526+0000 7f985a7fc640 1 -- 172.21.15.49:0/3599782164 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f986402c4f0 con 0x7f985006e5f0 2024-09-19T09:07:45.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f985006e5f0 msgr2=0x7f9850070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f985006e5f0 0x7f9850070ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9864198d60 tx=0x7f9854005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fe4d0 msgr2=0x7f9864197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fe4d0 0x7f9864197840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f986002a9c0 tx=0x7f98600055a0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 shutdown_connections 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f985006e5f0 0x7f9850070ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98640fee10 0x7f9864197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 --2- 172.21.15.49:0/3599782164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98640fe4d0 0x7f9864197840 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.528+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 >> 172.21.15.49:0/3599782164 conn(0x7f98640fa280 msgr2=0x7f9864107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.529+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 shutdown_connections 2024-09-19T09:07:45.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.529+0000 7f986b70b640 1 -- 172.21.15.49:0/3599782164 wait complete. 2024-09-19T09:07:45.538 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 -- 172.21.15.49:0/3254269731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 msgr2=0x7fc1ec100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/3254269731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec100830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009880 tx=0x7fc1e802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 -- 172.21.15.49:0/3254269731 shutdown_connections 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/3254269731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec100d70 0x7fc1ec1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/3254269731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec100830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 -- 172.21.15.49:0/3254269731 >> 172.21.15.49:0/3254269731 conn(0x7fc1ec0fa250 msgr2=0x7fc1ec0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 -- 172.21.15.49:0/3254269731 shutdown_connections 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.613+0000 7fc1f33a9640 1 -- 172.21.15.49:0/3254269731 wait complete. 2024-09-19T09:07:45.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f33a9640 1 Processor -- start 2024-09-19T09:07:45.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f33a9640 1 -- start start 2024-09-19T09:07:45.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f33a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f33a9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec100d70 0x7fc1ec19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f33a9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec19c6f0 con 0x7fc1ec0fe420 2024-09-19T09:07:45.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f33a9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec19c860 con 0x7fc1ec100d70 2024-09-19T09:07:45.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f1145640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f1145640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec19bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41434/0 (socket says 172.21.15.49:41434) 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f1145640 1 -- 172.21.15.49:0/623072131 learned_addr learned my addr 172.21.15.49:0/623072131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.614+0000 7fc1f0944640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec100d70 0x7fc1ec19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1f1145640 1 -- 172.21.15.49:0/623072131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec100d70 msgr2=0x7fc1ec19c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1f1145640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec100d70 0x7fc1ec19c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1f1145640 1 -- 172.21.15.49:0/623072131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8009560 con 0x7fc1ec0fe420 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1f0944640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec100d70 0x7fc1ec19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1f1145640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec19bbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80055a0 tx=0x7fc1e80055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1e27fc640 1 -- 172.21.15.49:0/623072131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1e8004aa0 con 0x7fc1ec0fe420 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1e27fc640 1 -- 172.21.15.49:0/623072131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1e8004c00 con 0x7fc1ec0fe420 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec1a12a0 con 0x7fc1ec0fe420 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1e27fc640 1 -- 172.21.15.49:0/623072131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1e8003b10 con 0x7fc1ec0fe420 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.615+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec1a1810 con 0x7fc1ec0fe420 2024-09-19T09:07:45.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.616+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec10ed90 con 0x7fc1ec0fe420 2024-09-19T09:07:45.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.617+0000 7fc1e27fc640 1 -- 172.21.15.49:0/623072131 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc1e8003d40 con 0x7fc1ec0fe420 2024-09-19T09:07:45.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.617+0000 7fc1e27fc640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc1d806e5f0 0x7fc1d8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.617+0000 7fc1e27fc640 1 -- 172.21.15.49:0/623072131 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fc1e80af890 con 0x7fc1ec0fe420 2024-09-19T09:07:45.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.617+0000 7fc1f0944640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc1d806e5f0 0x7fc1d8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.618+0000 7fc1f0944640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc1d806e5f0 0x7fc1d8070ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec19d100 tx=0x7fc1dc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:45.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.622+0000 7fc1e27fc640 1 -- 172.21.15.49:0/623072131 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc1e80789e0 con 0x7fc1ec0fe420 2024-09-19T09:07:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:45 smithi049 ceph-mon[91793]: pgmap v113: 65 pgs: 18 active+undersized, 4 peering, 2 unknown, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 64/321 objects degraded (19.938%) 2024-09-19T09:07:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:45 smithi049 ceph-mon[91793]: Health check failed: Degraded data redundancy: 64/321 objects degraded (19.938%), 17 pgs degraded (PG_DEGRADED) 2024-09-19T09:07:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:45 smithi049 ceph-mon[91793]: osdmap e69: 6 total, 5 up, 6 in 2024-09-19T09:07:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.833+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1ec101770 con 0x7fc1d806e5f0 2024-09-19T09:07:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.834+0000 7fc1e27fc640 1 -- 172.21.15.49:0/623072131 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc1ec101770 con 0x7fc1d806e5f0 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc1d806e5f0 msgr2=0x7fc1d8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc1d806e5f0 0x7fc1d8070ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec19d100 tx=0x7fc1dc005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 msgr2=0x7fc1ec19bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec19bbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80055a0 tx=0x7fc1e80055d0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 shutdown_connections 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc1d806e5f0 0x7fc1d8070ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1ec100d70 0x7fc1ec19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 --2- 172.21.15.49:0/623072131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1ec0fe420 0x7fc1ec19bbe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 >> 172.21.15.49:0/623072131 conn(0x7fc1ec0fa250 msgr2=0x7fc1ec0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:45.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 shutdown_connections 2024-09-19T09:07:45.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.836+0000 7fc1f33a9640 1 -- 172.21.15.49:0/623072131 wait complete. 2024-09-19T09:07:45.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 -- 172.21.15.49:0/1995007177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc102fb0 msgr2=0x7f9dbc1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 --2- 172.21.15.49:0/1995007177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc102fb0 0x7f9dbc1053a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9db00098b0 tx=0x7f9db002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 -- 172.21.15.49:0/1995007177 shutdown_connections 2024-09-19T09:07:45.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 --2- 172.21.15.49:0/1995007177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc102fb0 0x7f9dbc1053a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 --2- 172.21.15.49:0/1995007177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dbc100680 0x7f9dbc102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 -- 172.21.15.49:0/1995007177 >> 172.21.15.49:0/1995007177 conn(0x7f9dbc0fa280 msgr2=0x7f9dbc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:45.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 -- 172.21.15.49:0/1995007177 shutdown_connections 2024-09-19T09:07:45.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.920+0000 7f9dc45df640 1 -- 172.21.15.49:0/1995007177 wait complete. 2024-09-19T09:07:45.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc45df640 1 Processor -- start 2024-09-19T09:07:45.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc45df640 1 -- start start 2024-09-19T09:07:45.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc45df640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc100680 0x7f9dbc195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc45df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dbc102fb0 0x7f9dbc195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc45df640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc196230 con 0x7f9dbc100680 2024-09-19T09:07:45.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc45df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1963a0 con 0x7f9dbc102fb0 2024-09-19T09:07:45.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc237b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc100680 0x7f9dbc195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc237b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc100680 0x7f9dbc195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41446/0 (socket says 172.21.15.49:41446) 2024-09-19T09:07:45.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc237b640 1 -- 172.21.15.49:0/434726854 learned_addr learned my addr 172.21.15.49:0/434726854 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:45.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc1b7a640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dbc102fb0 0x7f9dbc195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc237b640 1 -- 172.21.15.49:0/434726854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dbc102fb0 msgr2=0x7f9dbc195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:45.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc237b640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dbc102fb0 0x7f9dbc195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:45.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc237b640 1 -- 172.21.15.49:0/434726854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db0009560 con 0x7f9dbc100680 2024-09-19T09:07:45.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.921+0000 7f9dc237b640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc100680 0x7f9dbc195720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00eb40 tx=0x7f9dac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:45.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.922+0000 7f9dbb7fe640 1 -- 172.21.15.49:0/434726854 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dac00cee0 con 0x7f9dbc100680 2024-09-19T09:07:45.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.922+0000 7f9dbb7fe640 1 -- 172.21.15.49:0/434726854 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dac005020 con 0x7f9dbc100680 2024-09-19T09:07:45.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.922+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc19ae40 con 0x7f9dbc100680 2024-09-19T09:07:45.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.922+0000 7f9dbb7fe640 1 -- 172.21.15.49:0/434726854 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dac010640 con 0x7f9dbc100680 2024-09-19T09:07:45.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.922+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc19b300 con 0x7f9dbc100680 2024-09-19T09:07:45.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.923+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc100a60 con 0x7f9dbc100680 2024-09-19T09:07:45.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.923+0000 7f9dbb7fe640 1 -- 172.21.15.49:0/434726854 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9dac005190 con 0x7f9dbc100680 2024-09-19T09:07:45.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.924+0000 7f9dbb7fe640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9da406e5f0 0x7f9da4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:45.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.924+0000 7f9dbb7fe640 1 -- 172.21.15.49:0/434726854 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6794+0+0 (secure 0 0 0) 0x7f9dac014070 con 0x7f9dbc100680 2024-09-19T09:07:45.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.924+0000 7f9dc1b7a640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9da406e5f0 0x7f9da4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:45.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.924+0000 7f9dc1b7a640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9da406e5f0 0x7f9da4070ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009880 tx=0x7f9db00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:45.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:45.928+0000 7f9dbb7fe640 1 -- 172.21.15.49:0/434726854 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9dac057ee0 con 0x7f9dbc100680 2024-09-19T09:07:46.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:45 smithi102 ceph-mon[80875]: pgmap v113: 65 pgs: 18 active+undersized, 4 peering, 2 unknown, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 64/321 objects degraded (19.938%) 2024-09-19T09:07:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:45 smithi102 ceph-mon[80875]: Health check failed: Degraded data redundancy: 64/321 objects degraded (19.938%), 17 pgs degraded (PG_DEGRADED) 2024-09-19T09:07:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:45 smithi102 ceph-mon[80875]: osdmap e69: 6 total, 5 up, 6 in 2024-09-19T09:07:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:46.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.112+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dbc103a50 con 0x7f9da406e5f0 2024-09-19T09:07:46.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.121+0000 7f9dbb7fe640 1 -- 172.21.15.49:0/434726854 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9dbc103a50 con 0x7f9da406e5f0 2024-09-19T09:07:46.122 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:07:46.122 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (11m) 29s ago 13m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (13m) 29s ago 13m 8933k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (12m) 2m ago 12m 8120k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (2m) 29s ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (2m) 2m ago 12m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (11m) 29s ago 13m 84.1M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (7m) 29s ago 7m 92.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (7m) 29s ago 7m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (7m) 2m ago 7m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (7m) 2m ago 7m 27.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (4m) 29s ago 14m 500M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (3m) 2m ago 12m 439M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (3m) 29s ago 14m 48.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:07:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (2m) 2m ago 12m 32.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (13m) 29s ago 13m 15.6M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (12m) 2m ago 12m 16.7M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (106s) 29s ago 11m 83.7M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (71s) 29s ago 11m 86.0M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (35s) 29s ago 10m 12.1M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 starting - - - 2240M 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (9m) 2m ago 9m 216M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 1c16ad256763 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (9m) 2m ago 9m 209M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:07:46.124 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (3m) 29s ago 12m 60.5M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9da406e5f0 msgr2=0x7f9da4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9da406e5f0 0x7f9da4070ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009880 tx=0x7f9db00314e0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc100680 msgr2=0x7f9dbc195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc100680 0x7f9dbc195720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00eb40 tx=0x7f9dac00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 shutdown_connections 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9da406e5f0 0x7f9da4070ab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dbc102fb0 0x7f9dbc195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 --2- 172.21.15.49:0/434726854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dbc100680 0x7f9dbc195720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 >> 172.21.15.49:0/434726854 conn(0x7f9dbc0fa280 msgr2=0x7f9dbc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:46.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 shutdown_connections 2024-09-19T09:07:46.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.123+0000 7f9dc45df640 1 -- 172.21.15.49:0/434726854 wait complete. 2024-09-19T09:07:46.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.206+0000 7fb31a916640 1 -- 172.21.15.49:0/688806442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140ffc80 msgr2=0x7fb314100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.206+0000 7fb31a916640 1 --2- 172.21.15.49:0/688806442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140ffc80 0x7fb314100100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb308009880 tx=0x7fb30802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.206+0000 7fb31a916640 1 -- 172.21.15.49:0/688806442 shutdown_connections 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.206+0000 7fb31a916640 1 --2- 172.21.15.49:0/688806442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140ffc80 0x7fb314100100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.206+0000 7fb31a916640 1 --2- 172.21.15.49:0/688806442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3140fea80 0x7fb3140fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.206+0000 7fb31a916640 1 -- 172.21.15.49:0/688806442 >> 172.21.15.49:0/688806442 conn(0x7fb3140fa230 msgr2=0x7fb3140fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.206+0000 7fb31a916640 1 -- 172.21.15.49:0/688806442 shutdown_connections 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.207+0000 7fb31a916640 1 -- 172.21.15.49:0/688806442 wait complete. 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.207+0000 7fb31a916640 1 Processor -- start 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.207+0000 7fb31a916640 1 -- start start 2024-09-19T09:07:46.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.207+0000 7fb31a916640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140fea80 0x7fb314102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.207+0000 7fb31a916640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3140ffc80 0x7fb314101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.207+0000 7fb31a916640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3141015a0 con 0x7fb3140fea80 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.207+0000 7fb31a916640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb314101710 con 0x7fb3140ffc80 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb313fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140fea80 0x7fb314102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb313fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140fea80 0x7fb314102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41468/0 (socket says 172.21.15.49:41468) 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb313fff640 1 -- 172.21.15.49:0/484828635 learned_addr learned my addr 172.21.15.49:0/484828635 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb3137fe640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3140ffc80 0x7fb314101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb313fff640 1 -- 172.21.15.49:0/484828635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3140ffc80 msgr2=0x7fb314101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb313fff640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3140ffc80 0x7fb314101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb313fff640 1 -- 172.21.15.49:0/484828635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308009560 con 0x7fb3140fea80 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb313fff640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140fea80 0x7fb314102a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb30400e940 tx=0x7fb30400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb3117fa640 1 -- 172.21.15.49:0/484828635 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3040096e0 con 0x7fb3140fea80 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb3117fa640 1 -- 172.21.15.49:0/484828635 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3040044f0 con 0x7fb3140fea80 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3141019f0 con 0x7fb3140fea80 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.208+0000 7fb3117fa640 1 -- 172.21.15.49:0/484828635 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb304010430 con 0x7fb3140fea80 2024-09-19T09:07:46.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.209+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31419d6d0 con 0x7fb3140fea80 2024-09-19T09:07:46.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.210+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3140fee80 con 0x7fb3140fea80 2024-09-19T09:07:46.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.210+0000 7fb3117fa640 1 -- 172.21.15.49:0/484828635 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb304004030 con 0x7fb3140fea80 2024-09-19T09:07:46.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.210+0000 7fb3117fa640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb2fc06e600 0x7fb2fc070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.211+0000 7fb3117fa640 1 -- 172.21.15.49:0/484828635 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6794+0+0 (secure 0 0 0) 0x7fb304014070 con 0x7fb3140fea80 2024-09-19T09:07:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.211+0000 7fb3137fe640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb2fc06e600 0x7fb2fc070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.211+0000 7fb3137fe640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb2fc06e600 0x7fb2fc070ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb308000c00 tx=0x7fb3080314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:46.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.215+0000 7fb3117fa640 1 -- 172.21.15.49:0/484828635 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb304057c80 con 0x7fb3140fea80 2024-09-19T09:07:46.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.464+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb31419da40 con 0x7fb3140fea80 2024-09-19T09:07:46.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.464+0000 7fb3117fa640 1 -- 172.21.15.49:0/484828635 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fb30405b340 con 0x7fb3140fea80 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2, 2024-09-19T09:07:46.466 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 3 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6, 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 7 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:07:46.467 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:07:46.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb2fc06e600 msgr2=0x7fb2fc070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb2fc06e600 0x7fb2fc070ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb308000c00 tx=0x7fb3080314e0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140fea80 msgr2=0x7fb314102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140fea80 0x7fb314102a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb30400e940 tx=0x7fb30400ee00 comp rx=0 tx=0).stop 2024-09-19T09:07:46.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 shutdown_connections 2024-09-19T09:07:46.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb2fc06e600 0x7fb2fc070ac0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3140ffc80 0x7fb314101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 --2- 172.21.15.49:0/484828635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3140fea80 0x7fb314102a10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 >> 172.21.15.49:0/484828635 conn(0x7fb3140fa230 msgr2=0x7fb314068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 shutdown_connections 2024-09-19T09:07:46.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.467+0000 7fb31a916640 1 -- 172.21.15.49:0/484828635 wait complete. 2024-09-19T09:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 -- 172.21.15.49:0/1832911924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 msgr2=0x7fd39c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/1832911924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c0fff90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd398009880 tx=0x7fd39802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 -- 172.21.15.49:0/1832911924 shutdown_connections 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/1832911924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd39c100d90 0x7fd39c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/1832911924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c0fff90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 -- 172.21.15.49:0/1832911924 >> 172.21.15.49:0/1832911924 conn(0x7fd39c0fb320 msgr2=0x7fd39c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 -- 172.21.15.49:0/1832911924 shutdown_connections 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 -- 172.21.15.49:0/1832911924 wait complete. 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.551+0000 7fd3a3e07640 1 Processor -- start 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a3e07640 1 -- start start 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a3e07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a3e07640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd39c100d90 0x7fd39c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a3e07640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c072de0 con 0x7fd39c0ffb90 2024-09-19T09:07:46.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a3e07640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c072f50 con 0x7fd39c100d90 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a1ba3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a1ba3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41490/0 (socket says 172.21.15.49:41490) 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a1ba3640 1 -- 172.21.15.49:0/522546731 learned_addr learned my addr 172.21.15.49:0/522546731 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a13a2640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd39c100d90 0x7fd39c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a1ba3640 1 -- 172.21.15.49:0/522546731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd39c100d90 msgr2=0x7fd39c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a1ba3640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd39c100d90 0x7fd39c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a1ba3640 1 -- 172.21.15.49:0/522546731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398009560 con 0x7fd39c0ffb90 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd3a1ba3640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c074250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd39802a9c0 tx=0x7fd398005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.552+0000 7fd392ffd640 1 -- 172.21.15.49:0/522546731 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd398004b20 con 0x7fd39c0ffb90 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.553+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c0731d0 con 0x7fd39c0ffb90 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.553+0000 7fd392ffd640 1 -- 172.21.15.49:0/522546731 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd398004c80 con 0x7fd39c0ffb90 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.553+0000 7fd392ffd640 1 -- 172.21.15.49:0/522546731 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd398003b80 con 0x7fd39c0ffb90 2024-09-19T09:07:46.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.553+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c19d770 con 0x7fd39c0ffb90 2024-09-19T09:07:46.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.554+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c100010 con 0x7fd39c0ffb90 2024-09-19T09:07:46.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.554+0000 7fd392ffd640 1 -- 172.21.15.49:0/522546731 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd398031640 con 0x7fd39c0ffb90 2024-09-19T09:07:46.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.555+0000 7fd392ffd640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd38806e5f0 0x7fd388070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.555+0000 7fd392ffd640 1 -- 172.21.15.49:0/522546731 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6794+0+0 (secure 0 0 0) 0x7fd3980afb40 con 0x7fd39c0ffb90 2024-09-19T09:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.555+0000 7fd3a13a2640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd38806e5f0 0x7fd388070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.555+0000 7fd3a13a2640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd38806e5f0 0x7fd388070ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd39c073fd0 tx=0x7fd38c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:46.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.559+0000 7fd392ffd640 1 -- 172.21.15.49:0/522546731 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd398078b10 con 0x7fd39c0ffb90 2024-09-19T09:07:46.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.769+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd39c108800 con 0x7fd39c0ffb90 2024-09-19T09:07:46.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.769+0000 7fd392ffd640 1 -- 172.21.15.49:0/522546731 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7fd39807c1d0 con 0x7fd39c0ffb90 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:07:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:07:46.772 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:07:46.773 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:07:46.774 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:07:46.775 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:07:46.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd38806e5f0 msgr2=0x7fd388070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd38806e5f0 0x7fd388070ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd39c073fd0 tx=0x7fd38c008040 comp rx=0 tx=0).stop 2024-09-19T09:07:46.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 msgr2=0x7fd39c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c074250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd39802a9c0 tx=0x7fd398005610 comp rx=0 tx=0).stop 2024-09-19T09:07:46.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 shutdown_connections 2024-09-19T09:07:46.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd38806e5f0 0x7fd388070ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd39c100d90 0x7fd39c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 --2- 172.21.15.49:0/522546731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd39c0ffb90 0x7fd39c074250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 >> 172.21.15.49:0/522546731 conn(0x7fd39c0fb320 msgr2=0x7fd39c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:46.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 shutdown_connections 2024-09-19T09:07:46.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.772+0000 7fd3a3e07640 1 -- 172.21.15.49:0/522546731 wait complete. 2024-09-19T09:07:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 -- 172.21.15.49:0/2010828653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac100d80 msgr2=0x7f00ac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 --2- 172.21.15.49:0/2010828653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac100d80 0x7f00ac101200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0094009880 tx=0x7f009402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 -- 172.21.15.49:0/2010828653 shutdown_connections 2024-09-19T09:07:46.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 --2- 172.21.15.49:0/2010828653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac100d80 0x7f00ac101200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 --2- 172.21.15.49:0/2010828653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ac0ffb80 0x7f00ac0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 -- 172.21.15.49:0/2010828653 >> 172.21.15.49:0/2010828653 conn(0x7f00ac0fb310 msgr2=0x7f00ac0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 -- 172.21.15.49:0/2010828653 shutdown_connections 2024-09-19T09:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.861+0000 7f00b10a8640 1 -- 172.21.15.49:0/2010828653 wait complete. 2024-09-19T09:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.862+0000 7f00b10a8640 1 Processor -- start 2024-09-19T09:07:46.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.862+0000 7f00b10a8640 1 -- start start 2024-09-19T09:07:46.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.862+0000 7f00b10a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac0ffb80 0x7f00ac1955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00b10a8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ac100d80 0x7f00ac195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00b10a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac1960e0 con 0x7f00ac0ffb80 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00b10a8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac196250 con 0x7f00ac100d80 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac0ffb80 0x7f00ac1955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac0ffb80 0x7f00ac1955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41512/0 (socket says 172.21.15.49:41512) 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aad9d640 1 -- 172.21.15.49:0/1445291818 learned_addr learned my addr 172.21.15.49:0/1445291818 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aa59c640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ac100d80 0x7f00ac195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aad9d640 1 -- 172.21.15.49:0/1445291818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ac100d80 msgr2=0x7f00ac195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aad9d640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ac100d80 0x7f00ac195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aad9d640 1 -- 172.21.15.49:0/1445291818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094009560 con 0x7f00ac0ffb80 2024-09-19T09:07:46.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00aad9d640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac0ffb80 0x7f00ac1955d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f009c00cc60 tx=0x7f009c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00a3fff640 1 -- 172.21.15.49:0/1445291818 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009c00f450 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00a3fff640 1 -- 172.21.15.49:0/1445291818 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f009c00fa70 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac19acf0 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.863+0000 7f00a3fff640 1 -- 172.21.15.49:0/1445291818 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009c018a80 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.864+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ac19b240 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.865+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ac0fff80 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.865+0000 7f00a3fff640 1 -- 172.21.15.49:0/1445291818 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f009c018cb0 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.865+0000 7f00a3fff640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f009806e5f0 0x7f0098070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.866+0000 7f00a3fff640 1 -- 172.21.15.49:0/1445291818 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6794+0+0 (secure 0 0 0) 0x7f009c08ec50 con 0x7f00ac0ffb80 2024-09-19T09:07:46.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.866+0000 7f00aa59c640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f009806e5f0 0x7f0098070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:46.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.866+0000 7f00aa59c640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f009806e5f0 0x7f0098070ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0094000c00 tx=0x7f00940314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:46.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:46.870+0000 7f00a3fff640 1 -- 172.21.15.49:0/1445291818 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f009c057c20 con 0x7f00ac0ffb80 2024-09-19T09:07:47.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:46 smithi049 ceph-mon[91793]: from='client.44225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:47.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:46 smithi049 ceph-mon[91793]: osdmap e70: 6 total, 5 up, 6 in 2024-09-19T09:07:47.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:46 smithi049 ceph-mon[91793]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:47.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:46 smithi049 ceph-mon[91793]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:47.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:46 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/484828635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:47.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:46 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/522546731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:07:47.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.064+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00ac105530 con 0x7f009806e5f0 2024-09-19T09:07:47.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.066+0000 7f00a3fff640 1 -- 172.21.15.49:0/1445291818 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f00ac105530 con 0x7f009806e5f0 2024-09-19T09:07:47.067 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:07:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:07:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:07:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:07:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:07:47.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:07:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:07:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:07:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:07:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "9/23 daemons upgraded", 2024-09-19T09:07:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:07:47.068 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:07:47.068 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:07:47.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f009806e5f0 msgr2=0x7f0098070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:47.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f009806e5f0 0x7f0098070ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0094000c00 tx=0x7f00940314e0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac0ffb80 msgr2=0x7f00ac1955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac0ffb80 0x7f00ac1955d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f009c00cc60 tx=0x7f009c00a620 comp rx=0 tx=0).stop 2024-09-19T09:07:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 shutdown_connections 2024-09-19T09:07:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f009806e5f0 0x7f0098070ab0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ac100d80 0x7f00ac195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 --2- 172.21.15.49:0/1445291818 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00ac0ffb80 0x7f00ac1955d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 >> 172.21.15.49:0/1445291818 conn(0x7f00ac0fb310 msgr2=0x7f00ac0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:47.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 shutdown_connections 2024-09-19T09:07:47.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.068+0000 7f00b10a8640 1 -- 172.21.15.49:0/1445291818 wait complete. 2024-09-19T09:07:47.107 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:46 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:07:46.805+0000 7fcdc681e640 -1 Falling back to public interface 2024-09-19T09:07:47.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:46 smithi102 ceph-mon[80875]: from='client.44225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:47.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:46 smithi102 ceph-mon[80875]: osdmap e70: 6 total, 5 up, 6 in 2024-09-19T09:07:47.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:46 smithi102 ceph-mon[80875]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:47.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:46 smithi102 ceph-mon[80875]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:47.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:46 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/484828635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:47.108 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:46 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/522546731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:07:47.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 -- 172.21.15.49:0/2021088398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128102fb0 msgr2=0x7f61281053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 --2- 172.21.15.49:0/2021088398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128102fb0 0x7f61281053a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61100098b0 tx=0x7f611002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 -- 172.21.15.49:0/2021088398 shutdown_connections 2024-09-19T09:07:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 --2- 172.21.15.49:0/2021088398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128102fb0 0x7f61281053a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 --2- 172.21.15.49:0/2021088398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6128100680 0x7f6128102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 -- 172.21.15.49:0/2021088398 >> 172.21.15.49:0/2021088398 conn(0x7f61280fa280 msgr2=0x7f61280fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 -- 172.21.15.49:0/2021088398 shutdown_connections 2024-09-19T09:07:47.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.151+0000 7f612da90640 1 -- 172.21.15.49:0/2021088398 wait complete. 2024-09-19T09:07:47.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.152+0000 7f612da90640 1 Processor -- start 2024-09-19T09:07:47.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.152+0000 7f612da90640 1 -- start start 2024-09-19T09:07:47.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.152+0000 7f612da90640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128100680 0x7f6128195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:47.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.152+0000 7f612da90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6128102fb0 0x7f6128195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:47.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.152+0000 7f612da90640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128196230 con 0x7f6128100680 2024-09-19T09:07:47.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.152+0000 7f612da90640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281963a0 con 0x7f6128102fb0 2024-09-19T09:07:47.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61277fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128100680 0x7f6128195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:47.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61277fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128100680 0x7f6128195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41528/0 (socket says 172.21.15.49:41528) 2024-09-19T09:07:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61277fe640 1 -- 172.21.15.49:0/1178999514 learned_addr learned my addr 172.21.15.49:0/1178999514 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:07:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f611effd640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6128102fb0 0x7f6128195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61277fe640 1 -- 172.21.15.49:0/1178999514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6128102fb0 msgr2=0x7f6128195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61277fe640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6128102fb0 0x7f6128195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61277fe640 1 -- 172.21.15.49:0/1178999514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009560 con 0x7f6128100680 2024-09-19T09:07:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61277fe640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128100680 0x7f6128195720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f611800e9a0 tx=0x7f611800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61257fa640 1 -- 172.21.15.49:0/1178999514 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611800cd50 con 0x7f6128100680 2024-09-19T09:07:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61257fa640 1 -- 172.21.15.49:0/1178999514 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f611800ceb0 con 0x7f6128100680 2024-09-19T09:07:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612819ae40 con 0x7f6128100680 2024-09-19T09:07:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f61257fa640 1 -- 172.21.15.49:0/1178999514 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6118010660 con 0x7f6128100680 2024-09-19T09:07:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.153+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612819b300 con 0x7f6128100680 2024-09-19T09:07:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.154+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128100a60 con 0x7f6128100680 2024-09-19T09:07:47.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.155+0000 7f61257fa640 1 -- 172.21.15.49:0/1178999514 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f61180048a0 con 0x7f6128100680 2024-09-19T09:07:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.155+0000 7f61257fa640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f611406e5f0 0x7f6114070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.155+0000 7f61257fa640 1 -- 172.21.15.49:0/1178999514 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6794+0+0 (secure 0 0 0) 0x7f6118014070 con 0x7f6128100680 2024-09-19T09:07:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.155+0000 7f611effd640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f611406e5f0 0x7f6114070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.156+0000 7f611effd640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f611406e5f0 0x7f6114070ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6110009880 tx=0x7f6110004260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:47.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.160+0000 7f61257fa640 1 -- 172.21.15.49:0/1178999514 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f611805b930 con 0x7f6128100680 2024-09-19T09:07:47.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.404+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6128108800 con 0x7f6128100680 2024-09-19T09:07:47.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.404+0000 7f61257fa640 1 -- 172.21.15.49:0/1178999514 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1407 (secure 0 0 0) 0x7f611805b4c0 con 0x7f6128100680 2024-09-19T09:07:47.405 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 64/321 objects degraded (19.938%), 17 pgs degraded 2024-09-19T09:07:47.405 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:07:47.405 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: osd.3 (root=default,host=smithi102) is down 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 64/321 objects degraded (19.938%), 17 pgs degraded 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-19T09:07:47.406 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-19T09:07:47.407 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-19T09:07:47.407 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-19T09:07:47.407 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-19T09:07:47.407 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-19T09:07:47.407 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-19T09:07:47.407 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-19T09:07:47.407 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-19T09:07:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.406+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f611406e5f0 msgr2=0x7f6114070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.406+0000 7f612da90640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f611406e5f0 0x7f6114070ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6110009880 tx=0x7f6110004260 comp rx=0 tx=0).stop 2024-09-19T09:07:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.406+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128100680 msgr2=0x7f6128195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.406+0000 7f612da90640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128100680 0x7f6128195720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f611800e9a0 tx=0x7f611800eda0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.407+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 shutdown_connections 2024-09-19T09:07:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.407+0000 7f612da90640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f611406e5f0 0x7f6114070ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.407+0000 7f612da90640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6128102fb0 0x7f6128195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.407+0000 7f612da90640 1 --2- 172.21.15.49:0/1178999514 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6128100680 0x7f6128195720 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.407+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 >> 172.21.15.49:0/1178999514 conn(0x7f61280fa280 msgr2=0x7f61280fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.407+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 shutdown_connections 2024-09-19T09:07:47.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:07:47.407+0000 7f612da90640 1 -- 172.21.15.49:0/1178999514 wait complete. 2024-09-19T09:07:48.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:47 smithi049 ceph-mon[91793]: pgmap v116: 65 pgs: 18 active+undersized, 4 peering, 2 unknown, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 64/321 objects degraded (19.938%) 2024-09-19T09:07:48.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:47 smithi049 ceph-mon[91793]: osdmap e71: 6 total, 5 up, 6 in 2024-09-19T09:07:48.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:47 smithi049 ceph-mon[91793]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:48.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:47 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1178999514' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:07:48.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:48.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:48.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:47 smithi102 ceph-mon[80875]: pgmap v116: 65 pgs: 18 active+undersized, 4 peering, 2 unknown, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 64/321 objects degraded (19.938%) 2024-09-19T09:07:48.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:47 smithi102 ceph-mon[80875]: osdmap e71: 6 total, 5 up, 6 in 2024-09-19T09:07:48.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:47 smithi102 ceph-mon[80875]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:07:48.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:47 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1178999514' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:07:48.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:48.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:49.738 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:49.738 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:50 smithi102 ceph-mon[80875]: pgmap v118: 65 pgs: 4 active+clean+remapped, 18 active+undersized, 1 peering, 1 unknown, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 60 MiB/s wr, 214 op/s; 64/321 objects degraded (19.938%); 3/321 objects misplaced (0.935%); 1.7 MiB/s, 106 objects/s recovering 2024-09-19T09:07:50.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:50 smithi049 ceph-mon[91793]: pgmap v118: 65 pgs: 4 active+clean+remapped, 18 active+undersized, 1 peering, 1 unknown, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 60 MiB/s wr, 214 op/s; 64/321 objects degraded (19.938%); 3/321 objects misplaced (0.935%); 1.7 MiB/s, 106 objects/s recovering 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: pgmap v119: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 47 MiB/s wr, 170 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%); 2.0 MiB/s, 85 objects/s recovering 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:52.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:07:52.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: pgmap v119: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 47 MiB/s wr, 170 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%); 2.0 MiB/s, 85 objects/s recovering 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:07:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:52 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:07:53.258 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:52 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:07:52.767+0000 7fcdc681e640 -1 osd.3 64 log_to_monitors true 2024-09-19T09:07:53.742 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:07:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:07:53.488+0000 7fcdbe5b8640 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:07:53.742 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:53 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:07:53.742 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:53 smithi102 ceph-mon[80875]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-09-19T09:07:53.743 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:53 smithi102 ceph-mon[80875]: from='osd.3 [v2:172.21.15.102:6800/1878259483,v1:172.21.15.102:6801/1878259483]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:07:53.743 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:53 smithi102 ceph-mon[80875]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:07:53.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:53 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:07:53.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:53 smithi049 ceph-mon[91793]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-09-19T09:07:53.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:53 smithi049 ceph-mon[91793]: from='osd.3 [v2:172.21.15.102:6800/1878259483,v1:172.21.15.102:6801/1878259483]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:07:53.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:53 smithi049 ceph-mon[91793]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:07:54.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:54 smithi102 ceph-mon[80875]: pgmap v120: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 37 MiB/s wr, 132 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%); 1.6 MiB/s, 66 objects/s recovering 2024-09-19T09:07:54.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:54 smithi102 ceph-mon[80875]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:07:54.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:54 smithi102 ceph-mon[80875]: osdmap e72: 6 total, 5 up, 6 in 2024-09-19T09:07:54.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:54 smithi102 ceph-mon[80875]: from='osd.3 [v2:172.21.15.102:6800/1878259483,v1:172.21.15.102:6801/1878259483]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:07:54.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:54 smithi102 ceph-mon[80875]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:07:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:54 smithi049 ceph-mon[91793]: pgmap v120: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 37 MiB/s wr, 132 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%); 1.6 MiB/s, 66 objects/s recovering 2024-09-19T09:07:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:54 smithi049 ceph-mon[91793]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:07:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:54 smithi049 ceph-mon[91793]: osdmap e72: 6 total, 5 up, 6 in 2024-09-19T09:07:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:54 smithi049 ceph-mon[91793]: from='osd.3 [v2:172.21.15.102:6800/1878259483,v1:172.21.15.102:6801/1878259483]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:07:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:54 smithi049 ceph-mon[91793]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:07:55.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:55 smithi102 ceph-mon[80875]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:07:55.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:55 smithi102 ceph-mon[80875]: osd.3 [v2:172.21.15.102:6800/1878259483,v1:172.21.15.102:6801/1878259483] boot 2024-09-19T09:07:55.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:55 smithi102 ceph-mon[80875]: osdmap e73: 6 total, 6 up, 6 in 2024-09-19T09:07:55.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:55 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:07:55.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:55 smithi049 ceph-mon[91793]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:07:55.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:55 smithi049 ceph-mon[91793]: osd.3 [v2:172.21.15.102:6800/1878259483,v1:172.21.15.102:6801/1878259483] boot 2024-09-19T09:07:55.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:55 smithi049 ceph-mon[91793]: osdmap e73: 6 total, 6 up, 6 in 2024-09-19T09:07:55.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:55 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:07:56.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:56 smithi102 ceph-mon[80875]: pgmap v123: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 37 MiB/s wr, 135 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%); 1.6 MiB/s, 66 objects/s recovering 2024-09-19T09:07:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:56 smithi102 ceph-mon[80875]: osdmap e74: 6 total, 6 up, 6 in 2024-09-19T09:07:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:56 smithi102 ceph-mon[80875]: osdmap e75: 6 total, 6 up, 6 in 2024-09-19T09:07:56.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:56 smithi049 ceph-mon[91793]: pgmap v123: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 37 MiB/s wr, 135 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%); 1.6 MiB/s, 66 objects/s recovering 2024-09-19T09:07:56.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:56 smithi049 ceph-mon[91793]: osdmap e74: 6 total, 6 up, 6 in 2024-09-19T09:07:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:56 smithi049 ceph-mon[91793]: osdmap e75: 6 total, 6 up, 6 in 2024-09-19T09:07:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:57 smithi102 ceph-mon[80875]: pgmap v126: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%) 2024-09-19T09:07:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:57 smithi102 ceph-mon[80875]: osdmap e76: 6 total, 6 up, 6 in 2024-09-19T09:07:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:57 smithi049 ceph-mon[91793]: pgmap v126: 65 pgs: 6 active+clean+remapped, 18 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 64/321 objects degraded (19.938%); 8/321 objects misplaced (2.492%) 2024-09-19T09:07:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:57 smithi049 ceph-mon[91793]: osdmap e76: 6 total, 6 up, 6 in 2024-09-19T09:07:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:07:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:07:59.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:58 smithi102 ceph-mon[80875]: osdmap e77: 6 total, 6 up, 6 in 2024-09-19T09:07:59.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:58 smithi049 ceph-mon[91793]: osdmap e77: 6 total, 6 up, 6 in 2024-09-19T09:08:00.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:59 smithi102 ceph-mon[80875]: pgmap v129: 65 pgs: 2 peering, 1 active+clean+remapped, 3 active+undersized, 4 active+undersized+degraded, 55 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s; 16/321 objects degraded (4.984%); 4/321 objects misplaced (1.246%); 0 B/s, 114 objects/s recovering 2024-09-19T09:08:00.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:59 smithi102 ceph-mon[80875]: osdmap e78: 6 total, 6 up, 6 in 2024-09-19T09:08:00.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:07:59 smithi102 ceph-mon[80875]: Health check update: Degraded data redundancy: 16/321 objects degraded (4.984%), 4 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:00.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:59 smithi049 ceph-mon[91793]: pgmap v129: 65 pgs: 2 peering, 1 active+clean+remapped, 3 active+undersized, 4 active+undersized+degraded, 55 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s; 16/321 objects degraded (4.984%); 4/321 objects misplaced (1.246%); 0 B/s, 114 objects/s recovering 2024-09-19T09:08:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:59 smithi049 ceph-mon[91793]: osdmap e78: 6 total, 6 up, 6 in 2024-09-19T09:08:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:07:59 smithi049 ceph-mon[91793]: Health check update: Degraded data redundancy: 16/321 objects degraded (4.984%), 4 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:01.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:00 smithi102 ceph-mon[80875]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/321 objects degraded (4.984%), 4 pgs degraded) 2024-09-19T09:08:01.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:00 smithi049 ceph-mon[91793]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/321 objects degraded (4.984%), 4 pgs degraded) 2024-09-19T09:08:02.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:01 smithi102 ceph-mon[80875]: pgmap v131: 65 pgs: 2 peering, 63 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 1016 KiB/s, 116 objects/s recovering 2024-09-19T09:08:02.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:01 smithi049 ceph-mon[91793]: pgmap v131: 65 pgs: 2 peering, 63 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 1016 KiB/s, 116 objects/s recovering 2024-09-19T09:08:04.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:03 smithi102 ceph-mon[80875]: pgmap v132: 65 pgs: 2 peering, 63 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 682 KiB/s, 78 objects/s recovering 2024-09-19T09:08:04.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:03 smithi049 ceph-mon[91793]: pgmap v132: 65 pgs: 2 peering, 63 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 682 KiB/s, 78 objects/s recovering 2024-09-19T09:08:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:05 smithi049 ceph-mon[91793]: pgmap v133: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 532 KiB/s, 60 objects/s recovering 2024-09-19T09:08:06.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:05 smithi102 ceph-mon[80875]: pgmap v133: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 532 KiB/s, 60 objects/s recovering 2024-09-19T09:08:07.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:06 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:08:07.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:06 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:08:08.139 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:07 smithi102 ceph-mon[80875]: pgmap v134: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 471 KiB/s, 53 objects/s recovering 2024-09-19T09:08:08.139 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:07 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:08:08.139 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:07 smithi102 ceph-mon[80875]: Upgrade: osd.4 is safe to restart 2024-09-19T09:08:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:07 smithi049 ceph-mon[91793]: pgmap v134: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 471 KiB/s, 53 objects/s recovering 2024-09-19T09:08:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:07 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T09:08:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:07 smithi049 ceph-mon[91793]: Upgrade: osd.4 is safe to restart 2024-09-19T09:08:09.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:08 smithi102 ceph-mon[80875]: Upgrade: Updating osd.4 2024-09-19T09:08:09.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:09.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:08:09.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:09.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:08 smithi102 ceph-mon[80875]: Deploying daemon osd.4 on smithi102 2024-09-19T09:08:09.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:08 smithi049 ceph-mon[91793]: Upgrade: Updating osd.4 2024-09-19T09:08:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:08:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:08 smithi049 ceph-mon[91793]: Deploying daemon osd.4 on smithi102 2024-09-19T09:08:10.183 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:09 smithi102 ceph-mon[80875]: pgmap v135: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 819 KiB/s, 1 objects/s recovering 2024-09-19T09:08:10.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:09 smithi049 ceph-mon[91793]: pgmap v135: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 819 KiB/s, 1 objects/s recovering 2024-09-19T09:08:11.042 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:10 smithi102 systemd[1]: Stopping Ceph osd.4 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:11.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:11 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[48086]: 2024-09-19T09:08:11.054+0000 7efed29c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:11.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:11 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[48086]: 2024-09-19T09:08:11.054+0000 7efed29c9640 -1 osd.4 78 *** Got signal Terminated *** 2024-09-19T09:08:11.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:11 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[48086]: 2024-09-19T09:08:11.054+0000 7efed29c9640 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:08:12.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:11 smithi102 ceph-mon[80875]: pgmap v136: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:08:12.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:11 smithi102 ceph-mon[80875]: osd.4 marked itself down and dead 2024-09-19T09:08:12.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:11 smithi049 ceph-mon[91793]: pgmap v136: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:08:12.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:11 smithi049 ceph-mon[91793]: osd.4 marked itself down and dead 2024-09-19T09:08:12.672 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:12 smithi102 podman[94849]: 2024-09-19 09:08:12.367984886 +0000 UTC m=+1.423258638 container died 1c16ad256763948687ee5106349f4fa69bbb5fd5255231a0056bea633968d1b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-19T09:08:12.948 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:12 smithi102 podman[94849]: 2024-09-19 09:08:12.771737602 +0000 UTC m=+1.827011341 container cleanup 1c16ad256763948687ee5106349f4fa69bbb5fd5255231a0056bea633968d1b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:08:12.948 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:12 smithi102 bash[94849]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:08:13.233 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:12 smithi102 podman[94876]: 2024-09-19 09:08:12.94823057 +0000 UTC m=+0.577213506 container remove 1c16ad256763948687ee5106349f4fa69bbb5fd5255231a0056bea633968d1b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:08:13.234 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:12 smithi102 ceph-mon[80875]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:08:13.234 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:12 smithi102 ceph-mon[80875]: osdmap e79: 6 total, 5 up, 6 in 2024-09-19T09:08:13.234 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:13.234 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:13.234 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:13.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:12 smithi049 ceph-mon[91793]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:08:13.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:12 smithi049 ceph-mon[91793]: osdmap e79: 6 total, 5 up, 6 in 2024-09-19T09:08:13.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:13.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:13.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:13.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:13 smithi102 podman[94966]: 2024-09-19 09:08:13.195479755 +0000 UTC m=+0.015717456 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:08:13.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:13 smithi102 podman[94966]: 2024-09-19 09:08:13.316096649 +0000 UTC m=+0.136334326 container create 00d61420f0ec050dacf06888acd4d3b736c4ccf71d86b7f6cb8e470979fcf3cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:08:13.968 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:13 smithi102 podman[94966]: 2024-09-19 09:08:13.510146953 +0000 UTC m=+0.330384640 container init 00d61420f0ec050dacf06888acd4d3b736c4ccf71d86b7f6cb8e470979fcf3cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T09:08:13.968 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:13 smithi102 podman[94966]: 2024-09-19 09:08:13.513654218 +0000 UTC m=+0.333891896 container start 00d61420f0ec050dacf06888acd4d3b736c4ccf71d86b7f6cb8e470979fcf3cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:08:13.968 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:13 smithi102 podman[94966]: 2024-09-19 09:08:13.618655255 +0000 UTC m=+0.438892950 container attach 00d61420f0ec050dacf06888acd4d3b736c4ccf71d86b7f6cb8e470979fcf3cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T09:08:13.968 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:13 smithi102 podman[94966]: 2024-09-19 09:08:13.700646969 +0000 UTC m=+0.520884656 container died 00d61420f0ec050dacf06888acd4d3b736c4ccf71d86b7f6cb8e470979fcf3cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T09:08:14.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:13 smithi102 ceph-mon[80875]: pgmap v138: 65 pgs: 5 stale+active+clean, 60 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:08:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:13 smithi102 ceph-mon[80875]: osdmap e80: 6 total, 5 up, 6 in 2024-09-19T09:08:14.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:13 smithi049 ceph-mon[91793]: pgmap v138: 65 pgs: 5 stale+active+clean, 60 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:08:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:13 smithi049 ceph-mon[91793]: osdmap e80: 6 total, 5 up, 6 in 2024-09-19T09:08:14.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:14 smithi102 podman[94990]: 2024-09-19 09:08:14.347327446 +0000 UTC m=+0.640352216 container remove 00d61420f0ec050dacf06888acd4d3b736c4ccf71d86b7f6cb8e470979fcf3cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:08:14.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:14 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-19T09:08:14.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:14 smithi102 systemd[1]: Stopped Ceph osd.4 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:08:14.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:14 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.4.service: Consumed 52.142s CPU time. 2024-09-19T09:08:14.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:14 smithi102 systemd[1]: Starting Ceph osd.4 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:15.076 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:15 smithi102 ceph-mon[80875]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-19T09:08:15.076 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:15 smithi102 ceph-mon[80875]: Health check failed: Degraded data redundancy: 43/321 objects degraded (13.396%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:15.077 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:14 smithi102 podman[95091]: 2024-09-19 09:08:14.692840703 +0000 UTC m=+0.015581492 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:08:15.077 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:14 smithi102 podman[95091]: 2024-09-19 09:08:14.815588815 +0000 UTC m=+0.138329587 container create 0c31b03e6f7d6624712b452c8ecfad8fc26019a4b7c47916eccbfd6730498af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:08:15.077 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 podman[95091]: 2024-09-19 09:08:15.076760666 +0000 UTC m=+0.399501450 container init 0c31b03e6f7d6624712b452c8ecfad8fc26019a4b7c47916eccbfd6730498af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:08:15.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:15 smithi049 ceph-mon[91793]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-19T09:08:15.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:15 smithi049 ceph-mon[91793]: Health check failed: Degraded data redundancy: 43/321 objects degraded (13.396%), 11 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:15.508 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 podman[95091]: 2024-09-19 09:08:15.080230876 +0000 UTC m=+0.402971648 container start 0c31b03e6f7d6624712b452c8ecfad8fc26019a4b7c47916eccbfd6730498af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:08:15.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 podman[95091]: 2024-09-19 09:08:15.18498282 +0000 UTC m=+0.507723604 container attach 0c31b03e6f7d6624712b452c8ecfad8fc26019a4b7c47916eccbfd6730498af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:08:15.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:15.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 bash[95091]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:15.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:15.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 bash[95091]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:16.226 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:16 smithi102 ceph-mon[80875]: pgmap v140: 65 pgs: 14 active+undersized, 7 peering, 11 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 43/321 objects degraded (13.396%) 2024-09-19T09:08:16.227 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:08:16.227 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 bash[95091]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:08:16.227 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:08:16.227 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:15 smithi102 bash[95091]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T09:08:16.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:16 smithi049 ceph-mon[91793]: pgmap v140: 65 pgs: 14 active+undersized, 7 peering, 11 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 43/321 objects degraded (13.396%) 2024-09-19T09:08:16.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:08:16.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 bash[95091]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T09:08:16.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:08:16.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 bash[95091]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T09:08:16.510 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-19T09:08:16.510 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 bash[95091]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-19T09:08:16.510 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:08:16.510 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 bash[95091]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:08:16.510 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate[95106]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-19T09:08:16.510 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 bash[95091]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-19T09:08:16.511 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 podman[95091]: 2024-09-19 09:08:16.255370634 +0000 UTC m=+1.578111424 container died 0c31b03e6f7d6624712b452c8ecfad8fc26019a4b7c47916eccbfd6730498af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:08:17.153 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:16 smithi102 podman[95236]: 2024-09-19 09:08:16.814121973 +0000 UTC m=+0.549859995 container remove 0c31b03e6f7d6624712b452c8ecfad8fc26019a4b7c47916eccbfd6730498af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:08:17.154 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:17 smithi102 podman[95293]: 2024-09-19 09:08:16.922132629 +0000 UTC m=+0.016122034 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:08:17.154 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:17 smithi102 podman[95293]: 2024-09-19 09:08:17.031743077 +0000 UTC m=+0.125732516 container create c3556b69168eda713e12605b80dbebd6f40a49f9e4870f35b444a6a604f67063 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:08:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.508+0000 7f0fad029640 1 -- 172.21.15.49:0/3047121597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80feaf0 msgr2=0x7f0fa80feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.508+0000 7f0fad029640 1 --2- 172.21.15.49:0/3047121597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80feaf0 0x7f0fa80feef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009880 tx=0x7f0f9802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.509+0000 7f0fad029640 1 -- 172.21.15.49:0/3047121597 shutdown_connections 2024-09-19T09:08:17.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.509+0000 7f0fad029640 1 --2- 172.21.15.49:0/3047121597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80ffcf0 0x7f0fa8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.509+0000 7f0fad029640 1 --2- 172.21.15.49:0/3047121597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80feaf0 0x7f0fa80feef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.509+0000 7f0fad029640 1 -- 172.21.15.49:0/3047121597 >> 172.21.15.49:0/3047121597 conn(0x7f0fa80fa280 msgr2=0x7f0fa80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.509+0000 7f0fad029640 1 -- 172.21.15.49:0/3047121597 shutdown_connections 2024-09-19T09:08:17.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.509+0000 7f0fad029640 1 -- 172.21.15.49:0/3047121597 wait complete. 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.510+0000 7f0fad029640 1 Processor -- start 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.510+0000 7f0fad029640 1 -- start start 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.510+0000 7f0fad029640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80feaf0 0x7f0fa81956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.510+0000 7f0fad029640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80ffcf0 0x7f0fa8195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.510+0000 7f0fad029640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81961c0 con 0x7f0fa80ffcf0 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.510+0000 7f0fad029640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8196330 con 0x7f0fa80feaf0 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.510+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80ffcf0 0x7f0fa8195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80feaf0 0x7f0fa81956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80ffcf0 0x7f0fa8195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32844/0 (socket says 172.21.15.49:32844) 2024-09-19T09:08:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80feaf0 0x7f0fa81956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:56776/0 (socket says 172.21.15.49:56776) 2024-09-19T09:08:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa659c640 1 -- 172.21.15.49:0/925806902 learned_addr learned my addr 172.21.15.49:0/925806902 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa6d9d640 1 -- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80ffcf0 msgr2=0x7f0fa8195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa6d9d640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80ffcf0 0x7f0fa8195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa6d9d640 1 -- 172.21.15.49:0/925806902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009560 con 0x7f0fa80feaf0 2024-09-19T09:08:17.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0fa6d9d640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80feaf0 0x7f0fa81956b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f9802a9c0 tx=0x7f0f980055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.511+0000 7f0f8ffff640 1 -- 172.21.15.49:0/925806902 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f98040070 con 0x7f0fa80feaf0 2024-09-19T09:08:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.512+0000 7f0f8ffff640 1 -- 172.21.15.49:0/925806902 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f98005d50 con 0x7f0fa80feaf0 2024-09-19T09:08:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.512+0000 7f0f8ffff640 1 -- 172.21.15.49:0/925806902 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f98031870 con 0x7f0fa80feaf0 2024-09-19T09:08:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.512+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa81013d0 con 0x7f0fa80feaf0 2024-09-19T09:08:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.512+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa81018c0 con 0x7f0fa80feaf0 2024-09-19T09:08:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.513+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa8107700 con 0x7f0fa80feaf0 2024-09-19T09:08:17.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.513+0000 7f0f8ffff640 1 -- 172.21.15.49:0/925806902 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0f9803aa20 con 0x7f0fa80feaf0 2024-09-19T09:08:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.514+0000 7f0f8ffff640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f9006e600 0x7f0f90070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.514+0000 7f0f8ffff640 1 -- 172.21.15.49:0/925806902 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f0f980b2c70 con 0x7f0fa80feaf0 2024-09-19T09:08:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.514+0000 7f0fa659c640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f9006e600 0x7f0f90070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.514+0000 7f0fa659c640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f9006e600 0x7f0f90070ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8196bd0 tx=0x7f0f9c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.519+0000 7f0f8ffff640 1 -- 172.21.15.49:0/925806902 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0f9807bca0 con 0x7f0fa80feaf0 2024-09-19T09:08:17.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.724+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fa8061520 con 0x7f0f9006e600 2024-09-19T09:08:17.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.725+0000 7f0f8ffff640 1 -- 172.21.15.49:0/925806902 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0fa8061520 con 0x7f0f9006e600 2024-09-19T09:08:17.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f9006e600 msgr2=0x7f0f90070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f9006e600 0x7f0f90070ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8196bd0 tx=0x7f0f9c005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:17.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80feaf0 msgr2=0x7f0fa81956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80feaf0 0x7f0fa81956b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f9802a9c0 tx=0x7f0f980055a0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 shutdown_connections 2024-09-19T09:08:17.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f9006e600 0x7f0f90070ac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0fa80ffcf0 0x7f0fa8195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 --2- 172.21.15.49:0/925806902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fa80feaf0 0x7f0fa81956b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 >> 172.21.15.49:0/925806902 conn(0x7f0fa80fa280 msgr2=0x7f0fa80fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 shutdown_connections 2024-09-19T09:08:17.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.728+0000 7f0fad029640 1 -- 172.21.15.49:0/925806902 wait complete. 2024-09-19T09:08:17.738 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:08:17.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:17 smithi102 podman[95293]: 2024-09-19 09:08:17.284185431 +0000 UTC m=+0.378174827 container init c3556b69168eda713e12605b80dbebd6f40a49f9e4870f35b444a6a604f67063 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:08:17.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:17 smithi102 podman[95293]: 2024-09-19 09:08:17.287299471 +0000 UTC m=+0.381288862 container start c3556b69168eda713e12605b80dbebd6f40a49f9e4870f35b444a6a604f67063 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:08:17.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:17 smithi102 ceph-osd[95312]: -- 172.21.15.102:0/3921616082 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b551321e0 con 0x564b542dfc00 2024-09-19T09:08:17.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:17 smithi102 bash[95293]: c3556b69168eda713e12605b80dbebd6f40a49f9e4870f35b444a6a604f67063 2024-09-19T09:08:17.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:17 smithi102 systemd[1]: Started Ceph osd.4 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 -- 172.21.15.49:0/4102799735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e84103000 msgr2=0x7f5e841053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 --2- 172.21.15.49:0/4102799735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e84103000 0x7f5e841053f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009880 tx=0x7f5e7802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 -- 172.21.15.49:0/4102799735 shutdown_connections 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 --2- 172.21.15.49:0/4102799735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e84103000 0x7f5e841053f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 --2- 172.21.15.49:0/4102799735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e841006d0 0x7f5e84102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 -- 172.21.15.49:0/4102799735 >> 172.21.15.49:0/4102799735 conn(0x7f5e840fa250 msgr2=0x7f5e840fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 -- 172.21.15.49:0/4102799735 shutdown_connections 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.814+0000 7f5e893e8640 1 -- 172.21.15.49:0/4102799735 wait complete. 2024-09-19T09:08:17.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e893e8640 1 Processor -- start 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e893e8640 1 -- start start 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e893e8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e841006d0 0x7f5e840fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e893e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e84103000 0x7f5e840fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e893e8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840febc0 con 0x7f5e841006d0 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e893e8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840fed30 con 0x7f5e84103000 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e82ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e841006d0 0x7f5e840fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e82ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e841006d0 0x7f5e840fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32848/0 (socket says 172.21.15.49:32848) 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.815+0000 7f5e82ffd640 1 -- 172.21.15.49:0/3177892274 learned_addr learned my addr 172.21.15.49:0/3177892274 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e827fc640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e84103000 0x7f5e840fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e82ffd640 1 -- 172.21.15.49:0/3177892274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e84103000 msgr2=0x7f5e840fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e82ffd640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e84103000 0x7f5e840fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e82ffd640 1 -- 172.21.15.49:0/3177892274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78009560 con 0x7f5e841006d0 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e82ffd640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e841006d0 0x7f5e840fffe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d8d0 tx=0x7f5e7400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e6bfff640 1 -- 172.21.15.49:0/3177892274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e74009c00 con 0x7f5e841006d0 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e6bfff640 1 -- 172.21.15.49:0/3177892274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e74009d60 con 0x7f5e841006d0 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.816+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840ff010 con 0x7f5e841006d0 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.817+0000 7f5e6bfff640 1 -- 172.21.15.49:0/3177892274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e740049d0 con 0x7f5e841006d0 2024-09-19T09:08:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.817+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8419d6d0 con 0x7f5e841006d0 2024-09-19T09:08:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.818+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e841090e0 con 0x7f5e841006d0 2024-09-19T09:08:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.818+0000 7f5e6bfff640 1 -- 172.21.15.49:0/3177892274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5e74004c40 con 0x7f5e841006d0 2024-09-19T09:08:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.818+0000 7f5e6bfff640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e6c06e5f0 0x7f5e6c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.819+0000 7f5e6bfff640 1 -- 172.21.15.49:0/3177892274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f5e7408e4a0 con 0x7f5e841006d0 2024-09-19T09:08:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.819+0000 7f5e827fc640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e6c06e5f0 0x7f5e6c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.819+0000 7f5e827fc640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e6c06e5f0 0x7f5e6c070ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009230 tx=0x7f5e780314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:17.823+0000 7f5e6bfff640 1 -- 172.21.15.49:0/3177892274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5e740575b0 con 0x7f5e841006d0 2024-09-19T09:08:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.018+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e84103a40 con 0x7f5e6c06e5f0 2024-09-19T09:08:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.020+0000 7f5e6bfff640 1 -- 172.21.15.49:0/3177892274 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5e84103a40 con 0x7f5e6c06e5f0 2024-09-19T09:08:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e6c06e5f0 msgr2=0x7f5e6c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e6c06e5f0 0x7f5e6c070ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009230 tx=0x7f5e780314e0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e841006d0 msgr2=0x7f5e840fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e841006d0 0x7f5e840fffe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d8d0 tx=0x7f5e7400dd90 comp rx=0 tx=0).stop 2024-09-19T09:08:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 shutdown_connections 2024-09-19T09:08:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e6c06e5f0 0x7f5e6c070ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e84103000 0x7f5e840fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 --2- 172.21.15.49:0/3177892274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e841006d0 0x7f5e840fffe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 >> 172.21.15.49:0/3177892274 conn(0x7f5e840fa250 msgr2=0x7f5e840fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 shutdown_connections 2024-09-19T09:08:18.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.022+0000 7f5e893e8640 1 -- 172.21.15.49:0/3177892274 wait complete. 2024-09-19T09:08:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/449115068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 msgr2=0x7f9f9c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/449115068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c0fff90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009880 tx=0x7f9f8c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/449115068 shutdown_connections 2024-09-19T09:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/449115068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f9c100d90 0x7f9f9c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/449115068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c0fff90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/449115068 >> 172.21.15.49:0/449115068 conn(0x7f9f9c0fb320 msgr2=0x7f9f9c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/449115068 shutdown_connections 2024-09-19T09:08:18.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.106+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/449115068 wait complete. 2024-09-19T09:08:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9fa0fb8640 1 Processor -- start 2024-09-19T09:08:18.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9fa0fb8640 1 -- start start 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9fa0fb8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9fa0fb8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f9c100d90 0x7f9f9c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9fa0fb8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c198380 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9fa0fb8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c1984f0 con 0x7f9f9c100d90 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9f9a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9f9a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32858/0 (socket says 172.21.15.49:32858) 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9f9a59c640 1 -- 172.21.15.49:0/3717006755 learned_addr learned my addr 172.21.15.49:0/3717006755 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.107+0000 7f9f99d9b640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f9c100d90 0x7f9f9c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9f9a59c640 1 -- 172.21.15.49:0/3717006755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f9c100d90 msgr2=0x7f9f9c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9f9a59c640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f9c100d90 0x7f9f9c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9f9a59c640 1 -- 172.21.15.49:0/3717006755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c009560 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9f9a59c640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c197870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c004650 tx=0x7f9f8c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:18.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9f937fe640 1 -- 172.21.15.49:0/3717006755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8c004aa0 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c19cf30 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9f937fe640 1 -- 172.21.15.49:0/3717006755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f8c005d50 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9f937fe640 1 -- 172.21.15.49:0/3717006755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8c0039e0 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.108+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c19d420 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.109+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c1056d0 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.110+0000 7f9f937fe640 1 -- 172.21.15.49:0/3717006755 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9f8c031c00 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.110+0000 7f9f937fe640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9f8806e5f0 0x7f9f88070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.111+0000 7f9f937fe640 1 -- 172.21.15.49:0/3717006755 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f9f8c0af7d0 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.111+0000 7f9f99d9b640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9f8806e5f0 0x7f9f88070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.111+0000 7f9f99d9b640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9f8806e5f0 0x7f9f88070ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c198d90 tx=0x7f9f84005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:18.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.115+0000 7f9f937fe640 1 -- 172.21.15.49:0/3717006755 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9f8c078910 con 0x7f9f9c0ffb90 2024-09-19T09:08:18.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.299+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f9c02c4f0 con 0x7f9f8806e5f0 2024-09-19T09:08:18.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.315+0000 7f9f937fe640 1 -- 172.21.15.49:0/3717006755 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9f9c02c4f0 con 0x7f9f8806e5f0 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (12m) 62s ago 13m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (14m) 62s ago 14m 8933k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (13m) 30s ago 13m 8280k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (2m) 62s ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (2m) 30s ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (12m) 62s ago 13m 84.1M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (8m) 62s ago 8m 92.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (8m) 62s ago 8m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (8m) 30s ago 8m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:08:18.317 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (8m) 30s ago 8m 27.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (5m) 62s ago 15m 500M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (4m) 30s ago 12m 441M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (3m) 62s ago 15m 48.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (3m) 30s ago 12m 39.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (13m) 62s ago 13m 15.6M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (12m) 30s ago 12m 16.6M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (2m) 62s ago 12m 83.7M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (103s) 62s ago 11m 86.0M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (67s) 62s ago 11m 12.1M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (33s) 30s ago 10m 11.5M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 starting - - - 2240M 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (9m) 30s ago 9m 214M 2240M 18.2.4-855-g19e2a2be 980a0bfcd684 779fd5269f24 2024-09-19T09:08:18.318 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (4m) 62s ago 13m 60.5M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9f8806e5f0 msgr2=0x7f9f88070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9f8806e5f0 0x7f9f88070ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c198d90 tx=0x7f9f84005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 msgr2=0x7f9f9c197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c197870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c004650 tx=0x7f9f8c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 shutdown_connections 2024-09-19T09:08:18.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9f8806e5f0 0x7f9f88070ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f9c100d90 0x7f9f9c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 --2- 172.21.15.49:0/3717006755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f9c0ffb90 0x7f9f9c197870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 >> 172.21.15.49:0/3717006755 conn(0x7f9f9c0fb320 msgr2=0x7f9f9c072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.317+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 shutdown_connections 2024-09-19T09:08:18.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.318+0000 7f9fa0fb8640 1 -- 172.21.15.49:0/3717006755 wait complete. 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.400+0000 7fa5b05a5640 1 -- 172.21.15.49:0/3130889800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 msgr2=0x7fa5a8102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.400+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/3130889800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8102a20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5980098b0 tx=0x7fa59802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.400+0000 7fa5b05a5640 1 -- 172.21.15.49:0/3130889800 shutdown_connections 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.400+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/3130889800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8102f60 0x7fa5a8105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.400+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/3130889800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8102a20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.400+0000 7fa5b05a5640 1 -- 172.21.15.49:0/3130889800 >> 172.21.15.49:0/3130889800 conn(0x7fa5a80fa250 msgr2=0x7fa5a80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.401+0000 7fa5b05a5640 1 -- 172.21.15.49:0/3130889800 shutdown_connections 2024-09-19T09:08:18.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.401+0000 7fa5b05a5640 1 -- 172.21.15.49:0/3130889800 wait complete. 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.401+0000 7fa5b05a5640 1 Processor -- start 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.401+0000 7fa5b05a5640 1 -- start start 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5b05a5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5b05a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8102f60 0x7fa5a8195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5b05a5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8196150 con 0x7fa5a8100630 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5b05a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81962c0 con 0x7fa5a8102f60 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5ae341640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5ae341640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32876/0 (socket says 172.21.15.49:32876) 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5ae341640 1 -- 172.21.15.49:0/45233403 learned_addr learned my addr 172.21.15.49:0/45233403 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:18.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5adb40640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8102f60 0x7fa5a8195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5ae341640 1 -- 172.21.15.49:0/45233403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8102f60 msgr2=0x7fa5a8195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5ae341640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8102f60 0x7fa5a8195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5ae341640 1 -- 172.21.15.49:0/45233403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa598009560 con 0x7fa5a8100630 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5adb40640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8102f60 0x7fa5a8195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.402+0000 7fa5ae341640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8195640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa5980054f0 tx=0x7fa598005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.403+0000 7fa59f7fe640 1 -- 172.21.15.49:0/45233403 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa598004aa0 con 0x7fa5a8100630 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.403+0000 7fa59f7fe640 1 -- 172.21.15.49:0/45233403 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa598004c00 con 0x7fa5a8100630 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.403+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a819ad00 con 0x7fa5a8100630 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.403+0000 7fa59f7fe640 1 -- 172.21.15.49:0/45233403 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa598003b10 con 0x7fa5a8100630 2024-09-19T09:08:18.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.403+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a819b220 con 0x7fa5a8100630 2024-09-19T09:08:18.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.404+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a81087c0 con 0x7fa5a8100630 2024-09-19T09:08:18.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.404+0000 7fa59f7fe640 1 -- 172.21.15.49:0/45233403 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa598003d80 con 0x7fa5a8100630 2024-09-19T09:08:18.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.405+0000 7fa59f7fe640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa59406e5f0 0x7fa594070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.405+0000 7fa59f7fe640 1 -- 172.21.15.49:0/45233403 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6596+0+0 (secure 0 0 0) 0x7fa5980af850 con 0x7fa5a8100630 2024-09-19T09:08:18.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.405+0000 7fa5adb40640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa59406e5f0 0x7fa594070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.406+0000 7fa5adb40640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa59406e5f0 0x7fa594070ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40058c0 tx=0x7fa5a4005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:18.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.409+0000 7fa59f7fe640 1 -- 172.21.15.49:0/45233403 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa598078960 con 0x7fa5a8100630 2024-09-19T09:08:18.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.655+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5a819b740 con 0x7fa5a8100630 2024-09-19T09:08:18.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:18 smithi049 ceph-mon[91793]: pgmap v141: 65 pgs: 14 active+undersized, 7 peering, 11 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/321 objects degraded (13.396%) 2024-09-19T09:08:18.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:18.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:18.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.656+0000 7fa59f7fe640 1 -- 172.21.15.49:0/45233403 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fa59807c020 con 0x7fa5a8100630 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:08:18.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 5, 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 8 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:08:18.659 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:08:18.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa59406e5f0 msgr2=0x7fa594070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa59406e5f0 0x7fa594070ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40058c0 tx=0x7fa5a4005850 comp rx=0 tx=0).stop 2024-09-19T09:08:18.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 msgr2=0x7fa5a8195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8195640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa5980054f0 tx=0x7fa598005520 comp rx=0 tx=0).stop 2024-09-19T09:08:18.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 shutdown_connections 2024-09-19T09:08:18.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fa59406e5f0 0x7fa594070ab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a8102f60 0x7fa5a8195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 --2- 172.21.15.49:0/45233403 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa5a8100630 0x7fa5a8195640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 >> 172.21.15.49:0/45233403 conn(0x7fa5a80fa250 msgr2=0x7fa5a80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:18.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.658+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 shutdown_connections 2024-09-19T09:08:18.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.659+0000 7fa5b05a5640 1 -- 172.21.15.49:0/45233403 wait complete. 2024-09-19T09:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.743+0000 7fabebc67640 1 -- 172.21.15.49:0/4137503808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 msgr2=0x7fabe4102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.743+0000 7fabebc67640 1 --2- 172.21.15.49:0/4137503808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe4102a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fabe00098b0 tx=0x7fabe002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.743+0000 7fabebc67640 1 -- 172.21.15.49:0/4137503808 shutdown_connections 2024-09-19T09:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.743+0000 7fabebc67640 1 --2- 172.21.15.49:0/4137503808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe4102fb0 0x7fabe41053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.743+0000 7fabebc67640 1 --2- 172.21.15.49:0/4137503808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe4102a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.743+0000 7fabebc67640 1 -- 172.21.15.49:0/4137503808 >> 172.21.15.49:0/4137503808 conn(0x7fabe40fa280 msgr2=0x7fabe40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 -- 172.21.15.49:0/4137503808 shutdown_connections 2024-09-19T09:08:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 -- 172.21.15.49:0/4137503808 wait complete. 2024-09-19T09:08:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 Processor -- start 2024-09-19T09:08:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 -- start start 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe40fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe4102fb0 0x7fabe40fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40feb70 con 0x7fabe4100680 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.744+0000 7fabebc67640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40fece0 con 0x7fabe4102fb0 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9a03640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe40fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9a03640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe40fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32900/0 (socket says 172.21.15.49:32900) 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9a03640 1 -- 172.21.15.49:0/1321472012 learned_addr learned my addr 172.21.15.49:0/1321472012 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9202640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe4102fb0 0x7fabe40fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9a03640 1 -- 172.21.15.49:0/1321472012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe4102fb0 msgr2=0x7fabe40fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9a03640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe4102fb0 0x7fabe40fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9a03640 1 -- 172.21.15.49:0/1321472012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009560 con 0x7fabe4100680 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabe9a03640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe40fffe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fabe002a9f0 tx=0x7fabe00054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabdaffd640 1 -- 172.21.15.49:0/1321472012 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe0004aa0 con 0x7fabe4100680 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe40fef60 con 0x7fabe4100680 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabdaffd640 1 -- 172.21.15.49:0/1321472012 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabe0004c00 con 0x7fabe4100680 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabdaffd640 1 -- 172.21.15.49:0/1321472012 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe0003a80 con 0x7fabe4100680 2024-09-19T09:08:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.745+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe40ff450 con 0x7fabe4100680 2024-09-19T09:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.746+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe4100a60 con 0x7fabe4100680 2024-09-19T09:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.747+0000 7fabdaffd640 1 -- 172.21.15.49:0/1321472012 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fabe0003d40 con 0x7fabe4100680 2024-09-19T09:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.747+0000 7fabdaffd640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fabd006e600 0x7fabd0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.747+0000 7fabdaffd640 1 -- 172.21.15.49:0/1321472012 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6596+0+0 (secure 0 0 0) 0x7fabe00af940 con 0x7fabe4100680 2024-09-19T09:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.748+0000 7fabe9202640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fabd006e600 0x7fabd0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:18.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.748+0000 7fabe9202640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fabd006e600 0x7fabd0070ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabe40ffd60 tx=0x7fabd400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:18.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.752+0000 7fabdaffd640 1 -- 172.21.15.49:0/1321472012 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fabe0078a80 con 0x7fabe4100680 2024-09-19T09:08:18.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:18 smithi102 ceph-mon[80875]: pgmap v141: 65 pgs: 14 active+undersized, 7 peering, 11 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/321 objects degraded (13.396%) 2024-09-19T09:08:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:18.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.963+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fabe419d930 con 0x7fabe4100680 2024-09-19T09:08:18.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.964+0000 7fabdaffd640 1 -- 172.21.15.49:0/1321472012 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7fabe007c140 con 0x7fabe4100680 2024-09-19T09:08:18.965 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:08:18.965 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:08:18.966 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:08:18.967 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:08:18.968 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:08:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:08:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fabd006e600 msgr2=0x7fabd0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fabd006e600 0x7fabd0070ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabe40ffd60 tx=0x7fabd400b390 comp rx=0 tx=0).stop 2024-09-19T09:08:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 msgr2=0x7fabe40fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe40fffe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fabe002a9f0 tx=0x7fabe00054f0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 shutdown_connections 2024-09-19T09:08:18.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fabd006e600 0x7fabd0070ac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe4102fb0 0x7fabe40fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 --2- 172.21.15.49:0/1321472012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fabe4100680 0x7fabe40fffe0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:18.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 >> 172.21.15.49:0/1321472012 conn(0x7fabe40fa280 msgr2=0x7fabe40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:18.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 shutdown_connections 2024-09-19T09:08:18.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:18.966+0000 7fabebc67640 1 -- 172.21.15.49:0/1321472012 wait complete. 2024-09-19T09:08:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 -- 172.21.15.49:0/2692477726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 msgr2=0x7f22700feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 --2- 172.21.15.49:0/2692477726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22700feef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f226c009880 tx=0x7f226c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 -- 172.21.15.49:0/2692477726 shutdown_connections 2024-09-19T09:08:19.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 --2- 172.21.15.49:0/2692477726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22700ffcf0 0x7f2270100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 --2- 172.21.15.49:0/2692477726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22700feef0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 -- 172.21.15.49:0/2692477726 >> 172.21.15.49:0/2692477726 conn(0x7f22700fa280 msgr2=0x7f22700fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 -- 172.21.15.49:0/2692477726 shutdown_connections 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 -- 172.21.15.49:0/2692477726 wait complete. 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 Processor -- start 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.051+0000 7f2278074640 1 -- start start 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2278074640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22701956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2278074640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22700ffcf0 0x7f2270195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2278074640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22701961c0 con 0x7f22700feaf0 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2278074640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270196330 con 0x7f22700ffcf0 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2275e10640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22701956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:19.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2275e10640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22701956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32928/0 (socket says 172.21.15.49:32928) 2024-09-19T09:08:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2275e10640 1 -- 172.21.15.49:0/893521109 learned_addr learned my addr 172.21.15.49:0/893521109 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f227560f640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22700ffcf0 0x7f2270195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2275e10640 1 -- 172.21.15.49:0/893521109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22700ffcf0 msgr2=0x7f2270195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2275e10640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22700ffcf0 0x7f2270195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2275e10640 1 -- 172.21.15.49:0/893521109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009560 con 0x7f22700feaf0 2024-09-19T09:08:19.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2275e10640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22701956b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f226c0054f0 tx=0x7f226c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.052+0000 7f2266ffd640 1 -- 172.21.15.49:0/893521109 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c004aa0 con 0x7f22700feaf0 2024-09-19T09:08:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.053+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227019ad70 con 0x7f22700feaf0 2024-09-19T09:08:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.053+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227019b200 con 0x7f22700feaf0 2024-09-19T09:08:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.053+0000 7f2266ffd640 1 -- 172.21.15.49:0/893521109 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f226c004c00 con 0x7f22700feaf0 2024-09-19T09:08:19.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.053+0000 7f2266ffd640 1 -- 172.21.15.49:0/893521109 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f226c003a80 con 0x7f22700feaf0 2024-09-19T09:08:19.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.053+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22701076e0 con 0x7f22700feaf0 2024-09-19T09:08:19.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.054+0000 7f2266ffd640 1 -- 172.21.15.49:0/893521109 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f226c031c90 con 0x7f22700feaf0 2024-09-19T09:08:19.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.054+0000 7f2266ffd640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f225c06e5f0 0x7f225c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:19.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.055+0000 7f2266ffd640 1 -- 172.21.15.49:0/893521109 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f226c0af8b0 con 0x7f22700feaf0 2024-09-19T09:08:19.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.055+0000 7f227560f640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f225c06e5f0 0x7f225c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:19.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.055+0000 7f227560f640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f225c06e5f0 0x7f225c070ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2270196bd0 tx=0x7f226000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:19.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.059+0000 7f2266ffd640 1 -- 172.21.15.49:0/893521109 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f226c078a70 con 0x7f22700feaf0 2024-09-19T09:08:19.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.251+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f227019b440 con 0x7f225c06e5f0 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.253+0000 7f2266ffd640 1 -- 172.21.15.49:0/893521109 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f227019b440 con 0x7f225c06e5f0 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:08:19.254 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:08:19.255 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:08:19.255 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "10/23 daemons upgraded", 2024-09-19T09:08:19.255 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:08:19.255 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:08:19.255 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:08:19.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f225c06e5f0 msgr2=0x7f225c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f225c06e5f0 0x7f225c070ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2270196bd0 tx=0x7f226000b390 comp rx=0 tx=0).stop 2024-09-19T09:08:19.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 msgr2=0x7f22701956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22701956b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f226c0054f0 tx=0x7f226c005520 comp rx=0 tx=0).stop 2024-09-19T09:08:19.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 shutdown_connections 2024-09-19T09:08:19.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f225c06e5f0 0x7f225c070ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22700ffcf0 0x7f2270195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 --2- 172.21.15.49:0/893521109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22700feaf0 0x7f22701956b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 >> 172.21.15.49:0/893521109 conn(0x7f22700fa280 msgr2=0x7f2270067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:19.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 shutdown_connections 2024-09-19T09:08:19.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.255+0000 7f2278074640 1 -- 172.21.15.49:0/893521109 wait complete. 2024-09-19T09:08:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.338+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3713287455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 msgr2=0x7f7f841012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.338+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3713287455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f841012b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009880 tx=0x7f7f7802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.338+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3713287455 shutdown_connections 2024-09-19T09:08:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.338+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3713287455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f841012b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.338+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3713287455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f840fde50 0x7f7f840fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.338+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3713287455 >> 172.21.15.49:0/3713287455 conn(0x7f7f840f99c0 msgr2=0x7f7f840fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3713287455 shutdown_connections 2024-09-19T09:08:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3713287455 wait complete. 2024-09-19T09:08:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 Processor -- start 2024-09-19T09:08:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 -- start start 2024-09-19T09:08:19.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f840fde50 0x7f7f84100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:19.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f840fede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:19.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84100cd0 con 0x7f7f84100e30 2024-09-19T09:08:19.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.339+0000 7f7f8ab88640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840ff350 con 0x7f7f840fde50 2024-09-19T09:08:19.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f840fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f840fede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32938/0 (socket says 172.21.15.49:32938) 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f83fff640 1 -- 172.21.15.49:0/3326049931 learned_addr learned my addr 172.21.15.49:0/3326049931 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f88924640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f840fde50 0x7f7f84100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f83fff640 1 -- 172.21.15.49:0/3326049931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f840fde50 msgr2=0x7f7f84100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f83fff640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f840fde50 0x7f7f84100790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f83fff640 1 -- 172.21.15.49:0/3326049931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78009560 con 0x7f7f84100e30 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f83fff640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f840fede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f78005610 tx=0x7f7f78005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f81ffb640 1 -- 172.21.15.49:0/3326049931 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f78004ba0 con 0x7f7f84100e30 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f81ffb640 1 -- 172.21.15.49:0/3326049931 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f78004d00 con 0x7f7f84100e30 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f81ffb640 1 -- 172.21.15.49:0/3326049931 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f78003bd0 con 0x7f7f84100e30 2024-09-19T09:08:19.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.340+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f840ff5d0 con 0x7f7f84100e30 2024-09-19T09:08:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.341+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f840ffb40 con 0x7f7f84100e30 2024-09-19T09:08:19.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.342+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8418f700 con 0x7f7f84100e30 2024-09-19T09:08:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.342+0000 7f7f81ffb640 1 -- 172.21.15.49:0/3326049931 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7f78031640 con 0x7f7f84100e30 2024-09-19T09:08:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.342+0000 7f7f81ffb640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7f6c06e5f0 0x7f7f6c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.343+0000 7f7f81ffb640 1 -- 172.21.15.49:0/3326049931 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f7f780afa60 con 0x7f7f84100e30 2024-09-19T09:08:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.343+0000 7f7f88924640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7f6c06e5f0 0x7f7f6c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:19.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.343+0000 7f7f88924640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7f6c06e5f0 0x7f7f6c070ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f84068250 tx=0x7f7f74005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:19.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.347+0000 7f7f81ffb640 1 -- 172.21.15.49:0/3326049931 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7f78078ba0 con 0x7f7f84100e30 2024-09-19T09:08:19.459 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:19 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:08:19.171+0000 7f6c78271640 -1 Falling back to public interface 2024-09-19T09:08:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:19 smithi049 ceph-mon[91793]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:19 smithi049 ceph-mon[91793]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:19.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:19 smithi049 ceph-mon[91793]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:19.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:19 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/45233403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:19.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:19 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1321472012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:08:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.591+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f84108770 con 0x7f7f84100e30 2024-09-19T09:08:19.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.591+0000 7f7f81ffb640 1 -- 172.21.15.49:0/3326049931 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1296 (secure 0 0 0) 0x7f7f7807c260 con 0x7f7f84100e30 2024-09-19T09:08:19.592 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: osd.4 (root=default,host=smithi102) is down 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.9 is active+undersized+degraded, acting [1,3] 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-19T09:08:19.593 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-19T09:08:19.594 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-19T09:08:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7f6c06e5f0 msgr2=0x7f7f6c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7f6c06e5f0 0x7f7f6c070ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f84068250 tx=0x7f7f74005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 msgr2=0x7f7f840fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:19.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f840fede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f78005610 tx=0x7f7f78005640 comp rx=0 tx=0).stop 2024-09-19T09:08:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 shutdown_connections 2024-09-19T09:08:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7f6c06e5f0 0x7f7f6c070ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f84100e30 0x7f7f840fede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 --2- 172.21.15.49:0/3326049931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f840fde50 0x7f7f84100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 >> 172.21.15.49:0/3326049931 conn(0x7f7f840f99c0 msgr2=0x7f7f841044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 shutdown_connections 2024-09-19T09:08:19.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:19.593+0000 7f7f8ab88640 1 -- 172.21.15.49:0/3326049931 wait complete. 2024-09-19T09:08:19.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:19 smithi102 ceph-mon[80875]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:19 smithi102 ceph-mon[80875]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:19 smithi102 ceph-mon[80875]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:19 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/45233403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:19.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:19 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1321472012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:08:20.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:20 smithi102 ceph-mon[80875]: pgmap v142: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:20 smithi102 ceph-mon[80875]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:20 smithi102 ceph-mon[80875]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-19T09:08:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:20 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3326049931' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:08:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:20.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:20 smithi049 ceph-mon[91793]: pgmap v142: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:20 smithi049 ceph-mon[91793]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:20 smithi049 ceph-mon[91793]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-19T09:08:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:20 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3326049931' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:08:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:22.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:21 smithi049 ceph-mon[91793]: pgmap v143: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:22.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:22.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:22.229 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:21 smithi102 ceph-mon[80875]: pgmap v143: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:22.229 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:22.229 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:23.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:22 smithi102 ceph-mon[80875]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:23.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:22 smithi049 ceph-mon[91793]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:23.994 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:23 smithi102 ceph-mon[80875]: pgmap v144: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:24.167 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:23 smithi049 ceph-mon[91793]: pgmap v144: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:25.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:25.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:25.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:25.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:25.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:25 smithi049 ceph-mon[91793]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:08:25.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:08:25.053+0000 7f6c78271640 -1 osd.4 78 log_to_monitors true 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:25.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:25.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:25.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:25.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:25.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:25 smithi102 ceph-mon[80875]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T09:08:26.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:26 smithi049 ceph-mon[91793]: pgmap v145: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:26.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:26 smithi049 ceph-mon[91793]: from='osd.4 [v2:172.21.15.102:6808/285057847,v1:172.21.15.102:6809/285057847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:08:26.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:26 smithi049 ceph-mon[91793]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:08:26.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:08:26 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:08:26.070+0000 7f6c6c003640 -1 osd.4 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:08:26.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:26 smithi102 ceph-mon[80875]: pgmap v145: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:26.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:26 smithi102 ceph-mon[80875]: from='osd.4 [v2:172.21.15.102:6808/285057847,v1:172.21.15.102:6809/285057847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:08:26.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:26 smithi102 ceph-mon[80875]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:08:27.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:27 smithi049 ceph-mon[91793]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:08:27.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:27 smithi049 ceph-mon[91793]: osdmap e81: 6 total, 5 up, 6 in 2024-09-19T09:08:27.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:27 smithi049 ceph-mon[91793]: from='osd.4 [v2:172.21.15.102:6808/285057847,v1:172.21.15.102:6809/285057847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:27.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:27 smithi049 ceph-mon[91793]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:27.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:27 smithi102 ceph-mon[80875]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:08:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:27 smithi102 ceph-mon[80875]: osdmap e81: 6 total, 5 up, 6 in 2024-09-19T09:08:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:27 smithi102 ceph-mon[80875]: from='osd.4 [v2:172.21.15.102:6808/285057847,v1:172.21.15.102:6809/285057847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:27.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:27 smithi102 ceph-mon[80875]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:28.469 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: pgmap v147: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:28.470 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:08:28.470 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: osd.4 [v2:172.21.15.102:6808/285057847,v1:172.21.15.102:6809/285057847] boot 2024-09-19T09:08:28.470 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: osdmap e82: 6 total, 6 up, 6 in 2024-09-19T09:08:28.470 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:08:28.470 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:28.470 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:28.470 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:28 smithi102 ceph-mon[80875]: osdmap e83: 6 total, 6 up, 6 in 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: pgmap v147: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: osd.4 [v2:172.21.15.102:6808/285057847,v1:172.21.15.102:6809/285057847] boot 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: osdmap e82: 6 total, 6 up, 6 in 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:28 smithi049 ceph-mon[91793]: osdmap e83: 6 total, 6 up, 6 in 2024-09-19T09:08:29.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:29 smithi102 ceph-mon[80875]: Health check update: Degraded data redundancy: 15/321 objects degraded (4.673%), 6 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:29.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:29 smithi049 ceph-mon[91793]: Health check update: Degraded data redundancy: 15/321 objects degraded (4.673%), 6 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:30.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:30 smithi102 ceph-mon[80875]: pgmap v150: 65 pgs: 5 peering, 6 active+undersized, 6 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5 op/s; 15/321 objects degraded (4.673%) 2024-09-19T09:08:30.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:30 smithi049 ceph-mon[91793]: pgmap v150: 65 pgs: 5 peering, 6 active+undersized, 6 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5 op/s; 15/321 objects degraded (4.673%) 2024-09-19T09:08:32.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:32 smithi102 ceph-mon[80875]: pgmap v151: 65 pgs: 5 peering, 3 active+undersized, 2 active+undersized+degraded, 55 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 5/321 objects degraded (1.558%) 2024-09-19T09:08:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:32 smithi049 ceph-mon[91793]: pgmap v151: 65 pgs: 5 peering, 3 active+undersized, 2 active+undersized+degraded, 55 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 5/321 objects degraded (1.558%) 2024-09-19T09:08:33.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:33 smithi102 ceph-mon[80875]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded) 2024-09-19T09:08:33.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:33 smithi049 ceph-mon[91793]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded) 2024-09-19T09:08:34.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:34 smithi102 ceph-mon[80875]: pgmap v152: 65 pgs: 5 peering, 60 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T09:08:34.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:34 smithi049 ceph-mon[91793]: pgmap v152: 65 pgs: 5 peering, 60 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-19T09:08:36.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:36 smithi102 ceph-mon[80875]: pgmap v153: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:08:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:36 smithi049 ceph-mon[91793]: pgmap v153: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:08:38.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:38 smithi102 ceph-mon[80875]: pgmap v154: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:08:38.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:38 smithi049 ceph-mon[91793]: pgmap v154: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:08:40.452 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:40 smithi102 ceph-mon[80875]: pgmap v155: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:08:40.452 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:40.452 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:40 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:40.452 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:40 smithi102 ceph-mon[80875]: Upgrade: osd.5 is safe to restart 2024-09-19T09:08:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:40 smithi049 ceph-mon[91793]: pgmap v155: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:08:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:40 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T09:08:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:40 smithi049 ceph-mon[91793]: Upgrade: osd.5 is safe to restart 2024-09-19T09:08:41.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:41 smithi102 ceph-mon[80875]: Upgrade: Updating osd.5 2024-09-19T09:08:41.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:41.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:08:41.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:41.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:41 smithi102 ceph-mon[80875]: Deploying daemon osd.5 on smithi102 2024-09-19T09:08:41.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:41 smithi049 ceph-mon[91793]: Upgrade: Updating osd.5 2024-09-19T09:08:41.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:41.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:08:41.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:41.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:41 smithi049 ceph-mon[91793]: Deploying daemon osd.5 on smithi102 2024-09-19T09:08:42.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:42 smithi102 ceph-mon[80875]: pgmap v156: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:08:42.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:42 smithi049 ceph-mon[91793]: pgmap v156: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:08:43.508 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:43 smithi102 systemd[1]: Stopping Ceph osd.5 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:43.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:43 smithi049 ceph-mon[91793]: pgmap v157: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:08:43.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:43.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:43.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:43.854 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:43 smithi102 ceph-mon[80875]: pgmap v157: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:08:43.854 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:43.854 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:43.854 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:43.854 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[54982]: 2024-09-19T09:08:43.646+0000 7faaf427c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:43.855 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[54982]: 2024-09-19T09:08:43.646+0000 7faaf427c640 -1 osd.5 83 *** Got signal Terminated *** 2024-09-19T09:08:43.855 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[54982]: 2024-09-19T09:08:43.646+0000 7faaf427c640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:08:44.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:44 smithi049 ceph-mon[91793]: osd.5 marked itself down and dead 2024-09-19T09:08:44.988 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:44 smithi102 ceph-mon[80875]: osd.5 marked itself down and dead 2024-09-19T09:08:45.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:44 smithi102 podman[100177]: 2024-09-19 09:08:44.98876121 +0000 UTC m=+1.445692881 container died 779fd5269f24ec1dc606db0ca367200a902cf8259c43c491b9ccb047c8db1254 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:08:45.542 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:45 smithi102 podman[100177]: 2024-09-19 09:08:45.321380598 +0000 UTC m=+1.778312254 container cleanup 779fd5269f24ec1dc606db0ca367200a902cf8259c43c491b9ccb047c8db1254 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:08:45.542 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:45 smithi102 bash[100177]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:08:45.542 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:45 smithi102 podman[100202]: 2024-09-19 09:08:45.506129562 +0000 UTC m=+0.516648820 container remove 779fd5269f24ec1dc606db0ca367200a902cf8259c43c491b9ccb047c8db1254 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:08:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:45 smithi049 ceph-mon[91793]: pgmap v158: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:45 smithi049 ceph-mon[91793]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:08:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:45 smithi049 ceph-mon[91793]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-19T09:08:45.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:45 smithi049 ceph-mon[91793]: osdmap e84: 6 total, 5 up, 6 in 2024-09-19T09:08:45.941 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:45 smithi102 ceph-mon[80875]: pgmap v158: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:45.942 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:45 smithi102 ceph-mon[80875]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T09:08:45.942 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:45 smithi102 ceph-mon[80875]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-19T09:08:45.942 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:45 smithi102 ceph-mon[80875]: osdmap e84: 6 total, 5 up, 6 in 2024-09-19T09:08:46.234 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:45 smithi102 podman[100294]: 2024-09-19 09:08:45.844564218 +0000 UTC m=+0.015785157 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:08:46.234 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:45 smithi102 podman[100294]: 2024-09-19 09:08:45.965557877 +0000 UTC m=+0.136778846 container create 46d5dddea4e854d727b90d50c99633ece4c4ac80ac3c1b39b867d9bc087fafb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:08:46.235 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 podman[100294]: 2024-09-19 09:08:46.15964177 +0000 UTC m=+0.330862700 container init 46d5dddea4e854d727b90d50c99633ece4c4ac80ac3c1b39b867d9bc087fafb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T09:08:46.235 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 podman[100294]: 2024-09-19 09:08:46.162938376 +0000 UTC m=+0.334159303 container start 46d5dddea4e854d727b90d50c99633ece4c4ac80ac3c1b39b867d9bc087fafb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T09:08:46.235 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 podman[100294]: 2024-09-19 09:08:46.234561682 +0000 UTC m=+0.405782613 container attach 46d5dddea4e854d727b90d50c99633ece4c4ac80ac3c1b39b867d9bc087fafb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:08:46.509 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 podman[100294]: 2024-09-19 09:08:46.354602008 +0000 UTC m=+0.525822931 container died 46d5dddea4e854d727b90d50c99633ece4c4ac80ac3c1b39b867d9bc087fafb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:08:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:46 smithi049 ceph-mon[91793]: osdmap e85: 6 total, 5 up, 6 in 2024-09-19T09:08:46.938 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:46 smithi102 ceph-mon[80875]: osdmap e85: 6 total, 5 up, 6 in 2024-09-19T09:08:47.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 podman[100317]: 2024-09-19 09:08:46.938353184 +0000 UTC m=+0.577379869 container remove 46d5dddea4e854d727b90d50c99633ece4c4ac80ac3c1b39b867d9bc087fafb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T09:08:47.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-19T09:08:47.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 systemd[1]: Stopped Ceph osd.5 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:08:47.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:46 smithi102 systemd[1]: ceph-63845326-7664-11ef-bceb-c7b262605968@osd.5.service: Consumed 53.016s CPU time. 2024-09-19T09:08:47.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 systemd[1]: Starting Ceph osd.5 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:47.634 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:47 smithi102 ceph-mon[80875]: pgmap v161: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 10/321 objects degraded (3.115%) 2024-09-19T09:08:47.634 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:47 smithi102 ceph-mon[80875]: Health check failed: Degraded data redundancy: 10/321 objects degraded (3.115%), 3 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:47.634 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 podman[100417]: 2024-09-19 09:08:47.27665051 +0000 UTC m=+0.015832406 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:08:47.634 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 podman[100417]: 2024-09-19 09:08:47.38150225 +0000 UTC m=+0.120684148 container create 971ff2ab766373618e4fa07c310fd40d670cf1cf2cbc9efe5f693d842179221a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:08:47.634 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 podman[100417]: 2024-09-19 09:08:47.634250647 +0000 UTC m=+0.373432548 container init 971ff2ab766373618e4fa07c310fd40d670cf1cf2cbc9efe5f693d842179221a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:08:47.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:47 smithi049 ceph-mon[91793]: pgmap v161: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 10/321 objects degraded (3.115%) 2024-09-19T09:08:47.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:47 smithi049 ceph-mon[91793]: Health check failed: Degraded data redundancy: 10/321 objects degraded (3.115%), 3 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:48.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 podman[100417]: 2024-09-19 09:08:47.637750995 +0000 UTC m=+0.376932895 container start 971ff2ab766373618e4fa07c310fd40d670cf1cf2cbc9efe5f693d842179221a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:08:48.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 podman[100417]: 2024-09-19 09:08:47.717590715 +0000 UTC m=+0.456772626 container attach 971ff2ab766373618e4fa07c310fd40d670cf1cf2cbc9efe5f693d842179221a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:08:48.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:48.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 bash[100417]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:48.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:48.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:47 smithi102 bash[100417]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T09:08:48.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:08:48.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 bash[100417]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:08:48.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:08:48.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 bash[100417]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T09:08:49.104 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 bash[100417]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 bash[100417]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 bash[100417]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 bash[100417]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate[100431]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 bash[100417]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-19T09:08:49.105 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:48 smithi102 podman[100417]: 2024-09-19 09:08:48.820507513 +0000 UTC m=+1.559689421 container died 971ff2ab766373618e4fa07c310fd40d670cf1cf2cbc9efe5f693d842179221a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T09:08:49.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.688+0000 7ff6f53c3640 1 -- 172.21.15.49:0/1354282302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00feaa0 msgr2=0x7ff6f00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.688+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/1354282302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00feaa0 0x7ff6f00feea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009880 tx=0x7ff6e002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.689+0000 7ff6f53c3640 1 -- 172.21.15.49:0/1354282302 shutdown_connections 2024-09-19T09:08:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.689+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/1354282302 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6f00ffca0 0x7ff6f0100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.689+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/1354282302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00feaa0 0x7ff6f00feea0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.689+0000 7ff6f53c3640 1 -- 172.21.15.49:0/1354282302 >> 172.21.15.49:0/1354282302 conn(0x7ff6f00fa250 msgr2=0x7ff6f00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.689+0000 7ff6f53c3640 1 -- 172.21.15.49:0/1354282302 shutdown_connections 2024-09-19T09:08:49.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.689+0000 7ff6f53c3640 1 -- 172.21.15.49:0/1354282302 wait complete. 2024-09-19T09:08:49.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.689+0000 7ff6f53c3640 1 Processor -- start 2024-09-19T09:08:49.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6f53c3640 1 -- start start 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6f53c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6f00feaa0 0x7ff6f0195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6f53c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ffca0 0x7ff6f0195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6f53c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f01961a0 con 0x7ff6f00ffca0 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6f53c3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f0196310 con 0x7ff6f00feaa0 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6ee7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ffca0 0x7ff6f0195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6ee7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ffca0 0x7ff6f0195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36574/0 (socket says 172.21.15.49:36574) 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6ee7fc640 1 -- 172.21.15.49:0/2985294278 learned_addr learned my addr 172.21.15.49:0/2985294278 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:49.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6eeffd640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6f00feaa0 0x7ff6f0195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6eeffd640 1 -- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ffca0 msgr2=0x7ff6f0195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6eeffd640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ffca0 0x7ff6f0195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6eeffd640 1 -- 172.21.15.49:0/2985294278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009560 con 0x7ff6f00feaa0 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.690+0000 7ff6ee7fc640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ffca0 0x7ff6f0195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.691+0000 7ff6eeffd640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6f00feaa0 0x7ff6f0195690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff6e002a9c0 tx=0x7ff6e00055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.691+0000 7ff6d7fff640 1 -- 172.21.15.49:0/2985294278 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e0004aa0 con 0x7ff6f00feaa0 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.691+0000 7ff6d7fff640 1 -- 172.21.15.49:0/2985294278 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6e0005d50 con 0x7ff6f00feaa0 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.691+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f019ad50 con 0x7ff6f00feaa0 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.691+0000 7ff6d7fff640 1 -- 172.21.15.49:0/2985294278 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e0003940 con 0x7ff6f00feaa0 2024-09-19T09:08:49.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.691+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f019b240 con 0x7ff6f00feaa0 2024-09-19T09:08:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.692+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f00feea0 con 0x7ff6f00feaa0 2024-09-19T09:08:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.692+0000 7ff6d7fff640 1 -- 172.21.15.49:0/2985294278 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff6e0031b90 con 0x7ff6f00feaa0 2024-09-19T09:08:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.693+0000 7ff6d7fff640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff6d806e5f0 0x7ff6d8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.693+0000 7ff6d7fff640 1 -- 172.21.15.49:0/2985294278 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6596+0+0 (secure 0 0 0) 0x7ff6e00af740 con 0x7ff6f00feaa0 2024-09-19T09:08:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.693+0000 7ff6ee7fc640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff6d806e5f0 0x7ff6d8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.693+0000 7ff6ee7fc640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff6d806e5f0 0x7ff6d8070ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0196bb0 tx=0x7ff6e4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.697+0000 7ff6d7fff640 1 -- 172.21.15.49:0/2985294278 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff6e0078820 con 0x7ff6f00feaa0 2024-09-19T09:08:49.741 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:49 smithi102 ceph-mon[80875]: pgmap v162: 65 pgs: 13 active+undersized, 1 stale+active+clean, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-09-19T09:08:49.742 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 podman[100578]: 2024-09-19 09:08:49.388458662 +0000 UTC m=+0.561960828 container remove 971ff2ab766373618e4fa07c310fd40d670cf1cf2cbc9efe5f693d842179221a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:08:49.742 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 podman[100639]: 2024-09-19 09:08:49.49680387 +0000 UTC m=+0.015924997 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:08:49.742 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 podman[100639]: 2024-09-19 09:08:49.597615896 +0000 UTC m=+0.116737009 container create 42836962daf2b8e3d9609b1bbc506e796bf9ea2a7eda8d19e796f948ac956f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:08:49.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:49 smithi049 ceph-mon[91793]: pgmap v162: 65 pgs: 13 active+undersized, 1 stale+active+clean, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-09-19T09:08:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.892+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6f0068bf0 con 0x7ff6d806e5f0 2024-09-19T09:08:49.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.894+0000 7ff6d7fff640 1 -- 172.21.15.49:0/2985294278 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff6f0068bf0 con 0x7ff6d806e5f0 2024-09-19T09:08:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff6d806e5f0 msgr2=0x7ff6d8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff6d806e5f0 0x7ff6d8070ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0196bb0 tx=0x7ff6e4005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6f00feaa0 msgr2=0x7ff6f0195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6f00feaa0 0x7ff6f0195690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff6e002a9c0 tx=0x7ff6e00055a0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 shutdown_connections 2024-09-19T09:08:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff6d806e5f0 0x7ff6d8070ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6f00ffca0 0x7ff6f0195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 --2- 172.21.15.49:0/2985294278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6f00feaa0 0x7ff6f0195690 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 >> 172.21.15.49:0/2985294278 conn(0x7ff6f00fa250 msgr2=0x7ff6f00684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 shutdown_connections 2024-09-19T09:08:49.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.896+0000 7ff6f53c3640 1 -- 172.21.15.49:0/2985294278 wait complete. 2024-09-19T09:08:49.906 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:08:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.982+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/765062597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 msgr2=0x7f9d84102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.982+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/765062597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d84102a70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d780098b0 tx=0x7f9d7802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.983+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/765062597 shutdown_connections 2024-09-19T09:08:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.983+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/765062597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d84102fb0 0x7f9d841053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.983+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/765062597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d84102a70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.983+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/765062597 >> 172.21.15.49:0/765062597 conn(0x7f9d840fa280 msgr2=0x7f9d840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.983+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/765062597 shutdown_connections 2024-09-19T09:08:49.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.983+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/765062597 wait complete. 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d8ac2c640 1 Processor -- start 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d8ac2c640 1 -- start start 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d8ac2c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d840fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d8ac2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d84102fb0 0x7f9d840fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d8ac2c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84100540 con 0x7f9d84100680 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d8ac2c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840feba0 con 0x7f9d84102fb0 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d889c8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d840fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d889c8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d840fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36590/0 (socket says 172.21.15.49:36590) 2024-09-19T09:08:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d889c8640 1 -- 172.21.15.49:0/1753026576 learned_addr learned my addr 172.21.15.49:0/1753026576 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d83fff640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d84102fb0 0x7f9d840fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d889c8640 1 -- 172.21.15.49:0/1753026576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d84102fb0 msgr2=0x7f9d840fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d889c8640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d84102fb0 0x7f9d840fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.984+0000 7f9d889c8640 1 -- 172.21.15.49:0/1753026576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009560 con 0x7f9d84100680 2024-09-19T09:08:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.985+0000 7f9d889c8640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d840fff70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006010 tx=0x7f9d780055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.986+0000 7f9d81ffb640 1 -- 172.21.15.49:0/1753026576 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d78004aa0 con 0x7f9d84100680 2024-09-19T09:08:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.986+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d840fee20 con 0x7f9d84100680 2024-09-19T09:08:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.986+0000 7f9d81ffb640 1 -- 172.21.15.49:0/1753026576 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d78005d50 con 0x7f9d84100680 2024-09-19T09:08:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.986+0000 7f9d81ffb640 1 -- 172.21.15.49:0/1753026576 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d78003a20 con 0x7f9d84100680 2024-09-19T09:08:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.987+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d840ff310 con 0x7f9d84100680 2024-09-19T09:08:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.988+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d84100a60 con 0x7f9d84100680 2024-09-19T09:08:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.988+0000 7f9d81ffb640 1 -- 172.21.15.49:0/1753026576 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9d78031c00 con 0x7f9d84100680 2024-09-19T09:08:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.989+0000 7f9d81ffb640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9d7406e5f0 0x7f9d74070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.989+0000 7f9d81ffb640 1 -- 172.21.15.49:0/1753026576 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f9d780af7b0 con 0x7f9d84100680 2024-09-19T09:08:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.989+0000 7f9d83fff640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9d7406e5f0 0x7f9d74070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.989+0000 7f9d83fff640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9d7406e5f0 0x7f9d74070ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d840ffcf0 tx=0x7f9d70005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:49.993+0000 7f9d81ffb640 1 -- 172.21.15.49:0/1753026576 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9d780788f0 con 0x7f9d84100680 2024-09-19T09:08:50.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.186+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d841039d0 con 0x7f9d7406e5f0 2024-09-19T09:08:50.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.187+0000 7f9d81ffb640 1 -- 172.21.15.49:0/1753026576 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9d841039d0 con 0x7f9d7406e5f0 2024-09-19T09:08:50.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9d7406e5f0 msgr2=0x7f9d74070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9d7406e5f0 0x7f9d74070ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d840ffcf0 tx=0x7f9d70005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 msgr2=0x7f9d840fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d840fff70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006010 tx=0x7f9d780055a0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 shutdown_connections 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9d7406e5f0 0x7f9d74070ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d84102fb0 0x7f9d840fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 --2- 172.21.15.49:0/1753026576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d84100680 0x7f9d840fff70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 >> 172.21.15.49:0/1753026576 conn(0x7f9d840fa280 msgr2=0x7f9d840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 shutdown_connections 2024-09-19T09:08:50.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.190+0000 7f9d8ac2c640 1 -- 172.21.15.49:0/1753026576 wait complete. 2024-09-19T09:08:50.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 podman[100639]: 2024-09-19 09:08:49.842188161 +0000 UTC m=+0.361309281 container init 42836962daf2b8e3d9609b1bbc506e796bf9ea2a7eda8d19e796f948ac956f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:08:50.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 podman[100639]: 2024-09-19 09:08:49.845396376 +0000 UTC m=+0.364517490 container start 42836962daf2b8e3d9609b1bbc506e796bf9ea2a7eda8d19e796f948ac956f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T09:08:50.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 ceph-osd[100658]: -- 172.21.15.102:0/109918680 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c567161e0 con 0x562c566a8000 2024-09-19T09:08:50.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 bash[100639]: 42836962daf2b8e3d9609b1bbc506e796bf9ea2a7eda8d19e796f948ac956f10 2024-09-19T09:08:50.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:49 smithi102 systemd[1]: Started Ceph osd.5 for 63845326-7664-11ef-bceb-c7b262605968. 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/337452594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 msgr2=0x7fc1a0100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/337452594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0100120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc190009880 tx=0x7fc19002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/337452594 shutdown_connections 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/337452594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0100120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/337452594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a00feaa0 0x7fc1a00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/337452594 >> 172.21.15.49:0/337452594 conn(0x7fc1a00fa250 msgr2=0x7fc1a00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/337452594 shutdown_connections 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.274+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/337452594 wait complete. 2024-09-19T09:08:50.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc1a5b2d640 1 Processor -- start 2024-09-19T09:08:50.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc1a5b2d640 1 -- start start 2024-09-19T09:08:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc1a5b2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a00feaa0 0x7fc1a0195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc1a5b2d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc1a5b2d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0196120 con 0x7fc1a00ffca0 2024-09-19T09:08:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc1a5b2d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0196290 con 0x7fc1a00feaa0 2024-09-19T09:08:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc19effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc19effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33354/0 (socket says 172.21.15.49:33354) 2024-09-19T09:08:50.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc19f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a00feaa0 0x7fc1a0195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.275+0000 7fc19effd640 1 -- 172.21.15.49:0/3084742634 learned_addr learned my addr 172.21.15.49:0/3084742634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc19effd640 1 -- 172.21.15.49:0/3084742634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a00feaa0 msgr2=0x7fc1a0195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc19effd640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a00feaa0 0x7fc1a0195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc19effd640 1 -- 172.21.15.49:0/3084742634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc190009560 con 0x7fc1a00ffca0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc19effd640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0195b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc1900055a0 tx=0x7fc1900055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc19cff9640 1 -- 172.21.15.49:0/3084742634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc190004aa0 con 0x7fc1a00ffca0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc19cff9640 1 -- 172.21.15.49:0/3084742634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc190004c00 con 0x7fc1a00ffca0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a019acd0 con 0x7fc1a00ffca0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc19cff9640 1 -- 172.21.15.49:0/3084742634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc190003b10 con 0x7fc1a00ffca0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.276+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a019b240 con 0x7fc1a00ffca0 2024-09-19T09:08:50.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.277+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a01087b0 con 0x7fc1a00ffca0 2024-09-19T09:08:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.278+0000 7fc19cff9640 1 -- 172.21.15.49:0/3084742634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc190031d20 con 0x7fc1a00ffca0 2024-09-19T09:08:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.278+0000 7fc19cff9640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18c06e5f0 0x7fc18c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.278+0000 7fc19cff9640 1 -- 172.21.15.49:0/3084742634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6596+0+0 (secure 0 0 0) 0x7fc1900af7e0 con 0x7fc1a00ffca0 2024-09-19T09:08:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.278+0000 7fc19f7fe640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18c06e5f0 0x7fc18c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.279+0000 7fc19f7fe640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18c06e5f0 0x7fc18c070ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00ffb00 tx=0x7fc188005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.283+0000 7fc19cff9640 1 -- 172.21.15.49:0/3084742634 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc1900789e0 con 0x7fc1a00ffca0 2024-09-19T09:08:50.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.466+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1a01045f0 con 0x7fc18c06e5f0 2024-09-19T09:08:50.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.476+0000 7fc19cff9640 1 -- 172.21.15.49:0/3084742634 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fc1a01045f0 con 0x7fc18c06e5f0 2024-09-19T09:08:50.477 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:08:50.477 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (13m) 94s ago 14m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:08:50.477 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (14m) 94s ago 14m 8933k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (13m) 30s ago 13m 8812k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (3m) 94s ago 14m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (3m) 30s ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (12m) 94s ago 14m 84.1M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (9m) 94s ago 9m 92.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (8m) 94s ago 8m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (8m) 30s ago 8m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (9m) 30s ago 9m 26.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (6m) 94s ago 15m 500M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (4m) 30s ago 13m 441M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (4m) 94s ago 15m 48.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:08:50.478 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (3m) 30s ago 13m 40.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (14m) 94s ago 14m 15.6M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (13m) 30s ago 13m 16.3M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (2m) 94s ago 12m 83.7M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (2m) 94s ago 12m 86.0M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (99s) 94s ago 11m 12.1M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (65s) 30s ago 11m 119M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (33s) 30s ago 10m 11.1M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 starting - - - 2240M 2024-09-19T09:08:50.479 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (4m) 94s ago 13m 60.5M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18c06e5f0 msgr2=0x7fc18c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18c06e5f0 0x7fc18c070ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00ffb00 tx=0x7fc188005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 msgr2=0x7fc1a0195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0195b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc1900055a0 tx=0x7fc1900055d0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 shutdown_connections 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc18c06e5f0 0x7fc18c070ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1a00ffca0 0x7fc1a0195b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 --2- 172.21.15.49:0/3084742634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a00feaa0 0x7fc1a0195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 >> 172.21.15.49:0/3084742634 conn(0x7fc1a00fa250 msgr2=0x7fc1a0102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 shutdown_connections 2024-09-19T09:08:50.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.478+0000 7fc1a5b2d640 1 -- 172.21.15.49:0/3084742634 wait complete. 2024-09-19T09:08:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 -- 172.21.15.49:0/1349049032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 msgr2=0x7f2134100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 --2- 172.21.15.49:0/1349049032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f2134100830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2124009880 tx=0x7f212402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 -- 172.21.15.49:0/1349049032 shutdown_connections 2024-09-19T09:08:50.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 --2- 172.21.15.49:0/1349049032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2134100d70 0x7f21341031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 --2- 172.21.15.49:0/1349049032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f2134100830 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 -- 172.21.15.49:0/1349049032 >> 172.21.15.49:0/1349049032 conn(0x7f21340fa250 msgr2=0x7f21340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 -- 172.21.15.49:0/1349049032 shutdown_connections 2024-09-19T09:08:50.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.561+0000 7f213a391640 1 -- 172.21.15.49:0/1349049032 wait complete. 2024-09-19T09:08:50.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f213a391640 1 Processor -- start 2024-09-19T09:08:50.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f213a391640 1 -- start start 2024-09-19T09:08:50.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f213a391640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f213419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f213a391640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2134100d70 0x7f213419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f213a391640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213419c6b0 con 0x7f21340fe420 2024-09-19T09:08:50.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f213a391640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213419c820 con 0x7f2134100d70 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f2133fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f213419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f2133fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f213419bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33386/0 (socket says 172.21.15.49:33386) 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f2133fff640 1 -- 172.21.15.49:0/4182494471 learned_addr learned my addr 172.21.15.49:0/4182494471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.562+0000 7f21337fe640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2134100d70 0x7f213419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f2133fff640 1 -- 172.21.15.49:0/4182494471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2134100d70 msgr2=0x7f213419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f2133fff640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2134100d70 0x7f213419c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f2133fff640 1 -- 172.21.15.49:0/4182494471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009560 con 0x7f21340fe420 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f21337fe640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2134100d70 0x7f213419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f2133fff640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f213419bba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21240055a0 tx=0x7f21240055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f21317fa640 1 -- 172.21.15.49:0/4182494471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2124004b20 con 0x7f21340fe420 2024-09-19T09:08:50.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f21317fa640 1 -- 172.21.15.49:0/4182494471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2124004c80 con 0x7f21340fe420 2024-09-19T09:08:50.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21341a1260 con 0x7f21340fe420 2024-09-19T09:08:50.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f21317fa640 1 -- 172.21.15.49:0/4182494471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2124003bc0 con 0x7f21340fe420 2024-09-19T09:08:50.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.563+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21341a1750 con 0x7f21340fe420 2024-09-19T09:08:50.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.564+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213410ed70 con 0x7f21340fe420 2024-09-19T09:08:50.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.565+0000 7f21317fa640 1 -- 172.21.15.49:0/4182494471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2124031640 con 0x7f21340fe420 2024-09-19T09:08:50.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.565+0000 7f21317fa640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f211c06e600 0x7f211c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.566+0000 7f21317fa640 1 -- 172.21.15.49:0/4182494471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f21240af930 con 0x7f21340fe420 2024-09-19T09:08:50.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.566+0000 7f21337fe640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f211c06e600 0x7f211c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.566+0000 7f21337fe640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f211c06e600 0x7f211c070ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f213419d0c0 tx=0x7f212800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.570+0000 7f21317fa640 1 -- 172.21.15.49:0/4182494471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2124078a70 con 0x7f21340fe420 2024-09-19T09:08:50.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.817+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21341a1c10 con 0x7f21340fe420 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.818+0000 7f21317fa640 1 -- 172.21.15.49:0/4182494471 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f212407c130 con 0x7f21340fe420 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:50.819 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4, 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 9 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:08:50.820 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:08:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f211c06e600 msgr2=0x7f211c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f211c06e600 0x7f211c070ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f213419d0c0 tx=0x7f212800b410 comp rx=0 tx=0).stop 2024-09-19T09:08:50.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 msgr2=0x7f213419bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f213419bba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21240055a0 tx=0x7f21240055d0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 shutdown_connections 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f211c06e600 0x7f211c070ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2134100d70 0x7f213419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 --2- 172.21.15.49:0/4182494471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21340fe420 0x7f213419bba0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 >> 172.21.15.49:0/4182494471 conn(0x7f21340fa250 msgr2=0x7f21340fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 shutdown_connections 2024-09-19T09:08:50.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.820+0000 7f213a391640 1 -- 172.21.15.49:0/4182494471 wait complete. 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 -- 172.21.15.49:0/3874298284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101b60 msgr2=0x7f952c0fdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3874298284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101b60 0x7f952c0fdc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9514009880 tx=0x7f951402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 -- 172.21.15.49:0/3874298284 shutdown_connections 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3874298284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101b60 0x7f952c0fdc10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3874298284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c101190 0x7f952c101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 -- 172.21.15.49:0/3874298284 >> 172.21.15.49:0/3874298284 conn(0x7f952c0f99c0 msgr2=0x7f952c0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 -- 172.21.15.49:0/3874298284 shutdown_connections 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.903+0000 7f9530b0c640 1 -- 172.21.15.49:0/3874298284 wait complete. 2024-09-19T09:08:50.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f9530b0c640 1 Processor -- start 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f9530b0c640 1 -- start start 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f9530b0c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101190 0x7f952c195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f9530b0c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c101b60 0x7f952c195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f9530b0c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c196120 con 0x7f952c101190 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f9530b0c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c196290 con 0x7f952c101b60 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f952a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101190 0x7f952c195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f952a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101190 0x7f952c195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33402/0 (socket says 172.21.15.49:33402) 2024-09-19T09:08:50.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f952a59c640 1 -- 172.21.15.49:0/3924321319 learned_addr learned my addr 172.21.15.49:0/3924321319 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.904+0000 7f9521d9b640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c101b60 0x7f952c195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f952a59c640 1 -- 172.21.15.49:0/3924321319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c101b60 msgr2=0x7f952c195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f952a59c640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c101b60 0x7f952c195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f952a59c640 1 -- 172.21.15.49:0/3924321319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514009560 con 0x7f952c101190 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f952a59c640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101190 0x7f952c195610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f951c00e970 tx=0x7f951c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f9523fff640 1 -- 172.21.15.49:0/3924321319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951c009700 con 0x7f952c101190 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f9523fff640 1 -- 172.21.15.49:0/3924321319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f951c00cc90 con 0x7f952c101190 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c19ad30 con 0x7f952c101190 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f9523fff640 1 -- 172.21.15.49:0/3924321319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951c010430 con 0x7f952c101190 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.905+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c19b270 con 0x7f952c101190 2024-09-19T09:08:50.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.906+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c108780 con 0x7f952c101190 2024-09-19T09:08:50.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.907+0000 7f9523fff640 1 -- 172.21.15.49:0/3924321319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f951c003f90 con 0x7f952c101190 2024-09-19T09:08:50.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.907+0000 7f9523fff640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f951806e5f0 0x7f9518070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:50.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.907+0000 7f9523fff640 1 -- 172.21.15.49:0/3924321319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f951c014070 con 0x7f952c101190 2024-09-19T09:08:50.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.907+0000 7f9521d9b640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f951806e5f0 0x7f9518070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:50.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.908+0000 7f9521d9b640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f951806e5f0 0x7f9518070ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9514009230 tx=0x7f95140314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:50.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:50.911+0000 7f9523fff640 1 -- 172.21.15.49:0/3924321319 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f951c057d00 con 0x7f952c101190 2024-09-19T09:08:51.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.127+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f952c19b540 con 0x7f952c101190 2024-09-19T09:08:51.128 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:50 smithi049 ceph-mon[91793]: from='client.44281 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:51.128 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:51.128 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:51.128 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:50 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:51.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:50 smithi049 ceph-mon[91793]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:51.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:50 smithi049 ceph-mon[91793]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:51.129 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:50 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/4182494471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:51.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.127+0000 7f9523fff640 1 -- 172.21.15.49:0/3924321319 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1939 (secure 0 0 0) 0x7f951c05b3c0 con 0x7f952c101190 2024-09-19T09:08:51.129 INFO:teuthology.orchestra.run.smithi049.stdout:e21 2024-09-19T09:08:51.129 INFO:teuthology.orchestra.run.smithi049.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-19T09:08:51.129 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 21 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:00:03.165859+0000 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:08:51.130 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 46 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478,1=24285} 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:08:51.131 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/693842732,v1:172.21.15.49:6827/693842732] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{1:24285} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:24295} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.102:6826/4054567392,v1:172.21.15.102:6827/4054567392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:08:51.132 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:08:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-09-19T09:08:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.129+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f951806e5f0 msgr2=0x7f9518070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f951806e5f0 0x7f9518070ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9514009230 tx=0x7f95140314e0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101190 msgr2=0x7f952c195610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101190 0x7f952c195610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f951c00e970 tx=0x7f951c00ee30 comp rx=0 tx=0).stop 2024-09-19T09:08:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 shutdown_connections 2024-09-19T09:08:51.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f951806e5f0 0x7f9518070ab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f952c101b60 0x7f952c195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 --2- 172.21.15.49:0/3924321319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f952c101190 0x7f952c195610 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 >> 172.21.15.49:0/3924321319 conn(0x7f952c0f99c0 msgr2=0x7f952c104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 shutdown_connections 2024-09-19T09:08:51.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.130+0000 7f9530b0c640 1 -- 172.21.15.49:0/3924321319 wait complete. 2024-09-19T09:08:51.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 -- 172.21.15.49:0/2302535986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0ffca0 msgr2=0x7f051c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 --2- 172.21.15.49:0/2302535986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0ffca0 0x7f051c100120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f050c009880 tx=0x7f050c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 -- 172.21.15.49:0/2302535986 shutdown_connections 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 --2- 172.21.15.49:0/2302535986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0ffca0 0x7f051c100120 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 --2- 172.21.15.49:0/2302535986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f051c0feaa0 0x7f051c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 -- 172.21.15.49:0/2302535986 >> 172.21.15.49:0/2302535986 conn(0x7f051c0fa250 msgr2=0x7f051c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 -- 172.21.15.49:0/2302535986 shutdown_connections 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 -- 172.21.15.49:0/2302535986 wait complete. 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 Processor -- start 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.215+0000 7f0523f6b640 1 -- start start 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0523f6b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0feaa0 0x7f051c195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0523f6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f051c0ffca0 0x7f051c195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0523f6b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c196160 con 0x7f051c0feaa0 2024-09-19T09:08:51.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0523f6b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c1962d0 con 0x7f051c0ffca0 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521d07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0feaa0 0x7f051c195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521d07640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0feaa0 0x7f051c195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33416/0 (socket says 172.21.15.49:33416) 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521d07640 1 -- 172.21.15.49:0/548746441 learned_addr learned my addr 172.21.15.49:0/548746441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521506640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f051c0ffca0 0x7f051c195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521d07640 1 -- 172.21.15.49:0/548746441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f051c0ffca0 msgr2=0x7f051c195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521d07640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f051c0ffca0 0x7f051c195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521d07640 1 -- 172.21.15.49:0/548746441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c009560 con 0x7f051c0feaa0 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0521d07640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0feaa0 0x7f051c195650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f051800e970 tx=0x7f051800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.216+0000 7f0512ffd640 1 -- 172.21.15.49:0/548746441 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05180096e0 con 0x7f051c0feaa0 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.217+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051c19ad70 con 0x7f051c0feaa0 2024-09-19T09:08:51.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.217+0000 7f0512ffd640 1 -- 172.21.15.49:0/548746441 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05180044f0 con 0x7f051c0feaa0 2024-09-19T09:08:51.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.217+0000 7f0512ffd640 1 -- 172.21.15.49:0/548746441 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0518010430 con 0x7f051c0feaa0 2024-09-19T09:08:51.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.217+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051c19b2b0 con 0x7f051c0feaa0 2024-09-19T09:08:51.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.218+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051c1076b0 con 0x7f051c0feaa0 2024-09-19T09:08:51.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.218+0000 7f0512ffd640 1 -- 172.21.15.49:0/548746441 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f051800cc90 con 0x7f051c0feaa0 2024-09-19T09:08:51.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.219+0000 7f0512ffd640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f050806e5f0 0x7f0508070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.219+0000 7f0512ffd640 1 -- 172.21.15.49:0/548746441 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f0518014070 con 0x7f051c0feaa0 2024-09-19T09:08:51.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.219+0000 7f0521506640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f050806e5f0 0x7f0508070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.219+0000 7f0521506640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f050806e5f0 0x7f0508070ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f050c000c00 tx=0x7f050c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.223+0000 7f0512ffd640 1 -- 172.21.15.49:0/548746441 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0518057c80 con 0x7f051c0feaa0 2024-09-19T09:08:51.245 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:50 smithi102 ceph-mon[80875]: from='client.44281 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:51.245 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:51.245 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:51.245 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:50 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:51.245 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:50 smithi102 ceph-mon[80875]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:51.245 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:50 smithi102 ceph-mon[80875]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:51.246 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:50 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/4182494471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:51.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.415+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f051c19b550 con 0x7f050806e5f0 2024-09-19T09:08:51.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.416+0000 7f0512ffd640 1 -- 172.21.15.49:0/548746441 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f051c19b550 con 0x7f050806e5f0 2024-09-19T09:08:51.417 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:08:51.417 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:08:51.417 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:08:51.417 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:08:51.417 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:08:51.417 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:08:51.418 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:08:51.418 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:08:51.418 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:08:51.418 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "11/23 daemons upgraded", 2024-09-19T09:08:51.418 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:08:51.418 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:08:51.418 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f050806e5f0 msgr2=0x7f0508070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f050806e5f0 0x7f0508070ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f050c000c00 tx=0x7f050c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0feaa0 msgr2=0x7f051c195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0feaa0 0x7f051c195650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f051800e970 tx=0x7f051800ee30 comp rx=0 tx=0).stop 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 shutdown_connections 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f050806e5f0 0x7f0508070ab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f051c0ffca0 0x7f051c195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 --2- 172.21.15.49:0/548746441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f051c0feaa0 0x7f051c195650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 >> 172.21.15.49:0/548746441 conn(0x7f051c0fa250 msgr2=0x7f051c068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 shutdown_connections 2024-09-19T09:08:51.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.418+0000 7f0523f6b640 1 -- 172.21.15.49:0/548746441 wait complete. 2024-09-19T09:08:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 -- 172.21.15.49:0/1359376833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 msgr2=0x7f5468100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 --2- 172.21.15.49:0/1359376833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f5468100170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5450009880 tx=0x7f545002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 -- 172.21.15.49:0/1359376833 shutdown_connections 2024-09-19T09:08:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 --2- 172.21.15.49:0/1359376833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f5468100170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 --2- 172.21.15.49:0/1359376833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54680feaf0 0x7f54680feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 -- 172.21.15.49:0/1359376833 >> 172.21.15.49:0/1359376833 conn(0x7f54680fa280 msgr2=0x7f54680fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 -- 172.21.15.49:0/1359376833 shutdown_connections 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.503+0000 7f546d763640 1 -- 172.21.15.49:0/1359376833 wait complete. 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.504+0000 7f546d763640 1 Processor -- start 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.504+0000 7f546d763640 1 -- start start 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.504+0000 7f546d763640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54680feaf0 0x7f5468102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.504+0000 7f546d763640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f54681010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.504+0000 7f546d763640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5468101610 con 0x7f54680ffcf0 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.504+0000 7f546d763640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5468101780 con 0x7f54680feaf0 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f54667fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f54681010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f54667fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f54681010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33434/0 (socket says 172.21.15.49:33434) 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f54667fc640 1 -- 172.21.15.49:0/2802368168 learned_addr learned my addr 172.21.15.49:0/2802368168 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f5466ffd640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54680feaf0 0x7f5468102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f54667fc640 1 -- 172.21.15.49:0/2802368168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54680feaf0 msgr2=0x7f5468102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f54667fc640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54680feaf0 0x7f5468102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f54667fc640 1 -- 172.21.15.49:0/2802368168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450009560 con 0x7f54680ffcf0 2024-09-19T09:08:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f5466ffd640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54680feaf0 0x7f5468102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f54667fc640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f54681010d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5450006010 tx=0x7f54500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.505+0000 7f545ffff640 1 -- 172.21.15.49:0/2802368168 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5450004aa0 con 0x7f54680ffcf0 2024-09-19T09:08:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.506+0000 7f545ffff640 1 -- 172.21.15.49:0/2802368168 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5450004c00 con 0x7f54680ffcf0 2024-09-19T09:08:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.506+0000 7f545ffff640 1 -- 172.21.15.49:0/2802368168 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5450003ac0 con 0x7f54680ffcf0 2024-09-19T09:08:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.506+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5468101a00 con 0x7f54680ffcf0 2024-09-19T09:08:51.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.506+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5468101ef0 con 0x7f54680ffcf0 2024-09-19T09:08:51.511 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:51 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:08:51.243+0000 7efd775d7640 -1 Falling back to public interface 2024-09-19T09:08:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.507+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54681076e0 con 0x7f54680ffcf0 2024-09-19T09:08:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.507+0000 7f545ffff640 1 -- 172.21.15.49:0/2802368168 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5450003d30 con 0x7f54680ffcf0 2024-09-19T09:08:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.508+0000 7f545ffff640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f545406e600 0x7f5454070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.508+0000 7f5466ffd640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f545406e600 0x7f5454070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.508+0000 7f545ffff640 1 -- 172.21.15.49:0/2802368168 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f54500afa00 con 0x7f54680ffcf0 2024-09-19T09:08:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.508+0000 7f5466ffd640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f545406e600 0x7f5454070ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54680ffb50 tx=0x7f545800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.513+0000 7f545ffff640 1 -- 172.21.15.49:0/2802368168 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5450079a30 con 0x7f54680ffcf0 2024-09-19T09:08:51.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.759+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f546819d950 con 0x7f54680ffcf0 2024-09-19T09:08:51.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.760+0000 7f545ffff640 1 -- 172.21.15.49:0/2802368168 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1535 (secure 0 0 0) 0x7f5450035090 con 0x7f54680ffcf0 2024-09-19T09:08:51.761 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded 2024-09-19T09:08:51.761 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:08:51.761 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:08:51.761 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: osd.5 (root=default,host=smithi102) is down 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-19T09:08:51.762 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-19T09:08:51.763 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-19T09:08:51.763 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-19T09:08:51.763 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-19T09:08:51.763 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-19T09:08:51.763 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-19T09:08:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f545406e600 msgr2=0x7f5454070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f545406e600 0x7f5454070ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54680ffb50 tx=0x7f545800b390 comp rx=0 tx=0).stop 2024-09-19T09:08:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 msgr2=0x7f54681010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f54681010d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5450006010 tx=0x7f54500055a0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 shutdown_connections 2024-09-19T09:08:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f545406e600 0x7f5454070ac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54680ffcf0 0x7f54681010d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 --2- 172.21.15.49:0/2802368168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54680feaf0 0x7f5468102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 >> 172.21.15.49:0/2802368168 conn(0x7f54680fa280 msgr2=0x7f5468067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 shutdown_connections 2024-09-19T09:08:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:08:51.763+0000 7f546d763640 1 -- 172.21.15.49:0/2802368168 wait complete. 2024-09-19T09:08:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:51 smithi049 ceph-mon[91793]: pgmap v163: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:51 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3924321319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:08:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:51 smithi049 ceph-mon[91793]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:51 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2802368168' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:08:52.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:51 smithi049 ceph-mon[91793]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:52.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:51 smithi102 ceph-mon[80875]: pgmap v163: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:51 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3924321319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:08:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:51 smithi102 ceph-mon[80875]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:08:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:51 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2802368168' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:08:52.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:51 smithi102 ceph-mon[80875]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded (PG_DEGRADED) 2024-09-19T09:08:53.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:53 smithi102 ceph-mon[80875]: pgmap v164: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:53.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:53 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:53.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:53 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:53.848 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:53 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:53.849 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:53 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:53 smithi049 ceph-mon[91793]: pgmap v164: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:54.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:53 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:55.952 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:55 smithi102 ceph-mon[80875]: pgmap v165: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:56.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:55 smithi049 ceph-mon[91793]: pgmap v165: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:57.258 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:56 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:08:56.773+0000 7efd775d7640 -1 osd.5 83 log_to_monitors true 2024-09-19T09:08:57.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all osd 2024-09-19T09:08:57.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-19T09:08:57.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: Upgrade: Setting require_osd_release to 19 squid 2024-09-19T09:08:57.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-19T09:08:57.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='osd.5 [v2:172.21.15.102:6816/1752786585,v1:172.21.15.102:6817/1752786585]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:08:57.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:57 smithi049 ceph-mon[91793]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:08:57.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:08:57.477+0000 7efd6f371640 -1 osd.5 83 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:08:57.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all osd 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-19T09:08:57.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: Upgrade: Setting require_osd_release to 19 squid 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-19T09:08:57.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='osd.5 [v2:172.21.15.102:6816/1752786585,v1:172.21.15.102:6817/1752786585]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:08:57.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:57 smithi102 ceph-mon[80875]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: pgmap v166: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: osdmap e86: 6 total, 5 up, 6 in 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='osd.5 [v2:172.21.15.102:6816/1752786585,v1:172.21.15.102:6817/1752786585]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-19T09:08:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-19T09:08:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: osdmap e87: 6 total, 5 up, 6 in 2024-09-19T09:08:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: pgmap v166: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: osdmap e86: 6 total, 5 up, 6 in 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='osd.5 [v2:172.21.15.102:6816/1752786585,v1:172.21.15.102:6817/1752786585]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-19T09:08:58.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:58.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: osdmap e87: 6 total, 5 up, 6 in 2024-09-19T09:08:58.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:08:59.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-19T09:08:59.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-19T09:08:59.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2024-09-19T09:08:59.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:59.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:59.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:59.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: osd.5 [v2:172.21.15.102:6816/1752786585,v1:172.21.15.102:6817/1752786585] boot 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: osdmap e88: 6 total, 6 up, 6 in 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:59.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:08:59 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:59.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: osd.5 [v2:172.21.15.102:6816/1752786585,v1:172.21.15.102:6817/1752786585] boot 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: osdmap e88: 6 total, 6 up, 6 in 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:08:59.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:08:59 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-19T09:09:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: pgmap v169: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:09:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: Upgrade: Scaling down filesystem cephfs 2024-09-19T09:09:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-19T09:09:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-19T09:09:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.102:6826/2534703038,v1:172.21.15.102:6827/2534703038] up:boot 2024-09-19T09:09:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.49:6826/3608129551,v1:172.21.15.49:6827/3608129551] up:boot 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: stopping daemon mds.cephfs.smithi102.snrasw 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:stopping} 2 up:standby 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: osdmap e89: 6 total, 6 up, 6 in 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:00.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:00.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:00.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:00.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: pgmap v169: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 54/321 objects degraded (16.822%) 2024-09-19T09:09:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: Upgrade: Scaling down filesystem cephfs 2024-09-19T09:09:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-19T09:09:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-19T09:09:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.102:6826/2534703038,v1:172.21.15.102:6827/2534703038] up:boot 2024-09-19T09:09:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.49:6826/3608129551,v1:172.21.15.49:6827/3608129551] up:boot 2024-09-19T09:09:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: stopping daemon mds.cephfs.smithi102.snrasw 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:active} 2 up:standby 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.uujbrc=up:active,1=cephfs.smithi102.snrasw=up:stopping} 2 up:standby 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: osdmap e89: 6 total, 6 up, 6 in 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:00.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:00.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:00.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:01.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:01 smithi102 ceph-mon[80875]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-19T09:09:01.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:01 smithi049 ceph-mon[91793]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-19T09:09:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:02 smithi102 ceph-mon[80875]: pgmap v172: 65 pgs: 2 peering, 13 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 51/321 objects degraded (15.888%) 2024-09-19T09:09:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:02 smithi102 ceph-mon[80875]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T09:09:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:02 smithi049 ceph-mon[91793]: pgmap v172: 65 pgs: 2 peering, 13 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 51/321 objects degraded (15.888%) 2024-09-19T09:09:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:02 smithi049 ceph-mon[91793]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T09:09:04.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:04 smithi102 ceph-mon[80875]: pgmap v173: 65 pgs: 2 peering, 4 active+undersized, 7 active+undersized+degraded, 52 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 202 B/s wr, 1 op/s; 29/321 objects degraded (9.034%) 2024-09-19T09:09:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:04 smithi049 ceph-mon[91793]: pgmap v173: 65 pgs: 2 peering, 4 active+undersized, 7 active+undersized+degraded, 52 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 202 B/s wr, 1 op/s; 29/321 objects degraded (9.034%) 2024-09-19T09:09:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:05 smithi102 ceph-mon[80875]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/321 objects degraded (9.034%), 7 pgs degraded) 2024-09-19T09:09:05.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:05 smithi049 ceph-mon[91793]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/321 objects degraded (9.034%), 7 pgs degraded) 2024-09-19T09:09:06.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:06 smithi102 ceph-mon[80875]: pgmap v174: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 439 B/s wr, 1 op/s 2024-09-19T09:09:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:06 smithi049 ceph-mon[91793]: pgmap v174: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 439 B/s wr, 1 op/s 2024-09-19T09:09:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:08 smithi102 ceph-mon[80875]: pgmap v175: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-19T09:09:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:08 smithi049 ceph-mon[91793]: pgmap v175: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: pgmap v176: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:10.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: pgmap v176: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:11.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:11 smithi102 ceph-mon[80875]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-19T09:09:11.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:11 smithi049 ceph-mon[91793]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-19T09:09:12.660 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:12 smithi102 ceph-mon[80875]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 372 B/s wr, 0 op/s 2024-09-19T09:09:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:12 smithi049 ceph-mon[91793]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 372 B/s wr, 0 op/s 2024-09-19T09:09:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:13 smithi049 ceph-mon[91793]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:09:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:09:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:13.914 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:13 smithi102 ceph-mon[80875]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:09:13.914 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:13.915 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:09:13.915 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:15.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:15 smithi049 ceph-mon[91793]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:16.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:15 smithi102 ceph-mon[80875]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:17.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:17 smithi049 ceph-mon[91793]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-19T09:09:18.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:17 smithi102 ceph-mon[80875]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-19T09:09:19.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:19 smithi102 ceph-mon[80875]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:09:19.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:19 smithi049 ceph-mon[91793]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: daemon mds.cephfs.smithi102.snrasw finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:20.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:20.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:20 smithi049 ceph-mon[91793]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: daemon mds.cephfs.smithi102.snrasw finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:21.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:21.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:21.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:20 smithi102 ceph-mon[80875]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-19T09:09:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:21 smithi049 ceph-mon[91793]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:09:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:21 smithi049 ceph-mon[91793]: mds.1 [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] down:stopped 2024-09-19T09:09:21.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:21 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 2 up:standby 2024-09-19T09:09:21.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.862+0000 7fccbed80640 1 -- 172.21.15.49:0/182451224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 msgr2=0x7fccb81015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.862+0000 7fccbed80640 1 --2- 172.21.15.49:0/182451224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81015a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009880 tx=0x7fccb402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.862+0000 7fccbed80640 1 -- 172.21.15.49:0/182451224 shutdown_connections 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.862+0000 7fccbed80640 1 --2- 172.21.15.49:0/182451224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccb8101b70 0x7fccb80fdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.862+0000 7fccbed80640 1 --2- 172.21.15.49:0/182451224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81015a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.862+0000 7fccbed80640 1 -- 172.21.15.49:0/182451224 >> 172.21.15.49:0/182451224 conn(0x7fccb80f99b0 msgr2=0x7fccb80fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.863+0000 7fccbed80640 1 -- 172.21.15.49:0/182451224 shutdown_connections 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.863+0000 7fccbed80640 1 -- 172.21.15.49:0/182451224 wait complete. 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.863+0000 7fccbed80640 1 Processor -- start 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.863+0000 7fccbed80640 1 -- start start 2024-09-19T09:09:21.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbed80640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81008a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbed80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccb8101b70 0x7fccb80feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbed80640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80ff430 con 0x7fccb81011a0 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbed80640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80ff5a0 con 0x7fccb8101b70 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbcb1c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbcb1c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81008a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59574/0 (socket says 172.21.15.49:59574) 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbcb1c640 1 -- 172.21.15.49:0/2351387834 learned_addr learned my addr 172.21.15.49:0/2351387834 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccaffff640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccb8101b70 0x7fccb80feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbcb1c640 1 -- 172.21.15.49:0/2351387834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccb8101b70 msgr2=0x7fccb80feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbcb1c640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccb8101b70 0x7fccb80feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbcb1c640 1 -- 172.21.15.49:0/2351387834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4009560 con 0x7fccb81011a0 2024-09-19T09:09:21.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.864+0000 7fccbcb1c640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81008a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fccb402a9c0 tx=0x7fccb40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.865+0000 7fccadffb640 1 -- 172.21.15.49:0/2351387834 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb4004aa0 con 0x7fccb81011a0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.865+0000 7fccadffb640 1 -- 172.21.15.49:0/2351387834 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccb4005d50 con 0x7fccb81011a0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.865+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb80ff820 con 0x7fccb81011a0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.865+0000 7fccadffb640 1 -- 172.21.15.49:0/2351387834 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb40039e0 con 0x7fccb81011a0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.865+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb819d6f0 con 0x7fccb81011a0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.866+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb818f760 con 0x7fccb81011a0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.867+0000 7fccadffb640 1 -- 172.21.15.49:0/2351387834 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fccb4031c00 con 0x7fccb81011a0 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.868+0000 7fccadffb640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcca006e5f0 0x7fcca0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:21.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.868+0000 7fccadffb640 1 -- 172.21.15.49:0/2351387834 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6596+0+0 (secure 0 0 0) 0x7fccb40af700 con 0x7fccb81011a0 2024-09-19T09:09:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.868+0000 7fccaffff640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcca006e5f0 0x7fcca0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:21.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.868+0000 7fccaffff640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcca006e5f0 0x7fcca0070ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fccb8100620 tx=0x7fcca8005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:21.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:21.872+0000 7fccadffb640 1 -- 172.21.15.49:0/2351387834 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fccb40788c0 con 0x7fccb81011a0 2024-09-19T09:09:22.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:21 smithi102 ceph-mon[80875]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T09:09:22.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:21 smithi102 ceph-mon[80875]: mds.1 [v2:172.21.15.102:6824/2151748213,v1:172.21.15.102:6825/2151748213] down:stopped 2024-09-19T09:09:22.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:21 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 2 up:standby 2024-09-19T09:09:22.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.069+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccb80608f0 con 0x7fcca006e5f0 2024-09-19T09:09:22.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.070+0000 7fccadffb640 1 -- 172.21.15.49:0/2351387834 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fccb80608f0 con 0x7fcca006e5f0 2024-09-19T09:09:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcca006e5f0 msgr2=0x7fcca0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcca006e5f0 0x7fcca0070ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fccb8100620 tx=0x7fcca8005f90 comp rx=0 tx=0).stop 2024-09-19T09:09:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 msgr2=0x7fccb81008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81008a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fccb402a9c0 tx=0x7fccb40055a0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 shutdown_connections 2024-09-19T09:09:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcca006e5f0 0x7fcca0070ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccb8101b70 0x7fccb80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 --2- 172.21.15.49:0/2351387834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccb81011a0 0x7fccb81008a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 >> 172.21.15.49:0/2351387834 conn(0x7fccb80f99b0 msgr2=0x7fccb81045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 shutdown_connections 2024-09-19T09:09:22.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.073+0000 7fccbed80640 1 -- 172.21.15.49:0/2351387834 wait complete. 2024-09-19T09:09:22.082 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:09:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 -- 172.21.15.49:0/620164140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0feaf0 msgr2=0x7fe3ac0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 --2- 172.21.15.49:0/620164140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac0feef0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009880 tx=0x7fe39c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 -- 172.21.15.49:0/620164140 shutdown_connections 2024-09-19T09:09:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 --2- 172.21.15.49:0/620164140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0ffcf0 0x7fe3ac100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 --2- 172.21.15.49:0/620164140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac0feef0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 -- 172.21.15.49:0/620164140 >> 172.21.15.49:0/620164140 conn(0x7fe3ac0fa280 msgr2=0x7fe3ac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 -- 172.21.15.49:0/620164140 shutdown_connections 2024-09-19T09:09:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.158+0000 7fe3b202e640 1 -- 172.21.15.49:0/620164140 wait complete. 2024-09-19T09:09:22.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3b202e640 1 Processor -- start 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3b202e640 1 -- start start 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3b202e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac194560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3b202e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0ffcf0 0x7fe3ac194aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3b202e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac195070 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3b202e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac1951e0 con 0x7fe3ac0feaf0 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3a2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0ffcf0 0x7fe3ac194aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3ab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac194560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3ab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac194560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:42326/0 (socket says 172.21.15.49:42326) 2024-09-19T09:09:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3a2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0ffcf0 0x7fe3ac194aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59598/0 (socket says 172.21.15.49:59598) 2024-09-19T09:09:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.159+0000 7fe3ab7fe640 1 -- 172.21.15.49:0/3284078966 learned_addr learned my addr 172.21.15.49:0/3284078966 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3a2ffd640 1 -- 172.21.15.49:0/3284078966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0feaf0 msgr2=0x7fe3ac194560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3a2ffd640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac194560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3a2ffd640 1 -- 172.21.15.49:0/3284078966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009560 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3ab7fe640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac194560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:09:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3a2ffd640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0ffcf0 0x7fe3ac194aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c920 tx=0x7fe39400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3a97fa640 1 -- 172.21.15.49:0/3284078966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe394007b80 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3a97fa640 1 -- 172.21.15.49:0/3284078966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3940054e0 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ac199c80 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3a97fa640 1 -- 172.21.15.49:0/3284078966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe394004e80 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.160+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ac19a1d0 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.162+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ac18e670 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.162+0000 7fe3a97fa640 1 -- 172.21.15.49:0/3284078966 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe394005020 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.163+0000 7fe3a97fa640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe39806e590 0x7fe398070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.163+0000 7fe3a97fa640 1 -- 172.21.15.49:0/3284078966 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6596+0+0 (secure 0 0 0) 0x7fe39408e500 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.163+0000 7fe3ab7fe640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe39806e590 0x7fe398070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.163+0000 7fe3ab7fe640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe39806e590 0x7fe398070a50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe39c004650 tx=0x7fe39c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.167+0000 7fe3a97fa640 1 -- 172.21.15.49:0/3284078966 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe394057640 con 0x7fe3ac0ffcf0 2024-09-19T09:09:22.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.361+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3ac02c4f0 con 0x7fe39806e590 2024-09-19T09:09:22.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.362+0000 7fe3a97fa640 1 -- 172.21.15.49:0/3284078966 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe3ac02c4f0 con 0x7fe39806e590 2024-09-19T09:09:22.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe39806e590 msgr2=0x7fe398070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe39806e590 0x7fe398070a50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe39c004650 tx=0x7fe39c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0ffcf0 msgr2=0x7fe3ac194aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0ffcf0 0x7fe3ac194aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c920 tx=0x7fe39400cde0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 shutdown_connections 2024-09-19T09:09:22.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe39806e590 0x7fe398070a50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3ac0ffcf0 0x7fe3ac194aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 --2- 172.21.15.49:0/3284078966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3ac0feaf0 0x7fe3ac194560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 >> 172.21.15.49:0/3284078966 conn(0x7fe3ac0fa280 msgr2=0x7fe3ac103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:22.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 shutdown_connections 2024-09-19T09:09:22.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.364+0000 7fe3b202e640 1 -- 172.21.15.49:0/3284078966 wait complete. 2024-09-19T09:09:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 -- 172.21.15.49:0/3521956757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 msgr2=0x7f3390101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 --2- 172.21.15.49:0/3521956757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390101210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3380009880 tx=0x7f338002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 -- 172.21.15.49:0/3521956757 shutdown_connections 2024-09-19T09:09:22.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 --2- 172.21.15.49:0/3521956757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390101210 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 --2- 172.21.15.49:0/3521956757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33900ffb90 0x7f33900fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 -- 172.21.15.49:0/3521956757 >> 172.21.15.49:0/3521956757 conn(0x7f33900fb320 msgr2=0x7f33900fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:22.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 -- 172.21.15.49:0/3521956757 shutdown_connections 2024-09-19T09:09:22.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 -- 172.21.15.49:0/3521956757 wait complete. 2024-09-19T09:09:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.448+0000 7f33976a7640 1 Processor -- start 2024-09-19T09:09:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f33976a7640 1 -- start start 2024-09-19T09:09:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f33976a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33900ffb90 0x7f33901977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f33976a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f33976a7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390198300 con 0x7f3390100d90 2024-09-19T09:09:22.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f33976a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390198470 con 0x7f33900ffb90 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3394c42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3394c42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59618/0 (socket says 172.21.15.49:59618) 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3394c42640 1 -- 172.21.15.49:0/1547270601 learned_addr learned my addr 172.21.15.49:0/1547270601 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3395443640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33900ffb90 0x7f33901977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3394c42640 1 -- 172.21.15.49:0/1547270601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33900ffb90 msgr2=0x7f33901977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3394c42640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33900ffb90 0x7f33901977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3394c42640 1 -- 172.21.15.49:0/1547270601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380009560 con 0x7f3390100d90 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.449+0000 7f3394c42640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390197d30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3380005520 tx=0x7f3380005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:22.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.450+0000 7f33867fc640 1 -- 172.21.15.49:0/1547270601 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3380004aa0 con 0x7f3390100d90 2024-09-19T09:09:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.450+0000 7f33867fc640 1 -- 172.21.15.49:0/1547270601 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3380004c00 con 0x7f3390100d90 2024-09-19T09:09:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.450+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339019ceb0 con 0x7f3390100d90 2024-09-19T09:09:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.450+0000 7f33867fc640 1 -- 172.21.15.49:0/1547270601 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3380003b10 con 0x7f3390100d90 2024-09-19T09:09:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.450+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339019d3f0 con 0x7f3390100d90 2024-09-19T09:09:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.451+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33900fff90 con 0x7f3390100d90 2024-09-19T09:09:22.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.451+0000 7f33867fc640 1 -- 172.21.15.49:0/1547270601 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3380003d60 con 0x7f3390100d90 2024-09-19T09:09:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.452+0000 7f33867fc640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f337c06e5f0 0x7f337c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.452+0000 7f33867fc640 1 -- 172.21.15.49:0/1547270601 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f33800af930 con 0x7f3390100d90 2024-09-19T09:09:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.452+0000 7f3395443640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f337c06e5f0 0x7f337c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.452+0000 7f3395443640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f337c06e5f0 0x7f337c070ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3390100bf0 tx=0x7f338c009870 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:22.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.456+0000 7f33867fc640 1 -- 172.21.15.49:0/1547270601 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f33800789c0 con 0x7f3390100d90 2024-09-19T09:09:22.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.643+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f339002c570 con 0x7f337c06e5f0 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.652+0000 7f33867fc640 1 -- 172.21.15.49:0/1547270601 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f339002c570 con 0x7f337c06e5f0 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (13m) 2m ago 14m 25.0M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (15m) 2m ago 15m 8933k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (14m) 30s ago 14m 8879k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (3m) 2m ago 15m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (3m) 30s ago 14m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (13m) 2m ago 14m 84.1M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:09:22.653 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (9m) 2m ago 9m 92.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 773f00433741 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (9m) 2m ago 9m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (9m) 30s ago 9m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (9m) 30s ago 9m 27.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (6m) 2m ago 16m 500M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (5m) 30s ago 13m 442M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (4m) 2m ago 16m 48.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (4m) 30s ago 13m 41.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (14m) 2m ago 14m 15.6M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (14m) 30s ago 14m 16.2M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 2m ago 13m 83.7M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (2m) 2m ago 12m 86.0M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:09:22.654 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 2m ago 12m 12.1M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:09:22.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (98s) 30s ago 11m 120M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:09:22.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (65s) 30s ago 11m 81.4M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:09:22.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (33s) 30s ago 11m 11.3M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:09:22.655 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (5m) 2m ago 14m 60.5M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:09:22.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.654+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f337c06e5f0 msgr2=0x7f337c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.654+0000 7f33976a7640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f337c06e5f0 0x7f337c070ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3390100bf0 tx=0x7f338c009870 comp rx=0 tx=0).stop 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.654+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 msgr2=0x7f3390197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.654+0000 7f33976a7640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390197d30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3380005520 tx=0x7f3380005550 comp rx=0 tx=0).stop 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.655+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 shutdown_connections 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.655+0000 7f33976a7640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f337c06e5f0 0x7f337c070ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.655+0000 7f33976a7640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3390100d90 0x7f3390197d30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.655+0000 7f33976a7640 1 --2- 172.21.15.49:0/1547270601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33900ffb90 0x7f33901977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.655+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 >> 172.21.15.49:0/1547270601 conn(0x7f33900fb320 msgr2=0x7f3390072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.655+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 shutdown_connections 2024-09-19T09:09:22.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.655+0000 7f33976a7640 1 -- 172.21.15.49:0/1547270601 wait complete. 2024-09-19T09:09:22.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 -- 172.21.15.49:0/2856460991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 msgr2=0x7f5314101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2856460991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f5314101210 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5304009880 tx=0x7f530402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 -- 172.21.15.49:0/2856460991 shutdown_connections 2024-09-19T09:09:22.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2856460991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f5314101210 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2856460991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53140ffb90 0x7f53140fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 -- 172.21.15.49:0/2856460991 >> 172.21.15.49:0/2856460991 conn(0x7f53140fb320 msgr2=0x7f53140fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:22.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 -- 172.21.15.49:0/2856460991 shutdown_connections 2024-09-19T09:09:22.739 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:22 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.102:6824/3508743177,v1:172.21.15.102:6825/3508743177] up:boot 2024-09-19T09:09:22.739 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:22 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 3 up:standby 2024-09-19T09:09:22.739 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:22 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:09:22.739 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:22 smithi049 ceph-mon[91793]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:22.740 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:22 smithi049 ceph-mon[91793]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.738+0000 7f531b6d9640 1 -- 172.21.15.49:0/2856460991 wait complete. 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f531b6d9640 1 Processor -- start 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f531b6d9640 1 -- start start 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f531b6d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53140ffb90 0x7f5314074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f531b6d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f53140728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f531b6d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314072de0 con 0x7f5314100d90 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f531b6d9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314072f50 con 0x7f53140ffb90 2024-09-19T09:09:22.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5318c74640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f53140728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5318c74640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f53140728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59628/0 (socket says 172.21.15.49:59628) 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5318c74640 1 -- 172.21.15.49:0/2427602204 learned_addr learned my addr 172.21.15.49:0/2427602204 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5319475640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53140ffb90 0x7f5314074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5318c74640 1 -- 172.21.15.49:0/2427602204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53140ffb90 msgr2=0x7f5314074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5318c74640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53140ffb90 0x7f5314074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5318c74640 1 -- 172.21.15.49:0/2427602204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304009560 con 0x7f5314100d90 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.739+0000 7f5319475640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53140ffb90 0x7f5314074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.740+0000 7f5318c74640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f53140728a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5304005610 tx=0x7f5304005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.740+0000 7f530a7fc640 1 -- 172.21.15.49:0/2427602204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5304004ba0 con 0x7f5314100d90 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.740+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53140731d0 con 0x7f5314100d90 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.740+0000 7f530a7fc640 1 -- 172.21.15.49:0/2427602204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5304004d00 con 0x7f5314100d90 2024-09-19T09:09:22.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.740+0000 7f530a7fc640 1 -- 172.21.15.49:0/2427602204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5304003bd0 con 0x7f5314100d90 2024-09-19T09:09:22.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.740+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531419d790 con 0x7f5314100d90 2024-09-19T09:09:22.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.741+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5314100010 con 0x7f5314100d90 2024-09-19T09:09:22.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.742+0000 7f530a7fc640 1 -- 172.21.15.49:0/2427602204 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5304031640 con 0x7f5314100d90 2024-09-19T09:09:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.742+0000 7f530a7fc640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f530006e5f0 0x7f5300070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.742+0000 7f530a7fc640 1 -- 172.21.15.49:0/2427602204 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f53040afae0 con 0x7f5314100d90 2024-09-19T09:09:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.742+0000 7f5319475640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f530006e5f0 0x7f5300070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:22.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.743+0000 7f5319475640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f530006e5f0 0x7f5300070ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5310006fd0 tx=0x7f5310008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:22.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.747+0000 7f530a7fc640 1 -- 172.21.15.49:0/2427602204 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5304078b70 con 0x7f5314100d90 2024-09-19T09:09:22.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.994+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5314108820 con 0x7f5314100d90 2024-09-19T09:09:22.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.995+0000 7f530a7fc640 1 -- 172.21.15.49:0/2427602204 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+737 (secure 0 0 0) 0x7f530407c230 con 0x7f5314100d90 2024-09-19T09:09:22.995 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-19T09:09:22.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:22.997 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:09:22.997 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4, 2024-09-19T09:09:22.997 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 10 2024-09-19T09:09:22.997 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:09:22.997 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:09:22.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f530006e5f0 msgr2=0x7f5300070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f530006e5f0 0x7f5300070ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5310006fd0 tx=0x7f5310008040 comp rx=0 tx=0).stop 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 msgr2=0x7f53140728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f53140728a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5304005610 tx=0x7f5304005640 comp rx=0 tx=0).stop 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 shutdown_connections 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f530006e5f0 0x7f5300070ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5314100d90 0x7f53140728a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 --2- 172.21.15.49:0/2427602204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53140ffb90 0x7f5314074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 >> 172.21.15.49:0/2427602204 conn(0x7f53140fb320 msgr2=0x7f5314103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 shutdown_connections 2024-09-19T09:09:22.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:22.997+0000 7f531b6d9640 1 -- 172.21.15.49:0/2427602204 wait complete. 2024-09-19T09:09:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:22 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.102:6824/3508743177,v1:172.21.15.102:6825/3508743177] up:boot 2024-09-19T09:09:23.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:22 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 3 up:standby 2024-09-19T09:09:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:22 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:09:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:22 smithi102 ceph-mon[80875]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:22 smithi102 ceph-mon[80875]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 -- 172.21.15.49:0/524632206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600feaa0 msgr2=0x7f91600feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 --2- 172.21.15.49:0/524632206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600feaa0 0x7f91600feea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f915c009880 tx=0x7f915c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 -- 172.21.15.49:0/524632206 shutdown_connections 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 --2- 172.21.15.49:0/524632206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91600ffca0 0x7f9160100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 --2- 172.21.15.49:0/524632206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600feaa0 0x7f91600feea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 -- 172.21.15.49:0/524632206 >> 172.21.15.49:0/524632206 conn(0x7f91600fa250 msgr2=0x7f91600fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 -- 172.21.15.49:0/524632206 shutdown_connections 2024-09-19T09:09:23.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.081+0000 7f916755b640 1 -- 172.21.15.49:0/524632206 wait complete. 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f916755b640 1 Processor -- start 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f916755b640 1 -- start start 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f916755b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91600feaa0 0x7f9160195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f916755b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600ffca0 0x7f9160195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f916755b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91601961a0 con 0x7f91600ffca0 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f916755b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160196310 con 0x7f91600feaa0 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f9164af6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600ffca0 0x7f9160195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f91652f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91600feaa0 0x7f9160195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f9164af6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600ffca0 0x7f9160195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59658/0 (socket says 172.21.15.49:59658) 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.082+0000 7f9164af6640 1 -- 172.21.15.49:0/1105715960 learned_addr learned my addr 172.21.15.49:0/1105715960 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:23.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f9164af6640 1 -- 172.21.15.49:0/1105715960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91600feaa0 msgr2=0x7f9160195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f9164af6640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91600feaa0 0x7f9160195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f9164af6640 1 -- 172.21.15.49:0/1105715960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009560 con 0x7f91600ffca0 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f9164af6640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600ffca0 0x7f9160195bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f915400d720 tx=0x7f915400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f91527fc640 1 -- 172.21.15.49:0/1105715960 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91540051f0 con 0x7f91600ffca0 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f91527fc640 1 -- 172.21.15.49:0/1105715960 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9154009ce0 con 0x7f91600ffca0 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916019adb0 con 0x7f91600ffca0 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f91527fc640 1 -- 172.21.15.49:0/1105715960 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9154010460 con 0x7f91600ffca0 2024-09-19T09:09:23.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.083+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916019b350 con 0x7f91600ffca0 2024-09-19T09:09:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.084+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91600feea0 con 0x7f91600ffca0 2024-09-19T09:09:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.085+0000 7f91527fc640 1 -- 172.21.15.49:0/1105715960 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9154009820 con 0x7f91600ffca0 2024-09-19T09:09:23.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.085+0000 7f91527fc640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f914c06e5f0 0x7f914c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.085+0000 7f91652f7640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f914c06e5f0 0x7f914c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.085+0000 7f91527fc640 1 -- 172.21.15.49:0/1105715960 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f915408e1d0 con 0x7f91600ffca0 2024-09-19T09:09:23.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.086+0000 7f91652f7640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f914c06e5f0 0x7f914c070ab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f915c005940 tx=0x7f915c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.089+0000 7f91527fc640 1 -- 172.21.15.49:0/1105715960 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9154057390 con 0x7f91600ffca0 2024-09-19T09:09:23.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.300+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f91601076b0 con 0x7f91600ffca0 2024-09-19T09:09:23.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.301+0000 7f91527fc640 1 -- 172.21.15.49:0/1105715960 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1928 (secure 0 0 0) 0x7f91540177a0 con 0x7f91600ffca0 2024-09-19T09:09:23.301 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-09-19T09:09:23.301 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-19T09:09:21:540738+0000 2024-09-19T09:09:23.301 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:09:23.301 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 25 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:09:19.677438+0000 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:09:23.302 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14478} 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 1 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:09:23.303 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 14478 members: 14478 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.49:6828/2801166372,v1:172.21.15.49:6829/2801166372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{-1:34380} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/3608129551,v1:172.21.15.49:6827/3608129551] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.102:6826/2534703038,v1:172.21.15.102:6827/2534703038] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:09:23.304 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.102:6824/3508743177,v1:172.21.15.102:6825/3508743177] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:09:23.305 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-09-19T09:09:23.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f914c06e5f0 msgr2=0x7f914c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f914c06e5f0 0x7f914c070ab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f915c005940 tx=0x7f915c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600ffca0 msgr2=0x7f9160195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600ffca0 0x7f9160195bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f915400d720 tx=0x7f915400dbe0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 shutdown_connections 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f914c06e5f0 0x7f914c070ab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91600ffca0 0x7f9160195bd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 --2- 172.21.15.49:0/1105715960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91600feaa0 0x7f9160195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 >> 172.21.15.49:0/1105715960 conn(0x7f91600fa250 msgr2=0x7f91600684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 shutdown_connections 2024-09-19T09:09:23.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.303+0000 7f916755b640 1 -- 172.21.15.49:0/1105715960 wait complete. 2024-09-19T09:09:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/1448019944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0fed40 msgr2=0x7fc5dc0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/1448019944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0fed40 0x7fc5dc0ff1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009c20 tx=0x7fc5cc02a970 comp rx=0 tx=0).stop 2024-09-19T09:09:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/1448019944 shutdown_connections 2024-09-19T09:09:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/1448019944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc0fed40 0x7fc5dc0ff1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/1448019944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5dc100090 0x7fc5dc100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/1448019944 >> 172.21.15.49:0/1448019944 conn(0x7fc5dc0f99c0 msgr2=0x7fc5dc0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/1448019944 shutdown_connections 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.388+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/1448019944 wait complete. 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5e2d0f640 1 Processor -- start 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5e2d0f640 1 -- start start 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5e2d0f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5dc0fed40 0x7fc5dc102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5e2d0f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc100090 0x7fc5dc101130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5e2d0f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc101670 con 0x7fc5dc100090 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5e2d0f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1017e0 con 0x7fc5dc0fed40 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5dbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc100090 0x7fc5dc101130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5dbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc100090 0x7fc5dc101130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59666/0 (socket says 172.21.15.49:59666) 2024-09-19T09:09:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5dbfff640 1 -- 172.21.15.49:0/2140770912 learned_addr learned my addr 172.21.15.49:0/2140770912 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5e0aab640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5dc0fed40 0x7fc5dc102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5dbfff640 1 -- 172.21.15.49:0/2140770912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5dc0fed40 msgr2=0x7fc5dc102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5dbfff640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5dc0fed40 0x7fc5dc102ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5dbfff640 1 -- 172.21.15.49:0/2140770912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009900 con 0x7fc5dc100090 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.389+0000 7fc5dbfff640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc100090 0x7fc5dc101130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc006010 tx=0x7fc5cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.390+0000 7fc5d9ffb640 1 -- 172.21.15.49:0/2140770912 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc030670 con 0x7fc5dc100090 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.390+0000 7fc5d9ffb640 1 -- 172.21.15.49:0/2140770912 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5cc030c90 con 0x7fc5dc100090 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.390+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc101a60 con 0x7fc5dc100090 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.390+0000 7fc5d9ffb640 1 -- 172.21.15.49:0/2140770912 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc0048a0 con 0x7fc5dc100090 2024-09-19T09:09:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.390+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc19d740 con 0x7fc5dc100090 2024-09-19T09:09:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.391+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc0ff1c0 con 0x7fc5dc100090 2024-09-19T09:09:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.392+0000 7fc5d9ffb640 1 -- 172.21.15.49:0/2140770912 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc5cc00a040 con 0x7fc5dc100090 2024-09-19T09:09:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.392+0000 7fc5d9ffb640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc5c806e5f0 0x7fc5c8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.392+0000 7fc5d9ffb640 1 -- 172.21.15.49:0/2140770912 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6596+0+0 (secure 0 0 0) 0x7fc5cc02c040 con 0x7fc5dc100090 2024-09-19T09:09:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.392+0000 7fc5e0aab640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc5c806e5f0 0x7fc5c8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.393+0000 7fc5e0aab640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc5c806e5f0 0x7fc5c8070ab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0681f0 tx=0x7fc5c4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.396+0000 7fc5d9ffb640 1 -- 172.21.15.49:0/2140770912 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc5cc078b40 con 0x7fc5dc100090 2024-09-19T09:09:23.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.594+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5dc0fe3d0 con 0x7fc5c806e5f0 2024-09-19T09:09:23.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.596+0000 7fc5d9ffb640 1 -- 172.21.15.49:0/2140770912 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5dc0fe3d0 con 0x7fc5c806e5f0 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:09:23.596 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:09:23.597 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "12/23 daemons upgraded", 2024-09-19T09:09:23.597 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T09:09:23.597 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:09:23.597 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:09:23.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc5c806e5f0 msgr2=0x7fc5c8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc5c806e5f0 0x7fc5c8070ab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0681f0 tx=0x7fc5c4005f90 comp rx=0 tx=0).stop 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc100090 msgr2=0x7fc5dc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc100090 0x7fc5dc101130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc006010 tx=0x7fc5cc004ab0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 shutdown_connections 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc5c806e5f0 0x7fc5c8070ab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5dc100090 0x7fc5dc101130 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 --2- 172.21.15.49:0/2140770912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5dc0fed40 0x7fc5dc102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 >> 172.21.15.49:0/2140770912 conn(0x7fc5dc0f99c0 msgr2=0x7fc5dc0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 shutdown_connections 2024-09-19T09:09:23.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.598+0000 7fc5e2d0f640 1 -- 172.21.15.49:0/2140770912 wait complete. 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 -- 172.21.15.49:0/604130488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4100d90 msgr2=0x7f86d4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/604130488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4100d90 0x7f86d4101210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009880 tx=0x7f86bc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 -- 172.21.15.49:0/604130488 shutdown_connections 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/604130488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d4100d90 0x7f86d4101210 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/604130488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d40ffb90 0x7f86d40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 -- 172.21.15.49:0/604130488 >> 172.21.15.49:0/604130488 conn(0x7f86d40fb320 msgr2=0x7f86d40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 -- 172.21.15.49:0/604130488 shutdown_connections 2024-09-19T09:09:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.682+0000 7f86d9c0d640 1 -- 172.21.15.49:0/604130488 wait complete. 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d9c0d640 1 Processor -- start 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d9c0d640 1 -- start start 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d9c0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d40ffb90 0x7f86d40741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d9c0d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d4100d90 0x7f86d40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d9c0d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d4074720 con 0x7f86d40ffb90 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d9c0d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d4072de0 con 0x7f86d4100d90 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d40ffb90 0x7f86d40741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d40ffb90 0x7f86d40741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59684/0 (socket says 172.21.15.49:59684) 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86d37fe640 1 -- 172.21.15.49:0/3648580786 learned_addr learned my addr 172.21.15.49:0/3648580786 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.683+0000 7f86cbfff640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d4100d90 0x7f86d40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d37fe640 1 -- 172.21.15.49:0/3648580786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d4100d90 msgr2=0x7f86d40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d37fe640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d4100d90 0x7f86d40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d37fe640 1 -- 172.21.15.49:0/3648580786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc009560 con 0x7f86d40ffb90 2024-09-19T09:09:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d37fe640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d40ffb90 0x7f86d40741e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c8f0 tx=0x7f86c400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d17fa640 1 -- 172.21.15.49:0/3648580786 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c40041f0 con 0x7f86d40ffb90 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d17fa640 1 -- 172.21.15.49:0/3648580786 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86c4007e10 con 0x7f86d40ffb90 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d4073060 con 0x7f86d40ffb90 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d17fa640 1 -- 172.21.15.49:0/3648580786 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c400f450 con 0x7f86d40ffb90 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.684+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d4073600 con 0x7f86d40ffb90 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.685+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d40fff90 con 0x7f86d40ffb90 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.686+0000 7f86d17fa640 1 -- 172.21.15.49:0/3648580786 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f86c4007950 con 0x7f86d40ffb90 2024-09-19T09:09:23.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.686+0000 7f86d17fa640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f86c006e600 0x7f86c0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.686+0000 7f86d17fa640 1 -- 172.21.15.49:0/3648580786 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f86c4013070 con 0x7f86d40ffb90 2024-09-19T09:09:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.686+0000 7f86cbfff640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f86c006e600 0x7f86c0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.687+0000 7f86cbfff640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f86c006e600 0x7f86c0070ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000c00 tx=0x7f86bc0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.691+0000 7f86d17fa640 1 -- 172.21.15.49:0/3648580786 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f86c40578a0 con 0x7f86d40ffb90 2024-09-19T09:09:23.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:23 smithi049 ceph-mon[91793]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:23.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:23 smithi049 ceph-mon[91793]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:23.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:23 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2427602204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:23.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:23 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1105715960' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:09:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.936+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f86d4108780 con 0x7f86d40ffb90 2024-09-19T09:09:23.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.936+0000 7f86d17fa640 1 -- 172.21.15.49:0/3648580786 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f86c4057070 con 0x7f86d40ffb90 2024-09-19T09:09:23.937 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:09:23.937 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:09:23.937 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f86c006e600 msgr2=0x7f86c0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f86c006e600 0x7f86c0070ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000c00 tx=0x7f86bc0314e0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d40ffb90 msgr2=0x7f86d40741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d40ffb90 0x7f86d40741e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c8f0 tx=0x7f86c400cdb0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 shutdown_connections 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f86c006e600 0x7f86c0070ac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d4100d90 0x7f86d40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 --2- 172.21.15.49:0/3648580786 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86d40ffb90 0x7f86d40741e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 >> 172.21.15.49:0/3648580786 conn(0x7f86d40fb320 msgr2=0x7f86d40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.938+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 shutdown_connections 2024-09-19T09:09:23.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:23.939+0000 7f86d9c0d640 1 -- 172.21.15.49:0/3648580786 wait complete. 2024-09-19T09:09:24.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:23 smithi102 ceph-mon[80875]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:24.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:23 smithi102 ceph-mon[80875]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:24.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:23 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2427602204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:24.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:23 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1105715960' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:09:24.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:24 smithi102 ceph-mon[80875]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:24.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:24 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3648580786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:09:25.052 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:24 smithi049 ceph-mon[91793]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:25.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:24 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3648580786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:09:26.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:25 smithi102 ceph-mon[80875]: pgmap v184: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:25 smithi049 ceph-mon[91793]: pgmap v184: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:27 smithi049 ceph-mon[91793]: pgmap v185: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:09:28.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:27 smithi102 ceph-mon[80875]: pgmap v185: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:28.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:09:30.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:29 smithi102 ceph-mon[80875]: pgmap v186: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:30.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:29 smithi049 ceph-mon[91793]: pgmap v186: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:09:30.865 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:30.865 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:30.865 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi049.ibssbl"]}]: dispatch 2024-09-19T09:09:30.866 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:30 smithi049 ceph-mon[91793]: Upgrade: It appears safe to stop mds.cephfs.smithi049.ibssbl 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi049.ibssbl"]}]: dispatch 2024-09-19T09:09:31.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:30 smithi102 ceph-mon[80875]: Upgrade: It appears safe to stop mds.cephfs.smithi049.ibssbl 2024-09-19T09:09:32.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:32 smithi049 ceph-mon[91793]: pgmap v187: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:32.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:32.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:09:32.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:32.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:32 smithi102 ceph-mon[80875]: pgmap v187: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.ibssbl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:09:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:33.412 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:33 smithi049 ceph-mon[91793]: Upgrade: Updating mds.cephfs.smithi049.ibssbl 2024-09-19T09:09:33.412 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:33 smithi049 ceph-mon[91793]: Deploying daemon mds.cephfs.smithi049.ibssbl on smithi049 2024-09-19T09:09:33.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:33 smithi102 ceph-mon[80875]: Upgrade: Updating mds.cephfs.smithi049.ibssbl 2024-09-19T09:09:33.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:33 smithi102 ceph-mon[80875]: Deploying daemon mds.cephfs.smithi049.ibssbl on smithi049 2024-09-19T09:09:34.637 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:34 smithi102 ceph-mon[80875]: pgmap v188: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:34.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:34 smithi049 ceph-mon[91793]: pgmap v188: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:35.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:35 smithi102 ceph-mon[80875]: osdmap e90: 6 total, 6 up, 6 in 2024-09-19T09:09:35.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:35 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 2 up:standby 2024-09-19T09:09:35.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:09:35.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:35 smithi049 ceph-mon[91793]: osdmap e90: 6 total, 6 up, 6 in 2024-09-19T09:09:35.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:35 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 2 up:standby 2024-09-19T09:09:35.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:09:36.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:36 smithi102 ceph-mon[80875]: pgmap v190: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:36.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:36 smithi049 ceph-mon[91793]: pgmap v190: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:38.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:38 smithi049 ceph-mon[91793]: pgmap v191: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:38.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:38 smithi102 ceph-mon[80875]: pgmap v191: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:40 smithi049 ceph-mon[91793]: pgmap v192: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:40.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:40 smithi102 ceph-mon[80875]: pgmap v192: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:41.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:41 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:boot 2024-09-19T09:09:41.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:41 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 3 up:standby 2024-09-19T09:09:41.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:09:41.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:41 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:boot 2024-09-19T09:09:41.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:41 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.uujbrc=up:active} 3 up:standby 2024-09-19T09:09:41.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:09:42.636 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:42 smithi049 ceph-mon[91793]: pgmap v193: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:42.660 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:42 smithi102 ceph-mon[80875]: pgmap v193: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:09:43.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:09:44.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:44 smithi102 ceph-mon[80875]: pgmap v194: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:44.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:44 smithi049 ceph-mon[91793]: pgmap v194: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:45.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:45 smithi049 ceph-mon[91793]: pgmap v195: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:45.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:45.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:45.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:45.907 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:45 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:46.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:45 smithi102 ceph-mon[80875]: pgmap v195: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:46.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:45 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:47.835 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:47 smithi049 ceph-mon[91793]: pgmap v196: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:48.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:47 smithi102 ceph-mon[80875]: pgmap v196: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: pgmap v197: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi049.uujbrc"]}]: dispatch 2024-09-19T09:09:49.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:49 smithi049 ceph-mon[91793]: Upgrade: It appears safe to stop mds.cephfs.smithi049.uujbrc 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: pgmap v197: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.889 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.890 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.890 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:49.890 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi049.uujbrc"]}]: dispatch 2024-09-19T09:09:49.890 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:49 smithi102 ceph-mon[80875]: Upgrade: It appears safe to stop mds.cephfs.smithi049.uujbrc 2024-09-19T09:09:51.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:51 smithi049 ceph-mon[91793]: Upgrade: Updating mds.cephfs.smithi049.uujbrc 2024-09-19T09:09:51.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:51.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:09:51.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:51.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:51 smithi049 ceph-mon[91793]: Deploying daemon mds.cephfs.smithi049.uujbrc on smithi049 2024-09-19T09:09:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:51 smithi102 ceph-mon[80875]: Upgrade: Updating mds.cephfs.smithi049.uujbrc 2024-09-19T09:09:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.uujbrc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:09:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:51.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:51 smithi102 ceph-mon[80875]: Deploying daemon mds.cephfs.smithi049.uujbrc on smithi049 2024-09-19T09:09:52.379 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[91789]: 2024-09-19T09:09:52.064+0000 7f49317f7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:09:52.379 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: pgmap v198: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:52.379 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:09:52.379 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:09:52.379 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: osdmap e91: 6 total, 6 up, 6 in 2024-09-19T09:09:52.379 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: Standby daemon mds.cephfs.smithi049.ibssbl assigned to filesystem cephfs as rank 0 2024-09-19T09:09:52.380 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:09:52.380 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-19T09:09:52.380 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:52 smithi049 ceph-mon[91793]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:replay} 2 up:standby 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: pgmap v198: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: osdmap e91: 6 total, 6 up, 6 in 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: Standby daemon mds.cephfs.smithi049.ibssbl assigned to filesystem cephfs as rank 0 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-19T09:09:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:52 smithi102 ceph-mon[80875]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:replay} 2 up:standby 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.026+0000 7f83dfb45640 1 -- 172.21.15.49:0/2457484192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8100d90 msgr2=0x7f83d8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.026+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2457484192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8100d90 0x7f83d8101210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009880 tx=0x7f83c802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.026+0000 7f83dfb45640 1 -- 172.21.15.49:0/2457484192 shutdown_connections 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.026+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2457484192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8100d90 0x7f83d8101210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.026+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2457484192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83d80ffb90 0x7f83d80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.026+0000 7f83dfb45640 1 -- 172.21.15.49:0/2457484192 >> 172.21.15.49:0/2457484192 conn(0x7f83d80fb360 msgr2=0x7f83d80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 -- 172.21.15.49:0/2457484192 shutdown_connections 2024-09-19T09:09:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 -- 172.21.15.49:0/2457484192 wait complete. 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 Processor -- start 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 -- start start 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d80ffb90 0x7f83d8197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83d8100d90 0x7f83d8197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8198310 con 0x7f83d80ffb90 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.027+0000 7f83dfb45640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8198480 con 0x7f83d8100d90 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd8e1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d80ffb90 0x7f83d8197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd8e1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d80ffb90 0x7f83d8197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41014/0 (socket says 172.21.15.49:41014) 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd8e1640 1 -- 172.21.15.49:0/2521468477 learned_addr learned my addr 172.21.15.49:0/2521468477 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd0e0640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83d8100d90 0x7f83d8197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd8e1640 1 -- 172.21.15.49:0/2521468477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83d8100d90 msgr2=0x7f83d8197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd8e1640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83d8100d90 0x7f83d8197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd8e1640 1 -- 172.21.15.49:0/2521468477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009560 con 0x7f83d80ffb90 2024-09-19T09:09:54.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dd8e1640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d80ffb90 0x7f83d8197800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83d400d900 tx=0x7f83d400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83ceffd640 1 -- 172.21.15.49:0/2521468477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d4009c00 con 0x7f83d80ffb90 2024-09-19T09:09:54.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83ceffd640 1 -- 172.21.15.49:0/2521468477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83d4009d60 con 0x7f83d80ffb90 2024-09-19T09:09:54.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d819cf20 con 0x7f83d80ffb90 2024-09-19T09:09:54.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.028+0000 7f83ceffd640 1 -- 172.21.15.49:0/2521468477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d400f7b0 con 0x7f83d80ffb90 2024-09-19T09:09:54.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.029+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d819d3e0 con 0x7f83d80ffb90 2024-09-19T09:09:54.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.030+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d8105260 con 0x7f83d80ffb90 2024-09-19T09:09:54.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.031+0000 7f83ceffd640 1 -- 172.21.15.49:0/2521468477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f83d4010460 con 0x7f83d80ffb90 2024-09-19T09:09:54.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.032+0000 7f83ceffd640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f83c406e5f0 0x7f83c4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.032+0000 7f83ceffd640 1 -- 172.21.15.49:0/2521468477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f83d408eda0 con 0x7f83d80ffb90 2024-09-19T09:09:54.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.032+0000 7f83dd0e0640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f83c406e5f0 0x7f83c4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.033+0000 7f83dd0e0640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f83c406e5f0 0x7f83c4070ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83c8000c00 tx=0x7f83c80314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.036+0000 7f83ceffd640 1 -- 172.21.15.49:0/2521468477 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f83d4057f00 con 0x7f83d80ffb90 2024-09-19T09:09:54.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.232+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83d802c5d0 con 0x7f83c406e5f0 2024-09-19T09:09:54.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.233+0000 7f83ceffd640 1 -- 172.21.15.49:0/2521468477 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f83d802c5d0 con 0x7f83c406e5f0 2024-09-19T09:09:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f83c406e5f0 msgr2=0x7f83c4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f83c406e5f0 0x7f83c4070ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83c8000c00 tx=0x7f83c80314e0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d80ffb90 msgr2=0x7f83d8197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d80ffb90 0x7f83d8197800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83d400d900 tx=0x7f83d400ddc0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 shutdown_connections 2024-09-19T09:09:54.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f83c406e5f0 0x7f83c4070ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83d8100d90 0x7f83d8197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 --2- 172.21.15.49:0/2521468477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d80ffb90 0x7f83d8197800 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 >> 172.21.15.49:0/2521468477 conn(0x7f83d80fb360 msgr2=0x7f83d8102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 shutdown_connections 2024-09-19T09:09:54.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.236+0000 7f83dfb45640 1 -- 172.21.15.49:0/2521468477 wait complete. 2024-09-19T09:09:54.244 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:09:54.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:54 smithi049 ceph-mon[91793]: pgmap v200: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-09-19T09:09:54.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:54 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:09:54.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.322+0000 7f672599d640 1 -- 172.21.15.49:0/3367977845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720100430 msgr2=0x7f6720102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.323+0000 7f672599d640 1 --2- 172.21.15.49:0/3367977845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720100430 0x7f6720102820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67140098b0 tx=0x7f671402a4d0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.323+0000 7f672599d640 1 -- 172.21.15.49:0/3367977845 shutdown_connections 2024-09-19T09:09:54.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.323+0000 7f672599d640 1 --2- 172.21.15.49:0/3367977845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6720102d60 0x7f6720105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.323+0000 7f672599d640 1 --2- 172.21.15.49:0/3367977845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720100430 0x7f6720102820 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.323+0000 7f672599d640 1 -- 172.21.15.49:0/3367977845 >> 172.21.15.49:0/3367977845 conn(0x7f67200fa010 msgr2=0x7f67200fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.323+0000 7f672599d640 1 -- 172.21.15.49:0/3367977845 shutdown_connections 2024-09-19T09:09:54.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.323+0000 7f672599d640 1 -- 172.21.15.49:0/3367977845 wait complete. 2024-09-19T09:09:54.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f672599d640 1 Processor -- start 2024-09-19T09:09:54.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f672599d640 1 -- start start 2024-09-19T09:09:54.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f672599d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6720100430 0x7f6720195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f672599d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720102d60 0x7f67201959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f672599d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6720195fa0 con 0x7f6720102d60 2024-09-19T09:09:54.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f672599d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6720196110 con 0x7f6720100430 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f671ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720102d60 0x7f67201959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f671ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720102d60 0x7f67201959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41026/0 (socket says 172.21.15.49:41026) 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f671ffff640 1 -- 172.21.15.49:0/1347059647 learned_addr learned my addr 172.21.15.49:0/1347059647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f672499b640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6720100430 0x7f6720195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f671ffff640 1 -- 172.21.15.49:0/1347059647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6720100430 msgr2=0x7f6720195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f671ffff640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6720100430 0x7f6720195490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.324+0000 7f671ffff640 1 -- 172.21.15.49:0/1347059647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6714009560 con 0x7f6720102d60 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.325+0000 7f671ffff640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720102d60 0x7f67201959d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c920 tx=0x7f670c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.325+0000 7f671dffb640 1 -- 172.21.15.49:0/1347059647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670c007b80 con 0x7f6720102d60 2024-09-19T09:09:54.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.325+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672019abb0 con 0x7f6720102d60 2024-09-19T09:09:54.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.325+0000 7f671dffb640 1 -- 172.21.15.49:0/1347059647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f670c007ce0 con 0x7f6720102d60 2024-09-19T09:09:54.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.325+0000 7f671dffb640 1 -- 172.21.15.49:0/1347059647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670c0187d0 con 0x7f6720102d60 2024-09-19T09:09:54.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.325+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672019b180 con 0x7f6720102d60 2024-09-19T09:09:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.327+0000 7f671dffb640 1 -- 172.21.15.49:0/1347059647 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f670c018930 con 0x7f6720102d60 2024-09-19T09:09:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.327+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67201085e0 con 0x7f6720102d60 2024-09-19T09:09:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.327+0000 7f671dffb640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f671006e5f0 0x7f6710070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.327+0000 7f671dffb640 1 -- 172.21.15.49:0/1347059647 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f670c08e820 con 0x7f6720102d60 2024-09-19T09:09:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.327+0000 7f672499b640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f671006e5f0 0x7f6710070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.328+0000 7f672499b640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f671006e5f0 0x7f6710070ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6714006010 tx=0x7f67140314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.331+0000 7f671dffb640 1 -- 172.21.15.49:0/1347059647 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f670c0578e0 con 0x7f6720102d60 2024-09-19T09:09:54.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:54 smithi102 ceph-mon[80875]: pgmap v200: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-09-19T09:09:54.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:54 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:09:54.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.527+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67201037a0 con 0x7f671006e5f0 2024-09-19T09:09:54.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.529+0000 7f671dffb640 1 -- 172.21.15.49:0/1347059647 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f67201037a0 con 0x7f671006e5f0 2024-09-19T09:09:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f671006e5f0 msgr2=0x7f6710070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f671006e5f0 0x7f6710070ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6714006010 tx=0x7f67140314e0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720102d60 msgr2=0x7f67201959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720102d60 0x7f67201959d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c920 tx=0x7f670c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 shutdown_connections 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f671006e5f0 0x7f6710070ab0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6720102d60 0x7f67201959d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 --2- 172.21.15.49:0/1347059647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6720100430 0x7f6720195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 >> 172.21.15.49:0/1347059647 conn(0x7f67200fa010 msgr2=0x7f67200fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 shutdown_connections 2024-09-19T09:09:54.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.531+0000 7f672599d640 1 -- 172.21.15.49:0/1347059647 wait complete. 2024-09-19T09:09:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.616+0000 7f2640184640 1 -- 172.21.15.49:0/2474463717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 msgr2=0x7f2638101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.616+0000 7f2640184640 1 --2- 172.21.15.49:0/2474463717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f2638101210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2628009880 tx=0x7f262802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.617+0000 7f2640184640 1 -- 172.21.15.49:0/2474463717 shutdown_connections 2024-09-19T09:09:54.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.617+0000 7f2640184640 1 --2- 172.21.15.49:0/2474463717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f2638101210 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.617+0000 7f2640184640 1 --2- 172.21.15.49:0/2474463717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26380ffb90 0x7f26380fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.617+0000 7f2640184640 1 -- 172.21.15.49:0/2474463717 >> 172.21.15.49:0/2474463717 conn(0x7f26380fb320 msgr2=0x7f26380fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.617+0000 7f2640184640 1 -- 172.21.15.49:0/2474463717 shutdown_connections 2024-09-19T09:09:54.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.617+0000 7f2640184640 1 -- 172.21.15.49:0/2474463717 wait complete. 2024-09-19T09:09:54.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f2640184640 1 Processor -- start 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f2640184640 1 -- start start 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f2640184640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26380ffb90 0x7f2638074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f2640184640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f26380728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f2640184640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2638072de0 con 0x7f2638100d90 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f2640184640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2638072f50 con 0x7f26380ffb90 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f263d71f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f26380728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f263d71f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f26380728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41052/0 (socket says 172.21.15.49:41052) 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f263d71f640 1 -- 172.21.15.49:0/1883103828 learned_addr learned my addr 172.21.15.49:0/1883103828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.618+0000 7f263df20640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26380ffb90 0x7f2638074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.619+0000 7f263d71f640 1 -- 172.21.15.49:0/1883103828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26380ffb90 msgr2=0x7f2638074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.619+0000 7f263d71f640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26380ffb90 0x7f2638074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.619+0000 7f263d71f640 1 -- 172.21.15.49:0/1883103828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628009560 con 0x7f2638100d90 2024-09-19T09:09:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.619+0000 7f263d71f640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f26380728a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2628005610 tx=0x7f2628005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.619+0000 7f262effd640 1 -- 172.21.15.49:0/1883103828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2628004ba0 con 0x7f2638100d90 2024-09-19T09:09:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.619+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26380731d0 con 0x7f2638100d90 2024-09-19T09:09:54.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.619+0000 7f262effd640 1 -- 172.21.15.49:0/1883103828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2628004d00 con 0x7f2638100d90 2024-09-19T09:09:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.620+0000 7f262effd640 1 -- 172.21.15.49:0/1883103828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2628003b50 con 0x7f2638100d90 2024-09-19T09:09:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.620+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2638073680 con 0x7f2638100d90 2024-09-19T09:09:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.621+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2638100010 con 0x7f2638100d90 2024-09-19T09:09:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.621+0000 7f262effd640 1 -- 172.21.15.49:0/1883103828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2628031640 con 0x7f2638100d90 2024-09-19T09:09:54.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.622+0000 7f262effd640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f262406e5f0 0x7f2624070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.622+0000 7f262effd640 1 -- 172.21.15.49:0/1883103828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f26280afa10 con 0x7f2638100d90 2024-09-19T09:09:54.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.622+0000 7f263df20640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f262406e5f0 0x7f2624070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.623+0000 7f263df20640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f262406e5f0 0x7f2624070ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2638100bf0 tx=0x7f2634009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.631+0000 7f262effd640 1 -- 172.21.15.49:0/1883103828 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2628078a50 con 0x7f2638100d90 2024-09-19T09:09:54.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.831+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f263802c450 con 0x7f262406e5f0 2024-09-19T09:09:54.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.841+0000 7f262effd640 1 -- 172.21.15.49:0/1883103828 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f263802c450 con 0x7f262406e5f0 2024-09-19T09:09:54.841 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (14m) 10s ago 15m 25.4M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (15m) 10s ago 15m 9407k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (14m) 62s ago 14m 8879k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (4m) 10s ago 15m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (4m) 62s ago 14m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (13m) 10s ago 15m 85.2M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (15s) 10s ago 10m 13.2M - 19.1.1-361-g2f599a46 d2baa855c067 3860d60c0271 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (10m) 10s ago 10m 157M - 18.2.4-855-g19e2a2be 980a0bfcd684 133bb7f02281 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (9m) 62s ago 9m 26.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (10m) 62s ago 10m 27.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 7b7247c8a33b 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (7m) 10s ago 16m 505M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:09:54.842 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (5m) 62s ago 14m 442M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (5m) 10s ago 16m 52.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (4m) 62s ago 14m 41.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (15m) 10s ago 15m 15.5M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (14m) 62s ago 14m 16.2M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 10s ago 13m 103M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (3m) 10s ago 13m 98.5M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 10s ago 12m 100M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (2m) 62s ago 12m 120M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (97s) 62s ago 11m 81.4M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (65s) 62s ago 11m 11.3M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:09:54.843 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (5m) 10s ago 14m 61.4M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:09:54.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f262406e5f0 msgr2=0x7f2624070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f262406e5f0 0x7f2624070ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2638100bf0 tx=0x7f2634009110 comp rx=0 tx=0).stop 2024-09-19T09:09:54.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 msgr2=0x7f26380728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f26380728a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2628005610 tx=0x7f2628005640 comp rx=0 tx=0).stop 2024-09-19T09:09:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 shutdown_connections 2024-09-19T09:09:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f262406e5f0 0x7f2624070ab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2638100d90 0x7f26380728a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 --2- 172.21.15.49:0/1883103828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26380ffb90 0x7f2638074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 >> 172.21.15.49:0/1883103828 conn(0x7f26380fb320 msgr2=0x7f26381044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 shutdown_connections 2024-09-19T09:09:54.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.845+0000 7f2640184640 1 -- 172.21.15.49:0/1883103828 wait complete. 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/2305498453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00ffcf0 msgr2=0x7ff8e0100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/2305498453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00ffcf0 0x7ff8e0100170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009880 tx=0x7ff8cc02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/2305498453 shutdown_connections 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/2305498453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00ffcf0 0x7ff8e0100170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/2305498453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e00feaf0 0x7ff8e00feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/2305498453 >> 172.21.15.49:0/2305498453 conn(0x7ff8e00fa280 msgr2=0x7ff8e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/2305498453 shutdown_connections 2024-09-19T09:09:54.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.933+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/2305498453 wait complete. 2024-09-19T09:09:54.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.934+0000 7ff8e6a9f640 1 Processor -- start 2024-09-19T09:09:54.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.934+0000 7ff8e6a9f640 1 -- start start 2024-09-19T09:09:54.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.934+0000 7ff8e6a9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00feaf0 0x7ff8e00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e6a9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e00ffcf0 0x7ff8e019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e483b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00feaf0 0x7ff8e00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e6a9f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e019aa60 con 0x7ff8e00feaf0 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e6a9f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e019abd0 con 0x7ff8e00ffcf0 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e483b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00feaf0 0x7ff8e00687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41064/0 (socket says 172.21.15.49:41064) 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e483b640 1 -- 172.21.15.49:0/1858826922 learned_addr learned my addr 172.21.15.49:0/1858826922 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8dffff640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e00ffcf0 0x7ff8e019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e483b640 1 -- 172.21.15.49:0/1858826922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e00ffcf0 msgr2=0x7ff8e019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e483b640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e00ffcf0 0x7ff8e019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e483b640 1 -- 172.21.15.49:0/1858826922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc009560 con 0x7ff8e00feaf0 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8e483b640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00feaf0 0x7ff8e00687d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400b3d0 tx=0x7ff8d400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.935+0000 7ff8ddffb640 1 -- 172.21.15.49:0/1858826922 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d4011800 con 0x7ff8e00feaf0 2024-09-19T09:09:54.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.936+0000 7ff8ddffb640 1 -- 172.21.15.49:0/1858826922 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8d4011e20 con 0x7ff8e00feaf0 2024-09-19T09:09:54.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.936+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e019aeb0 con 0x7ff8e00feaf0 2024-09-19T09:09:54.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.936+0000 7ff8ddffb640 1 -- 172.21.15.49:0/1858826922 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d400f510 con 0x7ff8e00feaf0 2024-09-19T09:09:54.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.936+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e019b350 con 0x7ff8e00feaf0 2024-09-19T09:09:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.937+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e018e710 con 0x7ff8e00feaf0 2024-09-19T09:09:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.938+0000 7ff8ddffb640 1 -- 172.21.15.49:0/1858826922 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff8d4010380 con 0x7ff8e00feaf0 2024-09-19T09:09:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.938+0000 7ff8ddffb640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.938+0000 7ff8ddffb640 1 -- 172.21.15.49:0/1858826922 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6682+0+0 (secure 0 0 0) 0x7ff8d408e4c0 con 0x7ff8e00feaf0 2024-09-19T09:09:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.938+0000 7ff8dffff640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:54.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.939+0000 7ff8dffff640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc000c00 tx=0x7ff8cc005d70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:54.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:54.943+0000 7ff8ddffb640 1 -- 172.21.15.49:0/1858826922 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff8d4057500 con 0x7ff8e00feaf0 2024-09-19T09:09:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.217+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff8e01079b0 con 0x7ff8e00feaf0 2024-09-19T09:09:55.218 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:55 smithi049 ceph-mon[91793]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:55.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.218+0000 7ff8ddffb640 1 -- 172.21.15.49:0/1858826922 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7ff8d405abc0 con 0x7ff8e00feaf0 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:55.219 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2, 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2, 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 11 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:09:55.220 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:09:55.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff8d006e5f0 msgr2=0x7ff8d0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc000c00 tx=0x7ff8cc005d70 comp rx=0 tx=0).stop 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00feaf0 msgr2=0x7ff8e00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00feaf0 0x7ff8e00687d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400b3d0 tx=0x7ff8d400b890 comp rx=0 tx=0).stop 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 shutdown_connections 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff8d006e5f0 0x7ff8d0070ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8e00ffcf0 0x7ff8e019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 --2- 172.21.15.49:0/1858826922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8e00feaf0 0x7ff8e00687d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 >> 172.21.15.49:0/1858826922 conn(0x7ff8e00fa280 msgr2=0x7ff8e01033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 shutdown_connections 2024-09-19T09:09:55.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.220+0000 7ff8e6a9f640 1 -- 172.21.15.49:0/1858826922 wait complete. 2024-09-19T09:09:55.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:55 smithi102 ceph-mon[80875]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:55.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.304+0000 7f87ad50a640 1 -- 172.21.15.49:0/2881593858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 msgr2=0x7f87a8105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.304+0000 7f87ad50a640 1 --2- 172.21.15.49:0/2881593858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a8105440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f879c009880 tx=0x7f879c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.305+0000 7f87ad50a640 1 -- 172.21.15.49:0/2881593858 shutdown_connections 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.305+0000 7f87ad50a640 1 --2- 172.21.15.49:0/2881593858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a8105440 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.305+0000 7f87ad50a640 1 --2- 172.21.15.49:0/2881593858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87a8100720 0x7f87a8102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.305+0000 7f87ad50a640 1 -- 172.21.15.49:0/2881593858 >> 172.21.15.49:0/2881593858 conn(0x7f87a80fa280 msgr2=0x7f87a80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.305+0000 7f87ad50a640 1 -- 172.21.15.49:0/2881593858 shutdown_connections 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.305+0000 7f87ad50a640 1 -- 172.21.15.49:0/2881593858 wait complete. 2024-09-19T09:09:55.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.305+0000 7f87ad50a640 1 Processor -- start 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87ad50a640 1 -- start start 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87ad50a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87a8100720 0x7f87a8100080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87ad50a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a80fe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87ad50a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80fec10 con 0x7f87a8103050 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87ad50a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80fed80 con 0x7f87a8100720 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87a67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a80fe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87a67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a80fe6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41094/0 (socket says 172.21.15.49:41094) 2024-09-19T09:09:55.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87a67fc640 1 -- 172.21.15.49:0/4242755308 learned_addr learned my addr 172.21.15.49:0/4242755308 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.306+0000 7f87a6ffd640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87a8100720 0x7f87a8100080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f87a67fc640 1 -- 172.21.15.49:0/4242755308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87a8100720 msgr2=0x7f87a8100080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f87a67fc640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87a8100720 0x7f87a8100080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f87a67fc640 1 -- 172.21.15.49:0/4242755308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009560 con 0x7f87a8103050 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f87a67fc640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a80fe6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f879c02a9c0 tx=0x7f879c0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f878ffff640 1 -- 172.21.15.49:0/4242755308 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f879c004aa0 con 0x7f87a8103050 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a80ff000 con 0x7f87a8103050 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f878ffff640 1 -- 172.21.15.49:0/4242755308 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f879c004c00 con 0x7f87a8103050 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f878ffff640 1 -- 172.21.15.49:0/4242755308 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f879c003a80 con 0x7f87a8103050 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.307+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a80ff4f0 con 0x7f87a8103050 2024-09-19T09:09:55.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.308+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8100b00 con 0x7f87a8103050 2024-09-19T09:09:55.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.310+0000 7f878ffff640 1 -- 172.21.15.49:0/4242755308 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f879c003d40 con 0x7f87a8103050 2024-09-19T09:09:55.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.311+0000 7f878ffff640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f879006e5f0 0x7f8790070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.311+0000 7f878ffff640 1 -- 172.21.15.49:0/4242755308 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f879c0afd80 con 0x7f87a8103050 2024-09-19T09:09:55.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.311+0000 7f87a6ffd640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f879006e5f0 0x7f8790070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.311+0000 7f87a6ffd640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f879006e5f0 0x7f8790070ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8798005fd0 tx=0x7f8798005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.314+0000 7f878ffff640 1 -- 172.21.15.49:0/4242755308 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f879c078e40 con 0x7f87a8103050 2024-09-19T09:09:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.531+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f87a81087d0 con 0x7f87a8103050 2024-09-19T09:09:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.531+0000 7f878ffff640 1 -- 172.21.15.49:0/4242755308 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1789 (secure 0 0 0) 0x7f879c040710 con 0x7f87a8103050 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:e30 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-19T09:09:52:069211+0000 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 30 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:09:55.532 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:09:52.069201+0000 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 91 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2024-09-19T09:09:55.533 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=34416} 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 1 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 0 members: 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:34416} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:55.534 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-09-19T09:09:55.535 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:09:55.535 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.102:6826/2534703038,v1:172.21.15.102:6827/2534703038] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:09:55.535 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.102:6824/3508743177,v1:172.21.15.102:6825/3508743177] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:09:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 30 2024-09-19T09:09:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f879006e5f0 msgr2=0x7f8790070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f879006e5f0 0x7f8790070ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8798005fd0 tx=0x7f8798005850 comp rx=0 tx=0).stop 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 msgr2=0x7f87a80fe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a80fe6d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f879c02a9c0 tx=0x7f879c0054f0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 shutdown_connections 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f879006e5f0 0x7f8790070ab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87a8103050 0x7f87a80fe6d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 --2- 172.21.15.49:0/4242755308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87a8100720 0x7f87a8100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.533+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 >> 172.21.15.49:0/4242755308 conn(0x7f87a80fa280 msgr2=0x7f87a80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.534+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 shutdown_connections 2024-09-19T09:09:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.534+0000 7f87ad50a640 1 -- 172.21.15.49:0/4242755308 wait complete. 2024-09-19T09:09:55.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/839027301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 msgr2=0x7fd4ac105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/839027301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac105460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009880 tx=0x7fd4a002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/839027301 shutdown_connections 2024-09-19T09:09:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/839027301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac105460 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/839027301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4ac100740 0x7fd4ac102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/839027301 >> 172.21.15.49:0/839027301 conn(0x7fd4ac0fa280 msgr2=0x7fd4ac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/839027301 shutdown_connections 2024-09-19T09:09:55.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.622+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/839027301 wait complete. 2024-09-19T09:09:55.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4b0f8b640 1 Processor -- start 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4b0f8b640 1 -- start start 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4b0f8b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4ac100740 0x7fd4ac1000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4b0f8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac0fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4b0f8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0fec30 con 0x7fd4ac103070 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4b0f8b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0feda0 con 0x7fd4ac100740 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4a9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac0fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4a9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac0fe6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41114/0 (socket says 172.21.15.49:41114) 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4a9d9b640 1 -- 172.21.15.49:0/3894025377 learned_addr learned my addr 172.21.15.49:0/3894025377 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.623+0000 7fd4aa59c640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4ac100740 0x7fd4ac1000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd4a9d9b640 1 -- 172.21.15.49:0/3894025377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4ac100740 msgr2=0x7fd4ac1000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd4a9d9b640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4ac100740 0x7fd4ac1000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd4a9d9b640 1 -- 172.21.15.49:0/3894025377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0009560 con 0x7fd4ac103070 2024-09-19T09:09:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd4a9d9b640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac0fe6f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0032b90 tx=0x7fd4a0032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd49b7fe640 1 -- 172.21.15.49:0/3894025377 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4a0005220 con 0x7fd4ac103070 2024-09-19T09:09:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac0ff020 con 0x7fd4ac103070 2024-09-19T09:09:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd49b7fe640 1 -- 172.21.15.49:0/3894025377 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4a0005380 con 0x7fd4ac103070 2024-09-19T09:09:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd49b7fe640 1 -- 172.21.15.49:0/3894025377 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4a0003ac0 con 0x7fd4ac103070 2024-09-19T09:09:55.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.624+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac0ff510 con 0x7fd4ac103070 2024-09-19T09:09:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.625+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac100b20 con 0x7fd4ac103070 2024-09-19T09:09:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.626+0000 7fd49b7fe640 1 -- 172.21.15.49:0/3894025377 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd4a0004c80 con 0x7fd4ac103070 2024-09-19T09:09:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.627+0000 7fd49b7fe640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd49406e5f0 0x7fd494070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.627+0000 7fd49b7fe640 1 -- 172.21.15.49:0/3894025377 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fd4a00af7d0 con 0x7fd4ac103070 2024-09-19T09:09:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.627+0000 7fd4aa59c640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd49406e5f0 0x7fd494070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.628+0000 7fd4aa59c640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd49406e5f0 0x7fd494070ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd49c005fd0 tx=0x7fd49c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.635+0000 7fd49b7fe640 1 -- 172.21.15.49:0/3894025377 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd4a00788c0 con 0x7fd4ac103070 2024-09-19T09:09:55.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.832+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4ac103a10 con 0x7fd49406e5f0 2024-09-19T09:09:55.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.833+0000 7fd49b7fe640 1 -- 172.21.15.49:0/3894025377 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd4ac103a10 con 0x7fd49406e5f0 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:09:55.834 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "13/23 daemons upgraded", 2024-09-19T09:09:55.835 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T09:09:55.835 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:09:55.835 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:09:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd49406e5f0 msgr2=0x7fd494070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd49406e5f0 0x7fd494070ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd49c005fd0 tx=0x7fd49c00b390 comp rx=0 tx=0).stop 2024-09-19T09:09:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 msgr2=0x7fd4ac0fe6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac0fe6f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0032b90 tx=0x7fd4a0032bc0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 shutdown_connections 2024-09-19T09:09:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd49406e5f0 0x7fd494070ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4ac103070 0x7fd4ac0fe6f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 --2- 172.21.15.49:0/3894025377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4ac100740 0x7fd4ac1000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 >> 172.21.15.49:0/3894025377 conn(0x7fd4ac0fa280 msgr2=0x7fd4ac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 shutdown_connections 2024-09-19T09:09:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.836+0000 7fd4b0f8b640 1 -- 172.21.15.49:0/3894025377 wait complete. 2024-09-19T09:09:55.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 -- 172.21.15.49:0/1101458463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 msgr2=0x7fef941053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 --2- 172.21.15.49:0/1101458463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef941053a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fef840098b0 tx=0x7fef8402a4d0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 -- 172.21.15.49:0/1101458463 shutdown_connections 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 --2- 172.21.15.49:0/1101458463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef941053a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 --2- 172.21.15.49:0/1101458463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef94100680 0x7fef94102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 -- 172.21.15.49:0/1101458463 >> 172.21.15.49:0/1101458463 conn(0x7fef940fa280 msgr2=0x7fef940fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 -- 172.21.15.49:0/1101458463 shutdown_connections 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 -- 172.21.15.49:0/1101458463 wait complete. 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.921+0000 7fef9bc52640 1 Processor -- start 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef9bc52640 1 -- start start 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef9bc52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef94100680 0x7fef941956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef9bc52640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef94195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef9bc52640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94196200 con 0x7fef94102fb0 2024-09-19T09:09:55.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef9bc52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94196370 con 0x7fef94100680 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef991ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef94195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef991ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef94195c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41132/0 (socket says 172.21.15.49:41132) 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef991ed640 1 -- 172.21.15.49:0/3238196058 learned_addr learned my addr 172.21.15.49:0/3238196058 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef999ee640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef94100680 0x7fef941956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef991ed640 1 -- 172.21.15.49:0/3238196058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef94100680 msgr2=0x7fef941956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef991ed640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef94100680 0x7fef941956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef991ed640 1 -- 172.21.15.49:0/3238196058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef84009560 con 0x7fef94102fb0 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.922+0000 7fef991ed640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef94195c30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef840055a0 tx=0x7fef840055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.923+0000 7fef8affd640 1 -- 172.21.15.49:0/3238196058 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef84004aa0 con 0x7fef94102fb0 2024-09-19T09:09:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.923+0000 7fef8affd640 1 -- 172.21.15.49:0/3238196058 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef84004c00 con 0x7fef94102fb0 2024-09-19T09:09:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.923+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9419adb0 con 0x7fef94102fb0 2024-09-19T09:09:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.923+0000 7fef8affd640 1 -- 172.21.15.49:0/3238196058 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef84003b50 con 0x7fef94102fb0 2024-09-19T09:09:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.923+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9419b2a0 con 0x7fef94102fb0 2024-09-19T09:09:55.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.924+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef941087e0 con 0x7fef94102fb0 2024-09-19T09:09:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.924+0000 7fef8affd640 1 -- 172.21.15.49:0/3238196058 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fef84003cb0 con 0x7fef94102fb0 2024-09-19T09:09:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.925+0000 7fef8affd640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fef8006e5f0 0x7fef80070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.925+0000 7fef8affd640 1 -- 172.21.15.49:0/3238196058 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fef840af810 con 0x7fef94102fb0 2024-09-19T09:09:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.925+0000 7fef999ee640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fef8006e5f0 0x7fef80070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.926+0000 7fef999ee640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fef8006e5f0 0x7fef80070ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef9000bbe0 tx=0x7fef9000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:55.930+0000 7fef8affd640 1 -- 172.21.15.49:0/3238196058 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fef84078980 con 0x7fef94102fb0 2024-09-19T09:09:56.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.199+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fef94108970 con 0x7fef94102fb0 2024-09-19T09:09:56.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.199+0000 7fef8affd640 1 -- 172.21.15.49:0/3238196058 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7fef8407c040 con 0x7fef94102fb0 2024-09-19T09:09:56.200 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-19T09:09:56.200 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T09:09:56.200 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-09-19T09:09:56.200 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:09:56.200 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:09:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fef8006e5f0 msgr2=0x7fef80070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fef8006e5f0 0x7fef80070ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef9000bbe0 tx=0x7fef9000b390 comp rx=0 tx=0).stop 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 msgr2=0x7fef94195c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef94195c30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef840055a0 tx=0x7fef840055d0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 shutdown_connections 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fef8006e5f0 0x7fef80070ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef94102fb0 0x7fef94195c30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 --2- 172.21.15.49:0/3238196058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef94100680 0x7fef941956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 >> 172.21.15.49:0/3238196058 conn(0x7fef940fa280 msgr2=0x7fef940fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 shutdown_connections 2024-09-19T09:09:56.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:09:56.201+0000 7fef9bc52640 1 -- 172.21.15.49:0/3238196058 wait complete. 2024-09-19T09:09:56.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:56 smithi102 ceph-mon[80875]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:56.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:56 smithi102 ceph-mon[80875]: pgmap v201: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 8.5 MiB/s rd, 3 op/s 2024-09-19T09:09:56.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:56 smithi102 ceph-mon[80875]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:56.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:56 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1858826922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:56.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:56 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/4242755308' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:09:56.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:56 smithi049 ceph-mon[91793]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:56.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:56 smithi049 ceph-mon[91793]: pgmap v201: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 8.5 MiB/s rd, 3 op/s 2024-09-19T09:09:56.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:56 smithi049 ceph-mon[91793]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:56.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:56 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1858826922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:09:56.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:56 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/4242755308' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:09:57.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:57 smithi049 ceph-mon[91793]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:57.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:57 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3238196058' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:09:57.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:57 smithi102 ceph-mon[80875]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:57.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:57 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3238196058' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:09:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:58 smithi049 ceph-mon[91793]: pgmap v202: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-09-19T09:09:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:09:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:09:58.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:58 smithi102 ceph-mon[80875]: pgmap v202: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-09-19T09:09:58.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:09:58.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:09:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: pgmap v203: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: fs cephfs is degraded 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: pgmap v203: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-19T09:10:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-19T09:10:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T09:10:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: fs cephfs is degraded 2024-09-19T09:10:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:10:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:10:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:00.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:00.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:01.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:01 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] up:boot 2024-09-19T09:10:01.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:01 smithi049 ceph-mon[91793]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:replay} 3 up:standby 2024-09-19T09:10:01.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:10:01.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:01 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] up:boot 2024-09-19T09:10:01.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:01 smithi102 ceph-mon[80875]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:replay} 3 up:standby 2024-09-19T09:10:01.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:10:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:02 smithi102 ceph-mon[80875]: pgmap v204: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-19T09:10:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:02 smithi102 ceph-mon[80875]: reconnect by client.24329 192.168.0.1:0/3002433656 after 0.000999973 2024-09-19T09:10:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:02 smithi102 ceph-mon[80875]: reconnect by client.14512 192.168.0.1:0/1855694255 after 0.00199994 2024-09-19T09:10:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:02 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:reconnect 2024-09-19T09:10:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:02 smithi102 ceph-mon[80875]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:reconnect} 3 up:standby 2024-09-19T09:10:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:02 smithi049 ceph-mon[91793]: pgmap v204: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-19T09:10:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:02 smithi049 ceph-mon[91793]: reconnect by client.24329 192.168.0.1:0/3002433656 after 0.000999973 2024-09-19T09:10:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:02 smithi049 ceph-mon[91793]: reconnect by client.14512 192.168.0.1:0/1855694255 after 0.00199994 2024-09-19T09:10:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:02 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:reconnect 2024-09-19T09:10:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:02 smithi049 ceph-mon[91793]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:reconnect} 3 up:standby 2024-09-19T09:10:03.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:03 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:rejoin 2024-09-19T09:10:03.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:03 smithi049 ceph-mon[91793]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:rejoin} 3 up:standby 2024-09-19T09:10:03.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:03 smithi049 ceph-mon[91793]: daemon mds.cephfs.smithi049.ibssbl is now active in filesystem cephfs as rank 0 2024-09-19T09:10:03.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:03 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:rejoin 2024-09-19T09:10:03.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:03 smithi102 ceph-mon[80875]: fsmap cephfs:1/1 {0=cephfs.smithi049.ibssbl=up:rejoin} 3 up:standby 2024-09-19T09:10:03.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:03 smithi102 ceph-mon[80875]: daemon mds.cephfs.smithi049.ibssbl is now active in filesystem cephfs as rank 0 2024-09-19T09:10:04.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:04 smithi102 ceph-mon[80875]: pgmap v205: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-19T09:10:04.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:04 smithi102 ceph-mon[80875]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:10:04.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:04 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:active 2024-09-19T09:10:04.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:04 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:04.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:04 smithi049 ceph-mon[91793]: pgmap v205: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-19T09:10:04.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:04 smithi049 ceph-mon[91793]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:10:04.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:04 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] up:active 2024-09-19T09:10:04.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:04 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:06.397 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:06 smithi049 ceph-mon[91793]: pgmap v206: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:10:06.397 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:06 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:06.397 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:06 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:06.397 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:06 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:06.398 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:06 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:06.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:06 smithi102 ceph-mon[80875]: pgmap v206: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:10:06.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:06 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:06.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:06 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:06.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:06 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:06.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:06 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:08.337 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:08 smithi049 ceph-mon[91793]: pgmap v207: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:10:08.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:08 smithi102 ceph-mon[80875]: pgmap v207: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: pgmap v208: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi102.snrasw"]}]: dispatch 2024-09-19T09:10:10.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:10 smithi102 ceph-mon[80875]: Upgrade: It appears safe to stop mds.cephfs.smithi102.snrasw 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: pgmap v208: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:10.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi102.snrasw"]}]: dispatch 2024-09-19T09:10:10.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:10 smithi049 ceph-mon[91793]: Upgrade: It appears safe to stop mds.cephfs.smithi102.snrasw 2024-09-19T09:10:12.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:11 smithi049 ceph-mon[91793]: pgmap v209: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-19T09:10:12.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:11 smithi049 ceph-mon[91793]: Upgrade: Updating mds.cephfs.smithi102.snrasw 2024-09-19T09:10:12.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:11 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:12.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:11 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:10:12.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:11 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:12.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:11 smithi049 ceph-mon[91793]: Deploying daemon mds.cephfs.smithi102.snrasw on smithi102 2024-09-19T09:10:12.091 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:11 smithi102 ceph-mon[80875]: pgmap v209: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-19T09:10:12.092 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:11 smithi102 ceph-mon[80875]: Upgrade: Updating mds.cephfs.smithi102.snrasw 2024-09-19T09:10:12.092 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:11 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:12.092 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:11 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.snrasw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:10:12.092 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:11 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:12.092 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:11 smithi102 ceph-mon[80875]: Deploying daemon mds.cephfs.smithi102.snrasw on smithi102 2024-09-19T09:10:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:13 smithi102 ceph-mon[80875]: pgmap v210: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-19T09:10:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:13 smithi049 ceph-mon[91793]: pgmap v210: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-19T09:10:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:14 smithi049 ceph-mon[91793]: osdmap e92: 6 total, 6 up, 6 in 2024-09-19T09:10:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:14 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 2 up:standby 2024-09-19T09:10:15.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:14 smithi102 ceph-mon[80875]: osdmap e92: 6 total, 6 up, 6 in 2024-09-19T09:10:15.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:14 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 2 up:standby 2024-09-19T09:10:15.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:15 smithi102 ceph-mon[80875]: pgmap v212: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-19T09:10:15.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:15 smithi049 ceph-mon[91793]: pgmap v212: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-19T09:10:17.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:17 smithi102 ceph-mon[80875]: pgmap v213: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-19T09:10:17.744 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:10:17.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:17 smithi049 ceph-mon[91793]: pgmap v213: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-19T09:10:17.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:10:19.417 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:19.417 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:19.417 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:19.417 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:19 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.102:6824/4160337930,v1:172.21.15.102:6825/4160337930] up:boot 2024-09-19T09:10:19.417 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:19 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:19.417 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:19 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:10:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:19 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.102:6824/4160337930,v1:172.21.15.102:6825/4160337930] up:boot 2024-09-19T09:10:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:19 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:19.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:19 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:10:20.393 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:20 smithi102 ceph-mon[80875]: pgmap v214: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:10:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:20 smithi049 ceph-mon[91793]: pgmap v214: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:10:22.122 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:21 smithi102 ceph-mon[80875]: pgmap v215: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:22.122 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:22.122 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:22.122 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:22.122 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:21 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:21 smithi049 ceph-mon[91793]: pgmap v215: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:21 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:24.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:23 smithi102 ceph-mon[80875]: pgmap v216: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:24.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:23 smithi049 ceph-mon[91793]: pgmap v216: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:25.895 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: pgmap v217: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi102.ojquyx"]}]: dispatch 2024-09-19T09:10:25.896 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:25 smithi102 ceph-mon[80875]: Upgrade: It appears safe to stop mds.cephfs.smithi102.ojquyx 2024-09-19T09:10:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: pgmap v217: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:26.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:26.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:26.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:26.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:26.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:26.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:26.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi102.ojquyx"]}]: dispatch 2024-09-19T09:10:26.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:25 smithi049 ceph-mon[91793]: Upgrade: It appears safe to stop mds.cephfs.smithi102.ojquyx 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 -- 172.21.15.49:0/1133899939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb0100ef0 msgr2=0x7fafb0101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 --2- 172.21.15.49:0/1133899939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb0100ef0 0x7fafb0101370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009880 tx=0x7fafa402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 -- 172.21.15.49:0/1133899939 shutdown_connections 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 --2- 172.21.15.49:0/1133899939 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb0100ef0 0x7fafb0101370 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 --2- 172.21.15.49:0/1133899939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafb00fde70 0x7fafb00fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 -- 172.21.15.49:0/1133899939 >> 172.21.15.49:0/1133899939 conn(0x7fafb00f99c0 msgr2=0x7fafb00fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 -- 172.21.15.49:0/1133899939 shutdown_connections 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 -- 172.21.15.49:0/1133899939 wait complete. 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.301+0000 7fafb58e7640 1 Processor -- start 2024-09-19T09:10:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafb58e7640 1 -- start start 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafb58e7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb00fde70 0x7fafb0100850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafb58e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafb0100ef0 0x7fafb00feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafb58e7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00ff3e0 con 0x7fafb00fde70 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafb58e7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00ff550 con 0x7fafb0100ef0 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafaeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb00fde70 0x7fafb0100850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafaeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb00fde70 0x7fafb0100850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51054/0 (socket says 172.21.15.49:51054) 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafaeffd640 1 -- 172.21.15.49:0/305839449 learned_addr learned my addr 172.21.15.49:0/305839449 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.302+0000 7fafae7fc640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafb0100ef0 0x7fafb00feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafaeffd640 1 -- 172.21.15.49:0/305839449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafb0100ef0 msgr2=0x7fafb00feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafaeffd640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafb0100ef0 0x7fafb00feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafaeffd640 1 -- 172.21.15.49:0/305839449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009560 con 0x7fafb00fde70 2024-09-19T09:10:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafaeffd640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb00fde70 0x7fafb0100850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fafa000e940 tx=0x7fafa000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:26.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafb48e5640 1 -- 172.21.15.49:0/305839449 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa00096e0 con 0x7fafb00fde70 2024-09-19T09:10:26.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00ff830 con 0x7fafb00fde70 2024-09-19T09:10:26.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafb48e5640 1 -- 172.21.15.49:0/305839449 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafa00044f0 con 0x7fafb00fde70 2024-09-19T09:10:26.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafb48e5640 1 -- 172.21.15.49:0/305839449 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa0010430 con 0x7fafb00fde70 2024-09-19T09:10:26.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.303+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb019d660 con 0x7fafb00fde70 2024-09-19T09:10:26.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.304+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb00fe270 con 0x7fafb00fde70 2024-09-19T09:10:26.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.306+0000 7fafb48e5640 1 -- 172.21.15.49:0/305839449 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fafa000cc90 con 0x7fafb00fde70 2024-09-19T09:10:26.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.306+0000 7fafb48e5640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf9806e5f0 0x7faf98070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.306+0000 7fafb48e5640 1 -- 172.21.15.49:0/305839449 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fafa0014070 con 0x7fafb00fde70 2024-09-19T09:10:26.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.306+0000 7fafae7fc640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf9806e5f0 0x7faf98070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.307+0000 7fafae7fc640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf9806e5f0 0x7faf98070ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa40314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:26.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.311+0000 7fafb48e5640 1 -- 172.21.15.49:0/305839449 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fafa0057c70 con 0x7fafb00fde70 2024-09-19T09:10:26.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.509+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafb0105840 con 0x7faf9806e5f0 2024-09-19T09:10:26.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.511+0000 7fafb48e5640 1 -- 172.21.15.49:0/305839449 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fafb0105840 con 0x7faf9806e5f0 2024-09-19T09:10:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf9806e5f0 msgr2=0x7faf98070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf9806e5f0 0x7faf98070ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa40314e0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb00fde70 msgr2=0x7fafb0100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb00fde70 0x7fafb0100850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fafa000e940 tx=0x7fafa000ee00 comp rx=0 tx=0).stop 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 shutdown_connections 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf9806e5f0 0x7faf98070ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafb0100ef0 0x7fafb00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 --2- 172.21.15.49:0/305839449 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafb00fde70 0x7fafb0100850 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 >> 172.21.15.49:0/305839449 conn(0x7fafb00f99c0 msgr2=0x7fafb0104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 shutdown_connections 2024-09-19T09:10:26.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.513+0000 7fafb58e7640 1 -- 172.21.15.49:0/305839449 wait complete. 2024-09-19T09:10:26.522 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:10:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 -- 172.21.15.49:0/1109156359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 msgr2=0x7f9e340fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 --2- 172.21.15.49:0/1109156359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e340fff90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009880 tx=0x7f9e2402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 -- 172.21.15.49:0/1109156359 shutdown_connections 2024-09-19T09:10:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 --2- 172.21.15.49:0/1109156359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34100d90 0x7f9e34101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 --2- 172.21.15.49:0/1109156359 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e340fff90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 -- 172.21.15.49:0/1109156359 >> 172.21.15.49:0/1109156359 conn(0x7f9e340fb320 msgr2=0x7f9e340fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 -- 172.21.15.49:0/1109156359 shutdown_connections 2024-09-19T09:10:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.599+0000 7f9e3a588640 1 -- 172.21.15.49:0/1109156359 wait complete. 2024-09-19T09:10:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e3a588640 1 Processor -- start 2024-09-19T09:10:26.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e3a588640 1 -- start start 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e3a588640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e34074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e3a588640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34100d90 0x7f9e340728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e3a588640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34072de0 con 0x7f9e340ffb90 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e3a588640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34072f50 con 0x7f9e34100d90 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e34074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e34074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51080/0 (socket says 172.21.15.49:51080) 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e33fff640 1 -- 172.21.15.49:0/395127877 learned_addr learned my addr 172.21.15.49:0/395127877 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:26.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.600+0000 7f9e337fe640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34100d90 0x7f9e340728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e33fff640 1 -- 172.21.15.49:0/395127877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34100d90 msgr2=0x7f9e340728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e33fff640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34100d90 0x7f9e340728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e33fff640 1 -- 172.21.15.49:0/395127877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24009560 con 0x7f9e340ffb90 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e33fff640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e34074200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e2402a9c0 tx=0x7f9e240054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e317fa640 1 -- 172.21.15.49:0/395127877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e24004aa0 con 0x7f9e340ffb90 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e317fa640 1 -- 172.21.15.49:0/395127877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e24004c00 con 0x7f9e340ffb90 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e340731d0 con 0x7f9e340ffb90 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e317fa640 1 -- 172.21.15.49:0/395127877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e24003a80 con 0x7f9e340ffb90 2024-09-19T09:10:26.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.601+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3419d6f0 con 0x7f9e340ffb90 2024-09-19T09:10:26.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.602+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e340fff90 con 0x7f9e340ffb90 2024-09-19T09:10:26.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.603+0000 7f9e317fa640 1 -- 172.21.15.49:0/395127877 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9e24003cf0 con 0x7f9e340ffb90 2024-09-19T09:10:26.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.603+0000 7f9e317fa640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e1c06e600 0x7f9e1c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.604+0000 7f9e317fa640 1 -- 172.21.15.49:0/395127877 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f9e240af880 con 0x7f9e340ffb90 2024-09-19T09:10:26.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.604+0000 7f9e337fe640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e1c06e600 0x7f9e1c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.604+0000 7f9e337fe640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e1c06e600 0x7f9e1c070ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e34073f80 tx=0x7f9e2800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:26.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.608+0000 7f9e317fa640 1 -- 172.21.15.49:0/395127877 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9e240789f0 con 0x7f9e340ffb90 2024-09-19T09:10:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.800+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e340608f0 con 0x7f9e1c06e600 2024-09-19T09:10:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.802+0000 7f9e317fa640 1 -- 172.21.15.49:0/395127877 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9e340608f0 con 0x7f9e1c06e600 2024-09-19T09:10:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e1c06e600 msgr2=0x7f9e1c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e1c06e600 0x7f9e1c070ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e34073f80 tx=0x7f9e2800b390 comp rx=0 tx=0).stop 2024-09-19T09:10:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 msgr2=0x7f9e34074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e34074200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e2402a9c0 tx=0x7f9e240054f0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 shutdown_connections 2024-09-19T09:10:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e1c06e600 0x7f9e1c070ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e34100d90 0x7f9e340728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 --2- 172.21.15.49:0/395127877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e340ffb90 0x7f9e34074200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 >> 172.21.15.49:0/395127877 conn(0x7f9e340fb320 msgr2=0x7f9e341044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:26.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 shutdown_connections 2024-09-19T09:10:26.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.804+0000 7f9e3a588640 1 -- 172.21.15.49:0/395127877 wait complete. 2024-09-19T09:10:26.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 -- 172.21.15.49:0/3726297306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 msgr2=0x7f8a24100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3726297306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 0x7f8a24100120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009880 tx=0x7f8a0c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 -- 172.21.15.49:0/3726297306 shutdown_connections 2024-09-19T09:10:26.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3726297306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 0x7f8a24100120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3726297306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a240feaa0 0x7f8a240feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 -- 172.21.15.49:0/3726297306 >> 172.21.15.49:0/3726297306 conn(0x7f8a240fa250 msgr2=0x7f8a240fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:26.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 -- 172.21.15.49:0/3726297306 shutdown_connections 2024-09-19T09:10:26.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.888+0000 7f8a293cd640 1 -- 172.21.15.49:0/3726297306 wait complete. 2024-09-19T09:10:26.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a293cd640 1 Processor -- start 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a293cd640 1 -- start start 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a293cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a240feaa0 0x7f8a24195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a293cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 0x7f8a24195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a293cd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24196160 con 0x7f8a240ffca0 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a293cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241962d0 con 0x7f8a240feaa0 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 0x7f8a24195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a22ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a240feaa0 0x7f8a24195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 0x7f8a24195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51102/0 (socket says 172.21.15.49:51102) 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.889+0000 7f8a227fc640 1 -- 172.21.15.49:0/3065211762 learned_addr learned my addr 172.21.15.49:0/3065211762 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a22ffd640 1 -- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 msgr2=0x7f8a24195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a22ffd640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 0x7f8a24195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a22ffd640 1 -- 172.21.15.49:0/3065211762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c009560 con 0x7f8a240feaa0 2024-09-19T09:10:26.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a22ffd640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a240feaa0 0x7f8a24195650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8a240ffb00 tx=0x7f8a1400db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:26.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a1bfff640 1 -- 172.21.15.49:0/3065211762 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a14009990 con 0x7f8a240feaa0 2024-09-19T09:10:26.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2419ad70 con 0x7f8a240feaa0 2024-09-19T09:10:26.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a1bfff640 1 -- 172.21.15.49:0/3065211762 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a14010460 con 0x7f8a240feaa0 2024-09-19T09:10:26.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a1bfff640 1 -- 172.21.15.49:0/3065211762 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a1400f5f0 con 0x7f8a240feaa0 2024-09-19T09:10:26.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.890+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2419b2e0 con 0x7f8a240feaa0 2024-09-19T09:10:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.891+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a241076b0 con 0x7f8a240feaa0 2024-09-19T09:10:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.892+0000 7f8a1bfff640 1 -- 172.21.15.49:0/3065211762 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8a14009af0 con 0x7f8a240feaa0 2024-09-19T09:10:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.893+0000 7f8a1bfff640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8a1006e5f0 0x7f8a10070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:26.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.893+0000 7f8a1bfff640 1 -- 172.21.15.49:0/3065211762 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f8a1408e510 con 0x7f8a240feaa0 2024-09-19T09:10:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.893+0000 7f8a227fc640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8a1006e5f0 0x7f8a10070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:26.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.893+0000 7f8a227fc640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8a1006e5f0 0x7f8a10070ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a24196b70 tx=0x7f8a0c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:26.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:26.897+0000 7f8a1bfff640 1 -- 172.21.15.49:0/3065211762 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8a14057560 con 0x7f8a240feaa0 2024-09-19T09:10:27.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.083+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a24068c30 con 0x7f8a1006e5f0 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.092+0000 7f8a1bfff640 1 -- 172.21.15.49:0/3065211762 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f8a24068c30 con 0x7f8a1006e5f0 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (14m) 22s ago 15m 25.4M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (16m) 22s ago 16m 9433k - 18.2.4-855-g19e2a2be 980a0bfcd684 255195427f90 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (15m) 6s ago 15m 9034k - 18.2.4-855-g19e2a2be 980a0bfcd684 92fb0bc5f638 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (4m) 22s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (4m) 6s ago 15m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (14m) 22s ago 15m 82.9M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:10:27.093 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (47s) 22s ago 10m 258M - 19.1.1-361-g2f599a46 d2baa855c067 3860d60c0271 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (27s) 22s ago 10m 15.2M - 19.1.1-361-g2f599a46 d2baa855c067 633df85b1957 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (10m) 6s ago 10m 12.5M - 18.2.4-855-g19e2a2be 980a0bfcd684 750178b2e5a1 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (9s) 6s ago 10m 11.5M - 19.1.1-361-g2f599a46 d2baa855c067 5257da592c71 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (7m) 22s ago 17m 506M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (6m) 6s ago 15m 442M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (5m) 22s ago 17m 52.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (5m) 6s ago 14m 38.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (16m) 22s ago 16m 15.1M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (15m) 6s ago 15m 16.6M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (4m) 22s ago 14m 107M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (3m) 22s ago 13m 105M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:10:27.094 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (3m) 22s ago 13m 106M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:10:27.095 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (2m) 6s ago 12m 120M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:10:27.095 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (2m) 6s ago 12m 86.3M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:10:27.095 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (97s) 6s ago 12m 84.5M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:10:27.095 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (6m) 22s ago 15m 61.4M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:10:27.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8a1006e5f0 msgr2=0x7f8a10070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8a1006e5f0 0x7f8a10070ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a24196b70 tx=0x7f8a0c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a240feaa0 msgr2=0x7f8a24195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a240feaa0 0x7f8a24195650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8a240ffb00 tx=0x7f8a1400db30 comp rx=0 tx=0).stop 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 shutdown_connections 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8a1006e5f0 0x7f8a10070ab0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a240ffca0 0x7f8a24195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 --2- 172.21.15.49:0/3065211762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a240feaa0 0x7f8a24195650 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 >> 172.21.15.49:0/3065211762 conn(0x7f8a240fa250 msgr2=0x7f8a24068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 shutdown_connections 2024-09-19T09:10:27.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.095+0000 7f8a293cd640 1 -- 172.21.15.49:0/3065211762 wait complete. 2024-09-19T09:10:27.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 -- 172.21.15.49:0/2789846787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 msgr2=0x7fb9f40feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/2789846787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f40feea0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009880 tx=0x7fb9f002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 -- 172.21.15.49:0/2789846787 shutdown_connections 2024-09-19T09:10:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/2789846787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9f40ffca0 0x7fb9f4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/2789846787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f40feea0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 -- 172.21.15.49:0/2789846787 >> 172.21.15.49:0/2789846787 conn(0x7fb9f40fa250 msgr2=0x7fb9f40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 -- 172.21.15.49:0/2789846787 shutdown_connections 2024-09-19T09:10:27.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.177+0000 7fb9fbf67640 1 -- 172.21.15.49:0/2789846787 wait complete. 2024-09-19T09:10:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9fbf67640 1 Processor -- start 2024-09-19T09:10:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9fbf67640 1 -- start start 2024-09-19T09:10:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9fbf67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f4102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9fbf67640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9f40ffca0 0x7fb9f4101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9fbf67640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41015c0 con 0x7fb9f40feaa0 2024-09-19T09:10:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9fbf67640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4101730 con 0x7fb9f40ffca0 2024-09-19T09:10:27.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9f9d03640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f4102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9f9d03640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f4102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51116/0 (socket says 172.21.15.49:51116) 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9f9d03640 1 -- 172.21.15.49:0/1739161144 learned_addr learned my addr 172.21.15.49:0/1739161144 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9f9502640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9f40ffca0 0x7fb9f4101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9f9d03640 1 -- 172.21.15.49:0/1739161144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9f40ffca0 msgr2=0x7fb9f4101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.178+0000 7fb9f9d03640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9f40ffca0 0x7fb9f4101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.179+0000 7fb9f9d03640 1 -- 172.21.15.49:0/1739161144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f0009560 con 0x7fb9f40feaa0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.179+0000 7fb9f9d03640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f4102a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9f002a9c0 tx=0x7fb9f0005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.179+0000 7fb9eaffd640 1 -- 172.21.15.49:0/1739161144 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f0004b20 con 0x7fb9f40feaa0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.179+0000 7fb9eaffd640 1 -- 172.21.15.49:0/1739161144 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9f0004c80 con 0x7fb9f40feaa0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.179+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f41019b0 con 0x7fb9f40feaa0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.179+0000 7fb9eaffd640 1 -- 172.21.15.49:0/1739161144 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f0003b80 con 0x7fb9f40feaa0 2024-09-19T09:10:27.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.179+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f419d690 con 0x7fb9f40feaa0 2024-09-19T09:10:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.180+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f41076b0 con 0x7fb9f40feaa0 2024-09-19T09:10:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.181+0000 7fb9eaffd640 1 -- 172.21.15.49:0/1739161144 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb9f0031640 con 0x7fb9f40feaa0 2024-09-19T09:10:27.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.182+0000 7fb9eaffd640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb9e006e5f0 0x7fb9e0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.182+0000 7fb9eaffd640 1 -- 172.21.15.49:0/1739161144 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fb9f00afd90 con 0x7fb9f40feaa0 2024-09-19T09:10:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.182+0000 7fb9f9502640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb9e006e5f0 0x7fb9e0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.182+0000 7fb9f9502640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb9e006e5f0 0x7fb9e0070ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb9f41027b0 tx=0x7fb9e400a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:27.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.185+0000 7fb9eaffd640 1 -- 172.21.15.49:0/1739161144 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb9f0078f00 con 0x7fb9f40feaa0 2024-09-19T09:10:27.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.439+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9f419d9a0 con 0x7fb9f40feaa0 2024-09-19T09:10:27.440 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:27 smithi049 ceph-mon[91793]: Upgrade: Updating mds.cephfs.smithi102.ojquyx 2024-09-19T09:10:27.440 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:27.440 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:10:27.440 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:27.440 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:27 smithi049 ceph-mon[91793]: Deploying daemon mds.cephfs.smithi102.ojquyx on smithi102 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.440+0000 7fb9eaffd640 1 -- 172.21.15.49:0/1739161144 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7fb9f0040360 con 0x7fb9f40feaa0 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:10:27.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 3 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1, 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 13 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:10:27.442 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:10:27.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb9e006e5f0 msgr2=0x7fb9e0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb9e006e5f0 0x7fb9e0070ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb9f41027b0 tx=0x7fb9e400a250 comp rx=0 tx=0).stop 2024-09-19T09:10:27.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 msgr2=0x7fb9f4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f4102a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9f002a9c0 tx=0x7fb9f0005610 comp rx=0 tx=0).stop 2024-09-19T09:10:27.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 shutdown_connections 2024-09-19T09:10:27.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb9e006e5f0 0x7fb9e0070ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9f40ffca0 0x7fb9f4101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 --2- 172.21.15.49:0/1739161144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9f40feaa0 0x7fb9f4102a30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 >> 172.21.15.49:0/1739161144 conn(0x7fb9f40fa250 msgr2=0x7fb9f40684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:27.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 shutdown_connections 2024-09-19T09:10:27.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.443+0000 7fb9fbf67640 1 -- 172.21.15.49:0/1739161144 wait complete. 2024-09-19T09:10:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 -- 172.21.15.49:0/2399574505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 msgr2=0x7f48cc102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 --2- 172.21.15.49:0/2399574505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc102a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0098b0 tx=0x7f48bc02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 -- 172.21.15.49:0/2399574505 shutdown_connections 2024-09-19T09:10:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 --2- 172.21.15.49:0/2399574505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48cc102f60 0x7f48cc105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 --2- 172.21.15.49:0/2399574505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc102a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 -- 172.21.15.49:0/2399574505 >> 172.21.15.49:0/2399574505 conn(0x7f48cc0fa250 msgr2=0x7f48cc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 -- 172.21.15.49:0/2399574505 shutdown_connections 2024-09-19T09:10:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.527+0000 7f48d22b3640 1 -- 172.21.15.49:0/2399574505 wait complete. 2024-09-19T09:10:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48d22b3640 1 Processor -- start 2024-09-19T09:10:27.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48d22b3640 1 -- start start 2024-09-19T09:10:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48d22b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc0fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48d22b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48cc102f60 0x7f48cc0fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48d22b3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0feb20 con 0x7f48cc100630 2024-09-19T09:10:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48d22b3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0fec90 con 0x7f48cc102f60 2024-09-19T09:10:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc0fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.528+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc0fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51124/0 (socket says 172.21.15.49:51124) 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48cbfff640 1 -- 172.21.15.49:0/961815927 learned_addr learned my addr 172.21.15.49:0/961815927 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48cb7fe640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48cc102f60 0x7f48cc0fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48cbfff640 1 -- 172.21.15.49:0/961815927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48cc102f60 msgr2=0x7f48cc0fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48cbfff640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48cc102f60 0x7f48cc0fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48cbfff640 1 -- 172.21.15.49:0/961815927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc009560 con 0x7f48cc100630 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48cb7fe640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48cc102f60 0x7f48cc0fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48cbfff640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc0fff90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48bc02a9f0 tx=0x7f48bc0054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48c97fa640 1 -- 172.21.15.49:0/961815927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48bc004aa0 con 0x7f48cc100630 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48c97fa640 1 -- 172.21.15.49:0/961815927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48bc004c00 con 0x7f48cc100630 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc0fef10 con 0x7f48cc100630 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48c97fa640 1 -- 172.21.15.49:0/961815927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48bc003a80 con 0x7f48cc100630 2024-09-19T09:10:27.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.529+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc19d6a0 con 0x7f48cc100630 2024-09-19T09:10:27.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.531+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc100a10 con 0x7f48cc100630 2024-09-19T09:10:27.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.531+0000 7f48c97fa640 1 -- 172.21.15.49:0/961815927 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f48bc003d40 con 0x7f48cc100630 2024-09-19T09:10:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.532+0000 7f48c97fa640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f48b406e600 0x7f48b4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.532+0000 7f48c97fa640 1 -- 172.21.15.49:0/961815927 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f48bc0afa20 con 0x7f48cc100630 2024-09-19T09:10:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.532+0000 7f48cb7fe640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f48b406e600 0x7f48b4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.532+0000 7f48cb7fe640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f48b406e600 0x7f48b4070ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48c00058c0 tx=0x7f48c0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:27.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.536+0000 7f48c97fa640 1 -- 172.21.15.49:0/961815927 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f48bc078a60 con 0x7f48cc100630 2024-09-19T09:10:27.689 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:27 smithi102 ceph-mon[80875]: Upgrade: Updating mds.cephfs.smithi102.ojquyx 2024-09-19T09:10:27.689 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:27.689 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi102.ojquyx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:10:27.690 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:27.690 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:27 smithi102 ceph-mon[80875]: Deploying daemon mds.cephfs.smithi102.ojquyx on smithi102 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.750+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f48cc19d900 con 0x7f48cc100630 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.751+0000 7f48c97fa640 1 -- 172.21.15.49:0/961815927 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1976 (secure 0 0 0) 0x7f48bc07c120 con 0x7f48cc100630 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi049.stdout:e36 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-19T09:10:18:541757+0000 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 34 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:10:03.202146+0000 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 91 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi049.stdout:in 0 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=34416} 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 1 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 34416 members: 34416 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{-1:34448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.102:6826/2534703038,v1:172.21.15.102:6827/2534703038] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{-1:44371} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.102:6824/4160337930,v1:172.21.15.102:6825/4160337930] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 36 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f48b406e600 msgr2=0x7f48b4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f48b406e600 0x7f48b4070ac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48c00058c0 tx=0x7f48c0005850 comp rx=0 tx=0).stop 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 msgr2=0x7f48cc0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc0fff90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48bc02a9f0 tx=0x7f48bc0054f0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 shutdown_connections 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f48b406e600 0x7f48b4070ac0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48cc102f60 0x7f48cc0fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 --2- 172.21.15.49:0/961815927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48cc100630 0x7f48cc0fff90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 >> 172.21.15.49:0/961815927 conn(0x7f48cc0fa250 msgr2=0x7f48cc0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 shutdown_connections 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.753+0000 7f48d22b3640 1 -- 172.21.15.49:0/961815927 wait complete. 2024-09-19T09:10:27.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 -- 172.21.15.49:0/4051011758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 msgr2=0x7f8db0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 --2- 172.21.15.49:0/4051011758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0101210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009880 tx=0x7f8da402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 -- 172.21.15.49:0/4051011758 shutdown_connections 2024-09-19T09:10:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 --2- 172.21.15.49:0/4051011758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0101210 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 --2- 172.21.15.49:0/4051011758 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db00ffb90 0x7f8db00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 -- 172.21.15.49:0/4051011758 >> 172.21.15.49:0/4051011758 conn(0x7f8db00fb320 msgr2=0x7f8db00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 -- 172.21.15.49:0/4051011758 shutdown_connections 2024-09-19T09:10:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 -- 172.21.15.49:0/4051011758 wait complete. 2024-09-19T09:10:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.838+0000 7f8db6623640 1 Processor -- start 2024-09-19T09:10:27.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8db6623640 1 -- start start 2024-09-19T09:10:27.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8db6623640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db00ffb90 0x7f8db01955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8db6623640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8db6623640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db01960f0 con 0x7f8db0100d90 2024-09-19T09:10:27.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8db6623640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0196260 con 0x7f8db00ffb90 2024-09-19T09:10:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51148/0 (socket says 172.21.15.49:51148) 2024-09-19T09:10:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8daf7fe640 1 -- 172.21.15.49:0/757292955 learned_addr learned my addr 172.21.15.49:0/757292955 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8daffff640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db00ffb90 0x7f8db01955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8daf7fe640 1 -- 172.21.15.49:0/757292955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db00ffb90 msgr2=0x7f8db01955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8daf7fe640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db00ffb90 0x7f8db01955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.839+0000 7f8daf7fe640 1 -- 172.21.15.49:0/757292955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da4009560 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.840+0000 7f8daf7fe640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0195b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8da40055a0 tx=0x7f8da40055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.840+0000 7f8dad7fa640 1 -- 172.21.15.49:0/757292955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da4004b20 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.840+0000 7f8dad7fa640 1 -- 172.21.15.49:0/757292955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8da4004c80 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.840+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db019aca0 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.840+0000 7f8dad7fa640 1 -- 172.21.15.49:0/757292955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da4003bc0 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.840+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db019b210 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.841+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db0108780 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.841+0000 7f8dad7fa640 1 -- 172.21.15.49:0/757292955 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8da4003d20 con 0x7f8db0100d90 2024-09-19T09:10:27.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.842+0000 7f8dad7fa640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8d9806e600 0x7f8d98070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:27.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.842+0000 7f8dad7fa640 1 -- 172.21.15.49:0/757292955 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f8da40af8c0 con 0x7f8db0100d90 2024-09-19T09:10:27.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.842+0000 7f8daffff640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8d9806e600 0x7f8d98070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:27.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.842+0000 7f8daffff640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8d9806e600 0x7f8d98070ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8db0100bf0 tx=0x7f8da000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:27.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:27.846+0000 7f8dad7fa640 1 -- 172.21.15.49:0/757292955 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8da4078a30 con 0x7f8db0100d90 2024-09-19T09:10:28.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.040+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8db019b450 con 0x7f8d9806e600 2024-09-19T09:10:28.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.041+0000 7f8dad7fa640 1 -- 172.21.15.49:0/757292955 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8db019b450 con 0x7f8d9806e600 2024-09-19T09:10:28.041 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:10:28.041 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:10:28.041 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:10:28.041 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "15/23 daemons upgraded", 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:10:28.042 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:10:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8d9806e600 msgr2=0x7f8d98070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8d9806e600 0x7f8d98070ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8db0100bf0 tx=0x7f8da000b390 comp rx=0 tx=0).stop 2024-09-19T09:10:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 msgr2=0x7f8db0195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0195b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8da40055a0 tx=0x7f8da40055d0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 shutdown_connections 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f8d9806e600 0x7f8d98070ac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8db0100d90 0x7f8db0195b20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 --2- 172.21.15.49:0/757292955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db00ffb90 0x7f8db01955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 >> 172.21.15.49:0/757292955 conn(0x7f8db00fb320 msgr2=0x7f8db00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 shutdown_connections 2024-09-19T09:10:28.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.043+0000 7f8db6623640 1 -- 172.21.15.49:0/757292955 wait complete. 2024-09-19T09:10:28.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 -- 172.21.15.49:0/1612118485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380feaa0 msgr2=0x7f93380feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 --2- 172.21.15.49:0/1612118485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380feaa0 0x7f93380feea0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9328009880 tx=0x7f932802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 -- 172.21.15.49:0/1612118485 shutdown_connections 2024-09-19T09:10:28.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 --2- 172.21.15.49:0/1612118485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93380ffca0 0x7f9338100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 --2- 172.21.15.49:0/1612118485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380feaa0 0x7f93380feea0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 -- 172.21.15.49:0/1612118485 >> 172.21.15.49:0/1612118485 conn(0x7f93380fa250 msgr2=0x7f93380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:28.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 -- 172.21.15.49:0/1612118485 shutdown_connections 2024-09-19T09:10:28.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.128+0000 7f933d751640 1 -- 172.21.15.49:0/1612118485 wait complete. 2024-09-19T09:10:28.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f933d751640 1 Processor -- start 2024-09-19T09:10:28.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f933d751640 1 -- start start 2024-09-19T09:10:28.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f933d751640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93380feaa0 0x7f9338194570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:28.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f933d751640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380ffca0 0x7f9338194ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:28.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f933d751640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9338195080 con 0x7f93380ffca0 2024-09-19T09:10:28.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f933d751640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93381951f0 con 0x7f93380feaa0 2024-09-19T09:10:28.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f93367fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380ffca0 0x7f9338194ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:28.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f93367fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380ffca0 0x7f9338194ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51180/0 (socket says 172.21.15.49:51180) 2024-09-19T09:10:28.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f93367fc640 1 -- 172.21.15.49:0/3691396885 learned_addr learned my addr 172.21.15.49:0/3691396885 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:28.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.129+0000 7f9336ffd640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93380feaa0 0x7f9338194570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:28.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f93367fc640 1 -- 172.21.15.49:0/3691396885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93380feaa0 msgr2=0x7f9338194570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f93367fc640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93380feaa0 0x7f9338194570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f93367fc640 1 -- 172.21.15.49:0/3691396885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328009560 con 0x7f93380ffca0 2024-09-19T09:10:28.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f93367fc640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380ffca0 0x7f9338194ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f932c00e9a0 tx=0x7f932c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:28.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f931ffff640 1 -- 172.21.15.49:0/3691396885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932c00cd50 con 0x7f93380ffca0 2024-09-19T09:10:28.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f931ffff640 1 -- 172.21.15.49:0/3691396885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f932c00ceb0 con 0x7f93380ffca0 2024-09-19T09:10:28.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9338199c90 con 0x7f93380ffca0 2024-09-19T09:10:28.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f931ffff640 1 -- 172.21.15.49:0/3691396885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932c010660 con 0x7f93380ffca0 2024-09-19T09:10:28.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.130+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933819a260 con 0x7f93380ffca0 2024-09-19T09:10:28.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.131+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933818e640 con 0x7f93380ffca0 2024-09-19T09:10:28.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.132+0000 7f931ffff640 1 -- 172.21.15.49:0/3691396885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f932c0107c0 con 0x7f93380ffca0 2024-09-19T09:10:28.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.132+0000 7f931ffff640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f932006e5f0 0x7f9320070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:28.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.132+0000 7f931ffff640 1 -- 172.21.15.49:0/3691396885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f932c014070 con 0x7f93380ffca0 2024-09-19T09:10:28.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.132+0000 7f9336ffd640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f932006e5f0 0x7f9320070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:28.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.133+0000 7f9336ffd640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f932006e5f0 0x7f9320070ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9328005940 tx=0x7f93280058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:28.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.137+0000 7f931ffff640 1 -- 172.21.15.49:0/3691396885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f932c057cf0 con 0x7f93380ffca0 2024-09-19T09:10:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:28 smithi049 ceph-mon[91793]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:28 smithi049 ceph-mon[91793]: pgmap v218: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:28 smithi049 ceph-mon[91793]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:28 smithi049 ceph-mon[91793]: from='client.44383 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:28 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1739161144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:28 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/961815927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:10:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.384+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f93381076b0 con 0x7f93380ffca0 2024-09-19T09:10:28.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.384+0000 7f931ffff640 1 -- 172.21.15.49:0/3691396885 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f932c05b3b0 con 0x7f93380ffca0 2024-09-19T09:10:28.385 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:10:28.385 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:10:28.385 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:10:28.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f932006e5f0 msgr2=0x7f9320070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f932006e5f0 0x7f9320070ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9328005940 tx=0x7f93280058d0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380ffca0 msgr2=0x7f9338194ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380ffca0 0x7f9338194ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f932c00e9a0 tx=0x7f932c00eda0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 shutdown_connections 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f932006e5f0 0x7f9320070ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93380ffca0 0x7f9338194ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 --2- 172.21.15.49:0/3691396885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93380feaa0 0x7f9338194570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.386+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 >> 172.21.15.49:0/3691396885 conn(0x7f93380fa250 msgr2=0x7f9338103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.387+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 shutdown_connections 2024-09-19T09:10:28.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:28.387+0000 7f933d751640 1 -- 172.21.15.49:0/3691396885 wait complete. 2024-09-19T09:10:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:28 smithi102 ceph-mon[80875]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:28 smithi102 ceph-mon[80875]: pgmap v218: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:28 smithi102 ceph-mon[80875]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:28 smithi102 ceph-mon[80875]: from='client.44383 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:28 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1739161144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:28 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/961815927' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:10:29.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:29 smithi102 ceph-mon[80875]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:29.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:29 smithi102 ceph-mon[80875]: osdmap e93: 6 total, 6 up, 6 in 2024-09-19T09:10:29.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:29 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 2 up:standby 2024-09-19T09:10:29.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:29 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3691396885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:10:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:29 smithi049 ceph-mon[91793]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:29 smithi049 ceph-mon[91793]: osdmap e93: 6 total, 6 up, 6 in 2024-09-19T09:10:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:29 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 2 up:standby 2024-09-19T09:10:29.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:29 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3691396885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:10:30.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:30 smithi049 ceph-mon[91793]: pgmap v220: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:30.556 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:30 smithi102 ceph-mon[80875]: pgmap v220: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:31.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:10:31.573 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:10:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:32 smithi049 ceph-mon[91793]: pgmap v221: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:32 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:32.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:32 smithi102 ceph-mon[80875]: pgmap v221: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:32 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:33.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:33 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.102:6826/801204290,v1:172.21.15.102:6827/801204290] up:boot 2024-09-19T09:10:33.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:33 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:33.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:33 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:10:33.572 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:33 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.102:6826/801204290,v1:172.21.15.102:6827/801204290] up:boot 2024-09-19T09:10:33.572 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:33 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:33.572 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:33 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:10:34.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:34 smithi102 ceph-mon[80875]: pgmap v222: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:34.805 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:34 smithi049 ceph-mon[91793]: pgmap v222: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:35.925 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:35 smithi102 ceph-mon[80875]: pgmap v223: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:35.925 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:35.925 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:35.925 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:35.925 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:36.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:35 smithi049 ceph-mon[91793]: pgmap v223: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:36.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:36.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:36.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:36.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:38.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:37 smithi102 ceph-mon[80875]: pgmap v224: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:38.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:37 smithi049 ceph-mon[91793]: pgmap v224: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:40.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: pgmap v225: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:40.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all mds 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.ibssbl"}]': finished 2024-09-19T09:10:40.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:10:40.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.uujbrc"}]': finished 2024-09-19T09:10:40.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:10:40.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.ojquyx"}]': finished 2024-09-19T09:10:40.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:10:40.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.snrasw"}]': finished 2024-09-19T09:10:40.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-19T09:10:40.011 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:39 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-19T09:10:40.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: pgmap v225: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:40.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:40.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all mds 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.ibssbl"}]: dispatch 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.ibssbl"}]': finished 2024-09-19T09:10:40.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.uujbrc"}]: dispatch 2024-09-19T09:10:40.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.uujbrc"}]': finished 2024-09-19T09:10:40.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.ojquyx"}]: dispatch 2024-09-19T09:10:40.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.ojquyx"}]': finished 2024-09-19T09:10:40.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.snrasw"}]: dispatch 2024-09-19T09:10:40.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi102.snrasw"}]': finished 2024-09-19T09:10:40.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-19T09:10:40.055 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:39 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: daemon mds.cephfs.smithi049.uujbrc assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi049.uujbrc=up:starting} 2 up:standby 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-19T09:10:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-19T09:10:41.010 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:40 smithi102 ceph-mon[80875]: daemon mds.cephfs.smithi049.uujbrc is now active in filesystem cephfs as rank 1 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: daemon mds.cephfs.smithi049.uujbrc assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: fsmap cephfs:1 {0=cephfs.smithi049.ibssbl=up:active} 3 up:standby 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi049.uujbrc=up:starting} 2 up:standby 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-19T09:10:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-19T09:10:41.054 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:40 smithi049 ceph-mon[91793]: daemon mds.cephfs.smithi049.uujbrc is now active in filesystem cephfs as rank 1 2024-09-19T09:10:42.247 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: pgmap v226: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:42.247 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-19T09:10:42.247 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: mds.? [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] up:active 2024-09-19T09:10:42.247 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi049.uujbrc=up:active} 2 up:standby 2024-09-19T09:10:42.247 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi049.uujbrc=up:active} 2 up:standby-replay 2024-09-19T09:10:42.247 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:42.247 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:42.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all rgw 2024-09-19T09:10:42.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:42.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:42.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T09:10:42.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:42.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:41 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: pgmap v226: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: mds.? [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] up:active 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi049.uujbrc=up:active} 2 up:standby 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: fsmap cephfs:2 {0=cephfs.smithi049.ibssbl=up:active,1=cephfs.smithi049.uujbrc=up:active} 2 up:standby-replay 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all rgw 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T09:10:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:42.260 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:41 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:10:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:43 smithi102 ceph-mon[80875]: Upgrade: Updating ceph-exporter.smithi049 (1/2) 2024-09-19T09:10:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:10:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:43 smithi102 ceph-mon[80875]: Deploying daemon ceph-exporter.smithi049 on smithi049 2024-09-19T09:10:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:43.765 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:43 smithi049 ceph-mon[91793]: Upgrade: Updating ceph-exporter.smithi049 (1/2) 2024-09-19T09:10:43.765 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:43.765 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi049", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:10:43.765 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:43.765 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:43 smithi049 ceph-mon[91793]: Deploying daemon ceph-exporter.smithi049 on smithi049 2024-09-19T09:10:43.765 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:44.638 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:44 smithi049 ceph-mon[91793]: pgmap v227: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T09:10:44.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:44 smithi102 ceph-mon[80875]: pgmap v227: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T09:10:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:46 smithi102 ceph-mon[80875]: pgmap v228: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:10:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:46 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:46 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:46 smithi049 ceph-mon[91793]: pgmap v228: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:10:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:46 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:48 smithi102 ceph-mon[80875]: pgmap v229: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:10:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:48 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:48 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:10:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:48 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:48.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:48 smithi049 ceph-mon[91793]: pgmap v229: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:10:48.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:48 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:48.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:48 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi102", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-19T09:10:48.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:48 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:49.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:49 smithi102 ceph-mon[80875]: Upgrade: Updating ceph-exporter.smithi102 (2/2) 2024-09-19T09:10:49.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:49 smithi102 ceph-mon[80875]: Deploying daemon ceph-exporter.smithi102 on smithi102 2024-09-19T09:10:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:49 smithi049 ceph-mon[91793]: Upgrade: Updating ceph-exporter.smithi102 (2/2) 2024-09-19T09:10:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:49 smithi049 ceph-mon[91793]: Deploying daemon ceph-exporter.smithi102 on smithi102 2024-09-19T09:10:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:50 smithi102 ceph-mon[80875]: pgmap v230: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-19T09:10:50.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:50 smithi049 ceph-mon[91793]: pgmap v230: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-19T09:10:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:52 smithi102 ceph-mon[80875]: pgmap v231: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-19T09:10:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:52 smithi049 ceph-mon[91793]: pgmap v231: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-19T09:10:54.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:54 smithi102 ceph-mon[80875]: pgmap v232: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-19T09:10:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:54 smithi049 ceph-mon[91793]: pgmap v232: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-19T09:10:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:56 smithi102 ceph-mon[80875]: pgmap v233: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 85 B/s wr, 12 op/s 2024-09-19T09:10:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:56 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:56 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:56 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:56 smithi049 ceph-mon[91793]: pgmap v233: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 85 B/s wr, 12 op/s 2024-09-19T09:10:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:56 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:56 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:56 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:58.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 -- 172.21.15.49:0/2288765013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 msgr2=0x7f3298100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 --2- 172.21.15.49:0/2288765013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298100120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3284009880 tx=0x7f328402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 -- 172.21.15.49:0/2288765013 shutdown_connections 2024-09-19T09:10:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 --2- 172.21.15.49:0/2288765013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298100120 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 --2- 172.21.15.49:0/2288765013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32980feaa0 0x7f32980feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 -- 172.21.15.49:0/2288765013 >> 172.21.15.49:0/2288765013 conn(0x7f32980fa250 msgr2=0x7f32980fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:58.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 -- 172.21.15.49:0/2288765013 shutdown_connections 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 -- 172.21.15.49:0/2288765013 wait complete. 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 Processor -- start 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.474+0000 7f329f0d4640 1 -- start start 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f329f0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32980feaa0 0x7f3298102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f329f0d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f329f0d4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32981015c0 con 0x7f32980ffca0 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f329f0d4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3298101730 con 0x7f32980feaa0 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f3297fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f3297fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49148/0 (socket says 172.21.15.49:49148) 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f3297fff640 1 -- 172.21.15.49:0/1642665800 learned_addr learned my addr 172.21.15.49:0/1642665800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:58.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f329ce70640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32980feaa0 0x7f3298102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f3297fff640 1 -- 172.21.15.49:0/1642665800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32980feaa0 msgr2=0x7f3298102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f3297fff640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32980feaa0 0x7f3298102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f3297fff640 1 -- 172.21.15.49:0/1642665800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284009560 con 0x7f32980ffca0 2024-09-19T09:10:58.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.475+0000 7f3297fff640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298101080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3284004650 tx=0x7f32840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.476+0000 7f3295ffb640 1 -- 172.21.15.49:0/1642665800 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3284004aa0 con 0x7f32980ffca0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.476+0000 7f3295ffb640 1 -- 172.21.15.49:0/1642665800 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3284005d50 con 0x7f32980ffca0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.476+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32981019b0 con 0x7f32980ffca0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.476+0000 7f3295ffb640 1 -- 172.21.15.49:0/1642665800 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32840039e0 con 0x7f32980ffca0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.476+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329819d660 con 0x7f32980ffca0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.477+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32980feea0 con 0x7f32980ffca0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.477+0000 7f3295ffb640 1 -- 172.21.15.49:0/1642665800 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3284031c00 con 0x7f32980ffca0 2024-09-19T09:10:58.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.478+0000 7f3295ffb640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f328806e5f0 0x7f3288070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.478+0000 7f329ce70640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f328806e5f0 0x7f3288070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.478+0000 7f3295ffb640 1 -- 172.21.15.49:0/1642665800 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f32840af850 con 0x7f32980ffca0 2024-09-19T09:10:58.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.479+0000 7f329ce70640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f328806e5f0 0x7f3288070ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32980ffb00 tx=0x7f328c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:58.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.483+0000 7f3295ffb640 1 -- 172.21.15.49:0/1642665800 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3284078940 con 0x7f32980ffca0 2024-09-19T09:10:58.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.706+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3298068c10 con 0x7f328806e5f0 2024-09-19T09:10:58.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.707+0000 7f3295ffb640 1 -- 172.21.15.49:0/1642665800 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f3298068c10 con 0x7f328806e5f0 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f328806e5f0 msgr2=0x7f3288070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f328806e5f0 0x7f3288070ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32980ffb00 tx=0x7f328c005f90 comp rx=0 tx=0).stop 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 msgr2=0x7f3298101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298101080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3284004650 tx=0x7f32840055a0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 shutdown_connections 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f328806e5f0 0x7f3288070ab0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f32980ffca0 0x7f3298101080 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 --2- 172.21.15.49:0/1642665800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32980feaa0 0x7f3298102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 >> 172.21.15.49:0/1642665800 conn(0x7f32980fa250 msgr2=0x7f3298068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:58.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 shutdown_connections 2024-09-19T09:10:58.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.709+0000 7f329f0d4640 1 -- 172.21.15.49:0/1642665800 wait complete. 2024-09-19T09:10:58.718 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:10:58.757 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:58 smithi102 ceph-mon[80875]: pgmap v234: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 4 op/s 2024-09-19T09:10:58.757 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:58.757 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.757 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.757 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.757 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:10:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 -- 172.21.15.49:0/4075042385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 msgr2=0x7f2950100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 --2- 172.21.15.49:0/4075042385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950100170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2940009880 tx=0x7f294002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 -- 172.21.15.49:0/4075042385 shutdown_connections 2024-09-19T09:10:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 --2- 172.21.15.49:0/4075042385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950100170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 --2- 172.21.15.49:0/4075042385 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29500feaf0 0x7f29500feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 -- 172.21.15.49:0/4075042385 >> 172.21.15.49:0/4075042385 conn(0x7f29500fa280 msgr2=0x7f29500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:58.796 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:58 smithi049 ceph-mon[91793]: pgmap v234: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 4 op/s 2024-09-19T09:10:58.796 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:10:58.796 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.796 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.796 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.796 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:10:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:10:58.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 -- 172.21.15.49:0/4075042385 shutdown_connections 2024-09-19T09:10:58.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.794+0000 7f29582a2640 1 -- 172.21.15.49:0/4075042385 wait complete. 2024-09-19T09:10:58.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f29582a2640 1 Processor -- start 2024-09-19T09:10:58.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f29582a2640 1 -- start start 2024-09-19T09:10:58.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f29582a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29500feaf0 0x7f29501956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:58.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f29582a2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:58.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f29582a2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29501961d0 con 0x7f29500ffcf0 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f29582a2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2950196340 con 0x7f29500feaf0 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f295583d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f295583d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49170/0 (socket says 172.21.15.49:49170) 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f295583d640 1 -- 172.21.15.49:0/4170975471 learned_addr learned my addr 172.21.15.49:0/4170975471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.795+0000 7f295603e640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29500feaf0 0x7f29501956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f295583d640 1 -- 172.21.15.49:0/4170975471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29500feaf0 msgr2=0x7f29501956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f295583d640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29500feaf0 0x7f29501956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f295583d640 1 -- 172.21.15.49:0/4170975471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940009560 con 0x7f29500ffcf0 2024-09-19T09:10:58.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f295583d640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950195c00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29400055a0 tx=0x7f29400055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f29477fe640 1 -- 172.21.15.49:0/4170975471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2940004b20 con 0x7f29500ffcf0 2024-09-19T09:10:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f29477fe640 1 -- 172.21.15.49:0/4170975471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2940004c80 con 0x7f29500ffcf0 2024-09-19T09:10:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295019ad80 con 0x7f29500ffcf0 2024-09-19T09:10:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f29477fe640 1 -- 172.21.15.49:0/4170975471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2940003bc0 con 0x7f29500ffcf0 2024-09-19T09:10:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.796+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295019b270 con 0x7f29500ffcf0 2024-09-19T09:10:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.797+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29501076e0 con 0x7f29500ffcf0 2024-09-19T09:10:58.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.798+0000 7f29477fe640 1 -- 172.21.15.49:0/4170975471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2940003d20 con 0x7f29500ffcf0 2024-09-19T09:10:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.798+0000 7f29477fe640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f293c06e600 0x7f293c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.798+0000 7f29477fe640 1 -- 172.21.15.49:0/4170975471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f29400af8c0 con 0x7f29500ffcf0 2024-09-19T09:10:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.798+0000 7f295603e640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f293c06e600 0x7f293c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:58.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.799+0000 7f295603e640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f293c06e600 0x7f293c070ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f294c005fd0 tx=0x7f294c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:58.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.803+0000 7f29477fe640 1 -- 172.21.15.49:0/4170975471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2940078a30 con 0x7f29500ffcf0 2024-09-19T09:10:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.997+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2950068410 con 0x7f293c06e600 2024-09-19T09:10:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:58.998+0000 7f29477fe640 1 -- 172.21.15.49:0/4170975471 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f2950068410 con 0x7f293c06e600 2024-09-19T09:10:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f293c06e600 msgr2=0x7f293c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f293c06e600 0x7f293c070ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f294c005fd0 tx=0x7f294c00b410 comp rx=0 tx=0).stop 2024-09-19T09:10:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 msgr2=0x7f2950195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950195c00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29400055a0 tx=0x7f29400055d0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 shutdown_connections 2024-09-19T09:10:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f293c06e600 0x7f293c070ac0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29500ffcf0 0x7f2950195c00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 --2- 172.21.15.49:0/4170975471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29500feaf0 0x7f29501956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.000+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 >> 172.21.15.49:0/4170975471 conn(0x7f29500fa280 msgr2=0x7f2950067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.001+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 shutdown_connections 2024-09-19T09:10:59.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.001+0000 7f29582a2640 1 -- 172.21.15.49:0/4170975471 wait complete. 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 -- 172.21.15.49:0/1974535382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90103050 msgr2=0x7f5e90105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 --2- 172.21.15.49:0/1974535382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90103050 0x7f5e90105440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009880 tx=0x7f5e8402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 -- 172.21.15.49:0/1974535382 shutdown_connections 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 --2- 172.21.15.49:0/1974535382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90103050 0x7f5e90105440 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 --2- 172.21.15.49:0/1974535382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e90100720 0x7f5e90102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 -- 172.21.15.49:0/1974535382 >> 172.21.15.49:0/1974535382 conn(0x7f5e900fa280 msgr2=0x7f5e900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 -- 172.21.15.49:0/1974535382 shutdown_connections 2024-09-19T09:10:59.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.090+0000 7f5e9695b640 1 -- 172.21.15.49:0/1974535382 wait complete. 2024-09-19T09:10:59.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.091+0000 7f5e9695b640 1 Processor -- start 2024-09-19T09:10:59.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.091+0000 7f5e9695b640 1 -- start start 2024-09-19T09:10:59.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.091+0000 7f5e9695b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90100720 0x7f5e901956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.091+0000 7f5e9695b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e90103050 0x7f5e90195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.091+0000 7f5e9695b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e901961b0 con 0x7f5e90100720 2024-09-19T09:10:59.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.091+0000 7f5e9695b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e90196320 con 0x7f5e90103050 2024-09-19T09:10:59.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90100720 0x7f5e901956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90100720 0x7f5e901956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49186/0 (socket says 172.21.15.49:49186) 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8ffff640 1 -- 172.21.15.49:0/504201347 learned_addr learned my addr 172.21.15.49:0/504201347 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8f7fe640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e90103050 0x7f5e90195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8ffff640 1 -- 172.21.15.49:0/504201347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e90103050 msgr2=0x7f5e90195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8ffff640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e90103050 0x7f5e90195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8ffff640 1 -- 172.21.15.49:0/504201347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84009560 con 0x7f5e90100720 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8ffff640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90100720 0x7f5e901956a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000e9a0 tx=0x7f5e8000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8d7fa640 1 -- 172.21.15.49:0/504201347 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e8000cd50 con 0x7f5e90100720 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9019adc0 con 0x7f5e90100720 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8d7fa640 1 -- 172.21.15.49:0/504201347 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e8000ceb0 con 0x7f5e90100720 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e8d7fa640 1 -- 172.21.15.49:0/504201347 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e80010660 con 0x7f5e90100720 2024-09-19T09:10:59.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.092+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9019b290 con 0x7f5e90100720 2024-09-19T09:10:59.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.093+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e901087f0 con 0x7f5e90100720 2024-09-19T09:10:59.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.094+0000 7f5e8d7fa640 1 -- 172.21.15.49:0/504201347 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5e800048a0 con 0x7f5e90100720 2024-09-19T09:10:59.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.094+0000 7f5e8d7fa640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e7806e5f0 0x7f5e78070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.094+0000 7f5e8d7fa640 1 -- 172.21.15.49:0/504201347 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f5e80014070 con 0x7f5e90100720 2024-09-19T09:10:59.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.094+0000 7f5e8f7fe640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e7806e5f0 0x7f5e78070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.095+0000 7f5e8f7fe640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e7806e5f0 0x7f5e78070ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009230 tx=0x7f5e840314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.099+0000 7f5e8d7fa640 1 -- 172.21.15.49:0/504201347 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5e8005b880 con 0x7f5e90100720 2024-09-19T09:10:59.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.282+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e9019b4e0 con 0x7f5e7806e5f0 2024-09-19T09:10:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.292+0000 7f5e8d7fa640 1 -- 172.21.15.49:0/504201347 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f5e9019b4e0 con 0x7f5e7806e5f0 2024-09-19T09:10:59.292 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:10:59.292 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (15m) 54s ago 16m 25.4M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:10:59.292 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 starting - - - - 2024-09-19T09:10:59.292 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (4s) 1s ago 15m 7428k - 19.1.1-361-g2f599a46 d2baa855c067 6f4f65bf81b8 2024-09-19T09:10:59.292 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (5m) 54s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:10:59.292 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (5m) 1s ago 15m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (15m) 54s ago 16m 82.9M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (80s) 54s ago 11m 258M - 19.1.1-361-g2f599a46 d2baa855c067 3860d60c0271 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (59s) 54s ago 11m 15.2M - 19.1.1-361-g2f599a46 d2baa855c067 633df85b1957 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (27s) 1s ago 11m 16.3M - 19.1.1-361-g2f599a46 d2baa855c067 3766d06b2add 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (41s) 1s ago 11m 87.9M - 19.1.1-361-g2f599a46 d2baa855c067 5257da592c71 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (8m) 54s ago 17m 506M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (6m) 1s ago 15m 443M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 54s ago 17m 52.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (6m) 1s ago 15m 40.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (16m) 54s ago 16m 15.1M - 1.5.0 0da6a335fe13 47577e65fa0a 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (15m) 1s ago 15m 16.5M - 1.5.0 0da6a335fe13 5d2ad54b4366 2024-09-19T09:10:59.293 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (4m) 54s ago 14m 107M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:10:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 54s ago 14m 105M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:10:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (3m) 54s ago 13m 106M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:10:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (3m) 1s ago 13m 122M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:10:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (2m) 1s ago 13m 88.4M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:10:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (2m) 1s ago 12m 87.5M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:10:59.294 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (6m) 54s ago 16m 61.4M - 2.43.0 a07b618ecd1d 818d86d64fbc 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e7806e5f0 msgr2=0x7f5e78070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e7806e5f0 0x7f5e78070ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009230 tx=0x7f5e840314e0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90100720 msgr2=0x7f5e901956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90100720 0x7f5e901956a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000e9a0 tx=0x7f5e8000eda0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 shutdown_connections 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5e7806e5f0 0x7f5e78070ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e90103050 0x7f5e90195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 --2- 172.21.15.49:0/504201347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e90100720 0x7f5e901956a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 >> 172.21.15.49:0/504201347 conn(0x7f5e900fa280 msgr2=0x7f5e900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 shutdown_connections 2024-09-19T09:10:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.294+0000 7f5e9695b640 1 -- 172.21.15.49:0/504201347 wait complete. 2024-09-19T09:10:59.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 -- 172.21.15.49:0/1404532062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7918100d90 msgr2=0x7f7918101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 --2- 172.21.15.49:0/1404532062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7918100d90 0x7f7918101210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f790c009880 tx=0x7f790c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 -- 172.21.15.49:0/1404532062 shutdown_connections 2024-09-19T09:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 --2- 172.21.15.49:0/1404532062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7918100d90 0x7f7918101210 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 --2- 172.21.15.49:0/1404532062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79180ffb90 0x7f79180fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 -- 172.21.15.49:0/1404532062 >> 172.21.15.49:0/1404532062 conn(0x7f79180fb360 msgr2=0x7f79180fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 -- 172.21.15.49:0/1404532062 shutdown_connections 2024-09-19T09:10:59.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.380+0000 7f791d4ec640 1 -- 172.21.15.49:0/1404532062 wait complete. 2024-09-19T09:10:59.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.381+0000 7f791d4ec640 1 Processor -- start 2024-09-19T09:10:59.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.381+0000 7f791d4ec640 1 -- start start 2024-09-19T09:10:59.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.381+0000 7f791d4ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79180ffb90 0x7f7918074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f791d4ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7918100d90 0x7f79180728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f791d4ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918199260 con 0x7f79180ffb90 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f791d4ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79181993d0 con 0x7f7918100d90 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f7916ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79180ffb90 0x7f7918074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f7916ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79180ffb90 0x7f7918074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49206/0 (socket says 172.21.15.49:49206) 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f7916ffd640 1 -- 172.21.15.49:0/3141205456 learned_addr learned my addr 172.21.15.49:0/3141205456 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f79167fc640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7918100d90 0x7f79180728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f7916ffd640 1 -- 172.21.15.49:0/3141205456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7918100d90 msgr2=0x7f79180728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f7916ffd640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7918100d90 0x7f79180728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f7916ffd640 1 -- 172.21.15.49:0/3141205456 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c009560 con 0x7f79180ffb90 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f79167fc640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7918100d90 0x7f79180728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:10:59.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.382+0000 7f7916ffd640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79180ffb90 0x7f7918074250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f790800d6f0 tx=0x7f790800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.383+0000 7f78fffff640 1 -- 172.21.15.49:0/3141205456 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7908009a30 con 0x7f79180ffb90 2024-09-19T09:10:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.383+0000 7f78fffff640 1 -- 172.21.15.49:0/3141205456 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7908009b90 con 0x7f79180ffb90 2024-09-19T09:10:59.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.383+0000 7f78fffff640 1 -- 172.21.15.49:0/3141205456 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7908003e70 con 0x7f79180ffb90 2024-09-19T09:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.383+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79181996b0 con 0x7f79180ffb90 2024-09-19T09:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.383+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7918199c80 con 0x7f79180ffb90 2024-09-19T09:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.384+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79180735a0 con 0x7f79180ffb90 2024-09-19T09:10:59.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.385+0000 7f78fffff640 1 -- 172.21.15.49:0/3141205456 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7908009d00 con 0x7f79180ffb90 2024-09-19T09:10:59.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.386+0000 7f78fffff640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f790006e5f0 0x7f7900070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.386+0000 7f78fffff640 1 -- 172.21.15.49:0/3141205456 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f790808e1c0 con 0x7f79180ffb90 2024-09-19T09:10:59.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.386+0000 7f79167fc640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f790006e5f0 0x7f7900070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.386+0000 7f79167fc640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f790006e5f0 0x7f7900070ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f790c031540 tx=0x7f790c005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.390+0000 7f78fffff640 1 -- 172.21.15.49:0/3141205456 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7908057280 con 0x7f79180ffb90 2024-09-19T09:10:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.640+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f791818f180 con 0x7f79180ffb90 2024-09-19T09:10:59.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.641+0000 7f78fffff640 1 -- 172.21.15.49:0/3141205456 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f790805a940 con 0x7f79180ffb90 2024-09-19T09:10:59.641 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:10:59.642 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:10:59.643 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T09:10:59.643 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:10:59.643 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:10:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f790006e5f0 msgr2=0x7f7900070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f790006e5f0 0x7f7900070ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f790c031540 tx=0x7f790c005de0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79180ffb90 msgr2=0x7f7918074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79180ffb90 0x7f7918074250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f790800d6f0 tx=0x7f790800dbb0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 shutdown_connections 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f790006e5f0 0x7f7900070ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7918100d90 0x7f79180728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 --2- 172.21.15.49:0/3141205456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79180ffb90 0x7f7918074250 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 >> 172.21.15.49:0/3141205456 conn(0x7f79180fb360 msgr2=0x7f79181044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 shutdown_connections 2024-09-19T09:10:59.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.643+0000 7f791d4ec640 1 -- 172.21.15.49:0/3141205456 wait complete. 2024-09-19T09:10:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.727+0000 7f5a374d6640 1 -- 172.21.15.49:0/3907833644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fe470 msgr2=0x7f5a300fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.727+0000 7f5a374d6640 1 --2- 172.21.15.49:0/3907833644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fe470 0x7f5a300fe870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009c20 tx=0x7f5a2002a970 comp rx=0 tx=0).stop 2024-09-19T09:10:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 -- 172.21.15.49:0/3907833644 shutdown_connections 2024-09-19T09:10:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 --2- 172.21.15.49:0/3907833644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a300fedb0 0x7f5a300ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 --2- 172.21.15.49:0/3907833644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fe470 0x7f5a300fe870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 -- 172.21.15.49:0/3907833644 >> 172.21.15.49:0/3907833644 conn(0x7f5a300fa280 msgr2=0x7f5a300fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 -- 172.21.15.49:0/3907833644 shutdown_connections 2024-09-19T09:10:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 -- 172.21.15.49:0/3907833644 wait complete. 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 Processor -- start 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.728+0000 7f5a374d6640 1 -- start start 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a374d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a300fe470 0x7f5a30197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a374d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fedb0 0x7f5a30197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a374d6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30198370 con 0x7f5a300fedb0 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a374d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a301984e0 con 0x7f5a300fe470 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a34a71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fedb0 0x7f5a30197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a34a71640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fedb0 0x7f5a30197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49224/0 (socket says 172.21.15.49:49224) 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a34a71640 1 -- 172.21.15.49:0/2845697042 learned_addr learned my addr 172.21.15.49:0/2845697042 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:10:59.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a35272640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a300fe470 0x7f5a30197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a34a71640 1 -- 172.21.15.49:0/2845697042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a300fe470 msgr2=0x7f5a30197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a34a71640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a300fe470 0x7f5a30197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a34a71640 1 -- 172.21.15.49:0/2845697042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20009900 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a34a71640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fedb0 0x7f5a30197da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400d720 tx=0x7f5a2400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a2e7fc640 1 -- 172.21.15.49:0/2845697042 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a240051f0 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a2e7fc640 1 -- 172.21.15.49:0/2845697042 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a24009ce0 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3019cf80 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a2e7fc640 1 -- 172.21.15.49:0/2845697042 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a24010460 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.729+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3019d4a0 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.730+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a300fe870 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.731+0000 7f5a2e7fc640 1 -- 172.21.15.49:0/2845697042 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5a24005350 con 0x7f5a300fedb0 2024-09-19T09:10:59.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.731+0000 7f5a2e7fc640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5a1806e5f0 0x7f5a18070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:59.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.732+0000 7f5a2e7fc640 1 -- 172.21.15.49:0/2845697042 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f5a2408e2d0 con 0x7f5a300fedb0 2024-09-19T09:10:59.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.732+0000 7f5a35272640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5a1806e5f0 0x7f5a18070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:59.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.732+0000 7f5a35272640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5a1806e5f0 0x7f5a18070ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a2002fd20 tx=0x7f5a20009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:59.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.736+0000 7f5a2e7fc640 1 -- 172.21.15.49:0/2845697042 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5a24057390 con 0x7f5a300fedb0 2024-09-19T09:10:59.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.954+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a30191970 con 0x7f5a300fedb0 2024-09-19T09:10:59.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.954+0000 7f5a2e7fc640 1 -- 172.21.15.49:0/2845697042 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+2003 (secure 0 0 0) 0x7f5a240177f0 con 0x7f5a300fedb0 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:e42 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-19T09:10:40:827552+0000 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 42 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:10:59.955 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:10:40.827533+0000 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 91 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:10:59.956 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=34416,1=34448} 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:10:59.957 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{0:44371} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6824/4160337930,v1:172.21.15.102:6825/4160337930] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:10:59.958 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{1:34448} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:10:59.958 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:44401} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6826/801204290,v1:172.21.15.102:6827/801204290] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:10:59.958 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:10:59.958 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:10:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-09-19T09:10:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5a1806e5f0 msgr2=0x7f5a18070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5a1806e5f0 0x7f5a18070ab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a2002fd20 tx=0x7f5a20009360 comp rx=0 tx=0).stop 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fedb0 msgr2=0x7f5a30197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fedb0 0x7f5a30197da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400d720 tx=0x7f5a2400dbe0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 shutdown_connections 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5a1806e5f0 0x7f5a18070ab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a300fedb0 0x7f5a30197da0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 --2- 172.21.15.49:0/2845697042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a300fe470 0x7f5a30197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.956+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 >> 172.21.15.49:0/2845697042 conn(0x7f5a300fa280 msgr2=0x7f5a30106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.957+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 shutdown_connections 2024-09-19T09:10:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:10:59.957+0000 7f5a374d6640 1 -- 172.21.15.49:0/2845697042 wait complete. 2024-09-19T09:11:00.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.048+0000 7f7238fcb640 1 -- 172.21.15.49:0/1443139259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 msgr2=0x7f72340fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.048+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1443139259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 0x7f72340fff90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7224009880 tx=0x7f722402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.049+0000 7f7238fcb640 1 -- 172.21.15.49:0/1443139259 shutdown_connections 2024-09-19T09:11:00.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.049+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1443139259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 0x7f7234101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.049+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1443139259 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 0x7f72340fff90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.049+0000 7f7238fcb640 1 -- 172.21.15.49:0/1443139259 >> 172.21.15.49:0/1443139259 conn(0x7f72340fb360 msgr2=0x7f72340fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:00.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.049+0000 7f7238fcb640 1 -- 172.21.15.49:0/1443139259 shutdown_connections 2024-09-19T09:11:00.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.049+0000 7f7238fcb640 1 -- 172.21.15.49:0/1443139259 wait complete. 2024-09-19T09:11:00.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7238fcb640 1 Processor -- start 2024-09-19T09:11:00.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7238fcb640 1 -- start start 2024-09-19T09:11:00.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7238fcb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 0x7f72341955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:00.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7238fcb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 0x7f7234195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7238fcb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72341960f0 con 0x7f72340ffb90 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7238fcb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7234196260 con 0x7f7234100d90 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f723259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 0x7f72341955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7231d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 0x7f7234195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7231d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 0x7f7234195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:33782/0 (socket says 172.21.15.49:33782) 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.050+0000 7f7231d9b640 1 -- 172.21.15.49:0/1078424504 learned_addr learned my addr 172.21.15.49:0/1078424504 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f7231d9b640 1 -- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 msgr2=0x7f72341955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f7231d9b640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 0x7f72341955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f7231d9b640 1 -- 172.21.15.49:0/1078424504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224009560 con 0x7f7234100d90 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f7231d9b640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 0x7f7234195b20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f722800e970 tx=0x7f722800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:00.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f72237fe640 1 -- 172.21.15.49:0/1078424504 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f722800cc90 con 0x7f7234100d90 2024-09-19T09:11:00.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f72237fe640 1 -- 172.21.15.49:0/1078424504 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f722800cdf0 con 0x7f7234100d90 2024-09-19T09:11:00.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723419ad00 con 0x7f7234100d90 2024-09-19T09:11:00.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f72237fe640 1 -- 172.21.15.49:0/1078424504 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7228018810 con 0x7f7234100d90 2024-09-19T09:11:00.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.051+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723419b2d0 con 0x7f7234100d90 2024-09-19T09:11:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.052+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7234108780 con 0x7f7234100d90 2024-09-19T09:11:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.054+0000 7f72237fe640 1 -- 172.21.15.49:0/1078424504 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7228010430 con 0x7f7234100d90 2024-09-19T09:11:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.054+0000 7f72237fe640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f721c06e5f0 0x7f721c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.054+0000 7f72237fe640 1 -- 172.21.15.49:0/1078424504 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f7228014070 con 0x7f7234100d90 2024-09-19T09:11:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.054+0000 7f723259c640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f721c06e5f0 0x7f721c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:00.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.055+0000 7f723259c640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f721c06e5f0 0x7f721c070ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7224009230 tx=0x7f72240314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:00.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.063+0000 7f72237fe640 1 -- 172.21.15.49:0/1078424504 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7228054210 con 0x7f7234100d90 2024-09-19T09:11:00.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.267+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f723419b4c0 con 0x7f721c06e5f0 2024-09-19T09:11:00.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.269+0000 7f72237fe640 1 -- 172.21.15.49:0/1078424504 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f723419b4c0 con 0x7f721c06e5f0 2024-09-19T09:11:00.270 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:11:00.270 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:11:00.270 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:11:00.270 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:11:00.270 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:11:00.271 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:11:00.271 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-09-19T09:11:00.271 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-09-19T09:11:00.271 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:11:00.271 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph-exporter", 2024-09-19T09:11:00.272 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:11:00.272 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:11:00.272 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "18/23 daemons upgraded", 2024-09-19T09:11:00.272 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-19T09:11:00.272 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:11:00.272 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:11:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f721c06e5f0 msgr2=0x7f721c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f721c06e5f0 0x7f721c070ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7224009230 tx=0x7f72240314e0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 msgr2=0x7f7234195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 0x7f7234195b20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f722800e970 tx=0x7f722800ee30 comp rx=0 tx=0).stop 2024-09-19T09:11:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 shutdown_connections 2024-09-19T09:11:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f721c06e5f0 0x7f721c070ab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7234100d90 0x7f7234195b20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 --2- 172.21.15.49:0/1078424504 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72340ffb90 0x7f72341955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 >> 172.21.15.49:0/1078424504 conn(0x7f72340fb360 msgr2=0x7f7234103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.271+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 shutdown_connections 2024-09-19T09:11:00.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.272+0000 7f7238fcb640 1 -- 172.21.15.49:0/1078424504 wait complete. 2024-09-19T09:11:00.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.359+0000 7f6b24a44640 1 -- 172.21.15.49:0/1230156138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200feaf0 msgr2=0x7f6b200feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.359+0000 7f6b24a44640 1 --2- 172.21.15.49:0/1230156138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200feaf0 0x7f6b200feef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009880 tx=0x7f6b1002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.360+0000 7f6b24a44640 1 -- 172.21.15.49:0/1230156138 shutdown_connections 2024-09-19T09:11:00.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.360+0000 7f6b24a44640 1 --2- 172.21.15.49:0/1230156138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b200ffcf0 0x7f6b20100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.360+0000 7f6b24a44640 1 --2- 172.21.15.49:0/1230156138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200feaf0 0x7f6b200feef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.360+0000 7f6b24a44640 1 -- 172.21.15.49:0/1230156138 >> 172.21.15.49:0/1230156138 conn(0x7f6b200fa280 msgr2=0x7f6b200fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:00.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.360+0000 7f6b24a44640 1 -- 172.21.15.49:0/1230156138 shutdown_connections 2024-09-19T09:11:00.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.360+0000 7f6b24a44640 1 -- 172.21.15.49:0/1230156138 wait complete. 2024-09-19T09:11:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.360+0000 7f6b24a44640 1 Processor -- start 2024-09-19T09:11:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b24a44640 1 -- start start 2024-09-19T09:11:00.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b24a44640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b200feaf0 0x7f6b20195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b24a44640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200ffcf0 0x7f6b20195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b24a44640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20196170 con 0x7f6b200ffcf0 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b24a44640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b201962e0 con 0x7f6b200feaf0 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b1e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b200feaf0 0x7f6b20195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b1dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200ffcf0 0x7f6b20195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b1e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b200feaf0 0x7f6b20195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:60532/0 (socket says 172.21.15.49:60532) 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b1e59c640 1 -- 172.21.15.49:0/2795828547 learned_addr learned my addr 172.21.15.49:0/2795828547 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b1dd9b640 1 -- 172.21.15.49:0/2795828547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b200feaf0 msgr2=0x7f6b20195660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b1dd9b640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b200feaf0 0x7f6b20195660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.361+0000 7f6b1dd9b640 1 -- 172.21.15.49:0/2795828547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009560 con 0x7f6b200ffcf0 2024-09-19T09:11:00.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.362+0000 7f6b1dd9b640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200ffcf0 0x7f6b20195ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800e9a0 tx=0x7f6b0800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:00.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.362+0000 7f6b177fe640 1 -- 172.21.15.49:0/2795828547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b08009640 con 0x7f6b200ffcf0 2024-09-19T09:11:00.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.362+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2019ad80 con 0x7f6b200ffcf0 2024-09-19T09:11:00.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.362+0000 7f6b177fe640 1 -- 172.21.15.49:0/2795828547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b0800cc90 con 0x7f6b200ffcf0 2024-09-19T09:11:00.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.362+0000 7f6b177fe640 1 -- 172.21.15.49:0/2795828547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b08018810 con 0x7f6b200ffcf0 2024-09-19T09:11:00.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.362+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2019b2d0 con 0x7f6b200ffcf0 2024-09-19T09:11:00.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.363+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b201076e0 con 0x7f6b200ffcf0 2024-09-19T09:11:00.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.364+0000 7f6b177fe640 1 -- 172.21.15.49:0/2795828547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6b08018a80 con 0x7f6b200ffcf0 2024-09-19T09:11:00.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.364+0000 7f6b177fe640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f6b0c06e5f0 0x7f6b0c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:00.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.364+0000 7f6b177fe640 1 -- 172.21.15.49:0/2795828547 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f6b08014070 con 0x7f6b200ffcf0 2024-09-19T09:11:00.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.364+0000 7f6b1e59c640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f6b0c06e5f0 0x7f6b0c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:00.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.365+0000 7f6b1e59c640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f6b0c06e5f0 0x7f6b0c070ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b10000c00 tx=0x7f6b100314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:00.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.369+0000 7f6b177fe640 1 -- 172.21.15.49:0/2795828547 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6b08054210 con 0x7f6b200ffcf0 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: pgmap v235: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 9.6 MiB/s rd, 5 op/s 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3141205456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2845697042' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:00 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:00.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.643+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6b2019b730 con 0x7f6b200ffcf0 2024-09-19T09:11:00.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.644+0000 7f6b177fe640 1 -- 172.21.15.49:0/2795828547 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6b08057c10 con 0x7f6b200ffcf0 2024-09-19T09:11:00.644 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:11:00.645 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:11:00.645 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:11:00.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f6b0c06e5f0 msgr2=0x7f6b0c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f6b0c06e5f0 0x7f6b0c070ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b10000c00 tx=0x7f6b100314e0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200ffcf0 msgr2=0x7f6b20195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:00.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200ffcf0 0x7f6b20195ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800e9a0 tx=0x7f6b0800ee60 comp rx=0 tx=0).stop 2024-09-19T09:11:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 shutdown_connections 2024-09-19T09:11:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f6b0c06e5f0 0x7f6b0c070ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b200ffcf0 0x7f6b20195ba0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 --2- 172.21.15.49:0/2795828547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b200feaf0 0x7f6b20195660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 >> 172.21.15.49:0/2795828547 conn(0x7f6b200fa280 msgr2=0x7f6b200fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 shutdown_connections 2024-09-19T09:11:00.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:00.646+0000 7f6b24a44640 1 -- 172.21.15.49:0/2795828547 wait complete. 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: pgmap v235: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 9.6 MiB/s rd, 5 op/s 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3141205456' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2845697042' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:00 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:01 smithi102 ceph-mon[80875]: from='client.44427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:01.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:01 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2795828547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:11:01.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:01 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:01 smithi049 ceph-mon[91793]: from='client.44427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:01.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:01 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2795828547' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:11:01.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:01.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:01 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:02 smithi102 ceph-mon[80875]: pgmap v236: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4 op/s 2024-09-19T09:11:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:02 smithi049 ceph-mon[91793]: pgmap v236: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4 op/s 2024-09-19T09:11:04.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: pgmap v237: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:11:04.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.720 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.721 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi049"}]: dispatch 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi049"}]': finished 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi102"}]: dispatch 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi102"}]': finished 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.722 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: pgmap v237: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:11:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi049"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi049"}]': finished 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi102"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi102"}]': finished 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:04.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:05.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:05 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T09:11:05.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:05 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all iscsi 2024-09-19T09:11:05.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:05 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all nfs 2024-09-19T09:11:05.715 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:05 smithi049 ceph-mon[91793]: Upgrade: Setting container_image for all nvmeof 2024-09-19T09:11:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:05 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T09:11:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:05 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all iscsi 2024-09-19T09:11:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:05 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all nfs 2024-09-19T09:11:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:05 smithi102 ceph-mon[80875]: Upgrade: Setting container_image for all nvmeof 2024-09-19T09:11:06.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:06 smithi102 ceph-mon[80875]: pgmap v238: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:11:06.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:06 smithi102 ceph-mon[80875]: Upgrade: Updating node-exporter.smithi049 (1/2) 2024-09-19T09:11:06.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:06 smithi102 ceph-mon[80875]: Deploying daemon node-exporter.smithi049 on smithi049 2024-09-19T09:11:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:06 smithi049 ceph-mon[91793]: pgmap v238: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:11:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:06 smithi049 ceph-mon[91793]: Upgrade: Updating node-exporter.smithi049 (1/2) 2024-09-19T09:11:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:06 smithi049 ceph-mon[91793]: Deploying daemon node-exporter.smithi049 on smithi049 2024-09-19T09:11:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:08 smithi102 ceph-mon[80875]: pgmap v239: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:08 smithi049 ceph-mon[91793]: pgmap v239: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:10.655 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:10 smithi102 ceph-mon[80875]: pgmap v240: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:10.655 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:10 smithi102 ceph-mon[80875]: Upgrade: Updating node-exporter.smithi102 (2/2) 2024-09-19T09:11:10.655 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:10 smithi102 ceph-mon[80875]: Deploying daemon node-exporter.smithi102 on smithi102 2024-09-19T09:11:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:10 smithi049 ceph-mon[91793]: pgmap v240: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:10 smithi049 ceph-mon[91793]: Upgrade: Updating node-exporter.smithi102 (2/2) 2024-09-19T09:11:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:10 smithi049 ceph-mon[91793]: Deploying daemon node-exporter.smithi102 on smithi102 2024-09-19T09:11:12.750 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:12 smithi102 ceph-mon[80875]: pgmap v241: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:12.750 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:12.750 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:12.750 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:12 smithi049 ceph-mon[91793]: pgmap v241: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:13.733 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:11:13.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:11:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:14 smithi049 ceph-mon[91793]: pgmap v242: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:14.658 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:14 smithi102 ceph-mon[80875]: pgmap v242: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:14.659 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:14.659 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:14.659 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:14.659 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:16 smithi102 ceph-mon[80875]: pgmap v243: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:16 smithi049 ceph-mon[91793]: pgmap v243: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:18.282 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:18 smithi049 ceph-mon[91793]: pgmap v244: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:18.282 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:18.282 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:18 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:18 smithi102 ceph-mon[80875]: pgmap v244: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:18 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:20.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: pgmap v245: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:20 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: pgmap v245: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:20.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:20 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:22 smithi049 ceph-mon[91793]: pgmap v246: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:22 smithi049 ceph-mon[91793]: Upgrade: Updating prometheus.smithi049 2024-09-19T09:11:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:22 smithi049 ceph-mon[91793]: Deploying daemon prometheus.smithi049 on smithi049 2024-09-19T09:11:22.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:22 smithi102 ceph-mon[80875]: pgmap v246: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:22.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:22 smithi102 ceph-mon[80875]: Upgrade: Updating prometheus.smithi049 2024-09-19T09:11:22.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:22 smithi102 ceph-mon[80875]: Deploying daemon prometheus.smithi049 on smithi049 2024-09-19T09:11:24.343 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:24 smithi049 ceph-mon[91793]: pgmap v247: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:24.378 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:24 smithi102 ceph-mon[80875]: pgmap v247: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:26.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:26 smithi049 ceph-mon[91793]: pgmap v248: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:26.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:26 smithi102 ceph-mon[80875]: pgmap v248: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:27.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:27.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:28.767 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:28 smithi049 ceph-mon[91793]: pgmap v249: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:28.767 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:11:29.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:28 smithi102 ceph-mon[80875]: pgmap v249: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:29.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:11:29.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:29 smithi049 ceph-mon[91793]: pgmap v250: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:30.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:29 smithi102 ceph-mon[80875]: pgmap v250: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 -- 172.21.15.49:0/949261966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 msgr2=0x7f58f40feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 --2- 172.21.15.49:0/949261966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f40feea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009880 tx=0x7f58e402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 -- 172.21.15.49:0/949261966 shutdown_connections 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 --2- 172.21.15.49:0/949261966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f40ffca0 0x7f58f4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 --2- 172.21.15.49:0/949261966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f40feea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 -- 172.21.15.49:0/949261966 >> 172.21.15.49:0/949261966 conn(0x7f58f40fa230 msgr2=0x7f58f40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 -- 172.21.15.49:0/949261966 shutdown_connections 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 -- 172.21.15.49:0/949261966 wait complete. 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.743+0000 7f58fa485640 1 Processor -- start 2024-09-19T09:11:30.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58fa485640 1 -- start start 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58fa485640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f41956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58fa485640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f40ffca0 0x7f58f4195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58fa485640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f41961b0 con 0x7f58f40feaa0 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58fa485640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4196320 con 0x7f58f40ffca0 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f41956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58f3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f41956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45232/0 (socket says 172.21.15.49:45232) 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58f3fff640 1 -- 172.21.15.49:0/2516441391 learned_addr learned my addr 172.21.15.49:0/2516441391 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.744+0000 7f58f37fe640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f40ffca0 0x7f58f4195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:30.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f3fff640 1 -- 172.21.15.49:0/2516441391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f40ffca0 msgr2=0x7f58f4195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f3fff640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f40ffca0 0x7f58f4195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f3fff640 1 -- 172.21.15.49:0/2516441391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4009560 con 0x7f58f40feaa0 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f37fe640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f40ffca0 0x7f58f4195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f3fff640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f41956a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58e402a9c0 tx=0x7f58e40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f17fa640 1 -- 172.21.15.49:0/2516441391 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e4004aa0 con 0x7f58f40feaa0 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f419ad60 con 0x7f58f40feaa0 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f17fa640 1 -- 172.21.15.49:0/2516441391 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58e4004c00 con 0x7f58f40feaa0 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58f17fa640 1 -- 172.21.15.49:0/2516441391 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e40039b0 con 0x7f58f40feaa0 2024-09-19T09:11:30.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.745+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f419b270 con 0x7f58f40feaa0 2024-09-19T09:11:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.746+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f4107690 con 0x7f58f40feaa0 2024-09-19T09:11:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.747+0000 7f58f17fa640 1 -- 172.21.15.49:0/2516441391 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f58e4031c00 con 0x7f58f40feaa0 2024-09-19T09:11:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.748+0000 7f58f17fa640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58dc06e5f0 0x7f58dc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.748+0000 7f58f17fa640 1 -- 172.21.15.49:0/2516441391 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f58e40af870 con 0x7f58f40feaa0 2024-09-19T09:11:30.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.748+0000 7f58f37fe640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58dc06e5f0 0x7f58dc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:30.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.748+0000 7f58f37fe640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58dc06e5f0 0x7f58dc070ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58f4196bc0 tx=0x7f58e800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:30.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.753+0000 7f58f17fa640 1 -- 172.21.15.49:0/2516441391 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f58e4078960 con 0x7f58f40feaa0 2024-09-19T09:11:30.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.968+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58f419b490 con 0x7f58dc06e5f0 2024-09-19T09:11:30.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.970+0000 7f58f17fa640 1 -- 172.21.15.49:0/2516441391 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f58f419b490 con 0x7f58dc06e5f0 2024-09-19T09:11:30.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58dc06e5f0 msgr2=0x7f58dc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:30.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58dc06e5f0 0x7f58dc070ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58f4196bc0 tx=0x7f58e800b390 comp rx=0 tx=0).stop 2024-09-19T09:11:30.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 msgr2=0x7f58f41956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:30.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f41956a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58e402a9c0 tx=0x7f58e40055a0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 shutdown_connections 2024-09-19T09:11:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f58dc06e5f0 0x7f58dc070ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f40ffca0 0x7f58f4195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 --2- 172.21.15.49:0/2516441391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58f40feaa0 0x7f58f41956a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 >> 172.21.15.49:0/2516441391 conn(0x7f58f40fa230 msgr2=0x7f58f40684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 shutdown_connections 2024-09-19T09:11:30.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:30.972+0000 7f58fa485640 1 -- 172.21.15.49:0/2516441391 wait complete. 2024-09-19T09:11:30.982 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 -- 172.21.15.49:0/1422558823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 msgr2=0x7f638c1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 --2- 172.21.15.49:0/1422558823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c1053a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63800098b0 tx=0x7f638002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 -- 172.21.15.49:0/1422558823 shutdown_connections 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 --2- 172.21.15.49:0/1422558823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c1053a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 --2- 172.21.15.49:0/1422558823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f638c100680 0x7f638c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 -- 172.21.15.49:0/1422558823 >> 172.21.15.49:0/1422558823 conn(0x7f638c0fa280 msgr2=0x7f638c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 -- 172.21.15.49:0/1422558823 shutdown_connections 2024-09-19T09:11:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.059+0000 7f63917b0640 1 -- 172.21.15.49:0/1422558823 wait complete. 2024-09-19T09:11:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f63917b0640 1 Processor -- start 2024-09-19T09:11:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f63917b0640 1 -- start start 2024-09-19T09:11:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f63917b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f638c100680 0x7f638c195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f63917b0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f63917b0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c196230 con 0x7f638c102fb0 2024-09-19T09:11:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f63917b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1963a0 con 0x7f638c100680 2024-09-19T09:11:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f638a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.060+0000 7f638a7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45248/0 (socket says 172.21.15.49:45248) 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f638a7fc640 1 -- 172.21.15.49:0/1843281084 learned_addr learned my addr 172.21.15.49:0/1843281084 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f638affd640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f638c100680 0x7f638c195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f638a7fc640 1 -- 172.21.15.49:0/1843281084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f638c100680 msgr2=0x7f638c195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f638a7fc640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f638c100680 0x7f638c195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f638a7fc640 1 -- 172.21.15.49:0/1843281084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009560 con 0x7f638c102fb0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f638a7fc640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c195c60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f63800055a0 tx=0x7f63800055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f6373fff640 1 -- 172.21.15.49:0/1843281084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6380004aa0 con 0x7f638c102fb0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f6373fff640 1 -- 172.21.15.49:0/1843281084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6380004c00 con 0x7f638c102fb0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c19ade0 con 0x7f638c102fb0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.061+0000 7f6373fff640 1 -- 172.21.15.49:0/1843281084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6380003b50 con 0x7f638c102fb0 2024-09-19T09:11:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.062+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c19b2d0 con 0x7f638c102fb0 2024-09-19T09:11:31.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.063+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c108800 con 0x7f638c102fb0 2024-09-19T09:11:31.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.063+0000 7f6373fff640 1 -- 172.21.15.49:0/1843281084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6380003cb0 con 0x7f638c102fb0 2024-09-19T09:11:31.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.064+0000 7f6373fff640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637406e5f0 0x7f6374070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.064+0000 7f6373fff640 1 -- 172.21.15.49:0/1843281084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f63800af810 con 0x7f638c102fb0 2024-09-19T09:11:31.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.064+0000 7f638affd640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637406e5f0 0x7f6374070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.065+0000 7f638affd640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637406e5f0 0x7f6374070ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f637c005fd0 tx=0x7f637c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:31.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.071+0000 7f6373fff640 1 -- 172.21.15.49:0/1843281084 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6380078980 con 0x7f638c102fb0 2024-09-19T09:11:31.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.273+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f638c19b460 con 0x7f637406e5f0 2024-09-19T09:11:31.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.274+0000 7f6373fff640 1 -- 172.21.15.49:0/1843281084 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f638c19b460 con 0x7f637406e5f0 2024-09-19T09:11:31.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637406e5f0 msgr2=0x7f6374070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637406e5f0 0x7f6374070ab0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f637c005fd0 tx=0x7f637c00b390 comp rx=0 tx=0).stop 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 msgr2=0x7f638c195c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c195c60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f63800055a0 tx=0x7f63800055d0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 shutdown_connections 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637406e5f0 0x7f6374070ab0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f638c102fb0 0x7f638c195c60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 --2- 172.21.15.49:0/1843281084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f638c100680 0x7f638c195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.276+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 >> 172.21.15.49:0/1843281084 conn(0x7f638c0fa280 msgr2=0x7f638c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.277+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 shutdown_connections 2024-09-19T09:11:31.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.277+0000 7f63917b0640 1 -- 172.21.15.49:0/1843281084 wait complete. 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 -- 172.21.15.49:0/3289747070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040feaf0 msgr2=0x7f69040feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 --2- 172.21.15.49:0/3289747070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040feaf0 0x7f69040feef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009880 tx=0x7f68f802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 -- 172.21.15.49:0/3289747070 shutdown_connections 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 --2- 172.21.15.49:0/3289747070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040ffcf0 0x7f6904100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 --2- 172.21.15.49:0/3289747070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040feaf0 0x7f69040feef0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 -- 172.21.15.49:0/3289747070 >> 172.21.15.49:0/3289747070 conn(0x7f69040fa280 msgr2=0x7f69040fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 -- 172.21.15.49:0/3289747070 shutdown_connections 2024-09-19T09:11:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.362+0000 7f690b212640 1 -- 172.21.15.49:0/3289747070 wait complete. 2024-09-19T09:11:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.363+0000 7f690b212640 1 Processor -- start 2024-09-19T09:11:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.363+0000 7f690b212640 1 -- start start 2024-09-19T09:11:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.363+0000 7f690b212640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040feaf0 0x7f69040687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.363+0000 7f690b212640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040ffcf0 0x7f690419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.363+0000 7f690b212640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419a9b0 con 0x7f69040ffcf0 2024-09-19T09:11:31.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.363+0000 7f690b212640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419ab20 con 0x7f69040feaf0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.363+0000 7f6903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040ffcf0 0x7f690419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040ffcf0 0x7f690419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45268/0 (socket says 172.21.15.49:45268) 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6903fff640 1 -- 172.21.15.49:0/46316749 learned_addr learned my addr 172.21.15.49:0/46316749 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6908fae640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040feaf0 0x7f69040687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6903fff640 1 -- 172.21.15.49:0/46316749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040feaf0 msgr2=0x7f69040687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6903fff640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040feaf0 0x7f69040687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6903fff640 1 -- 172.21.15.49:0/46316749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8009560 con 0x7f69040ffcf0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6908fae640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040feaf0 0x7f69040687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6903fff640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040ffcf0 0x7f690419a3e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d6f0 tx=0x7f68f000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6901ffb640 1 -- 172.21.15.49:0/46316749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68f0009a30 con 0x7f69040ffcf0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6901ffb640 1 -- 172.21.15.49:0/46316749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68f00054e0 con 0x7f69040ffcf0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690419ae00 con 0x7f69040ffcf0 2024-09-19T09:11:31.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.364+0000 7f6901ffb640 1 -- 172.21.15.49:0/46316749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68f0010460 con 0x7f69040ffcf0 2024-09-19T09:11:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.365+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690419b320 con 0x7f69040ffcf0 2024-09-19T09:11:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.366+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69040feef0 con 0x7f69040ffcf0 2024-09-19T09:11:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.366+0000 7f6901ffb640 1 -- 172.21.15.49:0/46316749 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f68f0009b90 con 0x7f69040ffcf0 2024-09-19T09:11:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.367+0000 7f6901ffb640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f68f406e5f0 0x7f68f4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.367+0000 7f6901ffb640 1 -- 172.21.15.49:0/46316749 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f68f008e2c0 con 0x7f69040ffcf0 2024-09-19T09:11:31.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.367+0000 7f6908fae640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f68f406e5f0 0x7f68f4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.368+0000 7f6908fae640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f68f406e5f0 0x7f68f4070ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6904068d10 tx=0x7f68f80314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:31.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.372+0000 7f6901ffb640 1 -- 172.21.15.49:0/46316749 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f68f0057380 con 0x7f69040ffcf0 2024-09-19T09:11:31.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.569+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f690402c540 con 0x7f68f406e5f0 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.578+0000 7f6901ffb640 1 -- 172.21.15.49:0/46316749 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f690402c540 con 0x7f68f406e5f0 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (15m) 0s ago 16m 25.5M - 0.25.0 c8568f914cd2 d7a74f29018f 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (45s) 0s ago 17m 8409k - 19.1.1-361-g2f599a46 d2baa855c067 b236633deeab 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (36s) 18s ago 16m 8292k - 19.1.1-361-g2f599a46 d2baa855c067 6f4f65bf81b8 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (5m) 0s ago 17m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (5m) 18s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (15m) 0s ago 16m 83.7M - 9.4.7 954c08fa6188 843a6400fa9c 2024-09-19T09:11:31.580 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (112s) 0s ago 11m 87.2M - 19.1.1-361-g2f599a46 d2baa855c067 3860d60c0271 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (92s) 0s ago 11m 20.1M - 19.1.1-361-g2f599a46 d2baa855c067 633df85b1957 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (59s) 18s ago 11m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 3766d06b2add 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (73s) 18s ago 11m 87.9M - 19.1.1-361-g2f599a46 d2baa855c067 5257da592c71 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (8m) 0s ago 18m 511M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (7m) 18s ago 16m 443M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 0s ago 18m 57.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (6m) 18s ago 16m 42.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (24s) 0s ago 17m 8048k - 1.5.0 0da6a335fe13 fed7048a29b5 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (20s) 18s ago 16m 3611k - 1.5.0 0da6a335fe13 be690cc5c2ad 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 0s ago 15m 108M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 0s ago 14m 107M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 0s ago 14m 102M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (3m) 18s ago 14m 121M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:11:31.581 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (3m) 18s ago 13m 87.1M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:11:31.582 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (2m) 18s ago 13m 86.2M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:11:31.582 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (5s) 0s ago 16m 42.0M - 2.43.0 a07b618ecd1d 0ee729414142 2024-09-19T09:11:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f68f406e5f0 msgr2=0x7f68f4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f68f406e5f0 0x7f68f4070ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6904068d10 tx=0x7f68f80314e0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040ffcf0 msgr2=0x7f690419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040ffcf0 0x7f690419a3e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d6f0 tx=0x7f68f000dbb0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 shutdown_connections 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f68f406e5f0 0x7f68f4070ab0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69040ffcf0 0x7f690419a3e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 --2- 172.21.15.49:0/46316749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69040feaf0 0x7f69040687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 >> 172.21.15.49:0/46316749 conn(0x7f69040fa280 msgr2=0x7f69041033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 shutdown_connections 2024-09-19T09:11:31.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.581+0000 7f690b212640 1 -- 172.21.15.49:0/46316749 wait complete. 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.665+0000 7fe66c241640 1 -- 172.21.15.49:0/3775854911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe664100d90 msgr2=0x7fe664101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.665+0000 7fe66c241640 1 --2- 172.21.15.49:0/3775854911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe664100d90 0x7fe664101210 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe654009880 tx=0x7fe65402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.665+0000 7fe66c241640 1 -- 172.21.15.49:0/3775854911 shutdown_connections 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.665+0000 7fe66c241640 1 --2- 172.21.15.49:0/3775854911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe664100d90 0x7fe664101210 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.665+0000 7fe66c241640 1 --2- 172.21.15.49:0/3775854911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6640ffb90 0x7fe6640fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.665+0000 7fe66c241640 1 -- 172.21.15.49:0/3775854911 >> 172.21.15.49:0/3775854911 conn(0x7fe6640fb360 msgr2=0x7fe6640fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.666+0000 7fe66c241640 1 -- 172.21.15.49:0/3775854911 shutdown_connections 2024-09-19T09:11:31.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.666+0000 7fe66c241640 1 -- 172.21.15.49:0/3775854911 wait complete. 2024-09-19T09:11:31.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.666+0000 7fe66c241640 1 Processor -- start 2024-09-19T09:11:31.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.666+0000 7fe66c241640 1 -- start start 2024-09-19T09:11:31.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe66c241640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6640ffb90 0x7fe664074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe66c241640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe664100d90 0x7fe6640728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe66c241640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664072de0 con 0x7fe6640ffb90 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe66c241640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664072f50 con 0x7fe664100d90 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe669fdd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6640ffb90 0x7fe664074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe669fdd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6640ffb90 0x7fe664074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45288/0 (socket says 172.21.15.49:45288) 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe669fdd640 1 -- 172.21.15.49:0/1069808399 learned_addr learned my addr 172.21.15.49:0/1069808399 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe6697dc640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe664100d90 0x7fe6640728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe669fdd640 1 -- 172.21.15.49:0/1069808399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe664100d90 msgr2=0x7fe6640728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe669fdd640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe664100d90 0x7fe6640728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.667+0000 7fe669fdd640 1 -- 172.21.15.49:0/1069808399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654009560 con 0x7fe6640ffb90 2024-09-19T09:11:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.668+0000 7fe669fdd640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6640ffb90 0x7fe664074250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe66000d6f0 tx=0x7fe66000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.668+0000 7fe65affd640 1 -- 172.21.15.49:0/1069808399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe660009a30 con 0x7fe6640ffb90 2024-09-19T09:11:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.668+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe664073230 con 0x7fe6640ffb90 2024-09-19T09:11:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.668+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66419d670 con 0x7fe6640ffb90 2024-09-19T09:11:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.668+0000 7fe65affd640 1 -- 172.21.15.49:0/1069808399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe660009b90 con 0x7fe6640ffb90 2024-09-19T09:11:31.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.668+0000 7fe65affd640 1 -- 172.21.15.49:0/1069808399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe660003e70 con 0x7fe6640ffb90 2024-09-19T09:11:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.669+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe648005280 con 0x7fe6640ffb90 2024-09-19T09:11:31.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.670+0000 7fe65affd640 1 -- 172.21.15.49:0/1069808399 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe660010460 con 0x7fe6640ffb90 2024-09-19T09:11:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.670+0000 7fe65affd640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe65006e600 0x7fe650070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.671+0000 7fe65affd640 1 -- 172.21.15.49:0/1069808399 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fe66008e0b0 con 0x7fe6640ffb90 2024-09-19T09:11:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.671+0000 7fe6697dc640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe65006e600 0x7fe650070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:31.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.671+0000 7fe6697dc640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe65006e600 0x7fe650070ac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe654000c00 tx=0x7fe6540314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.676+0000 7fe65affd640 1 -- 172.21.15.49:0/1069808399 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe660057220 con 0x7fe6640ffb90 2024-09-19T09:11:31.961 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:31 smithi049 ceph-mon[91793]: pgmap v251: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:31.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:31.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:31.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:31 smithi049 ceph-mon[91793]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:31.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:31 smithi049 ceph-mon[91793]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:31.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:31.962 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:31 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:31.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.974+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe648005d40 con 0x7fe6640ffb90 2024-09-19T09:11:31.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.975+0000 7fe65affd640 1 -- 172.21.15.49:0/1069808399 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe66005a8e0 con 0x7fe6640ffb90 2024-09-19T09:11:31.976 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:11:31.976 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:11:31.976 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:11:31.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:11:31.976 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:11:31.977 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.977+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe65006e600 msgr2=0x7fe650070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.977+0000 7fe66c241640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe65006e600 0x7fe650070ac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe654000c00 tx=0x7fe6540314e0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.977+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6640ffb90 msgr2=0x7fe664074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.977+0000 7fe66c241640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6640ffb90 0x7fe664074250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe66000d6f0 tx=0x7fe66000dbb0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.978+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 shutdown_connections 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.978+0000 7fe66c241640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe65006e600 0x7fe650070ac0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.978+0000 7fe66c241640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe664100d90 0x7fe6640728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.978+0000 7fe66c241640 1 --2- 172.21.15.49:0/1069808399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6640ffb90 0x7fe664074250 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.978+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 >> 172.21.15.49:0/1069808399 conn(0x7fe6640fb360 msgr2=0x7fe664104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:31.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.978+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 shutdown_connections 2024-09-19T09:11:31.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:31.978+0000 7fe66c241640 1 -- 172.21.15.49:0/1069808399 wait complete. 2024-09-19T09:11:32.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 -- 172.21.15.49:0/1403979517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 msgr2=0x7f6390100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 --2- 172.21.15.49:0/1403979517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390100100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6380009880 tx=0x7f638002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 -- 172.21.15.49:0/1403979517 shutdown_connections 2024-09-19T09:11:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 --2- 172.21.15.49:0/1403979517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390100100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 --2- 172.21.15.49:0/1403979517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63900fea80 0x7f63900fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 -- 172.21.15.49:0/1403979517 >> 172.21.15.49:0/1403979517 conn(0x7f63900fa230 msgr2=0x7f63900fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 -- 172.21.15.49:0/1403979517 shutdown_connections 2024-09-19T09:11:32.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.061+0000 7f63973d0640 1 -- 172.21.15.49:0/1403979517 wait complete. 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f63973d0640 1 Processor -- start 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f63973d0640 1 -- start start 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f63973d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63900fea80 0x7f6390195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f63973d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f63973d0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6390196090 con 0x7f63900ffc80 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f63973d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6390196200 con 0x7f63900fea80 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f639496b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f639496b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45316/0 (socket says 172.21.15.49:45316) 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f639496b640 1 -- 172.21.15.49:0/1545195277 learned_addr learned my addr 172.21.15.49:0/1545195277 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.062+0000 7f639516c640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63900fea80 0x7f6390195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f639496b640 1 -- 172.21.15.49:0/1545195277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63900fea80 msgr2=0x7f6390195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f639496b640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63900fea80 0x7f6390195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f639496b640 1 -- 172.21.15.49:0/1545195277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009560 con 0x7f63900ffc80 2024-09-19T09:11:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f639516c640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63900fea80 0x7f6390195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f639496b640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390195b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6380005610 tx=0x7f6380005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f63867fc640 1 -- 172.21.15.49:0/1545195277 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6380004ba0 con 0x7f63900ffc80 2024-09-19T09:11:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639019ac80 con 0x7f63900ffc80 2024-09-19T09:11:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f63867fc640 1 -- 172.21.15.49:0/1545195277 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6380004d00 con 0x7f63900ffc80 2024-09-19T09:11:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f63867fc640 1 -- 172.21.15.49:0/1545195277 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6380003bd0 con 0x7f63900ffc80 2024-09-19T09:11:32.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.063+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639019b1a0 con 0x7f63900ffc80 2024-09-19T09:11:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.064+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6390107670 con 0x7f63900ffc80 2024-09-19T09:11:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.065+0000 7f63867fc640 1 -- 172.21.15.49:0/1545195277 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6380031640 con 0x7f63900ffc80 2024-09-19T09:11:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.065+0000 7f63867fc640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637c06e5f0 0x7f637c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.065+0000 7f63867fc640 1 -- 172.21.15.49:0/1545195277 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f63800afb30 con 0x7f63900ffc80 2024-09-19T09:11:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.065+0000 7f639516c640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637c06e5f0 0x7f637c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.066+0000 7f639516c640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637c06e5f0 0x7f637c070ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63900ffae0 tx=0x7f638c00a5e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:32.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.070+0000 7f63867fc640 1 -- 172.21.15.49:0/1545195277 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6380078b70 con 0x7f63900ffc80 2024-09-19T09:11:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:31 smithi102 ceph-mon[80875]: pgmap v251: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:31 smithi102 ceph-mon[80875]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:31 smithi102 ceph-mon[80875]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:31 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:32.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.291+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f639019b650 con 0x7f63900ffc80 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.291+0000 7f63867fc640 1 -- 172.21.15.49:0/1545195277 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+2003 (secure 0 0 0) 0x7f638007c230 con 0x7f63900ffc80 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stdout:e42 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-19T09:10:40:827552+0000 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:11:32.293 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 42 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:10:40.827533+0000 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:11:32.294 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 91 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=34416,1=34448} 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:11:32.295 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{0:44371} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6824/4160337930,v1:172.21.15.102:6825/4160337930] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{1:34448} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:44401} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6826/801204290,v1:172.21.15.102:6827/801204290] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:11:32.296 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637c06e5f0 msgr2=0x7f637c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637c06e5f0 0x7f637c070ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63900ffae0 tx=0x7f638c00a5e0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 msgr2=0x7f6390195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390195b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6380005610 tx=0x7f6380005640 comp rx=0 tx=0).stop 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 shutdown_connections 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f637c06e5f0 0x7f637c070ab0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f63900ffc80 0x7f6390195b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 --2- 172.21.15.49:0/1545195277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63900fea80 0x7f6390195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 >> 172.21.15.49:0/1545195277 conn(0x7f63900fa230 msgr2=0x7f6390068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 shutdown_connections 2024-09-19T09:11:32.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.294+0000 7f63973d0640 1 -- 172.21.15.49:0/1545195277 wait complete. 2024-09-19T09:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 -- 172.21.15.49:0/2344647234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c102f60 msgr2=0x7f198c105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 --2- 172.21.15.49:0/2344647234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c102f60 0x7f198c105350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f197c0098b0 tx=0x7f197c02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 -- 172.21.15.49:0/2344647234 shutdown_connections 2024-09-19T09:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 --2- 172.21.15.49:0/2344647234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c102f60 0x7f198c105350 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 --2- 172.21.15.49:0/2344647234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f198c100630 0x7f198c102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 -- 172.21.15.49:0/2344647234 >> 172.21.15.49:0/2344647234 conn(0x7f198c0fa250 msgr2=0x7f198c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:32.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 -- 172.21.15.49:0/2344647234 shutdown_connections 2024-09-19T09:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.379+0000 7f1991e85640 1 -- 172.21.15.49:0/2344647234 wait complete. 2024-09-19T09:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f1991e85640 1 Processor -- start 2024-09-19T09:11:32.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f1991e85640 1 -- start start 2024-09-19T09:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f1991e85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c100630 0x7f198c0fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f1991e85640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f198c102f60 0x7f198c0fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f1991e85640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0feb20 con 0x7f198c100630 2024-09-19T09:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f1991e85640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0fec90 con 0x7f198c102f60 2024-09-19T09:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f198b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c100630 0x7f198c0fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f198b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c100630 0x7f198c0fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45344/0 (socket says 172.21.15.49:45344) 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.380+0000 7f198b7fe640 1 -- 172.21.15.49:0/218590124 learned_addr learned my addr 172.21.15.49:0/218590124 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f198affd640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f198c102f60 0x7f198c0fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f198b7fe640 1 -- 172.21.15.49:0/218590124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f198c102f60 msgr2=0x7f198c0fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f198b7fe640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f198c102f60 0x7f198c0fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f198b7fe640 1 -- 172.21.15.49:0/218590124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009560 con 0x7f198c100630 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f198affd640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f198c102f60 0x7f198c0fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f198b7fe640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c100630 0x7f198c0fff90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f197400c8f0 tx=0x7f197400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f1988ff9640 1 -- 172.21.15.49:0/218590124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1974007b80 con 0x7f198c100630 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c0fef70 con 0x7f198c100630 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f1988ff9640 1 -- 172.21.15.49:0/218590124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19740054e0 con 0x7f198c100630 2024-09-19T09:11:32.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f1988ff9640 1 -- 172.21.15.49:0/218590124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f197400f450 con 0x7f198c100630 2024-09-19T09:11:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.381+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c19d6d0 con 0x7f198c100630 2024-09-19T09:11:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.382+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c100a10 con 0x7f198c100630 2024-09-19T09:11:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.383+0000 7f1988ff9640 1 -- 172.21.15.49:0/218590124 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1974004f60 con 0x7f198c100630 2024-09-19T09:11:32.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.383+0000 7f1988ff9640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f197806e600 0x7f1978070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.383+0000 7f1988ff9640 1 -- 172.21.15.49:0/218590124 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f197408e570 con 0x7f198c100630 2024-09-19T09:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.383+0000 7f198affd640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f197806e600 0x7f1978070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.384+0000 7f198affd640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f197806e600 0x7f1978070ac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f197c009880 tx=0x7f197c004400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:32.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.388+0000 7f1988ff9640 1 -- 172.21.15.49:0/218590124 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1974057630 con 0x7f198c100630 2024-09-19T09:11:32.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.588+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f198c1039c0 con 0x7f197806e600 2024-09-19T09:11:32.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.589+0000 7f1988ff9640 1 -- 172.21.15.49:0/218590124 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f198c1039c0 con 0x7f197806e600 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:11:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph-exporter", 2024-09-19T09:11:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:11:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:11:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "18/23 daemons upgraded", 2024-09-19T09:11:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-19T09:11:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:11:32.592 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:11:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f197806e600 msgr2=0x7f1978070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f197806e600 0x7f1978070ac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f197c009880 tx=0x7f197c004400 comp rx=0 tx=0).stop 2024-09-19T09:11:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c100630 msgr2=0x7f198c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c100630 0x7f198c0fff90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f197400c8f0 tx=0x7f197400cdb0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 shutdown_connections 2024-09-19T09:11:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f197806e600 0x7f1978070ac0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f198c102f60 0x7f198c0fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 --2- 172.21.15.49:0/218590124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f198c100630 0x7f198c0fff90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 >> 172.21.15.49:0/218590124 conn(0x7f198c0fa250 msgr2=0x7f198c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.591+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 shutdown_connections 2024-09-19T09:11:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.592+0000 7f1991e85640 1 -- 172.21.15.49:0/218590124 wait complete. 2024-09-19T09:11:32.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 -- 172.21.15.49:0/2289854601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 msgr2=0x7f4fec102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 --2- 172.21.15.49:0/2289854601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec102a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40098b0 tx=0x7f4fd402a4d0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 -- 172.21.15.49:0/2289854601 shutdown_connections 2024-09-19T09:11:32.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 --2- 172.21.15.49:0/2289854601 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fec102fb0 0x7f4fec1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 --2- 172.21.15.49:0/2289854601 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec102a70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 -- 172.21.15.49:0/2289854601 >> 172.21.15.49:0/2289854601 conn(0x7f4fec0fa280 msgr2=0x7f4fec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:32.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 -- 172.21.15.49:0/2289854601 shutdown_connections 2024-09-19T09:11:32.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 -- 172.21.15.49:0/2289854601 wait complete. 2024-09-19T09:11:32.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.676+0000 7f4ff092e640 1 Processor -- start 2024-09-19T09:11:32.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4ff092e640 1 -- start start 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4ff092e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4ff092e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fec102fb0 0x7f4fec195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4ff092e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec196220 con 0x7f4fec100680 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4ff092e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec196390 con 0x7f4fec102fb0 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fea59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fea59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45354/0 (socket says 172.21.15.49:45354) 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fea59c640 1 -- 172.21.15.49:0/551314271 learned_addr learned my addr 172.21.15.49:0/551314271 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fe9d9b640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fec102fb0 0x7f4fec195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fea59c640 1 -- 172.21.15.49:0/551314271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fec102fb0 msgr2=0x7f4fec195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fea59c640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fec102fb0 0x7f4fec195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fea59c640 1 -- 172.21.15.49:0/551314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4009560 con 0x7f4fec100680 2024-09-19T09:11:32.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.677+0000 7f4fea59c640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec195710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40054f0 tx=0x7f4fd4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:32.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.678+0000 7f4fe37fe640 1 -- 172.21.15.49:0/551314271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd4004aa0 con 0x7f4fec100680 2024-09-19T09:11:32.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.678+0000 7f4fe37fe640 1 -- 172.21.15.49:0/551314271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4fd4004c00 con 0x7f4fec100680 2024-09-19T09:11:32.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.678+0000 7f4fe37fe640 1 -- 172.21.15.49:0/551314271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd4003b10 con 0x7f4fec100680 2024-09-19T09:11:32.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.678+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec19add0 con 0x7f4fec100680 2024-09-19T09:11:32.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.678+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec19b260 con 0x7f4fec100680 2024-09-19T09:11:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.679+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec108830 con 0x7f4fec100680 2024-09-19T09:11:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.679+0000 7f4fe37fe640 1 -- 172.21.15.49:0/551314271 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4fd4003d80 con 0x7f4fec100680 2024-09-19T09:11:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.680+0000 7f4fe37fe640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fd806e5f0 0x7f4fd8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.680+0000 7f4fe37fe640 1 -- 172.21.15.49:0/551314271 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f4fd40af8a0 con 0x7f4fec100680 2024-09-19T09:11:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.680+0000 7f4fe9d9b640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fd806e5f0 0x7f4fd8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:32.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.680+0000 7f4fe9d9b640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fd806e5f0 0x7f4fd8070ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc005fd0 tx=0x7f4fdc005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:32.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.684+0000 7f4fe37fe640 1 -- 172.21.15.49:0/551314271 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4fd4078960 con 0x7f4fec100680 2024-09-19T09:11:32.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.930+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4fec1089c0 con 0x7f4fec100680 2024-09-19T09:11:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:32 smithi049 ceph-mon[91793]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:32 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1069808399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:32 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1545195277' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:11:32.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.931+0000 7f4fe37fe640 1 -- 172.21.15.49:0/551314271 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4fd407c020 con 0x7f4fec100680 2024-09-19T09:11:32.932 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:11:32.932 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:11:32.932 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fd806e5f0 msgr2=0x7f4fd8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fd806e5f0 0x7f4fd8070ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc005fd0 tx=0x7f4fdc005850 comp rx=0 tx=0).stop 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 msgr2=0x7f4fec195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec195710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40054f0 tx=0x7f4fd4005520 comp rx=0 tx=0).stop 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 shutdown_connections 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fd806e5f0 0x7f4fd8070ab0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fec102fb0 0x7f4fec195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 --2- 172.21.15.49:0/551314271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fec100680 0x7f4fec195710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.933+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 >> 172.21.15.49:0/551314271 conn(0x7f4fec0fa280 msgr2=0x7f4fec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.934+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 shutdown_connections 2024-09-19T09:11:32.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:11:32.934+0000 7f4ff092e640 1 -- 172.21.15.49:0/551314271 wait complete. 2024-09-19T09:11:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:32 smithi102 ceph-mon[80875]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:32 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1069808399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:33.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:32 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1545195277' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:11:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:33 smithi049 ceph-mon[91793]: pgmap v252: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:34.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:33 smithi049 ceph-mon[91793]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:34.152 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:33 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/551314271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:11:34.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:33 smithi102 ceph-mon[80875]: pgmap v252: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:34.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:33 smithi102 ceph-mon[80875]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:34.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:33 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/551314271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:11:36.002 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: pgmap v253: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:36.002 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:36.002 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:35 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.131 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: pgmap v253: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:36.131 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.132 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.133 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:35 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:36.981 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:36 smithi049 ceph-mon[91793]: Upgrade: Updating alertmanager.smithi049 2024-09-19T09:11:36.981 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:36 smithi049 ceph-mon[91793]: Deploying daemon alertmanager.smithi049 on smithi049 2024-09-19T09:11:37.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:36 smithi102 ceph-mon[80875]: Upgrade: Updating alertmanager.smithi049 2024-09-19T09:11:37.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:36 smithi102 ceph-mon[80875]: Deploying daemon alertmanager.smithi049 on smithi049 2024-09-19T09:11:38.127 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:37 smithi049 ceph-mon[91793]: pgmap v254: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:38.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:37 smithi102 ceph-mon[80875]: pgmap v254: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:40.252 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:39 smithi049 ceph-mon[91793]: pgmap v255: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:40.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:39 smithi102 ceph-mon[80875]: pgmap v255: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:42.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:41 smithi049 ceph-mon[91793]: pgmap v256: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:42.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:41 smithi102 ceph-mon[80875]: pgmap v256: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:43.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:43.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:43.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:43.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:11:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:11:44.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:44 smithi049 ceph-mon[91793]: pgmap v257: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:44.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:44 smithi102 ceph-mon[80875]: pgmap v257: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:46.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:46 smithi102 ceph-mon[80875]: pgmap v258: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:46 smithi049 ceph-mon[91793]: pgmap v258: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:47.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:47.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:47.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:47 smithi049 ceph-mon[91793]: pgmap v259: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:47.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:47.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:47 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:48.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:48.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:48.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:47 smithi102 ceph-mon[80875]: pgmap v259: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:48.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:48.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:47 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:50.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:49 smithi102 ceph-mon[80875]: pgmap v260: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:50.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:49 smithi049 ceph-mon[91793]: pgmap v260: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:11:51.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:51 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:11:51.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:51.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:51 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:11:52.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:52 smithi049 ceph-mon[91793]: pgmap v261: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:52 smithi102 ceph-mon[80875]: pgmap v261: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:53 smithi049 ceph-mon[91793]: Upgrade: Updating grafana.smithi049 2024-09-19T09:11:53.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:53 smithi049 ceph-mon[91793]: Deploying daemon grafana.smithi049 on smithi049 2024-09-19T09:11:53.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:53 smithi102 ceph-mon[80875]: Upgrade: Updating grafana.smithi049 2024-09-19T09:11:53.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:53 smithi102 ceph-mon[80875]: Deploying daemon grafana.smithi049 on smithi049 2024-09-19T09:11:54.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:54 smithi102 ceph-mon[80875]: pgmap v262: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:54.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:54 smithi049 ceph-mon[91793]: pgmap v262: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:11:56.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:56 smithi102 ceph-mon[80875]: pgmap v263: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:56.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:56 smithi049 ceph-mon[91793]: pgmap v263: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:11:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:58 smithi102 ceph-mon[80875]: pgmap v264: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:11:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:11:58.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:58 smithi049 ceph-mon[91793]: pgmap v264: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:11:58.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:11:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:00.563 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:00 smithi049 ceph-mon[91793]: pgmap v265: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:00 smithi102 ceph-mon[80875]: pgmap v265: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:02.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:02 smithi049 ceph-mon[91793]: pgmap v266: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:02.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:02 smithi102 ceph-mon[80875]: pgmap v266: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:03.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 -- 172.21.15.49:0/449585023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 msgr2=0x7f06c4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/449585023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c4100170 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009880 tx=0x7f06ac02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 -- 172.21.15.49:0/449585023 shutdown_connections 2024-09-19T09:12:03.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/449585023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c4100170 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/449585023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c40feaf0 0x7f06c40feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 -- 172.21.15.49:0/449585023 >> 172.21.15.49:0/449585023 conn(0x7f06c40fa280 msgr2=0x7f06c40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 -- 172.21.15.49:0/449585023 shutdown_connections 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.027+0000 7f06cb1ed640 1 -- 172.21.15.49:0/449585023 wait complete. 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.028+0000 7f06cb1ed640 1 Processor -- start 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.028+0000 7f06cb1ed640 1 -- start start 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.028+0000 7f06cb1ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c40feaf0 0x7f06c40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.028+0000 7f06cb1ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.028+0000 7f06cb1ed640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c419a8d0 con 0x7f06c40ffcf0 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.028+0000 7f06cb1ed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c419aa40 con 0x7f06c40feaf0 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c419a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37096/0 (socket says 172.21.15.49:37096) 2024-09-19T09:12:03.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c3fff640 1 -- 172.21.15.49:0/2916119988 learned_addr learned my addr 172.21.15.49:0/2916119988 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c8f89640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c40feaf0 0x7f06c40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c3fff640 1 -- 172.21.15.49:0/2916119988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c40feaf0 msgr2=0x7f06c40687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c3fff640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c40feaf0 0x7f06c40687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c3fff640 1 -- 172.21.15.49:0/2916119988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac009560 con 0x7f06c40ffcf0 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c3fff640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c419a390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f06ac005610 tx=0x7f06ac005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c1ffb640 1 -- 172.21.15.49:0/2916119988 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ac004ba0 con 0x7f06c40ffcf0 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c419acc0 con 0x7f06c40ffcf0 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c1ffb640 1 -- 172.21.15.49:0/2916119988 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06ac004d00 con 0x7f06c40ffcf0 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.029+0000 7f06c1ffb640 1 -- 172.21.15.49:0/2916119988 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ac003bd0 con 0x7f06c40ffcf0 2024-09-19T09:12:03.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.030+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c419b1b0 con 0x7f06c40ffcf0 2024-09-19T09:12:03.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.031+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c418e670 con 0x7f06c40ffcf0 2024-09-19T09:12:03.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.031+0000 7f06c1ffb640 1 -- 172.21.15.49:0/2916119988 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f06ac031640 con 0x7f06c40ffcf0 2024-09-19T09:12:03.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.032+0000 7f06c1ffb640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f06b006e5f0 0x7f06b0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.032+0000 7f06c1ffb640 1 -- 172.21.15.49:0/2916119988 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f06ac0af9b0 con 0x7f06c40ffcf0 2024-09-19T09:12:03.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.032+0000 7f06c8f89640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f06b006e5f0 0x7f06b0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.032+0000 7f06c8f89640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f06b006e5f0 0x7f06b0070ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f06c4068d10 tx=0x7f06b4007600 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.036+0000 7f06c1ffb640 1 -- 172.21.15.49:0/2916119988 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f06ac078b20 con 0x7f06c40ffcf0 2024-09-19T09:12:03.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.238+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06c402c450 con 0x7f06b006e5f0 2024-09-19T09:12:03.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.239+0000 7f06c1ffb640 1 -- 172.21.15.49:0/2916119988 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f06c402c450 con 0x7f06b006e5f0 2024-09-19T09:12:03.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f06b006e5f0 msgr2=0x7f06b0070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f06b006e5f0 0x7f06b0070ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f06c4068d10 tx=0x7f06b4007600 comp rx=0 tx=0).stop 2024-09-19T09:12:03.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 msgr2=0x7f06c419a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c419a390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f06ac005610 tx=0x7f06ac005640 comp rx=0 tx=0).stop 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 shutdown_connections 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f06b006e5f0 0x7f06b0070ab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06c40ffcf0 0x7f06c419a390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 --2- 172.21.15.49:0/2916119988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06c40feaf0 0x7f06c40687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 >> 172.21.15.49:0/2916119988 conn(0x7f06c40fa280 msgr2=0x7f06c41033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 shutdown_connections 2024-09-19T09:12:03.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.241+0000 7f06cb1ed640 1 -- 172.21.15.49:0/2916119988 wait complete. 2024-09-19T09:12:03.252 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:12:03.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.333+0000 7fd3c8563640 1 -- 172.21.15.49:0/4063313012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 msgr2=0x7fd3c0102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.333+0000 7fd3c8563640 1 --2- 172.21.15.49:0/4063313012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c0102a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0098b0 tx=0x7fd3bc02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 -- 172.21.15.49:0/4063313012 shutdown_connections 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 --2- 172.21.15.49:0/4063313012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c0102f60 0x7fd3c0105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 --2- 172.21.15.49:0/4063313012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c0102a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 -- 172.21.15.49:0/4063313012 >> 172.21.15.49:0/4063313012 conn(0x7fd3c00fa230 msgr2=0x7fd3c00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 -- 172.21.15.49:0/4063313012 shutdown_connections 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 -- 172.21.15.49:0/4063313012 wait complete. 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 Processor -- start 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.334+0000 7fd3c8563640 1 -- start start 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c8563640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c01956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c8563640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c0102f60 0x7fd3c0195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c8563640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01961d0 con 0x7fd3c0100630 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c8563640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0196340 con 0x7fd3c0102f60 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c62ff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c01956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c62ff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c01956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37122/0 (socket says 172.21.15.49:37122) 2024-09-19T09:12:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c62ff640 1 -- 172.21.15.49:0/1753394688 learned_addr learned my addr 172.21.15.49:0/1753394688 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c5afe640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c0102f60 0x7fd3c0195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c62ff640 1 -- 172.21.15.49:0/1753394688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c0102f60 msgr2=0x7fd3c0195c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c62ff640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c0102f60 0x7fd3c0195c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c62ff640 1 -- 172.21.15.49:0/1753394688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc009560 con 0x7fd3c0100630 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.335+0000 7fd3c62ff640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c01956c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0054f0 tx=0x7fd3bc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.336+0000 7fd3b77fe640 1 -- 172.21.15.49:0/1753394688 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc004aa0 con 0x7fd3c0100630 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.336+0000 7fd3b77fe640 1 -- 172.21.15.49:0/1753394688 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3bc004c00 con 0x7fd3c0100630 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.336+0000 7fd3b77fe640 1 -- 172.21.15.49:0/1753394688 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc003ac0 con 0x7fd3c0100630 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.336+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c019ad30 con 0x7fd3c0100630 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.336+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c019b240 con 0x7fd3c0100630 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.337+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c01087e0 con 0x7fd3c0100630 2024-09-19T09:12:03.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.337+0000 7fd3b77fe640 1 -- 172.21.15.49:0/1753394688 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd3bc003d30 con 0x7fd3c0100630 2024-09-19T09:12:03.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.338+0000 7fd3b77fe640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd3ac06e600 0x7fd3ac070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.338+0000 7fd3b77fe640 1 -- 172.21.15.49:0/1753394688 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fd3bc0af8e0 con 0x7fd3c0100630 2024-09-19T09:12:03.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.338+0000 7fd3c5afe640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd3ac06e600 0x7fd3ac070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.339+0000 7fd3c5afe640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd3ac06e600 0x7fd3ac070ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0196b90 tx=0x7fd3b000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.343+0000 7fd3b77fe640 1 -- 172.21.15.49:0/1753394688 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd3bc078a50 con 0x7fd3c0100630 2024-09-19T09:12:03.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.547+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c0103980 con 0x7fd3ac06e600 2024-09-19T09:12:03.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.548+0000 7fd3b77fe640 1 -- 172.21.15.49:0/1753394688 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fd3c0103980 con 0x7fd3ac06e600 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.550+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd3ac06e600 msgr2=0x7fd3ac070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.550+0000 7fd3c8563640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd3ac06e600 0x7fd3ac070ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0196b90 tx=0x7fd3b000b390 comp rx=0 tx=0).stop 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.550+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 msgr2=0x7fd3c01956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.550+0000 7fd3c8563640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c01956c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0054f0 tx=0x7fd3bc005520 comp rx=0 tx=0).stop 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.551+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 shutdown_connections 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.551+0000 7fd3c8563640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd3ac06e600 0x7fd3ac070ac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.551+0000 7fd3c8563640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c0102f60 0x7fd3c0195c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.551+0000 7fd3c8563640 1 --2- 172.21.15.49:0/1753394688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd3c0100630 0x7fd3c01956c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.551+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 >> 172.21.15.49:0/1753394688 conn(0x7fd3c00fa230 msgr2=0x7fd3c00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.551+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 shutdown_connections 2024-09-19T09:12:03.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.551+0000 7fd3c8563640 1 -- 172.21.15.49:0/1753394688 wait complete. 2024-09-19T09:12:03.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 -- 172.21.15.49:0/86990991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 msgr2=0x7f10f8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/86990991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 0x7f10f8101210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00fae0 tx=0x7f10ec02e570 comp rx=0 tx=0).stop 2024-09-19T09:12:03.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 -- 172.21.15.49:0/86990991 shutdown_connections 2024-09-19T09:12:03.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/86990991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 0x7f10f8101210 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/86990991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 0x7f10f80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 -- 172.21.15.49:0/86990991 >> 172.21.15.49:0/86990991 conn(0x7f10f80fb360 msgr2=0x7f10f80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 -- 172.21.15.49:0/86990991 shutdown_connections 2024-09-19T09:12:03.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.638+0000 7f10fd4fe640 1 -- 172.21.15.49:0/86990991 wait complete. 2024-09-19T09:12:03.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10fd4fe640 1 Processor -- start 2024-09-19T09:12:03.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10fd4fe640 1 -- start start 2024-09-19T09:12:03.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10fd4fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 0x7f10f8193390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10fd4fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 0x7f10f81938d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10fd4fe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8193ea0 con 0x7f10f80ffb90 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10fd4fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8194010 con 0x7f10f8100d90 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 0x7f10f8193390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 0x7f10f8193390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37150/0 (socket says 172.21.15.49:37150) 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10f6ffd640 1 -- 172.21.15.49:0/9864740 learned_addr learned my addr 172.21.15.49:0/9864740 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.639+0000 7f10f67fc640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 0x7f10f81938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10f6ffd640 1 -- 172.21.15.49:0/9864740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 msgr2=0x7f10f81938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10f6ffd640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 0x7f10f81938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10f6ffd640 1 -- 172.21.15.49:0/9864740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8009560 con 0x7f10f80ffb90 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10f6ffd640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 0x7f10f8193390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e950 tx=0x7f10e800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10dffff640 1 -- 172.21.15.49:0/9864740 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10e800cd50 con 0x7f10f80ffb90 2024-09-19T09:12:03.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10dffff640 1 -- 172.21.15.49:0/9864740 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10e800ceb0 con 0x7f10f80ffb90 2024-09-19T09:12:03.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec00f790 con 0x7f10f80ffb90 2024-09-19T09:12:03.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10dffff640 1 -- 172.21.15.49:0/9864740 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10e8018930 con 0x7f10f80ffb90 2024-09-19T09:12:03.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.640+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f8198e20 con 0x7f10f80ffb90 2024-09-19T09:12:03.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.642+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f81065b0 con 0x7f10f80ffb90 2024-09-19T09:12:03.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.642+0000 7f10dffff640 1 -- 172.21.15.49:0/9864740 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f10e8018bf0 con 0x7f10f80ffb90 2024-09-19T09:12:03.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.643+0000 7f10dffff640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f10e006e600 0x7f10e0070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.643+0000 7f10dffff640 1 -- 172.21.15.49:0/9864740 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f10e8014070 con 0x7f10f80ffb90 2024-09-19T09:12:03.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.643+0000 7f10f67fc640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f10e006e600 0x7f10e0070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.643+0000 7f10f67fc640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f10e006e600 0x7f10e0070ac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10f81948b0 tx=0x7f10ec034870 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.647+0000 7f10dffff640 1 -- 172.21.15.49:0/9864740 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f10e8057dc0 con 0x7f10f80ffb90 2024-09-19T09:12:03.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.856+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10f8199070 con 0x7f10e006e600 2024-09-19T09:12:03.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.867+0000 7f10dffff640 1 -- 172.21.15.49:0/9864740 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f10f8199070 con 0x7f10e006e600 2024-09-19T09:12:03.869 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:12:03.869 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (22s) 17s ago 17m 16.9M - 0.25.0 c8568f914cd2 c4127e2a6a36 2024-09-19T09:12:03.869 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (78s) 17s ago 17m 8434k - 19.1.1-361-g2f599a46 d2baa855c067 b236633deeab 2024-09-19T09:12:03.869 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (68s) 50s ago 16m 8292k - 19.1.1-361-g2f599a46 d2baa855c067 6f4f65bf81b8 2024-09-19T09:12:03.869 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 17s ago 17m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:12:03.870 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (6m) 50s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:12:03.870 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 starting - - - - 2024-09-19T09:12:03.870 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (2m) 17s ago 12m 87.1M - 19.1.1-361-g2f599a46 d2baa855c067 3860d60c0271 2024-09-19T09:12:03.870 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (2m) 17s ago 12m 20.8M - 19.1.1-361-g2f599a46 d2baa855c067 633df85b1957 2024-09-19T09:12:03.870 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (92s) 50s ago 12m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 3766d06b2add 2024-09-19T09:12:03.870 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (106s) 50s ago 12m 87.9M - 19.1.1-361-g2f599a46 d2baa855c067 5257da592c71 2024-09-19T09:12:03.870 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (9m) 17s ago 18m 511M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:12:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (7m) 50s ago 16m 443M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:12:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (7m) 17s ago 19m 57.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:12:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (7m) 50s ago 16m 42.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:12:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (56s) 17s ago 17m 8270k - 1.5.0 0da6a335fe13 fed7048a29b5 2024-09-19T09:12:03.871 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (52s) 50s ago 16m 3611k - 1.5.0 0da6a335fe13 be690cc5c2ad 2024-09-19T09:12:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 17s ago 15m 109M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:12:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 17s ago 15m 107M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:12:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 17s ago 14m 104M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:12:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (4m) 50s ago 14m 121M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:12:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (3m) 50s ago 14m 87.1M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:12:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (3m) 50s ago 13m 86.2M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:12:03.872 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (37s) 17s ago 17m 47.0M - 2.43.0 a07b618ecd1d 0ee729414142 2024-09-19T09:12:03.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f10e006e600 msgr2=0x7f10e0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f10e006e600 0x7f10e0070ac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10f81948b0 tx=0x7f10ec034870 comp rx=0 tx=0).stop 2024-09-19T09:12:03.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 msgr2=0x7f10f8193390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 0x7f10f8193390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e950 tx=0x7f10e800ee10 comp rx=0 tx=0).stop 2024-09-19T09:12:03.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 shutdown_connections 2024-09-19T09:12:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f10e006e600 0x7f10e0070ac0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10f8100d90 0x7f10f81938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 --2- 172.21.15.49:0/9864740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10f80ffb90 0x7f10f8193390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 >> 172.21.15.49:0/9864740 conn(0x7f10f80fb360 msgr2=0x7f10f80fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 shutdown_connections 2024-09-19T09:12:03.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.870+0000 7f10fd4fe640 1 -- 172.21.15.49:0/9864740 wait complete. 2024-09-19T09:12:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 -- 172.21.15.49:0/4193856347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0feaf0 msgr2=0x7fc9ac0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 --2- 172.21.15.49:0/4193856347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0feaf0 0x7fc9ac0feef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009880 tx=0x7fc9a002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 -- 172.21.15.49:0/4193856347 shutdown_connections 2024-09-19T09:12:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 --2- 172.21.15.49:0/4193856347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ac0ffcf0 0x7fc9ac100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 --2- 172.21.15.49:0/4193856347 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0feaf0 0x7fc9ac0feef0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 -- 172.21.15.49:0/4193856347 >> 172.21.15.49:0/4193856347 conn(0x7fc9ac0fa280 msgr2=0x7fc9ac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 -- 172.21.15.49:0/4193856347 shutdown_connections 2024-09-19T09:12:03.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.959+0000 7fc9b1761640 1 -- 172.21.15.49:0/4193856347 wait complete. 2024-09-19T09:12:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.960+0000 7fc9b1761640 1 Processor -- start 2024-09-19T09:12:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.960+0000 7fc9b1761640 1 -- start start 2024-09-19T09:12:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.960+0000 7fc9b1761640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ac0feaf0 0x7fc9ac193470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.960+0000 7fc9b1761640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0ffcf0 0x7fc9ac1939b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.960+0000 7fc9b1761640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac193f80 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.960+0000 7fc9b1761640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac1940f0 con 0x7fc9ac0feaf0 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0ffcf0 0x7fc9ac1939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ac0feaf0 0x7fc9ac193470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ac0feaf0 0x7fc9ac193470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.49:44698/0 (socket says 172.21.15.49:44698) 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0ffcf0 0x7fc9ac1939b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37174/0 (socket says 172.21.15.49:37174) 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aaffd640 1 -- 172.21.15.49:0/2250142188 learned_addr learned my addr 172.21.15.49:0/2250142188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aa7fc640 1 -- 172.21.15.49:0/2250142188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ac0feaf0 msgr2=0x7fc9ac193470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aa7fc640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ac0feaf0 0x7fc9ac193470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aa7fc640 1 -- 172.21.15.49:0/2250142188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0009560 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc9aa7fc640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0ffcf0 0x7fc9ac1939b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00ba20 tx=0x7fc99c00bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.961+0000 7fc993fff640 1 -- 172.21.15.49:0/2250142188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc99c015040 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.962+0000 7fc993fff640 1 -- 172.21.15.49:0/2250142188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc99c019420 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.962+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac198b90 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.962+0000 7fc993fff640 1 -- 172.21.15.49:0/2250142188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc99c0095e0 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.962+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac1990e0 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.963+0000 7fc993fff640 1 -- 172.21.15.49:0/2250142188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc99c007b30 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.964+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac18d560 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.964+0000 7fc993fff640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc99406e600 0x7fc994070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.964+0000 7fc993fff640 1 -- 172.21.15.49:0/2250142188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fc99c092910 con 0x7fc9ac0ffcf0 2024-09-19T09:12:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.964+0000 7fc9aaffd640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc99406e600 0x7fc994070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.965+0000 7fc9aaffd640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc99406e600 0x7fc994070ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0000c00 tx=0x7fc9a00314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:03.969+0000 7fc993fff640 1 -- 172.21.15.49:0/2250142188 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc99c05b970 con 0x7fc9ac0ffcf0 2024-09-19T09:12:04.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.290+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9ac02c3e0 con 0x7fc9ac0ffcf0 2024-09-19T09:12:04.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.291+0000 7fc993fff640 1 -- 172.21.15.49:0/2250142188 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc99c05f030 con 0x7fc9ac0ffcf0 2024-09-19T09:12:04.292 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:12:04.292 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:12:04.292 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:12:04.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:04.292 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:12:04.293 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:12:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc99406e600 msgr2=0x7fc994070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc99406e600 0x7fc994070ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0000c00 tx=0x7fc9a00314e0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0ffcf0 msgr2=0x7fc9ac1939b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0ffcf0 0x7fc9ac1939b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00ba20 tx=0x7fc99c00bee0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 shutdown_connections 2024-09-19T09:12:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc99406e600 0x7fc994070ac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9ac0ffcf0 0x7fc9ac1939b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 --2- 172.21.15.49:0/2250142188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ac0feaf0 0x7fc9ac193470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 >> 172.21.15.49:0/2250142188 conn(0x7fc9ac0fa280 msgr2=0x7fc9ac103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 shutdown_connections 2024-09-19T09:12:04.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.294+0000 7fc9b1761640 1 -- 172.21.15.49:0/2250142188 wait complete. 2024-09-19T09:12:04.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 -- 172.21.15.49:0/3281489919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4100680 msgr2=0x7f64b4102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 --2- 172.21.15.49:0/3281489919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4100680 0x7f64b4102a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f64a80098b0 tx=0x7f64a802a4d0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 -- 172.21.15.49:0/3281489919 shutdown_connections 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 --2- 172.21.15.49:0/3281489919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b4102fb0 0x7f64b41053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 --2- 172.21.15.49:0/3281489919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4100680 0x7f64b4102a70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 -- 172.21.15.49:0/3281489919 >> 172.21.15.49:0/3281489919 conn(0x7f64b40fa280 msgr2=0x7f64b40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 -- 172.21.15.49:0/3281489919 shutdown_connections 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.381+0000 7f64badd2640 1 -- 172.21.15.49:0/3281489919 wait complete. 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64badd2640 1 Processor -- start 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64badd2640 1 -- start start 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64badd2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b4100680 0x7f64b4197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64badd2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4102fb0 0x7f64b4197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64badd2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4198380 con 0x7f64b4102fb0 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64badd2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b41984f0 con 0x7f64b4100680 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4102fb0 0x7f64b4197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4102fb0 0x7f64b4197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37180/0 (socket says 172.21.15.49:37180) 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64b3fff640 1 -- 172.21.15.49:0/3228370582 learned_addr learned my addr 172.21.15.49:0/3228370582 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.382+0000 7f64b8b6e640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b4100680 0x7f64b4197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64b3fff640 1 -- 172.21.15.49:0/3228370582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b4100680 msgr2=0x7f64b4197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64b3fff640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b4100680 0x7f64b4197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64b3fff640 1 -- 172.21.15.49:0/3228370582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a8009560 con 0x7f64b4102fb0 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64b3fff640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4102fb0 0x7f64b4197e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c8f0 tx=0x7f64a000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64b1ffb640 1 -- 172.21.15.49:0/3228370582 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a0004410 con 0x7f64b4102fb0 2024-09-19T09:12:04.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64b1ffb640 1 -- 172.21.15.49:0/3228370582 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64a0007c60 con 0x7f64b4102fb0 2024-09-19T09:12:04.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b419cfd0 con 0x7f64b4102fb0 2024-09-19T09:12:04.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64b1ffb640 1 -- 172.21.15.49:0/3228370582 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a000f450 con 0x7f64b4102fb0 2024-09-19T09:12:04.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.383+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b419d4a0 con 0x7f64b4102fb0 2024-09-19T09:12:04.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.384+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b4108810 con 0x7f64b4102fb0 2024-09-19T09:12:04.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.385+0000 7f64b1ffb640 1 -- 172.21.15.49:0/3228370582 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f64a00077a0 con 0x7f64b4102fb0 2024-09-19T09:12:04.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.386+0000 7f64b1ffb640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f64a406e640 0x7f64a4070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.386+0000 7f64b1ffb640 1 -- 172.21.15.49:0/3228370582 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f64a008e830 con 0x7f64b4102fb0 2024-09-19T09:12:04.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.389+0000 7f64b8b6e640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f64a406e640 0x7f64a4070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.389+0000 7f64b8b6e640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f64a406e640 0x7f64a4070b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006010 tx=0x7f64a8005b50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:04.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.392+0000 7f64b1ffb640 1 -- 172.21.15.49:0/3228370582 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f64a00577d0 con 0x7f64b4102fb0 2024-09-19T09:12:04.542 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:04 smithi049 ceph-mon[91793]: pgmap v267: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:04.542 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:04 smithi049 ceph-mon[91793]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:04.542 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:04.542 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:04.542 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:04 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:04.542 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:04 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2250142188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:04.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.650+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f64b41089f0 con 0x7f64b4102fb0 2024-09-19T09:12:04.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.651+0000 7f64b1ffb640 1 -- 172.21.15.49:0/3228370582 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+2003 (secure 0 0 0) 0x7f64a005ae90 con 0x7f64b4102fb0 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:e42 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-19T09:10:40:827552+0000 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:12:04.653 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 42 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:10:40.827533+0000 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 91 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:12:04.654 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=34416,1=34448} 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:12:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-19T09:12:04.656 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:12:04.656 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{0:44371} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6824/4160337930,v1:172.21.15.102:6825/4160337930] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:12:04.656 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{1:34448} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:12:04.656 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:44401} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6826/801204290,v1:172.21.15.102:6827/801204290] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:12:04.656 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:12:04.656 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f64a406e640 msgr2=0x7f64a4070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f64a406e640 0x7f64a4070b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006010 tx=0x7f64a8005b50 comp rx=0 tx=0).stop 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4102fb0 msgr2=0x7f64b4197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4102fb0 0x7f64b4197e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c8f0 tx=0x7f64a000cdb0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 shutdown_connections 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f64a406e640 0x7f64a4070b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64b4102fb0 0x7f64b4197e40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 --2- 172.21.15.49:0/3228370582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b4100680 0x7f64b4197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 >> 172.21.15.49:0/3228370582 conn(0x7f64b40fa280 msgr2=0x7f64b40ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 shutdown_connections 2024-09-19T09:12:04.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.654+0000 7f64badd2640 1 -- 172.21.15.49:0/3228370582 wait complete. 2024-09-19T09:12:04.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 -- 172.21.15.49:0/2331348440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 msgr2=0x7fbce40fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/2331348440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce40fff90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009880 tx=0x7fbcd402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 -- 172.21.15.49:0/2331348440 shutdown_connections 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/2331348440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbce4100d90 0x7fbce4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/2331348440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce40fff90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 -- 172.21.15.49:0/2331348440 >> 172.21.15.49:0/2331348440 conn(0x7fbce40fb320 msgr2=0x7fbce40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 -- 172.21.15.49:0/2331348440 shutdown_connections 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.748+0000 7fbce8fa1640 1 -- 172.21.15.49:0/2331348440 wait complete. 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce8fa1640 1 Processor -- start 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce8fa1640 1 -- start start 2024-09-19T09:12:04.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce8fa1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce4074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce8fa1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbce4100d90 0x7fbce40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce8fa1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4072de0 con 0x7fbce40ffb90 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce8fa1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4072f50 con 0x7fbce4100d90 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce4074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce4074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37212/0 (socket says 172.21.15.49:37212) 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce259c640 1 -- 172.21.15.49:0/4055033518 learned_addr learned my addr 172.21.15.49:0/4055033518 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce1d9b640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbce4100d90 0x7fbce40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce259c640 1 -- 172.21.15.49:0/4055033518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbce4100d90 msgr2=0x7fbce40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce259c640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbce4100d90 0x7fbce40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.749+0000 7fbce259c640 1 -- 172.21.15.49:0/4055033518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd4009560 con 0x7fbce40ffb90 2024-09-19T09:12:04.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.750+0000 7fbce259c640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce4074250 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009230 tx=0x7fbcd40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:04.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.750+0000 7fbcd37fe640 1 -- 172.21.15.49:0/4055033518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcd4004aa0 con 0x7fbce40ffb90 2024-09-19T09:12:04.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.750+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce40731d0 con 0x7fbce40ffb90 2024-09-19T09:12:04.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.750+0000 7fbcd37fe640 1 -- 172.21.15.49:0/4055033518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcd4004c00 con 0x7fbce40ffb90 2024-09-19T09:12:04.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.750+0000 7fbcd37fe640 1 -- 172.21.15.49:0/4055033518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcd4003b50 con 0x7fbce40ffb90 2024-09-19T09:12:04.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.750+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce419d6d0 con 0x7fbce40ffb90 2024-09-19T09:12:04.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.751+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce40fff90 con 0x7fbce40ffb90 2024-09-19T09:12:04.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.751+0000 7fbcd37fe640 1 -- 172.21.15.49:0/4055033518 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbcd4003d50 con 0x7fbce40ffb90 2024-09-19T09:12:04.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.752+0000 7fbcd37fe640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbccc06e600 0x7fbccc070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.752+0000 7fbcd37fe640 1 -- 172.21.15.49:0/4055033518 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fbcd40af990 con 0x7fbce40ffb90 2024-09-19T09:12:04.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.752+0000 7fbce1d9b640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbccc06e600 0x7fbccc070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.753+0000 7fbce1d9b640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbccc06e600 0x7fbccc070ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbce4073fd0 tx=0x7fbcd800a4c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.756+0000 7fbcd37fe640 1 -- 172.21.15.49:0/4055033518 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbcd40789d0 con 0x7fbce40ffb90 2024-09-19T09:12:04.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:04 smithi102 ceph-mon[80875]: pgmap v267: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:04.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:04 smithi102 ceph-mon[80875]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:04.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:04 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:04 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2250142188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:04.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.952+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbce40608f0 con 0x7fbccc06e600 2024-09-19T09:12:04.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.953+0000 7fbcd37fe640 1 -- 172.21.15.49:0/4055033518 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fbce40608f0 con 0x7fbccc06e600 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph-exporter", 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-09-19T09:12:04.955 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-19T09:12:04.956 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "18/23 daemons upgraded", 2024-09-19T09:12:04.956 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading grafana daemons", 2024-09-19T09:12:04.956 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:12:04.956 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:12:04.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.955+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbccc06e600 msgr2=0x7fbccc070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.955+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbccc06e600 0x7fbccc070ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbce4073fd0 tx=0x7fbcd800a4c0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.955+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 msgr2=0x7fbce4074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.955+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce4074250 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009230 tx=0x7fbcd40055a0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.956+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 shutdown_connections 2024-09-19T09:12:04.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.956+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbccc06e600 0x7fbccc070ac0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.956+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbce4100d90 0x7fbce40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.956+0000 7fbce8fa1640 1 --2- 172.21.15.49:0/4055033518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbce40ffb90 0x7fbce4074250 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.956+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 >> 172.21.15.49:0/4055033518 conn(0x7fbce40fb320 msgr2=0x7fbce4104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.956+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 shutdown_connections 2024-09-19T09:12:04.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:04.956+0000 7fbce8fa1640 1 -- 172.21.15.49:0/4055033518 wait complete. 2024-09-19T09:12:05.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 -- 172.21.15.49:0/2016324445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fd910 msgr2=0x7f021c0fdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:05.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2016324445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fd910 0x7f021c0fdd10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0214009c20 tx=0x7f021402a970 comp rx=0 tx=0).stop 2024-09-19T09:12:05.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 -- 172.21.15.49:0/2016324445 shutdown_connections 2024-09-19T09:12:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2016324445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f021c0fe250 0x7f021c105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2016324445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fd910 0x7f021c0fdd10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 -- 172.21.15.49:0/2016324445 >> 172.21.15.49:0/2016324445 conn(0x7f021c0f9540 msgr2=0x7f021c0fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 -- 172.21.15.49:0/2016324445 shutdown_connections 2024-09-19T09:12:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.043+0000 7f0220a7c640 1 -- 172.21.15.49:0/2016324445 wait complete. 2024-09-19T09:12:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.044+0000 7f0220a7c640 1 Processor -- start 2024-09-19T09:12:05.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.044+0000 7f0220a7c640 1 -- start start 2024-09-19T09:12:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.044+0000 7f0220a7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f021c0fd910 0x7f021c195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.044+0000 7f0220a7c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fe250 0x7f021c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.044+0000 7f0220a7c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c196130 con 0x7f021c0fe250 2024-09-19T09:12:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.044+0000 7f0220a7c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1962a0 con 0x7f021c0fd910 2024-09-19T09:12:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f0219d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fe250 0x7f021c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f0219d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fe250 0x7f021c195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37236/0 (socket says 172.21.15.49:37236) 2024-09-19T09:12:05.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f0219d9b640 1 -- 172.21.15.49:0/2964203077 learned_addr learned my addr 172.21.15.49:0/2964203077 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f021a59c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f021c0fd910 0x7f021c195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f0219d9b640 1 -- 172.21.15.49:0/2964203077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f021c0fd910 msgr2=0x7f021c195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f0219d9b640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f021c0fd910 0x7f021c195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f0219d9b640 1 -- 172.21.15.49:0/2964203077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214009900 con 0x7f021c0fe250 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f021a59c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f021c0fd910 0x7f021c195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f0219d9b640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fe250 0x7f021c195b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f020400d6f0 tx=0x7f020400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.045+0000 7f02137fe640 1 -- 172.21.15.49:0/2964203077 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02040099f0 con 0x7f021c0fe250 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.046+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c19ad40 con 0x7f021c0fe250 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.046+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c19b310 con 0x7f021c0fe250 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.046+0000 7f02137fe640 1 -- 172.21.15.49:0/2964203077 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0204009b50 con 0x7f021c0fe250 2024-09-19T09:12:05.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.046+0000 7f02137fe640 1 -- 172.21.15.49:0/2964203077 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020400f710 con 0x7f021c0fe250 2024-09-19T09:12:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.047+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01fc005280 con 0x7f021c0fe250 2024-09-19T09:12:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.048+0000 7f02137fe640 1 -- 172.21.15.49:0/2964203077 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f020400f870 con 0x7f021c0fe250 2024-09-19T09:12:05.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.049+0000 7f02137fe640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f020806e630 0x7f0208070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:05.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.049+0000 7f02137fe640 1 -- 172.21.15.49:0/2964203077 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f020408e530 con 0x7f021c0fe250 2024-09-19T09:12:05.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.049+0000 7f021a59c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f020806e630 0x7f0208070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:05.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.049+0000 7f021a59c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f020806e630 0x7f0208070af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f021402fd20 tx=0x7f0214009860 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:05.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.053+0000 7f02137fe640 1 -- 172.21.15.49:0/2964203077 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f020405b0a0 con 0x7f021c0fe250 2024-09-19T09:12:05.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.320+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f01fc0050f0 con 0x7f021c0fe250 2024-09-19T09:12:05.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.320+0000 7f02137fe640 1 -- 172.21.15.49:0/2964203077 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f020405ac30 con 0x7f021c0fe250 2024-09-19T09:12:05.322 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:12:05.322 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:12:05.322 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:12:05.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f020806e630 msgr2=0x7f0208070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:05.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f020806e630 0x7f0208070af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f021402fd20 tx=0x7f0214009860 comp rx=0 tx=0).stop 2024-09-19T09:12:05.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fe250 msgr2=0x7f021c195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:05.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fe250 0x7f021c195b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f020400d6f0 tx=0x7f020400dbb0 comp rx=0 tx=0).stop 2024-09-19T09:12:05.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 shutdown_connections 2024-09-19T09:12:05.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f020806e630 0x7f0208070af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:05.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f021c0fe250 0x7f021c195b60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:05.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 --2- 172.21.15.49:0/2964203077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f021c0fd910 0x7f021c195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:05.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.322+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 >> 172.21.15.49:0/2964203077 conn(0x7f021c0f9540 msgr2=0x7f021c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:05.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.323+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 shutdown_connections 2024-09-19T09:12:05.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:05.323+0000 7f0220a7c640 1 -- 172.21.15.49:0/2964203077 wait complete. 2024-09-19T09:12:05.583 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:05 smithi049 ceph-mon[91793]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:05.583 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:05 smithi049 ceph-mon[91793]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:05.584 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:05 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3228370582' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:12:05.584 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:05 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2964203077' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:12:05.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:05 smithi102 ceph-mon[80875]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:05 smithi102 ceph-mon[80875]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:05 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3228370582' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:12:05.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:05 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2964203077' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:12:06.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:06 smithi102 ceph-mon[80875]: pgmap v268: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:06.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:06 smithi102 ceph-mon[80875]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:06 smithi049 ceph-mon[91793]: pgmap v268: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:06 smithi049 ceph-mon[91793]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:08 smithi102 ceph-mon[80875]: pgmap v269: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:08 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:08.802 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:08 smithi049 ceph-mon[91793]: pgmap v269: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:08 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:10.051 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:09 smithi049 ceph-mon[91793]: pgmap v270: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:10.051 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:10.051 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:09 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:09 smithi102 ceph-mon[80875]: pgmap v270: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:09 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:12.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:11 smithi102 ceph-mon[80875]: pgmap v271: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:12.260 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:11 smithi049 ceph-mon[91793]: pgmap v271: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:13.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.555 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: Upgrade: Finalizing container_image settings 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-19T09:12:13.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T09:12:13.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: Upgrade: Complete! 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:13.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:13.559 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.559 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:13.559 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.559 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:13.559 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:13.559 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:13.559 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:13.761 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: Upgrade: Finalizing container_image settings 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-19T09:12:13.762 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T09:12:13.763 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: Upgrade: Complete! 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:13.764 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:13.765 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:12:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:14 smithi102 ceph-mon[80875]: pgmap v272: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:14 smithi049 ceph-mon[91793]: pgmap v272: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:16.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:16 smithi102 ceph-mon[80875]: pgmap v273: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:16 smithi049 ceph-mon[91793]: pgmap v273: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:18 smithi102 ceph-mon[80875]: pgmap v274: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:18 smithi049 ceph-mon[91793]: pgmap v274: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:20 smithi102 ceph-mon[80875]: pgmap v275: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:20 smithi049 ceph-mon[91793]: pgmap v275: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:22.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:22 smithi049 ceph-mon[91793]: pgmap v276: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:22 smithi102 ceph-mon[80875]: pgmap v276: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:24.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:24 smithi049 ceph-mon[91793]: pgmap v277: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:25.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:24 smithi102 ceph-mon[80875]: pgmap v277: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:26.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:26 smithi049 ceph-mon[91793]: pgmap v278: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:27.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:26 smithi102 ceph-mon[80875]: pgmap v278: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:28 smithi049 ceph-mon[91793]: pgmap v279: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:29.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:28 smithi102 ceph-mon[80875]: pgmap v279: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:29.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:30 smithi049 ceph-mon[91793]: pgmap v280: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:31.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:30 smithi102 ceph-mon[80875]: pgmap v280: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:31.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:31 smithi049 ceph-mon[91793]: pgmap v281: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:32.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:31 smithi102 ceph-mon[80875]: pgmap v281: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:33.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:33 smithi049 ceph-mon[91793]: pgmap v282: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:34.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:33 smithi102 ceph-mon[80875]: pgmap v282: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 -- 172.21.15.49:0/2379740615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280ffcf0 msgr2=0x7fc028100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 --2- 172.21.15.49:0/2379740615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280ffcf0 0x7fc028100170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009880 tx=0x7fc01c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 -- 172.21.15.49:0/2379740615 shutdown_connections 2024-09-19T09:12:35.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 --2- 172.21.15.49:0/2379740615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280ffcf0 0x7fc028100170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 --2- 172.21.15.49:0/2379740615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0280feaf0 0x7fc0280feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 -- 172.21.15.49:0/2379740615 >> 172.21.15.49:0/2379740615 conn(0x7fc0280fa280 msgr2=0x7fc0280fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 -- 172.21.15.49:0/2379740615 shutdown_connections 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.421+0000 7fc02e14b640 1 -- 172.21.15.49:0/2379740615 wait complete. 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.422+0000 7fc02e14b640 1 Processor -- start 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.422+0000 7fc02e14b640 1 -- start start 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.422+0000 7fc02e14b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280feaf0 0x7fc0281978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.422+0000 7fc02e14b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0280ffcf0 0x7fc028197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.422+0000 7fc02e14b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0281983c0 con 0x7fc0280feaf0 2024-09-19T09:12:35.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.422+0000 7fc02e14b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc028198530 con 0x7fc0280ffcf0 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.422+0000 7fc0277fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280feaf0 0x7fc0281978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc0277fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280feaf0 0x7fc0281978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56580/0 (socket says 172.21.15.49:56580) 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc0277fe640 1 -- 172.21.15.49:0/1822020194 learned_addr learned my addr 172.21.15.49:0/1822020194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc026ffd640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0280ffcf0 0x7fc028197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc0277fe640 1 -- 172.21.15.49:0/1822020194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0280ffcf0 msgr2=0x7fc028197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc0277fe640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0280ffcf0 0x7fc028197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc0277fe640 1 -- 172.21.15.49:0/1822020194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c009560 con 0x7fc0280feaf0 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc026ffd640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0280ffcf0 0x7fc028197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc0277fe640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280feaf0 0x7fc0281978b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc01800d720 tx=0x7fc01800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc024ff9640 1 -- 172.21.15.49:0/1822020194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0180041f0 con 0x7fc0280feaf0 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc024ff9640 1 -- 172.21.15.49:0/1822020194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc018004350 con 0x7fc0280feaf0 2024-09-19T09:12:35.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02819cfd0 con 0x7fc0280feaf0 2024-09-19T09:12:35.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc024ff9640 1 -- 172.21.15.49:0/1822020194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc018003df0 con 0x7fc0280feaf0 2024-09-19T09:12:35.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.423+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02819d490 con 0x7fc0280feaf0 2024-09-19T09:12:35.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.425+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0280feef0 con 0x7fc0280feaf0 2024-09-19T09:12:35.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.425+0000 7fc024ff9640 1 -- 172.21.15.49:0/1822020194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc0180035f0 con 0x7fc0280feaf0 2024-09-19T09:12:35.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.425+0000 7fc024ff9640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc01006e590 0x7fc010070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.426+0000 7fc024ff9640 1 -- 172.21.15.49:0/1822020194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fc01808e260 con 0x7fc0280feaf0 2024-09-19T09:12:35.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.426+0000 7fc026ffd640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc01006e590 0x7fc010070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.426+0000 7fc026ffd640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc01006e590 0x7fc010070a50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000c00 tx=0x7fc01c0314e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:35.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.430+0000 7fc024ff9640 1 -- 172.21.15.49:0/1822020194 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc0180572a0 con 0x7fc0280feaf0 2024-09-19T09:12:35.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.627+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0280683b0 con 0x7fc01006e590 2024-09-19T09:12:35.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.628+0000 7fc024ff9640 1 -- 172.21.15.49:0/1822020194 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc0280683b0 con 0x7fc01006e590 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc01006e590 msgr2=0x7fc010070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc01006e590 0x7fc010070a50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000c00 tx=0x7fc01c0314e0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280feaf0 msgr2=0x7fc0281978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280feaf0 0x7fc0281978b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc01800d720 tx=0x7fc01800dbe0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 shutdown_connections 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fc01006e590 0x7fc010070a50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0280ffcf0 0x7fc028197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 --2- 172.21.15.49:0/1822020194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0280feaf0 0x7fc0281978b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.630+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 >> 172.21.15.49:0/1822020194 conn(0x7fc0280fa280 msgr2=0x7fc028067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.631+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 shutdown_connections 2024-09-19T09:12:35.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:35.631+0000 7fc02e14b640 1 -- 172.21.15.49:0/1822020194 wait complete. 2024-09-19T09:12:35.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:35 smithi049 ceph-mon[91793]: pgmap v283: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:36.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:35 smithi102 ceph-mon[80875]: pgmap v283: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:36.376 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T09:12:36.630 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:12:36.948 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:36 smithi049 ceph-mon[91793]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:37.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:36 smithi102 ceph-mon[80875]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:37.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:37 smithi049 ceph-mon[91793]: pgmap v284: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:38.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:37 smithi102 ceph-mon[80875]: pgmap v284: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 -- 172.21.15.49:0/3258598127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 msgr2=0x7f7e14104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 --2- 172.21.15.49:0/3258598127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e14104df0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009880 tx=0x7f7e0402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 -- 172.21.15.49:0/3258598127 shutdown_connections 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 --2- 172.21.15.49:0/3258598127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e140fea10 0x7f7e140fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 --2- 172.21.15.49:0/3258598127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e14104df0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 -- 172.21.15.49:0/3258598127 >> 172.21.15.49:0/3258598127 conn(0x7f7e140fa730 msgr2=0x7f7e140fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 -- 172.21.15.49:0/3258598127 shutdown_connections 2024-09-19T09:12:38.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.198+0000 7f7e1932c640 1 -- 172.21.15.49:0/3258598127 wait complete. 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.199+0000 7f7e1932c640 1 Processor -- start 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.199+0000 7f7e1932c640 1 -- start start 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.199+0000 7f7e1932c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e140fea10 0x7f7e140fb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.199+0000 7f7e1932c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e140fb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.199+0000 7f7e1932c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140fbab0 con 0x7f7e14104a10 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.199+0000 7f7e1932c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140fbc20 con 0x7f7e140fea10 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e127fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e140fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e127fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e140fb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56608/0 (socket says 172.21.15.49:56608) 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e127fc640 1 -- 172.21.15.49:0/1216080589 learned_addr learned my addr 172.21.15.49:0/1216080589 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e12ffd640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e140fea10 0x7f7e140fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e127fc640 1 -- 172.21.15.49:0/1216080589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e140fea10 msgr2=0x7f7e140fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e127fc640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e140fea10 0x7f7e140fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e127fc640 1 -- 172.21.15.49:0/1216080589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009560 con 0x7f7e14104a10 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e127fc640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e140fb570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800d6f0 tx=0x7f7e0800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7dfbfff640 1 -- 172.21.15.49:0/1216080589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e08009a30 con 0x7f7e14104a10 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e141a1ce0 con 0x7f7e14104a10 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7dfbfff640 1 -- 172.21.15.49:0/1216080589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e080054e0 con 0x7f7e14104a10 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.200+0000 7f7dfbfff640 1 -- 172.21.15.49:0/1216080589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e08010460 con 0x7f7e14104a10 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.201+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e141a2040 con 0x7f7e14104a10 2024-09-19T09:12:38.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.202+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e14100150 con 0x7f7e14104a10 2024-09-19T09:12:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.202+0000 7f7dfbfff640 1 -- 172.21.15.49:0/1216080589 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7e08009b90 con 0x7f7e14104a10 2024-09-19T09:12:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.203+0000 7f7dfbfff640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7dfc06e5f0 0x7f7dfc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.203+0000 7f7dfbfff640 1 -- 172.21.15.49:0/1216080589 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f7e0808e2c0 con 0x7f7e14104a10 2024-09-19T09:12:38.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.203+0000 7f7e12ffd640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7dfc06e5f0 0x7f7dfc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.204+0000 7f7e12ffd640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7dfc06e5f0 0x7f7dfc070ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009230 tx=0x7f7e040058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:38.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.210+0000 7f7dfbfff640 1 -- 172.21.15.49:0/1216080589 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7e080573b0 con 0x7f7e14104a10 2024-09-19T09:12:38.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.395+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e1410bca0 con 0x7f7dfc06e5f0 2024-09-19T09:12:38.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.405+0000 7f7dfbfff640 1 -- 172.21.15.49:0/1216080589 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7e1410bca0 con 0x7f7dfc06e5f0 2024-09-19T09:12:38.406 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:12:38.406 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (56s) 30s ago 18m 16.9M - 0.25.0 c8568f914cd2 c4127e2a6a36 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (112s) 30s ago 18m 8464k - 19.1.1-361-g2f599a46 d2baa855c067 b236633deeab 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (103s) 84s ago 17m 8292k - 19.1.1-361-g2f599a46 d2baa855c067 6f4f65bf81b8 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 30s ago 18m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (6m) 84s ago 17m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (35s) 30s ago 17m 48.3M - 9.4.12 2bacad6d85d8 9268f1ab9520 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (2m) 30s ago 12m 87.1M - 19.1.1-361-g2f599a46 d2baa855c067 3860d60c0271 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (2m) 30s ago 12m 21.5M - 19.1.1-361-g2f599a46 d2baa855c067 633df85b1957 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (2m) 84s ago 12m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 3766d06b2add 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (2m) 84s ago 12m 87.9M - 19.1.1-361-g2f599a46 d2baa855c067 5257da592c71 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (9m) 30s ago 19m 518M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (8m) 84s ago 17m 443M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 30s ago 19m 58.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:12:38.407 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (7m) 84s ago 17m 42.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (91s) 30s ago 18m 8078k - 1.5.0 0da6a335fe13 fed7048a29b5 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (87s) 84s ago 17m 3611k - 1.5.0 0da6a335fe13 be690cc5c2ad 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 30s ago 16m 108M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 30s ago 15m 107M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 30s ago 15m 102M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (4m) 84s ago 15m 121M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (4m) 84s ago 14m 87.1M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (3m) 84s ago 14m 86.2M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:12:38.408 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (72s) 30s ago 17m 49.3M - 2.43.0 a07b618ecd1d 0ee729414142 2024-09-19T09:12:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7dfc06e5f0 msgr2=0x7f7dfc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7dfc06e5f0 0x7f7dfc070ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009230 tx=0x7f7e040058d0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 msgr2=0x7f7e140fb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e140fb570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800d6f0 tx=0x7f7e0800dbb0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 shutdown_connections 2024-09-19T09:12:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f7dfc06e5f0 0x7f7dfc070ab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e14104a10 0x7f7e140fb570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 --2- 172.21.15.49:0/1216080589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e140fea10 0x7f7e140fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 >> 172.21.15.49:0/1216080589 conn(0x7f7e140fa730 msgr2=0x7f7e14068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 shutdown_connections 2024-09-19T09:12:38.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:38.407+0000 7f7e1932c640 1 -- 172.21.15.49:0/1216080589 wait complete. 2024-09-19T09:12:39.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:38 smithi102 ceph-mon[80875]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:39.016 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:38 smithi049 ceph-mon[91793]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:39.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade status' 2024-09-19T09:12:39.250 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:12:40.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:39 smithi102 ceph-mon[80875]: pgmap v285: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:40.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:39 smithi049 ceph-mon[91793]: pgmap v285: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 -- 172.21.15.49:0/1035372539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 msgr2=0x7fdab0109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 --2- 172.21.15.49:0/1035372539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab0109ac0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009880 tx=0x7fdaa402a530 comp rx=0 tx=0).stop 2024-09-19T09:12:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 -- 172.21.15.49:0/1035372539 shutdown_connections 2024-09-19T09:12:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 --2- 172.21.15.49:0/1035372539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab0109ac0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 --2- 172.21.15.49:0/1035372539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdab0100cb0 0x7fdab0101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 -- 172.21.15.49:0/1035372539 >> 172.21.15.49:0/1035372539 conn(0x7fdab00758a0 msgr2=0x7fdab00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 -- 172.21.15.49:0/1035372539 shutdown_connections 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.895+0000 7fdab7afb640 1 -- 172.21.15.49:0/1035372539 wait complete. 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab7afb640 1 Processor -- start 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab7afb640 1 -- start start 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab7afb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdab0100cb0 0x7fdab019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab7afb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab7afb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab019c3b0 con 0x7fdab01015d0 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab7afb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0195940 con 0x7fdab0100cb0 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab5096640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab5096640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40990/0 (socket says 172.21.15.49:40990) 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.896+0000 7fdab5096640 1 -- 172.21.15.49:0/3031761510 learned_addr learned my addr 172.21.15.49:0/3031761510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab5897640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdab0100cb0 0x7fdab019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab5096640 1 -- 172.21.15.49:0/3031761510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdab0100cb0 msgr2=0x7fdab019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab5096640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdab0100cb0 0x7fdab019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab5096640 1 -- 172.21.15.49:0/3031761510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4009560 con 0x7fdab01015d0 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab5897640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdab0100cb0 0x7fdab019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab5096640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab019bd90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdaa402aa50 tx=0x7fdaa40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdaaeffd640 1 -- 172.21.15.49:0/3031761510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa40048d0 con 0x7fdab01015d0 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdaaeffd640 1 -- 172.21.15.49:0/3031761510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdaa4031640 con 0x7fdab01015d0 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab0195bc0 con 0x7fdab01015d0 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdaaeffd640 1 -- 172.21.15.49:0/3031761510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa40038d0 con 0x7fdab01015d0 2024-09-19T09:12:40.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.897+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab01960b0 con 0x7fdab01015d0 2024-09-19T09:12:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.898+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab0068510 con 0x7fdab01015d0 2024-09-19T09:12:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.899+0000 7fdaaeffd640 1 -- 172.21.15.49:0/3031761510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdaa402ad50 con 0x7fdab01015d0 2024-09-19T09:12:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.899+0000 7fdaaeffd640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fda9806e5f0 0x7fda98070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.899+0000 7fdaaeffd640 1 -- 172.21.15.49:0/3031761510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fdaa40af550 con 0x7fdab01015d0 2024-09-19T09:12:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.899+0000 7fdab5897640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fda9806e5f0 0x7fda98070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.900+0000 7fdab5897640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fda9806e5f0 0x7fda98070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80058c0 tx=0x7fdaa8005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:40.904+0000 7fdaaeffd640 1 -- 172.21.15.49:0/3031761510 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdaa4078590 con 0x7fdab01015d0 2024-09-19T09:12:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.099+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdab010cda0 con 0x7fda9806e5f0 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.100+0000 7fdaaeffd640 1 -- 172.21.15.49:0/3031761510 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fdab010cda0 con 0x7fda9806e5f0 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": null, 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": false, 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "", 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": null, 2024-09-19T09:12:41.101 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-09-19T09:12:41.102 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-09-19T09:12:41.102 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:12:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.101+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fda9806e5f0 msgr2=0x7fda98070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.101+0000 7fdab7afb640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fda9806e5f0 0x7fda98070ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80058c0 tx=0x7fdaa8005850 comp rx=0 tx=0).stop 2024-09-19T09:12:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.101+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 msgr2=0x7fdab019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab019bd90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdaa402aa50 tx=0x7fdaa40055a0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 shutdown_connections 2024-09-19T09:12:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fda9806e5f0 0x7fda98070ab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdab01015d0 0x7fdab019bd90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 --2- 172.21.15.49:0/3031761510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdab0100cb0 0x7fdab019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 >> 172.21.15.49:0/3031761510 conn(0x7fdab00758a0 msgr2=0x7fdab0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 shutdown_connections 2024-09-19T09:12:41.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:41.102+0000 7fdab7afb640 1 -- 172.21.15.49:0/3031761510 wait complete. 2024-09-19T09:12:41.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph health detail' 2024-09-19T09:12:41.849 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:12:41.957 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:41 smithi049 ceph-mon[91793]: pgmap v286: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:41.957 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:41 smithi049 ceph-mon[91793]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:42.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:41 smithi102 ceph-mon[80875]: pgmap v286: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:42.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:41 smithi102 ceph-mon[80875]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:42.849 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:43.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 -- 172.21.15.49:0/1800584159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 msgr2=0x7f5b3c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 --2- 172.21.15.49:0/1800584159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fee50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009880 tx=0x7f5b3002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 -- 172.21.15.49:0/1800584159 shutdown_connections 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 --2- 172.21.15.49:0/1800584159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fee50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 --2- 172.21.15.49:0/1800584159 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b3c1049f0 0x7f5b3c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 -- 172.21.15.49:0/1800584159 >> 172.21.15.49:0/1800584159 conn(0x7f5b3c0758a0 msgr2=0x7f5b3c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 -- 172.21.15.49:0/1800584159 shutdown_connections 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.361+0000 7f5b427d6640 1 -- 172.21.15.49:0/1800584159 wait complete. 2024-09-19T09:12:43.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b427d6640 1 Processor -- start 2024-09-19T09:12:43.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b427d6640 1 -- start start 2024-09-19T09:12:43.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b427d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b427d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b3c1049f0 0x7f5b3c0fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b427d6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0fb800 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b427d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0fb970 con 0x7f5b3c1049f0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41012/0 (socket says 172.21.15.49:41012) 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.362+0000 7f5b3bfff640 1 -- 172.21.15.49:0/620213451 learned_addr learned my addr 172.21.15.49:0/620213451 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b3b7fe640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b3c1049f0 0x7f5b3c0fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b3bfff640 1 -- 172.21.15.49:0/620213451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b3c1049f0 msgr2=0x7f5b3c0fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b3bfff640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b3c1049f0 0x7f5b3c0fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b3bfff640 1 -- 172.21.15.49:0/620213451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30009560 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b3bfff640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fad80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00d6f0 tx=0x7f5b2c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b397fa640 1 -- 172.21.15.49:0/620213451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c009a30 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b397fa640 1 -- 172.21.15.49:0/620213451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b2c0054e0 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c1a1c90 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b397fa640 1 -- 172.21.15.49:0/620213451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c010460 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.363+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c1a1ff0 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.364+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c100130 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.365+0000 7f5b397fa640 1 -- 172.21.15.49:0/620213451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5b2c009b90 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.366+0000 7f5b397fa640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5b2406e5f0 0x7f5b24070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.366+0000 7f5b397fa640 1 -- 172.21.15.49:0/620213451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f5b2c08e370 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.366+0000 7f5b3b7fe640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5b2406e5f0 0x7f5b24070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.366+0000 7f5b3b7fe640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5b2406e5f0 0x7f5b24070ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b30000c00 tx=0x7f5b30005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:43.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.370+0000 7f5b397fa640 1 -- 172.21.15.49:0/620213451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5b2c0573b0 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.622+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5b3c10bc80 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.623+0000 7f5b397fa640 1 -- 172.21.15.49:0/620213451 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5b2c05aa70 con 0x7f5b3c0fe9f0 2024-09-19T09:12:43.624 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:12:43.625 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:12:43.625 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5b2406e5f0 msgr2=0x7f5b24070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5b2406e5f0 0x7f5b24070ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b30000c00 tx=0x7f5b30005a20 comp rx=0 tx=0).stop 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 msgr2=0x7f5b3c0fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fad80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00d6f0 tx=0x7f5b2c00dbb0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 shutdown_connections 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f5b2406e5f0 0x7f5b24070ab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b3c1049f0 0x7f5b3c0fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 --2- 172.21.15.49:0/620213451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b3c0fe9f0 0x7f5b3c0fad80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 >> 172.21.15.49:0/620213451 conn(0x7f5b3c0758a0 msgr2=0x7f5b3c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 shutdown_connections 2024-09-19T09:12:43.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:43.625+0000 7f5b427d6640 1 -- 172.21.15.49:0/620213451 wait complete. 2024-09-19T09:12:43.910 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:43 smithi102 ceph-mon[80875]: pgmap v287: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:43.910 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:43 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/620213451' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:12:43.996 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:43 smithi049 ceph-mon[91793]: pgmap v287: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:43.997 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:43 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/620213451' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T09:12:44.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions' 2024-09-19T09:12:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:12:45.927 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:45 smithi049 ceph-mon[91793]: pgmap v288: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:46.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:45 smithi102 ceph-mon[80875]: pgmap v288: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:46.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 -- 172.21.15.49:0/1016044865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 msgr2=0x7fe994104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:46.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 --2- 172.21.15.49:0/1016044865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994104dd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe984009c20 tx=0x7fe98402a970 comp rx=0 tx=0).stop 2024-09-19T09:12:46.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 -- 172.21.15.49:0/1016044865 shutdown_connections 2024-09-19T09:12:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 --2- 172.21.15.49:0/1016044865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9940fe9f0 0x7fe9940fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 --2- 172.21.15.49:0/1016044865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994104dd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 -- 172.21.15.49:0/1016044865 >> 172.21.15.49:0/1016044865 conn(0x7fe9940758a0 msgr2=0x7fe9940fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 -- 172.21.15.49:0/1016044865 shutdown_connections 2024-09-19T09:12:46.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.114+0000 7fe99c06e640 1 -- 172.21.15.49:0/1016044865 wait complete. 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe99c06e640 1 Processor -- start 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe99c06e640 1 -- start start 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe99c06e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9940fe9f0 0x7fe994196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe99c06e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe99c06e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994197490 con 0x7fe9941049f0 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe99c06e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994197600 con 0x7fe9940fe9f0 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe999609640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe999609640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41038/0 (socket says 172.21.15.49:41038) 2024-09-19T09:12:46.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe999609640 1 -- 172.21.15.49:0/2157060418 learned_addr learned my addr 172.21.15.49:0/2157060418 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.115+0000 7fe999e0a640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9940fe9f0 0x7fe994196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe999609640 1 -- 172.21.15.49:0/2157060418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9940fe9f0 msgr2=0x7fe994196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe999609640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9940fe9f0 0x7fe994196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe999609640 1 -- 172.21.15.49:0/2157060418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984009900 con 0x7fe9941049f0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe999609640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994196ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe98800d6f0 tx=0x7fe98800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe992ffd640 1 -- 172.21.15.49:0/2157060418 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe988009a30 con 0x7fe9941049f0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe992ffd640 1 -- 172.21.15.49:0/2157060418 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9880054e0 con 0x7fe9941049f0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99419f9f0 con 0x7fe9941049f0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe992ffd640 1 -- 172.21.15.49:0/2157060418 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe988010460 con 0x7fe9941049f0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.116+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99419fe60 con 0x7fe9941049f0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.117+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe994100130 con 0x7fe9941049f0 2024-09-19T09:12:46.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.118+0000 7fe992ffd640 1 -- 172.21.15.49:0/2157060418 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe988009b90 con 0x7fe9941049f0 2024-09-19T09:12:46.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.118+0000 7fe992ffd640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe97c06e5f0 0x7fe97c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:46.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.118+0000 7fe992ffd640 1 -- 172.21.15.49:0/2157060418 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fe98808e1e0 con 0x7fe9941049f0 2024-09-19T09:12:46.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.118+0000 7fe999e0a640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe97c06e5f0 0x7fe97c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:46.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.119+0000 7fe999e0a640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe97c06e5f0 0x7fe97c070ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe984000f80 tx=0x7fe98403d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:46.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.123+0000 7fe992ffd640 1 -- 172.21.15.49:0/2157060418 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe988057350 con 0x7fe9941049f0 2024-09-19T09:12:46.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.367+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe994107000 con 0x7fe9941049f0 2024-09-19T09:12:46.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.368+0000 7fe992ffd640 1 -- 172.21.15.49:0/2157060418 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe988020290 con 0x7fe9941049f0 2024-09-19T09:12:46.368 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:12:46.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:12:46.370 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:12:46.370 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T09:12:46.370 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:12:46.370 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:12:46.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe97c06e5f0 msgr2=0x7fe97c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:46.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe97c06e5f0 0x7fe97c070ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe984000f80 tx=0x7fe98403d040 comp rx=0 tx=0).stop 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 msgr2=0x7fe994196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994196ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe98800d6f0 tx=0x7fe98800dbb0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 shutdown_connections 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fe97c06e5f0 0x7fe97c070ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9941049f0 0x7fe994196ec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 --2- 172.21.15.49:0/2157060418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9940fe9f0 0x7fe994196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 >> 172.21.15.49:0/2157060418 conn(0x7fe9940758a0 msgr2=0x7fe9940fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 shutdown_connections 2024-09-19T09:12:46.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:12:46.370+0000 7fe99c06e640 1 -- 172.21.15.49:0/2157060418 wait complete. 2024-09-19T09:12:46.947 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:46 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2157060418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:47.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-19T09:12:47.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:46 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2157060418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:12:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:12:47.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:47 smithi102 ceph-mon[80875]: pgmap v289: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:48.034 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:47 smithi049 ceph-mon[91793]: pgmap v289: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:48.922 INFO:teuthology.orchestra.run.smithi049.stdout:wait for servicemap items w/ changing names to refresh 2024-09-19T09:12:49.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'sleep 60' 2024-09-19T09:12:49.736 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:12:49.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:49 smithi049 ceph-mon[91793]: pgmap v290: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:50.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:49 smithi102 ceph-mon[80875]: pgmap v290: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:12:51.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:51 smithi049 ceph-mon[91793]: pgmap v291: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:52.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:51 smithi102 ceph-mon[80875]: pgmap v291: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:53.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:53 smithi049 ceph-mon[91793]: pgmap v292: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:54.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:53 smithi102 ceph-mon[80875]: pgmap v292: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:12:56.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:55 smithi102 ceph-mon[80875]: pgmap v293: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:56.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:55 smithi049 ceph-mon[91793]: pgmap v293: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:12:58.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:57 smithi102 ceph-mon[80875]: pgmap v294: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:58.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:12:58.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:57 smithi049 ceph-mon[91793]: pgmap v294: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:12:58.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:00.008 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:12:59 smithi102 ceph-mon[80875]: pgmap v295: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:00.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:12:59 smithi049 ceph-mon[91793]: pgmap v295: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:02.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:01 smithi102 ceph-mon[80875]: pgmap v296: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:02.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:01 smithi049 ceph-mon[91793]: pgmap v296: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:04.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:03 smithi102 ceph-mon[80875]: pgmap v297: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:04.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:03 smithi049 ceph-mon[91793]: pgmap v297: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:05 smithi102 ceph-mon[80875]: pgmap v298: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:05 smithi049 ceph-mon[91793]: pgmap v298: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:08.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:07 smithi102 ceph-mon[80875]: pgmap v299: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:07 smithi049 ceph-mon[91793]: pgmap v299: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:10.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:09 smithi102 ceph-mon[80875]: pgmap v300: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:10.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:09 smithi049 ceph-mon[91793]: pgmap v300: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:12.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:11 smithi102 ceph-mon[80875]: pgmap v301: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:12.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:11 smithi049 ceph-mon[91793]: pgmap v301: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:13.160 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:13.160 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:12 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:13.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:13.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:13 smithi102 ceph-mon[80875]: pgmap v302: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:13:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:13 smithi049 ceph-mon[91793]: pgmap v302: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:13:16.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:15 smithi102 ceph-mon[80875]: pgmap v303: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:16.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:15 smithi049 ceph-mon[91793]: pgmap v303: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:18.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:17 smithi102 ceph-mon[80875]: pgmap v304: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:18.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:17 smithi049 ceph-mon[91793]: pgmap v304: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:20.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:19 smithi102 ceph-mon[80875]: pgmap v305: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:20.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:19 smithi049 ceph-mon[91793]: pgmap v305: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:22.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:21 smithi102 ceph-mon[80875]: pgmap v306: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:21 smithi049 ceph-mon[91793]: pgmap v306: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:24.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:23 smithi102 ceph-mon[80875]: pgmap v307: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:23 smithi049 ceph-mon[91793]: pgmap v307: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:26.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:25 smithi102 ceph-mon[80875]: pgmap v308: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:26.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:25 smithi049 ceph-mon[91793]: pgmap v308: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:28.167 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:27 smithi102 ceph-mon[80875]: pgmap v309: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:28.167 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:27 smithi049 ceph-mon[91793]: pgmap v309: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:30.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:29 smithi102 ceph-mon[80875]: pgmap v310: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:30.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:29 smithi049 ceph-mon[91793]: pgmap v310: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:32.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:31 smithi102 ceph-mon[80875]: pgmap v311: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:32.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:31 smithi049 ceph-mon[91793]: pgmap v311: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:34.256 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:33 smithi049 ceph-mon[91793]: pgmap v312: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:34.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:33 smithi102 ceph-mon[80875]: pgmap v312: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:36.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:35 smithi102 ceph-mon[80875]: pgmap v313: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:36.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:35 smithi049 ceph-mon[91793]: pgmap v313: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:38.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:37 smithi102 ceph-mon[80875]: pgmap v314: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:38.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:37 smithi049 ceph-mon[91793]: pgmap v314: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:40.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:39 smithi102 ceph-mon[80875]: pgmap v315: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:40.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:39 smithi049 ceph-mon[91793]: pgmap v315: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:42.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:41 smithi102 ceph-mon[80875]: pgmap v316: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:42.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:41 smithi049 ceph-mon[91793]: pgmap v316: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:43.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:43.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:44.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:43 smithi102 ceph-mon[80875]: pgmap v317: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:44.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:43 smithi049 ceph-mon[91793]: pgmap v317: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:46.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:45 smithi102 ceph-mon[80875]: pgmap v318: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:46.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:45 smithi049 ceph-mon[91793]: pgmap v318: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:48.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:47 smithi102 ceph-mon[80875]: pgmap v319: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:48.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:47 smithi049 ceph-mon[91793]: pgmap v319: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:50.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:49 smithi102 ceph-mon[80875]: pgmap v320: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:50.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:49 smithi049 ceph-mon[91793]: pgmap v320: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:13:51.934 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T09:13:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:13:52.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:51 smithi102 ceph-mon[80875]: pgmap v321: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:52.275 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:51 smithi049 ceph-mon[91793]: pgmap v321: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:53.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 -- 172.21.15.49:0/3398502542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 msgr2=0x7faf48104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 --2- 172.21.15.49:0/3398502542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf48104dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faf38009880 tx=0x7faf3802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 -- 172.21.15.49:0/3398502542 shutdown_connections 2024-09-19T09:13:53.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 --2- 172.21.15.49:0/3398502542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf480fe9f0 0x7faf480fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 --2- 172.21.15.49:0/3398502542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf48104dd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 -- 172.21.15.49:0/3398502542 >> 172.21.15.49:0/3398502542 conn(0x7faf480758a0 msgr2=0x7faf480fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 -- 172.21.15.49:0/3398502542 shutdown_connections 2024-09-19T09:13:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 -- 172.21.15.49:0/3398502542 wait complete. 2024-09-19T09:13:53.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.800+0000 7faf4d86b640 1 Processor -- start 2024-09-19T09:13:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf4d86b640 1 -- start start 2024-09-19T09:13:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf4d86b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf480fe9f0 0x7faf480fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf4d86b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf480fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf4d86b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf480fb800 con 0x7faf481049f0 2024-09-19T09:13:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf4d86b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf480fb940 con 0x7faf480fe9f0 2024-09-19T09:13:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf467fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf480fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf467fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf480fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44544/0 (socket says 172.21.15.49:44544) 2024-09-19T09:13:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf467fc640 1 -- 172.21.15.49:0/1396025291 learned_addr learned my addr 172.21.15.49:0/1396025291 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:13:53.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf46ffd640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf480fe9f0 0x7faf480fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf467fc640 1 -- 172.21.15.49:0/1396025291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf480fe9f0 msgr2=0x7faf480fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf467fc640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf480fe9f0 0x7faf480fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.801+0000 7faf467fc640 1 -- 172.21.15.49:0/1396025291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38009560 con 0x7faf481049f0 2024-09-19T09:13:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.802+0000 7faf467fc640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf480fb2c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b420 tx=0x7faf3c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.802+0000 7faf4c869640 1 -- 172.21.15.49:0/1396025291 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf3c011800 con 0x7faf481049f0 2024-09-19T09:13:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.802+0000 7faf4c869640 1 -- 172.21.15.49:0/1396025291 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf3c011e20 con 0x7faf481049f0 2024-09-19T09:13:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.802+0000 7faf4c869640 1 -- 172.21.15.49:0/1396025291 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf3c00f2e0 con 0x7faf481049f0 2024-09-19T09:13:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.802+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf481a1e90 con 0x7faf481049f0 2024-09-19T09:13:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.802+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf481a2240 con 0x7faf481049f0 2024-09-19T09:13:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.803+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf48100130 con 0x7faf481049f0 2024-09-19T09:13:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.804+0000 7faf4c869640 1 -- 172.21.15.49:0/1396025291 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faf3c010380 con 0x7faf481049f0 2024-09-19T09:13:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.804+0000 7faf4c869640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf3006e600 0x7faf30070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.804+0000 7faf4c869640 1 -- 172.21.15.49:0/1396025291 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7faf3c08e150 con 0x7faf481049f0 2024-09-19T09:13:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.804+0000 7faf46ffd640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf3006e600 0x7faf30070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.805+0000 7faf46ffd640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf3006e600 0x7faf30070ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf38000c00 tx=0x7faf38031420 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:53.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.809+0000 7faf4c869640 1 -- 172.21.15.49:0/1396025291 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faf3c057190 con 0x7faf481049f0 2024-09-19T09:13:53.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:53.992+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 --> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf4810bce0 con 0x7faf3006e600 2024-09-19T09:13:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.001+0000 7faf4c869640 1 -- 172.21.15.49:0/1396025291 <== mgr.34104 v2:172.21.15.49:6800/4061156495 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7faf4810bce0 con 0x7faf3006e600 2024-09-19T09:13:54.002 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (2m) 105s ago 19m 16.9M - 0.25.0 c8568f914cd2 c4127e2a6a36 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi049 smithi049 running (3m) 105s ago 19m 8464k - 19.1.1-361-g2f599a46 d2baa855c067 b236633deeab 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-exporter.smithi102 smithi102 running (2m) 2m ago 18m 8292k - 19.1.1-361-g2f599a46 d2baa855c067 6f4f65bf81b8 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 105s ago 19m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 0d72e866bcca 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi102 smithi102 running (8m) 2m ago 18m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 975f11565228 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (110s) 105s ago 19m 48.3M - 9.4.12 2bacad6d85d8 9268f1ab9520 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.ibssbl smithi049 running (4m) 105s ago 14m 87.1M - 19.1.1-361-g2f599a46 d2baa855c067 3860d60c0271 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.uujbrc smithi049 running (3m) 105s ago 13m 21.5M - 19.1.1-361-g2f599a46 d2baa855c067 633df85b1957 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.ojquyx smithi102 running (3m) 2m ago 13m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 3766d06b2add 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi102.snrasw smithi102 running (3m) 2m ago 14m 87.9M - 19.1.1-361-g2f599a46 d2baa855c067 5257da592c71 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.qdvksw smithi049 *:8443,9283,8765 running (11m) 105s ago 20m 518M - 19.1.1-361-g2f599a46 d2baa855c067 b5f20a6a44b1 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi102.csalqv smithi102 *:8443,9283,8765 running (9m) 2m ago 18m 443M - 19.1.1-361-g2f599a46 d2baa855c067 f9a36d089631 2024-09-19T09:13:54.003 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 105s ago 20m 58.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a5ea9706c7ce 2024-09-19T09:13:54.004 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi102 smithi102 running (8m) 2m ago 18m 42.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 50b15ebe2a3e 2024-09-19T09:13:54.004 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (2m) 105s ago 19m 8078k - 1.5.0 0da6a335fe13 fed7048a29b5 2024-09-19T09:13:54.004 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi102 smithi102 *:9100 running (2m) 2m ago 18m 3611k - 1.5.0 0da6a335fe13 be690cc5c2ad 2024-09-19T09:13:54.004 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 105s ago 17m 108M 1216M 19.1.1-361-g2f599a46 d2baa855c067 530476c8de21 2024-09-19T09:13:54.004 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 105s ago 17m 107M 1216M 19.1.1-361-g2f599a46 d2baa855c067 ae5cb4e6931b 2024-09-19T09:13:54.005 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 105s ago 16m 102M 1216M 19.1.1-361-g2f599a46 d2baa855c067 72e20f7003f6 2024-09-19T09:13:54.005 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi102 running (6m) 2m ago 16m 121M 2240M 19.1.1-361-g2f599a46 d2baa855c067 a484137c7424 2024-09-19T09:13:54.005 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi102 running (5m) 2m ago 15m 87.1M 2240M 19.1.1-361-g2f599a46 d2baa855c067 c3556b69168e 2024-09-19T09:13:54.005 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi102 running (5m) 2m ago 15m 86.2M 2240M 19.1.1-361-g2f599a46 d2baa855c067 42836962daf2 2024-09-19T09:13:54.005 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi049 smithi049 *:9095 running (2m) 105s ago 18m 49.3M - 2.43.0 a07b618ecd1d 0ee729414142 2024-09-19T09:13:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf3006e600 msgr2=0x7faf30070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf3006e600 0x7faf30070ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf38000c00 tx=0x7faf38031420 comp rx=0 tx=0).stop 2024-09-19T09:13:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 msgr2=0x7faf480fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf480fb2c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b420 tx=0x7faf3c00b8e0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 shutdown_connections 2024-09-19T09:13:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7faf3006e600 0x7faf30070ac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf481049f0 0x7faf480fb2c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 --2- 172.21.15.49:0/1396025291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf480fe9f0 0x7faf480fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.003+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 >> 172.21.15.49:0/1396025291 conn(0x7faf480758a0 msgr2=0x7faf480fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.004+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 shutdown_connections 2024-09-19T09:13:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:54.004+0000 7faf4d86b640 1 -- 172.21.15.49:0/1396025291 wait complete. 2024-09-19T09:13:54.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:53 smithi102 ceph-mon[80875]: pgmap v322: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:54.301 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:53 smithi049 ceph-mon[91793]: pgmap v322: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:13:54.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions' 2024-09-19T09:13:54.972 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:13:55.232 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:54 smithi049 ceph-mon[91793]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:55.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:54 smithi102 ceph-mon[80875]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:56.224 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:55 smithi049 ceph-mon[91793]: pgmap v323: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:56.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:55 smithi102 ceph-mon[80875]: pgmap v323: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:13:56.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.578+0000 7f38943df640 1 -- 172.21.15.49:0/2798821017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 msgr2=0x7f388c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.578+0000 7f38943df640 1 --2- 172.21.15.49:0/2798821017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c100180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3888009880 tx=0x7f388802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 -- 172.21.15.49:0/2798821017 shutdown_connections 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 --2- 172.21.15.49:0/2798821017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c100750 0x7f388c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 --2- 172.21.15.49:0/2798821017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c100180 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 -- 172.21.15.49:0/2798821017 >> 172.21.15.49:0/2798821017 conn(0x7f388c0fb840 msgr2=0x7f388c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 -- 172.21.15.49:0/2798821017 shutdown_connections 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 -- 172.21.15.49:0/2798821017 wait complete. 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 Processor -- start 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.579+0000 7f38943df640 1 -- start start 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f38943df640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f38943df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c100750 0x7f388c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f38943df640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c19c480 con 0x7f388c0ffda0 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f38943df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c195a10 con 0x7f388c100750 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389217b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389217b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44568/0 (socket says 172.21.15.49:44568) 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389217b640 1 -- 172.21.15.49:0/10430384 learned_addr learned my addr 172.21.15.49:0/10430384 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389197a640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c100750 0x7f388c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389217b640 1 -- 172.21.15.49:0/10430384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c100750 msgr2=0x7f388c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389217b640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c100750 0x7f388c19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389217b640 1 -- 172.21.15.49:0/10430384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888009560 con 0x7f388c0ffda0 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389197a640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c100750 0x7f388c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:56.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f389217b640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c19b920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f388802a9c0 tx=0x7f38880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f387f7fe640 1 -- 172.21.15.49:0/10430384 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3888004aa0 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f387f7fe640 1 -- 172.21.15.49:0/10430384 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3888004c00 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f387f7fe640 1 -- 172.21.15.49:0/10430384 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3888003ab0 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c195c90 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.580+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c196180 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.581+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c101280 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.582+0000 7f387f7fe640 1 -- 172.21.15.49:0/10430384 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3888031d20 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.582+0000 7f387f7fe640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f387806e5f0 0x7f3878070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.582+0000 7f387f7fe640 1 -- 172.21.15.49:0/10430384 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f38880af7f0 con 0x7f388c0ffda0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.583+0000 7f389197a640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f387806e5f0 0x7f3878070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.583+0000 7f389197a640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f387806e5f0 0x7f3878070ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3880006fd0 tx=0x7f3880008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.587+0000 7f387f7fe640 1 -- 172.21.15.49:0/10430384 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f38880788b0 con 0x7f388c0ffda0 2024-09-19T09:13:56.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.834+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f388c1080b0 con 0x7f388c0ffda0 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.834+0000 7f387f7fe640 1 -- 172.21.15.49:0/10430384 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f388807bf70 con 0x7f388c0ffda0 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-09-19T09:13:56.835 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-19T09:13:56.836 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-19T09:13:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f387806e5f0 msgr2=0x7f3878070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f387806e5f0 0x7f3878070ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3880006fd0 tx=0x7f3880008040 comp rx=0 tx=0).stop 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 msgr2=0x7f388c19b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c19b920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f388802a9c0 tx=0x7f38880055a0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 shutdown_connections 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f387806e5f0 0x7f3878070ab0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c100750 0x7f388c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 --2- 172.21.15.49:0/10430384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f388c0ffda0 0x7f388c19b920 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 >> 172.21.15.49:0/10430384 conn(0x7f388c0fb840 msgr2=0x7f388c0fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 shutdown_connections 2024-09-19T09:13:56.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:56.837+0000 7f38943df640 1 -- 172.21.15.49:0/10430384 wait complete. 2024-09-19T09:13:57.210 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:56 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/10430384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:13:57.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:56 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/10430384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:13:57.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-19T09:13:57.763 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:13:58.138 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:57 smithi049 ceph-mon[91793]: pgmap v324: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:58.138 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:57 smithi102 ceph-mon[80875]: pgmap v324: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:13:58.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:13:59.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.443+0000 7f627d1db640 1 -- 172.21.15.49:0/292816103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 msgr2=0x7f62780fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.443+0000 7f627d1db640 1 --2- 172.21.15.49:0/292816103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f62780fee70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f626c009880 tx=0x7f626c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.444+0000 7f627d1db640 1 -- 172.21.15.49:0/292816103 shutdown_connections 2024-09-19T09:13:59.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.444+0000 7f627d1db640 1 --2- 172.21.15.49:0/292816103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f62780fee70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.444+0000 7f627d1db640 1 --2- 172.21.15.49:0/292816103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6278104a10 0x7f6278104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.444+0000 7f627d1db640 1 -- 172.21.15.49:0/292816103 >> 172.21.15.49:0/292816103 conn(0x7f62780fa730 msgr2=0x7f62780fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:59.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.444+0000 7f627d1db640 1 -- 172.21.15.49:0/292816103 shutdown_connections 2024-09-19T09:13:59.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.444+0000 7f627d1db640 1 -- 172.21.15.49:0/292816103 wait complete. 2024-09-19T09:13:59.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.444+0000 7f627d1db640 1 Processor -- start 2024-09-19T09:13:59.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f627d1db640 1 -- start start 2024-09-19T09:13:59.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f627d1db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f627819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f627d1db640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6278104a10 0x7f627819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f627d1db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627819c490 con 0x7f62780fea10 2024-09-19T09:13:59.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f627d1db640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278195a20 con 0x7f6278104a10 2024-09-19T09:13:59.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f6276d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f627819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f6276d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f627819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44592/0 (socket says 172.21.15.49:44592) 2024-09-19T09:13:59.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f6276d9d640 1 -- 172.21.15.49:0/3438703321 learned_addr learned my addr 172.21.15.49:0/3438703321 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f627659c640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6278104a10 0x7f627819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f6276d9d640 1 -- 172.21.15.49:0/3438703321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6278104a10 msgr2=0x7f627819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f6276d9d640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6278104a10 0x7f627819be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.445+0000 7f6276d9d640 1 -- 172.21.15.49:0/3438703321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009560 con 0x7f62780fea10 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.446+0000 7f6276d9d640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f627819b930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f626800b420 tx=0x7f626800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.446+0000 7f625ffff640 1 -- 172.21.15.49:0/3438703321 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6268011800 con 0x7f62780fea10 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.446+0000 7f625ffff640 1 -- 172.21.15.49:0/3438703321 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6268011e20 con 0x7f62780fea10 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.446+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278195d00 con 0x7f62780fea10 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.446+0000 7f625ffff640 1 -- 172.21.15.49:0/3438703321 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626800f2e0 con 0x7f62780fea10 2024-09-19T09:13:59.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.446+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6278196220 con 0x7f62780fea10 2024-09-19T09:13:59.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.447+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6278100150 con 0x7f62780fea10 2024-09-19T09:13:59.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.448+0000 7f625ffff640 1 -- 172.21.15.49:0/3438703321 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6268010380 con 0x7f62780fea10 2024-09-19T09:13:59.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.448+0000 7f625ffff640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f626006e5f0 0x7f6260070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.448+0000 7f625ffff640 1 -- 172.21.15.49:0/3438703321 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f626808e090 con 0x7f62780fea10 2024-09-19T09:13:59.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.448+0000 7f627659c640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f626006e5f0 0x7f6260070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.449+0000 7f627659c640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f626006e5f0 0x7f6260070ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f626c000c00 tx=0x7f626c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:59.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.453+0000 7f625ffff640 1 -- 172.21.15.49:0/3438703321 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6268057150 con 0x7f62780fea10 2024-09-19T09:13:59.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.697+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f627810bd00 con 0x7f62780fea10 2024-09-19T09:13:59.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.698+0000 7f625ffff640 1 -- 172.21.15.49:0/3438703321 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f626805a810 con 0x7f62780fea10 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.699+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f626006e5f0 msgr2=0x7f6260070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f626006e5f0 0x7f6260070ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f626c000c00 tx=0x7f626c005a20 comp rx=0 tx=0).stop 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 msgr2=0x7f627819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f627819b930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f626800b420 tx=0x7f626800b8e0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 shutdown_connections 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f626006e5f0 0x7f6260070ab0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6278104a10 0x7f627819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 --2- 172.21.15.49:0/3438703321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62780fea10 0x7f627819b930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 >> 172.21.15.49:0/3438703321 conn(0x7f62780fa730 msgr2=0x7f6278068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:59.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 shutdown_connections 2024-09-19T09:13:59.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:13:59.700+0000 7f627d1db640 1 -- 172.21.15.49:0/3438703321 wait complete. 2024-09-19T09:13:59.709 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-09-19T09:14:00.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:59 smithi102 ceph-mon[80875]: pgmap v325: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:00.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:13:59 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3438703321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:14:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:59 smithi049 ceph-mon[91793]: pgmap v325: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:00.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:13:59 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3438703321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:14:00.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-19T09:14:00.634 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:02.037 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:01 smithi049 ceph-mon[91793]: pgmap v326: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:02.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:01 smithi102 ceph-mon[80875]: pgmap v326: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 -- 172.21.15.49:0/910800602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 msgr2=0x7f90c80fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 --2- 172.21.15.49:0/910800602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c80fec60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009880 tx=0x7f90c402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 -- 172.21.15.49:0/910800602 shutdown_connections 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 --2- 172.21.15.49:0/910800602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c80ff230 0x7f90c810bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 --2- 172.21.15.49:0/910800602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c80fec60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 -- 172.21.15.49:0/910800602 >> 172.21.15.49:0/910800602 conn(0x7f90c80fa730 msgr2=0x7f90c80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 -- 172.21.15.49:0/910800602 shutdown_connections 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.263+0000 7f90cff92640 1 -- 172.21.15.49:0/910800602 wait complete. 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cff92640 1 Processor -- start 2024-09-19T09:14:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cff92640 1 -- start start 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cff92640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c8197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cff92640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c80ff230 0x7f90c81981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cff92640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c81988c0 con 0x7f90c80fe880 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cff92640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c819b530 con 0x7f90c80ff230 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cdd2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c8197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cdd2e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c8197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45362/0 (socket says 172.21.15.49:45362) 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cdd2e640 1 -- 172.21.15.49:0/1232730569 learned_addr learned my addr 172.21.15.49:0/1232730569 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.264+0000 7f90cd52d640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c80ff230 0x7f90c81981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90cdd2e640 1 -- 172.21.15.49:0/1232730569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c80ff230 msgr2=0x7f90c81981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90cdd2e640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c80ff230 0x7f90c81981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90cdd2e640 1 -- 172.21.15.49:0/1232730569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4009560 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90cdd2e640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c8197ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90c4006010 tx=0x7f90c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90beffd640 1 -- 172.21.15.49:0/1232730569 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c4004aa0 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90beffd640 1 -- 172.21.15.49:0/1232730569 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90c4031470 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c819b810 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90beffd640 1 -- 172.21.15.49:0/1232730569 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c4003940 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.265+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c819bd60 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.266+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c8068d30 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.267+0000 7f90beffd640 1 -- 172.21.15.49:0/1232730569 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f90c4031b90 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.267+0000 7f90beffd640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f90b406e600 0x7f90b4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.267+0000 7f90beffd640 1 -- 172.21.15.49:0/1232730569 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f90c40af730 con 0x7f90c80fe880 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.267+0000 7f90cd52d640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f90b406e600 0x7f90b4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.268+0000 7f90cd52d640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f90b406e600 0x7f90b4070ac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90c8199210 tx=0x7f90b800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.272+0000 7f90beffd640 1 -- 172.21.15.49:0/1232730569 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f90c40788a0 con 0x7f90c80fe880 2024-09-19T09:14:02.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.518+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90c8106770 con 0x7f90c80fe880 2024-09-19T09:14:02.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.519+0000 7f90beffd640 1 -- 172.21.15.49:0/1232730569 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f90c4078030 con 0x7f90c80fe880 2024-09-19T09:14:02.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f90b406e600 msgr2=0x7f90b4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f90b406e600 0x7f90b4070ac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90c8199210 tx=0x7f90b800b390 comp rx=0 tx=0).stop 2024-09-19T09:14:02.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 msgr2=0x7f90c8197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c8197ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90c4006010 tx=0x7f90c40055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 shutdown_connections 2024-09-19T09:14:02.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f90b406e600 0x7f90b4070ac0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c80ff230 0x7f90c81981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 --2- 172.21.15.49:0/1232730569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90c80fe880 0x7f90c8197ca0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 >> 172.21.15.49:0/1232730569 conn(0x7f90c80fa730 msgr2=0x7f90c80fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:02.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 shutdown_connections 2024-09-19T09:14:02.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:02.521+0000 7f90cff92640 1 -- 172.21.15.49:0/1232730569 wait complete. 2024-09-19T09:14:02.530 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)" 2024-09-19T09:14:03.125 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:02 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1232730569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:14:03.149 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:03.149 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:14:03.161 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T09:14:03.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63845326-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:14:03.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:02 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1232730569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T09:14:03.369 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:04.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:03 smithi102 ceph-mon[80875]: pgmap v327: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:04.282 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:03 smithi049 ceph-mon[91793]: pgmap v327: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 -- 172.21.15.49:0/2012019833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 msgr2=0x7f1f48109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 --2- 172.21.15.49:0/2012019833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f48109b00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1f300098b0 tx=0x7f1f3002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 -- 172.21.15.49:0/2012019833 shutdown_connections 2024-09-19T09:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 --2- 172.21.15.49:0/2012019833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f48109b00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 --2- 172.21.15.49:0/2012019833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f48100c60 0x7f1f48101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 -- 172.21.15.49:0/2012019833 >> 172.21.15.49:0/2012019833 conn(0x7f1f480fa730 msgr2=0x7f1f480fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 -- 172.21.15.49:0/2012019833 shutdown_connections 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 -- 172.21.15.49:0/2012019833 wait complete. 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.086+0000 7f1f4d779640 1 Processor -- start 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f4d779640 1 -- start start 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f4d779640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f48100c60 0x7f1f480fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f4d779640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f480fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f4d779640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480ff3d0 con 0x7f1f48101610 2024-09-19T09:14:05.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f4d779640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480ff540 con 0x7f1f48100c60 2024-09-19T09:14:05.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f467fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f480fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f46ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f48100c60 0x7f1f480fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f467fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f480fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45370/0 (socket says 172.21.15.49:45370) 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.087+0000 7f1f467fc640 1 -- 172.21.15.49:0/3576744189 learned_addr learned my addr 172.21.15.49:0/3576744189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f467fc640 1 -- 172.21.15.49:0/3576744189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f48100c60 msgr2=0x7f1f480fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f467fc640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f48100c60 0x7f1f480fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f467fc640 1 -- 172.21.15.49:0/3576744189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30009560 con 0x7f1f48101610 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f467fc640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f480fee90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f30006010 tx=0x7f1f300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f3ffff640 1 -- 172.21.15.49:0/3576744189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f30004aa0 con 0x7f1f48101610 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f3ffff640 1 -- 172.21.15.49:0/3576744189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f30031470 con 0x7f1f48101610 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f480ff7c0 con 0x7f1f48101610 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f3ffff640 1 -- 172.21.15.49:0/3576744189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f30003940 con 0x7f1f48101610 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.088+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f481a1f70 con 0x7f1f48101610 2024-09-19T09:14:05.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.089+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f48068d30 con 0x7f1f48101610 2024-09-19T09:14:05.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.090+0000 7f1f3ffff640 1 -- 172.21.15.49:0/3576744189 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1f30031b90 con 0x7f1f48101610 2024-09-19T09:14:05.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.090+0000 7f1f3ffff640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1f3406e5f0 0x7f1f34070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.090+0000 7f1f3ffff640 1 -- 172.21.15.49:0/3576744189 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f1f300af6b0 con 0x7f1f48101610 2024-09-19T09:14:05.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.090+0000 7f1f46ffd640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1f3406e5f0 0x7f1f34070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.091+0000 7f1f46ffd640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1f3406e5f0 0x7f1f34070ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005fd0 tx=0x7f1f4000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:05.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.095+0000 7f1f3ffff640 1 -- 172.21.15.49:0/3576744189 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1f300787a0 con 0x7f1f48101610 2024-09-19T09:14:05.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.308+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f480ff7c0 con 0x7f1f48101610 2024-09-19T09:14:05.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.308+0000 7f1f3ffff640 1 -- 172.21.15.49:0/3576744189 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+2003 (secure 0 0 0) 0x7f1f480ff7c0 con 0x7f1f48101610 2024-09-19T09:14:05.309 INFO:teuthology.orchestra.run.smithi049.stdout:e42 2024-09-19T09:14:05.309 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-19T09:10:40:827552+0000 2024-09-19T09:14:05.309 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 42 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-19T08:59:43.193626+0000 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-19T09:10:40.827533+0000 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-09-19T09:14:05.310 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 91 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=34416,1=34448} 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-19T09:14:05.311 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data enabled 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.ibssbl{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.49:6826/1214141994,v1:172.21.15.49:6827/1214141994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.snrasw{0:44371} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6824/4160337930,v1:172.21.15.102:6825/4160337930] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.uujbrc{1:34448} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.49:6828/3390163140,v1:172.21.15.49:6829/3390163140] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi102.ojquyx{1:44401} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.102:6826/801204290,v1:172.21.15.102:6827/801204290] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:05.312 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:05.313 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-09-19T09:14:05.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.310+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1f3406e5f0 msgr2=0x7f1f34070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.310+0000 7f1f4d779640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1f3406e5f0 0x7f1f34070ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005fd0 tx=0x7f1f4000b390 comp rx=0 tx=0).stop 2024-09-19T09:14:05.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.310+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 msgr2=0x7f1f480fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.310+0000 7f1f4d779640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f480fee90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f30006010 tx=0x7f1f300055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.311+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 shutdown_connections 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.311+0000 7f1f4d779640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f1f3406e5f0 0x7f1f34070ab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.311+0000 7f1f4d779640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f48101610 0x7f1f480fee90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.311+0000 7f1f4d779640 1 --2- 172.21.15.49:0/3576744189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f48100c60 0x7f1f480fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.311+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 >> 172.21.15.49:0/3576744189 conn(0x7f1f480fa730 msgr2=0x7f1f48101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.311+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 shutdown_connections 2024-09-19T09:14:05.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:05.311+0000 7f1f4d779640 1 -- 172.21.15.49:0/3576744189 wait complete. 2024-09-19T09:14:05.980 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-19T09:14:05.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:14:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:05 smithi102 ceph-mon[80875]: pgmap v328: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:06.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:05 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3576744189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:14:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:05 smithi049 ceph-mon[91793]: pgmap v328: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:06.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:05 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3576744189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:14:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 -- 172.21.15.49:0/2887601938 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c0fea10 msgr2=0x7f252c0fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 --2- 172.21.15.49:0/2887601938 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c0fea10 0x7f252c0fee70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2520009880 tx=0x7f252002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 -- 172.21.15.49:0/2887601938 shutdown_connections 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 --2- 172.21.15.49:0/2887601938 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c0fea10 0x7f252c0fee70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 --2- 172.21.15.49:0/2887601938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252c104a10 0x7f252c104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 -- 172.21.15.49:0/2887601938 >> 172.21.15.49:0/2887601938 conn(0x7f252c0fa730 msgr2=0x7f252c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 -- 172.21.15.49:0/2887601938 shutdown_connections 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 -- 172.21.15.49:0/2887601938 wait complete. 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 Processor -- start 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.884+0000 7f2532ff4640 1 -- start start 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f2532ff4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252c0fea10 0x7f252c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f2532ff4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c104a10 0x7f252c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f2532ff4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c19c480 con 0x7f252c104a10 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f2532ff4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c195a10 con 0x7f252c0fea10 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f252bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c104a10 0x7f252c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f252bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c104a10 0x7f252c19be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45390/0 (socket says 172.21.15.49:45390) 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f252bfff640 1 -- 172.21.15.49:0/332898300 learned_addr learned my addr 172.21.15.49:0/332898300 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f2530d90640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252c0fea10 0x7f252c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f252bfff640 1 -- 172.21.15.49:0/332898300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252c0fea10 msgr2=0x7f252c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f252bfff640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252c0fea10 0x7f252c19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f252bfff640 1 -- 172.21.15.49:0/332898300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520009560 con 0x7f252c104a10 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.885+0000 7f252bfff640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c104a10 0x7f252c19be60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2520006010 tx=0x7f25200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.886+0000 7f2529ffb640 1 -- 172.21.15.49:0/332898300 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2520004aa0 con 0x7f252c104a10 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.886+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c195c90 con 0x7f252c104a10 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.886+0000 7f2529ffb640 1 -- 172.21.15.49:0/332898300 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2520004c00 con 0x7f252c104a10 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.886+0000 7f2529ffb640 1 -- 172.21.15.49:0/332898300 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25200038f0 con 0x7f252c104a10 2024-09-19T09:14:07.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.886+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c196180 con 0x7f252c104a10 2024-09-19T09:14:07.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.887+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c100150 con 0x7f252c104a10 2024-09-19T09:14:07.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.888+0000 7f2529ffb640 1 -- 172.21.15.49:0/332898300 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2520003bb0 con 0x7f252c104a10 2024-09-19T09:14:07.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.888+0000 7f2529ffb640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f251406e600 0x7f2514070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.888+0000 7f2529ffb640 1 -- 172.21.15.49:0/332898300 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f25200af9a0 con 0x7f252c104a10 2024-09-19T09:14:07.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.888+0000 7f2530d90640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f251406e600 0x7f2514070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.889+0000 7f2530d90640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f251406e600 0x7f2514070ac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f251c009990 tx=0x7f251c009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:07.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:07.893+0000 7f2529ffb640 1 -- 172.21.15.49:0/332898300 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f25200789e0 con 0x7f252c104a10 2024-09-19T09:14:08.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.103+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f252c0feef0 con 0x7f252c104a10 2024-09-19T09:14:08.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.104+0000 7f2529ffb640 1 -- 172.21.15.49:0/332898300 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5290 (secure 0 0 0) 0x7f2520003e60 con 0x7f252c104a10 2024-09-19T09:14:08.104 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:08.104 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":42,"btime":"2024-09-19T09:10:40:827552+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:40.827533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":1,"incarnation":40,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44371":{"gid":44371,"name":"cephfs.smithi102.snrasw","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6825/4160337930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4160337930},{"type":"v1","addr":"172.21.15.102:6825","nonce":4160337930}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44401":{"gid":44401,"name":"cephfs.smithi102.ojquyx","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6827/801204290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":801204290},{"type":"v1","addr":"172.21.15.102:6827","nonce":801204290}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34448,34416]},"id":1}]} 2024-09-19T09:14:08.105 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 42 2024-09-19T09:14:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f251406e600 msgr2=0x7f2514070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f251406e600 0x7f2514070ac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f251c009990 tx=0x7f251c009110 comp rx=0 tx=0).stop 2024-09-19T09:14:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c104a10 msgr2=0x7f252c19be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c104a10 0x7f252c19be60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2520006010 tx=0x7f25200055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 shutdown_connections 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f251406e600 0x7f2514070ac0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f252c104a10 0x7f252c19be60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 --2- 172.21.15.49:0/332898300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f252c0fea10 0x7f252c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 >> 172.21.15.49:0/332898300 conn(0x7f252c0fa730 msgr2=0x7f252c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 shutdown_connections 2024-09-19T09:14:08.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:08.106+0000 7f2532ff4640 1 -- 172.21.15.49:0/332898300 wait complete. 2024-09-19T09:14:08.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:07 smithi102 ceph-mon[80875]: pgmap v329: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:07 smithi049 ceph-mon[91793]: pgmap v329: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:08.738 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 21, 'max_mds': 2, 'flags': 50} 2024-09-19T09:14:08.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:09.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:08 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/332898300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:14:09.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:08 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/332898300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:14:10.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:09 smithi049 ceph-mon[91793]: pgmap v330: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:10.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:09 smithi102 ceph-mon[80875]: pgmap v330: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 -- 172.21.15.49:0/3380005704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 msgr2=0x7f98e8101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 --2- 172.21.15.49:0/3380005704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e8101130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009880 tx=0x7f98e402a530 comp rx=0 tx=0).stop 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 -- 172.21.15.49:0/3380005704 shutdown_connections 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 --2- 172.21.15.49:0/3380005704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e8101670 0x7f98e8109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 --2- 172.21.15.49:0/3380005704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e8101130 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 -- 172.21.15.49:0/3380005704 >> 172.21.15.49:0/3380005704 conn(0x7f98e80758a0 msgr2=0x7f98e80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 -- 172.21.15.49:0/3380005704 shutdown_connections 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.657+0000 7f98efa55640 1 -- 172.21.15.49:0/3380005704 wait complete. 2024-09-19T09:14:10.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98efa55640 1 Processor -- start 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98efa55640 1 -- start start 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98efa55640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e80fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98efa55640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e8101670 0x7f98e80feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98efa55640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80ff430 con 0x7f98e8100d50 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98efa55640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80ff5a0 con 0x7f98e8101670 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98ed7f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e80fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.658+0000 7f98ed7f1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e80fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41376/0 (socket says 172.21.15.49:41376) 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98ed7f1640 1 -- 172.21.15.49:0/3608441618 learned_addr learned my addr 172.21.15.49:0/3608441618 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98ecff0640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e8101670 0x7f98e80feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98ed7f1640 1 -- 172.21.15.49:0/3608441618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e8101670 msgr2=0x7f98e80feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98ed7f1640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e8101670 0x7f98e80feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98ed7f1640 1 -- 172.21.15.49:0/3608441618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4009560 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98ed7f1640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e80fe9b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f98e402aa50 tx=0x7f98e4032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98de7fc640 1 -- 172.21.15.49:0/3608441618 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e40037c0 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e80ff820 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98de7fc640 1 -- 172.21.15.49:0/3608441618 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98e4005d50 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98de7fc640 1 -- 172.21.15.49:0/3608441618 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e403be30 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.659+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e81a1f60 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.660+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e8068470 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.661+0000 7f98de7fc640 1 -- 172.21.15.49:0/3608441618 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f98e402ad50 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.661+0000 7f98de7fc640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f98d406e590 0x7f98d4070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.661+0000 7f98de7fc640 1 -- 172.21.15.49:0/3608441618 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f98e40af1b0 con 0x7f98e8100d50 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.661+0000 7f98ecff0640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f98d406e590 0x7f98d4070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.662+0000 7f98ecff0640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f98d406e590 0x7f98d4070a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98d8005fd0 tx=0x7f98d8005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.666+0000 7f98de7fc640 1 -- 172.21.15.49:0/3608441618 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f98e40781f0 con 0x7f98e8100d50 2024-09-19T09:14:10.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.877+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f98e80ff820 con 0x7f98e8100d50 2024-09-19T09:14:10.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.878+0000 7f98de7fc640 1 -- 172.21.15.49:0/3608441618 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v42) v1 ==== 107+0+3376 (secure 0 0 0) 0x7f98e4041d40 con 0x7f98e8100d50 2024-09-19T09:14:10.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:10.878 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"btime":"2024-09-19T09:08:58:462639+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:08:58.462637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi102.snrasw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6825/2151748213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2151748213},{"type":"v1","addr":"172.21.15.102:6825","nonce":2151748213}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14478,"qdb_cluster":[14478,24285]},"id":1}]} 2024-09-19T09:14:10.879 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 22 2024-09-19T09:14:10.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f98d406e590 msgr2=0x7f98d4070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f98d406e590 0x7f98d4070a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98d8005fd0 tx=0x7f98d8005850 comp rx=0 tx=0).stop 2024-09-19T09:14:10.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 msgr2=0x7f98e80fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e80fe9b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f98e402aa50 tx=0x7f98e4032bb0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 shutdown_connections 2024-09-19T09:14:10.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f98d406e590 0x7f98d4070a50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98e8101670 0x7f98e80feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 --2- 172.21.15.49:0/3608441618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e8100d50 0x7f98e80fe9b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 >> 172.21.15.49:0/3608441618 conn(0x7f98e80758a0 msgr2=0x7f98e8101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 shutdown_connections 2024-09-19T09:14:10.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:10.880+0000 7f98efa55640 1 -- 172.21.15.49:0/3608441618 wait complete. 2024-09-19T09:14:11.253 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:10 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3608441618' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-19T09:14:11.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:10 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3608441618' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-19T09:14:11.528 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-19T09:14:11.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-19T09:14:11.740 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:12.149 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:11 smithi049 ceph-mon[91793]: pgmap v331: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:12.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:11 smithi102 ceph-mon[80875]: pgmap v331: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:13.222 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:12 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:13.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:13.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 -- 172.21.15.49:0/2081779841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 msgr2=0x7f6030104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 --2- 172.21.15.49:0/2081779841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f6030104dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f602c009880 tx=0x7f602c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 -- 172.21.15.49:0/2081779841 shutdown_connections 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 --2- 172.21.15.49:0/2081779841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60300fe9f0 0x7f60300fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 --2- 172.21.15.49:0/2081779841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f6030104dd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 -- 172.21.15.49:0/2081779841 >> 172.21.15.49:0/2081779841 conn(0x7f60300758a0 msgr2=0x7f60300fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 -- 172.21.15.49:0/2081779841 shutdown_connections 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.489+0000 7f6037a14640 1 -- 172.21.15.49:0/2081779841 wait complete. 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6037a14640 1 Processor -- start 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6037a14640 1 -- start start 2024-09-19T09:14:13.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6037a14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60300fe9f0 0x7f60300fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:13.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6037a14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f60300fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:13.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6037a14640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300fb800 con 0x7f60301049f0 2024-09-19T09:14:13.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6037a14640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300fb940 con 0x7f60300fe9f0 2024-09-19T09:14:13.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6034faf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f60300fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:13.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6034faf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f60300fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41390/0 (socket says 172.21.15.49:41390) 2024-09-19T09:14:13.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.490+0000 7f6034faf640 1 -- 172.21.15.49:0/2499349296 learned_addr learned my addr 172.21.15.49:0/2499349296 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:13.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f60357b0640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60300fe9f0 0x7f60300fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f6034faf640 1 -- 172.21.15.49:0/2499349296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60300fe9f0 msgr2=0x7f60300fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f6034faf640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60300fe9f0 0x7f60300fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f6034faf640 1 -- 172.21.15.49:0/2499349296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c009560 con 0x7f60301049f0 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f6034faf640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f60300fb2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f602000e970 tx=0x7f602000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f60267fc640 1 -- 172.21.15.49:0/2499349296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f602000cc90 con 0x7f60301049f0 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60301a1ca0 con 0x7f60301049f0 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f60267fc640 1 -- 172.21.15.49:0/2499349296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f602000cdf0 con 0x7f60301049f0 2024-09-19T09:14:13.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f60267fc640 1 -- 172.21.15.49:0/2499349296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6020010430 con 0x7f60301049f0 2024-09-19T09:14:13.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.491+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60301a20b0 con 0x7f60301049f0 2024-09-19T09:14:13.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.492+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6030100130 con 0x7f60301049f0 2024-09-19T09:14:13.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.493+0000 7f60267fc640 1 -- 172.21.15.49:0/2499349296 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f60200046c0 con 0x7f60301049f0 2024-09-19T09:14:13.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.494+0000 7f60267fc640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f601c06e5f0 0x7f601c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:13.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.494+0000 7f60267fc640 1 -- 172.21.15.49:0/2499349296 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f6020014070 con 0x7f60301049f0 2024-09-19T09:14:13.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.494+0000 7f60357b0640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f601c06e5f0 0x7f601c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:13.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.495+0000 7f60357b0640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f601c06e5f0 0x7f601c070ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f602c009230 tx=0x7f602c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:13.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.498+0000 7f60267fc640 1 -- 172.21.15.49:0/2499349296 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6020057ce0 con 0x7f60301049f0 2024-09-19T09:14:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.719+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f60300fee50 con 0x7f60301049f0 2024-09-19T09:14:13.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.720+0000 7f60267fc640 1 -- 172.21.15.49:0/2499349296 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v42) v1 ==== 107+0+4936 (secure 0 0 0) 0x7f602005b3a0 con 0x7f60301049f0 2024-09-19T09:14:13.721 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:13.721 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":23,"btime":"2024-09-19T09:08:59:473865+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi049.ibssbl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3608129551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3608129551},{"type":"v1","addr":"172.21.15.49:6827","nonce":3608129551}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:08:58.613453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14478,"mds_1":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi102.snrasw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6825/2151748213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2151748213},{"type":"v1","addr":"172.21.15.102:6825","nonce":2151748213}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14478,"qdb_cluster":[24285,14478]},"id":1}]} 2024-09-19T09:14:13.722 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 23 2024-09-19T09:14:13.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f601c06e5f0 msgr2=0x7f601c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:13.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f601c06e5f0 0x7f601c070ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f602c009230 tx=0x7f602c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 msgr2=0x7f60300fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:13.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f60300fb2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f602000e970 tx=0x7f602000ed70 comp rx=0 tx=0).stop 2024-09-19T09:14:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 shutdown_connections 2024-09-19T09:14:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f601c06e5f0 0x7f601c070ab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60301049f0 0x7f60300fb2c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 --2- 172.21.15.49:0/2499349296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60300fe9f0 0x7f60300fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 >> 172.21.15.49:0/2499349296 conn(0x7f60300758a0 msgr2=0x7f60300fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 shutdown_connections 2024-09-19T09:14:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:13.722+0000 7f6037a14640 1 -- 172.21.15.49:0/2499349296 wait complete. 2024-09-19T09:14:14.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:13 smithi102 ceph-mon[80875]: pgmap v332: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:14:14.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:13 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2499349296' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-19T09:14:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:13 smithi049 ceph-mon[91793]: pgmap v332: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:14.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:14:14.304 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:13 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2499349296' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-19T09:14:14.535 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-09-19T09:14:14.536 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-19T09:14:14.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-19T09:14:14.746 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:16.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:16 smithi102 ceph-mon[80875]: pgmap v333: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:16.285 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:16 smithi049 ceph-mon[91793]: pgmap v333: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 -- 172.21.15.49:0/2039116614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd980ffb40 msgr2=0x7efd980fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/2039116614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd980ffb40 0x7efd980fffa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009880 tx=0x7efd8c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 -- 172.21.15.49:0/2039116614 shutdown_connections 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/2039116614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd980ffb40 0x7efd980fffa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/2039116614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd98105bf0 0x7efd98105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 -- 172.21.15.49:0/2039116614 >> 172.21.15.49:0/2039116614 conn(0x7efd980fb860 msgr2=0x7efd980fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 -- 172.21.15.49:0/2039116614 shutdown_connections 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.637+0000 7efd9c9d4640 1 -- 172.21.15.49:0/2039116614 wait complete. 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9c9d4640 1 Processor -- start 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9c9d4640 1 -- start start 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9c9d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd980ffb40 0x7efd9819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9c9d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd98105bf0 0x7efd9819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9c9d4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9819c340 con 0x7efd98105bf0 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9c9d4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd981958d0 con 0x7efd980ffb40 2024-09-19T09:14:16.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd98105bf0 0x7efd9819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd98105bf0 0x7efd9819bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41412/0 (socket says 172.21.15.49:41412) 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd95d9b640 1 -- 172.21.15.49:0/1199717479 learned_addr learned my addr 172.21.15.49:0/1199717479 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9659c640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd980ffb40 0x7efd9819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd95d9b640 1 -- 172.21.15.49:0/1199717479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd980ffb40 msgr2=0x7efd9819b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd95d9b640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd980ffb40 0x7efd9819b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd95d9b640 1 -- 172.21.15.49:0/1199717479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c009560 con 0x7efd98105bf0 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.638+0000 7efd9659c640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd980ffb40 0x7efd9819b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.639+0000 7efd95d9b640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd98105bf0 0x7efd9819bd20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006010 tx=0x7efd8c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.639+0000 7efd877fe640 1 -- 172.21.15.49:0/1199717479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8c004aa0 con 0x7efd98105bf0 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.639+0000 7efd877fe640 1 -- 172.21.15.49:0/1199717479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd8c031470 con 0x7efd98105bf0 2024-09-19T09:14:16.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.639+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd98195b50 con 0x7efd98105bf0 2024-09-19T09:14:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.639+0000 7efd877fe640 1 -- 172.21.15.49:0/1199717479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8c003940 con 0x7efd98105bf0 2024-09-19T09:14:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.639+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd981960c0 con 0x7efd98105bf0 2024-09-19T09:14:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.640+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd981011f0 con 0x7efd98105bf0 2024-09-19T09:14:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.641+0000 7efd877fe640 1 -- 172.21.15.49:0/1199717479 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efd8c031b90 con 0x7efd98105bf0 2024-09-19T09:14:16.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.641+0000 7efd877fe640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efd8006e600 0x7efd80070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.641+0000 7efd877fe640 1 -- 172.21.15.49:0/1199717479 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7efd8c0af900 con 0x7efd98105bf0 2024-09-19T09:14:16.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.641+0000 7efd9659c640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efd8006e600 0x7efd80070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.642+0000 7efd9659c640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efd8006e600 0x7efd80070ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd880058c0 tx=0x7efd88005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.646+0000 7efd877fe640 1 -- 172.21.15.49:0/1199717479 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7efd8c078940 con 0x7efd98105bf0 2024-09-19T09:14:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.858+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7efd980fffa0 con 0x7efd98105bf0 2024-09-19T09:14:16.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.859+0000 7efd877fe640 1 -- 172.21.15.49:0/1199717479 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v42) v1 ==== 107+0+4932 (secure 0 0 0) 0x7efd8c004c00 con 0x7efd98105bf0 2024-09-19T09:14:16.860 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:16.861 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"btime":"2024-09-19T09:08:59:480211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi049.ibssbl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3608129551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3608129551},{"type":"v1","addr":"172.21.15.49:6827","nonce":3608129551}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:08:59.480206+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14478,"mds_1":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi102.snrasw","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.102:6825/2151748213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":2151748213},{"type":"v1","addr":"172.21.15.102:6825","nonce":2151748213}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14478,"qdb_cluster":[14478]},"id":1}]} 2024-09-19T09:14:16.861 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efd8006e600 msgr2=0x7efd80070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efd8006e600 0x7efd80070ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd880058c0 tx=0x7efd88005850 comp rx=0 tx=0).stop 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd98105bf0 msgr2=0x7efd9819bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd98105bf0 0x7efd9819bd20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006010 tx=0x7efd8c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 shutdown_connections 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efd8006e600 0x7efd80070ac0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd98105bf0 0x7efd9819bd20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 --2- 172.21.15.49:0/1199717479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd980ffb40 0x7efd9819b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 >> 172.21.15.49:0/1199717479 conn(0x7efd980fb860 msgr2=0x7efd980fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 shutdown_connections 2024-09-19T09:14:16.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:16.861+0000 7efd9c9d4640 1 -- 172.21.15.49:0/1199717479 wait complete. 2024-09-19T09:14:17.226 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:17 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1199717479' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-19T09:14:17.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:17 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1199717479' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-19T09:14:17.586 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-09-19T09:14:17.586 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-19T09:14:17.586 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-19T09:14:17.801 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:18.221 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:18 smithi049 ceph-mon[91793]: pgmap v334: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:18.258 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:18 smithi102 ceph-mon[80875]: pgmap v334: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.385+0000 7fcb2d249640 1 -- 172.21.15.49:0/2352008587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 msgr2=0x7fcb280fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.385+0000 7fcb2d249640 1 --2- 172.21.15.49:0/2352008587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb280fee90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009880 tx=0x7fcb1c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.385+0000 7fcb2d249640 1 -- 172.21.15.49:0/2352008587 shutdown_connections 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.385+0000 7fcb2d249640 1 --2- 172.21.15.49:0/2352008587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb280fee90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.385+0000 7fcb2d249640 1 --2- 172.21.15.49:0/2352008587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb28104a30 0x7fcb28104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.385+0000 7fcb2d249640 1 -- 172.21.15.49:0/2352008587 >> 172.21.15.49:0/2352008587 conn(0x7fcb280fa730 msgr2=0x7fcb280fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.386+0000 7fcb2d249640 1 -- 172.21.15.49:0/2352008587 shutdown_connections 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.386+0000 7fcb2d249640 1 -- 172.21.15.49:0/2352008587 wait complete. 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.386+0000 7fcb2d249640 1 Processor -- start 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.386+0000 7fcb2d249640 1 -- start start 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb2d249640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb28100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb2d249640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb28104a30 0x7fcb28100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb2d249640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281025d0 con 0x7fcb280fea30 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb2d249640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28101080 con 0x7fcb28104a30 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb26d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb28100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb26d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb28100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41422/0 (socket says 172.21.15.49:41422) 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb26d9d640 1 -- 172.21.15.49:0/3451318319 learned_addr learned my addr 172.21.15.49:0/3451318319 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb2659c640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb28104a30 0x7fcb28100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb26d9d640 1 -- 172.21.15.49:0/3451318319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb28104a30 msgr2=0x7fcb28100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb26d9d640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb28104a30 0x7fcb28100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb26d9d640 1 -- 172.21.15.49:0/3451318319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c009560 con 0x7fcb280fea30 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.387+0000 7fcb26d9d640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb28100600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c8a0 tx=0x7fcb1800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.388+0000 7fcb0ffff640 1 -- 172.21.15.49:0/3451318319 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb18007b80 con 0x7fcb280fea30 2024-09-19T09:14:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.388+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28101360 con 0x7fcb280fea30 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.388+0000 7fcb0ffff640 1 -- 172.21.15.49:0/3451318319 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb18007ce0 con 0x7fcb280fea30 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.388+0000 7fcb0ffff640 1 -- 172.21.15.49:0/3451318319 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb18018810 con 0x7fcb280fea30 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.388+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb281a1fa0 con 0x7fcb280fea30 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.389+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28100170 con 0x7fcb280fea30 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.389+0000 7fcb0ffff640 1 -- 172.21.15.49:0/3451318319 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcb18018a80 con 0x7fcb280fea30 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.390+0000 7fcb0ffff640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcb1006e5f0 0x7fcb10070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.390+0000 7fcb0ffff640 1 -- 172.21.15.49:0/3451318319 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fcb1808e930 con 0x7fcb280fea30 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.390+0000 7fcb2659c640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcb1006e5f0 0x7fcb10070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.390+0000 7fcb2659c640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcb1006e5f0 0x7fcb10070ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009230 tx=0x7fcb1c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.394+0000 7fcb0ffff640 1 -- 172.21.15.49:0/3451318319 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcb18057970 con 0x7fcb280fea30 2024-09-19T09:14:19.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.607+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fcb280fee90 con 0x7fcb280fea30 2024-09-19T09:14:19.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.608+0000 7fcb0ffff640 1 -- 172.21.15.49:0/3451318319 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v42) v1 ==== 107+0+4134 (secure 0 0 0) 0x7fcb1805b030 con 0x7fcb280fea30 2024-09-19T09:14:19.609 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:19.609 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"btime":"2024-09-19T09:09:20:535183+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi049.ibssbl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3608129551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3608129551},{"type":"v1","addr":"172.21.15.49:6827","nonce":3608129551}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:09:19.677438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14478,"qdb_cluster":[14478]},"id":1}]} 2024-09-19T09:14:19.610 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-09-19T09:14:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcb1006e5f0 msgr2=0x7fcb10070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcb1006e5f0 0x7fcb10070ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009230 tx=0x7fcb1c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 msgr2=0x7fcb28100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb28100600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c8a0 tx=0x7fcb1800cd60 comp rx=0 tx=0).stop 2024-09-19T09:14:19.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 shutdown_connections 2024-09-19T09:14:19.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcb1006e5f0 0x7fcb10070ab0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb28104a30 0x7fcb28100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 --2- 172.21.15.49:0/3451318319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb280fea30 0x7fcb28100600 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 >> 172.21.15.49:0/3451318319 conn(0x7fcb280fa730 msgr2=0x7fcb280fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:19.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 shutdown_connections 2024-09-19T09:14:19.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:19.610+0000 7fcb2d249640 1 -- 172.21.15.49:0/3451318319 wait complete. 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:20 smithi049 ceph-mon[91793]: pgmap v335: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:20.267 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:20 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3451318319' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-19T09:14:20.288 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-19T09:14:20.288 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-19T09:14:20.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-19T09:14:20.496 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:20 smithi102 ceph-mon[80875]: pgmap v335: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:20 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3451318319' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-19T09:14:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 -- 172.21.15.49:0/2780381192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 msgr2=0x7fb024104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/2780381192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb024104e10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb018009880 tx=0x7fb01802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 -- 172.21.15.49:0/2780381192 shutdown_connections 2024-09-19T09:14:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/2780381192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0240fea30 0x7fb0240fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/2780381192 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb024104e10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 -- 172.21.15.49:0/2780381192 >> 172.21.15.49:0/2780381192 conn(0x7fb0240fa730 msgr2=0x7fb0240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 -- 172.21.15.49:0/2780381192 shutdown_connections 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 -- 172.21.15.49:0/2780381192 wait complete. 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.178+0000 7fb02aa7b640 1 Processor -- start 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb02aa7b640 1 -- start start 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb02aa7b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0240fea30 0x7fb0240fb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb02aa7b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb0240fb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb02aa7b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240fbb10 con 0x7fb024104a30 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb02aa7b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240fbc80 con 0x7fb0240fea30 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb023fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb0240fb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb023fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb0240fb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52126/0 (socket says 172.21.15.49:52126) 2024-09-19T09:14:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb023fff640 1 -- 172.21.15.49:0/3973096690 learned_addr learned my addr 172.21.15.49:0/3973096690 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb028817640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0240fea30 0x7fb0240fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb023fff640 1 -- 172.21.15.49:0/3973096690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0240fea30 msgr2=0x7fb0240fb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb023fff640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0240fea30 0x7fb0240fb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb023fff640 1 -- 172.21.15.49:0/3973096690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018009560 con 0x7fb024104a30 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.179+0000 7fb023fff640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb0240fb5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b420 tx=0x7fb01000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.180+0000 7fb021ffb640 1 -- 172.21.15.49:0/3973096690 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb010011800 con 0x7fb024104a30 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.180+0000 7fb021ffb640 1 -- 172.21.15.49:0/3973096690 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb010011e20 con 0x7fb024104a30 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.180+0000 7fb021ffb640 1 -- 172.21.15.49:0/3973096690 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01000f2e0 con 0x7fb024104a30 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.180+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0241a1d70 con 0x7fb024104a30 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.180+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0241a20d0 con 0x7fb024104a30 2024-09-19T09:14:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.181+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024100170 con 0x7fb024104a30 2024-09-19T09:14:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.181+0000 7fb021ffb640 1 -- 172.21.15.49:0/3973096690 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb010010380 con 0x7fb024104a30 2024-09-19T09:14:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.182+0000 7fb021ffb640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb01406e600 0x7fb014070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.182+0000 7fb028817640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb01406e600 0x7fb014070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.182+0000 7fb021ffb640 1 -- 172.21.15.49:0/3973096690 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fb01008e180 con 0x7fb024104a30 2024-09-19T09:14:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.183+0000 7fb028817640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb01406e600 0x7fb014070ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb018000c00 tx=0x7fb018031420 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.187+0000 7fb021ffb640 1 -- 172.21.15.49:0/3973096690 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb0100571c0 con 0x7fb024104a30 2024-09-19T09:14:22.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:22 smithi049 ceph-mon[91793]: pgmap v336: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.401+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fb0240fbe40 con 0x7fb024104a30 2024-09-19T09:14:22.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.401+0000 7fb021ffb640 1 -- 172.21.15.49:0/3973096690 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v42) v1 ==== 107+0+4916 (secure 0 0 0) 0x7fb01005a880 con 0x7fb024104a30 2024-09-19T09:14:22.403 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:22.403 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"btime":"2024-09-19T09:09:21:540738+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi049.ibssbl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3608129551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3608129551},{"type":"v1","addr":"172.21.15.49:6827","nonce":3608129551}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:09:19.677438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14478,"qdb_cluster":[14478]},"id":1}]} 2024-09-19T09:14:22.404 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-09-19T09:14:22.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb01406e600 msgr2=0x7fb014070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb01406e600 0x7fb014070ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb018000c00 tx=0x7fb018031420 comp rx=0 tx=0).stop 2024-09-19T09:14:22.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 msgr2=0x7fb0240fb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb0240fb5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b420 tx=0x7fb01000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 shutdown_connections 2024-09-19T09:14:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fb01406e600 0x7fb014070ac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb024104a30 0x7fb0240fb5d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 --2- 172.21.15.49:0/3973096690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0240fea30 0x7fb0240fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 >> 172.21.15.49:0/3973096690 conn(0x7fb0240fa730 msgr2=0x7fb024068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 shutdown_connections 2024-09-19T09:14:22.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:22.404+0000 7fb02aa7b640 1 -- 172.21.15.49:0/3973096690 wait complete. 2024-09-19T09:14:22.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:22 smithi102 ceph-mon[80875]: pgmap v336: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:23.063 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-19T09:14:23.063 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-19T09:14:23.064 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-19T09:14:23.273 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:23.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:23 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3973096690' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-19T09:14:23.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:23 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3973096690' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-19T09:14:24.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:24 smithi049 ceph-mon[91793]: pgmap v337: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:24 smithi102 ceph-mon[80875]: pgmap v337: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.944+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2850569414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc140fea10 msgr2=0x7fcc140fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.944+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2850569414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc140fea10 0x7fcc140fee70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009880 tx=0x7fcc0402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.944+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2850569414 shutdown_connections 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.944+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2850569414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc140fea10 0x7fcc140fee70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.944+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2850569414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14104a10 0x7fcc14104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.944+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2850569414 >> 172.21.15.49:0/2850569414 conn(0x7fcc140fa730 msgr2=0x7fcc140fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2850569414 shutdown_connections 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2850569414 wait complete. 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 Processor -- start 2024-09-19T09:14:24.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 -- start start 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc140fea10 0x7fcc14197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14104a10 0x7fcc14198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14198900 con 0x7fcc14104a10 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.945+0000 7fcc1b53b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1419c670 con 0x7fcc140fea10 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc18ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14104a10 0x7fcc14198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc18ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14104a10 0x7fcc14198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52142/0 (socket says 172.21.15.49:52142) 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc192d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc140fea10 0x7fcc14197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc18ad6640 1 -- 172.21.15.49:0/2610351856 learned_addr learned my addr 172.21.15.49:0/2610351856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc18ad6640 1 -- 172.21.15.49:0/2610351856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc140fea10 msgr2=0x7fcc14197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc18ad6640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc140fea10 0x7fcc14197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc18ad6640 1 -- 172.21.15.49:0/2610351856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc04009560 con 0x7fcc14104a10 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc18ad6640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14104a10 0x7fcc14198270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcc04006010 tx=0x7fcc040055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc0a7fc640 1 -- 172.21.15.49:0/2610351856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc04004aa0 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc0a7fc640 1 -- 172.21.15.49:0/2610351856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc04031470 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1419c8f0 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc0a7fc640 1 -- 172.21.15.49:0/2610351856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc04003940 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.946+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1419cde0 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.947+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc14100150 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.948+0000 7fcc0a7fc640 1 -- 172.21.15.49:0/2610351856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcc04031b90 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.949+0000 7fcc0a7fc640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc0006e600 0x7fcc00070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.949+0000 7fcc192d7640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc0006e600 0x7fcc00070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.949+0000 7fcc0a7fc640 1 -- 172.21.15.49:0/2610351856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fcc040af780 con 0x7fcc14104a10 2024-09-19T09:14:24.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.949+0000 7fcc192d7640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc0006e600 0x7fcc00070ac0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc10005fd0 tx=0x7fcc1000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:24.953+0000 7fcc0a7fc640 1 -- 172.21.15.49:0/2610351856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcc040788f0 con 0x7fcc14104a10 2024-09-19T09:14:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.164+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fcc140fee70 con 0x7fcc14104a10 2024-09-19T09:14:25.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.165+0000 7fcc0a7fc640 1 -- 172.21.15.49:0/2610351856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v42) v1 ==== 107+0+4137 (secure 0 0 0) 0x7fcc04004c00 con 0x7fcc14104a10 2024-09-19T09:14:25.166 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:25.167 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-19T09:09:34:352450+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:09:19.677438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14478,"qdb_cluster":[14478]},"id":1}]} 2024-09-19T09:14:25.167 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-19T09:14:25.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc0006e600 msgr2=0x7fcc00070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc0006e600 0x7fcc00070ac0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc10005fd0 tx=0x7fcc1000b390 comp rx=0 tx=0).stop 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14104a10 msgr2=0x7fcc14198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14104a10 0x7fcc14198270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcc04006010 tx=0x7fcc040055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 shutdown_connections 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc0006e600 0x7fcc00070ac0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc14104a10 0x7fcc14198270 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 --2- 172.21.15.49:0/2610351856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc140fea10 0x7fcc14197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 >> 172.21.15.49:0/2610351856 conn(0x7fcc140fa730 msgr2=0x7fcc140fba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 shutdown_connections 2024-09-19T09:14:25.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:25.167+0000 7fcc1b53b640 1 -- 172.21.15.49:0/2610351856 wait complete. 2024-09-19T09:14:25.857 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-19T09:14:25.858 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-19T09:14:25.858 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-19T09:14:26.072 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:26.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:26 smithi049 ceph-mon[91793]: pgmap v338: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:26.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:26 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2610351856' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-19T09:14:26.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:26 smithi102 ceph-mon[80875]: pgmap v338: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:26.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:26 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2610351856' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-19T09:14:27.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 -- 172.21.15.49:0/513650482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00fe9f0 msgr2=0x7ff7b00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 --2- 172.21.15.49:0/513650482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00fe9f0 0x7ff7b00fee50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff798009880 tx=0x7ff79802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 -- 172.21.15.49:0/513650482 shutdown_connections 2024-09-19T09:14:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 --2- 172.21.15.49:0/513650482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b00fe9f0 0x7ff7b00fee50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 --2- 172.21.15.49:0/513650482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b01049f0 0x7ff7b0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 -- 172.21.15.49:0/513650482 >> 172.21.15.49:0/513650482 conn(0x7ff7b00758a0 msgr2=0x7ff7b00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 -- 172.21.15.49:0/513650482 shutdown_connections 2024-09-19T09:14:27.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.942+0000 7ff7b495a640 1 -- 172.21.15.49:0/513650482 wait complete. 2024-09-19T09:14:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7b495a640 1 Processor -- start 2024-09-19T09:14:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7b495a640 1 -- start start 2024-09-19T09:14:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7b495a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b00fe9f0 0x7ff7b00fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7b495a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b01049f0 0x7ff7b00fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7b495a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00fb800 con 0x7ff7b01049f0 2024-09-19T09:14:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7b495a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00fb970 con 0x7ff7b00fe9f0 2024-09-19T09:14:27.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7add9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b01049f0 0x7ff7b00fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7add9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b01049f0 0x7ff7b00fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52160/0 (socket says 172.21.15.49:52160) 2024-09-19T09:14:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7add9b640 1 -- 172.21.15.49:0/1316760276 learned_addr learned my addr 172.21.15.49:0/1316760276 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7ae59c640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b00fe9f0 0x7ff7b00fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7add9b640 1 -- 172.21.15.49:0/1316760276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b00fe9f0 msgr2=0x7ff7b00fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7add9b640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b00fe9f0 0x7ff7b00fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.943+0000 7ff7add9b640 1 -- 172.21.15.49:0/1316760276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009560 con 0x7ff7b01049f0 2024-09-19T09:14:27.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.944+0000 7ff7add9b640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b01049f0 0x7ff7b00fb2c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff79802a9c0 tx=0x7ff7980055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:27.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.944+0000 7ff7a77fe640 1 -- 172.21.15.49:0/1316760276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff798004aa0 con 0x7ff7b01049f0 2024-09-19T09:14:27.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.944+0000 7ff7a77fe640 1 -- 172.21.15.49:0/1316760276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff798004c00 con 0x7ff7b01049f0 2024-09-19T09:14:27.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.944+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b00fbbf0 con 0x7ff7b01049f0 2024-09-19T09:14:27.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.944+0000 7ff7a77fe640 1 -- 172.21.15.49:0/1316760276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff798003ab0 con 0x7ff7b01049f0 2024-09-19T09:14:27.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.944+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b01a2020 con 0x7ff7b01049f0 2024-09-19T09:14:27.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.945+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b0100130 con 0x7ff7b01049f0 2024-09-19T09:14:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.945+0000 7ff7a77fe640 1 -- 172.21.15.49:0/1316760276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff798003ce0 con 0x7ff7b01049f0 2024-09-19T09:14:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.946+0000 7ff7a77fe640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff79c06e5f0 0x7ff79c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.946+0000 7ff7a77fe640 1 -- 172.21.15.49:0/1316760276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7ff7980af790 con 0x7ff7b01049f0 2024-09-19T09:14:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.946+0000 7ff7ae59c640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff79c06e5f0 0x7ff79c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.947+0000 7ff7ae59c640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff79c06e5f0 0x7ff79c070ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009890 tx=0x7ff7a8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:27.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:27.950+0000 7ff7a77fe640 1 -- 172.21.15.49:0/1316760276 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff798078770 con 0x7ff7b01049f0 2024-09-19T09:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.165+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7ff7b00fbbf0 con 0x7ff7b01049f0 2024-09-19T09:14:28.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.166+0000 7ff7a77fe640 1 -- 172.21.15.49:0/1316760276 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v42) v1 ==== 107+0+4984 (secure 0 0 0) 0x7ff7b00fbbf0 con 0x7ff7b01049f0 2024-09-19T09:14:28.167 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:28.168 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"btime":"2024-09-19T09:09:40:369123+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:09:19.677438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi049.uujbrc","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6829/2801166372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2801166372},{"type":"v1","addr":"172.21.15.49:6829","nonce":2801166372}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14478,"qdb_cluster":[14478]},"id":1}]} 2024-09-19T09:14:28.168 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 28 2024-09-19T09:14:28.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff79c06e5f0 msgr2=0x7ff79c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff79c06e5f0 0x7ff79c070ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009890 tx=0x7ff7a8008040 comp rx=0 tx=0).stop 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b01049f0 msgr2=0x7ff7b00fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b01049f0 0x7ff7b00fb2c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff79802a9c0 tx=0x7ff7980055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 shutdown_connections 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7ff79c06e5f0 0x7ff79c070ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b01049f0 0x7ff7b00fb2c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 --2- 172.21.15.49:0/1316760276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7b00fe9f0 0x7ff7b00fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 >> 172.21.15.49:0/1316760276 conn(0x7ff7b00758a0 msgr2=0x7ff7b00fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 shutdown_connections 2024-09-19T09:14:28.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:28.168+0000 7ff7b495a640 1 -- 172.21.15.49:0/1316760276 wait complete. 2024-09-19T09:14:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:28 smithi049 ceph-mon[91793]: pgmap v339: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:28.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:28.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:28 smithi102 ceph-mon[80875]: pgmap v339: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:28.826 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-19T09:14:28.826 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-19T09:14:28.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-19T09:14:29.037 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:29.288 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:29 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1316760276' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-19T09:14:29.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:29 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1316760276' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-19T09:14:30.120 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:30 smithi049 ceph-mon[91793]: pgmap v340: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:30.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:30 smithi102 ceph-mon[80875]: pgmap v340: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:30.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 -- 172.21.15.49:0/2600108507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 msgr2=0x7efe54100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 --2- 172.21.15.49:0/2600108507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe54100180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe48009880 tx=0x7efe4802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 -- 172.21.15.49:0/2600108507 shutdown_connections 2024-09-19T09:14:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 --2- 172.21.15.49:0/2600108507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe54100750 0x7efe541047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 --2- 172.21.15.49:0/2600108507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe54100180 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 -- 172.21.15.49:0/2600108507 >> 172.21.15.49:0/2600108507 conn(0x7efe540fb840 msgr2=0x7efe540fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 -- 172.21.15.49:0/2600108507 shutdown_connections 2024-09-19T09:14:30.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.647+0000 7efe5ac52640 1 -- 172.21.15.49:0/2600108507 wait complete. 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe5ac52640 1 Processor -- start 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe5ac52640 1 -- start start 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe5ac52640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe5419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe5ac52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe54100750 0x7efe5419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe5ac52640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5419c480 con 0x7efe540ffda0 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe5ac52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe54195a10 con 0x7efe54100750 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe589ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe5419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe589ee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe5419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39318/0 (socket says 172.21.15.49:39318) 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe589ee640 1 -- 172.21.15.49:0/276894896 learned_addr learned my addr 172.21.15.49:0/276894896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:30.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe53fff640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe54100750 0x7efe5419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe589ee640 1 -- 172.21.15.49:0/276894896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe54100750 msgr2=0x7efe5419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe589ee640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe54100750 0x7efe5419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.648+0000 7efe589ee640 1 -- 172.21.15.49:0/276894896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48009560 con 0x7efe540ffda0 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.649+0000 7efe589ee640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe5419b920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efe4802a9c0 tx=0x7efe480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.649+0000 7efe51ffb640 1 -- 172.21.15.49:0/276894896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe48004aa0 con 0x7efe540ffda0 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.649+0000 7efe51ffb640 1 -- 172.21.15.49:0/276894896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe48004c00 con 0x7efe540ffda0 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.649+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe54195c90 con 0x7efe540ffda0 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.649+0000 7efe51ffb640 1 -- 172.21.15.49:0/276894896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe48003ab0 con 0x7efe540ffda0 2024-09-19T09:14:30.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.649+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe54196180 con 0x7efe540ffda0 2024-09-19T09:14:30.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.650+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe54101280 con 0x7efe540ffda0 2024-09-19T09:14:30.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.651+0000 7efe51ffb640 1 -- 172.21.15.49:0/276894896 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efe48031d20 con 0x7efe540ffda0 2024-09-19T09:14:30.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.651+0000 7efe51ffb640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efe4406e5f0 0x7efe44070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.652+0000 7efe51ffb640 1 -- 172.21.15.49:0/276894896 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7efe480af8b0 con 0x7efe540ffda0 2024-09-19T09:14:30.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.652+0000 7efe53fff640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efe4406e5f0 0x7efe44070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.652+0000 7efe53fff640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efe4406e5f0 0x7efe44070ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe54196e80 tx=0x7efe40008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.656+0000 7efe51ffb640 1 -- 172.21.15.49:0/276894896 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7efe480788f0 con 0x7efe540ffda0 2024-09-19T09:14:30.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.873+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7efe54108100 con 0x7efe540ffda0 2024-09-19T09:14:30.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.874+0000 7efe51ffb640 1 -- 172.21.15.49:0/276894896 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v42) v1 ==== 107+0+4186 (secure 0 0 0) 0x7efe4807bfb0 con 0x7efe540ffda0 2024-09-19T09:14:30.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:30.876 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"btime":"2024-09-19T09:09:52:064471+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:09:52.064462+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:14:30.876 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 29 2024-09-19T09:14:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.876+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efe4406e5f0 msgr2=0x7efe44070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.876+0000 7efe5ac52640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efe4406e5f0 0x7efe44070ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe54196e80 tx=0x7efe40008040 comp rx=0 tx=0).stop 2024-09-19T09:14:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.876+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 msgr2=0x7efe5419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.876+0000 7efe5ac52640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe5419b920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efe4802a9c0 tx=0x7efe480055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.877+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 shutdown_connections 2024-09-19T09:14:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.877+0000 7efe5ac52640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7efe4406e5f0 0x7efe44070ab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.877+0000 7efe5ac52640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe54100750 0x7efe5419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.877+0000 7efe5ac52640 1 --2- 172.21.15.49:0/276894896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe540ffda0 0x7efe5419b920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.877+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 >> 172.21.15.49:0/276894896 conn(0x7efe540fb840 msgr2=0x7efe540fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:30.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.877+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 shutdown_connections 2024-09-19T09:14:30.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:30.877+0000 7efe5ac52640 1 -- 172.21.15.49:0/276894896 wait complete. 2024-09-19T09:14:31.254 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:31 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/276894896' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-19T09:14:31.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:31 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/276894896' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-19T09:14:31.679 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-19T09:14:31.679 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-19T09:14:31.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-19T09:14:31.892 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:32.273 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:32 smithi049 ceph-mon[91793]: pgmap v341: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:32.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:32 smithi102 ceph-mon[80875]: pgmap v341: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:33.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 -- 172.21.15.49:0/1859714681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c0ffe20 msgr2=0x7f619c100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:33.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 --2- 172.21.15.49:0/1859714681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c0ffe20 0x7f619c100200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f618c009880 tx=0x7f618c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 -- 172.21.15.49:0/1859714681 shutdown_connections 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 --2- 172.21.15.49:0/1859714681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619c1007d0 0x7f619c104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 --2- 172.21.15.49:0/1859714681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c0ffe20 0x7f619c100200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 -- 172.21.15.49:0/1859714681 >> 172.21.15.49:0/1859714681 conn(0x7f619c0fb900 msgr2=0x7f619c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 -- 172.21.15.49:0/1859714681 shutdown_connections 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 -- 172.21.15.49:0/1859714681 wait complete. 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 Processor -- start 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.649+0000 7f61a185a640 1 -- start start 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a185a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619c0ffe20 0x7f619c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a185a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c1007d0 0x7f619c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a185a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c073230 con 0x7f619c1007d0 2024-09-19T09:14:33.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a185a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0733a0 con 0x7f619c0ffe20 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f6193fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c1007d0 0x7f619c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f6193fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c1007d0 0x7f619c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39342/0 (socket says 172.21.15.49:39342) 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f6193fff640 1 -- 172.21.15.49:0/4139039676 learned_addr learned my addr 172.21.15.49:0/4139039676 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f619affd640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619c0ffe20 0x7f619c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f6193fff640 1 -- 172.21.15.49:0/4139039676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619c0ffe20 msgr2=0x7f619c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f6193fff640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619c0ffe20 0x7f619c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f6193fff640 1 -- 172.21.15.49:0/4139039676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c009560 con 0x7f619c1007d0 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f619affd640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619c0ffe20 0x7f619c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f6193fff640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c1007d0 0x7f619c072cf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f618400d6f0 tx=0x7f618400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a0858640 1 -- 172.21.15.49:0/4139039676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6184009a30 con 0x7f619c1007d0 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a0858640 1 -- 172.21.15.49:0/4139039676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61840054e0 con 0x7f619c1007d0 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c1a1d60 con 0x7f619c1007d0 2024-09-19T09:14:33.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a0858640 1 -- 172.21.15.49:0/4139039676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6184010460 con 0x7f619c1007d0 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.650+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c1a20c0 con 0x7f619c1007d0 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.651+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c101300 con 0x7f619c1007d0 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.652+0000 7f61a0858640 1 -- 172.21.15.49:0/4139039676 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6184009b90 con 0x7f619c1007d0 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.652+0000 7f61a0858640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f618806e5f0 0x7f6188070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.653+0000 7f61a0858640 1 -- 172.21.15.49:0/4139039676 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f618408e360 con 0x7f619c1007d0 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.653+0000 7f619affd640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f618806e5f0 0x7f6188070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.653+0000 7f619affd640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f618806e5f0 0x7f6188070ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f618c006010 tx=0x7f618c005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:33.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.657+0000 7f61a0858640 1 -- 172.21.15.49:0/4139039676 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f61840573a0 con 0x7f619c1007d0 2024-09-19T09:14:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.869+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f619c1081d0 con 0x7f619c1007d0 2024-09-19T09:14:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.869+0000 7f61a0858640 1 -- 172.21.15.49:0/4139039676 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v42) v1 ==== 107+0+4265 (secure 0 0 0) 0x7f618405aa60 con 0x7f619c1007d0 2024-09-19T09:14:33.870 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:33.870 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"btime":"2024-09-19T09:09:52:069211+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:09:52.069201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:14:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 30 2024-09-19T09:14:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f618806e5f0 msgr2=0x7f6188070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f618806e5f0 0x7f6188070ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f618c006010 tx=0x7f618c005e60 comp rx=0 tx=0).stop 2024-09-19T09:14:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c1007d0 msgr2=0x7f619c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:33.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c1007d0 0x7f619c072cf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f618400d6f0 tx=0x7f618400dbb0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 shutdown_connections 2024-09-19T09:14:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f618806e5f0 0x7f6188070ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f619c1007d0 0x7f619c072cf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 --2- 172.21.15.49:0/4139039676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619c0ffe20 0x7f619c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 >> 172.21.15.49:0/4139039676 conn(0x7f619c0fb900 msgr2=0x7f619c0fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 shutdown_connections 2024-09-19T09:14:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:33.873+0000 7f61a185a640 1 -- 172.21.15.49:0/4139039676 wait complete. 2024-09-19T09:14:34.252 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:34 smithi049 ceph-mon[91793]: pgmap v342: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:34.252 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:34 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/4139039676' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-19T09:14:34.382 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:34 smithi102 ceph-mon[80875]: pgmap v342: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:34.382 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:34 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/4139039676' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-19T09:14:34.566 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-19T09:14:34.566 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-19T09:14:34.567 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-19T09:14:34.782 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:36.193 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:36 smithi049 ceph-mon[91793]: pgmap v343: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:36.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1232339079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 msgr2=0x7fcc281047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1232339079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc281047a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009880 tx=0x7fcc1c02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1232339079 shutdown_connections 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1232339079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc281047a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1232339079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc280ffda0 0x7fcc28100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1232339079 >> 172.21.15.49:0/1232339079 conn(0x7fcc280fb840 msgr2=0x7fcc280fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1232339079 shutdown_connections 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1232339079 wait complete. 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.426+0000 7fcc2d6cd640 1 Processor -- start 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc2d6cd640 1 -- start start 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc2d6cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc280ffda0 0x7fcc280727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:36.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc2d6cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc28072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc2d6cd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28073230 con 0x7fcc28100750 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc2d6cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28073370 con 0x7fcc280ffda0 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc267fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc28072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc267fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc28072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39368/0 (socket says 172.21.15.49:39368) 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc267fc640 1 -- 172.21.15.49:0/1306427017 learned_addr learned my addr 172.21.15.49:0/1306427017 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc26ffd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc280ffda0 0x7fcc280727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc267fc640 1 -- 172.21.15.49:0/1306427017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc280ffda0 msgr2=0x7fcc280727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc267fc640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc280ffda0 0x7fcc280727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.427+0000 7fcc267fc640 1 -- 172.21.15.49:0/1306427017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c009560 con 0x7fcc28100750 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.428+0000 7fcc267fc640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc28072cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c02a9c0 tx=0x7fcc1c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.428+0000 7fcc0ffff640 1 -- 172.21.15.49:0/1306427017 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1c004aa0 con 0x7fcc28100750 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.428+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc280735f0 con 0x7fcc28100750 2024-09-19T09:14:36.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.428+0000 7fcc0ffff640 1 -- 172.21.15.49:0/1306427017 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc1c004c00 con 0x7fcc28100750 2024-09-19T09:14:36.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.428+0000 7fcc0ffff640 1 -- 172.21.15.49:0/1306427017 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1c003980 con 0x7fcc28100750 2024-09-19T09:14:36.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.428+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc281a2000 con 0x7fcc28100750 2024-09-19T09:14:36.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.429+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc28101280 con 0x7fcc28100750 2024-09-19T09:14:36.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.429+0000 7fcc0ffff640 1 -- 172.21.15.49:0/1306427017 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcc1c003bf0 con 0x7fcc28100750 2024-09-19T09:14:36.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.430+0000 7fcc0ffff640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc1006e5f0 0x7fcc10070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:36.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.430+0000 7fcc0ffff640 1 -- 172.21.15.49:0/1306427017 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fcc1c0af780 con 0x7fcc28100750 2024-09-19T09:14:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.430+0000 7fcc26ffd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc1006e5f0 0x7fcc10070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.430+0000 7fcc26ffd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc1006e5f0 0x7fcc10070ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcc18005fd0 tx=0x7fcc1800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:36.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.434+0000 7fcc0ffff640 1 -- 172.21.15.49:0/1306427017 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcc1c078870 con 0x7fcc28100750 2024-09-19T09:14:36.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:36 smithi102 ceph-mon[80875]: pgmap v343: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.646+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fcc28100180 con 0x7fcc28100750 2024-09-19T09:14:36.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.647+0000 7fcc0ffff640 1 -- 172.21.15.49:0/1306427017 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v42) v1 ==== 107+0+5112 (secure 0 0 0) 0x7fcc1c07bf30 con 0x7fcc28100750 2024-09-19T09:14:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:36.648 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"btime":"2024-09-19T09:10:00:186396+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:09:52.069201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:14:36.648 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 31 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc1006e5f0 msgr2=0x7fcc10070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc1006e5f0 0x7fcc10070ab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcc18005fd0 tx=0x7fcc1800b390 comp rx=0 tx=0).stop 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 msgr2=0x7fcc28072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc28072cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c02a9c0 tx=0x7fcc1c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 shutdown_connections 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcc1006e5f0 0x7fcc10070ab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcc28100750 0x7fcc28072cf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 --2- 172.21.15.49:0/1306427017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc280ffda0 0x7fcc280727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 >> 172.21.15.49:0/1306427017 conn(0x7fcc280fb840 msgr2=0x7fcc280fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.649+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 shutdown_connections 2024-09-19T09:14:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:36.650+0000 7fcc2d6cd640 1 -- 172.21.15.49:0/1306427017 wait complete. 2024-09-19T09:14:37.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:37 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1306427017' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-19T09:14:37.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:37 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1306427017' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-19T09:14:37.527 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-19T09:14:37.527 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-19T09:14:37.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-19T09:14:37.742 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:38.229 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:38 smithi049 ceph-mon[91793]: pgmap v344: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:38.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:38 smithi102 ceph-mon[80875]: pgmap v344: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/146337834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 msgr2=0x7f9ea80fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/146337834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea80fee50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009c20 tx=0x7f9e9802a970 comp rx=0 tx=0).stop 2024-09-19T09:14:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/146337834 shutdown_connections 2024-09-19T09:14:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/146337834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea80fee50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/146337834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ea81049f0 0x7f9ea8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/146337834 >> 172.21.15.49:0/146337834 conn(0x7f9ea80758a0 msgr2=0x7f9ea80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/146337834 shutdown_connections 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.310+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/146337834 wait complete. 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eaeb6a640 1 Processor -- start 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eaeb6a640 1 -- start start 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eaeb6a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eaeb6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ea81049f0 0x7f9ea819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eaeb6a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81959f0 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eaeb6a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8195b30 con 0x7f9ea81049f0 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eac906640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eac906640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39378/0 (socket says 172.21.15.49:39378) 2024-09-19T09:14:39.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eac906640 1 -- 172.21.15.49:0/1401963369 learned_addr learned my addr 172.21.15.49:0/1401963369 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9ea7fff640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ea81049f0 0x7f9ea819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eac906640 1 -- 172.21.15.49:0/1401963369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ea81049f0 msgr2=0x7f9ea819bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eac906640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ea81049f0 0x7f9ea819bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.311+0000 7f9eac906640 1 -- 172.21.15.49:0/1401963369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009900 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.312+0000 7f9eac906640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea819b990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000b420 tx=0x7f9e9000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.312+0000 7f9ea5ffb640 1 -- 172.21.15.49:0/1401963369 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e90011800 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.312+0000 7f9ea5ffb640 1 -- 172.21.15.49:0/1401963369 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e90011e20 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.312+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea8195e10 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.312+0000 7f9ea5ffb640 1 -- 172.21.15.49:0/1401963369 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e9000f2e0 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.312+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea8196360 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.313+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea8100130 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.314+0000 7f9ea5ffb640 1 -- 172.21.15.49:0/1401963369 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9e90010380 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.314+0000 7f9ea5ffb640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e9406e5f0 0x7f9e94070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.314+0000 7f9ea5ffb640 1 -- 172.21.15.49:0/1401963369 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f9e9008e0a0 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.314+0000 7f9ea7fff640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e9406e5f0 0x7f9e94070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.315+0000 7f9ea7fff640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e9406e5f0 0x7f9e94070ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8197240 tx=0x7f9e9803d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:39.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.319+0000 7f9ea5ffb640 1 -- 172.21.15.49:0/1401963369 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9e900570e0 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.528+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f9ea80feed0 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.529+0000 7f9ea5ffb640 1 -- 172.21.15.49:0/1401963369 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v42) v1 ==== 107+0+5115 (secure 0 0 0) 0x7f9e9005a7a0 con 0x7f9ea80fe9f0 2024-09-19T09:14:39.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:39.530 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"btime":"2024-09-19T09:10:01:192504+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:00.268069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":7,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:14:39.530 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2024-09-19T09:14:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.531+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e9406e5f0 msgr2=0x7f9e94070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.531+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e9406e5f0 0x7f9e94070ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8197240 tx=0x7f9e9803d040 comp rx=0 tx=0).stop 2024-09-19T09:14:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.531+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 msgr2=0x7f9ea819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.531+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea819b990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000b420 tx=0x7f9e9000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.532+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 shutdown_connections 2024-09-19T09:14:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.532+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f9e9406e5f0 0x7f9e94070ab0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.532+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ea81049f0 0x7f9ea819bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.532+0000 7f9eaeb6a640 1 --2- 172.21.15.49:0/1401963369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ea80fe9f0 0x7f9ea819b990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.532+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 >> 172.21.15.49:0/1401963369 conn(0x7f9ea80758a0 msgr2=0x7f9ea80fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.532+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 shutdown_connections 2024-09-19T09:14:39.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:39.532+0000 7f9eaeb6a640 1 -- 172.21.15.49:0/1401963369 wait complete. 2024-09-19T09:14:40.158 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:40 smithi049 ceph-mon[91793]: pgmap v345: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:40.158 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:40 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1401963369' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-19T09:14:40.182 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-19T09:14:40.182 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-19T09:14:40.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-19T09:14:40.396 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:40.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:40 smithi102 ceph-mon[80875]: pgmap v345: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:40.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:40 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1401963369' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-19T09:14:42.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.061+0000 7feab4092640 1 -- 172.21.15.49:0/420410064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fe400 msgr2=0x7feaac0fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.061+0000 7feab4092640 1 --2- 172.21.15.49:0/420410064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fe400 0x7feaac0fe7e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feaa800a990 tx=0x7feaa802b7d0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 -- 172.21.15.49:0/420410064 shutdown_connections 2024-09-19T09:14:42.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 --2- 172.21.15.49:0/420410064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaac0fedb0 0x7feaac102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 --2- 172.21.15.49:0/420410064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fe400 0x7feaac0fe7e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 -- 172.21.15.49:0/420410064 >> 172.21.15.49:0/420410064 conn(0x7feaac0f9ec0 msgr2=0x7feaac0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 -- 172.21.15.49:0/420410064 shutdown_connections 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 -- 172.21.15.49:0/420410064 wait complete. 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 Processor -- start 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.062+0000 7feab4092640 1 -- start start 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab4092640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaac0fe400 0x7feaac0ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab4092640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fedb0 0x7feaac1003e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab4092640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac100920 con 0x7feaac0fedb0 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab4092640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac100a90 con 0x7feaac0fe400 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab162d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fedb0 0x7feaac1003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab162d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fedb0 0x7feaac1003e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34430/0 (socket says 172.21.15.49:34430) 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab162d640 1 -- 172.21.15.49:0/85653140 learned_addr learned my addr 172.21.15.49:0/85653140 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab1e2e640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaac0fe400 0x7feaac0ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab162d640 1 -- 172.21.15.49:0/85653140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaac0fe400 msgr2=0x7feaac0ffea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab162d640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaac0fe400 0x7feaac0ffea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab162d640 1 -- 172.21.15.49:0/85653140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa800a670 con 0x7feaac0fedb0 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab162d640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fedb0 0x7feaac1003e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00d6f0 tx=0x7fea9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feaa2ffd640 1 -- 172.21.15.49:0/85653140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c009a30 con 0x7feaac0fedb0 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feaa2ffd640 1 -- 172.21.15.49:0/85653140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea9c0054e0 con 0x7feaac0fedb0 2024-09-19T09:14:42.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac1a1c00 con 0x7feaac0fedb0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.063+0000 7feaa2ffd640 1 -- 172.21.15.49:0/85653140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9c010460 con 0x7feaac0fedb0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.064+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac1a1f60 con 0x7feaac0fedb0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.065+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0ff8e0 con 0x7feaac0fedb0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.065+0000 7feaa2ffd640 1 -- 172.21.15.49:0/85653140 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fea9c009b90 con 0x7feaac0fedb0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.066+0000 7feaa2ffd640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fea9806e5f0 0x7fea98070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.066+0000 7feab1e2e640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fea9806e5f0 0x7fea98070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.066+0000 7feaa2ffd640 1 -- 172.21.15.49:0/85653140 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fea9c08e1e0 con 0x7feaac0fedb0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.066+0000 7feab1e2e640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fea9806e5f0 0x7fea98070ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006010 tx=0x7feaa8008760 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:42.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.070+0000 7feaa2ffd640 1 -- 172.21.15.49:0/85653140 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fea9c057350 con 0x7feaac0fedb0 2024-09-19T09:14:42.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.282+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7feaac1087c0 con 0x7feaac0fedb0 2024-09-19T09:14:42.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.282+0000 7feaa2ffd640 1 -- 172.21.15.49:0/85653140 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v42) v1 ==== 107+0+5112 (secure 0 0 0) 0x7fea9c05aa10 con 0x7feaac0fedb0 2024-09-19T09:14:42.283 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:42.283 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"btime":"2024-09-19T09:10:02:196988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:01.200977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T09:14:42.284 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 33 2024-09-19T09:14:42.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fea9806e5f0 msgr2=0x7fea98070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fea9806e5f0 0x7fea98070ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006010 tx=0x7feaa8008760 comp rx=0 tx=0).stop 2024-09-19T09:14:42.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fedb0 msgr2=0x7feaac1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fedb0 0x7feaac1003e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00d6f0 tx=0x7fea9c00dbb0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 shutdown_connections 2024-09-19T09:14:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fea9806e5f0 0x7fea98070ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feaac0fedb0 0x7feaac1003e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 --2- 172.21.15.49:0/85653140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaac0fe400 0x7feaac0ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 >> 172.21.15.49:0/85653140 conn(0x7feaac0f9ec0 msgr2=0x7feaac0fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 shutdown_connections 2024-09-19T09:14:42.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:42.285+0000 7feab4092640 1 -- 172.21.15.49:0/85653140 wait complete. 2024-09-19T09:14:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:42 smithi102 ceph-mon[80875]: pgmap v346: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:42.552 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:42 smithi049 ceph-mon[91793]: pgmap v346: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:42.921 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-19T09:14:42.921 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-19T09:14:42.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-19T09:14:43.132 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:43.253 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:43 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/85653140' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-19T09:14:43.253 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:43.410 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:43 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/85653140' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-19T09:14:43.410 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:44.263 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:44 smithi049 ceph-mon[91793]: pgmap v347: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:44.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:44 smithi102 ceph-mon[80875]: pgmap v347: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:44.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 -- 172.21.15.49:0/425996720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc0fea30 msgr2=0x7f61bc0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 --2- 172.21.15.49:0/425996720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc0fea30 0x7f61bc0fee90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009880 tx=0x7f61ac02a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 -- 172.21.15.49:0/425996720 shutdown_connections 2024-09-19T09:14:44.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 --2- 172.21.15.49:0/425996720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc0fea30 0x7f61bc0fee90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 --2- 172.21.15.49:0/425996720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc104a30 0x7f61bc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 -- 172.21.15.49:0/425996720 >> 172.21.15.49:0/425996720 conn(0x7f61bc0fa730 msgr2=0x7f61bc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 -- 172.21.15.49:0/425996720 shutdown_connections 2024-09-19T09:14:44.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.758+0000 7f61c3be4640 1 -- 172.21.15.49:0/425996720 wait complete. 2024-09-19T09:14:44.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c3be4640 1 Processor -- start 2024-09-19T09:14:44.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c3be4640 1 -- start start 2024-09-19T09:14:44.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c3be4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc0fea30 0x7f61bc19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c3be4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc104a30 0x7f61bc19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c3be4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc19c3b0 con 0x7f61bc104a30 2024-09-19T09:14:44.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c3be4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc195940 con 0x7f61bc0fea30 2024-09-19T09:14:44.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c117f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc104a30 0x7f61bc19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c117f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc104a30 0x7f61bc19bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34448/0 (socket says 172.21.15.49:34448) 2024-09-19T09:14:44.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c117f640 1 -- 172.21.15.49:0/2917177674 learned_addr learned my addr 172.21.15.49:0/2917177674 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.759+0000 7f61c1980640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc0fea30 0x7f61bc19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61c117f640 1 -- 172.21.15.49:0/2917177674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc0fea30 msgr2=0x7f61bc19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61c117f640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc0fea30 0x7f61bc19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61c117f640 1 -- 172.21.15.49:0/2917177674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac009560 con 0x7f61bc104a30 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61c117f640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc104a30 0x7f61bc19bd90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f61ac02a9c0 tx=0x7f61ac0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61b2ffd640 1 -- 172.21.15.49:0/2917177674 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ac004aa0 con 0x7f61bc104a30 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61b2ffd640 1 -- 172.21.15.49:0/2917177674 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61ac004c00 con 0x7f61bc104a30 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc195bc0 con 0x7f61bc104a30 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61b2ffd640 1 -- 172.21.15.49:0/2917177674 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ac003980 con 0x7f61bc104a30 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.760+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc1960b0 con 0x7f61bc104a30 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.761+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc100170 con 0x7f61bc104a30 2024-09-19T09:14:44.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.762+0000 7f61b2ffd640 1 -- 172.21.15.49:0/2917177674 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f61ac003bf0 con 0x7f61bc104a30 2024-09-19T09:14:44.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.762+0000 7f61b2ffd640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f61a806e5f0 0x7f61a8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.763+0000 7f61c1980640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f61a806e5f0 0x7f61a8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.763+0000 7f61b2ffd640 1 -- 172.21.15.49:0/2917177674 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f61ac0af7a0 con 0x7f61bc104a30 2024-09-19T09:14:44.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.763+0000 7f61c1980640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f61a806e5f0 0x7f61a8070ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f61b8005fd0 tx=0x7f61b800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.767+0000 7f61b2ffd640 1 -- 172.21.15.49:0/2917177674 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f61ac078890 con 0x7f61bc104a30 2024-09-19T09:14:44.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.979+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f61bc107fb0 con 0x7f61bc104a30 2024-09-19T09:14:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.980+0000 7f61b2ffd640 1 -- 172.21.15.49:0/2917177674 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v42) v1 ==== 107+0+5121 (secure 0 0 0) 0x7f61ac07bf50 con 0x7f61bc104a30 2024-09-19T09:14:44.982 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"btime":"2024-09-19T09:10:03:202149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44319,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/3508743177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3508743177},{"type":"v1","addr":"172.21.15.102:6825","nonce":3508743177}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:03.202146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-19T09:14:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 34 2024-09-19T09:14:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f61a806e5f0 msgr2=0x7f61a8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f61a806e5f0 0x7f61a8070ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f61b8005fd0 tx=0x7f61b800b390 comp rx=0 tx=0).stop 2024-09-19T09:14:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc104a30 msgr2=0x7f61bc19bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc104a30 0x7f61bc19bd90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f61ac02a9c0 tx=0x7f61ac0055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 shutdown_connections 2024-09-19T09:14:44.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f61a806e5f0 0x7f61a8070ab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61bc104a30 0x7f61bc19bd90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 --2- 172.21.15.49:0/2917177674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc0fea30 0x7f61bc19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 >> 172.21.15.49:0/2917177674 conn(0x7f61bc0fa730 msgr2=0x7f61bc068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 shutdown_connections 2024-09-19T09:14:44.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:44.982+0000 7f61c3be4640 1 -- 172.21.15.49:0/2917177674 wait complete. 2024-09-19T09:14:45.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:45 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2917177674' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-19T09:14:45.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:45 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2917177674' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-19T09:14:45.636 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-19T09:14:45.637 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-19T09:14:45.637 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-19T09:14:45.849 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:46.291 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:46 smithi049 ceph-mon[91793]: pgmap v348: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:46.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:46 smithi102 ceph-mon[80875]: pgmap v348: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 -- 172.21.15.49:0/3741766581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc41049f0 msgr2=0x7fadc4104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 --2- 172.21.15.49:0/3741766581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc41049f0 0x7fadc4104dd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009880 tx=0x7fadb802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 -- 172.21.15.49:0/3741766581 shutdown_connections 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 --2- 172.21.15.49:0/3741766581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadc40fe9f0 0x7fadc40fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 --2- 172.21.15.49:0/3741766581 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc41049f0 0x7fadc4104dd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 -- 172.21.15.49:0/3741766581 >> 172.21.15.49:0/3741766581 conn(0x7fadc40758a0 msgr2=0x7fadc40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 -- 172.21.15.49:0/3741766581 shutdown_connections 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.586+0000 7fadcb129640 1 -- 172.21.15.49:0/3741766581 wait complete. 2024-09-19T09:14:47.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadcb129640 1 Processor -- start 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadcb129640 1 -- start start 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadcb129640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc40fe9f0 0x7fadc419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadcb129640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadc41049f0 0x7fadc419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadcb129640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc419b350 con 0x7fadc40fe9f0 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadcb129640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc41948e0 con 0x7fadc41049f0 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadc8ec5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc40fe9f0 0x7fadc419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadc8ec5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc40fe9f0 0x7fadc419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34470/0 (socket says 172.21.15.49:34470) 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadc8ec5640 1 -- 172.21.15.49:0/878404902 learned_addr learned my addr 172.21.15.49:0/878404902 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadc3fff640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadc41049f0 0x7fadc419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadc8ec5640 1 -- 172.21.15.49:0/878404902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadc41049f0 msgr2=0x7fadc419ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadc8ec5640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadc41049f0 0x7fadc419ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.587+0000 7fadc8ec5640 1 -- 172.21.15.49:0/878404902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb8009560 con 0x7fadc40fe9f0 2024-09-19T09:14:47.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.588+0000 7fadc8ec5640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc40fe9f0 0x7fadc419a7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fadb802a9c0 tx=0x7fadb80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.588+0000 7fadc1ffb640 1 -- 172.21.15.49:0/878404902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadb8004aa0 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.588+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc4194b60 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.588+0000 7fadc1ffb640 1 -- 172.21.15.49:0/878404902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadb8004c00 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.588+0000 7fadc1ffb640 1 -- 172.21.15.49:0/878404902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadb8003ab0 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.588+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc4195050 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.589+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc4100130 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.589+0000 7fadc1ffb640 1 -- 172.21.15.49:0/878404902 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fadb8003ce0 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.590+0000 7fadc1ffb640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fadb406e5f0 0x7fadb4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.590+0000 7fadc1ffb640 1 -- 172.21.15.49:0/878404902 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fadb80af8a0 con 0x7fadc40fe9f0 2024-09-19T09:14:47.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.590+0000 7fadc3fff640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fadb406e5f0 0x7fadb4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.590+0000 7fadc3fff640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fadb406e5f0 0x7fadb4070ab0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fadc4195d50 tx=0x7fadb0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.595+0000 7fadc1ffb640 1 -- 172.21.15.49:0/878404902 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fadb80788e0 con 0x7fadc40fe9f0 2024-09-19T09:14:47.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.807+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fadc40feed0 con 0x7fadc40fe9f0 2024-09-19T09:14:47.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.807+0000 7fadc1ffb640 1 -- 172.21.15.49:0/878404902 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v42) v1 ==== 107+0+4339 (secure 0 0 0) 0x7fadb807bfa0 con 0x7fadc40fe9f0 2024-09-19T09:14:47.808 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:47.808 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":35,"btime":"2024-09-19T09:10:13:527242+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:03.202146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-19T09:14:47.809 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 35 2024-09-19T09:14:47.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fadb406e5f0 msgr2=0x7fadb4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fadb406e5f0 0x7fadb4070ab0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fadc4195d50 tx=0x7fadb0008040 comp rx=0 tx=0).stop 2024-09-19T09:14:47.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc40fe9f0 msgr2=0x7fadc419a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc40fe9f0 0x7fadc419a7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fadb802a9c0 tx=0x7fadb80055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 shutdown_connections 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fadb406e5f0 0x7fadb4070ab0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadc41049f0 0x7fadc419ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 --2- 172.21.15.49:0/878404902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadc40fe9f0 0x7fadc419a7f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 >> 172.21.15.49:0/878404902 conn(0x7fadc40758a0 msgr2=0x7fadc40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 shutdown_connections 2024-09-19T09:14:47.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:47.810+0000 7fadcb129640 1 -- 172.21.15.49:0/878404902 wait complete. 2024-09-19T09:14:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:48 smithi102 ceph-mon[80875]: pgmap v349: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:48 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/878404902' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-19T09:14:48.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:48 smithi049 ceph-mon[91793]: pgmap v349: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:48.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:48 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/878404902' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-19T09:14:48.570 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-19T09:14:48.571 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-19T09:14:48.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-19T09:14:48.782 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:50.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:50 smithi049 ceph-mon[91793]: pgmap v350: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:50.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:50 smithi102 ceph-mon[80875]: pgmap v350: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 -- 172.21.15.49:0/2535478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70100c60 msgr2=0x7f0f70101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 --2- 172.21.15.49:0/2535478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70100c60 0x7f0f70101040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0098b0 tx=0x7f0f6c02a4d0 comp rx=0 tx=0).stop 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 -- 172.21.15.49:0/2535478 shutdown_connections 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 --2- 172.21.15.49:0/2535478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f70101610 0x7f0f70109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 --2- 172.21.15.49:0/2535478 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70100c60 0x7f0f70101040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 -- 172.21.15.49:0/2535478 >> 172.21.15.49:0/2535478 conn(0x7f0f700fa730 msgr2=0x7f0f700fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 -- 172.21.15.49:0/2535478 shutdown_connections 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.584+0000 7f0f7737f640 1 -- 172.21.15.49:0/2535478 wait complete. 2024-09-19T09:14:50.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7737f640 1 Processor -- start 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7737f640 1 -- start start 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7737f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f70100c60 0x7f0f700fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7737f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70101610 0x7f0f700fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7737f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700ff3d0 con 0x7f0f70101610 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7737f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700ff540 con 0x7f0f70100c60 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7491a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70101610 0x7f0f700fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7491a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70101610 0x7f0f700fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41138/0 (socket says 172.21.15.49:41138) 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7491a640 1 -- 172.21.15.49:0/1917878580 learned_addr learned my addr 172.21.15.49:0/1917878580 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.585+0000 7f0f7511b640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f70100c60 0x7f0f700fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f7491a640 1 -- 172.21.15.49:0/1917878580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f70100c60 msgr2=0x7f0f700fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f7491a640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f70100c60 0x7f0f700fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:50.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f7491a640 1 -- 172.21.15.49:0/1917878580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c009560 con 0x7f0f70101610 2024-09-19T09:14:50.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f7491a640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70101610 0x7f0f700fee90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000d8d0 tx=0x7f0f6000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f667fc640 1 -- 172.21.15.49:0/1917878580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6000bea0 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f667fc640 1 -- 172.21.15.49:0/1917878580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f60009c00 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f701a1c90 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f667fc640 1 -- 172.21.15.49:0/1917878580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6000f710 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.586+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f701a1ff0 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.587+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f70068d30 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.587+0000 7f0f667fc640 1 -- 172.21.15.49:0/1917878580 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0f60010460 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.588+0000 7f0f667fc640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f5c06e5f0 0x7f0f5c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.588+0000 7f0f667fc640 1 -- 172.21.15.49:0/1917878580 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f0f6008e490 con 0x7f0f70101610 2024-09-19T09:14:50.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.588+0000 7f0f7511b640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f5c06e5f0 0x7f0f5c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:50.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.589+0000 7f0f7511b640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f5c06e5f0 0x7f0f5c070ab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009230 tx=0x7f0f6c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:50.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.592+0000 7f0f667fc640 1 -- 172.21.15.49:0/1917878580 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0f60057550 con 0x7f0f70101610 2024-09-19T09:14:50.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.811+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f0f700ff700 con 0x7f0f70101610 2024-09-19T09:14:50.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.812+0000 7f0f667fc640 1 -- 172.21.15.49:0/1917878580 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v42) v1 ==== 107+0+5189 (secure 0 0 0) 0x7f0f700ff700 con 0x7f0f70101610 2024-09-19T09:14:50.814 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:50.814 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"btime":"2024-09-19T09:10:18:541757+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44313,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/2534703038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":2534703038},{"type":"v1","addr":"172.21.15.102:6827","nonce":2534703038}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44371,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/4160337930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4160337930},{"type":"v1","addr":"172.21.15.102:6825","nonce":4160337930}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:03.202146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-19T09:14:50.814 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 36 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f5c06e5f0 msgr2=0x7f0f5c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f5c06e5f0 0x7f0f5c070ab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009230 tx=0x7f0f6c005a20 comp rx=0 tx=0).stop 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70101610 msgr2=0x7f0f700fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70101610 0x7f0f700fee90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000d8d0 tx=0x7f0f6000dd90 comp rx=0 tx=0).stop 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 shutdown_connections 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0f5c06e5f0 0x7f0f5c070ab0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f70101610 0x7f0f700fee90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 --2- 172.21.15.49:0/1917878580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f70100c60 0x7f0f700fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 >> 172.21.15.49:0/1917878580 conn(0x7f0f700fa730 msgr2=0x7f0f70101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:50.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 shutdown_connections 2024-09-19T09:14:50.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:50.814+0000 7f0f7737f640 1 -- 172.21.15.49:0/1917878580 wait complete. 2024-09-19T09:14:51.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:51 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1917878580' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-19T09:14:51.493 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-19T09:14:51.494 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-19T09:14:51.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-19T09:14:51.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:51 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1917878580' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-19T09:14:51.703 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:52 smithi102 ceph-mon[80875]: pgmap v351: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:52.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:52 smithi049 ceph-mon[91793]: pgmap v351: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:53.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 -- 172.21.15.49:0/53662425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 msgr2=0x7f3eec104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 --2- 172.21.15.49:0/53662425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec104df0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009880 tx=0x7f3ee402a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 -- 172.21.15.49:0/53662425 shutdown_connections 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 --2- 172.21.15.49:0/53662425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3eec0fea10 0x7f3eec0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 --2- 172.21.15.49:0/53662425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec104df0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 -- 172.21.15.49:0/53662425 >> 172.21.15.49:0/53662425 conn(0x7f3eec0fa730 msgr2=0x7f3eec0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 -- 172.21.15.49:0/53662425 shutdown_connections 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.431+0000 7f3ef477d640 1 -- 172.21.15.49:0/53662425 wait complete. 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef477d640 1 Processor -- start 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef477d640 1 -- start start 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef477d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3eec0fea10 0x7f3eec19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef477d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef477d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec19e580 con 0x7f3eec104a10 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef477d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec197b00 con 0x7f3eec0fea10 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef1d18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef1d18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41154/0 (socket says 172.21.15.49:41154) 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef1d18640 1 -- 172.21.15.49:0/2954590875 learned_addr learned my addr 172.21.15.49:0/2954590875 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef2519640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3eec0fea10 0x7f3eec19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef1d18640 1 -- 172.21.15.49:0/2954590875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3eec0fea10 msgr2=0x7f3eec19d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef1d18640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3eec0fea10 0x7f3eec19d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.432+0000 7f3ef1d18640 1 -- 172.21.15.49:0/2954590875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4009560 con 0x7f3eec104a10 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.433+0000 7f3ef1d18640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec19def0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000cc60 tx=0x7f3ee000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.433+0000 7f3eeb7fe640 1 -- 172.21.15.49:0/2954590875 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee0004b20 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.433+0000 7f3eeb7fe640 1 -- 172.21.15.49:0/2954590875 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ee0004c80 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.433+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec197de0 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.433+0000 7f3eeb7fe640 1 -- 172.21.15.49:0/2954590875 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee000f640 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.433+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec198330 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.434+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec100150 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.434+0000 7f3eeb7fe640 1 -- 172.21.15.49:0/2954590875 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3ee00055e0 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.435+0000 7f3eeb7fe640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3ed406e5f0 0x7f3ed4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.435+0000 7f3eeb7fe640 1 -- 172.21.15.49:0/2954590875 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f3ee008e880 con 0x7f3eec104a10 2024-09-19T09:14:53.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.435+0000 7f3ef2519640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3ed406e5f0 0x7f3ed4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.436+0000 7f3ef2519640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3ed406e5f0 0x7f3ed4070ab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009230 tx=0x7f3ee40058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.439+0000 7f3eeb7fe640 1 -- 172.21.15.49:0/2954590875 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3ee00579f0 con 0x7f3eec104a10 2024-09-19T09:14:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.653+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f3eec0fee70 con 0x7f3eec104a10 2024-09-19T09:14:53.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.653+0000 7f3eeb7fe640 1 -- 172.21.15.49:0/2954590875 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v42) v1 ==== 107+0+4407 (secure 0 0 0) 0x7f3ee005b0b0 con 0x7f3eec104a10 2024-09-19T09:14:53.655 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:53.655 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":37,"btime":"2024-09-19T09:10:28:282249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44371,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/4160337930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4160337930},{"type":"v1","addr":"172.21.15.102:6825","nonce":4160337930}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:03.202146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-19T09:14:53.655 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 37 2024-09-19T09:14:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3ed406e5f0 msgr2=0x7f3ed4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3ed406e5f0 0x7f3ed4070ab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009230 tx=0x7f3ee40058d0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 msgr2=0x7f3eec19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec19def0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000cc60 tx=0x7f3ee000a620 comp rx=0 tx=0).stop 2024-09-19T09:14:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 shutdown_connections 2024-09-19T09:14:53.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f3ed406e5f0 0x7f3ed4070ab0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3eec104a10 0x7f3eec19def0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 --2- 172.21.15.49:0/2954590875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3eec0fea10 0x7f3eec19d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 >> 172.21.15.49:0/2954590875 conn(0x7f3eec0fa730 msgr2=0x7f3eec0fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 shutdown_connections 2024-09-19T09:14:53.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:53.655+0000 7f3ef477d640 1 -- 172.21.15.49:0/2954590875 wait complete. 2024-09-19T09:14:54.219 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:54 smithi049 ceph-mon[91793]: pgmap v352: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:54.220 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:54 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2954590875' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-19T09:14:54.242 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-19T09:14:54.242 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-19T09:14:54.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-19T09:14:54.450 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:54.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:54 smithi102 ceph-mon[80875]: pgmap v352: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:14:54.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:54 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2954590875' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-19T09:14:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 -- 172.21.15.49:0/2220748412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2438105c00 msgr2=0x7f2438105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 --2- 172.21.15.49:0/2220748412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2438105c00 0x7f2438105fe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2428009880 tx=0x7f242802a4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 -- 172.21.15.49:0/2220748412 shutdown_connections 2024-09-19T09:14:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 --2- 172.21.15.49:0/2220748412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24380ffb50 0x7f24380fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 --2- 172.21.15.49:0/2220748412 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2438105c00 0x7f2438105fe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 -- 172.21.15.49:0/2220748412 >> 172.21.15.49:0/2220748412 conn(0x7f24380fb830 msgr2=0x7f24380fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 -- 172.21.15.49:0/2220748412 shutdown_connections 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.071+0000 7f243ce7b640 1 -- 172.21.15.49:0/2220748412 wait complete. 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243ce7b640 1 Processor -- start 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243ce7b640 1 -- start start 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243ce7b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24380ffb50 0x7f24380727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243ce7b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2438105c00 0x7f2438072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243ce7b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438073230 con 0x7f24380ffb50 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243ce7b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380733a0 con 0x7f2438105c00 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24380ffb50 0x7f24380727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24380ffb50 0x7f24380727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41172/0 (socket says 172.21.15.49:41172) 2024-09-19T09:14:56.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f243659c640 1 -- 172.21.15.49:0/3692235480 learned_addr learned my addr 172.21.15.49:0/3692235480 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.072+0000 7f2435d9b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2438105c00 0x7f2438072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f243659c640 1 -- 172.21.15.49:0/3692235480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2438105c00 msgr2=0x7f2438072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f243659c640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2438105c00 0x7f2438072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f243659c640 1 -- 172.21.15.49:0/3692235480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428009560 con 0x7f24380ffb50 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f243659c640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24380ffb50 0x7f24380727b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f242802a9c0 tx=0x7f24280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f24277fe640 1 -- 172.21.15.49:0/3692235480 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2428004aa0 con 0x7f24380ffb50 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f24277fe640 1 -- 172.21.15.49:0/3692235480 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2428004c00 con 0x7f24380ffb50 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f24277fe640 1 -- 172.21.15.49:0/3692235480 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2428003a20 con 0x7f24380ffb50 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2438073620 con 0x7f24380ffb50 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.073+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24381a2040 con 0x7f24380ffb50 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.075+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2438101200 con 0x7f24380ffb50 2024-09-19T09:14:56.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.075+0000 7f24277fe640 1 -- 172.21.15.49:0/3692235480 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2428031c90 con 0x7f24380ffb50 2024-09-19T09:14:56.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.076+0000 7f24277fe640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f242006e5f0 0x7f2420070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:56.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.076+0000 7f24277fe640 1 -- 172.21.15.49:0/3692235480 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f24280af610 con 0x7f24380ffb50 2024-09-19T09:14:56.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.076+0000 7f2435d9b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f242006e5f0 0x7f2420070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:56.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.076+0000 7f2435d9b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f242006e5f0 0x7f2420070ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2438073f30 tx=0x7f242c009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:56.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.080+0000 7f24277fe640 1 -- 172.21.15.49:0/3692235480 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f24280786d0 con 0x7f24380ffb50 2024-09-19T09:14:56.155 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:56 smithi049 ceph-mon[91793]: pgmap v353: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:56.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.308+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f2438073620 con 0x7f24380ffb50 2024-09-19T09:14:56.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.309+0000 7f24277fe640 1 -- 172.21.15.49:0/3692235480 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v42) v1 ==== 107+0+5254 (secure 0 0 0) 0x7f2438073620 con 0x7f24380ffb50 2024-09-19T09:14:56.310 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:56.310 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"btime":"2024-09-19T09:10:32:298126+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44371,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/4160337930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4160337930},{"type":"v1","addr":"172.21.15.102:6825","nonce":4160337930}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44401,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/801204290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":801204290},{"type":"v1","addr":"172.21.15.102:6827","nonce":801204290}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:03.202146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-19T09:14:56.311 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 38 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f242006e5f0 msgr2=0x7f2420070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f242006e5f0 0x7f2420070ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2438073f30 tx=0x7f242c009110 comp rx=0 tx=0).stop 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24380ffb50 msgr2=0x7f24380727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24380ffb50 0x7f24380727b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f242802a9c0 tx=0x7f24280055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 shutdown_connections 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f242006e5f0 0x7f2420070ab0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2438105c00 0x7f2438072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 --2- 172.21.15.49:0/3692235480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24380ffb50 0x7f24380727b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:56.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.311+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 >> 172.21.15.49:0/3692235480 conn(0x7f24380fb830 msgr2=0x7f24380fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:56.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.312+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 shutdown_connections 2024-09-19T09:14:56.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:56.312+0000 7f243ce7b640 1 -- 172.21.15.49:0/3692235480 wait complete. 2024-09-19T09:14:56.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:56 smithi102 ceph-mon[80875]: pgmap v353: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:14:56.925 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-19T09:14:56.925 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-09-19T09:14:56.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-19T09:14:57.148 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:14:57.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:57 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3692235480' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-19T09:14:57.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:57 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3692235480' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-19T09:14:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:58 smithi049 ceph-mon[91793]: pgmap v354: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:58.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:14:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:58.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:58 smithi102 ceph-mon[80875]: pgmap v354: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:14:58.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:14:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/1797622746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 msgr2=0x7f0b14101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/1797622746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b14101090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009880 tx=0x7f0b0c02a530 comp rx=0 tx=0).stop 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/1797622746 shutdown_connections 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/1797622746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b141015d0 0x7f0b14109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/1797622746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b14101090 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/1797622746 >> 172.21.15.49:0/1797622746 conn(0x7f0b140758a0 msgr2=0x7f0b140fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/1797622746 shutdown_connections 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.996+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/1797622746 wait complete. 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1c4b6640 1 Processor -- start 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1c4b6640 1 -- start start 2024-09-19T09:14:59.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1c4b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b140fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1c4b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b141015d0 0x7f0b140fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1c4b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140ff390 con 0x7f0b14100cb0 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1c4b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140ff4d0 con 0x7f0b141015d0 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1a252640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b140fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1a252640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b140fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41178/0 (socket says 172.21.15.49:41178) 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.997+0000 7f0b1a252640 1 -- 172.21.15.49:0/2078818281 learned_addr learned my addr 172.21.15.49:0/2078818281 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b19a51640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b141015d0 0x7f0b140fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b1a252640 1 -- 172.21.15.49:0/2078818281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b141015d0 msgr2=0x7f0b140fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b1a252640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b141015d0 0x7f0b140fee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b1a252640 1 -- 172.21.15.49:0/2078818281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c009560 con 0x7f0b14100cb0 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b1a252640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b140fe910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c006010 tx=0x7f0b0c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:59.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b137fe640 1 -- 172.21.15.49:0/2078818281 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c004aa0 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b137fe640 1 -- 172.21.15.49:0/2078818281 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b0c004c00 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b140ff750 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b137fe640 1 -- 172.21.15.49:0/2078818281 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c003a20 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.998+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b141a20f0 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:58.999+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b14068510 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.000+0000 7f0b137fe640 1 -- 172.21.15.49:0/2078818281 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0b0c02ad50 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.000+0000 7f0b137fe640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0afc06e600 0x7f0afc070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.000+0000 7f0b137fe640 1 -- 172.21.15.49:0/2078818281 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f0b0c0af660 con 0x7f0b14100cb0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.000+0000 7f0b19a51640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0afc06e600 0x7f0afc070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.001+0000 7f0b19a51640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0afc06e600 0x7f0afc070ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b14100410 tx=0x7f0b08008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:59.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.005+0000 7f0b137fe640 1 -- 172.21.15.49:0/2078818281 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0b0c078720 con 0x7f0b14100cb0 2024-09-19T09:14:59.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.218+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f0b14101110 con 0x7f0b14100cb0 2024-09-19T09:14:59.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.219+0000 7f0b137fe640 1 -- 172.21.15.49:0/2078818281 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v42) v1 ==== 107+0+5254 (secure 0 0 0) 0x7f0b0c07bde0 con 0x7f0b14100cb0 2024-09-19T09:14:59.221 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:14:59.221 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"btime":"2024-09-19T09:10:39:808257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44371,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/4160337930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4160337930},{"type":"v1","addr":"172.21.15.102:6825","nonce":4160337930}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44401,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/801204290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":801204290},{"type":"v1","addr":"172.21.15.102:6827","nonce":801204290}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:38.812574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-19T09:14:59.221 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2024-09-19T09:14:59.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0afc06e600 msgr2=0x7f0afc070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0afc06e600 0x7f0afc070ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b14100410 tx=0x7f0b08008040 comp rx=0 tx=0).stop 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 msgr2=0x7f0b140fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b140fe910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c006010 tx=0x7f0b0c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 shutdown_connections 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f0afc06e600 0x7f0afc070ac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b141015d0 0x7f0b140fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 --2- 172.21.15.49:0/2078818281 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b14100cb0 0x7f0b140fe910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 >> 172.21.15.49:0/2078818281 conn(0x7f0b140758a0 msgr2=0x7f0b14102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:59.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 shutdown_connections 2024-09-19T09:14:59.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:14:59.221+0000 7f0b1c4b6640 1 -- 172.21.15.49:0/2078818281 wait complete. 2024-09-19T09:14:59.849 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-09-19T09:14:59.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-19T09:15:00.060 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:15:00.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:00 smithi102 ceph-mon[80875]: pgmap v355: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:00.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:00 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2078818281' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-19T09:15:00.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:00 smithi049 ceph-mon[91793]: pgmap v355: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:00.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:00 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2078818281' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1951482890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 msgr2=0x7f4fe0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1951482890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe0104e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009880 tx=0x7f4fd002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1951482890 shutdown_connections 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1951482890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fe00fea30 0x7f4fe00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1951482890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe0104e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1951482890 >> 172.21.15.49:0/1951482890 conn(0x7f4fe00fa730 msgr2=0x7f4fe00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1951482890 shutdown_connections 2024-09-19T09:15:01.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.668+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1951482890 wait complete. 2024-09-19T09:15:01.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fe4df8640 1 Processor -- start 2024-09-19T09:15:01.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fe4df8640 1 -- start start 2024-09-19T09:15:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fe4df8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fe00fea30 0x7f4fe019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fe4df8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fe4df8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe019c460 con 0x7f4fe0104a30 2024-09-19T09:15:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fe4df8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe01959f0 con 0x7f4fe00fea30 2024-09-19T09:15:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fddd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fddd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54072/0 (socket says 172.21.15.49:54072) 2024-09-19T09:15:01.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fddd9b640 1 -- 172.21.15.49:0/1266432576 learned_addr learned my addr 172.21.15.49:0/1266432576 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.669+0000 7f4fde59c640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fe00fea30 0x7f4fe019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fddd9b640 1 -- 172.21.15.49:0/1266432576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fe00fea30 msgr2=0x7f4fe019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fddd9b640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fe00fea30 0x7f4fe019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fddd9b640 1 -- 172.21.15.49:0/1266432576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0009560 con 0x7f4fe0104a30 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fddd9b640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe019be40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b420 tx=0x7f4fd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fcf7fe640 1 -- 172.21.15.49:0/1266432576 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd4011800 con 0x7f4fe0104a30 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe0195cd0 con 0x7f4fe0104a30 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fcf7fe640 1 -- 172.21.15.49:0/1266432576 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4fd4011e20 con 0x7f4fe0104a30 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.670+0000 7f4fcf7fe640 1 -- 172.21.15.49:0/1266432576 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd400f2e0 con 0x7f4fe0104a30 2024-09-19T09:15:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.671+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe0196220 con 0x7f4fe0104a30 2024-09-19T09:15:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.671+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe0100170 con 0x7f4fe0104a30 2024-09-19T09:15:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.672+0000 7f4fcf7fe640 1 -- 172.21.15.49:0/1266432576 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4fd4010380 con 0x7f4fe0104a30 2024-09-19T09:15:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.672+0000 7f4fcf7fe640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fc806e5f0 0x7f4fc8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.672+0000 7f4fcf7fe640 1 -- 172.21.15.49:0/1266432576 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f4fd408e0a0 con 0x7f4fe0104a30 2024-09-19T09:15:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.672+0000 7f4fde59c640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fc806e5f0 0x7f4fc8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.673+0000 7f4fde59c640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fc806e5f0 0x7f4fc8070ab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009230 tx=0x7f4fd00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:01.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.677+0000 7f4fcf7fe640 1 -- 172.21.15.49:0/1266432576 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4fd40570e0 con 0x7f4fe0104a30 2024-09-19T09:15:01.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.896+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f4fe00fef10 con 0x7f4fe0104a30 2024-09-19T09:15:01.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.897+0000 7f4fcf7fe640 1 -- 172.21.15.49:0/1266432576 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v42) v1 ==== 107+0+5271 (secure 0 0 0) 0x7f4fd405a7a0 con 0x7f4fe0104a30 2024-09-19T09:15:01.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:15:01.898 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":40,"btime":"2024-09-19T09:10:39:812156+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44371,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/4160337930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4160337930},{"type":"v1","addr":"172.21.15.102:6825","nonce":4160337930}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44401,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/801204290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":801204290},{"type":"v1","addr":"172.21.15.102:6827","nonce":801204290}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:39.812141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":1,"incarnation":40,"state":"up:starting","state_seq":1,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-19T09:15:01.899 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 40 2024-09-19T09:15:01.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fc806e5f0 msgr2=0x7f4fc8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:01.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fc806e5f0 0x7f4fc8070ab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009230 tx=0x7f4fd00058d0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 msgr2=0x7f4fe019be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:01.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe019be40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b420 tx=0x7f4fd400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 shutdown_connections 2024-09-19T09:15:01.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7f4fc806e5f0 0x7f4fc8070ab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4fe0104a30 0x7f4fe019be40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 --2- 172.21.15.49:0/1266432576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fe00fea30 0x7f4fe019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:01.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 >> 172.21.15.49:0/1266432576 conn(0x7f4fe00fa730 msgr2=0x7f4fe0068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:01.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 shutdown_connections 2024-09-19T09:15:01.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:01.899+0000 7f4fe4df8640 1 -- 172.21.15.49:0/1266432576 wait complete. 2024-09-19T09:15:02.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:02 smithi049 ceph-mon[91793]: pgmap v356: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:02.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:02 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1266432576' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-19T09:15:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:02 smithi102 ceph-mon[80875]: pgmap v356: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:02 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1266432576' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-19T09:15:02.555 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-09-19T09:15:02.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-19T09:15:02.764 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:15:04.238 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:04 smithi049 ceph-mon[91793]: pgmap v357: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:04.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 -- 172.21.15.49:0/4048579877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 msgr2=0x7fbfa810be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 --2- 172.21.15.49:0/4048579877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa810be20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009880 tx=0x7fbf9c02a530 comp rx=0 tx=0).stop 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 -- 172.21.15.49:0/4048579877 shutdown_connections 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 --2- 172.21.15.49:0/4048579877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa810be20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 --2- 172.21.15.49:0/4048579877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfa80728e0 0x7fbfa8072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 -- 172.21.15.49:0/4048579877 >> 172.21.15.49:0/4048579877 conn(0x7fbfa80fb860 msgr2=0x7fbfa80fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 -- 172.21.15.49:0/4048579877 shutdown_connections 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.484+0000 7fbfad83b640 1 -- 172.21.15.49:0/4048579877 wait complete. 2024-09-19T09:15:04.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfad83b640 1 Processor -- start 2024-09-19T09:15:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfad83b640 1 -- start start 2024-09-19T09:15:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfad83b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfa80728e0 0x7fbfa8197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfad83b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa8198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfad83b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa81988f0 con 0x7fbfa8073200 2024-09-19T09:15:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfad83b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa819c660 con 0x7fbfa80728e0 2024-09-19T09:15:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfa67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa8198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfa67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa8198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54104/0 (socket says 172.21.15.49:54104) 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfa67fc640 1 -- 172.21.15.49:0/2894959187 learned_addr learned my addr 172.21.15.49:0/2894959187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfa6ffd640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfa80728e0 0x7fbfa8197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfa67fc640 1 -- 172.21.15.49:0/2894959187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfa80728e0 msgr2=0x7fbfa8197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfa67fc640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfa80728e0 0x7fbfa8197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.485+0000 7fbfa67fc640 1 -- 172.21.15.49:0/2894959187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009560 con 0x7fbfa8073200 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.486+0000 7fbfa67fc640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa8198260 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c02aa50 tx=0x7fbf9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.486+0000 7fbfac839640 1 -- 172.21.15.49:0/2894959187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf9c004aa0 con 0x7fbfa8073200 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.486+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa819c8e0 con 0x7fbfa8073200 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.486+0000 7fbfac839640 1 -- 172.21.15.49:0/2894959187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf9c004c00 con 0x7fbfa8073200 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.486+0000 7fbfac839640 1 -- 172.21.15.49:0/2894959187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf9c003ab0 con 0x7fbfa8073200 2024-09-19T09:15:04.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.486+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa819cdd0 con 0x7fbfa8073200 2024-09-19T09:15:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.487+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa8073f90 con 0x7fbfa8073200 2024-09-19T09:15:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.488+0000 7fbfac839640 1 -- 172.21.15.49:0/2894959187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbf9c02ad50 con 0x7fbfa8073200 2024-09-19T09:15:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.488+0000 7fbfac839640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbf9006e5f0 0x7fbf90070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.488+0000 7fbfac839640 1 -- 172.21.15.49:0/2894959187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fbf9c0af510 con 0x7fbfa8073200 2024-09-19T09:15:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.488+0000 7fbfa6ffd640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbf9006e5f0 0x7fbf90070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.489+0000 7fbfa6ffd640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbf9006e5f0 0x7fbf90070ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf980058c0 tx=0x7fbf9800a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:04.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.493+0000 7fbfac839640 1 -- 172.21.15.49:0/2894959187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbf9c078620 con 0x7fbfa8073200 2024-09-19T09:15:04.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:04 smithi102 ceph-mon[80875]: pgmap v357: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:04.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.704+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7fbfa81065c0 con 0x7fbfa8073200 2024-09-19T09:15:04.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.705+0000 7fbfac839640 1 -- 172.21.15.49:0/2894959187 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v42) v1 ==== 107+0+5275 (secure 0 0 0) 0x7fbf9c07bce0 con 0x7fbfa8073200 2024-09-19T09:15:04.707 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-19T09:15:04.707 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"btime":"2024-09-19T09:10:40:817955+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44371,"name":"cephfs.smithi102.snrasw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6825/4160337930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4160337930},{"type":"v1","addr":"172.21.15.102:6825","nonce":4160337930}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44401,"name":"cephfs.smithi102.ojquyx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6827/801204290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":801204290},{"type":"v1","addr":"172.21.15.102:6827","nonce":801204290}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:59:43.193626+0000","modified":"2024-09-19T09:10:40.817952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi049.ibssbl","rank":0,"incarnation":30,"state":"up:active","state_seq":9,"addr":"172.21.15.49:6827/1214141994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1214141994},{"type":"v1","addr":"172.21.15.49:6827","nonce":1214141994}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi049.uujbrc","rank":1,"incarnation":40,"state":"up:active","state_seq":11,"addr":"172.21.15.49:6829/3390163140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3390163140},{"type":"v1","addr":"172.21.15.49:6829","nonce":3390163140}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416,34448]},"id":1}]} 2024-09-19T09:15:04.707 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 41 2024-09-19T09:15:04.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbf9006e5f0 msgr2=0x7fbf90070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbf9006e5f0 0x7fbf90070ab0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf980058c0 tx=0x7fbf9800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 msgr2=0x7fbfa8198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa8198260 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c02aa50 tx=0x7fbf9c0055a0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 shutdown_connections 2024-09-19T09:15:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fbf9006e5f0 0x7fbf90070ab0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa8073200 0x7fbfa8198260 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 --2- 172.21.15.49:0/2894959187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfa80728e0 0x7fbfa8197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 >> 172.21.15.49:0/2894959187 conn(0x7fbfa80fb860 msgr2=0x7fbfa8104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:04.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 shutdown_connections 2024-09-19T09:15:04.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:04.708+0000 7fbfad83b640 1 -- 172.21.15.49:0/2894959187 wait complete. 2024-09-19T09:15:05.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:05 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/2894959187' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-19T09:15:05.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:05 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/2894959187' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-19T09:15:05.330 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T09:15:05.343 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T09:15:05.343 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:15:05.343 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:05.363 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:15:05.364 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:05.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:15:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:15:06.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:06 smithi102 ceph-mon[80875]: pgmap v358: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:06.547 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:06 smithi049 ceph-mon[91793]: pgmap v358: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:07.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.448+0000 7fd8353cb640 1 -- 172.21.15.49:0/3361711136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd830100cb0 msgr2=0x7fd830101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3361711136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd830100cb0 0x7fd830101090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd820009c20 tx=0x7fd82002aa00 comp rx=0 tx=0).stop 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 -- 172.21.15.49:0/3361711136 shutdown_connections 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3361711136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8301015d0 0x7fd830109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3361711136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd830100cb0 0x7fd830101090 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 -- 172.21.15.49:0/3361711136 >> 172.21.15.49:0/3361711136 conn(0x7fd8300758a0 msgr2=0x7fd8300fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 -- 172.21.15.49:0/3361711136 shutdown_connections 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 -- 172.21.15.49:0/3361711136 wait complete. 2024-09-19T09:15:07.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.449+0000 7fd8353cb640 1 Processor -- start 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd8353cb640 1 -- start start 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd8353cb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd830100cb0 0x7fd8300fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd8353cb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8301015d0 0x7fd8300fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd8353cb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300ff390 con 0x7fd8301015d0 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd8353cb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300ff4d0 con 0x7fd830100cb0 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8301015d0 0x7fd8300fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8301015d0 0x7fd8300fee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54118/0 (socket says 172.21.15.49:54118) 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82e7fc640 1 -- 172.21.15.49:0/3671834830 learned_addr learned my addr 172.21.15.49:0/3671834830 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82effd640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd830100cb0 0x7fd8300fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:07.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82e7fc640 1 -- 172.21.15.49:0/3671834830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd830100cb0 msgr2=0x7fd8300fe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82e7fc640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd830100cb0 0x7fd8300fe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82e7fc640 1 -- 172.21.15.49:0/3671834830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009900 con 0x7fd8301015d0 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82effd640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd830100cb0 0x7fd8300fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.450+0000 7fd82e7fc640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8301015d0 0x7fd8300fee50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd81800b370 tx=0x7fd81800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.451+0000 7fd827fff640 1 -- 172.21.15.49:0/3671834830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd818011800 con 0x7fd8301015d0 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.451+0000 7fd827fff640 1 -- 172.21.15.49:0/3671834830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd818011e20 con 0x7fd8301015d0 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.451+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8301a1dc0 con 0x7fd8301015d0 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.451+0000 7fd827fff640 1 -- 172.21.15.49:0/3671834830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd81800f2e0 con 0x7fd8301015d0 2024-09-19T09:15:07.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.451+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8301a21d0 con 0x7fd8301015d0 2024-09-19T09:15:07.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.452+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd830068510 con 0x7fd8301015d0 2024-09-19T09:15:07.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.452+0000 7fd827fff640 1 -- 172.21.15.49:0/3671834830 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd818010380 con 0x7fd8301015d0 2024-09-19T09:15:07.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.453+0000 7fd827fff640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd81c06e5f0 0x7fd81c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:07.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.453+0000 7fd827fff640 1 -- 172.21.15.49:0/3671834830 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fd81808e470 con 0x7fd8301015d0 2024-09-19T09:15:07.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.453+0000 7fd82effd640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd81c06e5f0 0x7fd81c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:07.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.453+0000 7fd82effd640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd81c06e5f0 0x7fd81c070ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f80 tx=0x7fd82003b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:07.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.457+0000 7fd827fff640 1 -- 172.21.15.49:0/3671834830 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd8180574b0 con 0x7fd8301015d0 2024-09-19T09:15:07.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.650+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd830101110 con 0x7fd8301015d0 2024-09-19T09:15:07.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.650+0000 7fd827fff640 1 -- 172.21.15.49:0/3671834830 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v93) v1 ==== 81+0+2309 (secure 0 0 0) 0x7fd81805ab70 con 0x7fd8301015d0 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6828/2801166372 2024-09-20T09:09:52.064187+0000 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1018152091 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4066528719 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/707565764 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/191278421 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3833664596 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1448600861 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.653 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3048457886 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/769400933 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3838335144 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/4115442638 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1109277774 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2132142494 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/486100308 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2691016053 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2913047787 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1246626107 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4103089507 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6826/1350437086 2024-09-20T08:59:59.148911+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/438801189 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6827/1350437086 2024-09-20T08:59:59.148911+0000 2024-09-19T09:15:07.654 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1436634671 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3532044078 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2132142494 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1518344664 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/1881612617 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1436634671 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1902543814 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1902543814 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:07.655 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/2364890782 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:07.656 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/3857486798 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:07.656 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:6829/655933659 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:07.656 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6829/2801166372 2024-09-20T09:09:52.064187+0000 2024-09-19T09:15:07.656 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2913047787 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:07.656 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2514955449 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:07.656 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/4115442638 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:07.656 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:6828/655933659 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:07.657 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3682333928 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:07.657 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1944713960 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:listed 39 entries 2024-09-19T09:15:07.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd81c06e5f0 msgr2=0x7fd81c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd81c06e5f0 0x7fd81c070ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f80 tx=0x7fd82003b040 comp rx=0 tx=0).stop 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8301015d0 msgr2=0x7fd8300fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8301015d0 0x7fd8300fee50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd81800b370 tx=0x7fd81800b830 comp rx=0 tx=0).stop 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 shutdown_connections 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fd81c06e5f0 0x7fd81c070ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8301015d0 0x7fd8300fee50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 --2- 172.21.15.49:0/3671834830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd830100cb0 0x7fd8300fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 >> 172.21.15.49:0/3671834830 conn(0x7fd8300758a0 msgr2=0x7fd830102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:07.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 shutdown_connections 2024-09-19T09:15:07.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:07.653+0000 7fd8353cb640 1 -- 172.21.15.49:0/3671834830 wait complete. 2024-09-19T09:15:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:08 smithi049 ceph-mon[91793]: pgmap v359: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:08 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/3671834830' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:15:08.433 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-19T09:15:08.433 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:08.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 63845326-7664-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:15:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:08 smithi102 ceph-mon[80875]: pgmap v359: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:08 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/3671834830' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:15:08.714 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/mon.smithi049/config 2024-09-19T09:15:10.114 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:10 smithi049 ceph-mon[91793]: pgmap v360: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:10.508 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:10 smithi102 ceph-mon[80875]: pgmap v360: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 -- 172.21.15.49:0/4055046021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 msgr2=0x7fcdfc1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 --2- 172.21.15.49:0/4055046021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc1047a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009c20 tx=0x7fcdec02a970 comp rx=0 tx=0).stop 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 -- 172.21.15.49:0/4055046021 shutdown_connections 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 --2- 172.21.15.49:0/4055046021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc1047a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 --2- 172.21.15.49:0/4055046021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdfc0ffda0 0x7fcdfc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 -- 172.21.15.49:0/4055046021 >> 172.21.15.49:0/4055046021 conn(0x7fcdfc0fb840 msgr2=0x7fcdfc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 -- 172.21.15.49:0/4055046021 shutdown_connections 2024-09-19T09:15:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.508+0000 7fce02d0d640 1 -- 172.21.15.49:0/4055046021 wait complete. 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fce02d0d640 1 Processor -- start 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fce02d0d640 1 -- start start 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fce02d0d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdfc0ffda0 0x7fcdfc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fce02d0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fce02d0d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc073230 con 0x7fcdfc100750 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fce02d0d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc073370 con 0x7fcdfc0ffda0 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fcdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fcdfbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35308/0 (socket says 172.21.15.49:35308) 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.509+0000 7fcdfbfff640 1 -- 172.21.15.49:0/1936458878 learned_addr learned my addr 172.21.15.49:0/1936458878 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fce00aa9640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdfc0ffda0 0x7fcdfc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fcdfbfff640 1 -- 172.21.15.49:0/1936458878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdfc0ffda0 msgr2=0x7fcdfc0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fcdfbfff640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdfc0ffda0 0x7fcdfc0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fcdfbfff640 1 -- 172.21.15.49:0/1936458878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec009900 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fcdfbfff640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc072cf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcdec02ae90 tx=0x7fcdec030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fcdf9ffb640 1 -- 172.21.15.49:0/1936458878 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdec02f3c0 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fcdf9ffb640 1 -- 172.21.15.49:0/1936458878 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdec02f9e0 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc0735f0 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fcdf9ffb640 1 -- 172.21.15.49:0/1936458878 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdec039450 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.510+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc1a2000 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.511+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc101280 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.512+0000 7fcdf9ffb640 1 -- 172.21.15.49:0/1936458878 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 40) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcdec00a040 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.512+0000 7fcdf9ffb640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcde806e5f0 0x7fcde8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.512+0000 7fcdf9ffb640 1 -- 172.21.15.49:0/1936458878 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fcdec02c040 con 0x7fcdfc100750 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.512+0000 7fce00aa9640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcde806e5f0 0x7fcde8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.513+0000 7fce00aa9640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcde806e5f0 0x7fcde8070ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005fd0 tx=0x7fcde4005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.517+0000 7fcdf9ffb640 1 -- 172.21.15.49:0/1936458878 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcdec078ae0 con 0x7fcdfc100750 2024-09-19T09:15:10.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.706+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcdfc108100 con 0x7fcdfc100750 2024-09-19T09:15:10.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.706+0000 7fcdf9ffb640 1 -- 172.21.15.49:0/1936458878 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v93) v1 ==== 81+0+2309 (secure 0 0 0) 0x7fcdec07c1a0 con 0x7fcdfc100750 2024-09-19T09:15:10.707 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6828/2801166372 2024-09-20T09:09:52.064187+0000 2024-09-19T09:15:10.707 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1018152091 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.707 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4066528719 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.707 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/707565764 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.707 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/191278421 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3833664596 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1448600861 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3048457886 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/769400933 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3838335144 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/4115442638 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1109277774 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2132142494 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/486100308 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2691016053 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2913047787 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1246626107 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4103089507 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6826/1350437086 2024-09-20T08:59:59.148911+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/438801189 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6827/1350437086 2024-09-20T08:59:59.148911+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1436634671 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3532044078 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2132142494 2024-09-20T09:04:42.448791+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1518344664 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/1881612617 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:10.709 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1436634671 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1902543814 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1902543814 2024-09-20T08:53:59.836934+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/2364890782 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:0/3857486798 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:6829/655933659 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6829/2801166372 2024-09-20T09:09:52.064187+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2913047787 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2514955449 2024-09-20T08:53:25.290361+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/4115442638 2024-09-20T08:55:02.044798+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.102:6828/655933659 2024-09-20T09:03:26.394506+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3682333928 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1944713960 2024-09-20T09:01:51.803241+0000 2024-09-19T09:15:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:listed 39 entries 2024-09-19T09:15:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcde806e5f0 msgr2=0x7fcde8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcde806e5f0 0x7fcde8070ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005fd0 tx=0x7fcde4005850 comp rx=0 tx=0).stop 2024-09-19T09:15:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 msgr2=0x7fcdfc072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc072cf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcdec02ae90 tx=0x7fcdec030880 comp rx=0 tx=0).stop 2024-09-19T09:15:10.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 shutdown_connections 2024-09-19T09:15:10.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:6800/4061156495,v1:172.21.15.49:6801/4061156495] conn(0x7fcde806e5f0 0x7fcde8070ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdfc100750 0x7fcdfc072cf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 --2- 172.21.15.49:0/1936458878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdfc0ffda0 0x7fcdfc0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 >> 172.21.15.49:0/1936458878 conn(0x7fcdfc0fb840 msgr2=0x7fcdfc0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:10.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 shutdown_connections 2024-09-19T09:15:10.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-19T09:15:10.709+0000 7fce02d0d640 1 -- 172.21.15.49:0/1936458878 wait complete. 2024-09-19T09:15:11.386 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:11 smithi049 ceph-mon[91793]: from='client.? 172.21.15.49:0/1936458878' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:15:11.408 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-09-19T09:15:11.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:11.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T09:15:11.437 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:15:11.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:11 smithi102 ceph-mon[80875]: from='client.? 172.21.15.49:0/1936458878' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:15:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:12 smithi102 ceph-mon[80875]: pgmap v361: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:12.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:12 smithi049 ceph-mon[91793]: pgmap v361: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:13.410 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:15:13.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:15:14.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:14 smithi102 ceph-mon[80875]: pgmap v362: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:14.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:14 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:14 smithi049 ceph-mon[91793]: pgmap v362: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:14 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:15:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:15:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:15:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:15:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:15:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:15:16.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:16 smithi102 ceph-mon[80875]: pgmap v363: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:16.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:16 smithi049 ceph-mon[91793]: pgmap v363: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:18 smithi102 ceph-mon[80875]: pgmap v364: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:18.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:18 smithi049 ceph-mon[91793]: pgmap v364: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:20 smithi102 ceph-mon[80875]: pgmap v365: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:20 smithi049 ceph-mon[91793]: pgmap v365: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:22.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:22 smithi102 ceph-mon[80875]: pgmap v366: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:22.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:22 smithi049 ceph-mon[91793]: pgmap v366: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:24 smithi102 ceph-mon[80875]: pgmap v367: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:24.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:24 smithi049 ceph-mon[91793]: pgmap v367: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:26.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:26 smithi102 ceph-mon[80875]: pgmap v368: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:26.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:26 smithi049 ceph-mon[91793]: pgmap v368: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:28 smithi102 ceph-mon[80875]: pgmap v369: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:15:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:28 smithi049 ceph-mon[91793]: pgmap v369: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:15:30.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:30 smithi102 ceph-mon[80875]: pgmap v370: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:30.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:30 smithi049 ceph-mon[91793]: pgmap v370: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:32.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:32 smithi102 ceph-mon[80875]: pgmap v371: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:32 smithi049 ceph-mon[91793]: pgmap v371: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:34.512 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:34 smithi102 ceph-mon[80875]: pgmap v372: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:34.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:34 smithi049 ceph-mon[91793]: pgmap v372: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:36.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:36 smithi102 ceph-mon[80875]: pgmap v373: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:36.535 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:36 smithi049 ceph-mon[91793]: pgmap v373: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:38.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:38 smithi102 ceph-mon[80875]: pgmap v374: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:38.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:38 smithi049 ceph-mon[91793]: pgmap v374: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:40.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:40 smithi102 ceph-mon[80875]: pgmap v375: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:40.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:40 smithi049 ceph-mon[91793]: pgmap v375: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:42.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:42 smithi102 ceph-mon[80875]: pgmap v376: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:42.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:42 smithi049 ceph-mon[91793]: pgmap v376: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:43.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:15:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:15:44.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:44 smithi102 ceph-mon[80875]: pgmap v377: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:44.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:44 smithi049 ceph-mon[91793]: pgmap v377: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:46.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:46 smithi102 ceph-mon[80875]: pgmap v378: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:46 smithi049 ceph-mon[91793]: pgmap v378: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:48.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:48 smithi102 ceph-mon[80875]: pgmap v379: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:48.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:48 smithi049 ceph-mon[91793]: pgmap v379: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:50.511 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:50 smithi102 ceph-mon[80875]: pgmap v380: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:50 smithi049 ceph-mon[91793]: pgmap v380: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:15:52.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:52 smithi102 ceph-mon[80875]: pgmap v381: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:52.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:52 smithi049 ceph-mon[91793]: pgmap v381: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:54.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:54 smithi102 ceph-mon[80875]: pgmap v382: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:54.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:54 smithi049 ceph-mon[91793]: pgmap v382: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:15:56.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:56 smithi102 ceph-mon[80875]: pgmap v383: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:56.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:56 smithi049 ceph-mon[91793]: pgmap v383: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:15:58.510 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:58 smithi102 ceph-mon[80875]: pgmap v384: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:58.511 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:15:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:15:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:58 smithi049 ceph-mon[91793]: pgmap v384: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:15:58.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:15:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:00.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:00 smithi102 ceph-mon[80875]: pgmap v385: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:00.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:00 smithi049 ceph-mon[91793]: pgmap v385: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:02.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:02 smithi049 ceph-mon[91793]: pgmap v386: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:02 smithi102 ceph-mon[80875]: pgmap v386: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:04.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:04 smithi102 ceph-mon[80875]: pgmap v387: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:04.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:04 smithi049 ceph-mon[91793]: pgmap v387: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:06.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:06 smithi102 ceph-mon[80875]: pgmap v388: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:06.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:06 smithi049 ceph-mon[91793]: pgmap v388: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:08.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:08 smithi102 ceph-mon[80875]: pgmap v389: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:08 smithi049 ceph-mon[91793]: pgmap v389: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:10.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:10 smithi102 ceph-mon[80875]: pgmap v390: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:10.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:10 smithi049 ceph-mon[91793]: pgmap v390: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:12.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:12 smithi102 ceph-mon[80875]: pgmap v391: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:12.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:12 smithi049 ceph-mon[91793]: pgmap v391: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:13.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:13.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:14.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:14 smithi102 ceph-mon[80875]: pgmap v392: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:14.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:14 smithi049 ceph-mon[91793]: pgmap v392: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:16:15.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:15 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:16:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:16:15.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:15 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:16:16.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:16 smithi102 ceph-mon[80875]: pgmap v393: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:16.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:16.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:16.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:16:16.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:16 smithi049 ceph-mon[91793]: pgmap v393: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:16.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:16.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:16.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:16:18.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:18 smithi102 ceph-mon[80875]: pgmap v394: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:18.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:18 smithi049 ceph-mon[91793]: pgmap v394: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:20.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:20 smithi102 ceph-mon[80875]: pgmap v395: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:20.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:20 smithi049 ceph-mon[91793]: pgmap v395: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:22.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:22 smithi102 ceph-mon[80875]: pgmap v396: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:22.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:22 smithi049 ceph-mon[91793]: pgmap v396: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:24.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:24 smithi102 ceph-mon[80875]: pgmap v397: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:24.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:24 smithi049 ceph-mon[91793]: pgmap v397: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:26.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:26 smithi102 ceph-mon[80875]: pgmap v398: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:26.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:26 smithi049 ceph-mon[91793]: pgmap v398: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:28 smithi102 ceph-mon[80875]: pgmap v399: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:28.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:28 smithi049 ceph-mon[91793]: pgmap v399: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:30.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:30 smithi049 ceph-mon[91793]: pgmap v400: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:30 smithi102 ceph-mon[80875]: pgmap v400: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:32.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:32 smithi049 ceph-mon[91793]: pgmap v401: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:32 smithi102 ceph-mon[80875]: pgmap v401: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:34.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:34 smithi049 ceph-mon[91793]: pgmap v402: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:34.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:34 smithi102 ceph-mon[80875]: pgmap v402: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:36.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:36 smithi049 ceph-mon[91793]: pgmap v403: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:36.624 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:36 smithi102 ceph-mon[80875]: pgmap v403: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:38.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:38 smithi049 ceph-mon[91793]: pgmap v404: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:38.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:38 smithi102 ceph-mon[80875]: pgmap v404: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:40.554 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:40 smithi049 ceph-mon[91793]: pgmap v405: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:40 smithi102 ceph-mon[80875]: pgmap v405: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:42.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:42 smithi049 ceph-mon[91793]: pgmap v406: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:42.758 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:42 smithi102 ceph-mon[80875]: pgmap v406: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:43.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:43.660 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:44.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:44 smithi049 ceph-mon[91793]: pgmap v407: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:44 smithi102 ceph-mon[80875]: pgmap v407: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:46.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:46 smithi049 ceph-mon[91793]: pgmap v408: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:46 smithi102 ceph-mon[80875]: pgmap v408: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:48.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:48 smithi049 ceph-mon[91793]: pgmap v409: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:48 smithi102 ceph-mon[80875]: pgmap v409: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:50.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:50 smithi049 ceph-mon[91793]: pgmap v410: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:50 smithi102 ceph-mon[80875]: pgmap v410: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:16:52.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:52 smithi049 ceph-mon[91793]: pgmap v411: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:52 smithi102 ceph-mon[80875]: pgmap v411: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:54.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:54 smithi049 ceph-mon[91793]: pgmap v412: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:54.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:54 smithi102 ceph-mon[80875]: pgmap v412: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:16:56.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:56 smithi049 ceph-mon[91793]: pgmap v413: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:56 smithi102 ceph-mon[80875]: pgmap v413: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:16:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:58 smithi049 ceph-mon[91793]: pgmap v414: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:58.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:16:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:16:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:58 smithi102 ceph-mon[80875]: pgmap v414: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:16:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:16:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:00 smithi102 ceph-mon[80875]: pgmap v415: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:00 smithi049 ceph-mon[91793]: pgmap v415: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:02.509 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:02 smithi102 ceph-mon[80875]: pgmap v416: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:02 smithi049 ceph-mon[91793]: pgmap v416: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:04 smithi102 ceph-mon[80875]: pgmap v417: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:04 smithi049 ceph-mon[91793]: pgmap v417: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:06.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:06 smithi102 ceph-mon[80875]: pgmap v418: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:06 smithi049 ceph-mon[91793]: pgmap v418: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:08.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:08 smithi049 ceph-mon[91793]: pgmap v419: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:08 smithi102 ceph-mon[80875]: pgmap v419: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:10 smithi102 ceph-mon[80875]: pgmap v420: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:10 smithi049 ceph-mon[91793]: pgmap v420: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:12 smithi102 ceph-mon[80875]: pgmap v421: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:12 smithi049 ceph-mon[91793]: pgmap v421: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:13.660 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:14 smithi102 ceph-mon[80875]: pgmap v422: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:14 smithi049 ceph-mon[91793]: pgmap v422: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:16 smithi102 ceph-mon[80875]: pgmap v423: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:17:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:16 smithi049 ceph-mon[91793]: pgmap v423: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:17:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:18 smithi102 ceph-mon[80875]: pgmap v424: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:18 smithi049 ceph-mon[91793]: pgmap v424: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:20 smithi102 ceph-mon[80875]: pgmap v425: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:20 smithi049 ceph-mon[91793]: pgmap v425: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:22.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:22 smithi102 ceph-mon[80875]: pgmap v426: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:22.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:22 smithi049 ceph-mon[91793]: pgmap v426: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:24.704 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:24 smithi049 ceph-mon[91793]: pgmap v427: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:24.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:24 smithi102 ceph-mon[80875]: pgmap v427: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:26 smithi102 ceph-mon[80875]: pgmap v428: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:26.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:26 smithi049 ceph-mon[91793]: pgmap v428: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:28.646 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:28 smithi049 ceph-mon[91793]: pgmap v429: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:28.646 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:28.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:28 smithi102 ceph-mon[80875]: pgmap v429: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:28.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:30 smithi102 ceph-mon[80875]: pgmap v430: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:30 smithi049 ceph-mon[91793]: pgmap v430: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:32.647 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:32 smithi102 ceph-mon[80875]: pgmap v431: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:32.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:32 smithi049 ceph-mon[91793]: pgmap v431: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:34.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:34 smithi102 ceph-mon[80875]: pgmap v432: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:34.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:34 smithi049 ceph-mon[91793]: pgmap v432: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:36.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:36 smithi102 ceph-mon[80875]: pgmap v433: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:36.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:36 smithi049 ceph-mon[91793]: pgmap v433: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:38.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:38 smithi102 ceph-mon[80875]: pgmap v434: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:38 smithi049 ceph-mon[91793]: pgmap v434: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:40.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:40 smithi102 ceph-mon[80875]: pgmap v435: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:40.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:40 smithi049 ceph-mon[91793]: pgmap v435: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:42.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:42 smithi102 ceph-mon[80875]: pgmap v436: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:42.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:42 smithi049 ceph-mon[91793]: pgmap v436: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:43.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:44 smithi102 ceph-mon[80875]: pgmap v437: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:44.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:44 smithi049 ceph-mon[91793]: pgmap v437: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:46 smithi102 ceph-mon[80875]: pgmap v438: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:46 smithi049 ceph-mon[91793]: pgmap v438: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:48 smithi102 ceph-mon[80875]: pgmap v439: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:48.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:48 smithi049 ceph-mon[91793]: pgmap v439: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:50 smithi102 ceph-mon[80875]: pgmap v440: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:50.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:50 smithi049 ceph-mon[91793]: pgmap v440: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:17:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:52 smithi102 ceph-mon[80875]: pgmap v441: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:52 smithi049 ceph-mon[91793]: pgmap v441: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:54.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:54 smithi102 ceph-mon[80875]: pgmap v442: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:54 smithi049 ceph-mon[91793]: pgmap v442: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:17:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:56 smithi102 ceph-mon[80875]: pgmap v443: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:56 smithi049 ceph-mon[91793]: pgmap v443: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:17:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:58 smithi102 ceph-mon[80875]: pgmap v444: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:17:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:17:58.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:58 smithi049 ceph-mon[91793]: pgmap v444: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:17:58.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:17:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:00 smithi102 ceph-mon[80875]: pgmap v445: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:00 smithi049 ceph-mon[91793]: pgmap v445: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:02 smithi102 ceph-mon[80875]: pgmap v446: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:02 smithi049 ceph-mon[91793]: pgmap v446: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:04 smithi102 ceph-mon[80875]: pgmap v447: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:04 smithi049 ceph-mon[91793]: pgmap v447: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:06.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:06 smithi102 ceph-mon[80875]: pgmap v448: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:06.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:06 smithi049 ceph-mon[91793]: pgmap v448: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:08.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:08 smithi102 ceph-mon[80875]: pgmap v449: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:08 smithi049 ceph-mon[91793]: pgmap v449: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:10.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:10 smithi102 ceph-mon[80875]: pgmap v450: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:10 smithi049 ceph-mon[91793]: pgmap v450: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:12 smithi102 ceph-mon[80875]: pgmap v451: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:12 smithi049 ceph-mon[91793]: pgmap v451: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:13.660 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:14 smithi102 ceph-mon[80875]: pgmap v452: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:14 smithi049 ceph-mon[91793]: pgmap v452: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:16 smithi102 ceph-mon[80875]: pgmap v453: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:16.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:18:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:16 smithi049 ceph-mon[91793]: pgmap v453: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:18:18.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:18 smithi102 ceph-mon[80875]: pgmap v454: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:18 smithi049 ceph-mon[91793]: pgmap v454: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:20.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:20 smithi102 ceph-mon[80875]: pgmap v455: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:20 smithi049 ceph-mon[91793]: pgmap v455: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:22.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:22 smithi102 ceph-mon[80875]: pgmap v456: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:22.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:22 smithi049 ceph-mon[91793]: pgmap v456: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:24.696 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:24 smithi049 ceph-mon[91793]: pgmap v457: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:24.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:24 smithi102 ceph-mon[80875]: pgmap v457: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:26.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:26 smithi102 ceph-mon[80875]: pgmap v458: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:26.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:26 smithi049 ceph-mon[91793]: pgmap v458: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:28.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:28 smithi102 ceph-mon[80875]: pgmap v459: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:28.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:28 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:28 smithi049 ceph-mon[91793]: pgmap v459: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:28 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:30.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:30 smithi102 ceph-mon[80875]: pgmap v460: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:30 smithi049 ceph-mon[91793]: pgmap v460: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:32.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:32 smithi102 ceph-mon[80875]: pgmap v461: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:32.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:32 smithi049 ceph-mon[91793]: pgmap v461: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:34.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:34 smithi102 ceph-mon[80875]: pgmap v462: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:18:34.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:34 smithi049 ceph-mon[91793]: pgmap v462: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:18:36.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:36 smithi102 ceph-mon[80875]: pgmap v463: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:18:36.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:36 smithi049 ceph-mon[91793]: pgmap v463: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:18:38.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:38 smithi102 ceph-mon[80875]: pgmap v464: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:18:38.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:38 smithi049 ceph-mon[91793]: pgmap v464: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:18:40.760 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:40 smithi102 ceph-mon[80875]: pgmap v465: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:18:40.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:40 smithi049 ceph-mon[91793]: pgmap v465: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:18:42.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:42 smithi102 ceph-mon[80875]: pgmap v466: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:18:42.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:42 smithi049 ceph-mon[91793]: pgmap v466: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:18:43.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:43 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:43.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:43 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:44.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:44 smithi102 ceph-mon[80875]: pgmap v467: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:18:44.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:44 smithi049 ceph-mon[91793]: pgmap v467: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:18:46.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:46 smithi102 ceph-mon[80875]: pgmap v468: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:46.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:46 smithi049 ceph-mon[91793]: pgmap v468: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:48.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:48 smithi102 ceph-mon[80875]: pgmap v469: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:48.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:48 smithi049 ceph-mon[91793]: pgmap v469: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:50.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:50 smithi102 ceph-mon[80875]: pgmap v470: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:50.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:50 smithi049 ceph-mon[91793]: pgmap v470: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:18:52.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:52 smithi102 ceph-mon[80875]: pgmap v471: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:52.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:52 smithi049 ceph-mon[91793]: pgmap v471: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:54.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:54 smithi102 ceph-mon[80875]: pgmap v472: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:54.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:54 smithi049 ceph-mon[91793]: pgmap v472: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:18:56.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:56 smithi102 ceph-mon[80875]: pgmap v473: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:56 smithi049 ceph-mon[91793]: pgmap v473: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:18:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:58 smithi102 ceph-mon[80875]: pgmap v474: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:58.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:18:58 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:18:58.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:58 smithi049 ceph-mon[91793]: pgmap v474: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:18:58.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:18:58 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:00.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:00 smithi102 ceph-mon[80875]: pgmap v475: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:00.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:00 smithi049 ceph-mon[91793]: pgmap v475: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:02.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:02 smithi102 ceph-mon[80875]: pgmap v476: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:02.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:02 smithi049 ceph-mon[91793]: pgmap v476: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:04.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:04 smithi102 ceph-mon[80875]: pgmap v477: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:04.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:04 smithi049 ceph-mon[91793]: pgmap v477: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:06.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:06 smithi049 ceph-mon[91793]: pgmap v478: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:07.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:06 smithi102 ceph-mon[80875]: pgmap v478: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:08.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:08 smithi049 ceph-mon[91793]: pgmap v479: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:09.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:08 smithi102 ceph-mon[80875]: pgmap v479: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:10.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:10 smithi049 ceph-mon[91793]: pgmap v480: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:11.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:10 smithi102 ceph-mon[80875]: pgmap v480: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:12.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:12 smithi049 ceph-mon[91793]: pgmap v481: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:13.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:12 smithi102 ceph-mon[80875]: pgmap v481: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:13.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:13 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:13.910 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:13 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:14.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:14 smithi102 ceph-mon[80875]: pgmap v482: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:14.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:14 smithi049 ceph-mon[91793]: pgmap v482: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:16 smithi049 ceph-mon[91793]: pgmap v483: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:16.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:16 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:17.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:16 smithi102 ceph-mon[80875]: pgmap v483: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:17.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:16 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:17.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:17.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:17.804 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:17 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:19:18.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:18.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:18.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:17 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' 2024-09-19T09:19:18.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:18 smithi049 ceph-mon[91793]: pgmap v484: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:19.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:18 smithi102 ceph-mon[80875]: pgmap v484: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:20.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:20 smithi049 ceph-mon[91793]: pgmap v485: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:21.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:20 smithi102 ceph-mon[80875]: pgmap v485: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:22.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:22 smithi049 ceph-mon[91793]: pgmap v486: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:23.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:22 smithi102 ceph-mon[80875]: pgmap v486: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:24.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:24 smithi049 ceph-mon[91793]: pgmap v487: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:25.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:24 smithi102 ceph-mon[80875]: pgmap v487: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:26.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:26 smithi049 ceph-mon[91793]: pgmap v488: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:19:27.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:26 smithi102 ceph-mon[80875]: pgmap v488: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:19:27.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:27 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:28.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:27 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:28.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:28 smithi049 ceph-mon[91793]: pgmap v489: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:19:29.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:28 smithi102 ceph-mon[80875]: pgmap v489: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:19:30.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:30 smithi049 ceph-mon[91793]: pgmap v490: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:19:31.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:30 smithi102 ceph-mon[80875]: pgmap v490: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:19:33.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:32 smithi102 ceph-mon[80875]: pgmap v491: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:19:33.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:32 smithi049 ceph-mon[91793]: pgmap v491: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-19T09:19:34.882 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:34 smithi102 ceph-mon[80875]: pgmap v492: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:19:35.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:34 smithi049 ceph-mon[91793]: pgmap v492: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-19T09:19:36.947 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:36 smithi049 ceph-mon[91793]: pgmap v493: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:19:37.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:36 smithi102 ceph-mon[80875]: pgmap v493: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-19T09:19:39.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:38 smithi102 ceph-mon[80875]: pgmap v494: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:39.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:38 smithi049 ceph-mon[91793]: pgmap v494: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:41.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:40 smithi102 ceph-mon[80875]: pgmap v495: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:41.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:40 smithi049 ceph-mon[91793]: pgmap v495: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:43.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:42 smithi102 ceph-mon[80875]: pgmap v496: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:43.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:42 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:42 smithi049 ceph-mon[91793]: pgmap v496: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:43.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:42 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:45.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:44 smithi102 ceph-mon[80875]: pgmap v497: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:45.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:44 smithi049 ceph-mon[91793]: pgmap v497: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:46.947 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:46 smithi049 ceph-mon[91793]: pgmap v498: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:47.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:46 smithi102 ceph-mon[80875]: pgmap v498: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:49.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:48 smithi102 ceph-mon[80875]: pgmap v499: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:49.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:48 smithi049 ceph-mon[91793]: pgmap v499: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:51.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:50 smithi102 ceph-mon[80875]: pgmap v500: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:51.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:50 smithi049 ceph-mon[91793]: pgmap v500: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:19:53.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:52 smithi102 ceph-mon[80875]: pgmap v501: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:53.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:52 smithi049 ceph-mon[91793]: pgmap v501: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:54.855 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:54 smithi049 ceph-mon[91793]: pgmap v502: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:55.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:54 smithi102 ceph-mon[80875]: pgmap v502: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:19:56.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:56 smithi049 ceph-mon[91793]: pgmap v503: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:57.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:56 smithi102 ceph-mon[80875]: pgmap v503: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:19:58.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:57 smithi102 ceph-mon[80875]: pgmap v504: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:58.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:57 smithi102 ceph-mon[80875]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:19:58.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:57 smithi049 ceph-mon[91793]: pgmap v504: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:19:58.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:57 smithi049 ceph-mon[91793]: from='mgr.34104 172.21.15.49:0/3167375720' entity='mgr.smithi049.qdvksw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T09:20:00.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:19:59 smithi102 ceph-mon[80875]: pgmap v505: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:00.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:19:59 smithi049 ceph-mon[91793]: pgmap v505: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:01.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:00 smithi102 ceph-mon[80875]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:20:01.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:00 smithi102 ceph-mon[80875]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:20:01.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:00 smithi102 ceph-mon[80875]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:20:01.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:00 smithi049 ceph-mon[91793]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-19T09:20:01.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:00 smithi049 ceph-mon[91793]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-19T09:20:01.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:00 smithi049 ceph-mon[91793]: fs cephfs has deprecated feature inline_data enabled. 2024-09-19T09:20:01.803 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:01 smithi049 ceph-mon[91793]: pgmap v506: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:20:02.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:01 smithi102 ceph-mon[80875]: pgmap v506: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:20:04.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:03 smithi102 ceph-mon[80875]: pgmap v507: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:20:04.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:03 smithi049 ceph-mon[91793]: pgmap v507: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-19T09:20:06.009 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:05 smithi102 ceph-mon[80875]: pgmap v508: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:20:06.053 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:05 smithi049 ceph-mon[91793]: pgmap v508: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-19T09:20:08.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:07 smithi102 ceph-mon[80875]: pgmap v509: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:20:08.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:07 smithi049 ceph-mon[91793]: pgmap v509: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-19T09:20:10.259 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:09 smithi102 ceph-mon[80875]: pgmap v510: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:10.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:09 smithi049 ceph-mon[91793]: pgmap v510: 65 pgs: 65 active+clean; 259 MiB data, 995 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:10.578 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-19T09:20:10.579 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T09:20:10.581 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:20:10.596 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:20:10.596 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T09:20:10.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:20:10.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:20:10.663 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:20:10.663 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:20:10.692 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:20:10.719 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:20:10.719 INFO:tasks.cephadm.mon.smithi049:Stopping mon.smithi049... 2024-09-19T09:20:10.719 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049 2024-09-19T09:20:11.051 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:10 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:11.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:11 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[91789]: 2024-09-19T09:20:11.049+0000 7f4937002640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:11.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:11 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049[91789]: 2024-09-19T09:20:11.049+0000 7f4937002640 -1 mon.smithi049@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:20:11.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:11 smithi049 podman[154313]: 2024-09-19 09:20:11.141561724 +0000 UTC m=+0.206276901 container died a5ea9706c7ce3cf4a76bb2d8f736abe3a2d4168dbdcc429de8e45c74e3128ac8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:20:11.708 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:11 smithi049 podman[154313]: 2024-09-19 09:20:11.566536333 +0000 UTC m=+0.631251574 container cleanup a5ea9706c7ce3cf4a76bb2d8f736abe3a2d4168dbdcc429de8e45c74e3128ac8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:20:11.709 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:11 smithi049 bash[154313]: ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049 2024-09-19T09:20:12.033 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Sep 19 09:20:11 smithi049 podman[154325]: 2024-09-19 09:20:11.793589192 +0000 UTC m=+0.651441575 container remove a5ea9706c7ce3cf4a76bb2d8f736abe3a2d4168dbdcc429de8e45c74e3128ac8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi049, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:20:12.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi049.service' 2024-09-19T09:20:12.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:12.099 INFO:tasks.cephadm.mon.smithi049:Stopped mon.smithi049 2024-09-19T09:20:12.100 INFO:tasks.cephadm.mon.smithi102:Stopping mon.smithi102... 2024-09-19T09:20:12.100 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi102 2024-09-19T09:20:12.390 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:12 smithi102 systemd[1]: Stopping Ceph mon.smithi102 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:12 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102[80871]: 2024-09-19T09:20:12.388+0000 7fef3d269640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi102 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:12 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102[80871]: 2024-09-19T09:20:12.388+0000 7fef3d269640 -1 mon.smithi102@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:20:12.759 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:12 smithi102 podman[121657]: 2024-09-19 09:20:12.460999132 +0000 UTC m=+0.164143370 container died 50b15ebe2a3eb8f2143f70ca5d5db10eec822534ae9625a2c79558f80d79a744 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T09:20:13.191 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:12 smithi102 podman[121657]: 2024-09-19 09:20:12.964952747 +0000 UTC m=+0.668097030 container cleanup 50b15ebe2a3eb8f2143f70ca5d5db10eec822534ae9625a2c79558f80d79a744 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:20:13.191 INFO:journalctl@ceph.mon.smithi102.smithi102.stdout:Sep 19 09:20:12 smithi102 bash[121657]: ceph-63845326-7664-11ef-bceb-c7b262605968-mon-smithi102 2024-09-19T09:20:13.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@mon.smithi102.service' 2024-09-19T09:20:13.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:13.398 INFO:tasks.cephadm.mon.smithi102:Stopped mon.smithi102 2024-09-19T09:20:13.398 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:20:13.399 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:20:13.722 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:13 smithi049 systemd[1]: Stopping Ceph osd.0 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:14.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:13 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[100527]: 2024-09-19T09:20:13.720+0000 7f6631168640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:14.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:13 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[100527]: 2024-09-19T09:20:13.720+0000 7f6631168640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-19T09:20:14.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:13 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0[100527]: 2024-09-19T09:20:13.720+0000 7f6631168640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:19.357 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:19 smithi049 podman[154446]: 2024-09-19 09:20:19.070408399 +0000 UTC m=+5.473984347 container died 530476c8de21d517666f63fe364a6d2a192e1e244ccab8b8e10d937011d87383 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:20:19.765 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:19 smithi049 podman[154446]: 2024-09-19 09:20:19.446622319 +0000 UTC m=+5.850198278 container cleanup 530476c8de21d517666f63fe364a6d2a192e1e244ccab8b8e10d937011d87383 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:19.765 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:19 smithi049 bash[154446]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:20:20.053 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:19 smithi049 podman[154461]: 2024-09-19 09:20:19.764850862 +0000 UTC m=+0.689742860 container remove 530476c8de21d517666f63fe364a6d2a192e1e244ccab8b8e10d937011d87383 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-19T09:20:20.544 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:20 smithi049 podman[154550]: 2024-09-19 09:20:20.030924909 +0000 UTC m=+0.016763412 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:20.544 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:20 smithi049 podman[154550]: 2024-09-19 09:20:20.132431606 +0000 UTC m=+0.118270108 container create e6d3d83b9ede9cdd3d1182433f83b39cc88c96d6765f6d9bc05ca3b09874805a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:20.544 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:20 smithi049 podman[154550]: 2024-09-19 09:20:20.54417021 +0000 UTC m=+0.530008715 container init e6d3d83b9ede9cdd3d1182433f83b39cc88c96d6765f6d9bc05ca3b09874805a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:20:20.803 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:20 smithi049 podman[154550]: 2024-09-19 09:20:20.548503743 +0000 UTC m=+0.534342256 container start e6d3d83b9ede9cdd3d1182433f83b39cc88c96d6765f6d9bc05ca3b09874805a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:20:20.803 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:20 smithi049 podman[154550]: 2024-09-19 09:20:20.618835327 +0000 UTC m=+0.604673837 container attach e6d3d83b9ede9cdd3d1182433f83b39cc88c96d6765f6d9bc05ca3b09874805a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:20:20.804 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 19 09:20:20 smithi049 podman[154550]: 2024-09-19 09:20:20.744779181 +0000 UTC m=+0.730617683 container died e6d3d83b9ede9cdd3d1182433f83b39cc88c96d6765f6d9bc05ca3b09874805a (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:20:21.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:20:21.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:21.362 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:20:21.362 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:20:21.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:20:21.553 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:21 smithi049 systemd[1]: Stopping Ceph osd.1 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:21.878 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:21 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[106359]: 2024-09-19T09:20:21.674+0000 7f758cd20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:21.879 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:21 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[106359]: 2024-09-19T09:20:21.674+0000 7f758cd20640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-19T09:20:21.879 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:21 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1[106359]: 2024-09-19T09:20:21.674+0000 7f758cd20640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:27.303 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:27 smithi049 podman[154654]: 2024-09-19 09:20:27.060181426 +0000 UTC m=+5.468013336 container died ae5cb4e6931bab57fbce6121f312c712494bb9598528629a50789f173d7b308f (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:20:27.736 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:27 smithi049 podman[154654]: 2024-09-19 09:20:27.475786831 +0000 UTC m=+5.883618739 container cleanup ae5cb4e6931bab57fbce6121f312c712494bb9598528629a50789f173d7b308f (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T09:20:27.736 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:27 smithi049 bash[154654]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:20:28.053 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:27 smithi049 podman[154680]: 2024-09-19 09:20:27.735626232 +0000 UTC m=+0.673130740 container remove ae5cb4e6931bab57fbce6121f312c712494bb9598528629a50789f173d7b308f (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:20:28.397 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:28 smithi049 podman[154769]: 2024-09-19 09:20:28.04974614 +0000 UTC m=+0.016611664 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:28.397 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:28 smithi049 podman[154769]: 2024-09-19 09:20:28.169975187 +0000 UTC m=+0.136840702 container create 0840a8a67fb8c80cede259147f947c95f02e34f61f7b037bd89740fca65fbd01 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:20:28.397 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:28 smithi049 podman[154769]: 2024-09-19 09:20:28.397517776 +0000 UTC m=+0.364383297 container init 0840a8a67fb8c80cede259147f947c95f02e34f61f7b037bd89740fca65fbd01 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:20:28.803 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:28 smithi049 podman[154769]: 2024-09-19 09:20:28.400984591 +0000 UTC m=+0.367850124 container start 0840a8a67fb8c80cede259147f947c95f02e34f61f7b037bd89740fca65fbd01 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T09:20:28.803 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:28 smithi049 podman[154769]: 2024-09-19 09:20:28.48075379 +0000 UTC m=+0.447619308 container attach 0840a8a67fb8c80cede259147f947c95f02e34f61f7b037bd89740fca65fbd01 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:20:28.803 INFO:journalctl@ceph.osd.1.smithi049.stdout:Sep 19 09:20:28 smithi049 podman[154769]: 2024-09-19 09:20:28.596023019 +0000 UTC m=+0.562888536 container died 0840a8a67fb8c80cede259147f947c95f02e34f61f7b037bd89740fca65fbd01 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:20:29.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:20:29.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:29.214 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:20:29.214 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:20:29.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:20:29.547 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:29 smithi049 systemd[1]: Stopping Ceph osd.2 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:29.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:29 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[112180]: 2024-09-19T09:20:29.545+0000 7f2e84f50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:29.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:29 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[112180]: 2024-09-19T09:20:29.545+0000 7f2e84f50640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-19T09:20:29.803 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:29 smithi049 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2[112180]: 2024-09-19T09:20:29.545+0000 7f2e84f50640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:35.297 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:34 smithi049 podman[154871]: 2024-09-19 09:20:34.99830355 +0000 UTC m=+5.543846704 container died 72e20f7003f6100cafaa8740ed7736b7dd934374c2c85c0a94773475f8b012ec (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:20:35.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:35 smithi049 podman[154871]: 2024-09-19 09:20:35.378386663 +0000 UTC m=+5.923929806 container cleanup 72e20f7003f6100cafaa8740ed7736b7dd934374c2c85c0a94773475f8b012ec (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:20:35.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:35 smithi049 bash[154871]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:20:35.989 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:35 smithi049 podman[154886]: 2024-09-19 09:20:35.554763512 +0000 UTC m=+0.553500016 container remove 72e20f7003f6100cafaa8740ed7736b7dd934374c2c85c0a94773475f8b012ec (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:20:36.278 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:35 smithi049 podman[154975]: 2024-09-19 09:20:35.891875798 +0000 UTC m=+0.016473383 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:36.278 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:35 smithi049 podman[154975]: 2024-09-19 09:20:35.997215263 +0000 UTC m=+0.121812836 container create 081382d6617d062fc631e6fdde864be5b985e3b884a3c023b7c0f2bd112802df (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:20:36.278 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:36 smithi049 podman[154975]: 2024-09-19 09:20:36.278127118 +0000 UTC m=+0.402724689 container init 081382d6617d062fc631e6fdde864be5b985e3b884a3c023b7c0f2bd112802df (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:20:36.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:36 smithi049 podman[154975]: 2024-09-19 09:20:36.281630119 +0000 UTC m=+0.406227693 container start 081382d6617d062fc631e6fdde864be5b985e3b884a3c023b7c0f2bd112802df (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:20:36.553 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:36 smithi049 podman[154975]: 2024-09-19 09:20:36.358345918 +0000 UTC m=+0.482943490 container attach 081382d6617d062fc631e6fdde864be5b985e3b884a3c023b7c0f2bd112802df (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:20:36.554 INFO:journalctl@ceph.osd.2.smithi049.stdout:Sep 19 09:20:36 smithi049 podman[154975]: 2024-09-19 09:20:36.473771117 +0000 UTC m=+0.598368696 container died 081382d6617d062fc631e6fdde864be5b985e3b884a3c023b7c0f2bd112802df (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:37.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:20:37.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:37.339 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:20:37.339 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:20:37.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:20:37.753 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:37 smithi102 systemd[1]: Stopping Ceph osd.3 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:38.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:37 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:20:37.752+0000 7fcdc37b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:38.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:37 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:20:37.752+0000 7fcdc37b6640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-19T09:20:38.009 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:37 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:20:37.752+0000 7fcdc37b6640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:40.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:40 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:40.098+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:41.458 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:41 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:41.054+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:41.759 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:41 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:20:41.456+0000 7fcdbfdbb640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:17.164350+0000 front 2024-09-19T09:20:17.164301+0000 (oldest deadline 2024-09-19T09:20:40.664216+0000) 2024-09-19T09:20:42.490 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:42 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:42.024+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:42.759 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:42 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3[89998]: 2024-09-19T09:20:42.489+0000 7fcdbfdbb640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:17.164350+0000 front 2024-09-19T09:20:17.164301+0000 (oldest deadline 2024-09-19T09:20:40.664216+0000) 2024-09-19T09:20:42.760 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:42 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:42.605+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:43.354 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:43 smithi102 podman[121794]: 2024-09-19 09:20:43.081268202 +0000 UTC m=+5.539178054 container died a484137c7424b78b8c8876608f73ac3c54d115845d245ce99d0704b6abad70cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:20:43.354 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:43.012+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:43.720 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:43.558+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:43.721 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:43 smithi102 podman[121794]: 2024-09-19 09:20:43.452137622 +0000 UTC m=+5.910047473 container cleanup a484137c7424b78b8c8876608f73ac3c54d115845d245ce99d0704b6abad70cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:20:43.721 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:43 smithi102 bash[121794]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:20:43.977 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:43 smithi102 podman[121809]: 2024-09-19 09:20:43.720115739 +0000 UTC m=+0.632684266 container remove a484137c7424b78b8c8876608f73ac3c54d115845d245ce99d0704b6abad70cf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:20:44.232 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:43 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:43.976+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:44.232 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:44 smithi102 podman[121899]: 2024-09-19 09:20:43.966885427 +0000 UTC m=+0.015937043 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:44.233 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:44 smithi102 podman[121899]: 2024-09-19 09:20:44.08774291 +0000 UTC m=+0.136794512 container create ebe741afe70f4f26f99470a2cc4fa12f9723b6c1911124070b3fcc91ba2627bd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T09:20:44.503 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:44 smithi102 podman[121899]: 2024-09-19 09:20:44.315571726 +0000 UTC m=+0.364623328 container init ebe741afe70f4f26f99470a2cc4fa12f9723b6c1911124070b3fcc91ba2627bd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T09:20:44.503 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:44 smithi102 podman[121899]: 2024-09-19 09:20:44.318989744 +0000 UTC m=+0.368041357 container start ebe741afe70f4f26f99470a2cc4fa12f9723b6c1911124070b3fcc91ba2627bd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:44.503 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:44 smithi102 podman[121899]: 2024-09-19 09:20:44.399096153 +0000 UTC m=+0.448147771 container attach ebe741afe70f4f26f99470a2cc4fa12f9723b6c1911124070b3fcc91ba2627bd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T09:20:44.761 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:44 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:44.568+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:44.761 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 19 09:20:44 smithi102 podman[121899]: 2024-09-19 09:20:44.5036476 +0000 UTC m=+0.552699215 container died ebe741afe70f4f26f99470a2cc4fa12f9723b6c1911124070b3fcc91ba2627bd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:20:45.095 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:44 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:44.978+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:45.116 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:20:45.156 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:45.157 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:20:45.157 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:20:45.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:20:45.372 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:45 smithi102 systemd[1]: Stopping Ceph osd.4 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:45.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:45 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:45.506+0000 7f6c75209640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:45.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:45 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:45.506+0000 7f6c75209640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-19T09:20:45.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:45 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:45.506+0000 7f6c75209640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:45.760 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:45 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:45.560+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:46.259 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:45 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:45.967+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:46.975 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:46 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:46.578+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:47.259 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:46 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:46.974+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:48.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:47 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:47.579+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:48.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:48.014+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:49.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:48.558+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:49.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:48 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:48.558+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:49.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:49 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:49.031+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:50.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:49 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:49.526+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:50.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:49 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:49.526+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:50.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:50 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:50.011+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:18.146421+0000 front 2024-09-19T09:20:18.146191+0000 (oldest deadline 2024-09-19T09:20:39.846055+0000) 2024-09-19T09:20:50.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:50 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4[95308]: 2024-09-19T09:20:50.011+0000 7f6c6d806640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.247280+0000 front 2024-09-19T09:20:26.247336+0000 (oldest deadline 2024-09-19T09:20:49.147310+0000) 2024-09-19T09:20:50.875 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:50 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:50.521+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:50.875 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:50 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:50.521+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:51.132 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:50 smithi102 podman[122003]: 2024-09-19 09:20:50.874659037 +0000 UTC m=+5.488189153 container died c3556b69168eda713e12605b80dbebd6f40a49f9e4870f35b444a6a604f67063 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:20:51.466 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:51 smithi102 podman[122003]: 2024-09-19 09:20:51.231595581 +0000 UTC m=+5.845125678 container cleanup c3556b69168eda713e12605b80dbebd6f40a49f9e4870f35b444a6a604f67063 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:20:51.467 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:51 smithi102 bash[122003]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:20:51.759 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:51 smithi102 podman[122029]: 2024-09-19 09:20:51.466291244 +0000 UTC m=+0.587491256 container remove c3556b69168eda713e12605b80dbebd6f40a49f9e4870f35b444a6a604f67063 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:20:51.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:51 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:51.504+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:51.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:51 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:51.504+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:52.137 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:51 smithi102 podman[122117]: 2024-09-19 09:20:51.69369948 +0000 UTC m=+0.015569889 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:52.137 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:51 smithi102 podman[122117]: 2024-09-19 09:20:51.792073276 +0000 UTC m=+0.113943670 container create 30ec10d4daf8055dbf9ec4a8e6670d85cf6a7eae4c7c2a16cda0f38edf9f8d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:20:52.137 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:52 smithi102 podman[122117]: 2024-09-19 09:20:52.036469411 +0000 UTC m=+0.358339812 container init 30ec10d4daf8055dbf9ec4a8e6670d85cf6a7eae4c7c2a16cda0f38edf9f8d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T09:20:52.138 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:52 smithi102 podman[122117]: 2024-09-19 09:20:52.040323905 +0000 UTC m=+0.362194300 container start 30ec10d4daf8055dbf9ec4a8e6670d85cf6a7eae4c7c2a16cda0f38edf9f8d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:20:52.138 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:52 smithi102 podman[122117]: 2024-09-19 09:20:52.136381141 +0000 UTC m=+0.458251548 container attach 30ec10d4daf8055dbf9ec4a8e6670d85cf6a7eae4c7c2a16cda0f38edf9f8d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:20:52.509 INFO:journalctl@ceph.osd.4.smithi102.stdout:Sep 19 09:20:52 smithi102 podman[122117]: 2024-09-19 09:20:52.229687068 +0000 UTC m=+0.551557474 container died 30ec10d4daf8055dbf9ec4a8e6670d85cf6a7eae4c7c2a16cda0f38edf9f8d78 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T09:20:52.840 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:52 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:52.551+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:52.840 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:52 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:52.551+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:52.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:20:52.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:20:52.900 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:20:52.900 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:20:52.900 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-63845326-7664-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:20:53.219 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:52 smithi102 systemd[1]: Stopping Ceph osd.5 for 63845326-7664-11ef-bceb-c7b262605968... 2024-09-19T09:20:53.509 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:53.218+0000 7efd7456f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:20:53.509 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:53.218+0000 7efd7456f640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-19T09:20:53.509 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:53.218+0000 7efd7456f640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:20:54.010 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:53.527+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:54.010 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:53 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:53.527+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:54.759 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:54 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:54.484+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:54.760 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:54 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:54.484+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:56.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:55 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:55.521+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:56.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:55 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:55.521+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:57.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:56 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:56.553+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:57.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:56 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:56.553+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:58.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:57 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:57.536+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-19T09:20:16.660906+0000 front 2024-09-19T09:20:16.661069+0000 (oldest deadline 2024-09-19T09:20:42.560921+0000) 2024-09-19T09:20:58.009 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:57 smithi102 ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5[100654]: 2024-09-19T09:20:57.536+0000 7efd70b74640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-09-19T09:20:26.562348+0000 front 2024-09-19T09:20:26.562403+0000 (oldest deadline 2024-09-19T09:20:48.262284+0000) 2024-09-19T09:20:58.937 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:58 smithi102 podman[122221]: 2024-09-19 09:20:58.661868411 +0000 UTC m=+5.538561496 container died 42836962daf2b8e3d9609b1bbc506e796bf9ea2a7eda8d19e796f948ac956f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T09:20:59.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 podman[122221]: 2024-09-19 09:20:59.009715835 +0000 UTC m=+5.886408919 container cleanup 42836962daf2b8e3d9609b1bbc506e796bf9ea2a7eda8d19e796f948ac956f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:20:59.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 bash[122221]: ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:20:59.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 podman[122238]: 2024-09-19 09:20:59.185887139 +0000 UTC m=+0.518121927 container remove 42836962daf2b8e3d9609b1bbc506e796bf9ea2a7eda8d19e796f948ac956f10 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:20:59.906 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 podman[122330]: 2024-09-19 09:20:59.619901921 +0000 UTC m=+0.110791007 container create 1c6b8525a0248c94da75a0242b331f84a6d72cd5dad2e37ffcad718e892b9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:20:59.906 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 podman[122330]: 2024-09-19 09:20:59.524916797 +0000 UTC m=+0.015805895 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:20:59.906 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 podman[122330]: 2024-09-19 09:20:59.83123229 +0000 UTC m=+0.322121384 container init 1c6b8525a0248c94da75a0242b331f84a6d72cd5dad2e37ffcad718e892b9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:20:59.906 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 podman[122330]: 2024-09-19 09:20:59.834753862 +0000 UTC m=+0.325642947 container start 1c6b8525a0248c94da75a0242b331f84a6d72cd5dad2e37ffcad718e892b9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:20:59.906 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:20:59 smithi102 podman[122330]: 2024-09-19 09:20:59.905860335 +0000 UTC m=+0.396749429 container attach 1c6b8525a0248c94da75a0242b331f84a6d72cd5dad2e37ffcad718e892b9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:21:00.259 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 09:21:00 smithi102 podman[122330]: 2024-09-19 09:21:00.016076081 +0000 UTC m=+0.506965166 container died 1c6b8525a0248c94da75a0242b331f84a6d72cd5dad2e37ffcad718e892b9773 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-63845326-7664-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:21:00.591 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63845326-7664-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:21:00.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:21:00.631 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:21:00.631 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63845326-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:21:00.792 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:21:05.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[75896]: fuse finished with error 0 and tester_r 0 2024-09-19T09:21:26.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63845326-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:21:26.835 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:21:40.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:21:40.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:21:40.852 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:21:40.858 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875/remote/smithi049/crash 2024-09-19T09:21:40.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:21:40.893 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:21:40.893 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:21:40.895 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875/remote/smithi102/crash 2024-09-19T09:21:40.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:21:40.920 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/63845326-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:21:40.920 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:21:40.921 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:21:40.922 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T09:21:40.971 INFO:teuthology.orchestra.run.smithi049.stdout:2024-09-19T09:00:00.000283+0000 mon.smithi049 (mon.0) 762 : cluster [WRN] fs cephfs is degraded 2024-09-19T09:21:40.971 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T09:21:40.972 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:21:40.972 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:21:41.014 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:21:41.038 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:21:41.038 INFO:teuthology.orchestra.run.smithi049.stderr:: No such file or directory 2024-09-19T09:21:41.038 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi049.log 2024-09-19T09:21:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mgr.smithi049.qdvksw.log 2024-09-19T09:21:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi049.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:21:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mgr.smithi049.qdvksw.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:21:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:21:41.041 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi049.ibssbl.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:: No such file or directory 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi102.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi102.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi102.snrasw.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi102.snrasw.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi102.ojquyx.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:21:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi102.ojquyx.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:21:41.044 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:21:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.5.log: 94.1% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi102.log.gz 2024-09-19T09:21:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mon.smithi102.log 2024-09-19T09:21:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mgr.smithi102.csalqv.log 2024-09-19T09:21:41.045 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi049.uujbrc.log 2024-09-19T09:21:41.045 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi049.ibssbl.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:21:41.045 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi049.log.gz 2024-09-19T09:21:41.045 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi049.uujbrc.log: gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:21:41.045 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.6% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:21:41.045 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:21:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mon.smithi102.log: 91.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:21:41.046 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:21:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:21:41.047 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mgr.smithi102.csalqv.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-19T09:21:41.047 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.7% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:21:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:21:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.log: 91.1% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:21:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mon.smithi049.log 2024-09-19T09:21:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.log: 88.6% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:21:41.062 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T09:21:41.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:21:41.065 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mon.smithi049.log: 91.1% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:21:41.068 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:21:41.101 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mgr.smithi102.csalqv.log.gz 2024-09-19T09:21:41.128 INFO:teuthology.orchestra.run.smithi102.stderr: 94.6% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi102.ojquyx.log.gz 2024-09-19T09:21:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 90.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:21:41.372 INFO:teuthology.orchestra.run.smithi102.stderr: 92.5% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mon.smithi102.log.gz 2024-09-19T09:21:41.472 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mgr.smithi049.qdvksw.log.gz 2024-09-19T09:21:42.085 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mon.smithi049.log.gz 2024-09-19T09:21:44.503 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:21:45.786 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:21:46.245 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:21:46.946 INFO:teuthology.orchestra.run.smithi049.stderr: 93.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:21:46.953 INFO:teuthology.orchestra.run.smithi102.stderr: 94.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi102.snrasw.log.gz 2024-09-19T09:21:47.206 INFO:teuthology.orchestra.run.smithi049.stderr: 93.7% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:21:47.633 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:21:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-19T09:21:56.085 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-19T09:21:56.086 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-19T09:21:56.087 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m15.058s 2024-09-19T09:21:56.087 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m35.116s 2024-09-19T09:21:56.087 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m1.082s 2024-09-19T09:21:56.494 INFO:teuthology.orchestra.run.smithi049.stderr: 94.8% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi049.ibssbl.log.gz 2024-09-19T09:21:57.964 INFO:teuthology.orchestra.run.smithi049.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T09:23:14.172 INFO:teuthology.orchestra.run.smithi049.stderr: 92.7% -- replaced with /var/log/ceph/63845326-7664-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi049.uujbrc.log.gz 2024-09-19T09:23:14.174 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-09-19T09:23:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:real 1m33.146s 2024-09-19T09:23:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:user 2m19.974s 2024-09-19T09:23:14.174 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m4.025s 2024-09-19T09:23:14.175 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:23:14.175 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875/remote/smithi049/log 2024-09-19T09:23:14.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:23:33.428 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875/remote/smithi102/log 2024-09-19T09:23:33.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:23:38.807 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:23:38.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63845326-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:23:38.969 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:23:39.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63845326-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:23:39.537 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 63845326-7664-11ef-bceb-c7b262605968 2024-09-19T09:23:39.822 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:23:39.822 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:23:39.840 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:23:39.855 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:23:39.856 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:23:39.867 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T09:23:39.868 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:23:39.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:23:39.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:23:39.972 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:23:39.984 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:23:39.984 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:23:39.987 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:23:40.000 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:23:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:23:40.004 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:23:40.004 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-19T09:23:40.004 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv01.front.sepia.ceph.com 3 8 377 172 +1154us[+1304us] +/- 59ms 2024-09-19T09:23:40.004 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 -2472us[-2472us] +/- 66ms 2024-09-19T09:23:40.004 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +1402us[+1402us] +/- 84ms 2024-09-19T09:23:40.004 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:23:40.006 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:23:40.006 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-19T09:23:40.006 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 +1263us[+1250us] +/- 61ms 2024-09-19T09:23:40.006 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -2292us[-2305us] +/- 66ms 2024-09-19T09:23:40.006 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +1571us[+1557us] +/- 84ms 2024-09-19T09:23:40.006 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:23:40.006 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:23:40.018 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:23:40.018 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:23:40.048 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:23:40.134 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:23:40.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:23:40.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:40.239 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:23:40.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:40.268 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:23:40.279 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:23:40.306 INFO:teuthology.task.internal:Duration was 2282.963039 seconds 2024-09-19T09:23:40.307 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:23:40.339 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:23:40.340 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:23:40.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:23:40.380 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:23:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:23:40.600 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:23:40.600 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-09-19T09:23:40.600 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:23:40.662 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T09:23:40.663 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:23:40.687 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:23:40.687 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:23:40.706 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:23:40.753 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:23:40.753 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:23:40.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:23:41.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:23:41.509 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:23:41.509 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:23:41.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:23:41.562 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:23:41.574 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:23:41.578 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:23:41.600 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-09-19T09:23:41.626 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-19T09:23:41.675 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:23:41.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:41.690 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:23:41.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:41.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:23:41.742 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:23:41.743 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875/remote/smithi049 2024-09-19T09:23:41.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:23:41.795 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911875/remote/smithi102 2024-09-19T09:23:41.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:23:41.833 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:23:41.833 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:23:41.836 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:23:41.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:23:41.895 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:23:41.896 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:23:41.934 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:23:41.934 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:23:41.937 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:23:41.950 INFO:teuthology.orchestra.run.smithi049.stdout: 262169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 19 09:23 /home/ubuntu/cephtest 2024-09-19T09:23:41.950 INFO:teuthology.orchestra.run.smithi049.stdout: 292799 4 d--------- 2 ubuntu ubuntu 4096 Sep 19 09:00 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:23:41.950 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-19T09:23:41.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:23:41.952 INFO:teuthology.orchestra.run.smithi049.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-19T09:23:41.952 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi049 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-19T09:23:41.953 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:23:41.965 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:23:42.000 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T09:23:42.003 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2282.9630393981934 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-19T09:23:42.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:23:42.093 INFO:teuthology.run:FAIL